A recent study by the Computer Science Department at Swansea University has examined how humans and artificial intelligence (AI) can work together in creative design tasks. The research involved over 800 participants who used an AI-powered system to design virtual cars online.
The system differed from many existing AI tools by using a method called MAP-Elites, which generated a wide variety of visual design options. These included not only high-performing car designs but also unusual and intentionally imperfect examples.
Dr Sean Walton, Turing Fellow and Associate Professor of Computer Science at Swansea University, led the study. He said: “People often think of AI as something that speeds up tasks or improves efficiency, but our findings suggest something far more interesting. When people were shown AI-generated design suggestions, they spent more time on the task, produced better designs and felt more involved. It was not just about efficiency. It was about creativity and collaboration.”
The research, published in the ACM journal Transactions on Interactive Intelligent Systems, suggests that traditional ways of evaluating AI tools—such as measuring how often users click or copy suggestions—may not fully capture their impact. The Swansea team recommends broader evaluation methods that take into account emotional and cognitive engagement as well as user behavior.
Dr Walton emphasized the value of diversity in AI-generated ideas: “Our study highlights the importance of diversity in AI output. Participants responded most positively to galleries that included a wide variety of ideas, including bad ones! These helped them move beyond their initial assumptions and explore a broader design space. This structured diversity prevented early fixation and encouraged creative risk-taking.
“As AI becomes increasingly embedded in creative fields, from engineering and architecture to music and game design, understanding how humans and intelligent systems work together is essential. As the technology evolves, the question is not only what AI can do but how it can help us think, create and collaborate more effectively.”
The full paper is available under the title "From Metrics to Meaning: Time to Rethink Evaluation in Human–AI Collaborative Design."