“Humans and machine algorithms have complementary strengths and weaknesses,” says study co-author Mark Steyvers (right), UCI professor of cognitive sciences, here with fellow co-author Padhraic Smyth, UCI Chancellor’s Professor of computer science.
“Each uses different sources of information and strategies to make predictions and decisions.” Steve Zylius / UCI
From chatbots that answer tax questions to algorithms that drive autonomous vehicles and dish out medical diagnoses, artificial intelligence undergirds many aspects of daily life. Creating smarter, more accurate systems requires a hybrid human-machine approach, according to researchers at the University of California, Irvine. In a study published this month in Proceedings of the National Academy of Sciences, they present a new mathematical model that can improve performance by combining human and algorithmic predictions and confidence scores.
“Humans and machine algorithms have complementary strengths and weaknesses. Each uses different sources of information and strategies to make predictions and decisions,” said co-author Mark Steyvers, UCI professor of cognitive sciences. “We show through empirical demonstrations as well as theoretical analyses that humans can improve the predictions of AI even when human accuracy is somewhat below [that of] the AI – and vice versa. And this accuracy is higher than combining predictions from two individuals or two AI algorithms.”
To test the framework, researchers conducted an image classification experiment in which human participants and computer algorithms worked separately to correctly identify distorted pictures of animals and everyday items – chairs, bottles, bicycles, trucks. The human participants ranked their confidence in the accuracy of each image identification as low, medium or high, while the machine classifier generated a continuous score. The results showed large differences in confidence between humans and AI algorithms across images.
“In some cases, human participants were quite confident that a particular picture contained a chair, for example, while the AI algorithm was confused about the image,” said co-author Padhraic Smyth, UCI Chancellor’s Professor of computer science. “Similarly, for other images, the AI algorithm was able to confidently provide a label for the object shown, while human participants were unsure if the distorted picture contained any recognizable object.”
When predictions and confidence scores from both were combined using the researchers’ new Bayesian framework, the hybrid model led to better performance than either human or machine predictions achieved alone.
“While past research has demonstrated the benefits of combining machine predictions or combining human predictions – the so-called ‘wisdom of the crowds’ – this work forges a new direction in demonstrating the potential of combining human and machine predictions, pointing to new and improved approaches to human-AI collaboration,” Smyth said.
This interdisciplinary project was facilitated by the Irvine Initiative in AI, Law, and Society. The convergence of cognitive sciences – which are focused on understanding how humans think and behave – with computer science – in which technologies are produced – will provide further insight into how humans and machines can collaborate to build more accurate artificially intelligent systems, the researchers said.
More from: University of California Irvine
The Latest on: Human-AI collaboration
- Singapore, South Korea sign MoU on artificial intelligenceon December 6, 2022 at 8:52 pm
Singapore and South Korea are set to collaborate closely on artificial intelligence (AI) and promote the responsible use of the emerging technology, in a move that will deepen the two countries’ ...
- Accenture and Planet to Collaborate on AI-Powered Geospatial Intelligence Tools for Sustainability, Traceable Supply Chain and Climate Risk Solutionson December 6, 2022 at 11:24 am
Accenture (NYSE: ACN), through its Accenture Ventures Project Spotlight initiative, has entered into a collaboration agreement with Planet Labs PBC (NYSE: PL), a leading provider of daily data and ...
- Owkin open sources biotech AI bundleon December 4, 2022 at 7:32 pm
Owkin is open sourcing Substra, its Federated Learning (FL) software, to allow researchers and developers to collaboratively train ML models without the data leaving its source. T ...
- Harnessing the Power of AI and Transforming the Human Enterprise Experienceon December 1, 2022 at 5:59 am
Together, humans and Artificial Intelligence (AI) are bringing about dynamic developments. Three key characteristics ...
- Actuaries highlight need for ethical use of AI in insuranceon December 1, 2022 at 12:00 am
While artificial intelligence (AI) promises faster and smarter decision making, the Actuaries Institute and the Australian Human Rights Commission (AHRC) ...
- Clearview scandal exposes limits of transatlantic AI collaborationon November 29, 2022 at 10:14 pm
European lawmakers believe the U.S. has to align its rules with Europe's if AI collaboration is to happen ... which is an often-used euphemism for human rights. It needs to stick to that." ...
- 15 things AI can — and can't — doon November 29, 2022 at 12:30 pm
From pop star robots to autonomous cars, AI is all around us. Stacker assessed the current state of AI, from predictive models to learning algorithms, and identified the capabilities and limitations ...
- A.R. Rahman, Shekhar Kapur Talk Metaverse, VR and AI Collaboration at Goa Festivalon November 27, 2022 at 8:09 pm
Machines can never replace human creativity and technology should ... Mistry envisaged a future powered by VR, AR and AI where the audience participated in an MCU movie and solved world problems.
via Bing News
The Latest on: Human-AI collaboration
[google_news title=”” keyword=”human-AI collaboration” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News