“Humans and machine algorithms have complementary strengths and weaknesses,” says study co-author Mark Steyvers (right), UCI professor of cognitive sciences, here with fellow co-author Padhraic Smyth, UCI Chancellor’s Professor of computer science.
“Each uses different sources of information and strategies to make predictions and decisions.” Steve Zylius / UCI
From chatbots that answer tax questions to algorithms that drive autonomous vehicles and dish out medical diagnoses, artificial intelligence undergirds many aspects of daily life. Creating smarter, more accurate systems requires a hybrid human-machine approach, according to researchers at the University of California, Irvine. In a study published this month in Proceedings of the National Academy of Sciences, they present a new mathematical model that can improve performance by combining human and algorithmic predictions and confidence scores.
“Humans and machine algorithms have complementary strengths and weaknesses. Each uses different sources of information and strategies to make predictions and decisions,” said co-author Mark Steyvers, UCI professor of cognitive sciences. “We show through empirical demonstrations as well as theoretical analyses that humans can improve the predictions of AI even when human accuracy is somewhat below [that of] the AI – and vice versa. And this accuracy is higher than combining predictions from two individuals or two AI algorithms.”
To test the framework, researchers conducted an image classification experiment in which human participants and computer algorithms worked separately to correctly identify distorted pictures of animals and everyday items – chairs, bottles, bicycles, trucks. The human participants ranked their confidence in the accuracy of each image identification as low, medium or high, while the machine classifier generated a continuous score. The results showed large differences in confidence between humans and AI algorithms across images.
“In some cases, human participants were quite confident that a particular picture contained a chair, for example, while the AI algorithm was confused about the image,” said co-author Padhraic Smyth, UCI Chancellor’s Professor of computer science. “Similarly, for other images, the AI algorithm was able to confidently provide a label for the object shown, while human participants were unsure if the distorted picture contained any recognizable object.”
When predictions and confidence scores from both were combined using the researchers’ new Bayesian framework, the hybrid model led to better performance than either human or machine predictions achieved alone.
“While past research has demonstrated the benefits of combining machine predictions or combining human predictions – the so-called ‘wisdom of the crowds’ – this work forges a new direction in demonstrating the potential of combining human and machine predictions, pointing to new and improved approaches to human-AI collaboration,” Smyth said.
This interdisciplinary project was facilitated by the Irvine Initiative in AI, Law, and Society. The convergence of cognitive sciences – which are focused on understanding how humans think and behave – with computer science – in which technologies are produced – will provide further insight into how humans and machines can collaborate to build more accurate artificially intelligent systems, the researchers said.
More from: University of California Irvine
The Latest on: Human-AI collaboration
- VIQ Solutions and Law In Order Transform Court Cases Creating Efficiencies and Bolstering Collaborationon August 7, 2022 at 3:00 pm
VIQ Solutions Inc. ("VIQ" or "VIQ Solutions") (TSX and Nasdaq: VQS), a global provider of secure, AI-driven, digital voice and video capture technology and transcription services, today announced its ...
- Event Summary | Lessons from Europe: Deployment of Artificial Intelligence in the Public Sphereon August 4, 2022 at 9:29 am
The application of AI has been largely a private sector phenomenon. The public sector has advanced regulatory questions, especially in Europe, but struggled to find its own role in how to use AI to ...
- $4.8M collaborative biometrics project enables AI algorithms to detect fatigueon August 3, 2022 at 5:00 pm
Texas A&M University and Arizona State University (ASU) are collaborating on a $4.8 million multidisciplinary project funded by the Defense Advanced Research Projects Agency’s (DARPA) Biological ...
- Hong Kong Baptist University at the forefront of human-AI symbiotic art creation with innovative performanceon August 2, 2022 at 6:00 am
HONG KONG SAR - Media OutReach - 2 August 2022 - A pioneering and bold attempt to apply artificial intelligence (AI) technologies in the performing arts was carried out by Hong Kong Baptist ...
- The Future Of Work: More Hybrid, More Collaborative, More Automatedon July 31, 2022 at 6:45 pm
As companies pursue digital transformation — investing in new ways to collaborate, using AI to improve sales and marketing, and choose which channels were most effective for reaching their customers.
- Israeli tech leader launches new human health collaborationon July 28, 2022 at 8:55 am
If thinking you’re sick can make you feel sick, is there a way to train your brain — and your body — to reverse that process and restore you to health? That’s the central question that Tamar Koren, an ...
- VistaPath Launches New Collaboration with Gestalt Diagnostics to Further Accelerate Pathology Digitizationon July 28, 2022 at 7:04 am
VistaPath, the leading provider of artificial intelligence (AI)-based, data-driven pathology processing platforms, today announced a new collaboration with Gestalt Diagnostics of Spokane, WA, to ...
- AI performs as well as medical specialists in analyzing lung diseaseon July 28, 2022 at 6:23 am
A Nagoya University research group has developed an AI algorithm that accurately and quickly diagnoses idiopathic pulmonary fibrosis, a lung disease. The algorithm makes its diagnosis based only on ...
- Israeli tech leader launches new human health collaboration to solve urgent real-world problemson July 27, 2022 at 1:51 pm
A new effort is underway to bring together teaching hospitals, different departments at Israel's leading tech university, and commercial companies to focus on solving specific health-related ...
- Seeing the light: Researchers develop new AI system using light to learn associativelyon July 26, 2022 at 11:14 am
Researchers at Oxford University's Department of Materials, working in collaboration with colleagues from Exeter and Munster, have developed an on-chip optical processor capable of detecting ...
via Bing News
The Latest on: Human-AI collaboration
via Google News