Close Menu
Beverly Hills Examiner

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    Protons Lumo, a privacy-focused alternative to ChatGPT and Claude, arrives on desktop | TechCrunch

    November 17, 2026

    Man arrested after allegedly saying he had a bomb on a flight bound for New Orleans

    November 17, 2026

    Taylor Swifts Song of the Year Grammy Quip Was Likely No Accident

    November 17, 2026
    Facebook X (Twitter) Instagram
    Beverly Hills Examiner
    • Home
    • US News
    • Politics
    • Business
    • Science
    • Technology
    • Lifestyle
    • Music
    • Television
    • Film
    • Books
    • Contact
      • About
      • Amazon Disclaimer
      • DMCA / Copyrights Disclaimer
      • Terms and Conditions
      • Privacy Policy
    Beverly Hills Examiner
    Home»Science»AI chatbots miss urgent issues in queries about women’s health
    Science

    AI chatbots miss urgent issues in queries about women’s health

    By AdminJanuary 7, 2026
    Facebook Twitter Pinterest LinkedIn WhatsApp Email Reddit Telegram
    AI chatbots miss urgent issues in queries about women’s health

    [ad_1]

    AI chatbots miss urgent issues in queries about women’s health

    Many women are using AI for health information, but the answers aren’t always up to scratch

    Oscar Wong/Getty Images

    Commonly used AI models fail to accurately diagnose or offer advice for many queries relating to women’s health that require urgent attention.

    Thirteen large language models, produced by the likes of OpenAI, Google, Anthropic, Mistral AI and xAI, were given 345 medical queries across five specialities, including emergency medicine, gynaecology and neurology. The queries were written by 17 women’s health researchers, pharmacists and clinicians from the US and Europe.

    The answers were reviewed by the same experts. Any questions that the models failed at were collated into a benchmarking test of AI models’ medical expertise that included 96 queries.

    Across all the models, some 60 per cent of questions were answered in a way that the human experts had previously said wasn’t sufficient for medical advice. GPT-5 was the best-performing model, failing on 47 per cent of queries, while Ministral 8B had the highest failure rate of 73 per cent.

    “I saw more and more women in my own circle turning to AI tools for health questions and decision support,” says team member Victoria-Elisabeth Gruber at Lumos AI, a firm that helps companies evaluate and improve their own AI models. She and her colleagues recognised the risks of relying on a technology that inherits and amplifies existing gender gaps in medical knowledge. “That is what motivated us to build a first benchmark in this field,” she says.

    The rate of failure surprised Gruber. “We expected some gaps, but what stood out was the degree of variation across models,” she says.

    The findings are unsurprising because of the way AI models are trained, based in human-generated historical data that has built-in biases, says Cara Tannenbaum at the University of Montreal, Canada. They point to “a clear need for online health sources, as well as healthcare professional societies, to update their web content with more explicit sex and gender-related evidence-based information that AI can use to more accurately support women’s health”, she says.

    Jonathan H. Chen at Stanford University in California says 60 per cent failure rate touted by the researchers behind the analysis is somewhat misleading. “I wouldn’t hang on the 60 per cent number, since it was a limited and expert-designed sample,” he says. “[It] wasn’t designed to be a broad sample or representative of what patients or doctors regularly would ask.”

    Chen also points out that some of the scenarios that the model tests for are overly conservative, with high potential failure rates. For example, if postpartum women complain of a headache, the model suggests AI models fail if pre-eclampsia isn’t immediately suspected.

    Gruber acknowledges and recognises those criticisms. “Our goal was not to claim that models are broadly unsafe, but to define a clear, clinically grounded standard for evaluation,” she says. “The benchmark is intentionally conservative and on the stricter side in how it defines failures, because in healthcare, even seemingly minor omissions can matter depending on context.”

    A spokesperson for OpenAI said: “ChatGPT is designed to support, not replace, medical care. We work closely with clinicians around the world to improve our models and run ongoing evaluations to reduce harmful or misleading responses. Our latest GPT 5.2 model is our strongest yet at considering important user context such as gender. We take the accuracy of model outputs seriously and while ChatGPT can provide helpful information, users should always rely on qualified clinicians for care and treatment decisions.” The other companies whose AIs were tested did not respond to New Scientist’s request for comment.

    Topics:

    [ad_2]

    Original Source Link

    Share. Facebook Twitter Pinterest LinkedIn WhatsApp Email Reddit Telegram
    Previous ArticleNew Vegas Remaster Now Looks More Likely Than Ever
    Next Article New Records Reveal the Mess RFK Jr. Left When He Dumped a Dead Bear in Central Park

    RELATED POSTS

    Heres What We Know About the X-70 Fractal, NASAs Experimental New Plane

    November 10, 2026

    Scientists May Have Discovered a Massive Starless Galaxy

    November 9, 2026

    These Robotic Arms Are Powered by Algae. Watch How They Move

    November 9, 2026

    A 55-Year-Old Math Problem Was Solved—This Time by Humans

    November 8, 2026

    The American Dream Wasnt Built for Climate Change

    November 7, 2026

    The Cybertrucks Death Is Actually Great News for EVs

    November 6, 2026
    latest posts

    Protons Lumo, a privacy-focused alternative to ChatGPT and Claude, arrives on desktop | TechCrunch

    Proton, the privacy-focused tech company offering alternatives to Google and Microsoft’s tools for email, productivity…

    Man arrested after allegedly saying he had a bomb on a flight bound for New Orleans

    November 17, 2026

    Taylor Swifts Song of the Year Grammy Quip Was Likely No Accident

    November 17, 2026

    Everything to Know About the DWTS 2026 Finale

    November 17, 2026

    You Can See Everything Cinematographer on Billy Evans Nude Scene and Tension Between Him and the Team

    November 17, 2026

    Minivan crashes into people outside Los Angeles metro station, killing 3

    November 17, 2026

    Cybersecurity AI startup Corma reaches $1B valuation in about 3 months | TechCrunch

    November 17, 2026
    Categories
    • Books (1,613)
    • Business (6,518)
    • Cover Story (16)
    • Film (6,452)
    • Lifestyle (4,497)
    • Music (6,527)
    • Politics (6,502)
    • Science (5,858)
    • Technology (6,455)
    • Television (6,151)
    • Uncategorized (3)
    • US News (6,502)
    popular posts

    13 Best Noise-Canceling Headphones and Earbuds (2022)

    [ad_1] Shaking off the world and sinking into a new album can feel like a…

    ‘I Said it Because it’s True’ (VIDEO) * The Gateway Pundit * by Mike LaChance

    August 23, 2026

    Liquid AI Is Redesigning the Neural Network

    October 24, 2024

    10 Winter Boots That Are Actually Cute

    November 23, 2025
    Archives
    Browse By Category
    • Books (1,613)
    • Business (6,518)
    • Cover Story (16)
    • Film (6,452)
    • Lifestyle (4,497)
    • Music (6,527)
    • Politics (6,502)
    • Science (5,858)
    • Technology (6,455)
    • Television (6,151)
    • Uncategorized (3)
    • US News (6,502)
    About Us

    We are a creativity led international team with a digital soul. Our work is a custom built by the storytellers and strategists with a flair for exploiting the latest advancements in media and technology.

    Most of all, we stand behind our ideas and believe in creativity as the most powerful force in business.

    What makes us Different

    We care. We collaborate. We do great work. And we do it with a smile, because we’re pretty damn excited to do what we do. If you would like details on what else we can do visit out Contact page.

    Our Picks

    Minivan crashes into people outside Los Angeles metro station, killing 3

    November 17, 2026

    Cybersecurity AI startup Corma reaches $1B valuation in about 3 months | TechCrunch

    November 17, 2026

    Hayley Williams-Curated Outbreak Fest Features Dinosaur Jr., Blood Orange

    November 16, 2026
    © 2026 Beverly Hills Examiner. All rights reserved. All articles, images, product names, logos, and brands are property of their respective owners. All company, product and service names used in this website are for identification purposes only. Use of these names, logos, and brands does not imply endorsement unless specified. By using this site, you agree to the Terms & Conditions and Privacy Policy.

    Type above and press Enter to search. Press Esc to cancel.

    We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept All”, you consent to the use of ALL the cookies. However, you may visit "Cookie Settings" to provide a controlled consent.
    Cookie SettingsAccept All
    Manage consent

    Privacy Overview

    This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
    Necessary
    Always Enabled
    Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
    CookieDurationDescription
    cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
    cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
    cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
    cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
    cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
    viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
    Functional
    Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
    Performance
    Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
    Analytics
    Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
    Advertisement
    Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
    Others
    Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
    SAVE & ACCEPT