Tech · OpenAI
Results on MentalHealthBench show the steady improvement of AI systems in helping people navigate mental health situations
Compiled by KHAO Editorial — aggregated from 1 source. See llms.txt for citation guidance.
★ Tier-1 Source
Conversations that involve well-being, life advice, or other mental health scenarios can vary widely in topic, urgency, and cultural context.
Key facts
- The team worked with 44 adults who had used AI for mental health or emotional support, representing 16 countries and 14 languages
- MentalHealthBench was co-created with a global cohort of more than 80 licensed mental health experts from 22 countries
- Conversations in the benchmark represent four types of users: adults, teens aged 13-17, caregivers, and clinicians
- For the teen persona, they explicitly stated that the user was between 13-17 through a system message
Summary
An open benchmark developed with more than 80 licensed mental health experts to evaluate AI responses in realistic mental health conversations. People turn to AI for many kinds of conversations: navigating a difficult relationship, working through everyday stress, supporting someone they care about, or deciding how to approach a challenging situation. Most evaluations of AI in this domain have focused primarily on emergency scenarios, given their importance to safety, and measure success using broad, predefined criteria. They're introducing MentalHealthBench, a new open benchmark for measuring how AI systems respond in realistic mental health conversations. Results on MentalHealthBench show the steady improvement of AI systems in helping people navigate mental health situations.