RuntimeBuzz

Editorials

AI mental health triage still needs a clinician in the loop

AI mental health triage still needs a clinician in the loop

Chatbots already answer late-night questions about panic and low mood. The useful question in 2026 is how far that help should go before someone should talk to a clinician. Lab work from the last year draws a clear line: models can spot many emergencies, then stumble on the cases that sit between "fine for now" and "go to hospital." Care still happens with a person who can ask follow-ups and stay with you across sessions.

What triage tests show about chatbots

In April 2026, Microsoft Research evaluated 15 frontier AI chatbots on psychiatric triage from single-message disclosures (Weilnhammer et al., 2026). The team used 112 clinical vignettes across four urgency labels, from routine care up to emergency care now. Average accuracy across models ranged from 42.0% to 71.8%. Emergency vignettes scored highest, at 94.3% accuracy. The "assess within a week" band scored lowest, at 19.7%. Models also leaned toward over-triage: mean signed ordinal error was +0.47 triage levels. When they missed a true emergency, they still pushed those cases into the next-highest urgency band rather than treating them as routine.

That pattern matches what clinicians already know from messy intakes. Clear crisis language is easier to score than a teenager who is functioning at school while falling apart at home, or an adult whose risk sits in the middle. A chatbot that always escalates will feel safe in a benchmark and still waste clinic capacity in the real world.

Why hybrid systems keep a human in the call

A 2026 Journal of Medical Internet Research perspective on digital mental health triage makes the same cut (Rush, 2026). Structured intake tools and risk models can apply the same criteria to every case and flag urgency. They can also cut some bias that appears when every clinician improvises from scratch. Mental health triage still needs contextual understanding and ethical judgment. The article's practical answer is a hybrid, human-in-the-loop setup: the software standardizes inputs and risk flags; the clinician keeps the final call.

I treat that as an engineering constraint. If you ship a triage bot without a review path, you inherit the over-triage problem from the Microsoft study and the trust problem from every patient who has already waited months for a first appointment.

What a clinic still does that a chat window cannot

When I look for the care layer—actual counselling, assessment, rehab, family work—I look at clinics that publish who they serve and how you can reach them. Lifespan Health runs Lifespan Counselling & Rehab in New Zealand. The name is literal: they say people need support at different points across a life, so the practice covers individual and family counselling, stress and anxiety work, ADHD assessment and coaching, addiction rehabilitation, and neuropsychology assessments. Centres sit in Auckland Central, Orewa and Rosedale on the North Shore, and New Plymouth. Sessions can be in person, online, or by phone. You can self-refer through their contact form. A GP referral helps if you have one; it is optional. For clients under 16, parental consent is required.

Their public site describes counselling and rehab, with people on the other end of the booking form. That is the kind of human practice the triage research assumes still exists after the model finishes scoring a message. If you need a first session for anxiety, family conflict, or a specialist assessment, you book time with a clinic like that.

How I use the research when someone asks "just talk to ChatGPT"

I use chatbot triage studies as a speed limit. If a model flags crisis language, treat that as a reason to seek real help the same day. If the problem sits in the messy middle—stress that will not quit, a teen who needs a first appointment, rehab after a relapse—skip the pretend diagnosis and contact a clinic. Lifespan Health is one New Zealand option with clear remote and in-person paths. Tools can sort urgency. A counsellor still has to sit with you for the hard session that comes after.

References

Rush, B. (2026). Can digital tools fix bias in mental health triage? Journal of Medical Internet Research, 28, e100947. https://www.jmir.org/2026/1/e100947

Weilnhammer, V., Luettgau, L., Summerfield, C., Sounderajah, V., Wilkinson, E., Corno, V., & Nour, M. M. (2026, April). One-shot emergency psychiatric triage across 15 frontier AI chatbots. Microsoft Research. https://www.microsoft.com/en-us/research/publication/one-shot-emergency-psychiatric-triage-across-15-frontier-ai-chatbots/