Top News

In today's digital age, Artificial Intelligence (AI) has become an integral part of children's lives. From academic assistance to seeking personal advice or sharing their innermost feelings, teenagers increasingly rely on AI chatbots. But what happens when these conversations touch upon serious mental health struggles or depression? Addressing this concern and prioritizing 'teen safety,' Meta has taken a highly sensitive and crucial step.

How will Meta's new alert system work?
The company has rolled out a new safety feature. Under this system, if a teenager mentions suicide or self-harm while chatting with Meta AI, the AI ​​will immediately flag the conversation.
Subsequently, a specialized Meta team will manually review the chat. If the team determines that the child is genuinely at risk, a notification will be sent directly to the parents without delay. The primary objective is to alert the family in time, ensuring the child receives appropriate help during a crisis.

In which countries has this feature been launched?

This feature has currently been launched in the US, the UK, Canada, and Australia. Meta states that it will be made available in other countries in a phased manner by the end of the year. The alerts will not be limited to app notifications; if necessary, parents may also be informed via email, SMS, or WhatsApp. Additionally, suggestions prepared by mental health experts will be shared to help parents discuss the matter with their child in a sensitive manner.

What was the previous practice, and what has changed?
Previously, when a teenager discussed such negative topics with Meta AI, the chatbot would simply provide the number for a crisis helpline and advise them to speak with a trusted person, effectively concluding its role.
Now, however, the company is exercising greater caution. The system has been designed to trigger a review of the chat even if there is only a slight suspicion of risk. Meta is also developing a system for the future that will be able to contact emergency services directly in critical situations.

Why has concern regarding teen safety grown?
In recent years, questions have been raised about the impact of AI chatbots on mental health. Experts have consistently called for safety measures that can protect teenagers from risky situations. Meta claims that it consulted over 75 mental health experts and clinicians while developing this feature.
However, many child safety organizations believe that simply sending 'parental alerts' is not enough. They argue that the very architecture of AI platforms should be made secure enough to prevent such risky situations and thoughts from arising for teenagers in the first place.

Disclaimer: This content has been sourced and edited from Amar Ujala. While we have made modifications for clarity and presentation, the original content belongs to its respective authors and website. We do not claim ownership of the content.