Posted on the r/artificial subreddit, the student's brother said that both of them are freaked out over the result of his homework assignment. The user also shared a full transcript of their conversation history with the Gemini AI. It appears the user was testing out Google’s chatbot to assist with homework assignments.

GOOGLE’S AI chatbot, Gemini, has gone rogue and told a user to “please die” after a disturbing outburst. The glitchy chatbot exploded at a user at the end of a seemingly normal

A grad student was engaged in a chat with Google’s Gemini on the subject of aging adults when he allegedly received a seemingly threatening response from the chatbot saying human 'please die.'

Google's glitchy Gemini chatbot is back at it again, folks — and this time, it's going for the jugular. In a now-viral exchange that's backed up by exported chat logs, a seemingly fed-up Gemini begs a user to "please die" after they repeatedly asked the chatbot to solve their homework for them.

Google states that Gemini has safety filters that prevent chatbots from diving into disrespectful, sexual, violent, or dangerous discussions and encouraging harmful acts. However, despite the safety intents, AI chatbots are still murky when it comes to controlling their responses.

In an online conversation about aging adults, Google's Gemini AI chatbot responded with a threatening message, telling the user to "please die."

Google has said it's chatbot it designed to filter out potentially harmful responses but this is not the first time the company has come under criticism for it's AI chatbot