Snapchat received a warning from the U.K. data watchdog regarding its AI chatbot “My AI” and potentially failing to identify and address its privacy risks.
The social media platform Snapchat has received a warning from the United Kingdom’s data watchdog over its new artificial intelligence (AI) chatbot known as “My AI,” according to an update posted by the regulator.
On Oct. 6 the U.K. Information Commissioner's Office issued a preliminary notice to Snap Inc. and Snap Group Limited, the parent companies of Snapchat, of a potential failure to “properly assess the privacy risks” posed by the chatbot.
We have issued Snap, Inc and Snap Group Limited with a preliminary enforcement notice over a potential failure to properly assess the privacy risks posed by its generative AI chatbot ‘My AI’.
— ICO - Information Commissioner's Office (@ICOnews) October 6, 2023
Read more about the case: https://t.co/MAuHAH0h8B pic.twitter.com/BawISttPJN
The notice is based off a provisional investigation of the company conducted by the watchdog which said the risks to several million “My AI” users, including children aged 13-17, were not adequately identified prior to its launch.
John Edwards, the U.K.’s information commissioner, commented on the notice saying:
“We have been clear that organizations must consider the risks associated with AI, alongside the benefits. Today's preliminary enforcement notice shows we will take action in order to protect U.K. consumers' privacy rights.”
According to the notice, if a final enforcement notice is issued Snap may be subject to stopping data processing in relation to “My AI,” which would be not offering the service to U.K.-based users without an “adequate” risk assessment.
At the moment, the Commissioner’s Office said a conclusion should not be made from the current stage of investigations.
Related: Friend.tech offers login removal solutions after SIM-swap reports
Snapchat’s AI chatbot was rolled out to users of Snapchat+ in the U.K. in February 2023, with wider availability beginning in April 2023.
“My AI” is powered by OpenAI’s GPT-4 technology and according to the data watchdog was the “first example of generative AI embedded into a major messaging platform in the UK.”
Throughout the year major social media platforms have been integrating AI features into their operations. On Oct. 4 the Microsoft-owned business-focused social media platform LinkedIn announced additional AI tools available to recruiters and an AI assistant in its learning center.
BigTech giants Meta, the Facebook and Instagram parent company, and Google have also both revealed their own AI chatbot integration into their service offerings.
Magazine: ‘AI has killed the industry’: EasyTranslate boss on adapting to change