Published 17:26 IST, October 17th 2024

Telegram issue: 4 million users use AI bots to create deepfake nudes of people every month

Nearly 50 AI bots available on Pavel Durov's Telegram are being used to create deepfake nudes of people nearly 4 million users every month, a new report says.

Reported by: Shweta Ganjoo
Follow: Google News Icon
  • share
Telegram | Image: Reuters
Advertisement

Telegram is being used for creating and distributing deepfake nudes of people by millions of users every month, a new report has highlight. Pavel Durov-owned platform hosts at least 50 bots that are being used by more than 4 million monthly users for creating deepfake nudes of women, in some cases even teenage girls.

According to a study by Wired, two of 50 Telegram bots it analysed h more than 4,00,000 lakh monthly users each, while 14 or bots h more than 1,00,000 members each. se bots are supported by at least 25 Telegram Channels with more than three million subscribers "where people can subscribe to newsfeed-style updates". se channels alert subscribers about new features being offered by bot and special token that can be purchased to operate m and create images. se Telegram channels, as per study, also act as places where users of bots can find links to new bots in case y are removed by company.

Advertisement

Furrmore, study says that se bots come with varying capabilities. While some claim that y can 'remove clos' from photos, ors claim to create deepfake images of people in 'various sexual acts'. n re are or bots that require users to share multiple images to create desired image and train ir AI models in process. study also claims that while some bots refer to 'nudity and removing women’s clos' in ir names, ors don't give explicit material in ir name or landing page.

What's exacerbating situation is that Telegram's recommendation engine highlights 'similar channels' to users who land on one such channel creating deepfake nude images. This helps users in bouncing between images and channels and increasing usage. ditionally, Telegram can force bot developers to accept terms of usage, which can prevent users from uploing images of individuals without consent and, in process, help curb issue. However, study says that 're appears to be little or no enforcement of se rules'.

Advertisement

"It is really concerning that se tools—which are really ruining lives and creating a very nightmarish scenario primarily for young girls and for women—are still so easy to access and to find on surface web, on one of biggest apps in world," deepfake expert, Henry Ajder, said in a statement to publication.

What is Telegram doing about it?

While Telegram hasn't commented on matter, it has removed nearly 75 such bots from its platform.

Advertisement

It is worth noting that this report comes shortly after Telegram founder was arrested at an airport outside of Paris in France for reportedly enabling criminal activity, including distribution of child abuse images and drug trafficking images, on platform.

17:26 IST, October 17th 2024