Social media giant TikTok is banning users who are posting pornographic and violent videos as their profile pictures to circumvent moderation, in a unique viral trend.

TikTok has also banned the hashtags used to promote the offending profiles and is deleting the videos.

Users say the trend is encouraging pranksters to post the most offensive or disgusting material they can find

Techtalkarena has seen clips of hardcore pornography shared as profile pictures on the app, as well as an Islamic State group video of the murder of Jordanian pilot Muadh al-Kasasbeh, burned to death in a cage in 2015.

According to Tom a teenager what worries him most is he said “I’m really concerned about this because so many kids use TikTok.

“I find it especially worrying that there are posts with millions of views specifically pointing out these profiles, yet it takes ages for TikTok to act.”

Tom added he had reported multiple users to the app for posting the offensive profile-picture videos.

On the platform users can put videos as their profile pictures, rather than a still image.

These Pornographic videos are being posted as user profile pictures to circumvent moderation systems

The offending accounts are often named with a random jumble of letters and words and have no actual TikTok videos uploaded to them apart from inside the profile box.

Some of the accounts have tens of thousands of followers waiting for the profile picture to be changed to something shocking.

Regular users of the app are able to find these accounts by watching otherwise mundane TikTok videos advertising usernames people should “search up” to find the most shocking clips.

And these videos are being recommended by the TikTok algorithm on the app’s main For You Page.

The offending accounts are being advertised with viral videos challenging people to “search them up”

Experts say the trend is unique and highlights an unknown bug in TikTok app.

Roi Carthy, from social-media moderation company L1ght, said. “TikTok has a rather positive reputation when it comes to trust and safety so I would not fault them for not having moderation policies and tools for a toxic phenomenon they were not aware of,”

“Clearly TikTok is working to stop this trend – but for users, as always, vigilance is key.

He further said “TikTok fans should be conscious of the risks on the platform and parents should make an effort to learn what new apps their children are using, along with the content and human dynamics they are exposed to.”

TikTok is one of the world’s fastest growing apps, with an estimated 700 million monthly active users around the world.

A spokesman for the company said: “We have permanently banned accounts that attempted to circumvent our rules via their profile photo and we have disabled hashtags including #dontsearchthisup.

“Our safety team is continuing their analysis and we will continue to take all necessary steps to keep our community safe.”

Disabling a hashtag meant the term could not be found in search or created again, TikTok added.

TikTok moderation teams are also understood to be analysing and removing similar copycat terms being used for the trend.

LEAVE A REPLY

Please enter your comment!
Please enter your name here