A gruesome YouTube video depicting a man holding what he claimed to be his father’s decapitated head shocked viewers as it circulated on the platform for hours before being taken down. The video, which garnered over 5,000 views, is just one example of the disturbing and horrifying content that often goes unchecked on social media.
This incident occurred just hours before major tech CEOs faced Congress for a hearing on child safety and social media. Sundar Pichai, CEO of YouTube parent company Alphabet, was notably absent from the list of chief executives attending.
YouTube swiftly removed the video, citing violations of their graphic violence and violent extremism policies. The channel belonging to the uploader, Justin Mohn, was also terminated in accordance with these policies. However, the incident raises concerns about the efficacy of content moderation on online platforms.
Many social media companies have been criticized for their inadequate investments in trust and safety teams. In 2022, X eliminated teams focused on security, public policy, and human rights issues after a change in leadership. Similarly, Twitch, owned by Amazon, laid off employees working on responsible AI and trust and safety initiatives, while Microsoft cut a key team focused on ethical AI product development. Facebook’s parent company, Meta, also reduced staff working in non-technical roles during its latest round of layoffs.
Critics argue that social media platforms prioritize ad sales over safety, leading to a slow response in removing disturbing content. Algorithms used by these platforms tend to amplify videos with high levels of engagement, exacerbating the problem. Even when companies label violent content, they often struggle to moderate and remove it swiftly, leaving children and teens exposed to harmful imagery before it is taken down.
The sheer volume of content requiring moderation has overwhelmed platforms, affecting children’s mental health and well-being. Traumatizing images can leave lasting scars on young viewers.
As tech companies face questioning from Congress, they are expected to present tools and policies aimed at protecting children and providing parents with more control over their kids’ online experiences. However, critics argue that these measures often fall short, leaving the responsibility of safeguarding teens primarily to parents and young users themselves.
The consensus among advocates is that tech platforms can no longer be trusted to self-regulate effectively, urging more stringent regulation and oversight in the interest of child safety on the internet.
