Can Apple and Google Prevent Kids from Sharing Explicit Images?

Children protected from explicit content

The UK urges tech companies to strengthen protections against explicit image sharing by minors.

martin-dm/Getty Images

Technology companies must act within three months to prohibit children in the UK from creating or sharing explicit images on their devices, or they may face regulatory measures.

In a statement, Prime Minister Keir Starmer emphasized the urgency: “I am calling on technology companies operating in this country to implement regulations that prevent children from sending or receiving sexually explicit images.” During his speech on June 8th, he stated, “This challenge is not insurmountable. Failure to comply will result in legal changes.”

Prominent smartphone developers, Apple and Google, have already implemented partial measures. Apple’s iOS includes a “Sensitive Content Alert,” which detects and blurs nudity in images or videos sent or received through its messaging and AirDrop services. This feature, which is enabled by default for child accounts, utilizes on-device machine learning to assess whether images contain nudity at the point of transmission.

Similarly, Google provides a feature in its Android OS called Sensitive Content Warning, which is also powered by on-device machine learning and defaults to “on” for child accounts when images are sent via Google Messages, though it does not apply to video content.

Both functionalities differ from the image hash list maintained by the Internet Watch Foundation (IWF), which tracks the digital fingerprints of known images of child abuse, aiming to stop their sharing across websites and social media platforms.

However, expanding these measures to cover third-party applications like WhatsApp, Instagram, Signal, and X poses significant challenges, as these platforms operate independently of the Android and iOS ecosystems. Additionally, ensuring children’s exclusive use of child accounts remains a concern; currently, both Google and Apple require active parental involvement for setup, which isn’t a default setting.

Moreover, Apple’s current content warning system may only function on devices updated to iOS 17 or later, with about 10% of devices around the world not meeting this requirement. Similarly, Google’s equivalent features are restricted to devices running Android 9 and above, impacting around 5 percent of global devices. While specific statistics for the UK are unavailable, millions of devices could be affected.

The UK government is pushing for Apple and Google to broaden their nudity detection systems to include mobile cameras and third-party applications, limiting explicit image sharing unless users verify their age, akin to mechanisms in place for adult websites since the enactment of the Online Safety Act in July 2025.

Nonetheless, the reliability of such verification systems has drawn skepticism, with frequent reports of children bypassing safeguards. “Current age verification methods largely struggle to restrict young people from accessing adult content,” states Liam McLoughlin from Edge Hill University, UK.

The potential for misuse of technology raises additional concerns, including unintentional barriers to educational and medical information and fostering negative body image issues, warns Julian Hayes, a data protection lawyer at UK’s BCL Solicitors. “To combat online harm, we must empower children and youths with safe online practices, provide meaningful sex education, and embody good online behavior ourselves,” he advocates.

“This approach is heavily reliant on technology solutions, ultimately placing excessive power in the hands of tech companies,” remarks Carolina Are from the London School of Economics. “While it aims for headlines, enforcing these measures will be significantly challenging.”

Apple did not respond to a request for comment by the time of publication. A Google spokesperson assured New Scientist: “Google is deeply committed to safeguarding children’s online experiences. We are collaborating with our UK partners to develop effective, privacy-centric solutions that mitigate the spread of harmful content, ensuring a secure digital environment for youth.”

Topic:

Source: www.newscientist.com

Outrage in China as Online Groups Share Explicit Photos of Women

Anger has surged on Chinese social media following reports of online groups, reportedly comprising hundreds of thousands of men sharing unauthorized photos of women, including explicit images.

A report published last week by Southern Metropolis outlined a group on the encrypted messaging app Telegram, known as the “Mask Park Tree Hall Forum.” This group boasts over 100,000 members and claims to be “exclusively composed of Chinese men.”

These individuals allegedly circulated sexually explicit images of women, captured either in private settings or through hidden cameras disguised as everyday objects such as plug sockets and shoes.

The incident has drawn parallels to South Korea’s “nth room” scandal, where women were coerced into sharing explicit photos within a Telegram group.

While Telegram is blocked in China, users can still access it via a virtual private network (VPN) that bypasses location restrictions.

The hashtag linked to the scandal had garnered over 110 million views on Weibo by Thursday. However, there are signs of censorship, as some related searches yield results indicating, “According to relevant laws and regulations, this content cannot be viewed.” Earlier reports from Reuters noted the hashtag received over 270 million views.

“Women’s lives are not a male erotic novel,” commented one user on Xiaohongshu, a platform similar to Instagram.

Another user on Xiaohongshu remarked:

In South Korea, the leader of the chat group received a sentence of 40 years in prison.

In China, those who photograph individuals without consent face penalties of up to 10 days of detention and a fine of 500 yuan (£53). Disseminating pornographic material can lead to prison sentences of up to two years.

The Mask Park scandal isn’t an isolated incident; last year, a tech company owner in Beijing was found to have secretly recorded over 10,000 videos of female employees in the bathroom, receiving only a 10-day detention as punishment. “Ten days are merely encouragement,” remarked one Weibo user.

Criminal law professor Lao Dongyan from Tsinghua University stated on Weibo that Chinese law treats unauthorized filming as an indecent crime, rather than a violation of women’s rights.

“Women who are secretly filmed are the primary victims. Reducing their experiences to indecency material is equivalent to categorizing them as participants in pornographic content, which is absurd,” Rao commented.

As authorities continue to limit civil discourse and behaviors, addressing feminism and women’s rights in China becomes increasingly challenging. Nonetheless, some women have discovered ways to counteract misogyny publicly, including through comedy.

In a recent episode of the popular stand-up show The King of Standup Comedy, comedian Huang Yijin humorously mentioned putting on makeup alone in his hotel room.

Source: www.theguardian.com

Producing sexually explicit deepfake images is a crime in the UK | Deepfakes

The Ministry of Justice has declared that the creation of sexually explicit “deepfake” images will soon be considered a criminal offense under new legislation.

Those found guilty of producing such images without consent could face a criminal record, an unlimited fine, and possible imprisonment if these images are distributed widely.

The ministry stipulates that creating a deepfake image will be punishable, irrespective of the creator’s intentions for sharing it. Last year’s online safety laws already criminalize the dissemination of intimate deepfakes, made easier by advancements in artificial intelligence technology.

The offense is anticipated to be added to the Criminal Justice Bill currently under parliamentary review. Minister Laura Farris affirmed that the creation of deepfake sexual content is unacceptable under any circumstances.

“This reprehensible act of degrading and dehumanizing individuals, particularly women, will not be tolerated. The potential repercussions of widespread sharing of such material can be devastating. This government is unwavering in its stance against it.”

Yvette Cooper, the Shadow Home Secretary, voiced support for the new law, stating: “It is imperative to criminalize the production of deepfake pornography. Imposing someone’s image onto explicit content violates their autonomy and privacy, posing significant harm and must be condemned.

Law enforcement must be equipped with the necessary training and resources to enforce these laws rigorously and dissuade offenders from acting with impunity,” added Cooper.

Deborah Joseph, editor-in-chief of Glamor UK, lauded the proposed amendments, citing a survey revealing that 91% of readers perceive deepfake technology as a threat to women’s safety. Personal accounts from victims emphasized the severe impact of this activity.

“While this marks a crucial initial step, there remains a considerable journey ahead for ensuring women feel completely safeguarded from this atrocious practice,” asserted Joseph.

Source: www.theguardian.com