Tech Firms Collaborate with UK Child Safety Agency to Evaluate AI Tool for Generating Abuse Images

Under a new UK law, tech companies and child protection agencies will be granted the authority to test if artificial intelligence tools can create images of child abuse.

This announcement follows reports from a safety watchdog highlighting instances of child sexual abuse generated by AI. The number of cases surged from 199 in 2024 to 426 in 2025.

With these changes, the government will empower selected AI firms and child safety organizations to analyze AI models, including the tech behind chatbots like ChatGPT and image-generating devices such as Google’s Veo 3, to ensure measures are in place to prevent the creation of child sexual abuse images.

Kanishka Narayan, the Minister of State for AI and Online Safety, emphasized that this initiative is “ultimately to deter abuse before it happens,” stating, “Experts can now identify risks in AI models sooner, under stringent conditions.”

This alteration was made due to the illegality of creating and possessing CSAM. Consequently, AI developers and others will be prevented from producing such images during testing. Previously, authorities could only respond after AI-generated CSAM was uploaded online, but this law seeks to eliminate that issue by stopping the images from being generated at all.

The amendments are part of the Crime and Policing Bill, which also establishes a prohibition on the possession, creation, and distribution of AI models intended to generate child sexual abuse material.

During a recent visit to Childline’s London headquarters, Narayan listened to a simulated call featuring an AI-generated report of abuse, depicting a teenager seeking assistance after being blackmailed with a sexual deepfake of herself created with AI.

“Hearing about children receiving online threats provokes intense anger in me, and parents feel justified in their outrage,” he remarked.

The Internet Watch Foundation, which oversees CSAM online, reported that incidents of AI-generated abusive content have more than doubled this year. Reports of Category A material, the most severe type of abuse, increased from 2,621 images or videos to 3,086.

Girls are predominantly targeted, making up 94% of illegal AI images by 2025, with the portrayal of newborns to two-year-olds rising significantly from five in 2024 to 92 in 2025.

Kelly Smith, CEO of the Internet Watch Foundation, stated that these legal modifications could be “a crucial step in ensuring the safety of AI products before their launch.”

“AI tools enable survivors to be victimized again with just a few clicks, allowing criminals to create an unlimited supply of sophisticated, photorealistic child sexual abuse material,” she noted. “Such material commodifies the suffering of victims and increases risks for children, particularly girls, both online and offline.”

Childline also revealed insights from counseling sessions where AI was referenced. The concerns discussed included using AI to evaluate weight, body image, and appearance; chatbots discouraging children from confiding in safe adults about abuse; online harassment with AI-generated content; and blackmail involving AI-created images.

From April to September this year, Childline reported 367 counseling sessions where AI, chatbots, and related topics were mentioned, a fourfold increase compared to the same period last year. Half of these references in the 2025 sessions pertained to mental health and wellness, including the use of chatbots for support and AI therapy applications.

Source: www.theguardian.com

Judges Evaluate Legality of Trump Administration Cuts at the National Institutes of Health

On Monday, a federal judge in Boston ruled that the termination of grants from the National Institutes of Health signals the end of efforts aimed at diversity-related research topics. Trump’s administration has claimed this decision was “invalid and illegal,” citing discrimination against racial minorities and the LGBTQ community.

US District Judge William Young stated in a non-judicial trial that the NIH breached federal law by capriciously canceling over $1 billion in research grants linked to diversity, equity, and inclusion initiatives.

Judge Young indicated he is reinstating grants awarded to organizations that advocated for such initiatives in democratically led states. He also mentioned that as the case unfolds, more significant decisions might follow.

“This amounts to racism and discrimination against the American LGBTQ community,” remarked Young, a Republican appointee of President Ronald Reagan. “Government discrimination is profoundly wrong; I urge the court to prohibit it, and I will take action in due course.”

Discussing the end of grants for research addressing racial minority issues, Young expressed from the bench that he has “never witnessed such blatant racism” in his 40 years on the bench.

“You judge people of color based on their skin,” he stated concerning the Trump administration. “The Constitution does not permit that.”

The Department of Health and Human Services, representing the NIH and its parent organization, has not responded promptly to requests for statements.

Rachel Meelopol from the American Civil Liberties Union, who represents the grant recipients in the lawsuit, mentioned that Young’s ruling impacts hundreds of grants. The plaintiffs include the American Public Health Association and 16 states led by Massachusetts.

The NIH, the world’s premier funder of biomedical and behavioral research, has terminated approximately 2,100 research grants worth about $9.5 billion and an additional $2.6 billion in contracts since President Donald Trump took office in January. I signed on to protest the cuts last week.

These funding cuts reflect Trump’s broader agenda to reshape the government, reduce federal expenditures, and eliminate support for DEI programs and transgender healthcare. Another federal judge has temporarily blocked the administration’s plan to reduce 10,000 jobs across the NIH and other health agencies.

Trump has also enacted a series of executive orders mandating that institutions ensure grant funding does not support “gender ideology” and puts an end to what the administration deems “discriminatory” DEI programs. Conservative critics argue that these DEI initiatives unfairly target white individuals and others.

Aligned with Trump’s policy objectives, the NIH has directed staff to cease grant funding for research on DEI programs, issues facing transgender individuals, COVID-19 vaccine hesitancy, and funding beneficial to universities in China.

The trial presided over by Young on Monday focused on just a portion of the claims in the consolidated litigation regarding the funding cuts. He intends to consider additional claims later.

Young indicated he would allow political parties to present further evidence before making decisions regarding these claims and determine whether to restore grants beyond those allocated to the plaintiffs.

The cessation of NIH grants, coupled with delays in grant approvals and renewals, has reverberated across universities nationwide, many of which now face the loss of significant portions of their research budgets.

As a result, universities have initiated employment freezes, travel restrictions, reduced class sizes, furloughs, and layoffs.

Numerous universities depend on NIH grants for the majority of their research funding. For instance, Washington University, recognized as the top public institution for biomedical research, reported receiving roughly 1,220 grants from the NIH, totaling about $648 million last year, as per court documents.

Students and faculty at universities have expressed concerns that the funding confusion could lead to brain drain from the United States, as researchers increasingly seek positions abroad. This slowdown also threatens long-term research initiatives, including projects focused on banking and studying the brains of Alzheimer’s patients.

The Trump administration has aimed to reduce other critical research funding sources.

In February, US District Judge Angel Kelly halted regulations that severely restricted government payments for indirect research costs, including equipment, maintenance, utilities, and support staffing. The administration projected that this action would eliminate $4 billion in funding for research institutions.

Source: www.nbcnews.com