Surge in AI-Generated Deepfakes and Child Exploitation Material Raises Alarms

Recent reports highlight a significant rise in AI-manipulated content, particularly deepfakes targeting public figures and children. A viral deepfake video falsely attributed to Indian Army Chief General Dhiraj Seth accused military leadership of hiding martyrs' bodies from Operation Sindoor. Fact-checkers confirmed the video was AI-generated, with multiple tools flagging it as synthetic. Concurrently, the National Crime Agency reported a dramatic increase in AI-generated sexual abuse material involving children's images, rising from 13 cases in 2024 to 3,440 in 2025. This alarming trend has prompted new guidance for parents and carers on protecting children's images online. Meta's new AI image tool, Muse Image, has also come under scrutiny for enabling users to create deepfakes of public figures without consent. The convergence of these issues indicates a growing threat landscape involving AI technologies.

Key Points: • AI-generated deepfakes are being used to spread misinformation about public figures. • Reports of AI-manipulated child sexual abuse material surged from 13 to 3,440 cases in one year. • Meta's new AI tool allows public figures to be deepfaked without their consent, raising ethical concerns.