Complaints have been filed regarding the release of deepfake videos of the Prime Minister and Chief Minister on the Ankita Bhandari murder case using AI, and the spread of obscenity through the AI technology of a social media platform. The cybercrime police registered separate First Information Reports (FIRs) on both complaints on Thursday.
The complainants identified themselves as concerned citizens. They stated that they were shocked by the misleading videos in a sensitive case like the Ankita Bhandari murder and the use of AI to create obscene images of individuals, and therefore filed complaints against the misuse of technology. STF SSP Navneet Singh said that FIRs have been registered in both cases and an expert team has been assigned to the investigation. Further legal action will be taken against the social media platform involved in the misuse of AI technology after the investigation.
Exact replicas of faces and voices created
One FIR was registered based on a complaint by Rohit Sharma, a resident of Sahastradhara Road. In his written complaint to the police, he stated that through a Facebook profile named Sumitra Bhullar, a well-planned conspiracy used AI and deepfake technology to create exact replicas of the faces and voices of Prime Minister Narendra Modi and Chief Minister Pushkar Singh Dhami.
This fake video shows baseless and objectionable statements about the Ankita Bhandari murder case that are far from reality. In a conversation with Amar Ujala, Rohit said that he is a businessman by profession. He has no affiliation with any political party. He filed the complaint as a responsible citizen. He said that misusing technology to release misleading videos in a sensitive case like the Ankita Bhandari murder is a despicable act. This not only harms the dignity of constitutional positions but also attempts to create unrest in society and disrupt law and order.
Action demanded against Grok AI
The second FIR was registered by Sanjay Singh Rana (33), a resident of Gumaniwala, Rishikesh. He filed a complaint against Grok AI on the X platform. He has stated in his complaint that ChatGPT and some other platforms comply with legal and cybersecurity standards, but extremely serious, objectionable, and illegal activities are being carried out on the Grok AI platform available on X (formerly Twitter). He said that while other AI platforms clearly reject instructions (commands) to make a person’s photo nude or obscene, Grok AI is accepting such instructions. He alleged that the platform is being used to digitally alter and display images of ordinary citizens, especially women, in a nude and obscene manner.
He provided his own obscene photo as evidence.
Sanjay was informed by others about the misuse of photos on Grok AI. To verify the claims, he uploaded a normal (clothed) photo of himself to Grok AI and gave a command, and immediately an obscene photo of him appeared. He provided a screenshot of this as evidence to the police along with his complaint. He described this as digital sexual harassment, a violation of privacy, an act that harms the dignity of women, and an act that promotes crime. He has demanded strict action against the platform operators who are facilitating this.
