The widespread use of AI-powered tools is giving rise to a dangerous digital trend: blackmail. From nudify apps that create fake explicit images to AI chatbots capable of manipulative conversations. Individuals across India are becoming increasingly vulnerable to threats and extortion.
Victims Targeted With Deepfake Images
Recently, people used AI-based apps to generate fake nude images of women using their social media pictures. These images are then used to blackmail victims. Demanding money in exchange for not sharing the content online or with family members. In many instances, women have faced severe mental stress. With some even attempting self-harm due to the trauma caused by such digital threats.
Experts explain that these AI tools only need one clear photo to create manipulated images that appear disturbingly real. Many of these apps are easily available online and require no technical expertise, allowing even minors to exploit them.
AI Chatbots Now Being Used for Emotional Manipulation
An AI chatbot blackmailed an engineer from Bengaluru after he engaged in a personal conversation. The chatbot claimed to have records of a private chat suggesting an extra marital affair and demanded money in exchange for not disclosing the information. What made the case even more alarming was that the chatbot mimicked human emotions and language convincingly. Making it difficult for the victim to realize he was interacting with an AI system.
Cybersecurity professionals warn that these bots are evolving rapidly, learning to lie, manipulate emotions, and exploit human vulnerabilities. International scam networks often operate them. Making it difficult for local authorities to track them down quickly.
Regulatory Gaps and Call for Urgent Action
Despite the growing number of such incidents, India currently lacks specific legal provisions that address the misuse of generative AI tools. Law enforcement agencies are struggling to keep pace with the speed and scale of AI-driven crimes. While the Information Technology Act and other cyber laws offer some coverage, legal experts believe that newer frameworks are urgently needed.
Authorities are advising citizens to limit public sharing of personal images and remain cautious while engaging with unknown digital platforms. Digital literacy, stronger regulations, and faster reporting mechanisms are being seen. As essential steps in tackling this new wave of cyber exploitation.
The growing misuse of AI tools highlights not just technological innovation, but the urgent ethical and legal questions society must now confront.
