Nudification applications enable misuse of artificial intelligence to generate deepfake images by removing clothing from individuals in photos or videos. Such tools have produced non-consensual sexual imagery, an illegal act. These programs appear on both regulated and unregulated online platforms.
Apple and Google, operators of major app marketplaces, face criticism in San Francisco for hosting multiple nudification applications, according to TechCrunch. City officials sent several complaint letters regarding the apps, yet initial responses were limited. Both companies later stated they enforce policies against violations and have since removed the offending applications.
California maintains strict rules against sexual deepfakes created with generative AI. Officials increased oversight after an AI chatbot permitted widespread creation and distribution of non-consensual imagery earlier this year. Five anonymous young women and girls filed lawsuits against xAI and Stability AI, claiming their images were used to produce child sexual abuse material. The plaintiffs expressed fear that online deepfakes could lead to real-world stalking.
