The European Commission has unveiled plans to potentially criminalize the dissemination of artificial intelligence (AI)-generated images depicting child sexual abuse (CSA) and deepfakes, aiming to modernize legislation in response to technological advancements. Among the proposed measures are new criminal offenses targeting live streaming of child sexual abuse and the possession or distribution of "paedophile manuals", with a specific mention of AI chatbots implicated in child exploitation.
These proposals represent an effort to update rules established in 2011, introducing amendments that address mandatory reporting obligations and enhance legal provisions to combat child sexual abuse. Part of a broader strategy to prevent such crimes, the package seeks to raise awareness of online risks, encourage victim reporting, and provide support services, including avenues for financial compensation.
An impact assessment conducted prior to the proposal's drafting underscored the rise in online activity and the evolution of technology as contributing factors to increased risks of child sexual abuse. To mitigate these dangers, member states are encouraged to invest in educational campaigns aimed at enhancing awareness among children and caregivers alike.
Concerns have mounted regarding the misuse of technology to produce falsified CSA material, complicating the task of law enforcement in identifying genuine victims. This has prompted calls for a review of existing regulations to address emerging challenges effectively. However, the final version of the proposal will be shaped through negotiations between the European Parliament and the European Council.
The legislative process involves deliberations between the Commission, Parliament, and Council, with opportunities for modifications and revisions to ensure consensus. Once an agreement is reached, the amended directive will take effect upon publication in the Official Journal of the European Union. This initiative aligns with previous legislative efforts, such as the 2022 proposal mandating digital services to implement automated detection systems for CSA material, highlighting the Commission's ongoing commitment to safeguarding vulnerable populations in the digital age.
