Consultation on AI Models and Personal Data: Insights for Data Protection Experts (Germany)

As artificial intelligence continuously evolves, it has brought to light new challenges in data protection, especially concerning AI models trained with vast amounts of personal data. The Federal Commissioner for Data Protection and Freedom of Information (BfDI) has initiated a comprehensive consultation process to address the data protection-compliant handling of personal data within AI models. This initiative is particularly significant for data protection professionals as it seeks to navigate the intricate landscape of legal and technical complexities.

Understanding Key Challenges:

Memorization Concerns: The European Data Protection Board (EDPB) clarified in their statement 28/2024 that AI models could memorize personal data. The term “memorization” encompasses verbatim and paraphrased reproductions, both being relevant when such data can identify individuals. This issue prompts a crucial analysis of how AI models handle personal data, urging experts to consider data protection from the design phase through to application.

Consultation Objectives: The primary goal of this consultation is to gather practical experiences, technical assessments, and normative considerations from a broad spectrum of stakeholders. A particular focus is placed on large language models, with the BfDI keen on developing data protection-compliant strategies for dealing with memorized data.

Practical Applications and Responses:

Technical Measures: Data protection specialists are encouraged to contribute insights into effective techniques to prevent data memorization. This includes deduplication, using anonymized data, and differential privacy. Sharing experiences with these methods could shape best practices for managing personal data in AI models.

Extracting Personal Data: The potential for extracting personal data from language models is a crucial concern. Experts are invited to provide risk assessments and examples of how personal data might be extracted, necessitating precautionary measures in AI training protocols.

Ensuring Individuals’ Rights: Given the opaque nature of AI systems, safeguarding individuals’ rights—such as access, rectification, and deletion under GDPR—presents a challenge. Contributions on how organizations address these rights within AI contexts are vital.

Engagement Opportunities:

The consultation is open to all interested parties, particularly those from academia, industry, and civil society. Responses are requested by August 10, 2025, highlighting the urgency and importance of timely participation.

This consultation serves merely as an information-gathering exercise, not as a preemptive decision, emphasizing the exploration of both technical and legal facets of AI data processing. For additional information on contributing to this pivotal consultation, professionals are encouraged to refer to the full document available as a PDF.

Original source link: [Federal Commissioner for Data Protection and Freedom of Information](https://www.bfdi.bund.de/DE/BfDI/Konsultationsverfahren/KI-Modelle-pbD/KI-Modelle-pbD_node.html).