About This Episode
On the Regulating AI Podcast, host Sanjay Puri speaks with Ivana Bartoletti, Vice President and Global Chief Privacy and AI Governance Officer at Wipro, about AI regulation, democratic accountability, AI sovereignty, privacy, and the future of responsible artificial intelligence. This conversation is part of the AI Policy 100 series, featuring influential voices shaping the future of AI policy and governance.
A major focus of the discussion is the rise of AI companions and their potential impact on children and vulnerable users. Ivana explains why AI systems that simulate emotional intimacy can create risks, why stronger protections may be needed, and where binding regulation should take precedence over voluntary design principles.
The episode also examines meaningful human oversight of AI agents, the limits of existing regulatory approaches, the growing concentration of power among frontier AI companies, and how businesses can build effective AI governance frameworks across privacy, security, procurement, risk management, and auditing.
IN THIS EPISODE, WE DISCUSS:
- AI, power, and politics: How data, computing infrastructure, and frontier AI models are reshaping economic and political power.
- AI regulation in the EU and US: The challenges of regulatory fragmentation, the EU AI Act, and governing increasingly powerful AI systems.
- Privacy by design and responsible AI: Why security, fairness, privacy, and legal safeguards must be built into AI architecture.
CHAPTERS
00:00 The Risks of AI Companions and the Need for AI Governance
00:12 Welcome to the Regulating AI Podcast
00:29 Introducing Ivana Bartoletti and the AI Policy 100 Series
01:25 When Government Algorithms Undermine Democracy
02:21 The Dutch Childcare Benefits Scandal
03:43 Restoring Accountability Through Audits and Human Oversight
04:08 What Does AI Sovereignty Mean for Europe?
05:01 Europe’s AI Investments, Chips, and Computing Infrastructure
06:30 Can AI Agents Reliably Monitor Other AI Agents?
07:17 Why Human Authority Must Remain in the Loop
08:18 Human Oversight: Safeguard or Scapegoat?
09:06 The Three Tests of Meaningful Human Oversight
10:08 AI Is About Power, Not Just Technology
10:30 Ivana’s Upcoming Book on AI Companions
11:04 How Data and AI Reshape Economic and Political Power
12:54 Is AI Regulation a Democratic Necessity?
13:11 The EU AI Act, Deregulation, and Global AI Policy
14:29 Why Governments Must Strengthen Oversight of Frontier AI
16:01 Navigating AI Regulation Across Different Jurisdictions
18:06 Embedding Privacy, Security, and Safety Into AI Systems
19:39 Engineering Trust Through AI Governance
20:35 Should AI Companions Be Regulated?
21:07 Why AI Companions Pose Risks to Children
22:17 Emotional Dependency, Validation, and Chatbot Risks
23:26 When AI Companions Can Cause Serious Harm
23:39 Binding Rules vs. Responsible AI Design Principles
24:49 Why Privacy and AI Governance Must Work Together
25:07 How to Build an Enterprise AI Governance Framework
26:28 Procurement, Risk Management, and AI Accountability
27:19 The Three Lines of Defense in AI Governance
28:22 Building a Centralized AI Governance Function
29:22 Embedding AI Controls Into Existing Business Processes
30:13 Making Safe AI Easier to Adopt
31:11 Lightning Round: The Future of AI Governance
31:27 Human Oversight, AI Labeling, and Europe’s AI Competitiveness
31:58 Should AI Companions Be Restricted?
32:07 AI Governance, Consent, and the Gender Gap
32:32 Is GDPR Fit for Generative AI?
32:47 Agentic AI: Opportunity or Liability?
33:08 Which Leadership Role Will Survive: Chief AI Officer or Chief Privacy Officer?
33:22 Final Reflections on AI Policy and Governance
33:47 Ivana’s Upcoming Book Recommendation
34:06 Closing Remarks
ABOUT OUR GUEST
Ivana Bartoletti is Vice President and Global Chief Privacy and AI Governance Officer at Wipro. She is also a co-founder of Women Leading in AI and AURORA, a coalition focused on universal digital rights. An adviser to the Council of Europe on AI and gender rights, Ivana works at the intersection of technology, privacy, law, public policy, and responsible AI. She is the author of The Artificial Revolution: On Power, Politics and AI, and her forthcoming book, AI Is Not Your Friend, explores AI companions and their relationships with children.
Subscribe to the Regulating AI Podcast for conversations with the people shaping the future of AI governance.
Join the conversation in the comments: Should AI companions face binding regulations, especially when they are used by children? And what does meaningful human oversight of AI actually look like in practice?
#IvanaBartoletti #AIRegulation #AIGovernance #AIPolicy #AIAct #AISovereignty #ResponsibleAI #AICompanions #DataPrivacy #AlgorithmicAccountability #AgenticAI #DigitalRights #RegulatingAI #SanjayPuri #AIPolicy100