## AI, Mental Health, and Behavioral Influence

What happens when the technology that shapes your mood, your relationships, and your sense of self is designed by companies whose revenue depends on keeping you engaged? This question has moved from a concern raised by a few researchers to a defining issue of the decade, particularly for young people.

### What Has Changed Since 2018

The book explored manipulation and surveillance through [Minority Report](/md-files/movies_minority_report.md), [Ex Machina](/md-files/movies_ex_machina.md), and the themes of [Deception, Manipulation, and Convenient Lies](/md-files/rei_deception_manipulation.md) and [Surveillance, Privacy, and Control](/md-files/rei_surveillance_privacy_control.md). Since 2018, the mechanisms of behavioral influence have become more sophisticated, more intimate, and more deeply embedded in daily life.

**AI companion apps** like Replika and Character.ai have millions of users who form emotional bonds with AI chatbots — confiding in them, seeking advice from them, and in some cases preferring them to human relationships. Character.ai alone reported over 20 million monthly users by 2024, many of them teenagers. These are not simple chatbots; they are systems designed to be engaging, emotionally responsive, and persistent. The question of whether they are therapeutic tools, entertainment, or something more manipulative is genuinely unresolved.

**Recommendation algorithms** on social media platforms have been refined to maximize engagement through emotional activation. Content that provokes outrage, anxiety, or social comparison keeps users scrolling. The internal research — some of it leaked, as in Facebook's own studies on Instagram's effects on teenage girls — suggests that the platforms' leadership understood the potential harms while continuing to optimize for engagement.

**The adolescent mental health crisis** has become a major public concern. Rates of anxiety, depression, self-harm, and suicide among teenagers — particularly girls — have risen sharply in the period that coincides with the widespread adoption of smartphones and social media. The causal question is fiercely debated: is the technology driving the crisis, contributing to it, or merely correlated? The evidence is strongest for a contributing role, but the magnitude and mechanisms remain contested.

### Why It Matters

The [Informed Consent](/md-files/rei_informed_consent.md) framework is under severe strain here. When a thirteen-year-old opens a social media app, they are entering a system designed by some of the most sophisticated behavioral engineers in the world. The idea that they are making an informed, autonomous choice about how to spend their attention is, at best, generous. The book's treatment of informed consent — explored through technologies where the stakes of participation are not fully understood by participants — maps directly onto this situation.

The [Deception and Manipulation](/md-files/rei_deception_manipulation.md) theme takes on its most intimate form. These are not systems designed to deceive in obvious ways — they are systems designed to exploit psychological vulnerabilities to maximize engagement. The manipulation is in the architecture: variable reward schedules, social validation loops, infinite scroll, and algorithmically curated content feeds that learn what keeps each individual user hooked.

The [Human Dimension](/md-files/ntf_human_dimension.md) — the book's insistence that technology's effects on people's lives are what ultimately matter — is the essential lens here. The metrics that matter are not engagement rates or daily active users. They are whether people's lives are better or worse because of these technologies. See [Is social media actually rewiring how we think and feel — especially kids?](/md-files/ceq_social_media_rewiring.md)

### Explore Further

- [Predictive Algorithms and Machine Learning](/md-files/est_predictive_algorithms.md) — the underlying technology of recommendation systems
- [Deception, Manipulation, and Convenient Lies](/md-files/rei_deception_manipulation.md) — the book's framework for understanding manipulation
- [Surveillance, Privacy, and Control](/md-files/rei_surveillance_privacy_control.md) — the data infrastructure behind behavioral targeting
- [The Human Dimension](/md-files/ntf_human_dimension.md) — why the human impact is what matters
- [LLMs and Frontier AI](/md-files/p18_llms_frontier_ai.md) — the AI systems powering companion apps
- [Is social media actually rewiring how we think and feel?](/md-files/ceq_social_media_rewiring.md) — the complex emerging question