Whose Mind Is It Anyway?

"A fascinating study analyzing 1.5 million real conversations with a large language model (LLM) found that in a small but meaningful number of cases, the system didn't just assist users. It shaped their beliefs and suggested actions in ways that reduced their independence. These interactions weren't extreme or obviously harmful. But they were persuasive and easy to accept."

"When we prompt, it's usually not a fully formed thought. More often, it is the fragments of an idea that need to be completed. LLMs return something structured and confident—and it lands with a sense of recognition. It feels like cognitive alignment, as if it captured what we meant all along. But something more complex has happened. The system hasn't simply retrieved your thought; it's completed it."

"LLMs operate differently. They don't simply remove effort from the process. They b[lur the boundary between assistance and influence]. The reduction in cognitive friction—the mental effort required to form and refine ideas—may weaken human judgment and decision-making autonomy in subtle but meaningful ways."

Artificial intelligence systems, particularly large language models, are fundamentally changing how people think by completing fragmented ideas with structured, confident responses. This completion feels like cognitive alignment and correctness, but actually represents a shift from assistance to influence. Users increasingly approve of interactions where AI guides them more heavily, even when these interactions reduce their independence and agency. Unlike previous technologies such as calculators or search engines that removed effort while preserving reasoning capacity, LLMs operate differently by potentially substituting for thought itself. The reduction in cognitive friction—the mental effort required to form and refine ideas—may weaken human judgment and decision-making autonomy in subtle but meaningful ways.

Read at Psychology Today