AI and the 'Software Brain': Why Are People Rejecting Automation?

The Chasm Between Industry and Reality

There is a growing disconnect between Silicon Valley's enthusiasm for artificial intelligence and public perception. While executives celebrate breakthroughs in machine learning and large language models (LLMs), polls show unprecedented pushback. Recent data reveals that Gen Z, despite being the most frequent users of these tools, expresses the highest levels of skepticism and frustration toward the technology.

The problem is not one of marketing, as industry leaders suggest. People don't need to be sold on the benefits of AI; they are experiencing its effects in their daily lives, and they often don't like what they see.

What is the 'Software Brain'?

The concept of the software brain defines the industry's tendency to view the world as a series of databases that can be controlled through code. This vision, which fueled the rise of companies like Zillow or Uber, assumes that if something can be measured, it can be optimized. However, this mental framework has an insurmountable limit: reality is not a deterministic system.

"Humans are not computers, and we do not live in automatable loops that can be captured in databases."

When the industry attempts to apply this logic to complex sectors like law or labor, a collision is inevitable. As we analyzed in Sam Altman and AI Ethics: A Leader Without Limits on the Truth?, the management of these tools often ignores human and social implications in favor of algorithmic efficiency.

The Fallacy of Total Automation

The premise that AI will replace jobs—from entry-level consulting roles to creative tasks—is not a promise of progress for the average citizen, but a threat. The key points of this conflict are:

• The loss of humanity: People are asked to become "legible" to software, surrendering personal data, calendars, and communications to make models more accurate.
• The inefficiency of forced automation: Attempting to connect disparate systems (email, work, health) generates friction rather than value.
• The rejection of surveillance: The massive integration of AI into daily life is perceived as a constant intrusion into privacy.

Conclusion: Design Must Adapt to People

Historically, successful tech products are those that adapt to users, not the other way around. Demanding that society conform to the needs of a database is a fundamental strategic error. Technology should serve to empower, not to turn the human experience into a stream of optimized data. As long as the industry continues to ignore that people do not wish to be automated, the trust gap will continue to widen, regardless of the power of new language models.

Sources:

• The Verge: The People Do Not Yearn for Automation (2024)