Site iconSite icon ForkLog

Vitalik Buterin Criticizes Excessive Autonomy in AI

Vitalik Buterin Criticizes Excessive Autonomy in AI

Ethereum co-founder Vitalik Buterin has criticized the trend towards creating “overly agentic” AI models. He called for increased human oversight to enhance quality and safety.

“It frustrates me that many AI developers strive for maximum system autonomy, although in reality, more opportunities for human control not only improve results (both now and in the future) but also enhance safety,” he wrote.

Buterin responded to a post by former Tesla AI director Andrej Karpathy, who noted that large language models are becoming too independent due to optimization for long-term tasks. For instance, in programming, they spend a long time analyzing even the simplest requests.

“While this is justified for prolonged tasks, such an approach is less applicable to active iterative development or quick checks before script execution. I regularly interrupt AI with commands: ‘Stop analyzing. Limit yourself to this file. No additional tools. No redundant solutions,'” he emphasized.

Buterin supported his position, stating that excessive AI autonomy reduces efficiency. In his view, open models with editing functions are much better than those creating content from scratch.

The Ethereum co-founder sees potential in the brain-computer interface, which tracks user reactions to generated content in real-time and adapts accordingly. This would allow AI to consider intentions and expectations. Current models, he says, often ignore such nuances, reducing their usefulness.

Community Reaction

Besides Buterin, many users supported Karpathy’s position.

“I canceled Cursor yesterday for this reason — it constantly thinks five steps ahead in the wrong direction. I’m back to manually copying responses from ChatGPT/Claude/Gemini,” noted AI enthusiast barry farkus.

Software engineer Kaan Karakas added that existing AI-based models tend to overcomplicate. According to him, “this is good for deep analysis, but it slows down simple checks.”

However, not everyone agreed with the AI expert’s viewpoint. A user named Conor stated that Karpathy is discussing default behavior, which can be changed.

“You can clearly instruct the model in the prompt about what you want (for example, literally paste this tweet into the system instructions and write something like: ‘pay attention to this when executing the request’). I’m not against default behavior being more autonomous, but yes — if your tasks go beyond these limits, you’ll need to give clear instructions,” he commented.

On August 8, OpenAI released its flagship AI model GPT-5.

Exit mobile version