OpenAI Co-founder Predicts End of AI Training Data Era

OpenAI co-founder Ilya Sutskever has forecasted the end of the era of pre-training artificial intelligence and predicted the emergence of superintelligence. He made this statement at the NeurIPS 2024 conference in Vancouver, Canada.

According to him, the growth in computational power due to improvements in algorithms, hardware, and software is outpacing the total volume of data available for training AI models. The researcher compared existing information to fossil fuels, which will eventually run out.

“Data is not growing because we have only one internet. […] They were created in some way, and now we are using them, and we have reached the peak, there will be no more — we will have to deal with the information that exists,” Sutskever emphasized.

The OpenAI co-founder believes that AI agents, synthetic data, and accelerated computing are the next stage in the evolution of artificial intelligence, which will lead to the emergence of superintelligence.

AI agents are neural networks capable of independently performing operations on the internet, such as booking a flight or hotel.

In October, AI startup Anthropic released an updated version of the Claude 3.5 Sonnet model. It can interact with a computer like a human: moving the cursor, clicking buttons, and typing text.

In December, Google introduced its first AI agent capable of acting independently on the internet.

Earlier, similar developments from OpenAI were reported.