Ethereum co-founder Vitalik Buterin has expressed interest in using AI for formal code verification and bug detection.
One application of AI that I am excited about is AI-assisted formal verification of code and bug finding.
Right now ethereum’s biggest technical risk probably is bugs in code, and anything that could significantly change the game on that would be amazing.
— vitalik.eth (@VitalikButerin) February 19, 2024
“The biggest technical risk for Ethereum right now is probably bugs in the code, and anything that could significantly change the situation would be amazing,” he wrote.
However, OpenZeppelin previously obtained mixed results when experimenting with OpenAI’s GPT-4 for auditing smart contracts written in Solidity, Ethereum’s native programming language.
At that time, Mariko Wakabayashi, head of the firm’s machine learning division, noted in a Cointelegraph article in July 2023 that the chatbot identified vulnerabilities in only 20 out of 28 tasks. According to her, in some cases, the results were “frankly poor.” Sometimes the neural network required leading questions, and once it invented a bug that did not exist.
Wakabayashi also noted that Coinbase specialists achieved similar results when experimenting with token security audits using ChatGPT.
“AI itself will not replace humans. However, auditors who learn to use these tools will be much more effective than those who turn a blind eye to new technology,” she concluded.
In comments to the publication, CertiK’s Director of Security Kang Li stated that using solutions like ChatGPT in coding often creates more vulnerability issues than it solves. Overall, he recommended using AI tools only as assistants to experienced programmers.
“I think ChatGPT is a great useful tool for people involved in code analysis and reverse engineering. It is definitely a good assistant and will significantly enhance our efficiency,” Li emphasized.
In January, Buterin explored the prospects of AI and cryptocurrency technologies interacting, highlighting four promising opportunities for synergy.