Speculation Arises Over gpt2-chatbot as Potential Successor to GPT-4 from OpenAI

The LMSYS Chatbot Arena Leaderboard has unveiled a chatbot named gpt2-chatbot, which is likely developed by OpenAI.

Users who have interacted with the model noted a significant advancement over GPT-4 Turbo. According to them, the chatbot’s responses are more precise, and the tool can identify subtle logical and associative links.

I found one task that gpt2-chatbot is better than all other models, and it’s completely useless.
Early but rapid ascent on the A+B-1 question by @Kangwook_Lee pic.twitter.com/xwOfnB1r03

— Dimitris Papailiopoulos (@DimitrisPapail) April 29, 2024

One user asked gpt2-chatbot to solve an International Math Olympiad problem. The chatbot succeeded on the first attempt, a feat not always achieved by existing language models.

uh…. gpt2-chatbot just solved an International Math Olympiad (IMO) problem in one-shot

the IMO is insanely hard. only the FOUR best math students in the USA get to compete

prompt + its thoughts ? https://t.co/CuO0ToJmb9 pic.twitter.com/3xxWPvtmuG

— Andrew Gao (@itsandrewgao) April 29, 2024

Other users attempted to generate Python code for the game “Snake” using the chatbot.

This was the game it gave me! Code it right in the first try pic.twitter.com/ihMhBR9BAo

— Alvaro Cintas (@dr_cintas) April 29, 2024

Why gpt2-chatbot is Linked to OpenAI

Following the model’s appearance on LMSYS, users on X began speculating about the origins of gpt2-chatbot. The first clue suggesting a connection to OpenAI is the use of the GPT abbreviation in the chatbot’s name. The California-based startup invented and popularized it, although it failed to trademark it.

One user claims that the tool directly named OpenAI as the model’s developer.

No, OpenAI pic.twitter.com/PioFY7K1a6

— Ted Punt (@punt_ted) April 29, 2024

Moreover, on the night of April 30, OpenAI CEO Sam Altman acknowledged gpt2-chatbot.

“I have a soft spot for gpt2,” he wrote on X.

Altman rarely comments on rumors surrounding his company’s developments. Therefore, many users interpreted his tweet as a hint of the startup’s involvement with gpt2-chatbot.

Successor to GPT-4, a New Model, or an Old Development

Enthusiasts believe the chatbot could be GPT-4.5 or the next version, GPT-5. Some suggested it might be the original GPT-4 without the limitations imposed by developers before its release.

The number in the name might be misleading. The original GPT-2 model was released in November 2019 and lacked the capabilities of its successors. However, there is a theory that GPT2 represents the second iteration of all OpenAI models, rather than a traditional sequential number.

Anyone Can Try gpt2-chatbot

While the public awaits news from OpenAI, anyone can independently test gpt2-chatbot’s capabilities. To do so, one must visit the LMSYS site and select the Direct Chat section.

Then, in the dropdown list, find gpt2-chatbot and scroll down to the text input field.

Unfortunately, the direct chat is limited to 1000 messages per hour for all platform users. Due to high demand, accessing it becomes more challenging.

However, it can be encountered in Arena (battle) mode, where two models are randomly selected for “blind” comparison. In this case, one must spend some time to encounter gpt2-chatbot.

Back in November 2023, OpenAI introduced its most current model, GPT-4 Turbo.