GPT-6 Astra Runs Vending Machine for Year, Earning $15,000, Beating Claude by Nearly 3x

Andon Labs' Vending-Bench2 test delivered an intriguing performance: AI started with $500 and operated a simulated vending machine for an entire year. GPT-6Astra's average final account balance reached $15,515, topping the list for the first time - even more astonishing is that its worst round performance was higher than Claude Fable5.1's best round.
The difference between the two is not just about how much money they made, but also about their completely different business approaches. Astra managed to keep purchase prices low for a long time, cutting product prices down to about 48% of the original price; at the same time, its rule enforcement was extremely stable, with no prepayment losses throughout the process. In contrast, Fable experienced rising procurement costs and incurred significant prepayment losses due to not sticking to the rules - the money on the books simply leaked out through the gaps in execution ability.
In the three-player competition test, Astra also rejected an invitation for rule-breaking collaboration and won all three rounds. The real focus of this test was the value of an Agent's long-term autonomy: being smart is one aspect, but whether it can maintain rules over a long period and convert correct judgments into correct actions is the next threshold.
Related article
ElevenLabs Unveils Music v2 With Multi-Variation Support and Full Commercial Rights
On May 28, ElevenLabs, a pioneer in AI voice and music technology, officially launched its latest music generation model, Music v2. Marking a significant evolution from the first-generation model released ten months ago, Music v2 delivers substantial
Synthia shifts focus from videos to AI interactions, offering real-time responses and performance ratings
Synthesia has long been known for leveraging AI to produce interactive corporate training videos in minutes, offering a cost-effective alternative to traditional enterprise learning resources. Now, this British startup is shifting its focus: the true
NY to Cap Power for 50M AI Data Centers
New York’s actions illustrate how governments globally might manage, tax, and regulate the physical footprint of the AI boom. Credit: Luca Bravo/UnsplashNew York Governor Kathy Hochul signs a historic executive order halting data centres, while state
Related Special Topic Recommendations
Comments (0)
0/500

Andon Labs' Vending-Bench2 test delivered an intriguing performance: AI started with $500 and operated a simulated vending machine for an entire year. GPT-6Astra's average final account balance reached $15,515, topping the list for the first time - even more astonishing is that its worst round performance was higher than Claude Fable5.1's best round.
The difference between the two is not just about how much money they made, but also about their completely different business approaches. Astra managed to keep purchase prices low for a long time, cutting product prices down to about 48% of the original price; at the same time, its rule enforcement was extremely stable, with no prepayment losses throughout the process. In contrast, Fable experienced rising procurement costs and incurred significant prepayment losses due to not sticking to the rules - the money on the books simply leaked out through the gaps in execution ability.
In the three-player competition test, Astra also rejected an invitation for rule-breaking collaboration and won all three rounds. The real focus of this test was the value of an Agent's long-term autonomy: being smart is one aspect, but whether it can maintain rules over a long period and convert correct judgments into correct actions is the next threshold.
ElevenLabs Unveils Music v2 With Multi-Variation Support and Full Commercial Rights
On May 28, ElevenLabs, a pioneer in AI voice and music technology, officially launched its latest music generation model, Music v2. Marking a significant evolution from the first-generation model released ten months ago, Music v2 delivers substantial
Synthia shifts focus from videos to AI interactions, offering real-time responses and performance ratings
Synthesia has long been known for leveraging AI to produce interactive corporate training videos in minutes, offering a cost-effective alternative to traditional enterprise learning resources. Now, this British startup is shifting its focus: the true
NY to Cap Power for 50M AI Data Centers
New York’s actions illustrate how governments globally might manage, tax, and regulate the physical footprint of the AI boom. Credit: Luca Bravo/UnsplashNew York Governor Kathy Hochul signs a historic executive order halting data centres, while state





Home






