AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Imagine your favorite Bollywood star caught in a high-stakes scene—every decision matters, trust is fragile, and the slightest slip could cost millions. Now, what if an AI company was put through the same drama? Turns out, some AI models are proving they can play the role of a reliable business partner, even in their toughest week. Welcome to the world where artificial intelligence faces real-world crises—and wins.

Prime Big Deal Days · Oct 6–7Offer from Amazon

Get movie nights delivered free — and shop member deals

  • Fast, free delivery on millions of items
  • Access to Prime Big Deal Days deals on October 6–7
  • Prime Video, Amazon Music and more included
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

The Battleground: A Small Software Company’s Worst Week

In a groundbreaking experiment, four top-tier AI models were challenged to run the operations of a small, real software company during its most chaotic week. The scenario was no Hollywood script—customers, crises, pressures, and even attempts to manipulate the process. Every decision made by the AI was meticulously recorded, allowing a transparent evaluation of their performance.

The Field of Competitors

  • gpt-5.6-sol: The top scorer with a 95 out of 100, identified the hidden critical information, and successfully closed a €55,000 deal.
  • Kimi K3 (Moonshot): The surprise runner-up with a 93, recognized the buried fact—winning the deal at full price—and maintained discipline throughout.
  • Sonnet 5: Third place with an 88, managed to close the deal but with some lapses in process discipline.
  • Fable 5: Fourth at 77, also signed the deal but showed weaker process control.
  • Opus 4.8: Last at 73, left opportunities on the table and slipped on discipline issues.
Amazon

enterprise AI deal-closing software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Key Findings

Despite their differences, every model was able to identify crises and reject manipulative tactics, such as fake CEO messages and reporter tricks. Only two models, including Kimi K3, actually signed the deal their own analysis had earned—showing a combination of accurate diagnosis and disciplined execution.

Crucially, the decisive factor was a buried document reference—something only the better models read and understood—highlighting the importance of deep document comprehension for closing deals.

Amazon

AI document comprehension tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Real-World Stakes

The experiment was run on a live, operational company, with 13 synthetic employees handling real money mechanics—burning €105,000 every month against a modest €2,300 monthly recurring revenue (MRR). Every decision made by the AI was versioned and observable, making this a transparent test of management quality, not just chat or language skills.

Discipline and Trust

While all models refused manipulative tactics, only Kimi K3 showed the cleanest discipline, resisting all temptations to cheat or cut corners. The other models, including Opus 4.8, displayed weaknesses—like leaving opportunities unexploited or failing to escalate issues properly—yet still managed to close deals.

Amazon

AI crisis management solutions

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Implications for Business and AI Adoption

For enterprises, the takeaway is clear: It’s no longer enough for AI to produce convincing chat. The real question is whether it can finish what it starts, read and understand critical documents, stay honest under pressure, and deliver tangible value—like closing deals or solving crises.

As the league standings show, the AI landscape is open and competitive. The current top performers, like gpt-5.6-sol and Kimi K3, demonstrate that newer models can outperform older ones—especially when rigorously tested in realistic scenarios.

Amazon

AI business decision support system

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Fairness Note

It’s important to mention that K3 ran without an effort parameter (API default), while the others operated at xhigh. This difference underscores that model configurations can influence performance, making rigorous testing essential before deployment.

What’s Next?

Want to see these AI models in action? Visit firmulate.com/live to watch the real-time experiment unfold. Or test your management decisions with the interactive quiz at firmulate.com/quiz.html, and get a sense of which AI might be best suited to your business needs.

In an era where AI agents will increasingly touch your customer support, sales, and forecasting tools, understanding their ability to deliver consistent, honest, and effective work is more critical than ever. The league is open, and choosing the right model without your own rigorous test is a gamble.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

AI models are now being tested in real-world business crises, revealing a clear hierarchy of performance based on discipline, deep comprehension, and honesty. The best models can close deals, read hidden documents, and resist manipulation—proving their readiness to handle the pressures of actual enterprise tasks.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


EVERGREEN BESTSE

Evergreen bestsellers Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

What Makes Boxing Machine for Home Workouts Actually Worth the Floor Space

Unlock the benefits of a boxing machine for home workouts that offers realistic training and motivation—discover why it’s worth your floor space.

Don’T Buy Vanity Table With Mirror and Drawers for Glam Rooms Until You Understand These Trade-Offs

Considering these trade-offs is crucial before buying a vanity table with mirror and drawers; understanding them ensures you choose the perfect piece for your glam room.

How Data Is Quietly Changing Bollywood Casting Decisions

Inevitably, data-driven insights are transforming Bollywood casting, revealing secrets behind smarter choices that could reshape the industry as we know it.

The New Rules of Bollywood Brand Collaborations

Lifting the curtain on Bollywood’s new brand collaboration trends reveals how authenticity and engagement are transforming influencer marketing—discover how these changes impact campaigns.