Omid Ashtari, Founder of UK AI Gaming Companion Kult: Routing Decisions by Confidence Level with Lightweight Models Answering First and Escalating When Uncertain
Omid Ashtari, founder and CEO of London-based startup Kult, explains in a Google Cloud blog post the model routing architecture for its AI gaming companion: Gemini Flash handles every conversational turn, heavy models are used only once per game for deep reasoning, and a decision-specific model named Jev determines when to escalate based on calibrated confidence scores. This architecture allows a small team to support over 100 games while meeting consumer product requirements for latency, accuracy, and cost.
An AI gaming companion sitting next to a player must simultaneously satisfy three contradictory requirements: answers must be fast (games are real-time), accurate (each game has its own items, systems, and vocabulary), and low-cost (an always-on companion handles multiple turns per session, each of which must be cheap enough for a consumer product). Omid Ashtari, founder and CEO of London-based startup Kult, explained in a Google Cloud blog how they solved this trilemma using a model routing architecture.
The core idea is not to select a single model, but to let different tiers of models do their respective jobs. The lightest tier, Gemini Flash, handles high-frequency repetitive work—Kult initiates thousands of small calls for every game added. Gemini Flash runs every conversational turn: it determines what the player is asking and writes an answer based on Kult's self-built game knowledge base, fast enough to keep up with the pace of play. Meanwhile, the newest and heaviest Gemini models handle rare, deep reasoning tasks performed once per game. Ashtari noted that the latest Flash models have achieved a balance of price, speed, and quality that they could not find elsewhere, which is precisely why an always-on gaming companion can function as a viable consumer product.
However, tiering alone is insufficient; a mechanism is needed to decide when to upgrade. Kult uses a decision-specific model named Jev to handle such judgments: it does not write content, but returns a choice along with a calibrated confidence score. Cases with high confidence are resolved in a fraction of a second at minimal cost, while uncertain cases are escalated to larger Gemini models. Ashtari explained that much of the work in the system is inherently about decision-making rather than writing—it needs to understand which game the query concerns, whether the question requires a lookup, and whether the answer covers the key points. These decisions do not require large models, but they do need to be reliable.