Asset 20 8 2
Does AI recommend your business? Run the free check →

Join 15,000 business owners, marketers and entrepreneurs. The Sunday newsletter you'll be annoyed only arrives once a week.

Article

Casino games serve as test beds for AI research, from blackjack to poker

If you are skim reading
Casino games have quietly become some of the most useful test beds in AI research, and the reason is mathematical rather than commercial.

Casino games have quietly become some of the most useful test beds in AI research, and the reason is mathematical rather than commercial.

Games have served artificial intelligence research for decades because they offer something real-world systems rarely do: tightly defined rules, measurable outcomes and experiments that can be repeated under controlled conditions.

Blackjack and poker occupy different points on that spectrum. In simplified research environments, blackjack reduces decision-making to a compact sequence of choices under random outcomes. Poker adds concealed information, adaptive opponents and strategic signalling under uncertainty. The appeal to computer scientists lies in those formal properties, not in gambling as a commercial activity.

A casino game can therefore become a laboratory for algorithms when its mechanics isolate a problem researchers want to study.

AI research lab testing algorithms on blackjack and poker tables

Blackjack turns chance into a learning problem

In a simplified reinforcement-learning environment, blackjack can be represented as an episodic Markov decision process. The agent may observe variables such as its current total, the dealer's visible card and whether it holds a usable ace. It chooses an action, receives a result and begins another episode.

The arrangement is simple enough to audit but rich enough to test learning methods. Monte Carlo techniques, for example, allow an agent to estimate the value of decisions from completed simulated hands without requiring every transition probability to be supplied in advance.

Researchers can alter the state representation, exploration policy or learning method and measure the effect. That makes simplified blackjack useful as a benchmark: the problem is constrained, repeatable and comparatively easy to reproduce.

Those properties also impose limits. Instructional environments specify particular rules and state representations while omitting parts of real table play. An algorithm that learns an effective policy has solved the model presented to it, not blackjack in every form and certainly not gambling in general.

Poker introduces an opponent with private information

Poker changes the nature of the problem.

Players do not have access to the same information. Private cards are concealed, public cards appear over time and actions can themselves carry information. A large bet might reflect a strong hand, an attempt to represent one or strategic signalling intended to influence another player's decisions.

An AI system must therefore reason over beliefs rather than a fully visible state.

That separates poker from perfect-information games such as chess and Go. Search remains important, but the program cannot simply inspect a board on which all strategically relevant information is visible. Heads-up limit Texas Hold'em alone contains more than 1014 information sets, according to the Cepheus research that essentially solved that version of the game (Bowling et al., Science, 2015).

The difficulty is not only scale. It comes from making decisions when another agent possesses private information and acts strategically.

Regret minimisation gave poker AI a different toolkit

Counterfactual regret minimisation, or CFR, became a central method for tackling large imperfect-information games.

Work with me

Want AI doing the heavy lifting in your marketing?

I build the systems that handle the boring 80 percent, so you get your week back. Done properly, with the human kept in.

CFR tracks cumulative counterfactual regret for actions at individual information sets: roughly, how much better an alternative would have performed under the relevant counterfactual conditions. Regret matching uses those values to generate successive strategies, while strategy averaging is used to obtain the resulting solution. In two-player zero-sum settings, reducing regret through self-play provides a route toward approximate equilibrium.

That framework became part of a broader line of poker AI research. DeepStack combined recursive reasoning, decomposition and value estimates learned through self-play to tackle heads-up no-limit Texas Hold'em (Moravčík et al., Science, 2017). Libratus used a blueprint strategy, nested subgame solving and a self-improving component in the same two-player format (Brown and Sandholm, Science, 2018).

Pluribus then extended the research challenge to six-player no-limit poker (Brown and Sandholm, Science, 2019). The distinction matters theoretically. The clean equilibrium guarantees associated with two-player zero-sum settings do not transfer to multiplayer poker in the same form; the Pluribus researchers therefore used an approach designed for the additional strategic complications of several independent opponents.

Blackjack and poker expose different forms of uncertainty

In the simplified blackjack model, the main uncertainty is stochastic: the next card has not yet been revealed, while dealer behaviour follows fixed rules.

Poker adds another layer. Opponents choose actions strategically, hold private information and may change their behaviour in response to yours.

That is why poker remained an important AI benchmark after major advances in chess and Go. The challenge was not simply to search deeper. It was to make defensible decisions when the complete state could never be directly observed.

The algorithms travel further than the games

Similar mathematical structures appear outside card games. Negotiators can hold private preferences, auction participants have hidden valuations, and cybersecurity problems can place attackers and defenders in environments where neither has complete knowledge of the other's position.

The transfer is methodological. A poker algorithm does not automatically become a negotiation or cybersecurity system. Real applications introduce different incentives, laws, constraints and consequences.

The boundary with real-money gambling is equally important. In Great Britain, businesses providing remote gambling to consumers require appropriate Gambling Commission licensing under the Commission's remote-sector framework. Academic blackjack and poker experiments address algorithmic problems rather than providing a reliable strategy for financial gain.

Gambling carries financial risk and should not be treated as a source of income. Spending and time limits, breaks, self-exclusion and professional support are appropriate safeguards when control becomes difficult.

What blackjack and poker mean for AI research

The scientific value of these games lies in the problems they expose. Blackjack offers a compact environment for learning under stochastic outcomes. Poker asks the harder strategic question: how should an algorithm act when another decision-maker knows something it does not?

Published and maintained by the Lilach Bullock team, covering marketing, AI and business growth.
Your buyers are asking AI who to use. Does it say you?

See for free whether ChatGPT, Claude, Perplexity, Gemini and Google name you, and get the plan to become the answer.

Check my AI visibility →
Sundays only

Get the Sunday newsletter.

One email a week. AI experiments, marketing tactics, and the workflows Lilach is building right now in her own business.

Subscribe free

Let’s get your marketing running on AI.

Book a free 30-minute call

We figure out what you need, where AI fits in, and what working together would look like.

Book the call →

Or take the 30-second calculator

You’ll see the hours and the money quietly leaking out of your week, and the three workflows worth building first.

Take the calculator →

Or grab the free AI resource library

Prompt packs, templates, checklists, and swipe files. The exact tools I build for paying clients. Yours, free.

Get the library →
Keep reading

More from the blog.