Skip to content
Adaptive

Learn Decision Theory

Read the notes, then try the practice. It adapts as you go.When you're ready.

Session Length

~17 min

Adaptive Checks

15 questions

Transfer Probes

8

Lesson Notes

Decision theory is the interdisciplinary study of how rational agents select actions among available alternatives when outcomes are uncertain. Drawing on mathematics, philosophy, economics, psychology, and statistics, it provides formal frameworks for analyzing choices by modeling preferences, beliefs, and the structure of decision problems. At its core, decision theory asks what it means to make a good decision and whether there are systematic principles that rational decision-makers should follow.

The field divides into two major branches: normative decision theory and descriptive decision theory. Normative (or prescriptive) decision theory investigates how decisions should be made under ideal rationality, producing frameworks such as expected utility theory, Bayesian decision theory, and minimax strategies. Descriptive decision theory, by contrast, examines how people actually make decisions, incorporating findings from psychology and behavioral economics about systematic departures from rationality, such as those documented by Prospect Theory and satisficing behavior.

Decision theory has far-reaching applications across disciplines. In economics, it underpins models of consumer choice and market behavior. In artificial intelligence, it guides the design of autonomous agents that must act under uncertainty. In medicine, it informs clinical decision analysis and evidence-based treatment selection. In philosophy, it raises deep questions about rationality, free will, and the nature of preference. The field continues to evolve through connections with game theory, information theory, and computational approaches to bounded rationality.

You'll be able to:

  • Explain the foundations of rational choice including utility theory, expected value, and preference axioms
  • Apply decision matrices and decision trees to structure choices under conditions of risk and uncertainty
  • Analyze cognitive biases and heuristics that systematically distort human judgment in complex decision environments
  • Evaluate normative versus descriptive decision models and their implications for policy design and organizational strategy

One step at a time.

Key Concepts

Expected Utility Theory

A normative framework holding that a rational agent should choose the action that maximizes the weighted average of utilities across all possible outcomes, where weights are the probabilities of each outcome occurring.

Example: When deciding whether to carry an umbrella, you implicitly weigh the utility of staying dry (times the probability of rain) against the disutility of carrying it unnecessarily (times the probability of no rain).

Bayesian Decision Theory

An approach that combines Bayesian probability (updating beliefs based on evidence) with utility theory to determine optimal actions. The decision-maker assigns prior probabilities to uncertain states, updates them with new evidence, and chooses the action maximizing expected utility.

Example: A doctor uses Bayesian reasoning when updating the probability of a disease after receiving test results, then deciding whether to treat based on the expected utility of treatment versus no treatment.

Decision Under Uncertainty vs. Risk

Decision under risk involves known probability distributions over outcomes, while decision under uncertainty (or ambiguity) involves unknown or imprecise probabilities. Different decision rules apply to each: expected utility works under risk, while maximin or minimax regret may apply under uncertainty.

Example: Choosing between lottery tickets with known odds is decision under risk; choosing whether to invest in an entirely new market with no historical data is decision under uncertainty.

Minimax and Maximin Strategies

Conservative decision rules for situations of deep uncertainty. Maximin selects the action whose worst-case outcome is best (maximizing the minimum payoff). Minimax regret selects the action that minimizes the maximum possible regret across all states of the world.

Example: A general planning a military operation under complete uncertainty about enemy positions might use maximin, choosing the strategy that guarantees the least-bad outcome regardless of what the enemy does.

Von Neumann-Morgenstern Utility Theorem

A foundational result proving that if a decision-maker's preferences satisfy certain axioms (completeness, transitivity, continuity, and independence), then their preferences can be represented by a utility function, and they will act as if maximizing expected utility.

Example: If you consistently prefer coffee to tea, and tea to juice, and your preferences are stable when lotteries over these options are introduced, then a utility function exists that captures your preference ordering.

Rational Choice Theory

The framework assuming that individuals make decisions by selecting the option that best satisfies their preferences given their beliefs and constraints. It provides the theoretical backbone for much of economics, political science, and sociology.

Example: A consumer allocating a fixed budget among goods chooses the combination that maximizes satisfaction, considering prices and personal preferences.

Satisficing

A decision strategy introduced by Herbert Simon in which agents seek a solution that meets a minimum acceptability threshold rather than optimizing. This accounts for the cognitive costs of exhaustive search and computation.

Example: Rather than researching every possible apartment in a city, a renter sets criteria (under $1500, near transit, allows pets) and takes the first option that meets all thresholds.

The Ellsberg Paradox

A thought experiment demonstrating that people prefer known risks over unknown risks (ambiguity aversion), violating the independence axiom of expected utility theory. It reveals a systematic preference for betting on urns with known compositions over urns with unknown compositions.

Example: Given an urn with 30 red balls and 60 balls that are either black or yellow in unknown proportion, most people prefer betting on red (known probability) over black (unknown probability), even though expected utility theory says they shouldn't care.

More terms are available in the glossary.

Explore your way

Choose a different way to engage with this topic β€” no grading, just richer thinking.

Explore your way β€” choose one:

Explore with AI β†’

Concept Map

See how the key ideas connect. Nodes color in as you practice.

Worked Example

Walk through a solved problem step-by-step. Try predicting each step before revealing it.

Adaptive Practice

This is guided practice, not just a quiz. Hints and pacing adjust in real time.

Small steps add up.

What you get while practicing:

  • Math Lens cues for what to look for and what to ignore.
  • Progressive hints (direction, rule, then apply).
  • Targeted feedback when a common misconception appears.

Teach It Back

The best way to know if you understand something: explain it in your own words.

Keep Practicing

More ways to strengthen what you just learned.

Decision Theory Adaptive Course - Learn with AI Support | PiqCue