Lewis's triviality result explained

In the mathematical theory of probability, David Lewis's triviality result is a theorem about the impossibility of systematically equating the conditional probability

P(B\mid A) with the probability of a so-called conditional event, A → B .

Conditional probability and conditional events

The statement "The probability that if

A , then B , is 20%" means (put intuitively) that event B may be expected to occur in 20% of the outcomes where event A occurs. The standard formal expression of this is P(B\mid A) =0 . 20 , where the conditional probability P(B\mid A) equals, by definition, P(A \cap B)/P(A) .

Beginning in the 1960s, several philosophical logicians—most notably Ernest Adams and Robert Stalnaker—floated the idea that one might also write

P(A → B) = 0 . 20 , where A → B is the conditional event "If A , then B ".^[1] That is, given events A and B , one might suppose there is an event, A → B , such that P(A → B) could be counted on to equal P(B\mid A) , so long as P(A) > 0 .

Part of the appeal of this move would be the possibility of embedding conditional expressions within more complex constructions. One could write, say,

P(A \cup (B → C)) = 0 . 75 , to express someone's high subjective degree of confidence ("75% sure") that either A , or else if B , then C . Compound constructions containing conditional expressions might also be useful in the programming of automated decision-making systems.^[2]

How might such a convention be combined with standard probability theory? The most direct extension of the standard theory would be to treat

A → B as an event like any other, i.e., as a set of outcomes. Adding A → B to the familiar Venn- or Euler diagram of A and B would then result in something like Fig. 1, where s,t,\ldots, z are probabilities allocated to the eight respective regions, such that s + t + … + z = 1 .

For

P(A → B) to equal P(B\mid A) requires that t + v + w + y = (s + t)/(s + t + x + y) , i.e., that the probability inside the A → B region equal the A \cap B region's proportional share of the probability inside the A region. In general the equality will of course not be true, so that making it reliably true requires a new constraint on probability functions: in addition to satisfying Kolmogorov's probability axioms, they must also satisfy a new constraint, namely that P(A → B) = P(B\mid A) for any events A and B such that P(A) > 0 .

Lewis's result

pointed out a seemingly fatal problem with the above proposal: assuming a nontrivial set of events, the new, restricted class of

P -functions will not be closed under conditioning, the operation that turns probability function P into new function P _{C} ( ⋅ ) = P( ⋅ \mid C) , predicated on event C 's occurrence. That is, if P(A → B) = P(B\mid A) , it will not in general be true that P _{C(A} → B) = P _{C(B\mid} A) as long as P(C)> 0 . This implies that if rationality requires having a well-behaved probability function, then a fully rational person (or computing system) would become irrational simply in virtue of learning that arbitrary event C had occurred. Bas van Fraassen called this result "a veritable bombshell" (van Fraassen|1976}}|1976, p. 273).

Lewis's proof is as follows. Let a set of events be non-trivial if it contains two possible events,

A and B , that are mutually exclusive but do not together exhaust all possibilities, so that P(A) > 0 , P(B) > 0 , P(A \cap B) = 0 , and P(A \cup B) < 1 . The existence of two such events implies the existence of the event A \cup B , as well, and, if conditional events are admitted, the event (A \cup B) → A . The proof derives a contradiction from the assumption that such a minimally non-trivial set of events exists.

1. Consider the probability of

(A \cup B) → A after conditioning, first on A and then instead on its complement A' .

1. • Conditioning on

A gives P _{A((A} \cup B) → A) = P(((A \cup B) → A) \cap A)/P(A) . But also, by the new constraint on P -functions, P _{A((A} \cup B) → A) = P _{A((A} \cup B) \cap A)/P _{A(A} \cup B) = P((A \cup B) \cap A\mid A)/P(A \cup B\mid A) = 1 / 1 = 1 . Therefore, P(((A \cup B) → A) \cap A) = P(A) .

1. • Conditioning on

A' gives P _{A'} ((A \cup B) → A) = P(((A \cup B) → A) \cap A')/P(A') . But also, P _{A'} ((A \cup B) → A) = P _{A'} ((A \cup B) \cap A)/P _{A'} (A \cup B) = P((A \cup B) \cap A\mid A')/P(A \cup B\mid A') = 0 /P(A \cup B\mid A') = 0 . (The mutual exclusivity of B and A ensures that P(A \cup B\mid A') ≠ 0 .) Therefore, P(((A \cup B) → A) \cap A') = 0 .

1. Instantiate the identity

P(X \cap Y) + P(X \cap Y') = P(X) as P(((A \cup B) → A) \cap A) + P(((A \cup B) → A) \cap A') = P((A \cup B) → A) . By the results from Step 1, the left side reduces to P(A) , while the right side, by the new constraint on P -functions, equals P((A \cup B) \cap A)/P(A \cup B) = P(A)/P(A \cup B) . Therefore, P(A) = P(A)/P(A \cup B) , which means that P(A \cup B) = 1 , which contradicts the stipulation that P(A \cup B) < 1 . This completes the proof.

Graphical version

A graphical version of the proof starts with Fig. 2, where the

A and B from Fig. 1 are now disjoint and A → B has been replaced by (A \cup B) → A .^[3] By the assumption that A and B are possible, x + y> 0 and u + v> 0 . By the assumption that together A and B do not together exhaust all possibilities, u + v + x + y < 1 . And by the new constraint on probability functions, P((A \cup B) → A) = P(A\mid A \cup B) = P(A \cap (A \cup B))/P(A \cup B) = P(A)/P(A \cup B) , which means that

(1)

y + v + w = (x + y)/(x + y + u + v) ,

Conditioning on an event involves zeroing out the probabilities outside the event's region and increasing the probabilities inside the region by a common scale factor. Here, conditioning on

A will zero out u, v and w and scale up x and y , to x _{A} and y _{A} , respectively, and so

(2)

y _{A} + 0 + 0 = (x _{A} + y _{A})/(x _{A} + y _{A} +0+0) , which simplifies to y _{A} = 1 .

Conditioning instead on

A' will zero out x and y and scale up u, v and w , and so

(3)

0 + v _{A'} + w _{A'} = (0+0)/(0+0+ u _{A} + v _{A}) , which simplifies to v _{A'} + w _{A'} = 0 .

From (2), it follows that

x _{A} = 0 , and since x _{A} is the scaled-up value of x , it must also be that x = 0 . Similarly, from (3), v = w = 0 . But then (1) reduces to y = y/(y + u) , which implies that y + u = 1 , which contradicts the stipulation that u + v + x + y < 1 .

Later developments

In a follow-up article, noted that the triviality proof can proceed by conditioning not on

A and A' but instead, by turns, on each of a finite set of mutually exclusive and jointly exhaustive events A, C, D, E, \ldots. He also gave a variant of the proof that involved not total conditioning, in which the probability of either A or A' is set to 1, but partial conditioning (i.e., Jeffrey conditioning), by which probability is incrementally shifted from A' to A .

Separately, pointed out that even without conditioning, if the number of outcomes is large but finite, then in general

P(B\mid A) = P(A \cap B)/P(A) , being a ratio of two outputs of the P -function, will take on more values than any single output of the function can. So, for instance, if in Fig. 1 s, t, \ldots are all multiples of 0.01 (as would be the case if there were exactly 100 equiprobable outcomes), then P(A → B) must be a multiple of 0.01, as well, but P(A \cap B)/P(A) need not be. That being the case, P(A → B) cannot reliably be made to equal P(B \mid A) .

also argued that the condition

P(A → B) = P(B\mid A) caused acceptable P -functions to be implausibly sparse and isolated from one another. One way to put the point: standardly, any weighted average of two probability function is itself a probability function, so that between any two P -functions there will be a continuum of weighted-average P -functions along which one of the original P -functions gradually transforms into the other. But these continua disappear if the added P(A → B) = P(B\mid A) condition is imposed. Now an average of two acceptable P -functions will in general not be an acceptable P -function.

Possible rejoinders

Assuming that

P(A → B) = P(B\mid A) holds for a minimally nontrivial set of events and for any P -function leads to a contradiction. Thus P(A → B) = P(B\mid A) can hold for any P -function only for trivial sets of events—that is the triviality result. However, the proof relies on background assumptions that may be challenged. It may be proposed, for instance, that the referent event of an expression like “A → B ” is not fixed for a given A and B , but instead changes as the probability function changes. Or it may be proposed that conditioning on C should follow a rule other than P _{C( ⋅ )} = P( ⋅ \mid C) .

But the most common response, among proponents of the

P(A → B) = P(B\mid A) condition, has been to explore ways to model conditional events as something other than subsets of a universe set of outcomes. Even before Lewis published his result, had modeled conditional events as ordered pairs of sets of outcomes. With that approach and others in the same spirit, conditional events and their associated combination and complementation operations do not constitute the usual algebra of sets of standard probability theory, but rather a more exotic type of structure, known as a conditional event algebra.

References

• Hájek . Alan . 1989 . Probabilities of conditionals – Revisited . Journal of Philosophical Logic . 18 . 4 . 423–428 . 10.1007/BF00262944 . 30226421. 31355969 .
• Book: Hájek, Alan . 1994 . Triviality on the cheap? . Eells . Ellery . Skyrms . Brian . Probability and Conditionals . Cambridge UP . 113–140 . 978-0521039338.
• Book: Hájek . Alan . Hall . Ned . 1994 . The hypothesis of the conditional construal of conditional probability . Eells . Ellery . Skyrms . Brian . Probability and Conditionals . Cambridge UP . 75–111 . 978-0521039338.
• Lewis . David . 1976 . Probabilities of conditionals and conditional probabilities . Philosophical Review . 85 . 3 . 297–315. 10.2307/2184045 . 2184045.
• Lewis . David . 1986 . Probabilities of conditionals and conditional probabilities II . Philosophical Review . 95 . 4 . 581–589 . 10.2307/2185051 . 2185051.
• Schay . Geza . 1968 . An algebra of conditional events . Journal of Mathematical Analysis and Applications . 24 . 2 . 334–344 . 10.1016/0022-247X(68)90035-8.
• Book: van Fraassen, Bas C. . 1976 . Probabilities of conditionals . Harper . W. . Hooker . C. . Foundations and Philosophy of Epistemic Applications of Probability Theory . Foundations of Probability Theory, Statistical Inference, and Statistical Theories of Science, Volume I . D. Reidel . 261–308 . 978-9027706171.

Notes and References

1. Hájek and Hall (Hájek|Hall|1994}}|1994) give a historical summary. The debate was actually framed as being about the probabilities of conditional sentences, rather than conditional events. However, this is merely a difference of idiom, so long as sentences are taken to express propositions and propositions are thought of as sets of possible worlds.
2. Reading "If A , then B " as "Not A , unless also B " makes compounding straightforward, since A → B becomes equivalent to the Boolean expression A' \cup B . However, this has the unsatisfactory consequence that P(A → B) \geq P(A') ; then "If A , then B " is assigned high probability whenever A is highly unlikely, even if A 's occurrence would make B highly likely. This is a version of what in logic is called a paradox of material implication.
3. A proof starting with overlapping A and B , as in Fig. 1, would use mutually exclusive events A \cap B' and A' \cap B in place of A and B .