Post correspondence problem explained

Post correspondence problem should not be confused with PCP theorem.

The Post correspondence problem is an undecidable decision problem that was introduced by Emil Post in 1946.^[1] Because it is simpler than the halting problem and the Entscheidungsproblem it is often used in proofs of undecidability.

Definition of the problem

Let

A be an alphabet with at least two symbols. The input of the problem consists of two finite lists \alpha _{1} , \ldots, \alpha _{N} and \beta _{1} , \ldots, \beta _{N} of words over A . A solution to this problem is a sequence of indices (i _{k)} _{1} with K \ge 1 and 1 \le i _{k} \le N for all k , such that\alpha _{i _{1}} \ldots \alpha _{i _{K}} = \beta _{i _{1}} \ldots \beta _{i _{K}} .

The decision problem then is to decide whether such a solution exists or not.

Alternative definition

g: (i _{1,\ldots,i} _{K)} \mapsto \alpha _{i _{1}} \ldots \alpha _{i _{K}} h: (i _{1,\ldots,i} _{K)} \mapsto \beta _{i _{1}} \ldots \beta _{i _{K}} .

This gives rise to an equivalent alternative definition often found in the literature, according to which any two homomorphisms

g,h with a common domain and a common codomain form an instance of the Post correspondence problem, which now asks whether there exists a nonempty word w in the domain such thatg(w) = h(w) .

Another definition describes this problem easily as a type of puzzle. We begin with a collection of dominos, each containing two strings, one on each side. An individual domino looks like

\begin{bmatrix}a \ ab\end{bmatrix} and a collection of dominos looks like { \begin{bmatrix}bc \ ca\end{bmatrix}, \begin{bmatrix}a \ ab\end{bmatrix}, \begin{bmatrix}ca \ a\end{bmatrix}, \begin{bmatrix}abc \ c\end{bmatrix} } . The task is to make a list of these dominos (repetition permitted) so that the string we get by reading off the symbols on the top is the same as the string of symbols on the bottom. This list is called a match. The Post correspondence problem is to determine whether a collection of dominos has a match.For example, the following list is a match for this puzzle.{ \begin{bmatrix}a \ ab\end{bmatrix}, \begin{bmatrix}bc \ ca\end{bmatrix}, \begin{bmatrix}a \ ab\end{bmatrix}, \begin{bmatrix}abc \ c\end{bmatrix} } .For some collections of dominos, finding a match may not be possible. For example, the collection{ \begin{bmatrix}abc \ ab\end{bmatrix}, \begin{bmatrix}ca \ a\end{bmatrix}, \begin{bmatrix}acc \ ba\end{bmatrix} } .cannot contain a match because every top string is longer than the corresponding bottom string.

Example instances of the problem

Example 1

Consider the following two lists:

width=40	α1	width=40	α2	width=40	α3
a	ab	bba

width=40	β1	width=40	β2	width=40	β3
baa	aa	bb

A solution to this problem would be the sequence (3, 2, 3, 1), because\alpha _{3} \alpha _{2} \alpha _{3} \alpha _{1} = bba ⋅ ab ⋅ bba ⋅ a = bbaabbbaa = bb ⋅ aa ⋅ bb ⋅ baa = \beta _{3} \beta _{2} \beta _{3} \beta _{1} .

Furthermore, since (3, 2, 3, 1) is a solution, so are all of its "repetitions", such as (3, 2, 3, 1, 3, 2, 3, 1), etc.; that is, when a solution exists, there are infinitely many solutions of this repetitive kind.

However, if the two lists had consisted of only

\alpha _{2,} \alpha _{3} and \beta _{2} , \beta _{3} from those sets, then there would have been no solution (the last letter of any such α string is not the same as the letter before it, whereas β only constructs pairs of the same letter).

A convenient way to view an instance of a Post correspondence problem is as a collection of blocks of the form

αi
βi

there being an unlimited supply of each type of block. Thus the above example is viewed as

a
baa

i = 1

ab
aa

i = 2

bba
bb

i = 3where the solver has an endless supply of each of these three block types. A solution corresponds to some way of laying blocks next to each other so that the string in the top cells corresponds to the string in the bottom cells. Then the solution to the above example corresponds to:

bba
bb

i₁ = 3

ab
aa

i₂ = 2

bba
bb

i₃ = 3

a
baa

i₄ = 1

Example 2

Again using blocks to represent an instance of the problem, the following is an example that has infinitely many solutions in addition to the kind obtained by merely "repeating" a solution.

bb
b

1

ab
ba

2

c
bc

3

In this instance, every sequence of the form (1, 2, 2, . . ., 2, 3) is a solution (in addition to all their repetitions):

bb
b

1

ab
ba

2

ab
ba

2

ab
ba

2

c
bc

3

Proof sketch of undecidability

The most common proof for the undecidability of PCP describes an instance of PCP that can simulate the computation of an arbitrary Turing machine on a particular input. A match will occur if and only if the input would be accepted by the Turing machine. Because deciding if a Turing machine will accept an input is a basic undecidable problem, PCP cannot be decidable either. The following discussion is based on Michael Sipser's textbook Introduction to the Theory of Computation.^[2]

In more detail, the idea is that the string along the top and bottom will be a computation history of the Turing machine's computation. This means it will list a string describing the initial state, followed by a string describing the next state, and so on until it ends with a string describing an accepting state. The state strings are separated by some separator symbol (usually written #). According to the definition of a Turing machine, the full state of the machine consists of three parts:

• The current contents of the tape.
• The current state of the finite state machine which operates the tape head.
• The current position of the tape head on the tape.

Although the tape has infinitely many cells, only some finite prefix of these will be non-blank. We write these down as part of our state. To describe the state of the finite control, we create new symbols, labelled q₁ through q_k, for each of the finite state machine's k states. We insert the correct symbol into the string describing the tape's contents at the position of the tape head, thereby indicating both the tape head's position and the current state of the finite control. For the alphabet, a typical state might look something like:

101101110q₇00110.

A simple computation history would then look something like this:

q₀101#1q₄01#11q₂1#1q₈10.

We start out with this block, where x is the input string and q₀ is the start state:

q0x#

The top starts out "lagging" the bottom by one state, and keeps this lag until the very end stage. Next, for each symbol a in the tape alphabet, as well as #, we have a "copy" block, which copies it unmodified from one state to the next:

a
a

We also have a block for each position transition the machine can make, showing how the tape head moves, how the finite state changes, and what happens to the surrounding symbols. For example, here the tape head is over a 0 in state 4, and then writes a 1 and moves right, changing to state 7:

q40
1q7

Finally, when the top reaches an accepting state, the bottom needs a chance to finally catch up to complete the match. To allow this, we extend the computation so that once an accepting state is reached, each subsequent machine step will cause a symbol near the tape head to vanish, one at a time, until none remain. If q_f is an accepting state, we can represent this with the following transition blocks, where a is a tape alphabet symbol:

qfa
qf

aqf
qf

There are a number of details to work out, such as dealing with boundaries between states, making sure that our initial tile goes first in the match, and so on, but this shows the general idea of how a static tile puzzle can simulate a Turing machine computation.

The previous example

q₀101#1q₄01#11q₂1#1q₈10.

is represented as the following solution to the Post correspondence problem:

q0101#

q01
1 q4

0
0

1
1

1
1

q4 0
1 q2

1
1

1
1

1 q21
q810

1 q8
q8

1
1

0
0

q8 1
q8

0
0

q8 0
q8

q8

...

Variants

Many variants of PCP have been considered. One reason is that, when one tries to prove undecidability of some new problem by reducing from PCP, it often happens that the first reduction one finds is not from PCP itself but from an apparently weaker version.

• The problem may be phrased in terms of monoid morphisms f, g from the free monoid B^∗ to the free monoid A^∗ where B is of size n. The problem is to determine whether there is a word w in B⁺ such that f(w) = g(w).^[3]
• The condition that the alphabet

A have at least two symbols is required since the problem is decidable if A has only one symbol.

• A simple variant is to fix n, the number of tiles. This problem is decidable if n ≤ 2,^[4] but remains undecidable for n ≥ 5. It is unknown whether the problem is decidable for 3 ≤ n ≤ 4.^[5]
• The circular Post correspondence problem asks whether indexes

i _{1,} i _{2,\ldots} can be found such that \alpha _{i _{1}} … \alpha _{i _{k}} and \beta _{i _{1}} … \beta _{i _{k}} are conjugate words, i.e., they are equal modulo rotation. This variant is undecidable.^[6]

• One of the most important variants of PCP is the bounded Post correspondence problem, which asks if we can find a match using no more than k tiles, including repeated tiles. A brute force search solves the problem in time O(2^k), but this may be difficult to improve upon, since the problem is NP-complete.^[7] Unlike some NP-complete problems like the boolean satisfiability problem, a small variation of the bounded problem was also shown to be complete for RNP, which means that it remains hard even if the inputs are chosen at random (it is hard on average over uniformly distributed inputs).^[8]
• Another variant of PCP is called the marked Post Correspondence Problem, in which each

\alpha _{i} must begin with a different symbol, and each \beta _{i} must also begin with a different symbol. Halava, Hirvensalo, and de Wolf showed that this variation is decidable in exponential time. Moreover, they showed that if this requirement is slightly loosened so that only one of the first two characters need to differ (the so-called 2-marked Post Correspondence Problem), the problem becomes undecidable again.^[9]

• The Post Embedding Problem is another variant where one looks for indexes

i _{1,} i _{2,} \ldots such that \alpha _{i _{1}} … \alpha _{i _{k}} is a (scattered) subword of \beta _{i _{1}} … \beta _{i _{k}} . This variant is easily decidable since, when some solutions exist, in particular a length-one solution exists. More interesting is the Regular Post Embedding Problem, a further variant where one looks for solutions that belong to a given regular language (submitted, e.g., under the form of a regular expression on the set \{ 1 ,\ldots,N\} ). The Regular Post Embedding Problem is still decidable but, because of the added regular constraint, it has a very high complexity that dominates every multiply recursive function.^[10]

• The Identity Correspondence Problem (ICP) asks whether a finite set of pairs of words (over a group alphabet) can generate an identity pair by a sequence of concatenations. The problem is undecidable and equivalent to the following Group Problem: is the semigroup generated by a finite set of pairs of words (over a group alphabet) a group.^[11]

External links

• Eitan M. Gurari. An Introduction to the Theory of Computation, Chapter 4, Post's Correspondence Problem. A proof of the undecidability of PCP based on Chomsky type-0 grammars.
• Dong, Jing. "The Analysis and Solution of a PCP Instance." 2012 National Conference on Information Technology and Computer Science. The paper describes a heuristic rule for solving some specific PCP instances.
• Online PHP Based PCP Solver
• PCP AT HOME
• PCP - a nice problem
• PCP solver in Java
• Post Correspondence Problem

Notes and References

1. 1946. E. L. Post. Emil Post. A variant of a recursively unsolvable problem . Bull. Amer. Math. Soc.. 52. 4. 10.1090/s0002-9904-1946-08555-9. 264–269. 122948861 .
2. Book: Michael Sipser. Michael Sipser. 2005 . Introduction to the Theory of Computation . 2nd . Thomson Course Technology . 0-534-95097-3 . A Simple Undecidable Problem . 199 - 205.
3. Book: Salomaa, Arto . Arto Salomaa . Jewels of Formal Language Theory . Pitman Publishing . 0-273-08522-0 . 1981 . 0487.68064 . 74–75 .
4. Ehrenfeucht. A.. Andrzej Ehrenfeucht. Karhumäki. J.. Juhani Karhumäki. Rozenberg . G.. Grzegorz Rozenberg . The (generalized) post correspondence problem with lists consisting of two words is decidable . . November 1982 . 21 . 2 . 119–144 . 10.1016/0304-3975(89)90080-7 .
5. T. Neary. 2015. Undecidability in Binary Tag Systems and the Post Correspondence Problem for Five Pairs of Words. STACS 2015. 32nd International Symposium on Theoretical Aspects of Computer Science (STACS 2015). Ernst W. Mayr and Nicolas Ollinger. Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik. 30. 649–661. 10.4230/LIPIcs.STACS.2015.649. free .
6. K. Ruohonen . 1983. On some variants of Post's correspondence problem. Springer. 19. 4. 357 - 367. . 10.1007/BF00290732. 20637902.
7. Book: Michael R. Garey . Michael R. Garey . David S. Johnson . David S. Johnson . 1979 . . W.H. Freeman . 0-7167-1045-5 . 228 .
8. Y. Gurevich. Yuri Gurevich. J. Comput. Syst. Sci.. 1991. 346–398. 42. Average case completeness. Elsevier Science. 10.1016/0022-0000(91)90007-R. 3. 2027.42/29307.
9. V. Halava . M. Hirvensalo . R. de Wolf. 2001. Marked PCP is decidable. Theor. Comput. Sci.. Elsevier Science. 255. 1–2 . 193–204. 10.1016/S0304-3975(99)00163-2.
10. Book: P. Chambart. Ph. Schnoebelen. Post embedding problem is not primitive recursive, with applications to channel systems. 2007. 4855. 265–276. Springer. 10.1007/978-3-540-77050-3_22. Lecture Notes in Computer Science. 978-3-540-77049-7.
11. Paul C. Bell . Igor Potapov . On the Undecidability of the Identity Correspondence Problem and its Applications for Word and Matrix Semigroups . 2010. International Journal of Foundations of Computer Science . 21 . 6 . 963–978. World Scientific . 10.1142/S0129054110007660. 0902.1975.