Powerset construction explained

In the theory of computation and automata theory, the powerset construction or subset construction is a standard method for converting a nondeterministic finite automaton (NFA) into a deterministic finite automaton (DFA) which recognizes the same formal language. It is important in theory because it establishes that NFAs, despite their additional flexibility, are unable to recognize any language that cannot be recognized by some DFA. It is also important in practice for converting easier-to-construct NFAs into more efficiently executable DFAs. However, if the NFA has n states, the resulting DFA may have up to 2n states, an exponentially larger number, which sometimes makes the construction impractical for large NFAs.

The construction, sometimes called the Rabin–Scott powerset construction (or subset construction) to distinguish it from similar constructions for other types of automata, was first published by Michael O. Rabin and Dana Scott in 1959.[1]

Intuition

To simulate the operation of a DFA on a given input string, one needs to keep track of a single state at any time: the state that the automaton will reach after seeing a prefix of the input. In contrast, to simulate an NFA, one needs to keep track of a set of states: all of the states that the automaton could reach after seeing the same prefix of the input, according to the nondeterministic choices made by the automaton. If, after a certain prefix of the input, a set of states can be reached, then after the next input symbol the set of reachable states is a deterministic function of and . Therefore, the sets of reachable NFA states play the same role in the NFA simulation as single DFA states play in the DFA simulation, and in fact the sets of NFA states appearing in this simulation may be re-interpreted as being states of a DFA.[2]

Construction

The powerset construction applies most directly to an NFA that does not allow state transformations without consuming input symbols (aka: "ε-moves"). Such an automaton may be defined as a 5-tuple, in which is the set of states, is the set of input symbols, is the transition function (mapping a state and an input symbol to a set of states), is the initial state, and is the set of accepting states. The corresponding DFA has states corresponding to subsets of . The initial state of the DFA is, the (one-element) set of initial states. The transition function of the DFA maps a state (representing a subset of) and an input symbol to the set, the set of all states that can be reached by an -transition from a state in .A state of the DFA is an accepting state if and only if at least one member of is an accepting state of the NFA.[2] [3]

In the simplest version of the powerset construction, the set of all states of the DFA is the powerset of, the set of all possible subsets of . However, many states of the resulting DFA may be useless as they may be unreachable from the initial state. An alternative version of the construction creates only the states that are actually reachable.[4]

NFA with ε-moves

For an NFA with ε-moves (also called an ε-NFA), the construction must be modified to deal with these by computing the ε-closure of states: the set of all states reachable from some given state using only ε-moves. Van Noord recognizes three possible ways of incorporating this closure computation in the powerset construction:[5]

  1. Compute the ε-closure of the entire automaton as a preprocessing step, producing an equivalent NFA without ε-moves, then apply the regular powerset construction. This version, also discussed by Hopcroft and Ullman,[6] is straightforward to implement, but impractical for automata with large numbers of ε-moves, as commonly arise in natural language processing application.
  2. During the powerset computation, compute the ε-closure

\{q'~|~q

*
\to
\varepsilon

q'\}

of each state that is considered by the algorithm (and cache the result).
  1. During the powerset computation, compute the ε-closure

\{q'~|~\existsq\inQ',q

*
\to
\varepsilon

q'\}

of each subset of states that is considered by the algorithm, and add its elements to .

Multiple initial states

If NFAs are defined to allow for multiple initial states,[7] the initial state of the corresponding DFA is the set of all initial states of the NFA, or (if the NFA also has ε-moves) the set of all states reachable from initial states by ε-moves.

Example

The NFA below has four states; state 1 is initial, and states 3 and 4 are accepting. Its alphabet consists of the two symbols 0 and 1, and it has ε-moves.

The initial state of the DFA constructed from this NFA is the set of all NFA states that are reachable from state 1 by ε-moves; that is, it is the set .A transition from by input symbol 0 must follow either the arrow from state 1 to state 2, or the arrow from state 3 to state 4. Additionally, neither state 2 nor state 4 have outgoing ε-moves. Therefore, (0) = , and by the same reasoning the full DFA constructed from the NFA is as shown below.As can be seen in this example, there are five states reachable from the start state of the DFA; the remaining 11 sets in the powerset of the set of NFA states are not reachable.

Complexity

See main article: article and State complexity.

Because the DFA states consist of sets of NFA states, an -state NFA may be converted to a DFA with at most states.[2] For every, there exist -state NFAs such that every subset of states is reachable from the initial subset, so that the converted DFA has exactly states, giving Θ worst-case time complexity.[8] [9] A simple example requiring nearly this many states is the language of strings over the alphabet in which there are at least characters, the th from last of which is 1. It can be represented by an -state NFA, but it requires DFA states, one for each -character suffix of the input; cf. picture for

Notes and References

  1. Rabin . M. O. . Michael O. Rabin . Scott . D. . Dana Scott . 1959 . Finite automata and their decision problems . IBM Journal of Research and Development . 0018-8646 . 10.1147/rd.32.0114 . 3 . 2 . 114–125.
  2. Book: Sipser, Michael . Michael Sipser

    . Michael Sipser . Introduction to the Theory of Computation . 1997 . 0-534-94728-X . Theorem 1.19 . 55–56 . registration .

  3. Book: Hopcroft . John E. . John Hopcroft . Ullman . Jeffrey D. . Jeffrey Ullman . 1979 . . Addison-Wesley . Reading Massachusetts . 0-201-02988-X . The equivalence of DFA's and NFA's . 22–23 .
  4. Book: Schneider, Klaus . 2004 . Verification of reactive systems: formal methods and algorithms . Springer . 978-3-540-00296-3 . 210–212 .
  5. Van Noord . Gertjan . Treatment of epsilon moves in subset construction . Computational Linguistics . 26 . 1 . 2000 . 61–76 . 10.1162/089120100561638. cmp-lg/9804003 . 5622079 .
  6. , pp. 26–27.
  7. Book: Rothe, Jörg. Complexity Theory and Cryptology: An Introduction to Cryptocomplexity. Texts in Theoretical Computer Science. Springer. 2006. 9783540285205. 21–22. .
  8. Lupanov. Oleg B.. 1963. A comparison of two types of finite sources. Problemy Kibernetiki. 9. 321–326.
  9. Moore . Frank R. . 10.1109/T-C.1971.223108 . 10 . IEEE Transactions on Computers . 1211–1214 . On the bounds for state-set size in the proofs of equivalence between deterministic, nondeterministic, and two-way finite automata . C-20 . 1971. 206618275 . .