Aliasing (factorial experiments) explained

In the statistical theory of factorial experiments, aliasing is the property of fractional factorial designs that makes some effects "aliased" with each other – that is, indistinguishable from each other. A primary goal of the theory of such designs is the control of aliasing so that important effects are not aliased with each other.

In a "full" factorial experiment, the number of treatment combinations or cells (see below) can be very large. This necessitates limiting observations to a fraction (subset) of the treatment combinations.Aliasing is an automatic and unavoidable result of observing such a fraction.

The aliasing properties of a design are often summarized by giving itsresolution. This measures the degree to which the design avoids aliasing between main effects and important interactions.

Fractional factorial experiments have long been a basic tool inagriculture, food technology, industry, medicine and public health, and the social and behavioral sciences.They are widely used in exploratory research, particularly in screening experiments, which have applications in industry, drug design and genetics. In all such cases, a crucial step in designing such an experiment is deciding on the desired aliasing pattern, or at least the desired resolution.

As noted below, the concept of aliasing may have influenced the identification of an analogous phenomenon in signal processing theory.

Overview

Associated with a factorial experiment is a collection of effects. Each factor determines a main effect, and each set of two or more factors determines an interaction effect (or simply an interaction) between those factors. Each effect is defined by a set of relations between cell means, as described below. In a fractional factorial design, effects are defined by restricting these relations to the cells in the fraction. It is when the restricted relations for two different effects turn out to be the same that the effects are said to be aliased.

The presence or absence of a given effect in a given data set is tested by statistical methods, most commonly analysis of variance. While aliasing has significant implications for estimation and hypothesis testing, it is fundamentally a combinatorial and algebraic phenomenon. Construction and analysis of fractional designs thus rely heavily on algebraic methods.

The definition of a fractional design is sometimes broadened to allow multiple observations of some or all treatment combinations – a multisubset of all treatment combinations. A fraction that is a subset (that is, where treatment combinations are not repeated) is called simple. The theory described below applies to simple fractions.

Contrasts and effects

123
1μ11μ12μ13
2μ21μ22μ23

In any design, full or fractional, the expected value of an observation in a given treatment combination is called a cell mean,[1] usually denoted using the Greek letter μ. (The term cell is borrowed from its use in tables of data.)

A contrast in cell means is a linear combination of cell means in which the coefficients sum to 0. In the 2 × 3 experiment illustrated here, the expression

\mu11-\mu12

is a contrast that compares the mean responses of the treatment combinations 11 and 12. (The coefficients here are 1 and –1.)

The effects in a factorial experiment are expressed in terms of contrasts. In the above example, the contrast

\mu11+\mu12+\mu13-\mu21-\mu22-\mu23

is said to belong to the main effect of factor A as it contrasts the responses to the "1" level of factor

A

with those for the "2" level. The main effect of A is said to be absent if this expression equals 0. Similarly,

\mu11+\mu21-\mu12-\mu22

  and  

\mu11+\mu21-\mu13-\mu23

are contrasts belonging to the main effect of factor B. On the other hand, the contrasts

\mu11-\mu12-\mu21+\mu22

  and  

\mu11-\mu13-\mu21+\mu23

belong to the interaction of A and B; setting them equal to 0 expresses the lack of interaction. These designations, which extend to arbitrary factorial experiments having three or more factors, depend on the pattern of coefficients, as explained elsewhere.

Since it is the coefficients of these contrasts that carry the essential information, they are often displayed as column vectors. For the example above, such a table might look like this:

cell

A

B

A x B

11 1 1 0 1 1
12 1 −1 1 -1 0
13 1 0 −1 0 −1
21 −1 1 0 −1 -1
22 −1 −1 1 1 0
23 −1 0 −1 0 1

The columns of such a table are called contrast vectors: their components add up to 0. While there are in general many possible choices of columns to represent a given effect, the number of such columns — the degrees of freedom of the effect — is fixed and is given by a well-known formula. In the 2 × 3 example above, the degrees of freedom for

A,B

, and the

A x B

interaction are 1, 2 and 2, respectively.

In a fractional factorial experiment, the contrast vectors belonging to a given effect are restricted to the treatment combinations in the fraction. Thus, in the half-fraction in the 2 × 3 example, the three effects may be represented by the column vectors in the following table:

cell

A

B

A x B

11 1 1 0 1 1
12 1 −1 1 −1 0
13 1 0 −1 0 −1
The consequence of this truncation — aliasing — is described below.

Definitions

The factors in the design are allowed to have different numbers of levels, as in a

2 x 3 x 3

factorial experiment (an asymmetric or mixed-level experiment).

Fix a fraction of a full factorial design. Let

U

be a set of contrast vectors representing an effect (in particular, a main effect or interaction) in the full factorial design, and let

\widetilde{U}

consist of the restrictions of those vectors to the fraction. One says that the effect is

\widetilde{U}

consists of contrast vectors;

\widetilde{U}

consists of constant vectors, that is, vectors whose components are equal; and

Similarly, let

U1

and

U2

represent two effects and let

\widetilde{U}1

and

\widetilde{U}2

be their restrictions to the fraction. The two effects are said to be

\widetilde{U}1

is orthogonal (perpendicular) to all the vectors in

\widetilde{U}2

, and vice versa;

\widetilde{U}1

is a linear combination of vectors in

\widetilde{U}2

, and vice versa; and

Finney and Bush introduced the terms "lost" and "preserved" in the sense used here. Despite the relatively long history of this topic, though, its terminology is not entirely standardized. The literature often describes lost effects as "not estimable" in a fraction, although estimation is not the only issue at stake. Rao referred to preserved effects as "measurable from" the fraction.

Resolution

The extent of aliasing in a given fractional design is measured by the resolution of the fraction, a concept first defined by Box and Hunter:

A fractional factorial design is said to have resolution

R

if every

p

-factor effect[2] is unaliased with every effect having fewer than

R-p

factors.

For example, a design has resolution

R=3

if main effects are unaliased with each other (taking

p=1)

, though it allows main effects to be aliased with two-factor interactions. This is typically the lowest resolution desired for a fraction. It is not hard to see that a fraction of resolution

R

also has resolution

R-1,R-2

, etc., so one usually speaks of the maximum resolution of a fraction.

The number

p

in the definition of resolution is usually understood to be a positive integer, but one may consider the effect of the grand mean to be the (unique) effect with no factors (i.e., with

p=0

). This effect sometimes appears in analysis of variance tables. It has one degree of freedom, and is represented by a single vector, a column of 1's. With this understanding, an effect is

A fraction then has resolution

R=2

if all main effects are preserved in the fraction. If it has resolution

R=3

then two-factor interactions are also preserved.

Computation

The definitions above require some computations with vectors, illustrated in the examples that follow. For certain fractional designs (the regular ones), a simple algebraic technique can be used that bypasses these procedures and gives a simple way to determine resolution. This is discussed below.

Examples

The 2 × 3 experiment

The fraction of this experiment was described above along with its restricted vectors. It is repeated here along with the complementary fraction :

In both fractions, the

A

effect is completely lost (the

A

column is constant) while the

B

and interaction effects are preserved (each 3 × 1 column is a contrast vector as its components sum to 0). In addition, the

B

and interaction effects are completely aliased in each fraction: In the first fraction, the vectors for

B

are linear combinations of those for

A x B

, viz.,

\begin{bmatrix}1\ -1\ 0\end{bmatrix}=\begin{bmatrix}1\ -1\ 0\end{bmatrix}+0\begin{bmatrix}1\ 0\ -1\end{bmatrix}

and

\begin{bmatrix}0\ 1\ -1\end{bmatrix}=\begin{bmatrix}1\ 0\ -1\end{bmatrix}-\begin{bmatrix}1\ -1\ 0\end{bmatrix}

in the reverse direction, the vectors for

A x B

can be written similarly in terms of those representing

B

. The argument in the second fraction is analogous.

These fractions have maximum resolution 1. The fact that the main effect of

A

is lost makes both of these fractions undesirable in practice. It turns out that in a 2 × 3 experiment (or in any a × b experiment in which a and b are relatively prime) there is no fraction that preserves both main effects -- that is, no fraction has resolution 2.

The 2 × 2 × 2 (or 2³) experiment

This is a "two-level" experiment with factors

A,B

and

C

. In such experiments the factor levels are often denoted by 0 and 1, for reasons explained below. A treatment combination is then denoted by an ordered triple such as 101 (more formally, (1, 0, 1), denoting the cell in which

A

and

C

are at level "1" and

B

is at level "0"). The following table lists the eight cells of the full 2 × 2 × 2 factorial experiment, along with a contrast vector representing each effect, including a three-factor interaction:
cell

A

B

C

AB

AC

BC

ABC

000 1 1 1 1 1 1 1
001 1 1 −1 1 −1 −1 −1
010 1 −1 1 −1 1 −1 −1
011 1 −1 −1 −1 −1 1 1
100 −1 1 1 −1 −1 1 −1
101 −1 1 −1 −1 1 −1 1
110 −1 −1 1 1 −1 −1 1
111 −1 −1 −1 1 1 1 −1

Suppose that only the fraction consisting of the cells 000, 011, 101, and 110 is observed. The original contrast vectors, when restricted to these cells, are now 4 × 1, and can be seen by looking at just those four rows of the table. (Sorting the table on

ABC

will bring these rows together and make the restricted contrast vectors easier to see. Sorting twice puts them at the top.) The following can be observed concerning these restricted vectors:

ABC

column consists just of the constant 1 repeated four times.

C

and

AB

are equal. The same holds for

A

and

BC

, and for

B

and

AC

.

A

is orthogonal to that for

B

, for

C

, for

AB

, and for

AC

, as one can see by computing dot products.Thus

ABC

interaction is completely lost in the fraction;

A

and

BC

are completely aliased with each other, as are

B

and

AC

, and

C

and

AB

.

A

is unaliased with both

B

and

C

and with the

AB

and

AC

interactions.

Now suppose instead that the complementary fraction is observed. The same effects as before are lost or preserved, and the same pairs of effects as before are mutually unaliased. Moreover,

A

and

BC

are still aliased in this fraction since the

A

and

BC

vectors are negatives of each other, and similarly for

B

and

AC

and for

C

and

AB

. Both of these fractions thus have maximum resolution 3.

Aliasing in regular fractions

The two half-fractions of a

23

factorial experiment described above are of a special kind: Each is the solution set of a linear equation using modular arithmetic. More exactly:

\{000,011,101,110\}

is the solution set of the equation

t1+t2+t3=0\pmod2

. For example,

011

is a solution because

0+1+1=0\pmod2

.

\{001,010,100,111\}

is the solution set to

t1+t2+t3=1\pmod2

Such fractions are said to be regular. This idea applies to fractions of "classical"

sk

designs, that is,

sk

(or "symmetric") factorial designs in which the number of levels,

s

, of each of the

k

factors is a prime or the power of a prime.

A fractional factorial design is regular if it is the solution set of a system of one or more equations of the form

a1t1++aktk=b,

where the equation is modulo

s

if

s

is prime, and is in the finite field

GF(s)

if

s

is a power of a prime.[3] Such equations are called defining equations of the fraction. When the defining equation or equations are homogeneous, the fraction is said to be principal.

One defining equation yields a fraction of size

sk-1

, two independent equations a fraction of size

sk-2,

and so on. Such fractions are generally denoted as

sk-r

designs. The half-fractions described above are

23-1

designs. The notation often includes the resolution as a subscript, in Roman numerals; the above fractions are thus
3-1
2
III
designs.

Associated to each expression

a1t1++aktk

is another, namely
a1
A
1

ak
A
k
, which rewrites the coefficients as exponents. Such expressions are called "words", a term borrowed from group theory. (In a particular example where

k

is a specific number, the letters

A,B,C\ldots

are used, rather than

A1,A2,A3\ldots

.) These words can be multiplied and raised to powers, where the word
0
I=A
1

0
A
k
acts as a multiplicative identity, and they thus form an abelian group

G

, known as the effects group. When

s

is prime, one has

Ws=I

for every element (word)

W\inG

; something similar holds in the prime-power case.In

2k

factorial experiments, each element of

G

represents a main effect or interaction. In

sk

experiments with

s>2

, each one-letter word represents the main effect of that factor, while longer words represent components of interaction. An example below illustrates this with

s=3

.

H

of

G

that is variously called the alias subgroup, the defining contrast subgroup, or simply the defining subgroup of the fraction. Each element of

H

is a defining word since it corresponds to a defining equation, as one can show. The effects represented by the defining words are completely lost in the fraction while all other effects are preserved. If

H=\{I,W1,\ldots,W\ell\}

, say, then the equation

I=W1==W\ell

is called the defining relation of the fraction. This relation is used to determine the aliasing structure of the fraction: If a given effect is represented by the word

W

, then its aliases are computed by multiplying the defining relation by

W

, viz.,

W=WW1==WW\ell,

where the products

WWi

are then simplified. This relation indicates complete (not partial) aliasing, and W is unaliased with all other effects listed in

G

.

Example 1

In either of the

23-1

fractions described above, the defining word is

ABC

, since the exponents on these letters are the coefficients of

t1+t2+t3

. The

ABC

effect is completely lost in the fraction, and the defining subgroup

H

is simply

\{I,ABC\}

, since squaring does not generate new elements

((ABC)2=A2B2C2=I)

. The defining relation is thus

I=ABC

,and multiplying both sides by

A

gives

A=A2BC

; which simplifies to

A=BC,

the alias relation seen earlier. Similarly,

B=AC

and

C=AB

. Note that multiplying both sides of the defining relation by

AB,AC

and

BC

does not give any new alias relations.

For comparison, the

23-1

fraction with defining equation

t1+t2=0\pmod2

has the defining word

AB

(i.e.,

A1B1C0

). The effect

AB

is completely lost, and the defining relation is

I=AB

. Multiplying this by

A

, by

C

, and by

AC

gives the alias relations

A=B

,

C=ABC

, and

AC=BC

among the six remaining effects. This fraction only has resolution 2 since all effects (except

AB

) are preserved but two main effects are aliased. Finally, solving the defining equation

t1+t2=0\pmod2

yields the fraction . One may verify all of this by sorting the table above on column

AB

.The use of arithmetic modulo 2 explains why the factor levels in such designs are labeled 0 and 1.

Example 2

In a 3-level design, factor levels are denoted 0, 1 and 2, and arithmetic is modulo 3. If there are four factors, say

A,B,C

and

D

, the effects group

G

will have the relations

A3=B3=C3=D3=I.

From these it follows, for example, that

D4=D

and

D6=I

.A defining equation such as

t1+t2+t3+2t4=0\pmod{3}

would produce a regular 1/3-fraction of the 81 (=

34

) treatment combinations, and the corresponding defining word would be

ABCD2

. Since its powers are

(ABCD2)2=A2B2C2D

  and  

(ABCD2)3=I

,the defining subgroup

H

would be

\{I,ABCD2,A2B2C2D\}

, and so the fraction would have defining relation

I=ABCD2=A2B2C2D.

Multiplying by

A

, for example, yields the aliases

A=A2BCD2=B2C2D.

For reasons explained elsewhere, though, all powers of a defining word represent the same effect, and the convention is to choose that power whose leading exponent is 1. Squaring the latter two expressions does the trick[4] and gives the alias relations

A=AB2C2D=BCD2.

Twelve other sets of three aliased effects are given by Wu and Hamada. Examining all of these reveals that, like

A

, main effects are unaliased with each other and with two-factor effects, although some two-factor effects are aliased with each other. This means that this fraction has maximum resolution 4, and so is of type
4-1
3
IV
.

The effect

BCD2

is one of 4 components of the

B x C x D

interaction, while

AB2C2D

is one of 8 components of the

A x B x C x D

interaction. In a 3-level design, each component of interaction carries 2 degrees of freedom.

Example 3

A

25-2

design (

1/4

of a

25

design) may be created by solving two equations in 5 unknowns, say

\begin{cases} t1+t2+t4=1\\ t1+t3+t5=1 \end{cases}

modulo 2. The fraction has eight treatment combinations, such as 10000, 00110 and 11111, and is displayed in the article on fractional factorial designs.[5] Here the coefficients in the two defining equations give defining words

ABD

and

ACE

. Setting

I=ABD

and multiplying through by

D

gives the alias relation

D=AB

. The second defining word similarly gives

E=AC

. The article uses these two aliases to describe an alternate method of construction of the fraction.

The defining subgroup

H

has one more element, namely the product

(ABD)(ACE)

=BCDE

, making use of the fact that

A2=I

. The extra defining word

BCDE

is known as the generalized interaction of

ABD

and

ACE

, and corresponds to the equation

t2+t3+t4+t5=0\pmod2

, which is also satisfied by the fraction. With this word included, the full defining relation is

I=ABD=ACE=BCDE

(these are the four elements of the defining subgroup), from which all the alias relations of this fraction can be derived – for example, multiplying through by

D

yields

D=AB=ACDE=BCE

.

Continuing this process yields six more alias sets, each containing four effects. An examination of these sets reveals that main effects are not aliased with each other, but are aliased with two-factor interactions. This means that this fraction has maximum resolution 3. A quicker way to determine the resolution of a regular fraction is given below.

It is notable that the alias relations of the fraction depend only on the left-hand side of the defining equations, not on their constant terms. For this reason, some authors will restrict attention to principal fractions "without loss of generality", although the reduction to the principal case often requires verification.

Determining the resolution of a regular fraction

The length of a word in the effects group is defined to be the number of letters in its name, not counting repetition. For example, the length of the word

AB2C

is 3.[6]

Using this result, one immediately gets the resolution of the preceding examples without computing alias relations:

23-1

fraction with defining word

ABC

, the maximum resolution is 3 (the length of that word), while the fraction with defining word

AB

has maximum resolution 2.

34-1

fraction were

ABCD2

and

A2B2C2D

, both of length 4, so that the fraction has maximum resolution 4, as indicated.

25-2

fraction with defining words

ABD,ACE

and

BCDE

, the maximum resolution is 3, which is the shortest "wordlength".

One could also construct a

25-2

fraction from the defining words

ABCD

and

BCDE

, but the defining subgroup

H

will also include

AE

, their product, and so the fraction will only have resolution 2 (the length of

AE

). This is true starting with any two words of length 4. Thus resolution 3 is the best one can hope for in a fraction of type

25-2

.

As these examples indicate, one must consider all the elements of the defining subgroup in applying the theorem above. This theorem is often taken to be a definition of resolution, but the Box-Hunter definition given earlier applies to arbitrary fractional designs and so is more general.

Aliasing in general fractions

Nonregular fractions are common, and have certain advantages. For example, they are not restricted to having size a power of

s

, where

s

is a prime or prime power. While some methods have been developed to deal with aliasing in particular nonregular designs, no overall algebraic scheme has emerged.

There is a universal combinatorial approach, however, going back to Rao. If the treatment combinations of the fraction are written as rows of a table, that table is an orthogonal array. These rows are often referred to as "runs". The columns will correspond to the

k

factors, and the entries of the table will simply be the symbols used for factor levels, and need not be numbers. The number of levels need not be prime or prime-powered, and they may vary from factor to factor, so that the table may be a mixed-level array. In this section fractional designs are allowed to be mixed-level unless explicitly restricted.

A key parameter of an orthogonal array is its strength, the definition of which is given in the article on orthogonal arrays. One may thus refer to the strength of a fractional design. Two important facts flow immediately from its definition:

t

then it also has strength

t'

for every

t'<t

. The array's maximum strength is of particular importance.

s

levels, the number of runs is a multiple of

st

, where

t

is the strength. Here

s

need not be a prime or prime power.

To state the next result, it is convenient to enumerate the factors of the experiment by 1 through

k

, and to let each nonempty subset

I

of

\{1,\ldots,k\}

correspond to a main effect or interaction in the following way:

I=\{i\}

corresponds to the main effect of factor

i

,

I=\{i,j\}

corresponds to the interaction of factors

i

and

j

, and so on.

Example: Consider a fractional factorial design with factors

A,B,C,D,E

and maximum strength

t=3

. Then:
  1. All effects up to three-factor interactions are preserved in the fraction.
  2. Main effects are unaliased with each other and with two-factor interactions.
  3. Two-factor interactions are unaliased with each other if they share a factor. For example, the

A x B

and

A x C

interactions are unaliased, but the

A x B

and

C x D

interactions may be at least partly aliased as the set

\{A,B,C,D\}

contains 4 elements but the strength of the fraction is only 3.

The Fundamental Theorem has a number of important consequences. In particular, it follows almost immediately that if a fraction has strength

t

then it has resolution

t+1

. With additional assumptions, a stronger conclusion is possible:

This result replaces the group-theoretic condition (minimum wordlength) in regular fractions with a combinatorial condition (maximum strength) in arbitrary ones.

Example. An important class of nonregular two-level designs are Plackett-Burman designs. As with all fractions constructed from Hadamard matrices, they have strength 2, and therefore resolution 3. The smallest such design has 11 factors and 12 runs (treatment combinations), and is displayed in the article on such designs. Since 2 is its maximum strength,[7] 3 is its maximum resolution. Some detail about its aliasing pattern is given in the next section.

Partial aliasing

In regular

2k

fractions there is no partial aliasing: Each effect is either preserved or completely lost, and effects are either unaliased or completely aliased. The same holds in regular

sk

experiments with

s>2

if one considers only main effects and components of interaction. However, a limited form of partial aliasing occurs in the latter. For example, in the

34-1

design described above the overall

A x B x C x D

interaction is partly lost since its

ABCD2

component is completely lost in the fraction while its other components (such as

AB2C2D

) are preserved. Similarly, the main effect of

A

is partly aliased with the

B x C x D

interaction since

A

is completely aliased with its

BCD2

component and unaliased with the others.

In contrast, partial aliasing is uncontrolled and pervasive in nonregular fractions. In the 12-run Plackett-Burman design described in the previous section, for example, with factors labeled

A

through

K

, the only complete aliasing is between "complementary effects" such as

A

and

BCDEFGHIJK

or

ABCJK

and

DEFGHI

. Here the main effect of factor

A

is unaliased with the other main effects and with the

AB

interaction, but it is partly aliased with 45 of the 55 two-factor interactions, 120 of the 165 three-factor interactions, and 150 of the 330 four-factor interactions. This phenomenon is generally described as complex aliasing. Similarly, 924 effects are preserved in the fraction, 1122 effects are partly lost, and only one (the top-level interaction

ABCDEFGHIJK

) is completely lost.

Analysis of variance (ANOVA)

Wu and Hamada analyze a data set collected on the

4-1
3
IV
fractional design described above. Significance testing in the analysis of variance (ANOVA) requires that the error sum of squares and the degrees of freedom for error be nonzero. In order to insure this, two design decisions have been made:
Source
df

A

2

B

2

C

2

D

2

AB=CD2

2

AB2

2

AC=BD2

2

AC2

2

AD

2

BC=AD2

2

BC2

2

BD

2

CD

2
Error54
Total80

The accompanying table shows just two columns of an ANOVA table for this experiment. Only main effects and components of two-factor interactions are listed, including three pairs of aliases. Aliasing between some two-factor interactions is expected, since the maximum resolution of this design is 4.

This experiment studied two response variables. In both cases, some aliased interactions were statistically significant. This poses a challenge of interpretation, since without more information or further assumptions it is impossible to determine which interaction is responsible for significance. In some instances there may be a theoretical basis to make this determination.

This example shows one advantage of fractional designs. The full

34

factorial experiment has 81 treatment combinations, but taking one observation on each of these would leave no degrees of freedom for error. The fractional design also uses 81 observations, but on just 27 treatment combinations, in such a way that one can make inferences on main effects and on (most) two-factor interactions. This may be sufficient for practical purposes.

History

The first statistical use of the term "aliasing" in print is the 1945 paper by Finney, which dealt with regular fractions with 2 or 3 levels. The term was imported into signal processing theory a few years later, possibly influenced by its use in factorial experiments; the history of that usage is described in the article on aliasing in signal processing.

The 1961 paper in which Box and Hunter introduced the concept of "resolution" dealt with regular two-level designs, but their initial definition makes no reference to lengths of defining words and so can be understood rather generally. Rao actually makes implicit use of resolution in his 1947 paper introducing orthogonal arrays, reflected in an important parameter inequality that he develops. He distinguishes effects in full and fractional designs by using symbols

[]

and

\{\}

(corresponding to

U

and

\widetilde{U}

), but makes no mention of aliasing.

The term confounded is often used as a synonym for aliased, and so one must read the literature carefully. The former term "is generally reserved for the indistinguishability of a treatment contrast and a block contrast", that is, for confounding with blocks. Kempthorne has shown how confounding with blocks in a

k

-factor experiment may be viewed as aliasing in a fractional design with

k+1

factors, but it is unclear whether one can do the reverse.

See also

References

Notes and References

  1. . Hocking and others use the term "population mean" for expected value.
  2. A 1-factor effect is the main effect of a single factor. For

    p\ge2

    , a

    p

    -factor effect is an interaction between

    p

    factors. The 0-factor effect is the effect of the grand mean, described below.
  3. The case that

    s

    is prime is mentioned separately only for clarity, since the set of integers modulo

    s

    is itself a finite field, though often denoted

    Z/s

    rather than

    GF(s)

    .
  4. This uses relations such as

    A4=A

  5. That article uses alternate notation for treatment combinations; for example, 10000, 00110 and 11111 are expressed as

    a,cd

    and

    abcde

    .
  6. This differs from the definition used in group theory, which counts repetitions. According to the latter view, the length of

    AB2C

    is 4.
  7. The strength cannot be 3 since 12 is not a multiple of

    23

    .