Lagged Fibonacci generator explained

A Lagged Fibonacci generator (LFG or sometimes LFib) is an example of a pseudorandom number generator. This class of random number generator is aimed at being an improvement on the 'standard' linear congruential generator. These are based on a generalisation of the Fibonacci sequence.

The Fibonacci sequence may be described by the recurrence relation:

Sn=Sn-1+Sn-2

Hence, the new term is the sum of the last two terms in the sequence. This can be generalised to the sequence:

Sn\equivSn-j\starSn-k\pmod{m},0<j<k

In which case, the new term is some combination of any two previous terms. m is usually a power of 2 (m = 2M), often 232 or 264. The

\star

operator denotes a general binary operation. This may be either addition, subtraction, multiplication, or the bitwise exclusive-or operator (XOR). The theory of this type of generator is rather complex, and it may not be sufficient simply to choose random values for and . These generators also tend to be very sensitive to initialisation.

Generators of this type employ k words of state (they 'remember' the last k values).

If the operation used is addition, then the generator is described as an Additive Lagged Fibonacci Generator or ALFG, if multiplication is used, it is a Multiplicative Lagged Fibonacci Generator or MLFG, and if the XOR operation is used, it is called a Two-tap generalised feedback shift register or GFSR. The Mersenne Twister algorithm is a variation on a GFSR. The GFSR is also related to the linear-feedback shift register, or LFSR.

Properties of lagged Fibonacci generators

The maximum period of lagged Fibonacci generators depends on the binary operation

\star

. If addition or subtraction is used, the maximum period is (2k − 1) × 2M−1. If multiplication is used, the maximum period is (2k − 1) × 2M−3, or 1/4 of period of the additive case. If bitwise xor is used, the maximum period is 2k − 1.

For the generator to achieve this maximum period, the polynomial:

y = xk + xj + 1

must be primitive over the integers mod 2. Values of j and k satisfying this constraint have been published in the literature.

Popular pairs of primitive polynomial degrees[1] [2]
j7 5 24 65 128 6 31 97 353 168 334 273 418
k10 17 55 71 159 31 63 127 521 521 607 607 1279

Another list of possible values for j and k is on page 29 of volume 2 of The Art of Computer Programming:

(24, 55), (38, 89), (37, 100), (30, 127), (83, 258), (107, 378), (273, 607), (1029, 2281), (576, 3217), (4187, 9689), (7083, 19937), (9739, 23209)

Note that the smaller number have short periods (only a few "random" numbers are generated before the first "random" number is repeated and the sequence restarts).

If addition is used, it is required that at least one of the first k values chosen to initialise the generator be odd. If multiplication is used, instead, it is required that all the first k values be odd, and further that at least one of them is ±3 mod 8.[3]

It has been suggested that good ratios between and are approximately the golden ratio.[4]

Problems with LFGs

In a paper on four-tap shift registers, Robert M. Ziff, referring to LFGs that use the XOR operator, states that "It is now widely known that such generators, in particular with the two-tap rules such as R(103, 250), have serious deficiencies. Marsaglia observed very poor behavior with R(24, 55) and smaller generators, and advised against using generators of this type altogether. ... The basic problem of two-tap generators R(a, b) is that they have a built-in three-point correlation between

xn

,

xn-a

, and

xn-b

, simply given by the generator itself ... While these correlations are spread over the size

p=max(a,b,c,\ldots)

of the generator itself, they can evidently still lead to significant errors.".[5] This only refers to the standard LFG where each new number in the sequence depends on two previous numbers. A three-tap LFG has been shown to eliminate some statistical problems such as failing the Birthday Spacings and Generalized Triple tests.

Usage

See also

Wikipedia page 'List of random number generators' lists other PRNGs including some with better statistical qualitites:

References

Toward a universal random number generator, G.Marsaglia, A.Zaman

  1. Web site: RN Chapter . www.ccs.uky.edu . 13 January 2022 . https://web.archive.org/web/20040309175607/http://www.ccs.uky.edu/csep/RN/RN.html . 9 March 2004 . dead.
  2. Web site: SPRNG: Scalable Parallel Pseudo-Random Number Generator Library . 2005-04-11 . 2010-06-14 . https://web.archive.org/web/20100614213822/http://www.nersc.gov/nusers/resources/software/libs/math/random/www2.0/DOCS/www/parameters.html . dead .
  3. http://www.cs.fsu.edu/~asriniva/papers/mlfg.ps Parameterizing Parallel Multiplicative Lagged-Fibonacci Generators
  4. https://openresearch-repository.anu.edu.au/bitstream/1885/40805/3/TR-CS-92-02.pdf "Uniform random number generators for supercomputers"
  5. https://arxiv.org/abs/cond-mat/9710104 "Four-tap shift-register-sequence random-number generators"