Specify the vectors before calculating entropy
For N observations in chronological order, choose an integer embedding dimension m ≥ 2 and delay τ ≥ 1. Each vector is [x(i), x(i+τ), ..., x(i+(m-1)τ)]. Advance the start i by one observation. There are K = max(0, N-(m-1)τ) candidate vectors, each spanning (m-1)τ observation intervals. Delay changes the spacing inside a vector; it does not change the one-observation step between starts.
- A label such as 201 means position 2 is smallest, position 0 is next and position 1 is largest. For [9, 10, 6], this is 201. A convention that writes the rank of each observation instead produces 120. Use one encoding throughout; consistent relabeling preserves the entropy but changes named counts.
- For retained count M, estimate p(pattern) = count(pattern)/M. H = -Σ p ln(p), summing over positive counts, reports nats. Normalize with H_norm = H/ln(m!). The convention 0 ln(0) = 0 means absent patterns contribute nothing.
- With M > 0, H_norm lies between 0 and 1. Zero means one observed pattern; one requires equal frequency of all m! patterns. Dividing by ln(number of observed patterns) instead changes the statistic and hides unobserved possibilities.
| Setting | Meaning | Example |
|---|---|---|
| N = 8 | Observations in the analysis window | Eight ordered values |
| m = 3 | Values per embedded vector | 3! = 6 possible strict ordinal patterns |
| τ = 1 | Observation spacing within a vector | K = 8 - 2 = 6 vectors |
| τ = 2 | Every other observation within a vector | K = 8 - 4 = 4 vectors |
| Time-order ties | Sort equal values by their earlier position | [2, 2, 1] becomes 201 |