Recurrence quantification analysis

Recurrence quantification analysis (RQA) is a method of nonlinear data analysis (cf. chaos theory) for the investigation of dynamical systems. It quantifies the number and duration of recurrences of a dynamical system presented by its phase space trajectory.

Background

The recurrence quantification analysis (RQA) was developed in order to quantify differently appearing recurrence plots (RPs), based on the small-scale structures therein. Recurrence plots are tools which visualise the recurrence behaviour of the phase space trajectory ${\displaystyle {\vec {x}}(i)}$ of dynamical systems:

${\displaystyle \mathbf {R} (i,j)=\Theta (\varepsilon -\|{\vec {x}}(i)-{\vec {x}}(j)\|)}$,

where ${\displaystyle \Theta$ :\mathbb {R} \rightarrow (0,1)} and ${\displaystyle \varepsilon }$ a predefined distance.

Recurrence plots mostly contain single dots and lines which are parallel to the mean diagonal (line of identity, LOI) or which are vertical/horizontal. Lines parallel to the LOI are referred to as diagonal lines and the vertical structures as vertical lines. Because an RP is usually symmetric, horizontal and vertical lines correspond to each other, and, hence, only vertical lines are considered. The lines correspond to a typical behaviour of the phase space trajectory: whereas the diagonal lines represent such segments of the phase space trajectory which run parallel for some time, the vertical lines represent segments which remain in the same phase space region for some time.

If only a time series is available, the phase space can be reconstructed by using a time delay embedding (see Takens' theorem):

${\displaystyle {\vec {x}}(i)=(u(i),u(i+\tau ),\ldots ,u(i+\tau (m-1)),}$

where ${\displaystyle u(i)}$ is the time series, ${\displaystyle m}$ the embedding dimension and ${\displaystyle \tau }$ the time delay.

The RQA quantifies the small-scale structures of recurrence plots, which present the number and duration of the recurrences of a dynamical system. The measures introduced for the RQA were developed heuristically between 1992 and 2002 (Zbilut & Webber 1992; Webber & Zbilut 1994; Marwan et al. 2002). They are actually measures of complexity. The main advantage of the recurrence quantification analysis is that it can provide useful information even for short and non-stationary data, where other methods fail.

RQA can be applied to almost every kind of data. It is widely used in physiology, but was also successfully applied on problems from engineering, chemistry, Earth sciences etc.

RQA measures

The simplest measure is the recurrence rate, which is the density of recurrence points in a recurrence plot:

${\displaystyle {\text{RR}}={\frac {1}{N^{2}}}\sum _{i,j=1}^{N}\mathbf {R} (i,j).}$

The recurrence rate corresponds with the probability that a specific state will recur. It is almost equal with the definition of the correlation sum, where the LOI is excluded from the computation.

The next measure is the percentage of recurrence points which form diagonal lines in the recurrence plot of minimal length ${\displaystyle \ell _{\min }}$:

${\displaystyle {\text{DET}}={\frac {\sum _{\ell =\ell _{\min }}^{N}\ell \,P(\ell )}{\sum _{\ell =1}^{N}\ell P(\ell )}},}$

where ${\displaystyle P(\ell )}$ is the frequency distribution of the lengths ${\displaystyle \ell }$ of the diagonal lines (i.e., it counts how many instances have length ${\displaystyle \ell }$). This measure is called determinism and is related with the predictability of the dynamical system, because white noise has a recurrence plot with almost only single dots and very few diagonal lines, whereas a deterministic process has a recurrence plot with very few single dots but many long diagonal lines.

The amount of recurrence points which form vertical lines can be quantified in the same way:

${\displaystyle {\text{LAM}}={\frac {\sum _{v=v_{\min }}^{N}vP(v)}{\sum _{v=1}^{N}vP(v)}},}$

where ${\displaystyle P(v)}$ is the frequency distribution of the lengths ${\displaystyle v}$ of the vertical lines, which have at least a length of ${\displaystyle v_{\min }}$. This measure is called laminarity and is related with the amount of laminar phases in the system (intermittency).

The lengths of the diagonal and vertical lines can be measured as well. The averaged diagonal line length

${\displaystyle {\text{L}}={\frac {\sum _{\ell =\ell _{\min }}^{N}\ell \,P(\ell )}{\sum _{\ell =\ell _{\min }}^{N}P(\ell )}}}$

is related with the predictability time of the dynamical system and the trapping time, measuring the average length of the vertical lines,

${\displaystyle TT={\frac {\sum _{v=v_{\min }}^{N}vP(v)}{\sum _{v=v_{\min }}^{N}P(v)}}}$

is related with the laminarity time of the dynamical system, i.e. how long the system remains in a specific state.

Because the length of the diagonal lines is related on the time how long segments of the phase space trajectory run parallel, i.e. on the divergence behaviour of the trajectories, it was sometimes stated that the reciprocal of the maximal length of the diagonal lines (without LOI) would be an estimator for the positive maximal Lyapunov exponent of the dynamical system. Therefore, the maximal diagonal line length ${\displaystyle L_{\max }}$ or the divergence

${\displaystyle DIV={\frac {1}{L_{\max }}}}$

are also measures of the RQA. However, the relationship between these measures with the positive maximal Lyapunov exponent is not as easy as stated, but even more complex (to calculate the Lyapunov exponent from an RP, the whole frequency distribution of the diagonal lines has to be considered). The divergence can have the trend of the positive maximal Lyapunov exponent, but not more. Moreover, also RPs of white noise processes can have a really long diagonal line, although very seldom, just by a finite probability. Therefore the divergence cannot reflect the maximal Lyapunov exponent.

The probability ${\displaystyle p(\ell )}$ that a diagonal line has exactly length ${\displaystyle \ell }$ can be estimated from the frequency distribution ${\displaystyle P(\ell )}$ with ${\displaystyle p(\ell )={\frac {P(\ell )}{\sum _{\ell =l_{\min }}^{N}P(\ell )}}}$. The Shannon entropy of this probability,

${\displaystyle {\text{ENTR}}=-\sum _{\ell =\ell _{\min }}^{N}p(\ell )\ln p(\ell ),}$

reflects the complexity of the deterministic structure in the system. However, this entropy depends sensitively on the bin number and, thus, may differ for different realisations of the same process, as well as for different data preparations.

The last measure of the RQA quantifies the thinning-out of the recurrence plot. The trend is the regression coefficient of a linear relationship between the density of recurrence points in a line parallel to the LOI and its distance to the LOI. More exactly, consider the recurrence rate in a diagonal line parallel to LOI of distance k (diagonal-wise recurrence rate):

${\displaystyle {\text{RR}}_{k}={\frac {1}{N-k}}\sum _{j-i=k}^{N-k}\mathbf {R} (i,j),}$

then the trend is defined by

${\displaystyle {\text{TREND}}={\frac {\sum _{i=1}^{\tilde {N}}(i-{\tilde {N}}/2)(RR_{i}-\langle RR_{i}\rangle )}{\sum _{i=1}^{\tilde {N}}(i-{\tilde {N}}/2)^{2}}},}$

with ${\displaystyle \langle \cdot \rangle }$ as the average value and ${\displaystyle {\tilde {N}}<N}$. This latter relation should ensure to avoid the edge effects of too low recurrence point densities in the edges of the recurrence plot. The measure trend provides information about the stationarity of the system.

Similar to the diagonal-wise defined recurrence rate, the other measures based on the diagonal lines (DET, L, ENTR) can be defined diagonal-wise. These definitions are useful to study interrelations or synchronisation between different systems (using recurrence plots or cross recurrence plots).

Time-dependent RQA

Instead of computing the RQA measures of the entire recurrence plot, they can be computed in small windows moving over the recurrence plot along the LOI. This provides time-dependent RQA measures which allow detecting, e.g., chaos-chaos transitions (Marwan et al. 2002). Note: the choice of the size of the window can strongly influence the measure trend.

Example

Bifurcation diagram for the Logistic map.

RQA measures of the logistic map for various setting of the control parameter a. The measures RR and DET exhibit maxima at chaos-order/ order-chaos transitions. The measure DIV has a similar trend as the maximal Lyapunov exponent (but it is not the same!). The measure LAM has maxima at chaos-chaos transitions (laminar phases, intermittency).

Applications

Recurrence quantification analysis has been employed to detect the characteristic of business cycles and economic development. To this end, Orlando et al.[1] developed the so-called recurrence quantification correlation index to test correlations of RQA on a sample signal and then investigated the application to business time series. The said index has been proven to detect hidden changes in time series. Further, Orlando et al.,[2] over an extensive dataset, shown that recurrence quantification analysis may help in anticipating transitions from laminar (i.e. regular) to turbulent (i.e. chaotic) phases such as USA GDP in 1949, 1953, etc. Last but not least, it has been demonstrated that recurrence quantification analysis can detect differences between macroeconomic variables and highlight hidden features of economic dynamics.

See also

• Recurrence plot, a powerful visualisation tool of recurrences in dynamical (and other) systems.
• Recurrence period density entropy, an information-theoretic method for summarising the recurrence properties of both deterministic and stochastic dynamical systems.
• Approximate entropy

References

1. Orlando, Giuseppe; Zimatore, Giovanna (18 December 2017). "RQA correlations on real business cycles time series". Indian Academy of Sciences – Conference Series. 1 (1): 35–41. doi:10.29195/iascs.01.01.0009.
2. Orlando, Giuseppe; Zimatore, Giovanna (1 May 2018). "Recurrence quantification analysis of business cycles". Chaos, Solitons & Fractals. 110: 82–94. doi:10.1016/j.chaos.2018.02.032. ISSN 0960-0779.

Further reading

• Marwan, N. (2008). "A Historical Review of Recurrence Plots". European Physical Journal ST. 164 (1): 3–12. arXiv:1709.09971. Bibcode:2008EPJST.164....3M. doi:10.1140/epjst/e2008-00829-1.
• Marwan, N., Romano, M. C. ,Thiel, M. ,Kurths, J. (2007). "Recurrence Plots for the Analysis of Complex Systems". Physics Reports. 438 (5–6): 237–329. Bibcode:2007PhR...438..237M. doi:10.1016/j.physrep.2006.11.001.CS1 maint: multiple names: authors list (link)
• Marwan, N., Wessel, N., Meyerfeldt, U., Schirdewan, A., Kurths, J. (2002). "Recurrence Plot Based Measures of Complexity and its Application to Heart Rate Variability Data". Physical Review E. 66 (2): 026702. arXiv:physics/0201064. Bibcode:2002PhRvE..66b6702M. doi:10.1103/PhysRevE.66.026702. PMID 12241313.CS1 maint: multiple names: authors list (link)
• Marwan, N., Kurths, J. (2002). "Nonlinear analysis of bivariate data with cross recurrence plots". Physics Letters A. 302 (5–6): 299–307. arXiv:physics/0201061. Bibcode:2002PhLA..302..299M. doi:10.1016/S0375-9601(02)01170-2.CS1 maint: multiple names: authors list (link)
• Webber Jr., C. L., Zbilut, J. P. (1994). "Dynamical assessment of physiological systems and states using recurrence plot strategies". Journal of Applied Physiology. 76 (2): 965–973. doi:10.1152/jappl.1994.76.2.965. PMID 8175612.CS1 maint: multiple names: authors list (link)
• Zbilut, J.P., Webber Jr., C.L. (1992). "Embeddings and delays as derived from quantification of recurrence plots". Physics Letters A. 171 (3–4): 199–203. Bibcode:1992PhLA..171..199Z. doi:10.1016/0375-9601(92)90426-M.CS1 maint: multiple names: authors list (link)
• Pratyasa Bhui; Nilanjan Senroy (2016). "Application of Recurrence Quantification Analysis to Power System Dynamic Studies". IEEE Transactions on Power Systems. 31 (1): 581–591. Bibcode:2016ITPSy..31..581B. doi:10.1109/TPWRS.2015.2407894. Paper no. TPWRS-01211-2014
• Girault, J.-M. (2015). "Recurrence and Symmetry of time series : application to transition detection" (PDF). Chaos-Solition-Fractals. 77: 11–28. Bibcode:2015CSF....77...11G. doi:10.1016/j.chaos.2015.04.010.

External links

• http://www.recurrence-plot.tk/
• http://www.scitopics.com/Recurrence_Quantification_Analysis.html