Product integral

A product integral is any product-based counterpart of the usual sum-based integral of calculus. The first product integral (Type I below) was developed by the mathematician Vito Volterra in 1887 to solve systems of linear differential equations.[1][2] Other examples of product integrals are the geometric integral (Type II below), the bigeometric integral (Type III below), and some other integrals of non-Newtonian calculus.[3][4][5]

Product integrals have found use in areas from epidemiology (the Kaplan–Meier estimator) to stochastic population dynamics using multiplication integrals (multigrals), analysis and quantum mechanics. The geometric integral, together with the geometric derivative, is useful in image analysis[6][7][8][9] and in the study of growth/decay phenomena (e.g., in economic growth, bacterial growth, and radioactive decay).[10][11][12][13] The bigeometric integral, together with the bigeometric derivative, is useful in some applications of fractals,[14][15][16][17][18][19][20][21][22] and in the theory of elasticity in economics.[3][23][5][24][25]

This article adopts the "product" ${\displaystyle \prod }$ notation for product integration instead of the "integral" ${\displaystyle \int }$ (usually modified by a superimposed "times" symbol or letter P) favoured by Volterra and others. An arbitrary classification of types is also adopted to impose some order in the field.

Basic definitions

The classical Riemann integral of a function ${\displaystyle f:[a,b]\to \mathbb {R} }$ can be defined by the relation

${\displaystyle \int _{a}^{b}f(x)\,dx=\lim _{\Delta x\to 0}\sum f(x_{i})\,\Delta x,}$

where the limit is taken over all partitions of the interval ${\displaystyle [a,b]}$ whose norms approach zero.

Roughly speaking, product integrals are similar, but take the limit of a product instead of the limit of a sum. They can be thought of as "continuous" versions of "discrete" products.

The most popular product integrals are the following:

Type I: Volterra integral

${\displaystyle \prod _{a}^{b}{\big (}1+f(x)\,dx{\big )}=\lim _{\Delta x\to 0}\prod {\big (}1+f(x_{i})\,\Delta x{\big )}.}$

The type I product integral corresponds to Volterra's original definition.[2][26][27] The following relationship exists for scalar functions ${\displaystyle f:[a,b]\to \mathbb {R} }$:

${\displaystyle \prod _{a}^{b}{\big (}1+f(x)\,dx{\big )}=\exp \left(\int _{a}^{b}f(x)\,dx\right),}$

which is not a multiplicative operator. (So the concepts of product integral and multiplicative integral are not the same).

The Volterra product integral is most useful when applied to matrix-valued functions or functions with values in a Banach algebra, where the last equality is no longer true (see the references below).

When applied to scalars belonging to a non-commutative field, to matrixes, and to operators, i.e. to mathematical objects that don't commute, the Volterra integral splits in two definitions [28]

Left Product integral

${\displaystyle P(A,D)=\prod _{i=m}^{1}(\mathbb {1} +A(\xi _{i})\Delta t_{i})=(\mathbb {1} +A(\xi _{m})\Delta t_{m})...(\mathbb {1} +A(\xi _{1})\Delta t_{1})}$

With the notation of left products (i.e. normal products applied from left)

${\displaystyle \prod _{a}^{b}(\mathbb {1} +A(t)dt)=\lim _{max\Delta t_{i}\to 0}P(A,D)}$

Right Product Integral

${\displaystyle P(A,D)^{*}=\prod _{i=1}^{m}(\mathbb {1} +A(\xi _{i})\Delta t_{i})=(\mathbb {1} +A(\xi _{1})\Delta t_{1})...(\mathbb {1} +A(\xi _{m})\Delta t_{m})}$

With the notation of right products (i.e. applied from right)

${\displaystyle (\mathbb {1} +A(t)dt)\prod _{a}^{b}=\lim _{max\Delta t_{i}\to 0}P(A,D)^{*}}$

Where ${\displaystyle \mathbb {1} }$ is the identity matrix and D is a partition of the interval [a,b] in the Riemann sense, i.e. the limit is over the maximum interval in the partition. Note how in this case time ordering comes evident in the definitions.

For scalar functions, the derivative in the Volterra system is the logarithmic derivative, and so the Volterra system is not a multiplicative calculus and is not a non-Newtonian calculus.[2]

Type II: geometric integral

${\displaystyle \prod _{a}^{b}f(x)^{dx}=\lim _{\Delta x\to 0}\prod {f(x_{i})^{\Delta x}}=\exp \left(\int _{a}^{b}\ln f(x)\,dx\right),}$

which is called the geometric integral and is a multiplicative operator.

This definition of the product integral is the continuous analog of the discrete product operator

${\displaystyle \prod _{i=a}^{b}}$

(with ${\displaystyle i,a,b\in \mathbb {Z} }$) and the multiplicative analog to the (normal/standard/additive) integral

${\displaystyle \int _{a}^{b}dx}$

(with ${\displaystyle x\in [a,b]}$):

	additive	multiplicative
discrete	${\displaystyle \sum _{i=a}^{b}f(i)}$	${\displaystyle \prod _{i=a}^{b}f(i)}$
continuous	${\displaystyle \int _{a}^{b}f(x)\,dx}$	${\displaystyle \prod _{a}^{b}f(x)^{dx}}$

It is very useful in stochastics, where the log-likelihood (i.e. the logarithm of a product integral of independent random variables) equals the integral of the logarithm of these (infinitesimally many) random variables:

${\displaystyle \ln \prod _{a}^{b}p(x)^{dx}=\int _{a}^{b}\ln p(x)\,dx.}$

Type III: bigeometric integral

${\displaystyle \prod _{a}^{b}f(x)^{d(\ln x)}=\exp \left(\int _{r}^{s}\ln f(e^{x})\,dx\right),}$

where r = ln a, and s = ln b.

The type III product integral is called the bigeometric integral and is a multiplicative operator.

Results

Basic results

The following results are for the type II product integral (the geometric integral). Other types produce other results.

${\displaystyle \prod _{a}^{b}c^{dx}=c^{b-a},}$

${\displaystyle \prod _{a}^{b}x^{dx}={\frac {b^{b}}{a^{a}}}{\rm {e}}^{a-b},}$

${\displaystyle \prod _{0}^{b}x^{dx}=b^{b}{\rm {e}}^{-b},}$

${\displaystyle \prod _{a}^{b}\left(f(x)^{k}\right)^{dx}=\left(\prod _{a}^{b}f(x)^{dx}\right)^{k},}$

${\displaystyle \prod _{a}^{b}\left(c^{f(x)}\right)^{dx}=c^{\int _{a}^{b}f(x)\,dx},}$

The geometric integral (type II above) plays a central role in the geometric calculus,[3][29][30] which is a multiplicative calculus.

The fundamental theorem

${\displaystyle \prod _{a}^{b}f^{*}(x)^{dx}=\prod _{a}^{b}\exp \left({\frac {f'(x)}{f(x)}}\,dx\right)={\frac {f(b)}{f(a)}},}$

where ${\displaystyle f^{*}(x)}$ is the geometric derivative.

Product rule

${\displaystyle (fg)^{*}=f^{*}g^{*}.}$

Quotient rule

${\displaystyle (f/g)^{*}=f^{*}/g^{*}.}$

Law of large numbers

${\displaystyle {\sqrt[{n}]{X_{1}X_{2}\cdots X_{n}}}{\underset {n\to \infty }{\longrightarrow }}\prod _{x}X^{dF(x)},}$

where X is a random variable with probability distribution F(x).

Compare with the standard law of large numbers:

${\displaystyle {\frac {X_{1}+X_{2}+\cdots +X_{n}}{n}}{\underset {n\to \infty }{\longrightarrow }}\int X\,dF(x).}$

Lebesgue-type product-integrals

Just like the Lebesgue version of (classical) integrals, one can compute product integrals by approximating them with the product integrals of simple functions. Each type of product integral has a different form for simple functions.

Type I: Volterra integral

Because simple functions generalize step functions, in what follows we will only consider the special case of simple functions that are step functions. This will also make it easier to compare the Lebesgue definition with the Riemann definition.

Given a step function ${\displaystyle f:[a,b]\to \mathbb {R} }$ with corresponding partition ${\displaystyle a=y_{0}<y_{1}<\dots <y_{m}}$ and a tagged partition

${\displaystyle a=x_{0}<x_{1}<\dots <x_{n}=b,\quad x_{0}\leq t_{0}\leq x_{1},x_{1}\leq t_{1}\leq x_{2},\dots ,x_{n-1}\leq t_{n-1}\leq x_{n},}$

one approximation of the "Riemann definition" of the type I product integral is given by[31]

${\displaystyle \prod _{k=0}^{n-1}\left[{\big (}1+f(t_{k}){\big )}\cdot (x_{k+1}-x_{k})\right].}$

The (type I) product integral was defined to be, roughly speaking, the limit of these products by Ludwig Schlesinger in a 1931 article.

Another approximation of the "Riemann definition" of the type I product integral is defined as

${\displaystyle \prod _{k=0}^{n-1}\exp {\big (}f(t_{k})\cdot (x_{k+1}-x_{k}){\big )}.}$

When ${\displaystyle f}$ is a constant function, the limit of the first type of approximation is equal to the second type of approximation.[32] Notice that in general, for a step function, the value of the second type of approximation doesn't depend on the partition, as long as the partition is a refinement of the partition defining the step function, whereas the value of the first type of approximation does depend on the fineness of the partition, even when it is a refinement of the partition defining the step function.

It turns out that[33] that for any product-integrable function ${\displaystyle f}$, the limit of the first type of approximation equals the limit of the second type of approximation. Since, for step functions, the value of the second type of approximation doesn't depend on the fineness of the partition for partitions "fine enough", it makes sense to define[34] the "Lebesgue (type I) product integral" of a step function as

${\displaystyle \prod _{a}^{b}{\big (}1+f(x)\,dx{\big )}{\overset {def}{=}}\prod _{k=0}^{m-1}\exp {\big (}f(s_{k})\cdot (y_{k+1}-y_{k}){\big )},}$

where ${\displaystyle y_{0}<a=s_{0}<y_{1}<\dots <y_{n-1}<s_{n-1}<y_{n}=b}$ is a tagged partition, and again ${\displaystyle a=y_{0}<y_{1}<\dots <y_{m}}$ is the partition corresponding to the step function ${\displaystyle f}$. (In contrast, the corresponding quantity would not be unambiguously defined using the first type of approximation.)

This generalizes to arbitrary measure spaces readily. If ${\displaystyle X}$ is a measure space with measure ${\displaystyle \mu }$, then for any product-integrable simple function ${\displaystyle f(x)=\sum _{k=1}^{n}a_{k}I_{A_{k}}(x)}$ (i.e. a conical combination of the indicator functions for some disjoint measurable sets ${\displaystyle A_{0},A_{1},\dots ,A_{m-1}\subseteq X}$), its type I product integral is defined to be

${\displaystyle \prod _{X}{\big (}1+f(x)\,d\mu (x){\big )}{\overset {def}{=}}\prod _{k=0}^{m-1}\exp {\big (}a_{k}\mu (A_{k}){\big )},}$

since ${\displaystyle a_{k}}$ is the value of ${\displaystyle f}$ at any point of ${\displaystyle A_{k}}$. In the special case where ${\displaystyle X=\mathbb {R} }$, ${\displaystyle \mu }$ is Lebesgue measure, and all of the measurable sets ${\displaystyle A_{k}}$ are intervals, one can verify that this is equal to the definition given above for that special case. Analogous to the theory of Lebesgue (classical) integrals, the Volterra product integral of any product-integrable function ${\displaystyle f}$ can be written as the limit of an increasing sequence of Volterra product integrals of product-integrable simple functions.

Taking logarithms of both sides of the above definition, one gets that for any product-integrable simple function ${\displaystyle f}$:

${\displaystyle \ln \left(\prod _{X}{\big (}1+f(x)\,d\mu (x){\big )}\right)=\ln \left(\prod _{k=0}^{m-1}\exp {\big (}a_{k}\mu (A_{k}){\big )}\right)=\sum _{k=0}^{m-1}a_{k}\mu (A_{k})=\int _{X}f(x)\,d\mu (x)\iff }$

${\displaystyle \prod _{X}{\big (}1+f(x)\,d\mu (x){\big )}=\exp \left(\int _{X}f(x)\,d\mu (x)\right),}$

where we used the definition of integral for simple functions. Moreover, because continuous functions like ${\displaystyle \exp }$ can be interchanged with limits, and the product integral of any product-integrable function ${\displaystyle f}$ is equal to the limit of product integrals of simple functions, it follows that the relationship

${\displaystyle \prod _{X}{\big (}1+f(x)\,d\mu (x){\big )}=\exp \left(\int _{X}f(x)\,d\mu (x)\right)}$

holds generally for any product-integrable ${\displaystyle f}$. This clearly generalizes the property mentioned above.

The Volterra product integral is multiplicative as a set function,[35] which can be shown using the above property. More specifically, given a product-integrable function ${\displaystyle f}$ one can define a set function ${\displaystyle {\cal {V}}_{f}}$ by defining, for every measurable set ${\displaystyle B\subseteq X}$,

${\displaystyle {\cal {V}}_{f}(B){\overset {def}{=}}\prod _{B}{\big (}1+f(x)\,d\mu (x){\big )}{\overset {def}{=}}\prod _{X}{\big (}1+(f\cdot I_{B})(x)\,d\mu (x){\big )},}$

where ${\displaystyle I_{B}(x)}$ denotes the indicator function of ${\displaystyle B}$. Then for any two disjoint measurable sets ${\displaystyle B_{1},B_{2}}$ one has

${\displaystyle {\begin{aligned}{\cal {V}}_{f}(B_{1}\sqcup B_{2})&=\prod _{B_{1}\sqcup B_{2}}{\big (}1+f(x)\,d\mu (x){\big )}\\&=\exp \left(\int _{B_{1}\sqcup B_{2}}f(x)\,d\mu (x)\right)\\&=\exp \left(\int _{B_{1}}f(x)\,d\mu (x)+\int _{B_{2}}f(x)\,d\mu (x)\right)\\&=\exp \left(\int _{B_{1}}f(x)\,d\mu (x)\right)\exp \left(\int _{B_{2}}f(x)\,d\mu (x)\right)\\&=\prod _{B_{1}}(1+f(x)d\mu (x))\prod _{B_{2}}(1+f(x)\,d\mu (x))\\&={\cal {V}}_{f}(B_{1}){\cal {V}}_{f}(B_{2}).\end{aligned}}}$

This property can be contrasted with measures, which are additive set functions.

However the Volterra product integral is not multiplicative as a functional. Given two product-integrable functions ${\displaystyle f,g}$, and a measurable set ${\displaystyle A}$, it is generally the case that

${\displaystyle \prod _{A}{\big (}1+(fg)(x)\,d\mu (x){\big )}\neq \prod _{A}{\big (}1+f(x)\,d\mu (x){\big )}\prod _{A}{\big (}1+g(x)\,d\mu (x){\big )}.}$

Type II: geometric integral

If ${\displaystyle X}$ is a measure space with measure ${\displaystyle \mu }$, then for any product-integrable simple function ${\displaystyle f(x)=\sum _{k=1}^{n}a_{k}I_{A_{k}}(x)}$ (i.e. a conical combination of the indicator functions for some disjoint measurable sets ${\displaystyle A_{0},A_{1},\dots ,A_{m-1}\subseteq X}$), its type II product integral is defined to be

${\displaystyle \prod _{X}f(x)^{d\mu (x)}{\overset {def}{=}}\prod _{k=0}^{m-1}a_{k}^{\mu (A_{k})}.}$

This can be seen to generalize the definition given above.

Taking logarithms of both sides, we see that for any product-integrable simple function ${\displaystyle f}$:

${\displaystyle \ln \left(\prod _{X}f(x)^{d\mu (x)}\right)=\sum _{k=0}^{m-1}\ln(a_{k})\mu (A_{k})=\int _{X}\ln f(x)\,d\mu (x)\iff \prod _{X}f(x)^{d\mu (x)}=\exp \left(\int _{X}\ln f(x)\,d\mu (x)\right),}$

where we have used the definition of the Lebesgue integral for simple functions. This observation, analogous to the one already made above, allows one to entirely reduce the "Lebesgue theory of geometric integrals" to the Lebesgue theory of (classical) integrals. In other words, because continuous functions like ${\displaystyle \exp }$ and ${\displaystyle \ln }$ can be interchanged with limits, and the product integral of any product-integrable function ${\displaystyle f}$ is equal to the limit of some increasing sequence of product integrals of simple functions, it follows that the relationship

${\displaystyle \prod _{X}f(x)^{d\mu (x)}=\exp \left(\int _{X}\ln f(x)\,d\mu (x)\right)}$

holds generally for any product-integrable ${\displaystyle f}$. This generalizes the property of geometric integrals mentioned above.

See also

• List of derivatives and integrals in alternative calculi
• Indefinite product
• Logarithmic derivative
• Ordered exponential
• Fractal derivative

References

1. V. Volterra, B. Hostinský, Opérations Infinitésimales Linéaires, Gauthier-Villars, Paris (1938).
2. A. Slavík, Product integration, its history and applications, ISBN 80-7378-006-2, Matfyzpress, Prague, 2007.
3. M. Grossman, R. Katz, Non-Newtonian Calculus, ISBN 0-912938-01-3, Lee Press, 1972.
4. Michael Grossman. The First Nonlinear System of Differential And Integral Calculus, ISBN 0977117006, 1979.
5. Michael Grossman. Bigeometric Calculus: A System with a Scale-Free Derivative, ISBN 0977117030, 1983.
6. Luc Florack and Hans van Assen."Multiplicative calculus in biomedical image analysis", Journal of Mathematical Imaging and Vision, doi:10.1007/s10851-011-0275-1, 2011.
7. Luc Florack."Regularization of positive definite matrix fields based on multiplicative calculus", Reference 9, Scale Space and Variational Methods in Computer Vision, Lecture Notes in Computer Science, Volume 6667/2012, pages 786–796, doi:10.1007/978-3-642-24785-9_66, Springer, 2012.
8. Luc Florack."Regularization of positive definite matrix fields based on multiplicative calculus", Third International Conference on Scale Space and Variational Methods In Computer Vision, Ein-Gedi Resort, Dead Sea, Israel, Lecture Notes in Computer Science: 6667, ISBN 978-3-642-24784-2, Springer, 2012.
9. Joachim Weickert and Laurent Hoeltgen. University Course: "Analysis beyond Newton and Leibniz", Saarland University in Germany, Mathematical Image Analysis Group, Summer of 2012.
10. Diana Andrada Filip and Cyrille Piatecki. "A non-Newtonian examination of the theory of exogenous economic growth", CNCSIS – UEFISCSU Archived 2009-01-06 at the Wayback Machine(project number PNII IDEI 2366/2008) and LEO Archived 2010-02-08 at the Wayback Machine, 2010.
11. Diana Andrada Filip and Cyrille Piatecki. "An overview on non-Newtonian calculus and its potential applications to economics", Applied Mathematics – A Journal of Chinese Universities, Volume 28, China Society for Industrial and Applied Mathematics, Springer, 2014.
12. Agamirza E. Bashirov, Emine Misirli, Yucel Tandogdu, and Ali Ozyapici."On modelling with multiplicative differential equations", Applied Mathematics – A Journal of Chinese Universities, Volume 26, Number 4, pages 425–428, doi:10.1007/s11766-011-2767-6, Springer, 2011.
13. Diana Andrada Filip and Cyrille Piatecki. "In defense of a non-Newtonian economic analysis", http://www.univ-orleans.fr/leo/infer/PIATECKI.pdf%5B%5D, CNCSIS – UEFISCSU (Babes-Bolyai University of Cluj-Napoca, Romania) and LEO (Orléans University, France), 2013.
14. Wojbor Woycznski."Non-Newtonian calculus for the dynamics of random fractal structures: linear and nonlinear", seminar at Cleveland State University on 2 May 2012.
15. Wojbor Woycznski."Fractional calculus for random fractals", seminar at Case Western Reserve University on 3 April 2013.
16. Martin Ostoja-Starzewski."The inner workings of fractal materials", Media-Upload, University of Illinois at Urbana-Champaign.
17. Marek Rybaczuk."Critical growth of fractal patterns in biological systems", Acta of Bioengineering and Biomechanics, Volume 1, Number 1, Wroclaw University of Technology, 1999.
18. Marek Rybaczuk, Alicja Kedzia and Witold Zielinski (2001) "The concept of physical and fractal dimension II. The differential calculus in dimensional spaces", Chaos, Solitons, & FractalsVolume 12, Issue 13, October 2001, pages 2537–2552.
19. Aniszewska, Dorota (October 2007). "Multiplicative Runge–Kutta methods". Nonlinear Dynamics. 50 (1–2): 265–272. doi:10.1007/s11071-006-9156-3.
20. Dorota Aniszewska and Marek Rybaczuk (2005) "Analysis of the multiplicative Lorenz system", Chaos, Solitons & Fractals Volume 25, Issue 1, July 2005, pages 79–90.
21. Aniszewska, Dorota; Rybaczuk, Marek (2008). "Lyapunov type stability and Lyapunov exponent for exemplary multiplicative dynamical systems". Nonlinear Dynamics. 54 (4): 345–354. doi:10.1007/s11071-008-9333-7..
22. M. Rybaczuk and P. Stoppel (2000) "The fractal growth of fatigue defects in materials", International Journal of Fracture, Volume 103, Number 1 / May, 2000.
23. Fernando Córdova-Lepe. "The multiplicative derivative as a measure of elasticity in economics", TMAT Revista Latinoamericana de Ciencias e Ingeniería, Volume 2, Number 3, 2006.
24. Fernando Córdova-Lepe. "From quotient operation toward a proportional calculus", International Journal of Mathematics, Volume 18, Number 6, pages 527-536, 2009.
25. Murat Kirisci. "Topological structures of non-Newtonian metric spaces", Electronic Journal of Mathematical Analysis and Applications, Volume 5, Number 2, ISSN: 2090-729X (online), 2017.
26. J. D. Dollard, C. N. Friedman, Product integration with applications to differential equations, Addison Wesley Publishing Company, 1979.
27. F. R. Gantmacher (1959) The Theory of Matrices, volumes 1 and 2.
28. Wilson Lines in Quantum Field Theory
29. Michael Grossman. The First Nonlinear System of Differential And Integral Calculus, ISBN 0977117006, 1979.
30. A. E. Bashirov, E. M. Kurpınar, A. Özyapıcı. Multiplicative calculus and its applications, Journal of Mathematical Analysis and Applications, 2008.
31. A. Slavík, Product integration, its history and applications, p. 65. Matfyzpress, Prague, 2007. ISBN 80-7378-006-2.
32. A. Slavík, Product integration, its history and applications, p. 71. Matfyzpress, Prague, 2007. ISBN 80-7378-006-2.
33. A. Slavík, Product integration, its history and applications, p. 72. Matfyzpress, Prague, 2007. ISBN 80-7378-006-2.
34. A. Slavík, Product integration, its history and applications, p. 80. Matfyzpress, Prague, 2007. ISBN 80-7378-006-2
35. Gill, Richard D., Soren Johansen. "A Survey of Product Integration with a View Toward Application in Survival Analysis". The Annals of Statistics 18, no. 4 (December 1990): 1501—555, p. 1503.

• W. P. Davis, J. A. Chatfield, Concerning Product Integrals and Exponentials, Proceedings of the American Mathematical Society, Vol. 25, No. 4 (Aug., 1970), pp. 743–747, doi:10.2307/2036741.
• J. D. Dollard, C. N. Friedman, Product integrals and the Schrödinger Equation, Journ. Math. Phys. 18 #8,1598–1607 (1977).
• J. D. Dollard, C. N. Friedman, Product integration with applications to differential equations, Addison Wesley Publishing Company, 1979.

External links

• Non-Newtonian calculus website
• Richard Gill, Product Integration
• Richard Gill, Product Integral Symbol
• David Manura, Product Calculus
• Tyler Neylon, Easy bounds for n!
• An Introduction to Multigral (Product) and Dx-less Calculus
• Notes On the Lax equation
• Antonín Slavík, An introduction to product integration
• Antonín Slavík, Henstock–Kurzweil and McShane product integration