Statistics How To

Characteristic Functions: Simple Definition, List of Common Functions

Probability >

Note: the term characteristic function is sometimes called an indicator function. This can cause some confusion, as an indicator function is also a specific function used in set theory. If you’re looking for the indicator functions used in probability and set theory (that take on values of 1 or 0), see: What is an indicator function? Otherwise, read on.

A characteristic function completely defines a probability distribution. Completely defining a probability distribution involves defining a complex function (a mix of real numbers and imaginary numbers).

The characteristic function φ(X) of a random variable X is:

φ(X) = E(eitX) = E(cos(tX)) + iE(sin(tX))

Where:

Finding Characteristic Functions

Some of the more common functions (e.g. the normal distribution and binomial distribution) have already been defined (adapted from Lee & Lee, 2010):
characteristic functions

Finding others can be more challenging, but some rules have been formulated (much in the same way a set of rules for finding derivatives of functions have been found in calculus). For example, if a function is the sum of two independent random variables X and Y, then φ(X,Y) = X + Y (Battin, 1999).

Outside of probability (e.g. in quantum mechanics or signal processing), a characteristic function is called the Fourier transform. The Fourier transform in this context is defined as as “a function derived from a given function and representing it by a series of sinusoidal functions.” In other words, it’s a recipe (made up from sinusoidal functions) for a specific function of interest.

Characteristic Function vs. MGF

A characteristic function is almost the same as a moment generating function (MGF), and in fact, they use the same symbol φ — which can be confusing. The difference is that the “t” in the MGF definition E(etx) is replaced by “it”. In other words, the imaginary number is not present in the definition of an MGF. Therefore, the characteristic function has the advantage that it always exists — even when there is no MGF.

References:
Richard H. Battin. (1999). An Introduction to the Mathematics and Methods of Astrodynamics. AIAA.
Cheng-Few Lee, John Lee. (2010). Handbook of Quantitative Finance and Risk Management. Springer Science & Business Media.

------------------------------------------------------------------------------

If you prefer an online interactive environment to learn R and statistics, this free R Tutorial by Datacamp is a great way to get started. If you're are somewhat comfortable with R and are interested in going deeper into Statistics, try this Statistics with R track.

Comments are now closed for this post. Need help or want to post a correction? Please post a comment on our Facebook page and I'll do my best to help!
Characteristic Functions: Simple Definition, List of Common Functions was last modified: October 12th, 2017 by Stephanie Glen