Idempotent Matrix: Definition, Examples

Matrices >

An idempotent matrix is one which, when multiplied by itself, doesn’t change. If a matrix A is idempotent, A2 = A.

Examples of Idempotent Matrix

The simplest examples of n x n idempotent matrices are the identity matrix In, and the null matrix (where every entry on the matrix is 0).

Nontrivial examples of 2 x 2 matrices are relatively easy to come up with (Need help? Check out our tutoring page!). Since A2 = A, we know that for a matrix Idempotent Matrix - Nontrivial examples of 2 x 2 matrices image,


a = a2 + bc
b = ab + bd, so b – ab – bd = 0 and b(1 – a – d) = 0 and either b = 0 or d = 1 – a
c = ca + cd, so c – ca – cd = 0 and c(1 – a – d) = 0 and either c = 0 or d = 1 – a
d = bc + d2.

To come up with your own idempotent matrix, start by choosing any value of a. For an example, let’s choose 3. Make d = 1 – a, or -2. Now -2 = bc + 4, by our a last equation above, so -6 = bc. As a quick check, see that this fits our first equation, a = 3 = a2 + bc = 9 – 6.

We can choose any values of b and c that fit bc = -6, so to make it easy on ourselves and stick to whole integers; b = -2 and c = 3. So the matrix

Idempotent Matrix image

is idempotent.

You can come up with a similar set of algebra rules for finding idempotent matrices in any size n x n ; the larger the matrix gets, the stickier the algebra may become, but the method remains the same.

Properties of Idempotent Matrices

Except for the identity matrix (I), every idempotent matrix is singular. What this means is that it is a square matrix, whose determinant is 0.

Since
[I – M] [I – M] = I – M – M + M2 = I – M – M + M = I – M,
the identity matrix minus any other idempotent matrix is also an idempotent matrix.

The Idempotent Matrix in Statistics

Idempotent matrices are important in regression analysis and the theory of linear statistical models, especially as they relate to the analysis of variance and the theory of least squares.

References

Harville D.A. (1997) Idempotent Matrices. In: Matrix Algebra From a Statistician’s Perspective.


Comments? Need to post a correction? Please Contact Us.