Regression Analysis > Nonlinear Regression

## What is Nonlinear Regression?

Nonlinear regression uses nonlinear regression equations, which take the form:

**Y = f(X,β) + ε**

Where:

- X = a vector of
*p*predictors, - β = a vector of
*k*parameters, - f(-) = a known regression function,
- ε = an error term.

The **formal definition** is that if your regression equation looks like the one above, it’s nonlinear regression. However, this is actually a lot more difficult than it sounds. Take the following nonlinear regression equations:

- The Michaelis-Menten model: f(x,β) = (β
_{1}x) / (β_{2}+ x). - Y = β
_{0}+ (0.4 – β_{0})e^{-β1(xi-5)}+ ε_{i}.

These both meet the requirement of fitting the form Y = f(X,β) + ε, but that isn’t immediately obvious without some in-depth knowledge of algebra and regression analysis.

The good news is there is a much **simpler, more intuitive definition of nonlinear regression**:

If your model uses an equation in the form Y = a

_{0}+ b_{1}X_{1}, it’s a linear regression model. If not, it’s nonlinear.

It’s *much* easier to spot a linear regression equation, as it’s *always* going to take the form Y = a_{0} + b_{1}X_{1}*.

## Linear vs. Nonlinear Regression

Many people think that the difference between linear and nonlinear regression is that linear regression involves lines and nonlinear regression involves curves. This is partly true, and if you want a loose definition for the difference, you can probably stop right there. However,*linear equations can sometimes produce curves.*

In order to understand why, you need to take a look at the linear regression equation form.

Linear regression uses a linear equation in one basic form, Y = a +bx, where x is the explanatory variable and Y is the dependent variable:

Y = a

_{0}+ b_{1}X_{1}.

You can have multiple equations added together:

Y = a_{0} + b_{1}X_{1} + b_{2}X_{2} + b_{3}X_{3}…

And you can even square a term to model a curve:

Y = a_{0} + b_{1}X_{1}^{2}.

**Even though it’s modeling a curve, it’s still a linear regression equation because it’s in the form Y = a +bx.**

**A nonlinear regression equation can take on multiple forms.**

It’s worth highlighting the intuitive definition again: If your equation looks like the examples above (i.e. it looks like Y = a +bx), it’s linear. If not, it’s nonlinear.

**Note/caveat/disclaimer (AKA, there’s always an exception in statistics)**:* It’s true that if your model has an equation in the form Y = a +bx, then it’s linear. However, there are a few cases where a nonlinear equation can be transformed to mimic a linear equation. If this happens, the nonlinear equation is called “intrinsically linear.” For example, the nonlinear

Y = Β

_{0}X / (Β

_{1}+ X)

can be transformed with a little algebra to become intrinsically linear:

1/Y = 1/β

_{0}+ (β

_{1}/β

_{0})*1/X

= θ

_{0}+ θ

_{1}*1/X.