Statistics How To

What is a Statistic? A Plain English Explanation

Probability and Statistics >Basic Statistics > What is a Statistic?

Contents:

  1. What is a Statistic?
  2. What is the Difference Between Inferential and Descriptive Statistics?
  3. Notation
  4. Data & Variables
  5. Vital Statistics & Estimators

What is a Statistic?

A statistic is a piece of data from a portion of a population. It’s the opposite of a parameter. A parameter is data from a census. A census surveys everyone.

Think of it like this: If you have a bit of information, it’s a statistic. If you look at part of a data set, it’s a statistic. If you know something about 10% of people, that’s a statistic too. Parameters are all the information. And all the information is rarely known. That’s why we need stats!

What is a Statistic used for?

Statistics is a way to understand the data that is collected about us and the world. For example, every time you send a package through the mail, that package is tracked in a huge database. The UPS database is 17 terabytes — about as big as if you cataloged every book in the Library of Congress. All of that data is meaningless without a way to interpret it, which is where statistics comes in. Statistics is about data and variables. It’s also about analyzing that data and producing some meaningful information about that data.

What is a Statistic: Types

Stats come in three types:

  • Descriptive Statistics. Describe data. Includes sample mean or sample median. Order statistics are a subset of descriptive statistics. They tell you something about how the data is ordered. For example, measurements like the sample minimum. You know the order is #1. Also includes charts and graphs. Anything that describes data is descriptive statistics.
  • Estimators.Used to guess at a parameter. In other words, something about a population. Often taken from descriptive stats. For example, if you know the sample mean you can use it to guess what the population mean is. Used in inferential statistics. Inferential stats is just a “best guess” about something, based on data.
  • Test Statistics, which are used in null hypothesis testing. That’s where you take a known fact about a population and then test that fact to see if it is true or not. A “population” could be real people in a trial. Or it could be TVs in a factory. Which test statistic you use depends on what kind of data you have. Some examples of test stats: t score, and chi-square.

A statistic can be more than one type. For example, the sample standard deviation can be used as a descriptive statistic to describe the standard deviation of a sample. It can be used as an estimator: To estimate the population standard deviation. And it can be used to test a theory (a hypothesis).

Origin of Statistic

The word statistic indirectly comes from the medieval Latin word status, for a political state although there is also a closely related word in German (statistik) which is also used in a political sense. “Statistik” was popularized by German political scientist Gottfried Aschenwall (1719-1772) in his “Vorbereitung zur Staatswissenschaft” (1748).

According to Leiden University, it’s difficult to know exactly when the word ceased to have a meaning close to a “political state” and became more of a mathematical term. The first time the word was used in the Oxford English Dictionary is in 1770, in W. Hooper’s translation of Bielfield’s Elementary Universal Education: “The science, that is called statistics, teaches us what is the political arrangement of all the modern states of the known world.” The Online Etymology Dictionary states that the first recorded time the word meant “numerical data collected and classified” was 1829 and the abbreviated form stats first appeared in 1961.

Webster’s 1828 dictionary defines statistics as:

A collection of facts respecting the state of society, the condition of the people in a nation or country, their health, longevity, domestic economy, arts, property and political strength, the state of the country, &c.

Back to Top

What is the Difference Between Inferential and Descriptive Statistics?

Inferential means that you can infer (make predictions) from the data, while descriptive means that you just describe the data.

Difference Between Inferential and Descriptive Statistics: Example

Let’s say you worked every week last month and received four paychecks: $100, $105, $110, and $120.
Examples of descriptive statistics about your pay (describing and summarizing the set of data)
Some options available to you:

Examples of inferential statistics about your pay (making predictions):
Perhaps the most obvious inference you can make from your pay is that there’s an upwards trend. It looks like it’s going up by $5 per week, so you can expect to earn $125 in week 5. You can quantify this trend by:

  • Inserting a trendline: this is easy to do in Microsoft Excel (instructions can be found here). You could also draw a rough line by hand–grab a ruler, draw a pencil line, and make your predictions based on where the line is going. For your pay, the line is going upwards (it should have a positive slope).
  • If you want an equation for the trendline, you can perform regression analysis, enabling you to easily predict what you’ll earn next, week, next month, or next year.
  • More complex inferential statistics include hypothesis testing, where you take raw data and use a known model to verify the accuracy of your predictions. For this pay check example, you might compare your pay to the average pay of someone else working in your particular field.

Back to Top

What is a Statistic? Notation

In general, stats notation is in Roman letters, a-z. Parameters have Greek letters or uppercase Roman). If some letters look the same: look closely. For example, look for the small p and large P. Usually, if you see a large letter (i.e. P), it’s a parameter. Small letters usually mean it’s a stat.

Measurement Statistic (Roman or lowercase) Parameter (Greek or uppercase)
Population Proportion p P
Data Elements x X
Population Mean what is a statistic μ
http://www.statisticshowto.com/what-is-standard-deviation/ s σ
Variance s2 σ2
Number of elements n N
Correlation Coefficient r ρ

Back to Top

What is a Statistic: Data & Variables

You might think that data is a list of numbers. However, in statistics, “Data” means something a little different; Data contains the who and what about something (the “something” could be anything from a book in a bookstore to a batting average to a choice about elections). Data can have numerals that have meaning. For example, 1453767142 is the ISBN for the Practically Cheating Statistics Handbook. The What as it related to ISBNs is the name of the book (The Practically Cheating statistics Handbook) and the Who as it related to book sales could be the person who ordered the book or it could be the purchase orders (as opposed to the individuals who placed those orders).

What is a Statistic: Variable

You might be familiar with variables from algebra, like “x” or “y.” They stand for something (usually a number that you plug-in to solve an equation). In statistics, variables are broken down into two types: numerical or quantitative variables and categorical variables. Numerical variables are the variables you’re most familiar with: numbers. For example, those “x” and “y” variables in algebra stand for a number. Categorical variables are variables that aren’t numbers: they are descriptive. For example, sex (male or female), occupation, school district, state and dog breeds are all types of categorical variables.

What is a statistic 2.

Breeds of dog are categorical variables (this particular dog is a bergamasco). How many dogs is numeric (this picture has one dog).


Back to Top

What is a Statistic: Vital Statistics

What is a statistic? Vital Statistics

Vital Statistics


Vital statistics can mean one of three things, as far as stats goes:

  1. National Vital Statistics System (run by the CDC) government records), a government database that keeps records of births, deaths, marriages, divorces, and fetal deaths.
  2. Bust-waist-hip measurements: measurements for clothes fitting, usually listed on a clothing size chart.
  3. Vital signs: Blood pressure and other body measurements taken by health professionals. For example, blood pressure and pulse are used to measure the health of your heart.

What is an Estimator?

An estimator (or estimate) is a statistic that’s used to approximate a population parameter. While there are several types of estimators, the word “estimator” on its own usually refers to a point estimate. A point estimate is a single value (as opposed to an interval, like a confidence interval). For example, the mean is a point estimate. The two characteristics of point estimates that are arguably most important are:

Bias

When you visit a gas station, you expect that the gas pump is calibrated correctly. And in fact, it has the potential to be a very accurate calibration. However, state inspectors in Houston, Texas, found that around one in five gas pumps weren’t calibrated correctly. An incorrectly calibrated pump could cost a consumer up to 18 cubic inches per five gallons pumped. These pumps showed bias, by consistently overcharging consumers by a certain amount.
Many formulas in stats are designed to eliminate bias. For example, the formula for population variance is:

estimator

Population variance formula.


If this formula is used for the sample variance, it tends to underestimate the true population parameter. Therefore, a slightly modified formula is used with N-1 in the denominator:
Variance formula. Image: Boston University

Variance formula. Image: Boston University


This formula is an unbiased estimate for the sample variance.

Sampling Variability

Your average bathroom scale probably goes up and down like a yoyo, stating a slightly different weight every time you get on it. Your weight might range from 158.1 one minute, to 161.2 the next. However, if you take a large enough sample (say, 30 measurements), your actual weight would probably be close to the mean of these readings. The wide spread of weights (anywhere from 158.1 to 161.2) is one example of variability between samples.
Sampling variability is usually measured in terms of standard error. The larger the standard error, the larger the sampling variability.

What is a Statistic in The National Vital Statistics System?

The National Vital Statistics System is a database run by the Centers for Disease Control (CDC). Although the individual states are responsible for actually registering the data, the CDC collaborates with the National Center for Health Statistics, the National Cancer Institute and the Census Bureau to keep an up-to-date database of life and death statistics for the United States. Included are: births, deaths, marriages, divorces, and fetal deaths.

Additional programs related to the National Vital Statistics System include:

Back to Top

What is a Statistic? A Plain English Explanation was last modified: July 26th, 2017 by Andale

4 thoughts on “What is a Statistic? A Plain English Explanation

  1. Steve

    Can you please explain the concept of unbiasedness and minimum variance in the context of a sampling distribution? Can’t find it on the site search. Great site!

  2. Andale Post author

    Hello, Steve,
    Thanks for your comment!
    The unbiased article covers unbiasedness in sampling distributions. There’s a little on minimum variance. I made some tweaks so it should show up on the search now :)

Leave a Reply

Your email address will not be published. Required fields are marked *