### Tutorial Files

Before we begin, you may want to download the sample data (.csv) used in this tutorial. Be sure to right-click and save the file to your R working directory. Note that all code samples in this tutorial assume that this data has already been read into an R variable and has been attached. This dataset contains variables for the following information related to NFL quarterback and team salaries in 1991.- TEAM: Name of team
- QB: Starting quarterback salary in thousands of dollars
- TOTAL: team salary in thousands of dollars
- CONF: conference (NFC or AFC)

### Dummy Coding

To be able to perform regression with a categorical variable, it must first be coded. Here, I will use the as.numeric(VAR) function, where VAR is the categorical variable, to dummy code the CONF predictor. As a result, CONF will represent NFC as 1 and AFC as 0. The sample code below demonstrates this process.Note that the -1 that comes after the as.numeric(CONF) function causes the variables to read 1 and 0 rather than 2 and 1, which is the default behavior.

- > #represent a categorical variable numerically using as.numeric(VAR)
- > #dummy code the CONF variable into NFC = 1 and AFC = 0
- > dCONF <- as.numeric(CONF) - 1

### Interpretation

#### Visual

One useful way to visualize the relationship between a categorical and continuous variable is through a box plot. When dealing with categorical variables, R automatically creates such a graph via the plot() function (see Scatterplots). The CONF variable is graphically compared to TOTAL in the following sample code.The resulting box plot is show below.

- > #use the plot() function to create a box plot
- > #what does the relationship between conference and team salary look like?
- > plot(CONF, TOTAL, main="Team Salary by Conference", xlab="Conference", ylab="Salary ($1,000s)")

From a box plot, we can derive many useful insights, such as the minimum, maximum, and median values. Our box plot of total team salary on conference suggests that, compared to AFC teams, NFC teams have slightly higher salaries on average and the range of these salaries is larger.

#### Routine Analysis

Once a categorical variable has been quantified, it can be used in routine analyses, such as descriptive statistics and correlations. The following code depicts a few examples.The correlation between total team salary and conference indicates that there is little to no linear relationship between the variables.

- > #what are the mean and standard deviation of conference?
- > mean(dCONF)
- > [1] 0.5
- > sd(dCONF)
- > [1] 0.5091751
- > #this makes sense… there are an even number of teams in both conferences and they are coded as either 0 or 1!
- > #what is the correlation between total team salary and conference?
- > cor(dCONF, TOTAL)
- > [1]0.007019319

#### Linear Regression

Let's return to our original question of how well quarterback salary and conference predict team salary. With the categorical predictor quantified, we can create a regression model for this relationship, as demonstrated below.The model summary is pictured below.

- > #create a linear model using lm(FORMULA, DATAVAR)
- > #predict team salary using quarterback salary and conference
- linearModel <- lm(TOTAL ~ QB + dCONF, datavar)
- #generate model summary
- summary(linearModel)

Considering both the counterintuitive and statistically insignificant results of this model, our analysis of the conference variable would likely end or change directions at this point. However, there is one more interpretation method that is worth mentioning for future reference.

#### Split Model

With a dummy coded predictor, a regression model can be split into two halves by substituting in the possible values for the categorical variable. For example, we can think of our model as a regression of total salary on quarterback salary for two states of the world - teams in the AFC and teams in the NFC. These derivative models are covered in the following sample code.Based only on what we have modeled, we can further infer that conference was not a significant predictor of total team salaries in the NFL in 1991. The difference between the team salaries based on conference is less than one-half of one percent on average! Of course, only using quarterback salary and conference to predict an NFL team's overall salary is neglecting quite a few potentially significant predictors. Nonetheless, split model interpretation is a useful way to break down the perspectives captured by a categorical regression model.

- > #input the categorical values to split the linear model into two representations
- > #the original model: TOTAL = 19099 + 2.5 * QB - 103 * dCONF
- > #substitute 0 for dCONF to derive the AFC model: TOTAL = 19099 + 2.5 * QB
- > #substitute 1 for dCONF to derive the NFC model: TOTAL = 18996 + 2.5 * QB
- #what is the predicted salary for a team with a quarterback salary of $2,000,000 in the AFC and NFC conferences?
- #AFC prediction
- 19099 + 2.5 * 2000
- [1] 24099
- #NFC prediction
- 18996 + 2.5 * 2000
- [1] 23996

What if you had more than two categories? The "as.numeric" trick you are using only works for binary categories doesn't it?

ReplyDeleteHi,

Deleteas.numeric() is not limited to binary categories

John

Hello,

DeleteWhile it is treu that as.numeric() is not limited to binary categories. However, you cannot use that be a categorical regression. You need to create n-1 variables and make them all 1s or 0s. You will have category 1 as 10 category 2 as 01, and category 3 as 00. This makes sure you don't have interference or implied relationships or order between variables.

In short, the function works to create inputs, but is statistically NOT correct.

Yes, that is correct. For more than two levels, you need to create n-1 variables. Thanks for pointing that out. John

DeleteHow do u convert a variable into dummy variable having more than two categories?

ReplyDeleteSee the above question from Harry.

DeleteWhy not simply run lm(variable ~ factor(cat_variable) + continous_var)?

ReplyDeleteThere are usually a large number of ways to execute things in R, so my tutorials focus on demonstrating just one way of doing things.

DeleteNice tutorial, But how can i create n-1 dummy variables?

ReplyDeleteIs there a trick to use plot() to generate boxplot? When I tried to do plot() on my own dataset, I am still getting a scatterplot instead of boxplot.

ReplyDeletetest <- c("yes","no","no","no","no","yes","yes");

test <- as.factor(test)

dtest <- as.numeric(test)-1

test2 <- c(17256,23074,20666,24249,21992,19413,19545);

plot(dtest,test2);

There is a boxplot() function in R, so try using that to see if you can get the intended graph. Something may have changed in R since I wrote this tutorial that prevents the plot() function from working as demonstrated.

DeleteAs it turned out, the following work. Still not sure why plotting dtest doesn't work.

Deletetest <- c("yes","no","no","no","no","yes","yes");

test <- factor(test)

test2 <- c(17256,23074,20666,24249,21992,19413,19545);

plot(test,test2);

Thanks for the tutorial. Didn't know you want generate boxplot this way. Very useful

try

Deleteest <- c("yes","no","no","no","no","yes","yes");

test <- as.factor(test)

dtest <- as.numeric(test)-1

test2 <- c(17256,23074,20666,24249,21992,19413,19545);

plot(as.factor(dtest),test2);

By default R2.15 produces a boxplot when you plot a continuous variable against a categorical variable.

So, is there significant difference between salary in AFC and NFC? Since the p-value for dCONF is > 0.05 doesn't that means there is no significant difference between conference salaries?

ReplyDeleteThis tutorial did not explore whether there is a statistically significant difference between the conferences, although that is something you could examine if you wanted to. Instead, the tutorial looked at how conference and QB salaries predicted the total team salaries. Ultimately, conference was not a good predictor of overall team salaries.

Deletewhat about the relationship between 2 categorical variables

ReplyDeletesay high blood pressure: yes/no

Obese : yes/no

can box plot work there?

I have a data in which the binary response coded 0 and 1 needs to be changed. For example: since I`m gonna run a logistic regression, the response in which I am interested in is coded 0. But the reference for the model in R is 1. So, I need to switch the coding, and the response encoded 1 turn out to be 0 and vice-versa. I´m sweating my pants here to try and change this. Does anyone know how to do it?

ReplyDeleteTry ifelse(x =="yes", 1, 0)?

Deletesubtract 1 and take the square.

ReplyDeleteThere is a tutorial for creating those Coding Systems for categorical variables

ReplyDeletehttp://www.ats.ucla.edu/stat/r/library/contrast_coding.htm