Questions are below. My solutions are below all the question parts for a question; scroll down if you get stuck. There might be extra discussion below that for some of the questions; you might find that interesting to read, maybe after tutorial.
For these worksheets, you will learn the most by spending a few minutes thinking about how you would answer each question before you look at my solution. There are no grades attached to these worksheets, so feel free to guess: it makes no difference at all how wrong your initial guess is!
A survey of students at the University of California Davis asked respondents:
Sex in the data set)NonLib (“not arts” meaning science, math, engineering etc).Students were allowed to not respond to any of the items, so there are some missing values, labelled NA in the dataframe you are about to read in.
The data are in http://ritsokiguess.site/datafiles/UCDavis1.csv.
Read in and display (some of) the data.
Find the mean and standard deviation of sleep times (for all the students taken together).
For the students that sit in each part of the classroom (separately), find the number of students and their mean sleep time. (Hint: the column is called Seat with a capital S; the S being uppercase matters.)
For this data set, display how much time the students have spent watching TV and on the computer. (Display only these two columns.)
Several of the columns are heights. Display all of these columns, without naming any columns.
Display only the students who sit at the back of the classroom.
Display all the students that either slept 5 hours or less or watched over 30 hours of TV (or both).
For the students who are 70 or more inches tall, what are the mean heights of their mother and their father? Hint: the first time you do this, your answers will probably be missing. Why is that? Look at my solution to see how to get the answers you were expecting.
My solutions follow:
As usual:
my_url <- "http://ritsokiguess.site/datafiles/UCDavis1.csv"
davis <- read_csv(my_url)Rows: 173 Columns: 12
── Column specification ────────────────────────────────────────────────────────
Delimiter: ","
chr (3): Sex, Seat, class
dbl (9): TV, computer, Sleep, alcohol, Height, momheight, dadheight, exercis...
ℹ Use `spec()` to retrieve the full column specification for this data.
ℹ Specify the column types or set `show_col_types = FALSE` to quiet this message.davisGive the dataframe a suitable name. I called it davis, because it is a bunch of information about students at University of California-Davis.
A summarize. Use your name for the dataframe, if it is different from mine:
davis %>% summarize(mean_sleep = mean(Sleep), sd_sleep = sd(Sleep))You can use whatever names you like for the summaries. My recent habit is to use longer and more descriptive names for the summaries than I did in the past (like, when I wrote the lecture notes).
Seat with a capital S; the S being uppercase matters.)This is a group-by and summarize, grouping by the categorical variable Seat first, and then computing the required summaries. We are finding something else other than the counts (the mean sleep time), so we have to use the n() idea here:
# summary(davis)
davis %>%
group_by(Seat) %>%
summarize(n_student = n(), mean_sleep = mean(Sleep))There were two students who didn’t say where they liked to sit, so their Seat is missing.
These two things are columns in the dataframe, and choosing columns is select:
davis %>% select(TV, computer)It is rather annoying that the column computer has a lowercase C, and this matters as far as R is concerned.1
The first thing is to find out exactly what it is that these height column names have in common. They are Height, momheight, and dadheight. (They are the student’s height and the heights of their parents.) What they have in common is that they end with height:
davis %>% select(ends_with("height"))Given what we were just saying about uppercase and lowercase, you might be surprised that this worked: after all, the one that is the student’s height starts with an uppercase H, which does not match what I put in the ends_with. It turns out that select-helpers are not case-sensitive, unless you make them so:
davis %>% select(ends_with("height", ignore.case = FALSE))The option is the rather cumbersome double negative “don’t ignore case”, ie. pay attention to the case. This gets only the two columns whose names literally end in height, not the student’s height whose name is (ends with) Height with a capital H, and this no longer matches because we are paying attention to uppercase/lowercase.
Another way to get all three columns, if you are worried about upper and lower case, is to match on the ends of the names that are the same including case:
davis %>% select(ends_with("eight"))Fortunately, there are no columns ending in weight here, so this gets only the columns we want.
Or you could say that these three columns are the only ones that contain height, which is also true:
davis %>% select(contains("height"))or if you really want to grapple with regular expressions, even this:
davis %>% select(matches("height$"))Inside matches, my regular expression searches for columns that match with the letters height at the end of the column name, so that eg height_in_cm wouldn’t match.2
(Hint: this is the sort of thing I like to ask on exams.)
This is choosing rows, specifically the rows for which Seat is Back, so it needs filter:
davis %>% filter(Seat == "Back")Don’t forget the two equals signs, which is how R tests that something is equal to something else: “give me all the rows for which it is true that Seat is equal to Back”.
Confusing aside: Also, Back is a literal piece of text, so it has to be in quotes; filter(Seat == Back) would mean “give me all the rows for which the column Seat is equal to whatever is stored in the variable Back. Can you make sense of this?
Back <- "Front"
davis %>% filter(Seat == Back) By the way, because this is so confusing, don’t do something like what I just did! Your work colleagues will hate it, and when you come back to your code in six months, you will hate yourself!
End of aside.
This is either/or, so needs |:
davis %>% filter(Sleep <= 5 | TV > 30)To be precise, “5 hours or less” is less than or equal, and “over” is strictly greater than.
To convince yourself that you have the right ones, scroll through your results and say why each of the students is there. My first ten students are all there because they slept 5 hours or less (the 8th one also watched over 30 hours of TV). In the next ten, the first student got more than 5 hours of sleep but is there because they (claimed to have) watched 100 hours of TV. Students 24 and 25 got lots of sleep but also watched lots of TV. And so on.
In this kind of problem, where we want summaries for only some of the observations, the first step is to select the observations we want, and the second step is to summarize the observations we selected:
davis %>% filter(Height >= 70) %>%
summarize(mom_mean = mean(momheight), dad_mean = mean(dadheight))OK, so those were both missing. To find out why, step back to the filter (run it without the summarize):
davis %>% filter(Height >= 70) Page down almost to the end to see that the 40th student didn’t give an answer for their mother’s and father’s heights. As far as R is concerned, the mean of a set of numbers including a missing value is itself missing, on the basis that the missing value could be anything.
Here, it seems reasonable to calculate the means of the non-missing parental heights.3 There are a couple of ways to do that, which you probably haven’t seen before. The first includes the missing values, but removes them when calculating the mean:4
davis %>% filter(Height >= 70) %>%
summarize(mom_mean = mean(momheight, na.rm = TRUE), dad_mean = mean(dadheight, na.rm = TRUE))The second way removes the missing momheights and dadheights first before trying to calculate the means:
davis %>% filter(Height >= 70) %>%
drop_na(momheight, dadheight) %>%
summarize(mom_mean = mean(momheight), dad_mean = mean(dadheight))Same answer. If you run the first two lines of this (and not the third one), you’ll see that there are now only 41 students chosen, and the one with the missing momheight and dadheight is no longer there. So when you run mean, you will not run into any missing values.
You could have another column called Computer in here as well, and R would treat them as different. But that means that in R, case matters.↩︎
Though height_in_cm, if we had such a column, would match contains.↩︎
You might want not to do that if being missing is itself informative about heights. The sort of thing I mean is if students with short parents are more likely not to report their parents’ heights. In that case, a mean of parental heights would be biased because you have too few small ones.↩︎
rm is shorthand for “remove”, and NA is R’s notation for “missing”. Thus the function option na.rm = TRUE means “it is true that you remove the missing values” before calculating the mean. rm comes from the Unix operating system, which lives on as Linux, and is a command for removing files.↩︎