One thing I love about is that you always new things, even when giving a lecture about stuff that you know (or you think you do) very well.

Today a student asked why we should use Student's -test at all when comparing samples with equal variances if you can use Welch's variant, which works with unequal variances... that is, why bother checking equality of variances?

Indeed, in the case of equal variances the calculated t statistics would be the same!

This led to a great discussion involving 3 instructors, a bunch of students, and a few simulations in which I really enjoyed!

The answer is that Welch's variation also changes how degrees of freedom are calculated, so no they are not equal!

Also, the current recommendation is NOT to check for variance equality (e.g. using Levene's test) as this paper clearly points out, lest you want to increase your Type I error!

bpspsychub.onlinelibrary.wiley

Gotta go change some slides...

@nicolaromano Perhaps the more important question is whether anyone should ever use a t test. A randomisation test is surely always preferable (if you are still happy with p values)🙂

Follow

@david_colquhoun Yes, agreed, and indeed in the same course we speak a lot about randomisation tests, bootstrapping etc. However, given how pervasively the t test is used in biology, it's important that students know of it's existence, at they'll come across it when reading the literature

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.