We present a method to teach hypothesis testing by engaging students into an A/B-test facilitated by a Shiny app.
The idea is to teach hypothesis testing in the context of A/B-testing, which is nowadays massively used to optimize apps and webpages. The proposed method engages students into an A/B-test in class as follows: Students access a quiz app via a QR-code. The students are randomly assigned to either control or treatment group and run the quiz without knowing their group or the treatment. We then reveal the treatment and anonymously save and analyze the scores in class using a hypothesis test to see whether the treatment had any effect on the scores.
The procedure, based on a pen&paper game by Adam Shrager, comes with a number of challenges and pitfalls – as any randomized trial - that can be openly discussed with students.
In this presentation we walk you through this A/B-test, collecting live quiz data from the audience if time permits. We present and discuss some challenges and key findings. The app is freely available, feedback is appreciated:
documentation and installation:
https://github.com/IFAFMultiLA/memory_gamelive demo:
https://tinyurl.com/MemGameTrial
or sign up with email →
Create a custom schedule.
Take it with you on mobile.
Get listed in the directory.
