Question types: popularity and quality

Yacapaca has six question types, ignoring the numerous permutations. Which are the most popular with authors, and which tend to be the best-written? I recently ran an analysis of the 135,513 questions in the database.

More than half are straight multiple choice. Come on, folks – get more adventurous! Kids respond well to variety so you can improve the learning they get by mixing up the types of questions you use.

We measure the quality of each question in the database by looking at the proportion of passes to fails. The ideal question discriminates between those students who have ‘got it’ and those who have not, so we hope to see an average mark half way between perfect and random. That varies between question types: in a 4-option multiple choice, it would be 62.5%.

Different question types turn out to have somewhat different average qualities. The best are checkbox questions, and the worst multiple-choice cloze. Note, though, the scale on this graph. 59% and 67% are only 8% apart; it’s not that much.

I am now doing weekly online author training events – if you are a Yaquapacista you should already have had an invitation. One of the things I will be focusing on is different question types, and how to really get the best out of each.

Hope to see you there!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s