Yacapaca has a dozen different analytics views, depending on exactly what you count as “analytics”. The table below shows the structure.
|Block of time
6. Parent reports
7. Progress chart
8. Progression with metadata
4. Progress in topics
2. Quiz analysis
1. Gap Analysis
2. Quiz analysis
3. Analysis whiteboard
9. Pivot Chart (beta) does not quite fit in this table.
*strictly speaking these are Continue reading
There are three major, and several minor, results pages in Yacapaca. Ordered by level of detail, the major pages are the Gradebook, Activity Log and Detail.
Click for full size
This is your overview for a complete student set, for a whole Continue reading
Computer-adaptive Testing (CAT) has actually been around since the 1970s but it is still little-known and less understood.
How CAT works
Any given CAT assessment is based on a large bank of questions of varying, but known, difficulty on a given topic. The first question is served at Continue reading
The absolute quickest way to get your students revising on Yacapaca is:
- Sign up here if you don’t already have an account.
- Create a new student set via Students tab -> New Student Set
- Use the “casual” set type so students can create their own logins
- Set up the subject and syllabus. We currently support 67 syllabi across all popular CGSE subjects.
- Hand out the Access Key to your students, and coach them to do 5 minutes a day, every day without fail.
- Check the weekly report you will be emailed to see, in detail, how well each student is doing.
This screencast will talk you through it. I recommend the high-quality version on Vimeo, if it is not blocked in your location.
Revision is free on Yacapaca. Some other uses are available only to paid subscribers.
Start the process now
My thanks to Bobby Grewal at Four Dwellings Academy for the awkward question.
Let’s start by asking what it is we are trying to measure. At Yacapaca, we have opted for “current” grading, as that’s what the majority of our users want. This means that we are attempting to answer the question:
- If the student were to take the GCSE exam today,
- and they had studied all the content to the same level as the content of this quiz
- then what grade might they be expected to achieve?
Without actually throwing students as young as 11 into a real GCSE, how can we test whether our answers are accurate? Not only is that impractical; we can’t even (yet) back-calculate from real GCSE results. So we have to calibrate against some existing scheme for which we have data that can be validated.
Fortunately, there are two sources, NC Levels and GCSE A*-G. There are published conversion tables between each of these and the GCSE 9-1 grades. My preferred version is the QEGS Points Conversion Wheel.
The next question becomes “how do we know that our original NC and GCSE gradings were accurate. The answer is that we crowdsourced the calibration from thousands of teachers. As well as quizzes, Yacapaca allows you to add other grades from teacher-graded assignments. We correlate these to difficulty-adjusted quiz scores using linear regression. Thus, the accuracy of our quiz scores is based on the consensus in the teaching profession, rather than one arbitrary authority.
Now, we have to ask ourselves how accurate the result of one single quiz might be anyway. There are fundamental limits: consider the hypothetical case of a quiz that contains only one question, which may be got right or wrong. Does a correct answer equate to a Grade 9? An incorrect to a Grade 1? Of course not. A single answer tells you almost nothing. In practice, the absolute minimum you should rely on is 50 questions spread across at least three separate quizzes.
Finally, what accuracy can you expect from a single session with any assessment tool? Everyone has good and bad days; teenagers take it to extremes. If you really want Yacapaca to give you grades that you can rely on, my recommendation is that you use it little and often, building up a picture over time. Use the Progress Chart and the Parents’ Report to discover averages and trends in the data.
So is Yacapaca accurate? Yes, provided you use it intelligently.