• In these hazy, lazy, but all too frequently rainy days of Summer, may I commend your attention to Nobody Here; my favourite ever website.

  • In a previous post I covered the KUE model and bemoaned the infrequent application of U and E in multiple-choice questions. Assessing evaluative thinking in multiple choice may seem the hardest of the lot, because it’s the most abstracted form of learning. In fact, it’s relatively easy provided you are very clear about exactly what you are testing for with each question.

    Continuing the cycling theme, I’d like you to imagine you are talking one-to-one with a student, and you want (more…)

  • The original 1988 National Curriculum couched learning achievement in terms of knowledge, understanding and evaluation (KUE), a cut-down version of Bloom’s Taxonomy. This remains, in my view, by far the most practical version for the working educator.

    The easiest way to set up an assessment is via multiple-choice questions. Building the technology to serve and mark multiple choice tests is easy; most VLEs support it and there are plenty of (more…)

  • Are you old enough to remember those TV adverts with the robots that fell about laughing at humans who still mashed their own potatoes?

    That image came into my head when I read this BBC article about robots reading books [quote]

    A robot in the US library could fetch the book and, as directed by the web user, turn to the correct pages and scan the text and images.

    So let me see if I’ve got this right. Via the internet, I’m supposed to instruct a million dollars-worth of machine that just happens to inhabit my local branch library to trundle around the floor, pick a book off a shelf, delicately turn the pages, scan them and send me images of them to read.

    Rather than me just downloading it as an ebook in the first place, that is.

    I see only one problem with this ingenious plan. How do we stop the robot spending all its time rolling on the floor convulsed with laughter?

  • An excellent phone conversation yesterday with Steve Margetts. He’s been assessing a “Managed Learning Environment” that in his opinion isn’t. I won’t name it here, but its key feature seems to be that teachers can put their notes on the web using it. Unsurprisingly, he wasn’t wildly impressed.

    Then today, an excellent research review by Graham Blacker in Auricle caught my attention. He said

    A significant finding was the necessity to teach the redesign methodology. In our experience this is significant but not very surprising. Many of the early adopters of e-learning did consider that this would be the equivalent of putting course notes online. Consequently courses following this approach offered very little extra to traditional face-to-face courses, apart from a convenient repository for downloading course notes.

    This exactly mirrored our experience when introducing Paperless School. The big challenge was (and to some extent remains) educating authors that online and offline media must be structured entirely differently.

    Digging deeper to the research itself, I discovered a gem. Improving Learning and Reducing Costs: Lessons Learned from Round I of the Pew Grant Program in Course Redesign reviews results from 10 projects in which traditionally-delivered undergraduate courses were redesigned to use elearning. Most of their findings seem to me to be equally applicable at school level.

    I strongly recommend you read the whole thing; it’s a peach. And to tempt you, here are some highlights.

    • Five of the ten projects reported improved learning outcomes.
    • Seven of the ten projects measured changes in course completion/retention rates; all showed improvement.
    • All ten projects made significant shifts in the teaching-learning enterprise, making it more active and learner-centered.
    • All ten projects reduced their costs by 33 percent on average, with a range of 16 to 77 percent.

    Key to success was the fact that the courses were restructured; it wasn’t simply a case of swapping textbooks out and computers in.

    Lectures were replaced with a variety of learning resources, all of which involved more active forms of student learning or more individualized assistance. When the structure of the course moves from an entirely lecture-based to a student-engagement approach, learning was less dependent on the conveying of words by instructors and more on reading, exploring, and problem solving by students.

    The role of the teacher changed, becoming less didactic and more facilitative.

    Undergraduate Learning Assistants (ULAs). [Two of the universities] employed ULAs in lieu of GTAs [Graduate Teaching Assistants. Both universities found that ULAs turned out to be better at assisting their peers than GTAs because of their understanding of the course content, their superior communication skills and their awareness of the common misconceptions about computers held by the students.

    Those knowledgeable about the impact of pedagogy on improved student learning will find nothing surprising in this list. Among the well-accepted “Seven Principles for Good Practice in Undergraduate Education” developed by Arthur W. Chickering and Zelda F. Gamson in 1987 are “encourage active learning,” “give prompt feedback,” “encourage cooperation among students,” and “emphasize time on task.” Good pedagogy itself has nothing to do with technology. What is significant about these redesigns, however, is that they were able to incorporate good pedagogical practice in courses with very large numbers of students, which would have been impossible without using technology.

    All of this is enormously cheering for me personally. When we first designed Paperless School three years ago, nobody knew what was really going to work and what wasn’t. Judging by this research, we seem to have come a lot closer to the ideal than we really had any right to on a first attempt.