• An excellent phone conversation yesterday with Steve Margetts. He’s been assessing a “Managed Learning Environment” that in his opinion isn’t. I won’t name it here, but its key feature seems to be that teachers can put their notes on the web using it. Unsurprisingly, he wasn’t wildly impressed.

    Then today, an excellent research review by Graham Blacker in Auricle caught my attention. He said

    A significant finding was the necessity to teach the redesign methodology. In our experience this is significant but not very surprising. Many of the early adopters of e-learning did consider that this would be the equivalent of putting course notes online. Consequently courses following this approach offered very little extra to traditional face-to-face courses, apart from a convenient repository for downloading course notes.

    This exactly mirrored our experience when introducing Paperless School. The big challenge was (and to some extent remains) educating authors that online and offline media must be structured entirely differently.

    Digging deeper to the research itself, I discovered a gem. Improving Learning and Reducing Costs: Lessons Learned from Round I of the Pew Grant Program in Course Redesign reviews results from 10 projects in which traditionally-delivered undergraduate courses were redesigned to use elearning. Most of their findings seem to me to be equally applicable at school level.

    I strongly recommend you read the whole thing; it’s a peach. And to tempt you, here are some highlights.

    • Five of the ten projects reported improved learning outcomes.
    • Seven of the ten projects measured changes in course completion/retention rates; all showed improvement.
    • All ten projects made significant shifts in the teaching-learning enterprise, making it more active and learner-centered.
    • All ten projects reduced their costs by 33 percent on average, with a range of 16 to 77 percent.

    Key to success was the fact that the courses were restructured; it wasn’t simply a case of swapping textbooks out and computers in.

    Lectures were replaced with a variety of learning resources, all of which involved more active forms of student learning or more individualized assistance. When the structure of the course moves from an entirely lecture-based to a student-engagement approach, learning was less dependent on the conveying of words by instructors and more on reading, exploring, and problem solving by students.

    The role of the teacher changed, becoming less didactic and more facilitative.

    Undergraduate Learning Assistants (ULAs). [Two of the universities] employed ULAs in lieu of GTAs [Graduate Teaching Assistants. Both universities found that ULAs turned out to be better at assisting their peers than GTAs because of their understanding of the course content, their superior communication skills and their awareness of the common misconceptions about computers held by the students.

    Those knowledgeable about the impact of pedagogy on improved student learning will find nothing surprising in this list. Among the well-accepted “Seven Principles for Good Practice in Undergraduate Education” developed by Arthur W. Chickering and Zelda F. Gamson in 1987 are “encourage active learning,” “give prompt feedback,” “encourage cooperation among students,” and “emphasize time on task.” Good pedagogy itself has nothing to do with technology. What is significant about these redesigns, however, is that they were able to incorporate good pedagogical practice in courses with very large numbers of students, which would have been impossible without using technology.

    All of this is enormously cheering for me personally. When we first designed Paperless School three years ago, nobody knew what was really going to work and what wasn’t. Judging by this research, we seem to have come a lot closer to the ideal than we really had any right to on a first attempt.

  • Examination scandals, usually reserved for announcement of results, have come early this year. The problem this time is that Edexcel deliver the exam papers to centres ahead of time to offset the risk of delays in the post. Enterprising young North London tealeaves exploit this window of vulnerability to help themselves and their classmates to higher marks than they might otherwise have got.

    All three exam boards are well aware of the potential to solve this problem with electronic delivery of exam papers, because each question needn’t leave the exam board until the very moment the first student needs to read it. Whilst they are experimenting with electronic delivery, they are taking it very slowly. The reason: they fear even greater scandals if it goes wrong. No exam board wants to be the first to suffer headlines claiming that their computer error had ruined the lives of thousands of young people. When I first presented Paperless School to the boards, almost three years ago, a panel member from one board put it to me thus:

    “We will move to electronic delivery when and only when we judge the probability of a scandal to be lower through electronic delivery than it is through paper delivery.”

    Chalkface now has considerable experience of delivering mixed-mode assessments (i.e. not just multiple-choice) through the web, so it might be useful to look at our experience of what can go wrong.

    • Peaky system loads. It’s quite normal for the load on Paperless School’s servers to fluctuate by 2000% in the space of 5 minutes because so many schools have the same class times. It’s the actual process of students logging on that puts the biggest loads on the server.
    • Hosting vulnerabilities. Every hosting company claims to be invulnerable; none are. Inside the data centre itself they may have reduced the probability of a fatal error to something very small, but what about their connection to the outside world? At some point there’s a cable that’s very, very vulnerable to a drunk with a JCB. Our solution has been to look at the physical location of the data centre and to try to find one with the shortest route to a major exchange from which your data can flow in multiple directions. An exam board would do well to go further, and have duplicate systems running in two different data centres.
    • Local difficulties. How good is the centre’s network and connection to the outside world? There are frequently teething problems caused by rogue proxy servers or over-zealous security software. Using a proven delivery system is vital; I’d recommend several full-scale rehearsals in each centre.
    • Terminal failures. Individual candidates’ computers will sometimes crash in the middle of an assessment. This needn’t be a huge problem, provided the software is designed to save the candidate’s work to the server as often as possible, and there’s a procedure in place to allow a little extra time to the candidate in compensation.

    Mitigate these risks and you are on track for successful, electronically-delivered exams. You’ve probably achieved a good tradeoff between the risks of paper and electronic delivery.

    I would like to see the exam boards go much further and embrace the potential of electronic delivery by moving from synchronous to asynchronous delivery. But more on that in a future post.

  • I’ve quoted Berthold Weidmann on students using mobile phones to access lessons before, and will doubtless do so again, because I’m intrigued by this largely-ignored scenario.

    Now, this excellent overview from Reuters puts a little flesh on the bones. It explains why we’ve not got there already with 3G, and covers the technical choices that Europe now faces.

    This introductory paragraph could not fail to set me thinking:

    Third-generation mobile phone services are finally here after a mammoth effort that cost the industry at least $123 billion, but new systems that operate much faster already threaten to consign 3G to history.

    $123 Bn!!! What could we have achieved if we’d decided that it was an economic imperative to invest an extra $123Bn into educating Europe’s children?

    When you think about where that money actually went, you discover this need not be an idle daydream. Most of the cost was the operating licenses auctioned by governments across Europe. Our governments. Effectively, that $123Bn is a tax on phone calls that mobile users will be paying off for the next decade.

    And what are taxes for? That’s right. Education.

  • Most schoolkids have access to dictionaries and encyclopedias, both on- and off-line. The problem with them is that they generally present only a single definition of a term, which the student may or may not truly grasp.

    To get a more complete understanding, wouldn’t it be great if a student could look a term up in multiple dictionaries simultaneously – preferably dictionaries designed for completely different functions and written in completely different styles.

    Well, now they can, through a little-known Google search term; ‘define’. Here are some examples. Try them:

    As you’ll see from the examples above, the form is

    • define:word or
    • define:”phrase”

    I’d be fascinated to hear if your students take to it.

  • Many thanks to the Applied Business class at Seaford Head Community College for their hospitality yesterday. Look out for better research facilities on the Cameron Balloons site as a result of your feedback!