Fighting cheating, one baseball cap at a time

A fascinating article in the New York Times looks at some of the more unusual measures taken to fight cheating at the University of Central Florida and other US institutions.  Approaches range from the unremarkable (Turnitin) to the ‘I would never have thought of that in a million years’, such as banning baseball caps from being worn the right way round in case answers were written on the underside of the brim.  Firmly technological approaches include overhead cameras which record any ‘suspicious’ behaviour by a student at the same time as recording what is happening on their computer for later investigation.

Such a paranoid approach to student integrity, although apparently very successful, does start from the assumption that all students are out to cheat, an attitude that both students and institutions can find unacceptable, and the article cites one institution that felt the use of Turnitin was inconsistent with their own policies and  honour code.

As anyone who’s ever marked written work will know, there are grades of cheating and of plagiarism, and much  of what is identified as plagiarism is not an intentional attempt at cheating but often the result of weak academic or communication skills, or bad time management and study practices.  It’s very encouraging to see that educating students about what constitutes plagiarism can have a substantial impact on rates of plagiarism – not all those who ‘cheat’ are actually setting out to do so.  As for those who are: some of the examples here will certainly astonish…

Moodle XML Converter

Moodle XML Converter is a simple, free, online tool for creating Moodle quizzes and glossaries from human readable text files.  Developed by Olga Tikhonova, Yulia Ivanova and Alekzandr Ivanov at the Yakutsk State University, the tool supports a number of item types ( MCQ, MRQ, short answer, essay, description, true/false, cloze, numerical and order) and supports feedback and formatting.  The team have also set up a Google group to support the tool.

In concept it’s similar to MCQFM, led by Steve Bennett of the University of Hertfordshire, which provided a human readable method for creating QTI items and linked up with the University of Southampton‘s R2Q2 renderer.

IMS QTI implementation survey results and implications

IMS have now released (registration required) the results of the QTI 2.1 implementation survey launched in January, looking in great detail into current implementations of the specification.

Twenty-one implementations are covered by the responses, representing a wide range of approaches to implementation, and the actual responses are available for download for those interested.  The responses support the notion of a core set of basic features implemented by all respondents, with broader parts of the specification being implemented on a more individual basis.

The results are feeding in to the development of profiles for QTI 2.1:

  • Base QTI Profile, covering the features available in the most comprehensive implementations;
  • CC-QTI, which updates the functionality covered by the QTI 1.2.1 profile within Common Cartridge 1.0 and which will be integrated into a later version of CC.

Profiling work, including the CETIS QTI working group activities, and subject-specific activities such as profiles for maths are also discussed.

This information will be very valuable for developers of tools and content, and it’s great to see IMS making it available to the community.

Qyouti: MCQ testing with QTI and scanners

Developed in response to frustration at existing high stakes MCQ testing options, Qyouti combines IMS QTI and scanning technology to provide robust, inexpensive and flexible assessment and is now available for free download from the tool’s SourceForge site.

Jon Maber, who developed the tool for Leeds Metropolitan University, describes how the tool works:

Qyouti is software which takes an IMS QTI file containing questions, a class list and prints the questions on an ordinary colour laser printer with areas for the student responses to be made in pencil or pen. I.e. the responses are marked as crosses or ticks (or just about any other kind of mark) in boxes that are right next to the options in the question paper. Every page is bar-coded with the candidate’s name and ID so it is impossible to give the marks to the wrong person. At the end of the exam the papers are scanned with an ordinary desktop scanner.  Then Qyouti processes the scanned images and produces a list of candidates with their marks […]  Each individual script has metrics encoded on it using square barcodes and so there is potential for customising font and layout for candidates with visual impairment or dyslexia.  A proper statistical analysis is done on the question items too.

Jon is keen to find volunteers to test and help contribute to the further development of the tool, and is offering free staff training in the use of MCQs in return for significant contributions.  He can be contacted through his homepage.

CAA 2010 submission deadline extended

The deadline for submitting proposals for papers and posters to the 2010 International Computer Assisted Assessment Conference has been extended to Friday 14 May 2010.

This year’s conference will be held on 20 and 21 June at the DeVere Grand Harbour Hotel in Southampton, and is jointly organised by the School of Electronics and Computer Science, University of Southampton, and the Institute of Educational Technology, The Open University, and as always promises to be a lively and valuable event.

Transforming Assessment webinar series 2010

The Transforming Assessment project funded by the Australian Learning and Teaching Council and led by Professor Geoffrey Crisp of the University of Adelaide is examining the use of eassessment in online learning, particularly in the context of Web 2.0 and virtual world technologies.

A series of free public webinars has just been announced, starting with a session led by Geoffrey on Wednesday 12 May at 08:00h London time. Sessions will be held in Wimba and run approximately monthly. A number of speakers have already been confirmed, but the team are still interested in hearing from potential presenters.

More information on the seminar series can be found at http://transformingassessment.com/

eAssessment Scotland 2010 – call for papers now open

Those of you interested in delivering a presentation or workshop to eAssessment Scotland 2010 have until 1 June to get your proposals in.   Themes for this year’s event include reports on successful implementations of eassessment within institutions, staff and student views, and emerging trends, techniques and tensions in eassessment.   This year’s conference, on the theme of Marking the Decade, will take place at the University of Dundee on 3 September and will include keynotes, presentations, seminars and posters as well as the second year of the Scottish eAssessment Awards; the event is free to attend and pre-registration is already open.

IMS QTI v2.1 Implementation Survey

IMS invite developers to participate in an IMS Question and Test Interoperability (QTI) v2.1 implementation survey.

The survey is designed to do two things:

  • establish the ‘state of play’ with regard to QTI v2.1 tool capabilities
  • establish whether there is sufficient overlap in tool capabilities to define one or more profiles.

IMS will publish an anonymous summery of the survey outcomes to all participants.  Survey results will be strictly confidential and data from this research will be reported only in the aggregate.  Your information will be coded and will remain confidential, however if you wish you may supply your email address if you are willing to be contacted to follow up or for additional information.

The survey only poses questions about QTI v2.1 capabilities, which means that it is not relevant for developers of earlier versions of QTI.

The survey will only take around 20-30 minutes to complete.  Information about the QTI project group and results from this survey will be posted in the IMS QTI forum.

This is a great opportunity for QTI v2.1 developers to help steer the future of the specification.

Under development: AskClass.net

Charlie Balch at Arizona Western College has been working on a simple, web-based question system for networked computers and hand held devices.  AskClass.net currently functions as a poll tool, allowing the creation of multiple-choice, single-answer questions that can be used in a variety of educational settings and as a consensus building tool.  It’s still very much under development, so while it’s not possible at the moment to specify a correct answer, this and other functionality may emerge in the future depending on user feedback and viability.  A simple marking system would make this an extremely useful tool for both classroom and remote teaching support.

AskClass is written in ASP with a MS Access backend, although Balch is considering making future versions in PHP or Java with an XML backend to increase portability.  Other applications may be integrated with the tool over time.  This is intended as a learning aid, therefore security and multiple voting are not addressed in this version.

Contact details for requesting source code and suggesting features are available on the site’s FAQ.

Public draft consultation on standard for transfer of assessment data

You may remember a proposed standard for the transfer of qualification assessment data and evidence that was previously covered on this blog.

Work on this has been ongoing since then, and a draft standard is now available for public consultation and comment.  The public draft can be accessed via the BSI website, and comments may be submitted by following the instructions there.

All comments must be submitted by 30 November to be considered for the final version of the standard.  Depending on the nature and extent of comments received, the standard is likely to be released in the first quarter of 2010.