Category Archives: cetis
LRMI Implementation Cases Study: Untrikiwiki
“The purpose of this project was to allow MediaWiki-based Open Educational Resource (OER) communities to adopt LRMI. This was done in two ways. Firstly, we built the technical infrastructure necessary for MediaWiki-based OER communities to implement LRMI. Secondly, we approached MediaWiki-based OER communities in attempt to convince them to use LRMI.”
LRMI Implementation Case Study: Curriki
Project team – Joshua Marks, Chief Technology Advisor, Robert Greenawalt, Chief Technology Officer, Paul Libbrecht, Developer.
“Curriki provides peer reviewed open educational resources, curricula and instructional materials to support teachers, professional educators, students, lifelong learners, and parents, primarily in the domain of K-12 education. Curriki is a nonprofit organization and the majority of the resources it provides carry Creative Commons licenses.”
LRMI Implementation Case Study: P2PU
“P2PU is a grassroots open education project that organizes learning outside of institutional walls and gives learners recognition for their achievements. P2PU creates a model for lifelong learning alongside traditional formal higher education. Leveraging the internet and educational materials openly available online, P2PU enables high-quality low-cost education opportunities. Learning for the people, by the people. About almost anything.”
LRMI Implementation Case Study: PhET Interactive Simulations
Project Team – Kathy Perkins, Director and Jonathan B Olson, Software Engineer
“PhET provides fun, interactive, research-based simulations of physical phenomena for free. We believe that our research-based approach- incorporating findings from prior research and our own testing- enables students to make connections between real-life phenomena and the underlying science, deepening their understanding and appreciation of the physical world.”
The PhET LRMI implementation project ran from July 2012 – July 2013. PhET currently has 128 simulations which are used over 45 million times per year. Since the site has 36 current website translations, unique metadata is provided on 4608 pages (each translated page has LRMI metadata in that language). The simulations are aimed primarily at K-12 and college use, but are designed to be compatible with any type of education. All simulations are licensed under the GPL, and most are also licensed CC BY.
LRMI is integrated into PhET metadata, so it is detectable by third parties that crawl or search the website. The site also provides Dublin Core, NSDL Dublin Core, IEEE LOM, IMS LODE ILOX, and a custom super-set of this metadata available via OAI-PMH and a REST API. Additionally, various custom exports have been created, usually CSV-based and customized to a particular portal. Metadata is stored in the PhET website’s main database and metadata for third-parties is automatically generated from the database, on demand, in a variety of formats. Since metadata is provided only for simulations, PhET does not store many of the LRMI properties internally in the DB since they are the same for every simulation. However the mapping includes translations (viewing a page on the Korean translation of the website will include Korean terms in the metadata).
PhET has implented the following LRMI properties and types:
- educationalAlignment: yes, includes multiple standards alignments
- educationalUse: yes, “classroom”, “homework” and “solution” for simulations
- interactivityType: yes, “active”
- learningResourceType: yes, “simulation”
- useRightsUrl: yes, can include multiple URLs (many simulations are dual-licensed)
PhET has not implemented:
- timeRequired: no (for inquiry-based simulations, there is no “standard” time required)
- typicalAgeRange: not yet, had previous uncertainty about format
- isBasedonUrl: no, simulations are original works
Currently “educationalAlignment” aligns to the Math Common Core, but the project team is currently working with teachers to create an NGSS alignment, which can be added.
PhET also implements the Schema.org “SoftwareApplication” type which enables them to provide available language information, denote PhET as the publishing and authoring organization, provide thumbnail and screenshot image URLs, denote it as applicationCategory:Educational, provide the “run now” and “download” URLs (url and downloadUrl), the download filesize, version/softwareVersion, description (in the language provided), a list of keywords, and dates created / modified.
During the funded phase of their LRMI implementation project, PhET initially shared their metadata with the Learning Registry, but as the Learning Registry has changed their protocols so frequently the project team has not been able to keep up with their change requests. PhET is currently not listed as Learning Registry contributors, but the team hopes that they will be able start sharing their metadata again once the protocols have settled down.
PhET has no current plans to develop their LRMI implementation further, unless there is additional demand from other organizations. The project team is unsure of how to measure the direct benefits of LRMI implementation but they are pleased that their simulations include LRMI metadata. Other third-party projects have also been pleased that PhET make LRMI metadata available and have pulled that data into their own applications.
Euclid in colour and technology for learning
I work in the area commonly known as Learning Technology, or Educational Technology. I don’t have much time for trying to pin down what exactly constitutes “technology” in that context, and certainly none for considerations like “printing is technology, does that count”. But today I bought a book which does quite literally(*) illustrate advances in printing applied to learning.
The book is a reprint of the Oliver Byrne’s The first six books of the elements of Euclid in which coloured diagrams and symbols are used instead of letters for the greater ease of learners which was first published in 1847. Instead of the conventional referencing of lines, shapes and angle by letters used in geometry text books. So instead of:
Proposition 30: Straight lines parallel to the same straight line are also parallel to one another.
Let each of the straight lines AB and CD be parallel to EF.
I say that AB is also parallel to CD.
Let the straight line GK fall upon them. Since the straight line GK falls on the parallel straight lines AB and EF, therefore the angle AGK equals the angle GHF.
Again, since the straight line GK falls on the parallel straight lines EF and CD, therefore the angle GHF equals the angle GKD.
But the angle AGK was also proved equal to the angle GHF. Therefore the angle AGK also equals the angle GKD, and they are alternate.
Therefore AB is parallel to CD.
Therefore straight lines parallel to the same straight line are also parallel to one another.
Colour printing of books was not common in 1847, it only became commercially viable after the invention new printing techniques in the C19th and mass production of cheap synthetic dyes, starting with mauvine in 1856, so this can fairly be called advanced technology for its time. Like many uses of technology to enhance learning, when colour printing of text books did become commonplace, it wasn’t used with the same imagination as shown by the pioneers.
* except, of course, that “literally” means according to the written word and this is a book of pictures. #CetisPedantry
LRMI Implementation Case Study: MERLOT
Team leader: Barbra Beid Sperling
“MERLOT is a free and open peer reviewed collection of online teaching and learning materials and faculty-developed services contributed and used by an international education community. The MERLOT collection consists of tens of thousands of discipline-specific learning materials, learning exercises, and Content Builder web pages, together with associated comments, and personal collections, all intended to enhance the teaching and learning experience.”
MERLOT is a metadata repository containing records for 46,000 open educational resources covering a wide range of subjects and all levels of education. Users are able to comment on and aggregate resources to create personal collections. MERLOT resources are peer reviewed by members and each resource record includes a “Quality Box”, which presents information on peer reviews, user ratings, comments and collections the resource has been added to.
MERLOT also provides access to a wide range of additional facilities including APIs to integrate with learning management systems and other applications, mobile search apps for iOS, Android and Blackberry, a content builder for creating hosted online learning materials and various community building tools such as discipline communities, community discussions, and social networking facilities.
MERLOT uses Spring Framework as well as a number of Apache Commons java libraries and is served from CentOS (Linux) using Apache and Tomcat. Eclipse IDE, Vim and Notepad++ are used for editing, and Mozilla Firefox for testing. MERLOT applications are not open source.
MERLOT has developed a proprietary metadata schema, which covers a range of common fields including title, URL, description, material type, primary audience, language, keywords, subject category / disciplines, author information, technical format, technical requirements, mobile platforms, license, cost and accessibility. Fields are stored in Oracle database tables. Metadata is created by users when a resource is added to MERLOT, and it is rarely modified beyond this point, other than to verify that all links still work. MERLOT does not share metadata with the Learning Registry, and MERLOT metadata records are not Creative Commons licensed.
A mapping (.xls) has been created between the proprietary MERLOT metadata schema and LRMI to enable the appropriate microtags to be added to resource description pages within MERLOT.
Merlot uses the following LRMI properties:
- educationAlignment
- useRightsUrl
Plus additional Schema.org properties:
- creativeWork,
- headline,
- rating,
- aggregateRating,
- offer
The alignmentType of educationAlignment is educationalSubject, which maps to a proprietary vocabulary.
Since implementing LRMI MERLOT has not observed any measurable impact, although it is possible that the presence of LRMI and schema.org metadata on MERLOT’s resource description pages increases the discoverability of resources.
Links
MERLOT
MERLOT / LRMI mapping (.xls)
LRMI Implementation Case Study: Gooru
Project lead: Lisa McLaughlin, Senior Director of Partnerships
“Gooru’s mission is to honor the human right to education. We are dedicated to engaging a community of teachers, developers, and supporters to unleash personalized learning with technology to educate all the students of the world.”
Gooru serves as a personalized learning platform, incorporating a custom search engine, playlist creation tool, and content aggregator. The system allows users to find standards-aligned, interactive learning materials that have been curated by teachers; share those materials in the form of custom collections, personalized to meet the needs of individual students; and measure students’ progress across collections and quizzes assigned to them. Users can search over 2 million CC licensed learning resources, browse through collections, lessons and individual resources and filter search results by grade level, resource type, and Common Core State Standard.
Gooru is a repository of playlists, rather than a repository of content. There are currently 18 million resources in the Gooru catalog; 180,000 of these are tagged to instructional standards such as the Common Core State Standards and 50,000 are collections created by teachers and students. Users can also build assessment features into their playlists and the system includes an assessment bank of 1.5 million items. Gooru resources carry a variety of different licences but all are open and free to use. Playlists are currently shared under a CC BY SA licence, however Gooru are in the process of transitioning to CC0 over the course of the next month. Most content is aimed at the K-12 sector.
Gooru has developed an open source learning architecture licensed under the MIT Open Source Initiative approved licence, and a number of APIs that enable developers to build applications based on the Gooru infrastructure. The Gooru APIs are available here: Gooru APIs, and further information about the Gooru development community is available here Gooru Learning Developers.
A custom Gooru Metadata Schema (GMS) composed of 40 fields has been created from various metadata schemas. The Gooru Metadata Schema may be regarded as a variant of the LOM, though to date, GMS has not been mapped directly to LOM. Accessibility Metadata Project fields are used to describe the accessibility of content.
Content with high quality metadata is weighted more heavily in search results, though other factors also come into play, such as how many times a resource is included in other playlists.
Gooru does not ingest metadata through OAI PMH; some metadata is generated by users uploading resources and tagging them using the GMS, but the majority comes from web crawling. Domains are curated through a range of input, both internal and through Gooru’s wider network of partners, before pursuing crawls. Teacher-added domains are prioritized. Basic metadata including title, author, publisher, description, etc is captured from each domain, and then passed to a QA cleaning team, who manually identify more nuanced characteristics, e.g. educational use, time required, etc. For subjective fields, such as educational use, a script has been created for cleaning the metadata. The QA team is currently focused on cleaning the metadata on all OER collections and Gooru recently launched an OER filter.
Metadata fields are currently stored in an SQL database, however Gooru will move to a no-SQL framework later in 2014. Paradata is also stored in similar SQL tables but is returned by different APIs. Only some of the Gooru paradata is currently exposed.
Components of LRMI have been incorporated into the Gooru Metadata Schema and a mapping can be provided from the GMS to LRMI. Approximately 95% of the Gooru catalog is now tagged with LRMI.
The following LRMI properties and types have been implemented and the Gooru LRMI Metadata schema is available here (.xls).
- educationalAlignment
- educationalUse
- timeRequired
- typicalAgeRange
- interactivityType
- learningResourceType
- useRightsUrl
- isBasedonUrl
The GMS includes an Educational Alignment field with alignment types ‘subject’ and ‘educational level’. Alignment type ‘text complexity’ may be added in the future.
In addition to Common Core State Standards, Gooru content is also aligned to Texas Curriculum Standards and California Science Standards
Links
Gooru
Gooru Metadata Guide
Gooru LRMI Metadata Schema
Licence information in schema.org and LRMI
When the Learning Resource Metadata Initiative (LRMI) technical working group started its work it focused on identifying the properties and relationships that were important for educational resources but could not be adequately expressed using schema.org as it then stood. One of those important pieces of information was the licence under which a resource was released, and so the LRMI spec from the start had the property useRightsUrl “The URL where the owner specifies permissions for using the resource.” When schema.org adopted most of the LRMI properties, useRightsUrl was an exception, it was not adopted pending further consideration–not surprising really given the wide-ranging applicability of licence information beyond learning resources.
Back in June the good news came that with version 1.6 of schema.org included a license property for Creative Works that does all that LRMI wanted, and more.
What does this mean for LRMI adopters?
Some adopters of LRMI have already started using useRightsUrl. Such implementations are valid LRMI but not valid schema.org, which means that they will only be understood by applications that have been written specifically to understand LRMI and not by the general purpose web-scale search applications. This is sub-optimal.
In passing, let me mention another complication. With schema.org you have a choice of syntax: microdata and RDFa 1.1 lite. With RDFa there was already a mechanism for identifying a link to a licence, that is rel=”license”. Just to complicate a little more, RDFa allows name spacing, and the term license appears in at least three widely used namespaces: HTML5, Dublin Core Terms, and the Creative Commons Rights Expression Language–hopefully this will never matter to you. To exemplify one of these options I’ll use the HTML that you get when you use the Creative Commons License Chooser (but let’s be absolutely clear, what I am writing about applies to any type of license whether the terms be open or commercial):
<a rel="license" href="http://creativecommons.org/licenses/by/4.0/">
The good news is that all these options play nicely together, you can have the best of all worlds.
If you are already using itemprop=”useRightsUrl” to identify the link to a licence using LRMI in microdata, you can also use the license property and rel=”license”. The following LRMI microdata with a bit RDFa thrown in works:
<html> <body itemscope itemtype="http://schema.org/CreativeWork"> <a itemprop="license useRightsUrl" rel="license" href="https://creativecommons.org/licenses/by/4.0/"> Creative Commons Attribution 4.0 International (CC BY 4.0) licence </a> </body> </html>
If you are using LRMI / schema.org in RDFa, then the following is valid
<html> <body vocab="http://schema.org/" typeof="CreativeWork"> <a rel="license useRightsUrl" href="https://creativecommons.org/licenses/by/4.0/"> Creative Commons Attribution 4.0 International (CC BY 4.0) licence </a> </body> </html>
License does what LRMI asked for and more
In my opinion the schema.org license property is superior to the LRMI useRightsUrl for a few reasons. It does everything that LRMI wanted by way of identifying the URL of the licence under which the creative work is released, but also:
- It belongs to a more widely recognised namespace, especially important if you are wanting to generate RDF data
- I prefer the semantics of the name and definition: a license can include restrictions of use as well as grant rights and permissions.
- the range, i.e. the type of value that can be provided, includes Creative Works as well as Urls
That last points allows one to encode the name, url, description, date, accountable person and a whole host of other information about the licence (albeit at the cost of the not being able to do so alongside LRMI’s useRightsUrl quite so simply)
Summary
The inclusion in schema.org of the license property is good news for aims for LRMI. If you use LRMI and care about licensing you should tag the information you provide about the license with it. If you already use LRMI’s useRightsUrl or RDFa’s rel=”license” there is no need to stop doing so.
LRMI Implementation Case Study: Jorum
Project lead – Ben Ryan, Jorum Technical Coordinator.
“Jorum is a Jisc funded Service for UK Further and Higher Education, to collect and share open educational resources, allowing their reuse and repurposing. Jorum’s free online repository service forms a key part of Jisc’s Learning and Teaching digital content offering. It is the first port of call for thousands of resources, all shared and created by those who teach or have been inspired in the FE and HE and professional skills community.”
The Jorum LRMI implementation project began in September 2013 and work is ongoing as the platform develops. Jorum is a DSpace repository containing a wide range of educational resources in many different formats, including a considerable volume of IMS Content Packages. The repository contains approximately 16,000+ resources, most of which are openly licensed. Jorum uses a combination of LOM, DC, LRMI, Jorum metadata, plus custom fields for different collection ‘windows’. LRMI properties are crosswalked to LOM education fields.
Jorum search returns page
Implementing LRMI in Jorum presented something of a challenge to the project team as DSpace only allows metadata to be added to ‘items’ which are collections of individual files. Metadata can not be applied at the file level, e.g. an html page within a content package, and there is no way to add microdata to an individual page. If Jorum ingests a resource that already includes LRMI it can be cross walked to map to the LOM fields, however if a content package contains multiple pages that are marked up with LRMI it is difficult to extract this data as there is nowhere to store it in DSpace. In addition, in order to enable a search engine to access a full set of LRMI metadata it is necessary to generate a page containing the LRMI which the search engine can hit. The default page generated by DSpace only includes title, author and description. To generate a page with a richer set of metadata it is necessary to create a custom theme, which is a non trivial task.
Jorum resource page
Despite the technical difficulty of implementing LRMI in DSpace, the Jorum project has made good progress and the team have plans for further development in this area including implementing the new Schema.org License property, implementing the alignmentObject and aligning it to the UK higher education Joint Academic Subject Coding Scheme. The project team also plan to build a Google Custom Search engine to demonstrate how Jorum LRMI metadata can be surfaced.
Jorum has implemented the following LRMI properties and types, though this is dependent on what metadata has been supplied for each resource.
- educationalAlignment: plan to implement in the future
- educationalUse: yes,
- timeRequired: yes
- typicalAgeRange: no
- interactivityType: yes
- learningResourceType: yes
- useRightsUrl: no, but plan to implement License property
The Jorum project team have not yet shared their LRMI metadata with the Learning Registry as they are waiting to upgrade their platform to DSpace 4.0 before taking this implementation forward as DSpace 4.0 includes an upgraded OAI PMH interface providing a good flexible way to generate metadata from different schema. It should be noted that Jorum have already undertaken a successful Learning Registry implementation project, the Jisc funded JLeRN Experiment ( which successfully built a Learning Registry node in the UK and developed a number of prototype services for LR ingest and querying. The same developer responsible for the JLeRN implementation has been commissioned to undertake the Jorum LRMI implementation and this work will be taken forward once the upgrade to DSpace 4.0 is complete.
Links
Jorum
Jorum Case Study Questionnaire
Jorum Blog: Implementing the Learning Resource Metadata Initiative (LRMI) in Jorum