Development of a conceptual model

Posted on by

Reflecting on the challenging field of conceptual models, I thought of the idea of exposing my evolving conceptual model that extends across the areas of learner mobility, learning, evaluation/assessment, credit, qualifications and awards, and intended learning outcomes — which could easily be detailed to cover knowledge, skill and competence.

eurolmcm10

This is more or less the whole thing as it is at present. It will evolve, and I would like that to illustrate how a model can evolve as a result of taking into account other ideas. It also wants a great deal of explanation. I invite questions as comments (or directly) so that I can judge what explanation is helpful. I also warmly welcome views that might be contrasting, to help my conceptual model to grow and develop.

It originates in work with the European Learner Mobility team specifying a model for European Learner Mobility documents — that currently include the Diploma Supplement (DS) and Certificate Supplement. This in turn is based on the European draft standard Metadata for Learning Opportunities (MLO), which is quite similar to the UK’s (and CETIS’s) XCRI. (Note: some terminology has been modified from MLO.) Alongside the DS, the model is intended to cover the UK’s HEAR — Higher Education Achievement Report. And the main advance from previous models of these things, including transcripts of course results, is that it aims to cover intended learning outcomes in a coherent way.

This work is evolving already with valued input from colleagues I talk to in

but I wanted to publish it here so that anyone can contribute, and anyone in any of these groups can refer to it and pass it round — even if as a “straw man”.

It would have been better to start from the beginning, so that I could explain the origin of each part. However that is not feasible, so I will have to be content with starting from where I am, and hoping that the reasoning supporting each feature will become clear in time, as there is an interest. Of course, at any time, the reasoning may not adequately support the feature, and on realising that I will want to change the model.

Please comment if there are discrepancies between this model and your model of the same things, and we can explore the language expressing the divergence of opinion, and the possibility for unification.

Obviously this relates to the SC36 model I discussed yesterday.

See also the next version.

Consensus process and conceptual models

Posted on by

I was in Umeå last week — at the NORDLET conference — but also there were lots of ISO SC36 people coming for their meeting. Now SC36 is trying to put forward a “PDTR” — draft technical report — “ITLET – Conceptual reference model for competencies and related objects” which I have been interested in for a while, as it would be nice to use this opportunity to broaden consensus about competence and related terms. There is a diagram representing a current proposal, and this is part of a set of documents tracing the development of this work, which up to now I was not aware of.

You know the basic idea about the standardization process — there is meant to be established practice in the area which would benefit from standardization. But, as I am just discovering, there is another kind of ISO document, the Technical Report. This one is of “type 3, when the joint technical committee has collected data of a different kind from that which is normally published as an International Standard (“state of the art”, for example).” And so we could at least think over, what is the appropriate time to try to agree a conceptual model? What is the appropriate process?

My experience and intuition both tell me that it takes a lot of work to agree on a shared conceptual model. People almost always build up their own private conceptual models of any area they are involved with. Concepts are used in discussion among groups, and these concepts become important to the group members, as they are part of their language, and their means of communication. Put two groups together, attempting to merge their conceptual models, and you are likely to find people defending their corners. That’s not consensus process, and it could easily result in a botch of a conceptual model that satisfies no one at all.

But put two individuals together, free from the constraints of being answerable to a group, and a wholly different process can take place. Instead of communication being a prompt to defend known terms, it is naturally a motive to explore the other person’s terms and meanings. And the prize at the end of a deep exploratory dialogue of this kind could be a shared conceptual model — not necessarily where the facts in the model are agreed, but at least where the language is agreed in which it is possible to disagree comprehensibly. And it is just during these dialogues — again, in my experience — that each person’s conceptual model is able to grow.

It seems like a good idea, therefore, in any case of trying to agree a conceptual model, to base the consensus process around dialogues between pairs of people. The time needed can seem long. My (good) experience of talking with Simone Laughton — an SC36 member from Canada — suggests that it takes at least several hours to get a good enough understanding of someone else’s conceptual model, at least of the type that SC36 are trying to agree on, if one wants to create a shared conceptual model.

So, contrast two alternatives. Firstly, the existing committee-based processes, which seem to run up again and again into the difficulties of disagreement, perhaps because of the mechanisms suggested above. Secondly, deep pairwise dialogue between all the participants who feel they have a position on a conceptual model. The second option is front-loaded — that is, it seems to need more work up front — but my guess is that once that work had been done — once people have had the experience of the development of their own model through dialogue — the committee process would probably be very quick and painless. And, maybe, the process might even take less time overall, as well as being more likely to result in a genuinely shared model.

Worth a try?

Worth a try also, perhaps, in areas that might be of similar complexity, such as the attempt to agree a management or governance structure between people in the same organisation, or with a common interest?

LEAP2A in ALT newsletter

Posted on by

The LEAP2A specification – for e-portfolio portability and interoperability – means a lot to the developers who have worked on it, but can be a challenge to describe concisely to others who are less familiar with this technology. Recently it was suggested that I write a short article to do just that, and it appeared in Issue 16 of the ALT Newsletter, May 2009.

More PDP and e-portfolios – Reading

Posted on by

Yesterday I went to an interesting event in Reading (at the University) called “Future-proofing PDP and ePortfolios“. My role was only to answer questions in a Q&A session on interoperability, but as there were few technical people around it was called “Can I take away what I’ve put into our PDP system?”

Two really interesting points emerged.

  1. Many institutions feel stuck with Blackboard at present, even for their portfolio functionality. Generally, they are unhappy with this.
  2. There are a few interesting tools that work in Blackboard, and people are keen on using the wiki facility for building portfolio presentations.

The wiki tool in question is from Learning Objects. The general idea is that learners find wiki technology an easy way to write a presentation, and if that is what they want to do with a “portfolio”, it should work fine – as indeed any wiki technology. I don’t know how important the integration with the rest of the e-learning system would be.

But this in turn brings up the question, if wikis are used as a platform for constructing e-portfolio presentations, can we make them interoperable with other e-portfolio systems? It would be great if we could. I intend to ask around, and think around, this issue, and write more. The basic idea would be to get a new version of LEAP2 out – LEAP2R – that would be LEAP2 in RDFa – and then see if a wiki system can be tweaked to export and import XHTML+RDFa in LEAP2R format. We would of course also build transforms to convert between LEAP2A and LEAP2R.

Book finally available

Posted on by

My book, “Electronic Portfolios: Personal information, personal development and personal values” has recently been published, and is eventually available on Amazon UK etc. (or .fr or .de or .com)

The publishers have it in their catalogue.

I was very surprised by the high list price, which I have had no influence over. I would publish it for no more than half that price. Perhaps the publishers aren’t expecting all that many sales? But I hope that doesn’t stop people ordering it for their libraries. It is relevant to many different people, and the principles should be valid for a few years, so I’d say it’s worth having in any library where there are educators using e-portfolios, or developers developing them.

Skills frameworks, interoperability, portfolios, etc.

Posted on by

Last Thursday (2009-04-16) I went to a very interesting meeting in Leeds, specially arranged, at the Leeds Institute of Medical Education, between various interested parties, about their needs and ideas for interoperability with e-portfolio tools – but also about skills frameworks.

It was interesting particularly because it showed more evidence of a groundswell of willingness to work towards e-portfolio interoperability, and this has two aspects for the people gathered (6 including me). On the one hand, the ALPS CETL is working with MyKnowledgeMap (MKM) – a small commercial learning technology vendor based in York – on a project involving health and social care students in their 5 HEIs around Leeds. They are using the MKM portfolio tool, Multi-Port, but are aware of a need to have records which are portable between their system and others. It looks like being a fairly straightforward case of a vendor with a portfolio tool being drawn in to the LEAP2A fold on the back of the success we have had so far – without the need for extra funding. The outcome should be a classic interoperability win-win: learners will be able to export their records to PebblePad, Mahara, etc., and the MKM tool users will be able to import their records from the LEAP2A-implementing systems to kick-start their portfolio records there with the ALPS CETL or other MKM sites.

MKM tools, as suggested by the MKM name, do cover the representation of skills frameworks, and this forms a bridge between two threads to this meeting: first, the ALPS CETL work, and second, the more challenging area of medical education, where frameworks – of knowledge, skill or competence – abound and are pretty important for medical students and in the professional development of medical practitioners, and health professionals more generally.

In this more challenging side of the meeting, we discussed some of the issues surrounding skills frameworks in medical education – including the transfer of students at undergraduate level; the transfer between a medical school like Leeds and a teaching hospital, where the doctors may well soon be using the NHS Foundation Year e-portfolio tools in conjunction with their further training and development; and then on to professional life.

The development of LEAP2A has probably been helped greatly by not trying to do too much all at once. We haven’t yet fully dealt with how to integrate skills frameworks into e-portfolio information. At one very simple level we have covered it – if each skill definition has a URI, that can be referred to by an “ability” item in the LEAP2A. But at another level it is greatly challenging. Here in medical education we have not one, but several real-life scenarios calling for interoperable skills frameworks for use with portfolio tools. So how are we actually going to advise the people who want to create skills frameworks, about how to do this in a useful way? Their users, using their portfolio tools, want to carry forward the learning (against learning outcomes) and evidence (of competence) to another setting. They want the information to be ready to use, to save them repetition – potentially wasteful to the institution as well as the learner.

The answer necessarily goes beyond portfolio technology, and needs to tackle the issues which several people are currently working on: European projects like TENCompetence and ICOPER, where I have given presentations or written papers; older JISC project work I have been involved with (ioNW2, SPWS); and now the recently set up a CETIS team on competences.

Happily, it seems like we are all pushing at an open door. I am happy to be able to respond in my role as Learning Technology Advisor for e-portfolio technology, and point MKM towards the documentation on – and those with experience of implementing – LEAP2A. And the new competence team has been looking for a good prompt to hold an initial meeting. I imagine we might hold a meeting, perhaps around the beginning of July, focused on frameworks of skills, competence, knowledge, and their use together with curriculum learning outcomes, with assessment criteria, and with portfolio evidence? The Leeds people would be very willing to contribute. Then, perhaps JISC might offer a little extra funding (on the same lines as previous PIOP and XCRI projects) to get together a group of medical educators to implement LEAP2A and related skills frameworks together – in whatever way we all agree is good to take forward the skills framework developments.

LEAP2A progress

Posted on by

The Portfolio InterOperability Projects (PIOP) partners have been working hard on our LEAP2A spec for portfolio interoperability and portability, and at our meeting last week we ironed out some of the last things necessary to agree a good working specification, able to represent just about any information that is in common use in more than one e-portfolio system. The spec just allows for export/download and import/upload so far, rather than web services, but that will come later.

The spec has been developed with and by developers for developers, so it is relatively easy to implement, being based on Atom. Several people working on e-portfolio-related projects were at the JISC e-Learning Programme meeting yesterday (at Aston) and there was plenty of positive and encouraging comment around.

Anyone interested is very welcome to comment on where we have got to, and send me suggestions for improvement so that any other relevant system dealing with similar information can have the appropriate information also represented in LEAP2A, to enable interoperability with the rest of our established partners.

Representing defining and using ability competency and similar concepts

Posted on by

I’ve been telling people, for quite a while, that I will write up suggestions for how to deal with abilities (competence, competencies, knowledge, etc. etc.) for many reasons, including particularly e-portfolio related uses. Well, here are my current ideas for the New Year.

They are expressed in a set of linked pages, each dealing with a facet of the issues. The pages are very much draft ideas, but serve the purpose of getting out the basic ideas and inviting other ideas for improvement. If you have an interest, please do at least leave a comment here, or e-mail me with ideas and suggestions.

Anti-social software

Posted on by

Social software is good for learning if, and only if, the society of learners is, or can be persuaded to be, positive towards learning. But what if you’re a teenager in a peer group in which learning is uncool? Perhaps we need software that expressly excludes the peer group?

I was at a meeting in Birkbeck, London, November 18th, called “Workshop on Personalised Technologies for Lifelong Learning”, which included outcomes (I missed) from the MyPlan project – generally to do with e-portfolio systems, lifelong learning, etc. In the general discussion, “Next Generation Environments for Lifelong Learning”, it was Andrew Ravenscroft (who manages the fascinating InterLoc) who came out with the phrase “antisocial software”, but I thought is was so apt, even though a bit extreme, that it needs popularising.

There’s enough of a serious point there to be well worth thinking about carefully. The general assumption that social software is a potential positive force for learning (among those keen on social software) needs challenging, not because is isn’t often true, but because it isn’t true always. Rather, you have to start by thinking about what the social group norms and values are. It has been said that in some school environments, achievement is a serious handicap to social success in the peer group. Surely, in these environments, it is not a good idea to use social software for learning, in the sense of doing learning in a group which involves all the peer group by default.

Instead, learning ideally needs to be done out of the view of the peer group, or in a setting where the peer group social norms and values do not apply. One way of doing this for traditional classroom learning is to introduce strong behaviour rules that are very different from behaviour outside the classroom. This approach would be the one proposed by various “old school” teachers, and there are books which I remember from teacher training days where these approaches are promulgated. Another way of doing this, which could also now be thought of as traditional, is through a more personalised approach, where learners work on their own worksheets. But for e-learning in these environments, what is needed is to separate the learning experience from the social group, not link it.

Of course, learning software that works that way would not really be “antisocial”, and this for two reasons. Firstly, one could have social software with varying degrees of privacy. Learners could use the more openly social facilities with the peer group, and private ones with teachers. Indeed, learners actually interested in learning might benefit from support in their interactions in the peer group. Secondly, social software with these capabilities could help learners find those other minority individuals who also want to learn, and smaller groups could be formed, outside the view of the majority.

A wider point relates to other things of interest to me, particularly about the multiplicity of personality. Teenagers in particular have different “personas”, or whatever you want to call this phenomenon of behaving in different ways in different contexts, and being embarrassed if behaviour displaying the values from one context slips through into the other. E-portfolio tools, as I will be describing in my book, could be used to help young learners to recognise the differences between the different contexts they find themselves in, and to adapt their personality differently in those different contexts.

To end with a much wider-reaching question, could we use anti-social software, not only in schools, to subvert social norms which do not value learning, but also perhaps as an aid to subversion in an organisation where the peer culture has turned against really effective work, or a country being ruled by a force which is fundamentally against democratic and accountable government?