Category Archives: portfolio

The growing need for open frameworks of learning outcomes

Posted on by

(A contribution to Open Education Week — see note at end.)

(24th in my logic of competence series.)

What is the need?

Imagine what could happen if we had a really good sets of usable open learning outcomes, across academic subjects, occupations and professions. It would be easy to express and then trace the relationships between any learning outcomes. To start with, it would be easy to find out which higher-level learning outcomes are composed, in a general consensus view, of which lower-level outcomes.

Some examples … In academic study, for example around a more complex topic from calculus, perhaps it would be made clear what other mathematics needs to be mastered first (see this recent example which lists, but does not structure). In management, it would be made clear, for instance, what needs to be mastered in order to be able to advise on intellectual property rights. In medicine, to pluck another example out of the air, it would be clarified what the necessary components of competent dementia care are. Imagine this is all done, and each learning outcome or competence definition, at each level, is given a clear and unambiguous identifier. Further, imagine all these identifiers are in HTTP IRI/URI/URL format, as is envisaged for Linked Data and the Semantic Web. Imagine that putting in the URL into your browser leads you straight to results giving information about that learning outcome. And in time it would become possible to trace not just what is composed of what, but other relationships between outcomes: equivalence, similarity, origin, etc.

It won’t surprise anyone who has read other pieces from me that I am putting forward one technical specification as part of an answer to what is needed: InLOC.

So what could then happen?

Every course, every training opportunity, however large or small, could be tagged with the learning outcomes that are intended to result from it. Every educational resource (as in “OER”) could be similarly tagged. Every person’s learning record, every person’s CV, people’s electronic portfolios, could have each individual point referred, unambiguously, to one or more learning outcomes. Every job advert or offer could specify precisely which are the learning outcomes that candidates need to have achieved, to have a chance of being selected.

All these things could be linked together, leading to a huge increase in clarity, a vast improvement in the efficiency of relevant web-based search services, and generally a much better experience for people in personal, occupational and professional training and development, and ultimately in finding jobs or recruiting people to fill vacancies, right down to finding the right person to do a small job for you.

So why doesn’t that happen already? To answer that, we need to look at what is actually out there, what it doesn’t offer, and what can be done about it.

What is out there?

Frameworks, that is, structures of learning outcomes, skills, competences, or similar things under other names, are surprisingly common in the UK. For many years now in the UK, Sector Skills Councils (SSCs), and other similar bodies, have been producing National Occupational Standards (NOSs), which provided the basis for all National Vocational Qualifications (NVQs). In theory at least, this meant that the industry representatives in the SSCs made sure that the needs of industry were reflected in the assessment criteria for awarding NVQs, generally regarded as useful and prized qualifications at least in occupations that are not classed as “professional”.

NOSs have always been published openly, and they are still available to be searched and downloaded at the UKCES’s NOS site. The site provides a search page. As one of my current interests is corporate governance, I put that phrase in to the search box giving several results, including a NOS called CFABAI131 Support corporate decision-making (which is a PDF document). It’s a short document, with a few lines of overview, six performance criteria, each expressed as one sentence, and 15 items of knowledge and understanding, which is what is seen to be needed to underpin competent performance. It serves to let us all know what industry representatives think is important in that support function.

In professional training and development, practice has been more diverse. At one pole, the medical profession has been very keen to document all the skills and competences that doctors should have, and keen to ensure that these are reflected in medical education. The GMC publishes Tomorrow’s Doctors, introduced as follows:

The GMC sets the knowledge, skills and behaviours that medical students learn at UK medical schools: these are the outcomes that new UK graduates must be able to demonstrate.

Tomorrow’s Doctors covers the outline of the whole syllabus. It prepares the ground for doctors to move on to working in line with Good Medical Practice — in essence, the GMC’s list of requirements for someone to be recognised as a competent doctor.

The medical field is probably the best developed in this way. Some other professions, for example engineering and teaching, have some general frameworks in place. Yet others may only have paper documentation, if any at all.

Beyond the confines of such enclaves of good practice, yet more diverse structures of learning outcomes can be found, which may be incoherent and conflicting, particularly where there is no authority or effective body charged with bringing people to consensus. There are few restrictions on who can now offer a training course, and ask for it to be accredited. It doesn’t have to be consistent with a NOS, let alone have the richer technical infrastructure hinted at above. In Higher Education, people have started to think in terms of learning outcomes (see e.g. the excellent Writing and using good learning outcomes by David Baume), but, lacking sufficient motivation to do otherwise, intended learning outcomes tend to be oriented towards institutional assessment processes, rather than to the needs of employers, or learners themselves. In FE, the standardisation influence of NOSs has been weakened and diluted.

In schools in the UK there is little evidence of useful common learning outcomes being used, though (mainly) for the USA there exists the Achievement Standards Network (ASN), documenting a very wide range of school curricula and some other things. It has recently been taken over by private interests (Desire2Learn) because no central funding is available for this kind of service in the USA.

What do these not offer?

The ASN is a brilliant piece of work, considering its age. Also related to its age, it has been constructed mainly through processing paper-style documentation into the ASN web site, which includes allocating ASN URIs. It hasn’t been used much for authorities constructing their own learning outcome frameworks, with URIs belonging to their own domains, though it could in principle be.

Apart from ASN, practically none of the other frameworks that are openly available (and none that are not) have published URIs for every component. Without these URIs, it is much harder to identify, unambiguously, which learning outcome one is referring to, and virtually impossible to check that automatically. So the quality of any computer assisted searching or matching will inevitably be at best compromised, at worst non-existent.

As learning outcomes are not easily searchable (outside specific areas like NOSs), the tendency is to reinvent them each time they are written. Even similar outcomes, whatever the level, routinely seem to be be reinvented and rewritten without cross-reference to ones that already exist. Thus it becomes impossible in practice to see whether a learning opportunity or educational resource is roughly equivalent to another one in terms of its learning outcomes.

Thus, there is little effective transparency, no easy comparison, only the confusion of it being practically impossible to do the useful things that were envisaged above.

What is needed?

What is needed is, on the one hand, much richer support for bodies to construct useful frameworks, and on the other hand, good examples leading the way, as should be expected from public bodies.

And as a part of this support, we need standard ways of modelling, representing, encoding, and communicating learning outcomes and competences. It was just towards these ends that InLOC was commissioned. There’s a hint in the name: Integrating Learning Outcomes and Competences. InLOC is also known as ELM 2.0, where ELM stands for European Learner Mobility, within which InLOC represents part of a powerful proposed infrastructure. It has been developed under the auspices of the CEN Workshop, Learning Technologies, and funded by the DG Enterprise‘s ICT Standardization Work Programme.

InLOC, fully developed, would really be the icing on the cake. Even if people just did no more than publishing stable URIs to go with every component of every framework or structure of learning outcomes or competencies, that would be a great step forward. The existence and openness of InLOC provides some of the motivation and encouragement for everyone to get on with documenting their learning outcomes in a way that is not only open in terms of rights and licences, but open in terms of practice and effect.

Open Education Week 2014 logoThe third annual Open Education Week takes place from 10-15 March 2014. As described on the Open Education Week web site “its purpose is to raise awareness about the movement and its impact on teaching and learning worldwide“.

Cetis staff are supporting Open Education Week by publishing a series of blog posts about open education activities. Cetis have had long-standing involvement in open education and have published a range of papers which cover topics such as OERs (Open Educational Resources) and MOOCs (Massive Open Online Courses).

The Cetis blog provides access to the posts which describe Cetis activities concerned with a range of open education activities.

Learning about learning about …

Posted on by

I was recently reading a short piece from Peter Honey (of learning styles fame)
in a CIPD blog post in which he writes, saving the most important item for last in his list:

Learning to learn – the ultimate life-skill

You can turn learning in on itself and use your learning skills to help you learn how to become an increasingly effective learner. Learning to learn is the key to enhancing all the above.

It’s all excellent stuff, and very central to the consideration of learning technology, particularly that dedicated to supporting reflection.

Then I started thinking further (sorry, just can’t help it…)

If learning to learn is the ultimate life skill, then surely the best that educators can do is to help people learn to learn.

But learning to learn is not altogether straightforward. There are many pitfalls that interfere with effective learning, and which may not respond to pure unaided will-power or effort. Thus, to help people learn to learn, we (as educators) have to know about those pitfalls, those obstacles, those hazards that stand in the way of learning generally, and we have to be able somehow at least to guide the learners we want to help around those hazards.

There are two approaches we could take here. First, we could try to diagnose what our learners are trying to learn, what is preventing them, and maybe give them the knowledge they are lacking. That’s a bit like a physician prescribing some cure — not just medicine, perhaps, but a cure that involves a change of behaviour. Or it’s a bit like seeing people hungry, and feeding them — hungry for knowledge, perhaps? If we’re talking about knowledge here, of course, there is a next stage: helping people to find the knowledge that they need, rather than giving it to them directly. I put that in the same category, as it is not so very different.

There is a second, qualitatively different approach. We could help our learners learn about their own learning. We could guide them — and this is a highly reflective task — to diagnose their own obstables to learning. This is not simply not knowing where to look for what they want to know, it is about knowing more about themselves, and what it may be within them that interferes with their learning processes — their will to learn, their resolve (Peter Honey’s article starts with New Year’s resolutions) or, even, their blind spots. To pursue the analogy, that is like a physician giving people the tools to maintain their own health, or, proverbially, rather than giving a person a fish, teaching them to fish.

Taking this further starts to relate closely in my mind to Kelly’s Personal Construct Psychology; and also perhaps to Kuhn’s ideas about the “Structure of Scientific Revolutions”. Within a particular world view, one’s learning is limited by that world view. When the boundaries of that learning are being pushed, it is time to abandon the old skin and take up a new and more expansive one; or just a different one, more suited to the learning that one wants. But it is hard — painful even (Kelly recognised that clearly) and the scientific establishment resists revolutions.

In the literature and on the web, there is the concept called “triple loop learning”, and though this doesn’t seem to be quite the same, it would appear to be going in the same direction, even if not as far.

What, then, is our task as would-be educators; guides; coaches; mentors? Can we get beyond the practices analogous to Freudian psychoanalyis, which are all too prone to set up a dependency? How can we set our learners truly free?

This may sound strange, but I would say we (as educators, etc.) need to study, and learn about, learning about learning. We need to understand not just about particular obstacles to learning, and how to get around those; but also about how people learn about their own inner obstacles, and how they can successfully grow around them.

As part of this learning, we do indeed need to understand how, in any given situation, a person’s world view is likely to relate to what they can learn in that situation; but further, we need to understand how it might be possible to help people recognise that in themselves. You think not? You think that we just have to let people be, to find their own way? It may be, indeed, that there is nothing effective that we are wise enough to know how to do, for a particular person, in a particular situation. And, naturally, it may be that even if we offer some deep insight, that we know someone is ready to receive, they may choose not to receive it. That is always a possibility that we must indeed respect.

And there cannot be a magic formula, a infallible practice, a sure method, a way of forcibly imbuing people with that deep wisdom. Of course there isn’t — we know that. But at least we can strive in our own ways to live with the attitude of doing whatever we can, firstly, not to stand in the way of whatever light may dawn on others, but also, if we are entrusted with the opportunity, to channel or reflect some of that light in a direction that we hope might bear fruit.

Again, it is not hard to connect this to systems thinking and cybernetics. Beyond the law of requisite variety — something about controlling systems needing to be at least as complex as the systems they are controlling — the corresponding principle is practically commonplace: to help people learn something, we have to have learned more than we expect them to learn. In this case, to help people learn about their own learning, we have to have learned about learning about learning.

People are all complex. It is sadly common to fail to take into account the richness and complexity of the people we have dealings with. To understand the issues and challenges people might have with learning about their own learning, we have to really stretch ourselves, to attend to the Other, to listen and to hear acutely enough with all our senses, to understand enough about them, where they come from, where they are, to have an idea about what may either stand in the way, or enable, their learning about their learning. Maybe love is the best motivator. But we also need to learn.

Right then, back on the CETIS earth (which is now that elegant blue-grey place…) I just have to ask, how can technology help? E-portfolio technology has over the years taken a few small steps towards supporting reflection, and indeed communication between learners, and between learners and tutors, mentors, educators. I think there is something we can do, but what it is, I am not so sure…

Learning about learning about learning — let’s talk about it!

Privacy? What about self-disclosure?

Posted on by

When we talk about privacy, we are often talking about the right to privacy. That is something like the right to limit or constrain disclosure of information relating to oneself. I’ve often been puzzled by the concept of privacy, and I think that it helps to think first about self-disclosure.

Self-disclosure is something that we would probably all like to control. There’s a lot of literature on self-disclosure in many settings, and it is clearly recognised as important in several ways. I like the concept of self-disclosure, because it is a positive concept, in contrast to the rather negative idea of privacy. Privacy is, as its name suggests, a “privative” concept. Though definitions vary greatly, one common factor is that definitions of privacy tend to be in terms of the absence of something undesirable, rather than directly as the presence of something valuable.

Before I go on, let me explain my particular interest in privacy and self-disclosure – though everyone potentially has a strong legitimate interest in them. Privacy is a key aspect of e-portfolio technology. People are only happy with writing down reflections on personal matters, including personal development, if they can be assured that the information will only be shared with people they want it to be shared with. It is easy to understand this in terms of mistakes, for example. To learn from one’s mistakes, one needs to be aware of them, and it may help to be able to discuss mistakes with other trusted people. But we often naturally have a sense of shame about mistakes, and unless understanding and compassion can be assured, we reasonably worry that the knowledge of our mistakes may negatively influence other people’s perception of our value as people. So it is vital that e-portfolio technology allows us to record reflections on such sensitive matters privately, and share them only with carefully selected people, if anyone at all.

This central concept for e-portfolios, reflection, links straight back to self-disclosure and self-understanding, and indeed identity. Developing ourselves, our identity, qualities and values as well as our knowledge and skill, depends in part on reflection giving us a realistic appreciation of where we are now, and who we are now.

Let me make the perhaps obvious point that most of us want to be accepted and valued as we are, and ideally understood positively; and that this can even be a precondition of our personal growth and development. Privacy, being a negative concept, doesn’t directly help with that. What is vital to acceptance and understanding is appropriate self-disclosure, with the right people, at the right time and in the right context. Even in a world where there was no privacy, this would still be a challenge. How would we gain the attention of people we trust, to notice what we are, what we do, what we mean, and to help us make sense of that?

In our society, commercial interests see, in more and more detail, some selected aspects of what we do. Our information browsing behaviour is noted by Google, and helps to shape what we get in reply to our searches, as well as the adverts that are served up. On Amazon, our shopping behaviour is pooled, enabling us to be told what others in our position might have bought or looked at. The result of this kind of information gathering is that we are “understood”, but only superficially, in the dimensions that relate to what we might pay for. If this helps in our development, it is only in superficial ways. That is a problem.

A more sinister aspect is where much of the energy in the privacy discussion is used up. The patterns of our information search, added to the records of who we communicate with, and perhaps key words in the content of our communications, alert those in power to the possibility that we may pose a threat to the status quo, or to those who have a vested interest in maintaining that power. We have noticed the trend of growing inequality in our society over the last half century.

But, in focusing on these, albeit genuine and worrying issues, what is lost from focus is the rich subtlety of active self-disclosure. It is as if we are so worried by information about ourselves falling into undesirable hands that we forget about the value of knowledge of ourselves being shared with, and entrusted to, those who can really validate us, and who can help us to understand who we are and where we might want to go.

So, I say, let’s turn the spotlight instead onto how technology can help make self-disclosure not only easier, but directed to the right people. This could start along the lines of finding trustable people, and verifying their trustworthiness. Rather than these trustable people being establishment authorities, how about finding peers, or peer groups, where mutual trust can develop? Given a suitable peer group, it is easy to envisage tools helping with an ordered process of mutual self-disclosure, and increasing trust. Yes, privacy comes into this, because an ordered process of self-disclosure will avoid untimely and inappropriate disclosures. But what do we mean by appropriate? Beyond reciprocity, which is pretty much universally acknowledged as an essential part in friendship and other good relationships, I’d say that what is appropriate is a matter for negotiation, rather than assumption. So, there is a role for tools to help in the negotiation of what is appropriate. Tools could help expose assumptions, so that they can be questioned and laid open to change.

Let’s make and use tools like this to retake control, or perhaps take control for the first time, of the rules and processes of self-disclosure, so that we can genuinely improve mutual recognition, acceptance and understanding, and provide a more powerful and fertile ground for personal and collective development.

Even-handed peer-to-peer self-disclosure will be a stimulus to move towards more sharing, equality, co-operation, collaboration, and a better society.

InLOC moving on

Posted on by

Today is the final day of the InLOC project — a European ICT Standardization Work Programme project I have been leading since November 2011. So a good day for an initial review and reflection. I blogged some previous thoughts on InLOC in November 2012 and February this year, and these thoughts are based on some aspects of the project’s final report.

InLOC — Integrating Learning Outcomes and Competences — is all about devising a good way of representing and communicating structures of learning outcomes, competence, skills, competencies, etc. that can be defined by framework owners, and used by many kinds of ICT tools, including those supporting: specifying learning outcomes of courses; claiming skills and competences in portfolios; recruitment and specifying job requirements; learning objectives relevant to resources; and possibly many more.

Project outcomes

We have produced three CEN Workshop Agreements, two formally approved and awaiting publication (Information Model, and Guidelines), and one where a workshop vote will be concluded in the coming days (Application Profile: we don’t expect any problems). Further work includes technical bindings, and two demo prototypes kindly contributed.

The Information Model

There are a number of key advances made in the InLOC Information Model, with respect to other and previous work. “LOC” here stands for “Learning Outcome or Competence”.

  1. A clear distinction is made between a LOCdefinition and a LOCstructure.
    • A LOCdefinition is similar in some ways to IMS RDCEO or IEEE RCD. Any idea of structure is kept separate from this, so that the definition can potentially be reused in different structures. Thus, a LOC definition is like the expression of just one concept about learning outcome, competence, etc.
    • A LOCstructure is the information about the structure and compound properties, but this is kept separate from any particular single definition. While it is recognised that in practice the two are often mixed, the InLOC specification separates them for clarity and for effective implementation.
  2. A clear distinction is made between defining levels with level definitions, and attributing levels (from another scheme) to definitions. This is explained in InLOC treatment of levels. This is necessary for logical clarity, and therefore at some point for applications. A decimal number is introduced as a key part of the model, to allow level information to be automatically processed.
  3. A single structural form, the LOCassociation, is used both to represent relationships between LOC structures and definitions, and to represent several different kinds of compound properties, each with more than one part. This results in structures that are easier to process, with fewer distinct information model components. It also is responsible for the relative ease of representing InLOC naturally in RDF, with minor changes to the model.

Within InLOC in general, a recurrent pattern is of one identifier together with a set of multilingual titles or labels. This is a common pattern elsewhere, and ensures that InLOC representations can naturally work multilingually.

There is a diagrammatic illustration of the Information Model structure as a UML diagram, and many more illustrative diagrams in the Guidelines section on InLOC explained through example.

The Guidelines

The central feature of the Guidelines is a detailed examination of a cross-section of the European e-Competence Framework, given as a good example of the power and flexibility of InLOC in a case from real life. The e-CF is a useful example for InLOC as it identifies 5 levels of competence. The e-CF is analysed in the section on InLOC explained through example. In this section, there are more diagrams illustrating the Information Model and how it is applied in this case.

The e-CF is fully expressed here in InLOC XML format.

Application Profile of Europass CV and Language Passport

The most used Europass instrument is the Europass CV, and Cedefop have recently been revamping it. It is a kind of simple e-portfolio, and the challenge here is to allow it to refer effectively to InLOC structures, so that the end users — the people who have the skills and competences they want to show off — can refer directly to InLOC identifiers, and so have better hope of having them accurately recognised and found in relevant searches. For the Europass CV, the InLOC team have proposed a modification of their XML Schema, and it looks like several if not all of our proposals will be taken on by Cedefop, paving the way for the Europass CV being a leading example of the use of InLOC structures in practice.

Technical bindings

No information model is complete without suggestions for how to bind it to currently relevant technologies. The ones chosen by InLOC were:

We hope that they are reasonably clear and self-explanatory.

While the project found no great motivation for developing other bindings, I personally believe that it would be very valuable in the future to develop something with RDFa and schema.org.

Prototypes

We have been really lucky to have two initiatives filling in where the project was not funded to deliver. There is a Viewer-editors page on the project wiki with access details.

Challenges

The main challenge in this project has been trying to generate interest and contributions from interested parties. It’s not that the topic isn’t important, just that, as usual, busy people need a pressing reason to engage with this kind of activity. This challenge is endemic to all “anticipatory” standardization work. Before either policy mandation or clear economic interest, it takes some spare effort and a clear vision before people are willing to engage.

I’m intending to write more about what this means for my own personal view of what standardization could best be, or perhaps “should” be.

Recommendations

It seems to me good practice to make some recommendations at the end of the project — after all, if one has been engaged in some good work, there should be some ways forward that are clearer at the end than at the beginning. The recommendations that the team agreed included:

  • focusing on trying to get people to publish frameworks in InLOC, as this will in turn motivate tool builders;
  • ensuring that when people are ready to adopt InLOC, they can find resources and expertise;
  • persuading developers to make it easy for users to refer to definitions within InLOC structures;
  • get other Workshop, and other European, projects to use InLOC where possible;
  • work on APIs, and on automatic configuration of key domain terms within user interfaces.

Future Learners, new Opportunities and Technology

Posted on by

The wider CETIS community has often appreciated meeting up, with others sharing the same “special interests”, in “SIG” meetings. That kind of meeting took place, including old “Portfolio” SIG participants, on 11th Dec in Nottingham, and many interesting points came up.

The people who came to the meeting would not all use the label “portfolio”. We billed the meeting as exploring issues from the viewpoint of the learner, so neither institutions, nor providers of learning resources, were the focus. The e-portfolio community has indeed had the learner at the centre of thinking, but this meeting had many ideas that were not specifically “portfolio”.

Indeed, the main attraction of the day was Doug Belshaw talking, and leading a workshop, on the Mozilla Open Badges concept and technology. Badges are not in themselves portfolios, though they do seem to fit well into the same “ecosystem”, which perhaps may come gradually to supplant the current system of the established educational institutions monopolising the award of degrees, with those being necessary for many jobs. And Doug converted people! Several attendees who had not previously been convinced of the value of badges now saw the light. That can only be good.

For those with doubts, Doug also announced that the Mozilla team had agreed to introduce a couple more pieces of metadata into the Open Badges specification. That is definitely worth looking at closely, to see if we can use that extra information to fill gaps that have been perceived. One of these new metadata elements looks like it will naturally link to a definition of skill, competence, or similar, in the style of InLOC, which of course I think is an excellent idea!

The “lightning talks” model worked well, with 10 speakers given only 5 minutes each to speak. The presentations remain listed on the meeting web page, with a link to the slides. Topics included:

  • board games
  • peer assessment
  • students producing content
  • placement and employability

My own contribution was an outline argument of the case that InLOC is positioned to unlock a chain of events, via the vital link of employers taking non-institutional credentials seriously, towards “reinvigorating the e-portfolio landscape”.

So learner-focused learning technology community is alive and well, and doing many good things.

In parallel with the badges workshop, a small group including me talked over more subtle issues. For me, a key point is the need to think through the bigger picture of how badges may be used in practice. How will we differentiate between the likely plethora of badges that will be created and displayed? How will employers, for example, distinguish the ones that are both relevant to their interests, and issued by reputable people or bodies? Looking at the same question another way, what does it take to be the issuer of badges that are genuinely useful, and that will really help the labour market move on? Employers are no more going to wade through scores of badges than they currently wade through the less vital sections of an e-portfolio.

We could see a possible key idea here as “badging the badgers”. If we think through what is needed to be responsible for issuing badges that are really useful, we could turn that into a badge. And a very significant badge it would be, too!

The local arrangements were ably looked after by the Nottingham CIePD group, which seems to be the most active and highly-regarded current such group in UK HE. Ever since, under Angela Smallwood, Nottingham pioneered the ePARs system, they have consistently been in the forefront of developments in this area of learning technology. I hope that they, as well as other groups, will be able to continue work in this area, and continue to act as focal points for the learner-centric learning technology community.

Critical friendship pointer

Posted on by

I picked up a tweet yesterday via Paul Chippendale from an HBR blog called “You Are (Probably) Wrong About You” by Heidi Grant Halvorson. This seems to me a useful tying together of several important things: (e-)portfolios, reflection, critical friendship, and how to run P2P organisations. She writes:

Who knows you best? Well, the research suggests that they do — other people’s assessment of your personality predicts your behavior, on average, better than your assessment does.
[…]
In his fascinating book Strangers to Ourselves, psychologist Timothy Wilson summarizes decades of research […] showing us just how much of what we do during every moment of every day […] is happening below our conscious awareness. Some of it we can notice if we engage in a little self-reflection, but much of it we simply cannot — it’s not directly accessible to us at all.

This might remind us first of the perennial problem of e-portfolios and reflection. People tend to reflect only in their own way in their own time, and this is not necessarily helpful for their personal development. It is not easy for practitioners to persuade people to use e-portfolio tools to reflect in a fruitful way. And when it comes to putting together a presentation of one’s abilities and qualities using an e-portfolio tool, the result is therefore not always realistic.

Often what is more effective is a personal one-to-one approach, where the person in the helping role might be called a mentor, a coach, a personal tutor, or something else. But here we run into the problem of the moment: resources. In many related fields, resource is being taken away from personal contact, with learners left to fend for themselves, given only a website to browse.

If only … we could create an effective peer-to-peer mentoring service. This approach has certainly been explored in many places, not least in Bolton, but I do not have personal experience of this, nor do I currently know of authoritative reviews of what is seen as genuinely effective. One might expect pitfalls of schemes under that name to include a formulaic approach; a lack of genuine insight into the “mentee”; and a reliance on older-to-younger mentoring, rather than a more strictly peer-to-peer approach. In Bolton it would appear to be still a minority practice, and the support is clearly given by more advanced to less advanced students. In this kind of setting, what is the chance of a peer mentor helping to correct someone’s misconceptions about their own abilities?

The term “critical friend” seems to me to address some of these potential deficiencies with peer mentors. If the people in question really are friends, if they know each other well and trust each other, surely there is more of a possibility of bringing up and challenging personal misconceptions, given the mutual desire and a supportive culture. The Wikipedia article provides helpful background. There are many other useful sources of ideas about this idea, also known as “critical colleague”, “critical companion” or “learning partner”, all pointing in the same general direction. The idea has taken root, even if it is not yet a well-known commonplace.

The critical friend concept is certainly inspiring, but how many people have colleagues who are both willing and well-positioned to act in this role? In my experience, friends seldom see the range of professional behaviour that one would want constructive critique of, and colleagues seem rather more able to offer positive suggestions in some areas than in others. The challenge seems partly in bringing such practice into the mainstream, where it does not seem odd, or too upsetting to a culture too weak for anything more strenuous than laissez-faire.

What I believe we need is more practiced and reported experimentation along the lines of benefiting from what colleagues are prepared naturally to do, not expecting everyone to have counselling skills, or a sufficient rapport with each other to be the person … well … that we would like them to be! And in any case there are potential problems with small closed groups of people, whether pairs or slightly larger, all commenting on each other’s performance. It could easily lead to a kind of “groupthink”.

My guess is that there is a robust peer-to-peer solution waiting to be more widely acknowledged, tested, and incorporated into work cultures. I have provisionally thought of it as “follower guidance“, but I will save writing more on that to later, and hope that people may comment in the meantime on how would you address the challenges of people mis-assessing their own abilities and qualities. Really, we need to have a culture that promotes good self-knowledge, not only to help personal and professional development, but also to serve as the bedrock of an effective P2P culture.

p.s. I have now written more on the follower guidance idea.

Reviewing the future for Leap2

Posted on by

JISC commissioned a Leap2A review report (PDF), carried out early in 2012, that has now been published. It is available along with other relevant materials from the e-Portfolio interoperability JISC page. For anyone following the fortunes of Leap2A, it is highly worthwhile reading. Naturally, not all possible questions were answered (or asked), and I’d like to take up some of these, with implications for the future direction of Leap2 more generally.

The summary recommendations were as follows — these are very welcome!

  1. JISC should continue to engage with vendors in HE who have not yet implemented Leap2A.
  2. Engagement should focus on communities of practice that are using or are likely to use e-portfolios, and situations where e-portfolio data transfer is likely to have a strong business case.
  3. JISC should continue to support small-scale tightly focused developments that are likely to show immediate impact.
  4. JISC should consider the production of case studies from PebblePad and Mahara that demonstrate the business case in favour of Leap2A.
  5. JISC should consider the best way of encouraging system vendors to provide seamless import services.
  6. JISC should consider constructing a standardisation roadmap via an appropriate BSI or CEN route.

That tallies reasonably with the outcome of the meeting back in November last year, where we reckoned that Leap2A needs: more adoption; more evidence of utility; to be taken more into the professional world; good governance; more examples; and for the practitioner community to build around it models of lifelong development that will justify its existence.

Working backwards up the list for the Leap2A review report, recommendation 6 is one for the long term. It could perhaps be read in the context of the newly formed CETIS position on the recent Government Open Standards Consultation. There we note:

Established public standards bodies (such as ISO, BSI and CEN), while doing valuable work, have some aspects that would benefit from modernisation to bring them more into line with organisations such as W3C and OASIS.

The point then elaborated is that the community really needs open standards that are freely available as well as royalty-free and unencumbered. The de jure standards bodies normally still charge for copies of their standards, as part of their business model, which we see as outdated. If we can circumvent that issue, then BSI and CEN would become more attractive options.

It is the previous recommendation, number 5 in the list above, that I will focus on more, though. Here is the fuller version of that recommendation (appearing as paragraph 81).

One of the challenges identified in this review is to increase the usability of data exchange with the Leap2A specification, by removing the current necessity for separate export and import. This report RECOMMENDS that JISC considers the best way of encouraging system vendors to provide seamless data exchange services between their products, perhaps based on converging practice in the use of interoperability and discovery technologies (for example future use of RDF). It is recognised that this type of data exchange may require co-ordinated agreement on interoperability approaches across HEIs, FECs and vendors, so that e-portfolio data can be made available through web services, stressing ease of access to the learner community. In an era of increasing quantities of open and linked data, this recommendation seems timely. The current initiatives around courses information — XCRI-CAP, Key Information Sets (KIS) and HEAR — may suggest some suitable technical approaches, even though a large scale and expensive initiative is not recommended in the current financially constrained circumstances.

As an ideal, that makes perfect sense from the point of view of an institution transferring a learner’s portfolio information to another institution. However, seamless transfer is inherently limited by the compatibility (or lack of it) between the information stored in each system. There is also a different scenario, that has always been in people’s minds when working on Leap2A. It is that learners themselves may want to be able to download their own information, to keep for use, at an uncertain time in the future, in various ways that are not necessarily predictable by the institutions that have been hosting their information. In any case, the predominant culture in the e-portfolio community is that all the information should be learner-ownable, if not actually learner-owned. This is reflected in the report’s paragraph 22, dealing with current usage from PebblePad.

The implication of the Leap2A functionality is that data transfer is a process of several steps under the learner’s control, so the learner has to be well-motivated to carry it out. In addition Leap2A is one of several different import/export possibilities, and it may be less well understood than other options. It should perhaps be stressed here that PebblePad supports extensive data transfer methods other than Leap2A, including zip archives, native PebblePad transfers of whole or partial data between accounts, and similarly full or partial export to HTML.

This is followed up in the report’s paragraph 36, part of the “Challenges and Issues” section.

There also appears to be a gap in promoting the usefulness of data transfer specifically to students. For example in the Mahara and PebblePad e-portfolios there is an option to export to a Leap2A zip file or to a website/HTML, without any explanation of what Leap2A is or why it might be valuable to export to that format. With a recognisable HTML format as the other option, it is reasonable to assume that students will pick the format that they understand. Similarly it was suggested that students are most likely to export into the default format, which in more than one case is not the Leap2A specification.

The obvious way to create a simpler interface for learners is to have just one format for export. What could that format be? It should be noted first that separate files that are attached to or included with a portfolio will always remain separate. The issue is the format of the core data, which in normal Leap2A exports is represented by a file named “leap2a.xml”.

  1. It could be plain HTML, but in this case the case for Leap2A would be lost, as there is no easy way for plain HTML to be imported into another portfolio system without a complex and time-consuming process of choosing where each single piece of information should be put in the new system.
  2. It could be Leap2A as it is, but the question then would be, would this satisfy users’ needs? Users’ own requirements for the use of exports is not spelled out in the report, and it does not appear to have been systematically investigated anywhere, but it would be reasonable to expect that one use case would be that users want to display the information so that it can be cut and pasted elsewhere. Leap2A supports the display of media files within text, and formatting of text, only through the inclusion of XHTML within the content of entries, in just the same way as Atom does. It is not unreasonable to conclude that limiting exports to plain Leap2A would not fully serve user export needs, and therefore it is and will continue to be unreasonable to expect portfolio systems to limit users to Leap2A export only.
  3. If there were a format that fully met the requirements both for ease of viewing and cut-and-paste, and for relatively easy and straightforward importing to another portfolio system (comparable to Leap2A currently), it might then be reasonable to expect portfolio systems to have this as their only export format. Then, users would not have to choose, would not be confused, and the files which they could view easily and fully through a browser on their own computer system would also be able to be imported to another portfolio system to save the same time and effort that is currently saved through the use of Leap2A.

So, on to the question, what could that format be? What follows explains just what the options are for this, and how it would work.

The idea for microformats apparently originated in 2000. The first sentence of the Wikipedia article summarises nicely:

A microformat (sometimes abbreviated µF) is a web-based approach to semantic markup which seeks to re-use existing HTML/XHTML tags to convey metadata and other attributes in web pages and other contexts that support (X)HTML, such as RSS. This approach allows software to process information intended for end-users (such as contact information, geographic coordinates, calendar events, and the like) automatically.

In 2004, a more sophisticated approach to similar ends was proposed in RDFa. Wikipedia has “RDFa (or Resource Description Framework –in– attributes) is a W3C Recommendation that adds a set of attribute-level extensions to XHTML for embedding rich metadata within Web documents.”

In 2009 the WHATWG were developing Microdata towards its current form. The Microformats community sees Microdata as having grown out of Microformats ideas. Wikipedia writes “Microdata is a WHATWG HTML specification used to nest semantics within existing content on web pages. Search engines, web crawlers, and browsers can extract and process Microdata from a web page and use it to provide a richer browsing experience for users.”

Wikipedia quotes the Schema.org originators (launched on 2 June 2011 by Bing, Google and Yahoo!) as stating that it was launched to “create and support a common set of schemas for structured data markup on web pages”. It provides a hierarchical vocabulary, in some cases drawing on Microformats work, that can be used within the RDFa as well as Microdata formats.

Is it possible to represent Leap2A information in this kind of way? Initial exploratory work on Leap2R has suggested that it is indeed possible to identify a set of classes and properties that could be used more or less as they are with RDFa, or could be correlated with the schema.org hierarchy for use with Microdata. However, the solution needs detail adding and working through.

In principle, using RDFa or Microdata, any portfolio information could be output as HTML, with the extra information currently represented by Leap2A added into the HTML attributes, which is not directly displayed, and so does not interfere with human reading of the HTML. Thus, this kind of representation could fully serve all the purposes currently served by HTML export of Leap2A. It seems highly likely that practical ways of doing this can be devised that can convey the complete structure currently given by Leap2A. The requirements currently satisfied by Leap2A would be satisfied by this new format, which might perhaps be called “Leap2H5″, for Leap2 information in HTML5, or maybe alternatively “Leap2XR”, for Leap2 information in XHTML+RDFa (in place of Leap2A, meaning Leap2 information in Atom).

Thus, in principle it appears perfectly possible to have a single format that simultaneously does the job both of HTML and Leap2A, and so could serve as a plausible principal export and import format, removing that key obstacle identified in paragraph 36 of the Leap2A review report. The practical details may be worked out in due course.

There is another clear motivation in using schema.org metadata to mark up portfolio information. If a web page uses schema.org semantics, whether publicly displayed on a portfolio system or on a user’s own site, Google and others state that the major search engines will create rich snippets to appear under the search result, explaining the content of the page. This means, potentially, that portfolio presentations would be more easily recognised by, for instance, employers looking for potential employees. In time, it might also mean that the search process itself was made more accurate. If portfolio systems were to adopt export and import using schema.org in HTML, it could also be used for all display of portfolio information through their systems. This would open the way to effective export of small amounts of portfolio information simply by saving a web page displayed through normal e-portfolio system operation; and could also serve as an even more effective and straightforward method for transferring small amounts of portfolio information between systems.

Having recently floated this idea of agreeing Leap2 semantics in schema.org with European collaborators, it looks like gaining substantial support. This opens up yet another very promising possibility: existing European portfolio related formats could be harmonised through this new format, that is not biased towards any of the existing ones — as well as Leap2A, there is the Dutch NTA 2035 (derived from IMS ePortfolio), and also the Europass CV format. (There is more about this strand of unfunded work through MELOI.) All of these are currently expressed using XML, but none have yet grasped the potential of schema.org in HTML through microdata or RDFa. To restate the main point here, this means having the semantics of portfolio information embedded in machine-processable ways, without interfering with the human-readable HTML.

I don’t want to be over-optimistic, as currently money tends only to go towards initiatives with a clear business case, but I am hopeful that in the medium term, people will recognise that this is an exciting and powerful potential development. When any development of Leap2 gets funded, I’m suggesting that this is what to go for, and if anyone has spare resource to work on Leap2 in the meanwhile, this is what I recommend.

The future of Leap2A?

Posted on by

We’ve done a great job with Leap2A in terms of providing a workable starting point for interoperability of e-portfolio systems and portability of learner-ownable information, but what are the next steps we (and JISC) should be taking? That’s what we need to think about.

The role of CETIS was only to co-ordinate this work. The ones to take the real credit are the vendors and developers of e-portfolio and related systems, who worked well together to make the decisions on how Leap2A should be, representing all the information that is seen as sharable between actual e-portfolio tools, allowing it to be communicated between different systems.

The current limitations come from the lack of coherent practice in personal and professional development, indeed in all the areas that e-portfolio and related tools are used for. Where some institutions support activities that are simply different from those supported by a different institution, there is no magic wand that can be waved over the information related to one activity that can turn it into a form that supports a fundamentally different one. We need coherent practice. Not identical practice, by any means, but practice where it is as clear as possible what the building blocks of stored lifelong learning information are.

What we really need is for real users — learners — to be taking information between systems that they use or have used. We need to have motivating stories of how this opens up new possibilities; how it enables lifelong personal and professional development in ways that haven’t been open before. When learners start needing the interoperability, it will naturally be time to start looking again, and developing Leap2A to respond to the actual needs. We’ve broken the deadlock by providing a good initial basis, but now the baton passes to real practice, to take advantage of what we have created.

What will help this? Does it need convergence, not on individual development practice necessarily, but on the concepts behind it? Does it need tools to be better – and if so, what tools? Does it need changes in the ways institutions support PDP? In November, we held a meeting co-located with the annual residential seminar of the CRA, as a body that has a long history of collaboration with CETIS in this area.

And how do we provide for the future of Leap2A more generally? Is it time to form a governing group of software developers who have implemented Leap2A? Is there any funding, or are there any initiatives, that can keep Leap2A fresh and increasingly relevant?

Please consider sharing your views, and contributing to the future of Leap2A.

E-portfolios and identity: more!

Posted on by

The one annual e-portfolio (and identity) conference that I attend reliably was this year co-sponsored by CRA, on top of the principal EIfEL — London, 11th to 13th July. Though it wasn’t a big gathering, I felt it was somehow a notch up from last time.

Perhaps this was because it was just a little more grounded in practice, and this could have been the influence of the CRA. Largely gone were speculations about identity management and architecture, but in was more of the idea of identity as something that was to be developed personally.

We heard from three real recent students, who have used their portfolio systems for their own benefit. Presumably they developed their identity? That’s not a representative sample, and of course these are the converted, not the rank and file dissatisfied or apathetic. A message that surprisingly came from them was that e-portfolio use should be compulsory, at least at some point during the student’s studies. That’s worth reflecting on.

And as well as some well-known faces (Helen, Shane, et al.) there were those, less familiar in these settings, of our critical-friendly Mark Stiles, and later Donald Clark (who had caused slight consternation by his provocative blog post, finding fault with the portfolio concept, and was invited to speak as a result). Interestingly, I didn’t think Donald’s presentation worked as well as his blog (it was based on the same material). In a blog, you can be deliberately provocative, let the objections come, and then gracefully give way to good counter-arguments. But in the conference there wasn’t time to do this, so people may have gone away thinking that he really held these ideas, which would be a pity. Next year we should be more creative about the way of handling that kind of contribution. Mark’s piece — may I call it a friendly Jeremiad? I do have a soft spot for Jeremiah! — seemed to go down much better. We don’t want learners themselves to be commodified, but we can engage with Mark through thinking of plausible ways of avoiding that fate.

Mark also offered some useful evidence for my view that learners’ interests are being systematically overlooked, and that people are aware of this. Just let your eye off the ball of learner-centricity for a moment, and — whoops! — your learner focus is sneakily transformed into a concern of the institution that wants to know all kinds of things about learners — probably not what the learners wanted at all. There is great depth and complexity of the challenge to be truly learner-focused or learner-centred.

One of the most interesting presentations was by Kristin Norris of IUPUI, looking at what the Americans call “civic identity” and “civic-mindedness”. This looks like a laudibly ambitious programme for helping students to become responsible citizens, and seems related to our ethical portfolios paper of 2006 as well as the personal values part of my book.

Kristin knows about Perry and Kegan, so I was slightly surprised that I couldn’t detect any signs in the IUPUI programme of diagnosis of the developmental stage of individual students. I would have thought that what you do on a programme to develop students ethically should depend on the stage they have already arrived at. I’ll follow up on this with her.

So, something was being pointed to from many directions. It’s around the idea that we need richer models of the learner, the student, the person. And in particular, we need better models of learner motivation, so that we can really get under their (and our own) skins, so that the e-portfolio (or whatever) tools are things that they (and we) really want to use.

Intrinsic motivation to use portfolio tools remains largely unsolved. We are faced again and again with the feedback that students don’t want to know about “personal development” or “portfolios” (unless they are creatives who know about these anyway) or even less “reflection”! Yes, there are certainly some (counterexemplifying Donald Clark’s over-generalisation) who want to reflect. Perhaps they are similar to those who spontaneously write diaries — some of the most organised among us. But not many.

This all brings up many questions that I would like to follow up, in no particular order.

  • How are we, then, to motivate learners (i.e. people) to engage in activities that we recognise as involving reflection or leading to personal development?
  • Could we put more effort into deepening and enriching the model we have of each of our learners?
  • Might some “graduate attributes” be about this kind of personal and ethical development?
  • Are we suffering from a kind of conspiracy of the social web, kidding people that they are actually integrated, when they are not?
  • Can we use portfolio-like tools to promote growth towards personal integrity?
  • “Go out and live!” we could say. “But as you do it, record things. Reflect on your feelings as well as your actions. Then, later, when you ‘come up for air’, you will have something really useful to reflect on.” But how on earth can we motivate that?
  • Should we be training young people to reflect as a habit, like personal hygiene habits?
  • Is critical friendship a possible motivator?

I’m left with the feeling that there’s something really exciting waiting to be grasped here, and the ePIC conference has it all going for itself to grasp that opportunity. I wonder if, next year, we could

  • keep it as ePIC — e-portfolios and identity — a good combination
  • keep close involvement of the CRA and others interested in personal development
  • put more focus on the practice of personal-social identity development
  • discuss the tools that really support the development of personal social identity
  • talk about theories and architectures that support the tools and the development?

CPD-Eng – review of a JISC project in progress

Posted on by

I was asked to look into the CPD-Eng project by the JISC programme managers, specifically in conjunction with the JISC “Benefits Realisation” work, because this project in particular has a lot to do with portfolio technology and interoperability, and then with skills and competences in professional development.

CPD-Eng is a JISC-funded project, to quote from the JISC project page, “to integrate systems that support personalised IPD/CPD, applicable to professional frameworks.” The lead institution is the University of Hull, and much of the documentation can be found through their own project page.

The project start date was April 2009. At that date, the tender documentation spelled out the aspirations for the project. The main image that emerges from the tender documentation is not of a new e-portfolio system as such, but of an approach to integrating evidence that may reside on different systems, all of which has relevance to an individual’s CPD. “CPD-Eng will provide the innovative, personalised infrastructure that will support the work-based learner through a new suite of flexible pathways…”

The original plan was to deploy Sun’s Identity Management software, perhaps aiming towards Shibboleth in the longer term. These were overtaken by various events. Consultations with various people related to JISC lowered the perceived value of Shibboleth, and in any case there needed to be a more open approach to accommodate the wider potential usage of the tools.

One of the shaping factors was the requirement to integrate the Hull institutional VLE (“eBridge”), based on the SAKAI framework. Right from the outset there was explicit mention also of integrating e-portfolio systems that have adopted Leap2A. Clearly, one of the main areas of future evidence of the success of a project that claims to be about integrating systems will be the actual extent of integration carried out. In the project plan, WP7 states that the most important integration is between eBridge and other partners’ VLEs. The nature of the integration, however, was not specified at the outset, but remained to be filled in through earlier work in the project itself. A theme that does continue throughout the tender is about the ability of learners to control access to information that may be stored in different places.

The baseline report (version 0.9 of August 2009) spells out more graphically where the project started from. Perhaps the core point at the centre of the vision is the statement: “A portal system has been established alongside an Identity Management (IDM) system that allows self-service management of the learner’s identity. CPD-Eng will develop a robust and scalable approach to interoperability, access and identity management that is both easy to use and seamless, allowing the learner to control their personal e-portfolio-type technologies and share the content within them with whom they choose.” Compared to this, the rest of the baseline report is interesting background.

After the baseline report the project took stock of the situation. Some other portfolio products were “not very engineering”. TAS3 was not seen as very user-friendly. Academics still wanted the software to sit in SAKAI. Unfortunately, the lead programmer resigned to take up employment elsewhere, and the project was left without a developer. After looking into advertising for a replacement, and consulting with the JISC Programme Manager, it was decided to put the software development out to tender. MyKnowledgeMap (MKM: a York-based company with a track record of producing software in the area of skills and portfolios, for users in education and various professions) was judged as the most suitable partner, though they lacked experience of SAKAI. The project leads arranged for MKM employees to be trained by the University’s consultant, Unicon.

This was the situation for the following progress report of 2010-03. Three software modules were being developed within SAKAI:

  • Aggregator
  • Mapper / Tagger
  • Showcaser

The Aggregator module “provides a mechanism for users to gather their artefacts and items of evidence from across multiple sources.” While it is relatively easy simply to copy information from other sources into a system like this, the point here is explicitly “not” (emphasis original) to copy, where it is possible to establish access from the original location.

Tagging is conceived of similarly to elsewhere, in terms of adding free text tags to aid categorisation by individuals. Mapping, in contrast, is designed to allow users to connect artefacts to elements of established “skills, competency and assessment frameworks”. This function is vital within CPD practice, so that users can present evidence of meeting required standards. Such frameworks are stored externally. JISC is now funding some “Competence structures for e-portfolio tools interoperability” work finishing July 2011, and CPD-Eng can play a useful role in determining the standard form in which competence structures should be communicated. MKM does have existing techniques for this, but they will be critiqued and adapted as necessary before being adopted as a consensus.

Showcasing is conceived of similarly as in many portfolio tools. Official review is supported by routine copying of showcases to uneditable areas. This works for e.g. health professionals, because they want a carefully controlled system, though others like engineers need that less, and prefer to do without the extra burden of storage. It is planned to support review without necessarily copying showcases in a later release. Access to showcases was originally only via SAKAI, but it was later recognised that limiting to SAKAI access was not ideal, particularly as many professional bodies have their own e-portfolio systems.

Working with health professionals, archeologists and others (there is also interest from schools, and a pilot with BT), it became clear that a useful system should not be tightly bound to other institutional software or to SAKAI, so what was needed was an independent identity management system.

In the Benefits Realisation plan from the summer of 2010 came a clear restatement of the core aim of the work. “At its centre is a scalable, interoperable and robust access and identity management system that integrates and control access to personal e-portfolio technologies.” But what is the relationship between the CPD-Eng work and other identity management systems? Sun’s Identity Management software had been abandoned. The European funded TAS3 work (in which the University of Nottingham is a partner) was seen as too complex for professional end users. A question which remains outstanding is to clarify the relationship of the system devised with the trials funded by JISC under the PIOP 3 programme, involving PebblePad, the University of Nottingham and Newcastle University. It would be good to see a clear exposition of these and any other relationships. All that can be said at this stage is that in the perception of the CPD-Eng project, none of the other identity management systems really worked for them.

The next piece of documentation is the progress report from September 2010. This is where the questions really start to become clearer. Included in this massive report is the complete text of the final report from “Personalised systems to support CPD within Health Care”, a mini project extending CPD-Eng concepts to health care professions. In this very interesting inner report, there is a large body of evidence about CPD practice in the health professions. This leads to a second major question. What about the whole process side of portfolio practice? CPD-Eng has very clearly focused on the rather technical side of facilitating the access management for artefacts. This is certainly useful at the stage when all the evidence has been generated, when it remains to gather together appropriate items from different places.

Much portfolio practice centrally involves reflection on evidence as well as its collection and showcasing. The phrase “collect, select, reflect…” is often used in portfolio circles. (Helen Barrett adds direction/projection and connection.) Reflection is often vital in portfolio practice, because the mere presentation of a selection of artefacts is no guarantee of a clear and coherent understanding of how and why they fit together. Because unprompted reflection is hard, institutions often support the process. It is useful to be able to build in some aspect of process into the same tools which hold the information and resources to be reflected on, and it is useful to hold the reflections themselves in a place that they can be easily connected with the things on which they are reflecting.

Increasingly, it is recognised that the peer group is another vital aspect of this reflection process. In a situation where staff time is short, or the staff seem uninvolved, possibly the best stimulus for reflection and re-evaluation of ideas is the peer group. Portfolio systems designers themselves have recognised this, by integrating social tools into the portfolio software.

It is clear that MyShowcase is not primarily designed to support reflection. (More information about MyShowcase can be found at www.my-showcase.org which has a demo and links, and through www.mkmlabs.com.) However, one of the consequences of implementing a stand-alone version is that users found an immediate need for some of the functionality that is normally provided within full-feature e-portfolio systems. In particular, users want to collect evidence together and send a link to a tutor for feedback. The link is sent to the reviewer by e-mail, who can then access the system for the purpose of leaving feedback comments. Indeed, some users feel that fully-featured e-portfolio systems are just too complex for their users’ needs, and value a simple tool because it does less, and does not explicitly support reflection by users. So this is the only extra feature implemented in MyShowcase that comes from the fuller set normal in portfolio software.

If one has a hybrid system including MyShowcase and some other portfolio tool, the portfolio functionality will therefore mainly be fulfilled in the portfolio tool, not MyShowcase. But what of the feedback that has been designed into MyShowcase for standalone use? To be useful, it would have to seen within the portfolio system. And generally, any information used in MyShowcase needs to be presented to the associated e-portfolio system for use within whatever (e.g. reflective) processes the portfolio software is used for. We don’t want the flow of information to be only one-way, or there to be solely unidirectional two-stage processes. What is needed is an effective two-way integration, so that the chosen portfolio tool can access all the information gathered through MyShowcase, the user / learner can gather further feedback and reflect, and present the outcomes of that further reflection back into the MyShowcase pool, for onward presentation.

Recent discussion has confirmed that MyShowcase is not primarily conceived of as a replacement for a full e-portfolio system, though it does act as what we might call an “evidence resource management” tool. Perhaps we can now discern an ideal answer to where this might lead, and where things ought to be heading, and the questions that still need to be answered.

If a service such as MyShowcase is to work effectively alongside e-portfolio tools, there needs to be transfer of information all ways round. In addition to this, and because it can be implemented stand-alone, there needs to be Leap2A export and import directly between MyShowcase and a user’s personal storage.

Looking at things from a user’s perspective, a portfolio tool user should be able to make use of MyShowcase functionality transparently. It should be able to be used as invisible “middleware”, allowing the front end e-portfolio system to focus on an appropriate user interface, and portfolio and PDP processes (including reflection and feedback), with MyShowcase providing the funcationality that allow the user to link to evidential resources held in a variety of places, including VLEs, HR systems, other portfolio tools, social networking services, blogs, etc., possibly including sites with sensitive information that will only be displayed to authorised users.

The MyShowcase architecture in principle could provide resource management for “thin portfolio” services, where the storage is not in the portfolio system. Is it, or could it be, adapted for this?

As part of the PIOP 3 projects, Leap2A connection between different systems was been investigated by PebblePad, Nottingham and Newcastle, and this work needs to be carefully compared with the MyShowcase architecture. What exactly are the similarities and the differences? Are they alternatives? Can they be integrated, combining any strong points from both?

In order to facilitate this two-way interaction, there really needs to be substantial compatibility between the information models in all the connected systems, so that there can be meaningful communication between the systems. This does not necessarily mean a full implementation of Leap2A in each participating system, but it does mean at least a reasonable mapping between the information managed and corresponding Leap2A structures, because Leap2A is the only well-implemented and tested model we have at this time that covers all the relevant information. If there are requirements that are not covered by Leap2A, this is a good time to raise them so that they can be incorporated into discussion with other parties interested in Leap2A, and our common future thinking.

I hope I’ve made the issues clearer here. Here are collected recommendations for taking this work forward, whether within the current CPD-Eng and Benefits Realisation work or beyond it.

  • What the portfolio community really needs is multi-way integration of portfolio information, artefacts and permissions, based around Leap2A concepts.
  • Leap2A export and import by users should be provided for standalone implementations of MyShowcase, just as with other portfolio systems that have adopted Leap2A.
  • Showcases in MyShowcase need to be exportable as Leap2A (as with PebblePad WebFolios and Mahara Views).
  • For transparent integration between different sources of information in a portfolio architecture, identity management approaches need consolidating around good workable models such as OAuth
  • The PIOP 3 work by PebblePad Nottingham and Newcastle, as well as TAS3, need to be carefully considered, to extract any lessons relevant to CPD-Eng, even if their appearance is only in the final report.
  • The opportunity provided by any planned project meeting should be fully exploited in these directions.
  • Another meeting should be planned around the wider questions of e-portfolio interoperability architecture, covering not only the technical aspects, but the requirements of practice as well, such as reflection, feedback and comments on non-public items stored elsewhere.