This is an issue that come up frequently for me – an indicator that it’s time to distil my thoughts.
A lot of effort, from a lot of people, has been devoted to finding adequate (let along accurate) ways to describe learning. There’s a problem, though – learning doesn’t lend itself well to description. In the realm of education and learning, language falters.
An example of where description works – food
Consider the domain of food. Here are some Things that we find in food:
Ingredient
Preparation technique
Recipe
Now we can agree that these are Things, and we can agree that these Things are related to Food. We also have something very precious: user consensus on what is what.
If I show you a carrot, you’ll say ‘that’s an ingredient’.
If I show you a page of a Jamie Oliver book with the heading ‘Jamie’s yummo roast beef’, you’ll say ‘that’s a recipe’.
If I show you carrots mentioned in ‘Jamie’s yummo roast beef’, you will understand the carrot-to-recipe relationship immediately and unambiguously.
…and so will everyone else who encounters instances of our Things, with very few exceptions. Yay! Consensus!
Now let me ask a different question: what type of Thing would you look at and say ‘that is a Competency’?
Would your definition match – or, would you have consensus with – the person next to you?
An example of where description didn’t work – LOM
Fortunately, we seem to now be leaving behind the Dark Days of the Learning Object Metadata (IEEE LOM) profile. We’re leaving it behind because it didn’t work very well. But what was it about it (aside from being un-indexably and un-editably stuck in the middle of a bunch of sequencing information in an imsmanifest.xml file, which is itself tucked away deep in a compressed file) that made it not work?
I’d suggest that LOM tried to describe things that can’t be described in schemas, and that was the seed of it’s downfall.
Here it is, in all it’s glory:
The LOM base schema. AAAAAAAAAAAAARGGGHHHH
Let’s take an example (it’s page 25, for those of you playing along at home):
IEEE LOM 5.3: Interactivity Level
Explanation:
The degree of interactivity characterizing this learning object. Interactivity in this context refers to the degree to which the learner can influence the aspect or behavior of the learning object. NOTE 1:–Inherently, this scale is meaningful within the context of a community of practice.
Value space:
very low
low
medium
high
very high
Example:
NOTE 2:–Learning objects with 5.1:Educational.InteractivityType=”active” may have a high interactivity level (e.g., a simulation environment endowed with many controls) or a low interactivity level (e.g., a written set of instructions that solicit an activity). Learning objects with 5.1:Educational.InteractivityType=”expositive” may have a low interactivity level (e.g., a piece of linear, narrative text produced with a standard word processor) or a medium to high interactivity level (e.g., a sophisticated hyperdocument, with many internal links and views).
Now my questions are – and I mean this literally, in the literal sense of literally:
Who cares?
What value does this description have to a user?
What do the values actually mean? (And no, I don’t see much value in the stated CoE proviso.)
Who uses the term ‘hyperdocument’?
(I want special credit for not using the even less meaningful field 5.4, ‘semantic density’, but I will award five points and a star to anyone who can guess what that means.)
I’m leery of any descriptive metadata that is not user-meaningful on it’s face. My issue with this, however, is different – by providing definitions in the first place, this schema tries to introduce the idea that level of interactivity is an attribute that a learning object can meaningfully have, and by implication, that learning can have. I disagree – I don’t think that that is an accurate way to describe learning content, let alone a useful one.
In terms of usefulness – can you imagine a teacher poring over a database of content muttering ‘well this is grand, but I really need something with an interactivity level of at least ‘high’? I can’t. That’s why I say it’s not useful.
In bite-size:
Learning is probably the most sophisticated/complex thing that human beings do.
The more sophisticated/complex the learning is, the less it can be described using schemas and controlled vocabularies.
Sophisticated/complex learning is the best kind – and therefore the kind we want to support with learning content the most.
LOM is fading away, but the idea behind it – that the often intangible learning outcomes supported by learning content both can (I disagree) and should (I disagree more) be described in structured metadata. This idea pops up in the projects like CELEBRATE and MELT and Ariadne and ReSIST (and ReSIST, if I’m honest, I had never heard of before today).
Educational concepts aren’t like self-raising flour and basting and baking. They defy attempts to encapsulate them. The various curricula of the world can’t even decide if ‘social science’ and ‘social studies’ are equivalent*, so there’s little hope for ‘interactivity level’, ‘difficulty’, or even ‘learning resource type’.
So when it comes to creating stable definitions for educational concepts, well – a lot of the time, I don’t think we should.
Coda:
I have a lot of hope for the LRMI specification, especially with its use of DC terms and (more importantly) the backing of schema.org. Where Things are included, they are included at a high level of abstraction: ‘alignmentType’ has pretty sensible values like assesses, teaches, requires, and the apparently-meaningful-but-I’ve-never-heard-of-it textComplexity.
But I note that even here, we have fields where no fields should really go - does ‘interactivityType:mixed’ mean anything to you?
I didn’t think so.
*As it turns out, they’re not.
Previous post: Van Halen: the greatest QA testers of all time
Next post: Cambridge! Are you ready to ROCK?!*
{ 11 comments… read them below or add one }
I think it’s telling that Class Clips (as it’s relevant to the discussion!) doesn’t do much beyond broad categorisation, along with a very loose “learning-oriented narrative” (i.e., “suggestions for classroom use”) which is aimed at a particular audience.
I think there’s a danger in this kind of thing in attempting to model the world in intricate detail without a real understanding of what people actually do, need, or want to get out of that modelling. From my perspective, I just want a way to represent (relatively) unambiguously the information which is already there. If you can, in a rather fractal-like fashion, drill down from there then that’s great, but it’s not necessary in order to do cool stuff.
If you take this sort of top-down approach, you have the advantage of already knowing the problem-space, the desirable outcomes, and the limits of what you need to do in order to achieve that — anything else is nice to haves. Well, in theory. In practice it’s almost certainly going to be a bit more complicated than that, but it does give you a safe place to fall back to if all the deep modelling starts to seem just a little too abstract…
Interesting stuff. Generally, I agree – having previously worked on LEDM/SMEF/whatever-you-want-to-call-it, I too am wary of any hugely complicated uber-model to rule them all. http://www.bbc.co.uk/guidelines/smef/ if you want to see…
However, I think there’s a difference with the Linked Data/Web approach. In a way, it’s not actually about describing something. It’s more about identifying distinct things, and those things can then have relationships/labels. So we don’t all have to agree that a carrot is an ingredient, or that ‘improvisation’ is a competency (to make one up out of thin air, appropriately) – it’s more that we’ve identified that competencies *are* things that we want to be able to point at.
..and I’d tie this to the domain-driven-design approach – you only really choose to identify things that users can relate to. So ‘interactivity level’ may not be something that we feel the audience can relate to. However, I’d argue that there is something useful there – it’s just that the label may be wrong. I could imagine a teacher saying “I need something for my class to do which is pretty interactive.” (the exact wording, maybe not, but the sentiment, the concept that they’re trying to express, is valid, I think.
Linked Data etc isn’t about everyone agreeing on the definition of things – it’s about identifying discrete things, expressing them in a structured way. So your definition of a competency can be different from mine, that’s OK. But it’s important to know that thing X over here is something you’re calling a competency. I can then look up what you mean by that, if I want.
I guess overall I’m confident that there’s stuff out there we can say ‘these are types of things within the sphere of education that people can point at’ and/or ‘the things we’re interested in when we talk about educational stuff, are as follows…’.
Even the more intangible ones, someone’s defined them as discrete things – Y is an idea for using this resource in a classroom, Z is an ability someone should gain whilst taking this course.
But I’m rambling a bit now, and I’m not in my own area of expertise with education. Suffice to say, that I agree that describing learning is tricky, that complex, huge models are generally less useful than anything else, but that one approach around this is to establish what’s possible, what can exist in the world, what concepts people can use to describe things, and leave the ‘things being described’ to others…
Yup – ace comments.
Mo, to pick up on your comment – “I think there’s a danger in this kind of thing in attempting to model the world in intricate detail without a real understanding of what people actually do, need, or want to get out of that modelling.”
You’ll correct me if I’m wrong, but it sounds to me like that statement is predicated on the assumption ‘a model is possible’.
That’s the point I’m not convinced about. To quote some guy my husband mentioned to me one time, ‘all models are wrong – but some are useful’.
I think that, especially within domain driven design, we all tend towards a natural belief that the more accurate in describing a domain a model is, the more useful it is. My argument is
a) An accurate model for learning might just be impossible
But
b) That might not actually matter
…in all seriousness, what would happen if we acknowledged the impossibility o ‘accurate’ and flipped the scales? If we gave ‘useful’ the priority over ‘accurate’?
I’m not saying we should, I’m just saying… well, what would happen?
Oh, and Paul: First – my unfavourite schemas weren’t linked data-y (not by a long chalk) but my Shining Hope LRMI is. I like linked data! Really I do!
But to follow up on ‘Linked Data etc isn’t about everyone agreeing on the definition of things – it’s about identifying discrete things’. That is actually a huge amount of power. The writers of LOM decided that ‘interactivity type’ was a thing, and – Lo! – it was rendered a Thing.
Was it a Thing before they said it was a Thing? Probably not. ‘Semantic density’ sure wasn’t.
The problem is, complex learning doesn’t lend itself to Thingification. The simpler the learning, the easier it is to Thingify, but (BIG but) that’s also true vice versa. So my problem is – by trying to Thingify sophisticated learning, do we inadvertently not just misrepresent it, but in fact make it less sophisticated?
…and that’s where I see the danger.
(I just thought of something – did you read ‘a Wizard of Earthsea?’ (http://en.wikipedia.org/wiki/A_Wizard_of_Earthsea) it’s kind of like that – the power to Name the Things is the power to Control the World. It’s a huge power, and you don’t use it often, because every time you do, you are going to Change Things but things will not do what you expected/wanted them to. Or I’m trying yo make my work sound more interesting. Could be that.)
“Reality is it’s own best representation”- yay go cliche me.
There’s a real problem in trying to ascribe a rigorous learning centric metadata schema to material for learning, and that is that ANYTHING can be learning material. Learning is at its most powerful and most pervasive the simple act of intellectually engaging with a complex world. As the power of a metadata schema is inversely proportional to the breadth of it’s applicability, one might therefore say that any learning centric schema applied to the totality of all possible learning objects is so weak and loose as to be almost worthless.
This may seem to be a mildly eccentric philosophical argument, but for the fact that if one tries to use a complex schema to run a learning environment one will unavoidably have bound to that environment, and arguably it is at and beyond that bound that more useful learning happens. So straight away your environment stops just when the learning starts.
Much better approach is to say ‘let’s explore the world and learn stuff, but understand that learning is a feature of us as humans, as social animals and possibly as corporate entities like classes, clubs and schools, and let the world just be.
Not sure I’ve contributed to this, but yeah, there you go.
To quote:
“I think that, especially within domain driven design, we all tend towards a natural belief that the more accurate in describing a domain a model is, the more useful it is. My argument is
a) An accurate model for learning might just be impossible
But
b) That might not actually matter
…in all seriousness, what would happen if we acknowledged the impossibility o ‘accurate’ and flipped the scales? If we gave ‘useful’ the priority over ‘accurate’?”
I think we’re in furious agreement
As far as I’ve used DDD (and it’s certainly never been a strict thing..) I’ve never thought that the drive is to go for an accurate model, useful-ness definitely FTW. I guess I’m coming from the POV that it’s (nearly) always good to model *something*, just to give it at least a bit of structure.
In summary – (almost) always model, accept that your model will never be right/perfect, and make sure that what you choose to model is useful.
I’d never seen the LOM layout before, but milliseconds after it attacked my retina, I thought how similar it is to highly useful tools like this org chart for heaven.
Zoe, seems like we share a fascination for the memex, but have a slightly different appreciation of LOM
In ARIADNE, together with our GLOBE (http://globe-info.org/) partners, we have collected slightly more than 800.000 learning objects for ‘share and reuse’.
In order to enable learners and teachers to find something useful in that abundance, we developed a simple search tool – our “finder” (http://ariadne.cs.kuleuven.be/finder/ariadne/).
One cannot make much sense of content without metadata and we found LOM very suitable for our purpose…
Ant –
‘As the power of a metadata schema is inversely proportional to the breadth of it’s applicability’.
Word. That’s not esoteric, that’s what I was trying to say (but not as succinctly). I’m keeping that.
Hi Eric, thanks for that link back to Ariadne!
It’s a very comprehensive collection. If you’re able to tell me, I would be very interested to know how much use that service is getting, and what testing you used to verify that the search infrastructure was working for teachers. Is that information available?
{ 1 trackback }