There are many traps for the unwary in the practice of analytics, which I take to be the process of developing actionable insights through problem definition and the application of statistical models. The technical traps are most obvious but the epistemological traps are better disguised.
That these traps exist and are seemingly not recognised in the commercial and corporate rhetoric around analytics worries the more philosphically-minded; Virginia Tech’s Garner Campbell has shared some clear and well-received thoughts on the potential for damaging reductionism in Learning Analytics. I particularly like Anne Zelenka’s blogged reaction to Gardner’s LAK12 MOOC (I believe there is a recording but elluminate recordings don’t seem to play on linux) and my colleague Sheila has also blogged on the topic.
I don’t see reduction as being the issue per se but careless reductionism and failing to remember that our models are surrogates for what might be does worry me. Analytics does give us power for “myth busting” and a means to reduce the degree to which anecdote, prejudice and the opinion of the powerful determines action but let us be very wary indeed.
This all reminded me of the following poem by my favourite poet and mythographer, Robert Graves. Let us be slow.
In Broken Images
He is quick, thinking in clear images;
I am slow, thinking in broken images.
He becomes dull, trusting to his clear images;
I become sharp, mistrusting my broken images,
Trusting his images, he assumes their relevance;
Mistrusting my images, I question their relevance.
Assuming their relevance, he assumes the fact,
Questioning their relevance, I question the fact.
When the fact fails him, he questions his senses;
When the fact fails me, I approve my senses.
He continues quick and dull in his clear images;
I continue slow and sharp in my broken images.
He in a new confusion of his understanding;
I in a new understanding of my confusion.
Robert Graves
Hi Adam
How apt!
As a Friday aside, I was reading Graves biography a couple of years ago on a plane, and when the gentleman sitting next to me spotted it, he told me about a weekend in 1972, in Barcelona when he pretended to be Graves . . .
As always, Graves gets to the heart of the matter. Analytics may give us the power of “myth busting” but are we also beginning to seeing a mythos forming around analytics? Let us be slow and sharp indeed.
Perfect. More “broken images” please – they’re much more interesting…
Thanks for this, very much to the point.
I’m currently WFH, about a mile from Graves’ house as the seagull flies, and delighted to be able to make the connection!
Graves can be satisfied with charting the confusion, but we have to wrestle with the consequences. Confusion resulting from applying over simplistic ideas to a complex system may lead to enthusiastic searching for people to blame when the system fails to perform as expected, while “a new understanding of my confusion” brings with it the danger of paralysis.
Which brings to mind me the over-quoted but still resonant lines from Yeats
The best lack all conviction, while the worst
Are full of passionate intensity.
If we are concerned about these issues, we need some way to show that the broken image is a better guide than a detailed but misconceived map. The messenger will not be popular in some quarters!