More ways of using Cynefin in evaluation

October 13, 2011

There is strong tendency in the evaluation field right now to treat everything as if it were complex. In my view that is both incorrect and wasteful. Most evaluations cover situations that have simple, complicated and complex aspects. Methods designed to understand complex aspects are generally far more expensive and time consuming than simple aspects. Therefore Cynefin can help me design much more cost effective evaluations. For those aspects of a situation that fall within the simple domain, I can identify cheap reliable methods of data collection and analysis. For complicated aspects, often using single or multiple ToCs, I can identify rather more expensive but appropriate methods of data collection and analysis. For the remaining aspects that are complex there are few, often quite expensive methods in terms of time and cash but at least I am focusing them where they need to. These can be guided by a Theory of Action or at least a set of “when X happens do Y” set of rules. So this ontological aspect of Cynefin is invaluable to me. However, in this blog I want to reflect on the value in evaluation of the epistemological aspects of Cynefin.

If you read Rick Davies’ comments on my last blog he mentioned that models were, essentially, representations of reality. Taking this slightly further you could say that the purpose of models is to reflect reality in a way that helps us cope with it. It is something very poorly understood within the evaluation field, which tends to use models as squashed down versions of reality. Let me explain with an example commonly used to help describe the difference between simple, complicated and complex aspects of a situation. It is often said that “baking a cake” is a simple endeavour, sending a rocket to the moon is a complicated endeavour and bringing up a child is a complex one. I’ll deal with child rearing at another time, but for now let’s think about the cake. I was originally trained as a biologist and my knowledge of physics and chemistry tells me that baking a cake is most certainly not a simple matter. It is a complicated perhaps even complex process. Yet we have developed simple models to make it possible to prepare something you can stand a candle on without a degree in biochemistry and atmospheric physics. It’s known as a recipe. We know it’s not perfect and that sometimes we end up with a gooey brown mess but it works most of the time and we accept that. We are treating this complicated situation as if were simple and mostly getting away with it.

This slipperiness of how we see things and what they may be has other uses. I was once running a workshop in Scotland using the Cynefin framework to evaluate activities relating to health care for the rural isolated elderly. I’d just done the Post-It business and there was a shout from the room. Turns out that two participants, both experts and senior in their trade, had put the same aspect of the rural elderly health care situation into two different quadrants; one complex and one complicated. It took us very little time to reveal that they had understood the that situation quite differently and consequently their approaches to manage it were at odds with each other. The two senior medics went into a huddle and within ten minutes had come to a resolution. It wasn’t that either was right or wrong, or that the allocation to the Cynefin quadrants were right or wrong, or even that the model underpinning Cynefin was flawed. It was just that Cynefin had been used in an epistemological manner – as something that generated useful learning.

This epistemological use of models is often poorly understood, especially in the evaluation field. The evaluation field tends to argue whether its models reflect reality rather then whether they are “useful”. So I find Cynefin helpful in softening this orientation. At some stage in a Cynefin based process someone, somewhere, will always ask what happens when the same thing appears in two or more quadrants. It’s a good question, and because I come from the “appreciative” end of the systems field (that subsequently led to soft and critical systems approaches) one I am familiar addressing. However, Cynefin stops me waving my arms around in some vague manner and allows me to point directly to a framework that illustrates the point that how we frame things determines how we respond to things. Evaluators like to reify, they like to have their feet on solid ground. It’s in their blood. It’s the field’s great strength and its greatest weakness. Cynefin helps solidify ground that might otherwise be too marshy.

Enough about Cynefin, the next blogs will be meditations on the trials and tribulations of using Sensemaker within an evaluation context. A bit of a challenge it turns out.

One response to “More ways of using Cynefin in evaluation”

  1. Colin Dyas says:

    I love the cake analogy, but there is another version to buying the book, the ingridients, and the oven before applying the processes of food chemistry. We can collect cake crumbs, bring them together and in doing so create something that is cake-like and collective. Quite a few markets operate by collecting lots of crumbs. As you say, neither method is right or wrong. Its a different way of seeing a problem. One is traditional. One is adaptive. In either case – let them eat cake! Great post – as ever….

Leave a Reply

Your email address will not be published. Required fields are marked *

Recent Posts

About the Cynefin Company

The Cynefin Company (formerly known as Cognitive Edge) was founded in 2005 by Dave Snowden. We believe in praxis and focus on building methods, tools and capability that apply the wisdom from Complex Adaptive Systems theory and other scientific disciplines in social systems. We are the world leader in developing management approaches (in society, government and industry) that empower organisations to absorb uncertainty, detect weak signals to enable sense-making in complex systems, act on the rich data, create resilience and, ultimately, thrive in a complex world.

Cognitive Edge Ltd. & Cognitive Edge Pte. trading as The Cynefin Company and The Cynefin Centre.


< Prev

Two challenges and a puzzle

Let's recap. The evaluation field tends to use things called “Logic Models” to assess and ...

More posts

Next >

Sensemaker and Evaluation

My last blog was sent from the Air New Zealand transfer lounge in LA. This ...

More posts

linkedin facebook pinterest youtube rss twitter instagram facebook-blank rss-blank linkedin-blank pinterest youtube twitter instagram