This is Care Opinion [siteRegion]. Did you want Care Opinion [usersRegionBasedOnIP]?

How many stories is enough?

Update from Care Opinion

Posted by on

 

picture of James Munro

 

Two weeks ago we held a very lively North of England stakeholder event in Sheffield. And, in the course of what was a very stimulating and enjoyable day, there was one brief exchange between a speaker and a participant which really made me think.

Jane Danforth, involvement manager at Nottinghamshire Healthcare NHS Trust, was speaking about the impact of Patient Opinion in the trust. And Helen Forrester, the manager of B50, one of the trust's adult mental health inpatient wards, talked about how using Patient Opinion had changed the culture of her ward. (Their slides are available.)

One of the participants asked how many stories the trust received through Patient Opinion. Jane pointed to the figure on the slide - "259".

"Oh, so 259 per month?"

"No", said Jane. "259 since we started."

The questioner - and one or two others - looked rather taken aback.

And that was the moment the proverbial light bulb above my head went on. That was exactly the point: it wasn't that Helen had seen significant changes in her ward culture despite there being only 259 stories across the trust. It was that just 259 stories (and many fewer specifically about ward B50) on a public web site had been enough to help her change the culture in important ways. That was all it took.

Of course, everyone (including me) is used to thinking that we need thousands of responses to surveys to tell us anything reliable. But here were worthwhile changes in culture and practice in the wake of a much smaller number of stories.

The point was underlined later in the day, when Steve Eastwood, a commissioner of drug and alcohol services in the North West, talked about how the stories they had received through Patient Opinion were helping them commission better services. (Slides available.)

How many stories? 78.

So there's the question: how many stories is enough? And, of course, we know the answer: enough for what?

It all depends on what you want to achieve. What are your objectives? Why do you want to hear the experiences of patients and carers?

If your objective is to measure (as it so often is in the NHS, where "listening" and "measuring" seem to be used almost interchangeably), and compare those measures between times or places, then yes, you will need a lot of responses to gain the precision and certainty you need.

But if your objective is to change culture, empower patients, prompt staff reflection, or improve services, then on the evidence of Jane, Helen and Steve it seems that a very much smaller number of stories - coupled with an understanding of how to use them - may be more than enough.

At last, I'm starting to understand why we talk about the power of stories.

 

Response from PaulH on

Thanks for a great blog James. As you point our lots of people naturally assume that the more stories the better. This is for two reasons – neither of which actually applies to Patient Opinion. Staff who work in the NHS know that in many cases having a bigger sample size means greater accuracy. This is absolutely true for much evidence-based care and for things like the National Patient Survey which aims to be objective and allow comparison across services or time. But Patient Opinion is about [b]implementation [/b]not measurement and here small really can be beautiful: If a single story changes the world that's fantastic - and what is more it is really cost-effective! But the other reason people think that size matters is due to the way the web works. If someone tells you 'My video on YouTube has been viewed 22,000 times' or 'Stephen Fry has a million followers on Twitter' and then you naturally think Wow! because here size does matter. But this does not apply to stories on Patient Opinion: If you're telling the story of your mum's stay in the John Radcliffe Hospital all you want is for just the right people at the trust, CCG and HealthWatch to see it and respond. Then you're happy. Of course if Patient Opinion was funded by adverts for, say, medical negligence lawyers, the number of eyeballs would matter because eyeballs equals clicks on banner ads and clicks equal money. But then Patient Opinion would not be Patient Opinion.

This blog post is closed to responses.