Skip to content

14. Measuring the impact of the crowd

14. Measuring the impact of the crowd published on No Comments on 14. Measuring the impact of the crowd

Over the past few weeks, I’ve been posting cartoons I drew for Measuring the Networked Nonprofit: Using Data to Change the World, by Beth Kanter and Katie Delahaye Paine. I blogged about the book a while ago on Social Signal, explaining why I love it.

This is the final cartoon in the series. So go buy a copy right now so Katie and Beth will have to write another book! And then make effective measurement one of your new year’s resolutions.

>>> *** <<<

Chapter 14 is the conclusion, and it’s both the most inspiring and the scariest part of the book. Inspiring, because it’s about your organization’s fundamental goals. And scary, because it’s about whether you’re achieving them – or, in the inspired words of a New Yorker cartoon, whether it’s “just so much pointing and clicking.”

Maybe that’s ultimately why so many of us still resist measurement. The warm, furry comfort of thinking we might be making progress is a lot more alluring than the threat of cold, clammy certainty that we’ve been spinning our wheels. Not that we’d make that calculation consciously; it just makes us that much more willing to postpone thinking about something as big and daunting as a measurement strategy.

Which is why Beth and Katie’s book is important. Really important.

It’s important because it breaks the enormous idea of a measurement strategy into far more manageable pieces, each with its own practical steps and potential wins. And for managers and leaders who can never seem to set aside a huge chunk of time and attention, that means a chance to at least take the first step, and then the second… until you’ve made enough progress to make a more ambitious commitment to measurement possible. (Crawl, walk, run, fly, as Beth says.)

And it’s important because while we do need a little fear to push us — when the monster in the closet is real, pretending it’s imaginary doesn’t work — we also need the pull of inspiration. In case after case, Katie and Beth show us how using measurement in an intelligent, thoughtful way can mean we have more impact, in terms of genuine meaningful change.

We can identify the tactics that aren’t working and redirect their resources to tactics than do; we can take strategies built on wishful thinking and ground them in certainty. And whether we measure the resulting progress in lives saved, jobs created, houses built, animals rescued, crimes prevented, wells dug, gardens tilled, hectares set aside for conservation, families lifted out of poverty or children united with new parents, we can know – know – that we are changing the world.

Have a fantastic, inspiring and measurable 2013.

13. I can see right through your nonprofit!

13. I can see right through your nonprofit! published on No Comments on 13. I can see right through your nonprofit!

Over the past few weeks, I’ve been posting cartoons I drew for Measuring the Networked Nonprofit: Using Data to Change the World, by Beth Kanter and Katie Delahaye Paine. I blogged about the book a while ago on Social Signal, explaining why I love it.

There’s only one more cartoon left to post! Quick, go buy a copy right now so Katie and Beth will have to write another book!

12. Influence

12. Influence published on No Comments on 12. Influence

Over the next several days, I’m posting cartoons I drew for Measuring the Networked Nonprofit: Using Data to Change the World, by Beth Kanter and Katie Delahaye Paine. I blogged about the book a while ago on Social Signal, explaining why I love it and why I think you should go buy a copy right now.

11. My God, it’s full of nodes!

11. My God, it’s full of nodes! published on No Comments on 11. My God, it’s full of nodes!

Over the next several days, I’m posting cartoons I drew for Measuring the Networked Nonprofit: Using Data to Change the World, by Beth Kanter and Katie Delahaye Paine. I blogged about the book a while ago on Social Signal, explaining why I love it and why I think you should go buy a copy right now.

↑
N
|
W———•———E
|
S

Chapter 11 is called “Understanding, Visualizing and Improving Networks,” is your introduction to the world of network analysis. That’s a dry-sounding term for a truly juicy topic: mapping and understanding your organization’s network of support and attention.

Why juicy? Because mapping your network takes an abstract concept and makes it visual – and once it’s visual, you can draw sudden, unexpected, profound insights.

For example, thanks to that map of Middle Earth on the opening pages of my copy of The Lord of the Rings trilogy, I knew long before any of the other characters that one really doesn’t simply walk into Mordor. (Also, that a horse-drawn wagon had jacknifed on the Old Forest Road and that drivers should take alternate routes to Mirkwood.)

Possibly more relevant is your ability to see who the hubs and influencers in your network are, and who’s on the periphery – where growth can take off. You can find gaps, identify weak and strong ties, and start measuring the value of your network. You can use something as sophisticated as an Excel plug-in, or as low-tech and analog as sticky notes.

Best of all, you can have a perfectly rational reason to create one of those Carrie-Mathison-style walls-of-clues-and-connections of your own. (Disclaimer: this is insufficient justification for doing this on behalf on your organization. But what you do on your own time is your own business.)

10. How many hectares is that relationship?

10. How many hectares is that relationship? published on No Comments on 10. How many hectares is that relationship?

Over the next several days, I’m posting cartoons I drew for Measuring the Networked Nonprofit: Using Data to Change the World, by Beth Kanter and Katie Delahaye Paine. I blogged about the book a while ago on Social Signal, explaining why I love it and why I think you should go buy a copy right now.

<3 <3 <3

Chapter 10 takes you into advanced measurement, starting with how you measure relationships. Relationships are at the heart of social media; they’re the nucleus around which all else revolves. You can’t make the piñata of change without the papier maché of relationships – and yes, that metaphor is available for re-use under a Creative Commons license. You’re welcome.

But how do you measure relationships, and the value they offer? The book points to the surprisingly straightforward approach pioneered by professors James and Larissa Grunig, and how organizations can apply it to their own relationships. And as for value…

“Make a friend before you need one,” my communications mentor Dennis McGann used to tell me, and two anecdotes from the book bear his wisdom out: one, the online conversation that ensued after the accidental death of a SeaWorld trainer, and two, the way the American Red Cross was able to turn a Twitter misfire into a fundraising opportunity.

The latter incident saw a staffer tweet about getting drunk on Dogfish Head’s Midas Touch beer. Normally, that would be fine, except the employee used the official Red Cross account, which usually uses hashtags like #hurricane or #relief, and not – let me just check the spelling – #gettngslizzerd.

The organization responded swiftly, deleting the tweet but also explaining it wittily. Dogfish Head, meanwhile, encouraged its followers to donate to the Red Cross. They raised nearly $10,000, briefly crashing the Red Cross server and helping #gettngslizzerd to trend on Twitter.

The lesson is clear: when life gives you lemons, make beer.

9. Meowtrics and measurement: using your data to change the world

9. Meowtrics and measurement: using your data to change the world published on No Comments on 9. Meowtrics and measurement: using your data to change the world

Over the next several days, I’m posting cartoons I drew for Measuring the Networked Nonprofit: Using Data to Change the World, by Beth Kanter and Katie Delahaye Paine. I blogged about the book a while ago on Social Signal, explaining why I love it and why I think you should go buy a copy right now.

/\/\    __/
=ºi º= /
 ww--ww

In Chapter 9, “Measurement and the Aha! Moment: Using Your Data to Tell Stories, Make Decisions and Change the World”, the rubber really hits the road. And because we’re changing the world, both the rubber and the road are made from reclaimed and recycled materials; the vehicle is electrically driven and charged from a wind-turbine-powered grid; and it’s actually not on the road at all because we’re taking modern commuter rail instead.

This is where you dive into the data and find actionable insights.

Roy Neary serves dinner

Side effects of reading this chapter include dramatic improvements in organizational effectiveness, and a compulsion to construct bar graphs out of Cheerios at the breakfast table – kind of like Roy Neary in Close Encounters of the Third Kind, only with data visualizations rather than perfectly-scaled replicas of Devil’s Tower.

And as with Roy Neary, your loved ones will still think you’re nuts, and your living room will end up filled with mud and the neighbours’ shrubs. (Actually, the mud may just be because I’ve misconfigured Google Analytics.)

In fact, one of the more exciting things you can find is a Devil’s Tower-shaped plateau in your metrics: not just a short-lived spike, but a significant, sustained increase in some measurable variable that matters to you. One such Devil’s Tower led Beth to start regularly posting Fun Geeky Friday Shares on her Facebook Page.

Also in this chapter, Katie makes a pretty compelling case that measurement is hawt.

8. Someone’s Looking at You: The Fine Art of Measuring

8. Someone’s Looking at You: The Fine Art of Measuring published on No Comments on 8. Someone’s Looking at You: The Fine Art of Measuring

Over the next several days, I’m posting cartoons I drew for Measuring the Networked Nonprofit: Using Data to Change the World, by Beth Kanter and Katie Delahaye Paine. I blogged about the book a while ago on Social Signal, explaining why I love it and why I think you should go buy a copy right now.

___ ___ < • > < • >

Chapter 8, “Measurement Tools: How to Choose and Use the Right Tool for the Job,” will break your heart in two short sentences:

Many nonprofits think that fancy analytics or monitoring software will provide them with actionable information with just a click or two. This is seldom the case.

Dang. (By which I mean something less family-friendly.)

Fortunately, the work involved in turning data into insight can be actual fun. Katie and Beth walk you through choosing the tools to use (web analytics? a survey? content analysis?) depending on your goals and strategy, with an overview for each one. The section on surveys alone may be brief, but it’s worth the price of the book for anyone who’s been fumbling uncertainly with SurveyMonkey and wondering why they get such poor results.

Meanwhile, allow me to deploy a tool of my own to better understand my readers. By completing this survey, you’ll be entered to win a… um… uh… another cartoon tomorrow.

7. Me dot org

7. Me dot org published on No Comments on 7. Me dot org

Over the next several days, I’m posting cartoons I drew for Measuring the Networked Nonprofit: Using Data to Change the World, by Beth Kanter and Katie Delahaye Paine. I blogged about the book a while ago on Social Signal, explaining why I love it and why I think you should go buy a copy right now.

$

Chapter 7 is titled “How to Turn Your Stakeholders into Fundraisers: Social Fundraising and How Measurement Can Make It More Effective”. (After seeing an early outline, I wanted to call it “Turning Philanthropy into Philanthro-we“. How history might have changed if I’d ever hit “send” on that email.)

Beth and Katie suggest defining social fundraising as “people asking personal networks to give support.” If you’ve ever had a Facebook notification that a friend suggested you donate to a particular organization on Causes, or seen any of the endlessly inventive campaigns run by supporters of charity: water, you’ve seen social fundraising.

And it can work well. But taking it beyond just “let’s ask our supporters to put a widget on their blogs” requires fundraising expertise, social savvy, some decent technical chops… and smart measurement. If the Obama campaign’s message and tactics seemed to be constantly evolving, it’s because they were – in response to the data they’d analyze obsessively over what kind of appeals worked on whom, when, and under what conditions. (To put it in terms that I can relate to, “The Borg have adapted to our multi-phasic shielding, Captain – their last three appeals got through untouched and caused major donations on Decks 12 through 15.”)

Warbler as seen through a telescope
Flickr photo: Yellow-throated warbler by hart_curt

Segmenting your audience is key, too. Katie and Beth look at how Blue State Digital’s segmentation strategy dramatically boosted the chances that an email appeal from Autism Speaks would get opened by its recipient. (I love segmentation purely on the strength of the names marketers like to give their segments: “Furious Experimenters,” “Jazz-Inflected Repeat Adolescents” and “Regret-Tinged Revenge-Seekers”. Half of them sound like they were lifted from the pages of an Audubon field guide; come to think of it, the notes that accompany segmentation reports often have that observed-from-inside-a-bird-blind feel to them.)

And as the authors point out, the return you get won’t just be in the form of credit card authorizations. You’ll have a larger, more engaged network of supporters, ready to take actions ranging from advocacy to, potentially, organizational leadership.

(An aside: Turning stakeholders into fundraisers was thought for a long time to be fraught with danger. Sure, you’d probably get some lovely networked fundraising… but what if it went wrong? What if you ended up with fund-holders and stake-raisers? Almost inevitably, pundits warned, you’d have an angry stake-wielding crowd chasing people holding fistfuls of cash. But then it actually happened, and was called Occupy Wall Street. It turns out that crowd just uses their stakes to hold up hand-lettered banners and enormous effigies representing leading economists from the Austrian School, chanting “Hey hey, ho ho, slavish adherence to the ideas of Eugen Böhm von Bawerk has got to go!”)

6. “OMG, what happened to you?!” “I fell off our engagement ladder.”

6. “OMG, what happened to you?!” “I fell off our engagement ladder.” published on No Comments on 6. “OMG, what happened to you?!” “I fell off our engagement ladder.”

Over the next several days, I’m posting cartoons I drew for Measuring the Networked Nonprofit: Using Data to Change the World, by Beth Kanter and Katie Delahaye Paine. I blogged about the book a while ago on Social Signal, explaining why I love it and why I think you should go buy a copy right now.

|_|
|_|
|_|
|_|
| |

Chapter 6 is titled “The Ladder of Engagement: How to Measure Engagement and Use It to Improve Relationships with Your Stakeholders”. The authors walk us through the idea of online engagement that draws users into increasingly greater and more meaningful actions. You might start by following an organization on Twitter, then commenting on their blog, then making a small donation, and then giving them your house and becoming their Executive Director, and wondering how all of this happened in just three minutes. (That, friends, is what great interaction design can do.)

With some organizations, it really isn’t a ladder so much as a step-stool. They have a very limited number of roles for their supporters, and can’t really imagine how they could possible accommodate someone who’d like to work outside those boundaries. “Oh, you’d, uh, you’d like to get more involved (gulp) beyond writing a cheque every year. (gasp, pant) That’s great, that’s just wonderful. (ragged, rapid breathing) Could, could you please hand me that paper bag to breathe into for a moment? Never mind – I’ll be fine. Gosh, the room’s lovely when it spins like that. (thud)” For them, there’s Beth’s previous book (cowritten with Allison Fine), The Networked Nonprofit

5. A theory of change we can believe in

5. A theory of change we can believe in published on No Comments on 5. A theory of change we can believe in

Over the next several days, I’m posting cartoons I drew for Measuring the Networked Nonprofit: Using Data to Change the World, by Beth Kanter and Katie Delahaye Paine. I blogged about the book a while ago on Social Signal, explaining why I love it and why I think you should go buy a copy right now.

-<  ºº>•
”   “

(That little separator was intended to be a hamster. So now you know why my preferred drawing tool is a stylus and not a keyboard.)

Chapter 5 is titled “Don’t confuse activity with results,” which ought to cause us all some deep-seated soul-searching. It’s so easy to fall into patterns of behaviour, trot out the same shopworn tactics for campaign after campaign, and never ask the basic question, “Is this actually getting us anywhere?”

Katie and Beth say it’s time we held our activity accountable. (Giant puppets at protest rallies, tremble; you may have just heard your death knell.) And they recommend placing that activity in the context of a theory of change: a causal chain that begins with your tactics and ends – we hope! – with some measurable progress toward your goal.

A theory of change allows you to demonstrate the value of something like social media, where returns can be indirect and qualitative, resisting easy conversion to a dollar value – but which may be every bit as valuable as a cashier’s cheque. Beth and Katie (whom I may start calling “Kanter and Paine,” because it sounds like either a Broadway musical-writing duo or a don’t-f*ck-with-us law firm) prefer that to talking about ROI, an accounting term that often doesn’t capture the value in network- and relationship-building.

That’s an excellent reason to develop a theory of change. Here’s mine: it’s a powerful tool for motivating people, especially if they’re skeptical that what you’re asking them to do will have an impact. Your supporters, volunteers or staff may be asking “Why will this e-petition work when every other one I’ve signed had no impact?” or “I’ve never posted an online video before. Why should I believe it will make any difference?” A theory of change can be the story of just how their action will help to change things — and can inspire them to tweak their action for maximum impact.