I had an interesting conversation on Twitter earlier with a friend of mine, Jon (who I should say is one of the brainiest guys I have ever met... and quick to learn!). His questions were centered on ROI and whether it should be the only thing that mattered when one designs a campaign.
Now, I really wouldn't venture into getting into a debate with him - since he's a PhD in Marketing. But I thought his questions were interesting.
Photo from heytherespaceman on Flickr
If we didn't measure ROI, then what's the point of spending?
We've always believed that marketing - like any other corporate funds - are investments. They are being 'spent' to create value for the shareholder. If a certain line on the corporate expenditure accounts didn't serve any purpose, then it shouldn't be there, right? We might as well save it for something else.
Returns of marketing investments should therefore be measured.
But should ROI, then dictate the plan and its executions?
That's a deeper question, really - which brings us back to my previous post on whether communications and media planning were an art or a science. My answer is, yes... but.
And it's a big but.
We have to clarify exactly what we mean by returns. Are we talking about returns on investments in the form of savings and additional value? Are we talking about returns in the form of being talked about in digital communities and vox-pops and forums? Are we talking about returns in awareness and genuine affinity and likeability towards the brand? Are we talking about products being purchased off the shelves? Are we talking about users of the competitive-brands moving to ours? Or our competitors falling in love more deeply with our brand?
Because ROI is on the verge of becoming another 'buzz-word' - like "engagement".
Everybody wants ROI. But everybody has got a different view of what ROI is and should be. And therefore should be clarified.
Brand managers have their own ROIs - salary increments and perhaps,
that promotion to AGM position. CMOs have their own KPIs - perhaps, that golden parachute and more stock options or discounted stocks, and eventual accession to become the CEO. CEOs have their own ROIs - stock prices, analyst ratings, and well, a positive disposition from the board.
Because ROI is 'bandied' around - and is almost always mentioned in every and any meeting between client ang agencies - it is bound to lose its meaning.
(An aside: When I was working on a fast-moving consumer good which shall go unnamed, their KPI measurement for their planning agency was "savings generated" - the same KPI for their buying agency because "that is ROI for all media investments"!)
So ROI - or ROMI or ROAI or iROI or iROMI or iROAI or ROMA or iROMA - needs be clear.
And every one needs to be aligned on what it is.
Lest it becomes another buzzword - "important but meaningless".
But ROI is only a number; how many ideas and campaigns have been killed because its ROI cannot be ensured because pretest scores are bad?
It is indeed only a number - but it is a number that should inspire, encourage, and motivate - not restrain and constrain.
We have this habit of looking at numbers as if they were a manifestation of God (with all due respect to physicists and mathematicians - and well, gnostics). But I see numbers as guideposts.
People don't like the ad during the pretest? Rather than dwell on the score, ask why. What is it about it that makes it so... wrong? Why is it unlikeable to this particular person? Why is it unlikeable to this particular group?
Most pretests are run on groups and/or on people. And usually in the form on unfinished TVCs. Surely, they cannot appreciate the beauty of the idea in a rough form. And the fact that you have convened them into a room (however natural, comfortable, open that room is...) have put them in a different mode altogether.
The more important thing about pretest scores is "Why is this not working on this paticular person or this particular group?" Any self-respecting pre-test moderator would want to explore that!
Turning the question around: How many ideas and campaigns have been killed because they have not been tested and their ROI potentials unmeasured?
Which - I believe - is also a valid question: Just how many ideas, campaigns, thoughts, executions have been killed because they have not been invested into properly because they were not measured, they were not subjected to some form of indicative pretest?
It is again back to "numbers versus gut" - "art versus science".
So what now?
In statistics and econometrics, we have a concept called the "error". Whilst statisticians and econometricians think of the "error term" differently, the term is there in models to remind us - constantly - that we cannot ensnare every single thing with numbers.
In econometrics, "error terms" are sometimes called "innovations". (Let's not get into the technical details for now...)
And that could exactly be that: we can derive all the numbers and formulas that we want, create stringent benchmarks and tests and questionnaires and surveys... but we will never really capture reality - the audiences' reality.
It doesn't mean the stats and the formulas are wrong: it's just that, well, it's incomplete. And it can never be complete.
Because that's the nature of numbers.
ROI? Yes. Testing? Yes. Measuring post-campaign effects? Yes.
But they are your tools - you're not theirs.