Repealing Reg's law

While I recognize that it’s not very fashionable to complain about being quoted out of context in this era of “You didn’t build that” I’m going to take a run at it nonetheless.  Back on July 12 in a post about the MRMW Conference I noted that we are moving into an era when data will be plentiful, cheap and of uncertain quality. If your MR business features high quality data as the key differentiator then you are in for a tough time because clients will not be looking for data, clients will be looking for smart people who can filter through all of those data and help put them to work in their companies. 

My buddy Jeffrey Henning seized on one sentence in that post and tweeted Reg’s law: “Clients will buy good data over cheap data every time.”  That’s not the point I was trying to make. Edward Appleton, a client-side researcher, more or less took Jeffrey to task in his blog and rightfully noted that my post was much more balanced than that single out-of-context quote might suggest.

All that aside, what was I getting at?  As I wrote in a subsequent post, “Good research balances evidence and insight.”  Too often in contemporary MR the quality of the evidence is not what we might wish it to be.  That’s not going to change.  So it is more important than ever to evaluate evidence, understand its strengths and its weaknesses and characterize it correctly.  Clients need to be able to judge the quality of our work and the only way they can do that is if we are completely transparent about what we have done, being forthcoming about the limits the evidence imposes on what we can conclude.

Transparency is a long-held value of the research profession as it is with any discipline that claims to be scientific in its methods.  Today we are competing against new entrants in our industry whose values and skills are primarily entrepreneurial and often at odds with the traditional values of our profession.  Transparency is one of those values.

At MRMW there was a panel session on social media that got bogged down in a discussion about “benchmarks” that at its root was really about transparency.   At one point a somewhat exasperated client-side researcher blurted out, “Social media does not predict behavior!”  Apparently someone had told him that it did.