Previous month:
April 2014
Next month:
August 2014

Posts from June 2014

Innovate or ?

I spent most of this week in Atlanta at the Insight Innovation Exchange. All I can say is, “Whew!” There must have been 100 presentations over the three days, most a merciful 20 minutes with a few meatier 40 minute sessions mixed in. Coming on the heels of MRMW in Chicago just two weeks ago I am in a serious state of information overload.

To state the obvious, the whole point of this event was to showcase innovation in MR. It impressed me as a sort of MR version of the Consumers Electronics Show, and I mean that as a compliment. Several years ago (I can’t remember exactly when) I was interviewed by ESOMAR’s Research World on the topic of, “Is market research innovative enough?” (I said I thought it was.) Then again, several of the conferences I’ve attended over the last couple of years had speakers worrying about us not innovating enough. I am hard pressed to imagine anyone coming away from Atlanta believing that there is not enough innovation in market research.

But there is a catch and a couple of panel sessions brought that home: the take up rate with clients is nowhere near what some would expect given the explosion of new techniques. The innovation funnel is full if not overflowing, but other than a few home runs like mobile and communities, not much is filtering down to the mainstream (forgive the mixed metaphor).

One reason for that, I believe, is that many of these innovations are being driven by entrepreneurs from outside of MR whose main focus is the technologies themselves, rather than a clear understanding of clients’ unmet needs. Clients will always listen to faster andFallInLove cheaper, but so far they don’t seem to have found the rest of the value proposition offered by most of these innovations all that compelling.

 I heard Innovation guru Clayton Christensen mentioned more than once but no one offered up my favorite quote from The Innovator’s Dilemma. “Customers control what companies can and cannot do.” There was a lot of navel gazing in Atlanta, and I did my share, but getting to know our clients better might move us farther faster.

A bad survey or no survey at all?

For a whole lot of reasons that I won’t go into online privacy suddenly is front and center, not just in the research industry, but in the popular press as well. The central message is that people are “concerned,” but about what exactly and by how much, well the answers there are all over the map. One of the few clear things about this whole debate, if that’s what it is, is the ongoing misuse of online surveys to describe what is going on.

I am hard pressed to think of anything sillier than using online surveys to help us understand attitudes about online privacy. Think about it. You have a sample of people who have signed up to share their personal behavior, attitudes, and beliefs in online surveys. What in God’s name could possibly make us think that these online extroverts, this sliver of the population, could possibly represent the range of attitudes about online privacy among “consumers” as generally alleged?  MisinformationIf ever there was an example of an issue where online is not fit to purpose, this is it. Yet these surveys are churned out weekly, generally to serve the commercial interests of whoever commissioned them, and often widely cited as some version of the truth.

To quote H. L. Mencken, “A newspaper is a device for making the ignorant more ignorant and the crazy crazier.” Sometimes it feels like online surveys serve a similar purpose.


Whither mobile?

I spent two days last week in Chicago at Market Research in the Mobile World (MRMW). I now have been to all four of the North American versions of this event, all the way back to Atlanta in 2011. Last week’s iteration caused me to go back and look at my post about the Atlanta event as a way to gauge how much things may or may not have changed.

One obvious change was the sorting out of marketing applications from genuine research. In Atlanta we heard from too many companies whose business was collecting personal data for direct marketing, and not always transparently. As far as I could tell, the presenters in Chicago were primarily focused on research. A second change was the emphasis on case studies. Atlanta was mostly about the potential for mobile—what could be—while Chicago was mostly actual studies completed.

Atlanta also was heavy on hype and there was plenty of that over the two days in Chicago, including a fair amount on the potential of wearbles. But it was hard to get too worked up about any of it given the sobering start.

  • The first presentation was a paen to mobile as “the most important marketing channel, ever” that included the claim that 55% of people really like targeted ads, a figure undermined by virtually every credible survey on online privacy.
  • That was followed by an update on last year’s eye-popping announcement by General Mills that they hoped to be doing 80% of their research via mobile in 2014. No exact figure was given but it was clear that it turned out to be harder than they thought. They have dismantled their mobile team,  but they keep on plugging.
  • The segment was closed out with a panel of industry heavyweights on the topic, “Investments in (mobile) MR—where are they going and why?” The answer: they are not. The money is all going to big data analytics.

That was followed by about 30 presentations with an overwhelming emphasis on pure mobile applications: in-the-moment, geolocation, and mobile ethnography (as opposed to the unintended mobiles that comprise the bulk of mobile MR right now). Some were genuinely interesting and others seemed like sales pitches. The highlights and lowlights in no particular order:

  • There were a couple of nice papers on the topic of integrating mobile with other platforms as a way to understand the context in which people view different ads.
  • I heard no discussion of the sampling challenges beyond a preliminary report from TNS aimed at allaying concerns about bias in online surveys that include respondents using mobile devices. One might have gotten the impression from most presentations that there is 100% smartphone penetration and people are willing to use them to do pretty much anything researchers ask them to do.
  • The potential power of mobile ethnography was nicely demonstrated by several presentations.
  • There was a somewhat bizarre though seemingly heartfelt epilogue to one presentation pleading with us not to be swayed by the media into giving up on Google Glass.
  • There was an equally bizarre presentation on mobile’s ability to reduce social desirability bias and satisficing that opened with the presenter acknowledging that all he knew about the phenomena was what he learned from their Wikipedia entries. It seemed to be just another study on recall.
  • There continues to be some sloppiness around proper privacy protections, especially in mobile ethnography. There was a panel on the topic (I was on it) but less than half of the attendees were in the room.
  • A number of presentations took up the theme of respondent-driven design that emphasized better interfaces, choice of channel, and better-designed if not shorter surveys. On this latter topic, one presenter showed that a well-designed 15-minute survey is possible with no discernible data quality drop off.  No doubt music to the ears of clients (of which there were very few) and even researchers who cling to long surveys like an NRA member clings to his assault rifle.

My bottom line is that things have changed substantially since Atlanta, but nowhere near as much as mobile evangelists predicted. Mobile has become mostly an extension of online, and while there is no shortage of startups offering in-the-moment and other pure mobile solutions there also are no clear signs yet of research buyers flocking to them. Mobile has changed substantially how we interact with one another and the world around us. It must be a fundamental concern in every research design, but it has yet to truly transform MR in any meaningful way.