Article Synopsis: “Tips on Measuring Crucial Social Factors in New Product Research”

Quirk's CoverQuirk’s August 2014

By Briana Brownell

Let’s compare plastic and reusable grocery bags. There are several differences, but one is this: your choice of bag says something about you. Although you might prefer getting them at the store over carrying your own, reusable bags communicate, “I’m eco-friendly! I care about the earth! I recycle!” In other words, when it comes to determining which type of bag people will carry—and really, most consumer behavior in general—social factors are important to consider. For example, some would even argue that we cannot completely trust survey results reflecting self-reported socially desirable behaviors.

Consumer behavior about new products or product categories are often hard to anticipate for many reasons, but one that is often overlooked is social factors. According to author Briana Brownell, the success of some new products heavily depends on social factors which are often undetectable during concept-testing. Failure to recognize these factors may blindside companies, causing unnecessary overspending on advertising or inventory.

However, not all products are equally influenced by social effects. So, as market researchers, how do we know when these factors do play an important role? Brownell says that, “the qualities of the product being launched determine which social elements may be relevant to integrate into a research program.” Here are four important guidelines:

  • Is seeing someone else use or recommend the product the key to adoption? Awareness and word of mouth are most important for certain kinds of products. In her article, Brownell explains which types are most likely to fall under this category.
  • Does adoption depend on the number of users? For example, social networks will only catch on if people sense that there will be widespread adoption. If no one is using Facebook, what is the point of joining?
  • Is adoption socially acceptable? If not, perceptions must be changed before the product is adopted. Often, adoption by change agents and opinion leaders gives the right signal to the masses.
  • Do product reviews aid adoption decisions? People often use others as shortcuts in their purchase decisions. Brownell discusses when peer or expert opinions are sought.

Social factors are always important to consider, yet when it comes to new product research, the stakes of ignoring them are even higher. To minimize the risk of overly-rosy market research, researchers should work to uncover which specific social factors play into the situation at hand and address them during the research process—or at least consider them when interpreting and reporting key findings. For more of Brownell’s tips, read her article here:

This article was written by Research Rockstar intern Sarah Stites. Sarah is a student at Grove City College, and is a member of the Research Rockstar Scholarship program for college students.



Are Market Researchers Creating the Functional Equivalent of genetically modified food?

CoverScreenshot-rev-210x261Have you ever had the nagging feeling that a research project collected data that was simply not very good? That the respondents weren’t adequately engaged when supplying answers? Or that the method didn’t gather enough meaningful context?

In market research, our convention is to conduct studies that employ imposed calibration.  Our studies often capture and measure attitudes and behaviors, as if they could all be sorted into neat packages. We carefully structure our questions, and in the case of survey research, even our answers. We use quotas, we use weighting.  But are we creating the functional equivalent of genetically modified food?

For some research needs (some, not all), it is time to think about options other than surveys, IDIs and focus groups. New methods such as webcam research, idea voting sites and online projective methods, to name just a few.

But newer market research methods are unpredictable and can compromise on demographic profiling—just like organic produce sometimes has a few more blemishes or less consistent coloring.  And these differences can make us research types uncomfortable. Heck, it makes me uncomfortable. But now that I have had the opportunity to test some of these new methods, I am also excited about their value.

My experiences have also let me to author a short white paper, “Organic Market Research: Avoiding Overly Contrived Data.” Please click here to download it.



SANTA DOESN’T LIVE HERE: Don’t Oversell Market Research

Imagine a six year old who truly believes Santa grants all wishes. Even though he lives in a sixth-floor Chicago walkup, this child firmly believes Santa will come down the (nonexistent) chimney and leave a pony under the Christmas tree. Imagine the tears on Christmas morning when there’s no pony.

Most of us have experienced the feeling of being oversold, whether in business or in our personal lives. It’s painful. And it’s the last thing you want your internal colleagues, team members, or other associates to feel at the end of a market research project. Unfortunately, it happens. Maybe the results were unexpected, maybe the scope or methodology ended up being somewhat different than what they’d pictured. For whatever reason, the people who should have joyfully embraced your research results are unhappy. And after you’ve invested weeks or months of effort, time, and money, unhappy internal clients are the last thing you want.

How can we avoid this outcome? Be careful not to oversell market research. Those of us who do market research professionally tend to get enthusiastic. We are typically people who enjoy designing and implementing research methodologies, who like to dive into mounds of data and extract meaningful results. In our enthusiasm for research, we have to be careful not to over-promise. Realistic expectations are the key to satisfied clients, especially for riskier types of projects.


Product Concept Testing Example: What We Can and Cannot Promise

Product concept testing can be designed to help identify product ideas or feature combinations that have the highest potential share of the market. Key word: potential.

But there are challenges with product concept testing research. Sometimes people can’t respond to particular product concepts that are too new or innovative. They don’t have a frame of reference, so it is just too hypothetical. Henry Ford once said, “If I’d asked people what they wanted, they would have said a faster horse.”

Even in more mature categories, product concept testing research has limits. After all, a lot of research depends on asking people about their attitudes and behaviors, and even well-intentioned participants cannot report such information perfectly.

What can we promise about product concept testing that is realistic? We could design the project and promise we will:

  • prioritize features
  • prioritize among multiple new concepts
  • identify likely tradeoffs between features and price
  • estimate a demand elasticity curve
  • weed out blatantly bad ideas
  • identify potential demand deterrents or sales objections to a particular product concept

We also need to let colleagues know that there are many factors beyond our control. A major competitor may come out with a new product that influences purchase criteria. A new entrant may come out with a big splash and disrupt brand preferences. A shift in the economic environment could change price sensitivities.

Product concept testing research is still very worthwhile (and far better than not doing any at all), but it is an example of the type of project that has inherent limitations. It’s always better to do some research than none, but we don’t want to over-sell it.


Bottom line

If you’re doing market research on a project that is known to be risky in terms of how well it can predict actual customer attitudes and behaviors, you have two key steps to take:

  1. Consider augmenting survey research with other methodologies.
    Social media monitoring? A prediction market? Ethnography? Rapid prototype testing?
  2. Set realistic expectations. First, be certain that internal clients have realistic expectations about what they can and can’t expect. Let them know that inconclusive, contrary, or contradictory results can come up. If they do, it may require further research or the use of other methods—all of these things are part of the real world.

With realistic expectations, people will have the right mindset. We won’t have to worry about disappointing them in the end, and that saves everybody a lot of aggravation.

So don’t even try to be an all-powerful Santa. If that pony won’t be trotting out from under the tree, make it clear in advance. That city child would be happier with a shiny new bicycle anyway.


For more on Social Media Research, sign up for Research Rockstar’s White Paper on the subject.

Want access to more market research articles and training materials? Sign up for the Research Rockstar newsletter: SIGNUP


Computer-Based Training for Market Research Excellence

Computer-based training (CBT), also known as eLearning, is a time-efficient, cost-effective training option for busy professionals.

Self-paced Learning

Research Rockstar classes are self-paced. Watch when you want, pause when you want, re-start when you want.

Easy Access

Anyone with internet access and a browser can access a class. No travel!

Low-cost alternative to in-person seminars

Not everyone has the time, or money, to attend 2-day seminars out-of-state. CBT removes geographic boundaries to learning.


Learn what you want, when you want. So many seminars seem to throw in a mind-numbing mix of tangential content to fill up their 2 or 3 day agendas. With CBT, we can offer very precise topics so you can get what you need, and quickly.

Market Research Training

Whether you think of it as computer-based training, eLearning, or whatever, the idea of accessing learning material over the Internet is powerful. Research Rockstar is dedicated to offering convenient access to practical content. Plus, because the material is all online, it can be easily customized if your team has special interests.

[We offer classes on market segmentation, product concept testing and many more. Buy a single class, or sign up for an annual membership]


When Good Enough is Good Enough: Seeking Balance in Product & Pricing Research

The difference between good market research and great market research can be significant.

But sometimes the incremental time, cost and sweat of that extra effort simply doesn’t make sense. Sometimes, “good” is just perfect.

I was reminded of this last week at the Launch Camp conference in Cambridge. The event, for entrepreneurs seeking social media wisdom, had some interesting speakers; the one from whom I learned the most was Dharmesh Shah, Chief Technology Officer and Founder of HubSpot (on Twitter as @Dharmesh).

In three years, this company has gone from start-up to 2,000+ customers, most of whom pay a monthly fee. Dharmesh shared his start-up success insights at Launch Camp and advised the attending entrepreneurs to focus on practical marketing. Selling stuff. Tracking key metrics to understand what sells stuff. And in his case, this clearly works.

He observes that many entrepreneurs get bogged down by over-analyzing their decisions—ultimately missing their window of opportunity. Key areas for such analysis paralysis? Product optimization and pricing.

ACK! Product concept testing and pricing research are two key pillars of market research practices around the world! But of course, he is correct. Especially in the context of new or rapidly evolving product categories.

Product Concept Testing

Market research offers proven methods for testing new product concepts—methods that can prioritize features or optimize feature-price combinations. And that’s great.

But I have seen companies completely miss windows of opportunity because they kept adding on less-than-critical features before they would launch. Kept conducting more and more research to inform (or justify) their decisions. Their leaders traded early market feedback for an over-engineered product. Dharmesh chastised this approach and emphasized that while market research is useful, at some point you need actual market feedback in order to inform further improvements. The ultimate feedback: will people buy it? If they buy it, will they return it?

Of course, these days, there are ways to simulate actual product releases to do this—although that is not a realistic option for all categories.

Pricing Research

Look, if you are talking about mature consumer product categories (like toothpaste and laundry detergent), pricing research is a very defined, concrete sort of practice. But in many B2B markets, emerging markets, and new product categories, it simply isn’t perfect. Yes, do some research. Do some primary research, analyze competitive/substitute pricing, understand your target market’s overall budget, know your expected ROI. But at some point you have to take a leap with pricing. And as Dharmesh said, despite long-held tenets to the contrary, you CAN adjust your pricing down the road.

Imperfect Data is Better Than No Data

Yes, it is true—imperfect data is better than no data. And sometimes, directional data sooner is better than quantitative data later.  In any case, knowing when to stop conducting market research in order to price and release new products can be tricky. Luckily for busy professionals seeking to inform product and pricing decisions, there are many options along the continuums of research speed and exactitude.

BTW, Dharmesh has a book out—I ordered my copy and can’t wait to read it: Inbound Marketing.

[Would you rather take one market research class for $2000 or get unlimited access to 12 online for $600/year? Or how about 5 for FREE? I thought so!  Sign up for a Research Rockstar membership today:]

[For more info on Launch Camp search #LaunchCamp on Twitter for great links to blogs, RTs and even videos from the event]