marketing research project work

Are you an agency specialized in UX, digital marketing, or growth? Join our Partner Program

Learn / Blog / Article

Back to blog

How to do market research in 4 steps: a lean approach to marketing research

From pinpointing your target audience and assessing your competitive advantage, to ongoing product development and customer satisfaction efforts, market research is a practice your business can only benefit from.

Learn how to conduct quick and effective market research using a lean approach in this article full of strategies and practical examples. 

Last updated

Reading time.

A comprehensive (and successful) business strategy is not complete without some form of market research—you can’t make informed and profitable business decisions without truly understanding your customer base and the current market trends that drive your business.

In this article, you’ll learn how to conduct quick, effective market research  using an approach called 'lean market research'. It’s easier than you might think, and it can be done at any stage in a product’s lifecycle.

How to conduct lean market research in 4 steps

What is market research, why is market research so valuable, advantages of lean market research, 4 common market research methods, 5 common market research questions, market research faqs.

We’ll jump right into our 4-step approach to lean market research. To show you how it’s done in the real world, each step includes a practical example from Smallpdf , a Swiss company that used lean market research to reduce their tool’s error rate by 75% and boost their Net Promoter Score® (NPS) by 1%.

Research your market the lean way...

From on-page surveys to user interviews, Hotjar has the tools to help you scope out your market and get to know your customers—without breaking the bank.

The following four steps and practical examples will give you a solid market research plan for understanding who your users are and what they want from a company like yours.

1. Create simple user personas

A user persona is a semi-fictional character based on psychographic and demographic data from people who use websites and products similar to your own. Start by defining broad user categories, then elaborate on them later to further segment your customer base and determine your ideal customer profile .

How to get the data: use on-page or emailed surveys and interviews to understand your users and what drives them to your business.

How to do it right: whatever survey or interview questions you ask, they should answer the following questions about the customer:

Who are they?

What is their main goal?

What is their main barrier to achieving this goal?

Pitfalls to avoid:

Don’t ask too many questions! Keep it to five or less, otherwise you’ll inundate them and they’ll stop answering thoughtfully.

Don’t worry too much about typical demographic questions like age or background. Instead, focus on the role these people play (as it relates to your product) and their goals.

How Smallpdf did it: Smallpdf ran an on-page survey for a couple of weeks and received 1,000 replies. They learned that many of their users were administrative assistants, students, and teachers.

Next, they used the survey results to create simple user personas like this one for admins:

Who are they? Administrative Assistants.

What is their main goal? Creating Word documents from a scanned, hard-copy document or a PDF where the source file was lost.

What is their main barrier to achieving it? Converting a scanned PDF doc to a Word file.

💡Pro tip: Smallpdf used Hotjar Surveys to run their user persona survey. Our survey tool helped them avoid the pitfalls of guesswork and find out who their users really are, in their own words. 

You can design a survey and start running it in minutes with our easy-to-use drag and drop builder. Customize your survey to fit your needs, from a sleek one-question pop-up survey to a fully branded questionnaire sent via email. 

We've also created 40+ free survey templates that you can start collecting data with, including a user persona survey like the one Smallpdf used.

2. Conduct observational research

Observational research involves taking notes while watching someone use your product (or a similar product).

Overt vs. covert observation

Overt observation involves asking customers if they’ll let you watch them use your product. This method is often used for user testing and it provides a great opportunity for collecting live product or customer feedback .

Covert observation means studying users ‘in the wild’ without them knowing. This method works well if you sell a type of product that people use regularly, and it offers the purest observational data because people often behave differently when they know they’re being watched. 

Tips to do it right:

Record an entry in your field notes, along with a timestamp, each time an action or event occurs.

Make note of the users' workflow, capturing the ‘what,’ ‘why,’ and ‘for whom’ of each action.

Don’t record identifiable video or audio data without consent. If recording people using your product is helpful for achieving your research goal, make sure all participants are informed and agree to the terms.

Don’t forget to explain why you’d like to observe them (for overt observation). People are more likely to cooperate if you tell them you want to improve the product.

💡Pro tip: while conducting field research out in the wild can wield rewarding results, you can also conduct observational research remotely. Hotjar Recordings is a tool that lets you capture anonymized user sessions of real people interacting with your website. 

Observe how customers navigate your pages and products to gain an inside look into their user behavior . This method is great for conducting exploratory research with the purpose of identifying more specific issues to investigate further, like pain points along the customer journey and opportunities for optimizing conversion .

With Hotjar Recordings you can observe real people using your site without capturing their sensitive information

How Smallpdf did it: here’s how Smallpdf observed two different user personas both covertly and overtly.

Observing students (covert): Kristina Wagner, Principle Product Manager at Smallpdf, went to cafes and libraries at two local universities and waited until she saw students doing PDF-related activities. Then she watched and took notes from a distance. One thing that struck her was the difference between how students self-reported their activities vs. how they behaved (i.e, the self-reporting bias). Students, she found, spent hours talking, listening to music, or simply staring at a blank screen rather than working. When she did find students who were working, she recorded the task they were performing and the software they were using (if she recognized it).

Observing administrative assistants (overt): Kristina sent emails to admins explaining that she’d like to observe them at work, and she asked those who agreed to try to batch their PDF work for her observation day. While watching admins work, she learned that they frequently needed to scan documents into PDF-format and then convert those PDFs into Word docs. By observing the challenges admins faced, Smallpdf knew which products to target for improvement.

“Data is really good for discovery and validation, but there is a bit in the middle where you have to go and find the human.”

3. Conduct individual interviews

Interviews are one-on-one conversations with members of your target market. They allow you to dig deep and explore their concerns, which can lead to all sorts of revelations.

Listen more, talk less. Be curious.

Act like a journalist, not a salesperson. Rather than trying to talk your company up, ask people about their lives, their needs, their frustrations, and how a product like yours could help.

Ask "why?" so you can dig deeper. Get into the specifics and learn about their past behavior.

Record the conversation. Focus on the conversation and avoid relying solely on notes by recording the interview. There are plenty of services that will transcribe recorded conversations for a good price (including Hotjar!).

Avoid asking leading questions , which reveal bias on your part and pushes respondents to answer in a certain direction (e.g. “Have you taken advantage of the amazing new features we just released?).

Don't ask loaded questions , which sneak in an assumption which, if untrue, would make it impossible to answer honestly. For example, we can’t ask you, “What did you find most useful about this article?” without asking whether you found the article useful in the first place.

Be cautious when asking opinions about the future (or predictions of future behavior). Studies suggest that people aren’t very good at predicting their future behavior. This is due to several cognitive biases, from the misguided exceptionalism bias (we’re good at guessing what others will do, but we somehow think we’re different), to the optimism bias (which makes us see things with rose-colored glasses), to the ‘illusion of control’ (which makes us forget the role of randomness in future events).

How Smallpdf did it: Kristina explored her teacher user persona by speaking with university professors at a local graduate school. She learned that the school was mostly paperless and rarely used PDFs, so for the sake of time, she moved on to the admins.

A bit of a letdown? Sure. But this story highlights an important lesson: sometimes you follow a lead and come up short, so you have to make adjustments on the fly. Lean market research is about getting solid, actionable insights quickly so you can tweak things and see what works.

💡Pro tip: to save even more time, conduct remote interviews using an online user research service like Hotjar Engage , which automates the entire interview process, from recruitment and scheduling to hosting and recording.

You can interview your own customers or connect with people from our diverse pool of 200,000+ participants from 130+ countries and 25 industries. And no need to fret about taking meticulous notes—Engage will automatically transcribe the interview for you.

4. Analyze the data (without drowning in it)

The following techniques will help you wrap your head around the market data you collect without losing yourself in it. Remember, the point of lean market research is to find quick, actionable insights.

A flow model is a diagram that tracks the flow of information within a system. By creating a simple visual representation of how users interact with your product and each other, you can better assess their needs.

You’ll notice that admins are at the center of Smallpdf’s flow model, which represents the flow of PDF-related documents throughout a school. This flow model shows the challenges that admins face as they work to satisfy their own internal and external customers.

Affinity diagram

An affinity diagram is a way of sorting large amounts of data into groups to better understand the big picture. For example, if you ask your users about their profession, you’ll notice some general themes start to form, even though the individual responses differ. Depending on your needs, you could group them by profession, or more generally by industry.

We wrote a guide about how to analyze open-ended questions to help you sort through and categorize large volumes of response data. You can also do this by hand by clipping up survey responses or interview notes and grouping them (which is what Kristina does).

“For an interview, you will have somewhere between 30 and 60 notes, and those notes are usually direct phrases. And when you literally cut them up into separate pieces of paper and group them, they should make sense by themselves.”

Pro tip: if you’re conducting an online survey with Hotjar, keep your team in the loop by sharing survey responses automatically via our Slack and Microsoft Team integrations. Reading answers as they come in lets you digest the data in pieces and can help prepare you for identifying common themes when it comes time for analysis.

Hotjar lets you easily share survey responses with your team

Customer journey map

A customer journey map is a diagram that shows the way a typical prospect becomes a paying customer. It outlines their first interaction with your brand and every step in the sales cycle, from awareness to repurchase (and hopefully advocacy).

The above  customer journey map , created by our team at Hotjar, shows many ways a customer might engage with our tool. Your map will be based on your own data and business model.

📚 Read more: if you’re new to customer journey maps, we wrote this step-by-step guide to creating your first customer journey map in 2 and 1/2 days with free templates you can download and start using immediately.

Next steps: from research to results

So, how do you turn market research insights into tangible business results? Let’s look at the actions Smallpdf took after conducting their lean market research: first they implemented changes, then measured the impact.

Implement changes

Based on what Smallpdf learned about the challenges that one key user segment (admins) face when trying to convert PDFs into Word files, they improved their ‘PDF to Word’ conversion tool.

We won’t go into the details here because it involves a lot of technical jargon, but they made the entire process simpler and more straightforward for users. Plus, they made it so that their system recognized when you drop a PDF file into their ‘Word to PDF’ converter instead of the ‘PDF to Word’ converter, so users wouldn’t have to redo the task when they made that mistake. 

In other words: simple market segmentation for admins showed a business need that had to be accounted for, and customers are happier overall after Smallpdf implemented an informed change to their product.

Measure results

According to the Lean UX model, product and UX changes aren’t retained unless they achieve results.

Smallpdf’s changes produced:

A 75% reduction in error rate for the ‘PDF to Word’ converter

A 1% increase in NPS

Greater confidence in the team’s marketing efforts

"With all the changes said and done, we've cut our original error rate in four, which is huge. We increased our NPS by +1%, which isn't huge, but it means that of the users who received a file, they were still slightly happier than before, even if they didn't notice that anything special happened at all.”

Subscribe to fresh and free monthly insights.

Over 50,000 people interested in UX, product,
 digital empathy, and beyond, receive our newsletter every month. No spam, just thoughtful perspectives from a range of experts, new approaches to remote work, and loads more valuable insights. If that floats your boat, why not become a subscriber?

I have read and accepted the message outlined here: Hotjar uses the information you provide to us to send you relevant content, updates and offers from time to time. You can unsubscribe at any time by clicking the link at the bottom of any email.

Market research (or marketing research) is any set of techniques used to gather information and better understand a company’s target market. This might include primary research on brand awareness and customer satisfaction or secondary market research on market size and competitive analysis. Businesses use this information to design better products, improve user experience, and craft a marketing strategy that attracts quality leads and improves conversion rates.

David Darmanin, one of Hotjar’s founders, launched two startups before Hotjar took off—but both companies crashed and burned. Each time, he and his team spent months trying to design an amazing new product and user experience, but they failed because they didn’t have a clear understanding of what the market demanded.

With Hotjar, they did things differently . Long story short, they conducted market research in the early stages to figure out what consumers really wanted, and the team made (and continues to make) constant improvements based on market and user research.

Without market research, it’s impossible to understand your users. Sure, you might have a general idea of who they are and what they need, but you have to dig deep if you want to win their loyalty.

Here’s why research matters:

Obsessing over your users is the only way to win. If you don’t care deeply about them, you’ll lose potential customers to someone who does.

Analytics gives you the ‘what’, while research gives you the ‘why’. Big data, user analytics , and dashboards can tell you what people do at scale, but only research can tell you what they’re thinking and why they do what they do. For example, analytics can tell you that customers leave when they reach your pricing page, but only research can explain why.

Research beats assumptions, trends, and so-called best practices. Have you ever watched your colleagues rally behind a terrible decision? Bad ideas are often the result of guesswork, emotional reasoning, death by best practices , and defaulting to the Highest Paid Person’s Opinion (HiPPO). By listening to your users and focusing on their customer experience , you’re less likely to get pulled in the wrong direction.

Research keeps you from planning in a vacuum. Your team might be amazing, but you and your colleagues simply can’t experience your product the way your customers do. Customers might use your product in a way that surprises you, and product features that seem obvious to you might confuse them. Over-planning and refusing to test your assumptions is a waste of time, money, and effort because you’ll likely need to make changes once your untested business plan gets put into practice.

Lean User Experience (UX) design is a model for continuous improvement that relies on quick, efficient research to understand customer needs and test new product features.

Lean market research can help you become more...

Efficient: it gets you closer to your customers, faster.

Cost-effective: no need to hire an expensive marketing firm to get things started.

Competitive: quick, powerful insights can place your products on the cutting edge.

As a small business or sole proprietor, conducting lean market research is an attractive option when investing in a full-blown research project might seem out of scope or budget.

There are lots of different ways you could conduct market research and collect customer data, but you don’t have to limit yourself to just one research method. Four common types of market research techniques include surveys, interviews, focus groups, and customer observation.

Which method you use may vary based on your business type: ecommerce business owners have different goals from SaaS businesses, so it’s typically prudent to mix and match these methods based on your particular goals and what you need to know.

1. Surveys: the most commonly used

Surveys are a form of qualitative research that ask respondents a short series of open- or closed-ended questions, which can be delivered as an on-screen questionnaire or via email. When we asked 2,000 Customer Experience (CX) professionals about their company’s approach to research , surveys proved to be the most commonly used market research technique.

What makes online surveys so popular?  

They’re easy and inexpensive to conduct, and you can do a lot of data collection quickly. Plus, the data is pretty straightforward to analyze, even when you have to analyze open-ended questions whose answers might initially appear difficult to categorize.

We've built a number of survey templates ready and waiting for you. Grab a template and share with your customers in just a few clicks.

💡 Pro tip: you can also get started with Hotjar AI for Surveys to create a survey in mere seconds . Just enter your market research goal and watch as the AI generates a survey and populates it with relevant questions. 

Once you’re ready for data analysis, the AI will prepare an automated research report that succinctly summarizes key findings, quotes, and suggested next steps.

An example research report generated by Hotjar AI for Surveys

2. Interviews: the most insightful

Interviews are one-on-one conversations with members of your target market. Nothing beats a face-to-face interview for diving deep (and reading non-verbal cues), but if an in-person meeting isn’t possible, video conferencing is a solid second choice.

Regardless of how you conduct it, any type of in-depth interview will produce big benefits in understanding your target customers.

What makes interviews so insightful?

By speaking directly with an ideal customer, you’ll gain greater empathy for their experience , and you can follow insightful threads that can produce plenty of 'Aha!' moments.

3. Focus groups: the most unreliable

Focus groups bring together a carefully selected group of people who fit a company’s target market. A trained moderator leads a conversation surrounding the product, user experience, or marketing message to gain deeper insights.

What makes focus groups so unreliable?

If you’re new to market research, we wouldn’t recommend starting with focus groups. Doing it right is expensive , and if you cut corners, your research could fall victim to all kinds of errors. Dominance bias (when a forceful participant influences the group) and moderator style bias (when different moderator personalities bring about different results in the same study) are two of the many ways your focus group data could get skewed.

4. Observation: the most powerful

During a customer observation session, someone from the company takes notes while they watch an ideal user engage with their product (or a similar product from a competitor).

What makes observation so clever and powerful?

‘Fly-on-the-wall’ observation is a great alternative to focus groups. It’s not only less expensive, but you’ll see people interact with your product in a natural setting without influencing each other. The only downside is that you can’t get inside their heads, so observation still isn't a recommended replacement for customer surveys and interviews.

The following questions will help you get to know your users on a deeper level when you interview them. They’re general questions, of course, so don’t be afraid to make them your own.

1. Who are you and what do you do?

How you ask this question, and what you want to know, will vary depending on your business model (e.g. business-to-business marketing is usually more focused on someone’s profession than business-to-consumer marketing).

It’s a great question to start with, and it’ll help you understand what’s relevant about your user demographics (age, race, gender, profession, education, etc.), but it’s not the be-all-end-all of market research. The more specific questions come later.

2. What does your day look like?

This question helps you understand your users’ day-to-day life and the challenges they face. It will help you gain empathy for them, and you may stumble across something relevant to their buying habits.

3. Do you ever purchase [product/service type]?

This is a ‘yes or no’ question. A ‘yes’ will lead you to the next question.

4. What problem were you trying to solve or what goal were you trying to achieve?

This question strikes to the core of what someone’s trying to accomplish and why they might be willing to pay for your solution.

5. Take me back to the day when you first decided you needed to solve this kind of problem or achieve this goal.

This is the golden question, and it comes from Adele Revella, Founder and CEO of Buyer Persona Institute . It helps you get in the heads of your users and figure out what they were thinking the day they decided to spend money to solve a problem.

If you take your time with this question, digging deeper where it makes sense, you should be able to answer all the relevant information you need to understand their perspective.

“The only scripted question I want you to ask them is this one: take me back to the day when you first decided that you needed to solve this kind of problem or achieve this kind of a goal. Not to buy my product, that’s not the day. We want to go back to the day that when you thought it was urgent and compelling to go spend money to solve a particular problem or achieve a goal. Just tell me what happened.”

— Adele Revella , Founder/CEO at Buyer Persona Institute

Bonus question: is there anything else you’d like to tell me?

This question isn’t just a nice way to wrap it up—it might just give participants the opportunity they need to tell you something you really need to know.

That’s why Sarah Doody, author of UX Notebook , adds it to the end of her written surveys.

“I always have a last question, which is just open-ended: “Is there anything else you would like to tell me?” And sometimes, that’s where you get four paragraphs of amazing content that you would never have gotten if it was just a Net Promoter Score [survey] or something like that.”

What is the difference between qualitative and quantitative research?

Qualitative research asks questions that can’t be reduced to a number, such as, “What is your job title?” or “What did you like most about your customer service experience?” 

Quantitative research asks questions that can be answered with a numeric value, such as, “What is your annual salary?” or “How was your customer service experience on a scale of 1-5?”

 → Read more about the differences between qualitative and quantitative user research .

How do I do my own market research?

You can do your own quick and effective market research by 

Surveying your customers

Building user personas

Studying your users through interviews and observation

Wrapping your head around your data with tools like flow models, affinity diagrams, and customer journey maps

What is the difference between market research and user research?

Market research takes a broad look at potential customers—what problems they’re trying to solve, their buying experience, and overall demand. User research, on the other hand, is more narrowly focused on the use (and usability ) of specific products.

What are the main criticisms of market research?

Many marketing professionals are critical of market research because it can be expensive and time-consuming. It’s often easier to convince your CEO or CMO to let you do lean market research rather than something more extensive because you can do it yourself. It also gives you quick answers so you can stay ahead of the competition.

Do I need a market research firm to get reliable data?

Absolutely not! In fact, we recommend that you start small and do it yourself in the beginning. By following a lean market research strategy, you can uncover some solid insights about your clients. Then you can make changes, test them out, and see whether the results are positive. This is an excellent strategy for making quick changes and remaining competitive.

Net Promoter, Net Promoter System, Net Promoter Score, NPS, and the NPS-related emoticons are registered trademarks of Bain & Company, Inc., Fred Reichheld, and Satmetrix Systems, Inc.

Related articles

6 traits of top marketing leaders (and how to cultivate them in yourself)

Stepping into a marketing leadership role can stir up a mix of emotions: excitement, optimism, and, often, a gnawing doubt. "Do I have the right skills to truly lead and inspire?" If you've ever wrestled with these uncertainties, you're not alone.

Hotjar team

The 7 best BI tools for marketers in 2024 (and how to use them)

Whether you're sifting through campaign attribution data or reviewing performance reports from different sources, extracting meaningful business insights from vast amounts of data is an often daunting—yet critical—task many marketers face. So how do you efficiently evaluate your results and communicate key learnings? 

This is where business intelligence (BI) tools come in, transforming raw data into actionable insights that drive informed, customer-centric decisions. 

6 marketing trends that will shape the future of ecommerce in 2023

Today, marketing trends evolve at the speed of technology. Ecommerce businesses that fail to update their marketing strategies to meet consumers where they are in 2023 will be left out of the conversations that drive brand success. 

Geoff Whiting

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

10.2 Steps in the Marketing Research Process

Learning objective.

• Describe the basic steps in the marketing research process and the purpose of each step.

The basic steps used to conduct marketing research are shown in Figure 10.6 “Steps in the Marketing Research Process” . Next, we discuss each step.

Figure 10.6 Steps in the Marketing Research Process

Step 1: Define the Problem (or Opportunity)

There’s a saying in marketing research that a problem half defined is a problem half solved. Defining the “problem” of the research sounds simple, doesn’t it? Suppose your product is tutoring other students in a subject you’re a whiz at. You have been tutoring for a while, and people have begun to realize you’re darned good at it. Then, suddenly, your business drops off. Or it explodes, and you can’t cope with the number of students you’re being asked help. If the business has exploded, should you try to expand your services? Perhaps you should subcontract with some other “whiz” students. You would send them students to be tutored, and they would give you a cut of their pay for each student you referred to them.

Both of these scenarios would be a problem for you, wouldn’t they? They are problems insofar as they cause you headaches. But are they really the problem? Or are they the symptoms of something bigger? For example, maybe your business has dropped off because your school is experiencing financial trouble and has lowered the number of scholarships given to incoming freshmen. Consequently, there are fewer total students on campus who need your services. Conversely, if you’re swamped with people who want you to tutor them, perhaps your school awarded more scholarships than usual, so there are a greater number of students who need your services. Alternately, perhaps you ran an ad in your school’s college newspaper, and that led to the influx of students wanting you to tutor them.

Businesses are in the same boat you are as a tutor. They take a look at symptoms and try to drill down to the potential causes. If you approach a marketing research company with either scenario—either too much or too little business—the firm will seek more information from you such as the following:

• In what semester(s) did your tutoring revenues fall (or rise)?
• In what subject areas did your tutoring revenues fall (or rise)?
• In what sales channels did revenues fall (or rise): Were there fewer (or more) referrals from professors or other students? Did the ad you ran result in fewer (or more) referrals this month than in the past months?
• Among what demographic groups did your revenues fall (or rise)—women or men, people with certain majors, or first-year, second-, third-, or fourth-year students?

The key is to look at all potential causes so as to narrow the parameters of the study to the information you actually need to make a good decision about how to fix your business if revenues have dropped or whether or not to expand it if your revenues have exploded.

The next task for the researcher is to put into writing the research objective. The research objective is the goal(s) the research is supposed to accomplish. The marketing research objective for your tutoring business might read as follows:

To survey college professors who teach 100- and 200-level math courses to determine why the number of students referred for tutoring dropped in the second semester.

This is admittedly a simple example designed to help you understand the basic concept. If you take a marketing research course, you will learn that research objectives get a lot more complicated than this. The following is an example:

“To gather information from a sample representative of the U.S. population among those who are ‘very likely’ to purchase an automobile within the next 6 months, which assesses preferences (measured on a 1–5 scale ranging from ‘very likely to buy’ to ‘not likely at all to buy’) for the model diesel at three different price levels. Such data would serve as input into a forecasting model that would forecast unit sales, by geographic regions of the country, for each combination of the model’s different prices and fuel configurations (Burns & Bush, 2010).”

Now do you understand why defining the problem is complicated and half the battle? Many a marketing research effort is doomed from the start because the problem was improperly defined. Coke’s ill-fated decision to change the formula of Coca-Cola in 1985 is a case in point: Pepsi had been creeping up on Coke in terms of market share over the years as well as running a successful promotional campaign called the “Pepsi Challenge,” in which consumers were encouraged to do a blind taste test to see if they agreed that Pepsi was better. Coke spent four years researching “the problem.” Indeed, people seemed to like the taste of Pepsi better in blind taste tests. Thus, the formula for Coke was changed. But the outcry among the public was so great that the new formula didn’t last long—a matter of months—before the old formula was reinstated. Some marketing experts believe Coke incorrectly defined the problem as “How can we beat Pepsi in taste tests?” instead of “How can we gain market share against Pepsi?” (Burns & Bush, 2010)

New Coke Is It! 1985

(click to see video)

This video documents the Coca-Cola Company’s ill-fated launch of New Coke in 1985.

1985 Pepsi Commercial—“They Changed My Coke”

This video shows how Pepsi tried to capitalize on the blunder.

Step 2: Design the Research

The next step in the marketing research process is to do a research design. The research design is your “plan of attack.” It outlines what data you are going to gather and from whom, how and when you will collect the data, and how you will analyze it once it’s been obtained. Let’s look at the data you’re going to gather first.

There are two basic types of data you can gather. The first is primary data. Primary data is information you collect yourself, using hands-on tools such as interviews or surveys, specifically for the research project you’re conducting. Secondary data is data that has already been collected by someone else, or data you have already collected for another purpose. Collecting primary data is more time consuming, work intensive, and expensive than collecting secondary data. Consequently, you should always try to collect secondary data first to solve your research problem, if you can. A great deal of research on a wide variety of topics already exists. If this research contains the answer to your question, there is no need for you to replicate it. Why reinvent the wheel?

Sources of Secondary Data

Your company’s internal records are a source of secondary data. So are any data you collect as part of your marketing intelligence gathering efforts. You can also purchase syndicated research. Syndicated research is primary data that marketing research firms collect on a regular basis and sell to other companies. J.D. Power & Associates is a provider of syndicated research. The company conducts independent, unbiased surveys of customer satisfaction, product quality, and buyer behavior for various industries. The company is best known for its research in the automobile sector. One of the best-known sellers of syndicated research is the Nielsen Company, which produces the Nielsen ratings. The Nielsen ratings measure the size of television, radio, and newspaper audiences in various markets. You have probably read or heard about TV shows that get the highest (Nielsen) ratings. (Arbitron does the same thing for radio ratings.) Nielsen, along with its main competitor, Information Resources, Inc. (IRI), also sells businesses scanner-based research . Scanner-based research is information collected by scanners at checkout stands in stores. Each week Nielsen and IRI collect information on the millions of purchases made at stores. The companies then compile the information and sell it to firms in various industries that subscribe to their services. The Nielsen Company has also recently teamed up with Facebook to collect marketing research information. Via Facebook, users will see surveys in some of the spaces in which they used to see online ads (Rappeport, Gelles, 2009).

By contrast, MarketResearch.com is an example of a marketing research aggregator. A marketing research aggregator is a marketing research company that doesn’t conduct its own research and sell it. Instead, it buys research reports from other marketing research companies and then sells the reports in their entirety or in pieces to other firms. Check out MarketResearch.com’s Web site. As you will see there are a huge number of studies in every category imaginable that you can buy for relatively small amounts of money.

Figure 10.7

Market research aggregators buy research reports from other marketing research companies and then resell them in part or in whole to other companies so they don’t have to gather primary data.

Source: http://www.marketresearch.com .

Your local library is a good place to gather free secondary data. It has searchable databases as well as handbooks, dictionaries, and books, some of which you can access online. Government agencies also collect and report information on demographics, economic and employment data, health information, and balance-of-trade statistics, among a lot of other information. The U.S. Census Bureau collects census data every ten years to gather information about who lives where. Basic demographic information about sex, age, race, and types of housing in which people live in each U.S. state, metropolitan area, and rural area is gathered so that population shifts can be tracked for various purposes, including determining the number of legislators each state should have in the U.S. House of Representatives. For the U.S. government, this is primary data. For marketing managers it is an important source of secondary data.

The Survey Research Center at the University of Michigan also conducts periodic surveys and publishes information about trends in the United States. One research study the center continually conducts is called the “Changing Lives of American Families” ( http://www.isr.umich.edu/home/news/research-update/2007-01.pdf ). This is important research data for marketing managers monitoring consumer trends in the marketplace. The World Bank and the United Nations are two international organizations that collect a great deal of information. Their Web sites contain many free research studies and data related to global markets. Table 10.1 “Examples of Primary Data Sources versus Secondary Data Sources” shows some examples of primary versus secondary data sources.

Table 10.1 Examples of Primary Data Sources versus Secondary Data Sources

Gauging the Quality of Secondary Data

When you are gathering secondary information, it’s always good to be a little skeptical of it. Sometimes studies are commissioned to produce the result a client wants to hear—or wants the public to hear. For example, throughout the twentieth century, numerous studies found that smoking was good for people’s health. The problem was the studies were commissioned by the tobacco industry. Web research can also pose certain hazards. There are many biased sites that try to fool people that they are providing good data. Often the data is favorable to the products they are trying to sell. Beware of product reviews as well. Unscrupulous sellers sometimes get online and create bogus ratings for products. See below for questions you can ask to help gauge the credibility of secondary information.

Gauging the Credibility of Secondary Data: Questions to Ask

• Who gathered this information?
• For what purpose?
• What does the person or organization that gathered the information have to gain by doing so?
• Was the information gathered and reported in a systematic manner?
• Is the source of the information accepted as an authority by other experts in the field?
• Does the article provide objective evidence to support the position presented?

Types of Research Design

Now let’s look specifically at the types of research designs that are utilized. By understanding different types of research designs, a researcher can solve a client’s problems more quickly and efficiently without jumping through more hoops than necessary. Research designs fall into one of the following three categories:

• Exploratory research design
• Descriptive research design
• Causal research design (experiments)

An exploratory research design is useful when you are initially investigating a problem but you haven’t defined it well enough to do an in-depth study of it. Perhaps via your regular market intelligence, you have spotted what appears to be a new opportunity in the marketplace. You would then do exploratory research to investigate it further and “get your feet wet,” as the saying goes. Exploratory research is less structured than other types of research, and secondary data is often utilized.

One form of exploratory research is qualitative research. Qualitative research is any form of research that includes gathering data that is not quantitative, and often involves exploring questions such as why as much as what or how much . Different forms, such as depth interviews and focus group interviews, are common in marketing research.

The depth interview —engaging in detailed, one-on-one, question-and-answer sessions with potential buyers—is an exploratory research technique. However, unlike surveys, the people being interviewed aren’t asked a series of standard questions. Instead the interviewer is armed with some general topics and asks questions that are open ended, meaning that they allow the interviewee to elaborate. “How did you feel about the product after you purchased it?” is an example of a question that might be asked. A depth interview also allows a researcher to ask logical follow-up questions such as “Can you tell me what you mean when you say you felt uncomfortable using the service?” or “Can you give me some examples?” to help dig further and shed additional light on the research problem. Depth interviews can be conducted in person or over the phone. The interviewer either takes notes or records the interview.

Focus groups and case studies are often utilized for exploratory research as well. A focus group is a group of potential buyers who are brought together to discuss a marketing research topic with one another. A moderator is used to focus the discussion, the sessions are recorded, and the main points of consensus are later summarized by the market researcher. Textbook publishers often gather groups of professors at educational conferences to participate in focus groups. However, focus groups can also be conducted on the telephone, in online chat rooms, or both, using meeting software like WebEx. The basic steps of conducting a focus group are outlined below.

The Basic Steps of Conducting a Focus Group

• Establish the objectives of the focus group. What is its purpose?
• Identify the people who will participate in the focus group. What makes them qualified to participate? How many of them will you need and what they will be paid?
• Obtain contact information for the participants and send out invitations (usually e-mails are most efficient).
• Develop a list of questions.
• Choose a facilitator.
• Choose a location in which to hold the focus group and the method by which it will be recorded.
• Conduct the focus group. If the focus group is not conducted electronically, include name tags for the participants, pens and notepads, any materials the participants need to see, and refreshments. Record participants’ responses.
• Summarize the notes from the focus group and write a report for management.

A case study looks at how another company solved the problem that’s being researched. Sometimes multiple cases, or companies, are used in a study. Case studies nonetheless have a mixed reputation. Some researchers believe it’s hard to generalize, or apply, the results of a case study to other companies. Nonetheless, collecting information about companies that encountered the same problems your firm is facing can give you a certain amount of insight about what direction you should take. In fact, one way to begin a research project is to carefully study a successful product or service.

Two other types of qualitative data used for exploratory research are ethnographies and projective techniques. In an ethnography , researchers interview, observe, and often videotape people while they work, live, shop, and play. The Walt Disney Company has recently begun using ethnographers to uncover the likes and dislikes of boys aged six to fourteen, a financially attractive market segment for Disney, but one in which the company has been losing market share. The ethnographers visit the homes of boys, observe the things they have in their rooms to get a sense of their hobbies, and accompany them and their mothers when they shop to see where they go, what the boys are interested in, and what they ultimately buy. (The children get seventy-five dollars out of the deal, incidentally.) (Barnes, 2009)

Projective techniques are used to reveal information research respondents might not reveal by being asked directly. Asking a person to complete sentences such as the following is one technique:

People who buy Coach handbags __________.

(Will he or she reply with “are cool,” “are affluent,” or “are pretentious,” for example?)

KFC’s grilled chicken is ______.

Or the person might be asked to finish a story that presents a certain scenario. Word associations are also used to discern people’s underlying attitudes toward goods and services. Using a word-association technique, a market researcher asks a person to say or write the first word that comes to his or her mind in response to another word. If the initial word is “fast food,” what word does the person associate it with or respond with? Is it “McDonald’s”? If many people reply that way, and you’re conducting research for Burger King, that could indicate Burger King has a problem. However, if the research is being conducted for Wendy’s, which recently began running an advertising campaign to the effect that Wendy’s offerings are “better than fast food,” it could indicate that the campaign is working.

Completing cartoons is yet another type of projective technique. It’s similar to finishing a sentence or story, only with the pictures. People are asked to look at a cartoon such as the one shown in Figure 10.8 “Example of a Cartoon-Completion Projective Technique” . One of the characters in the picture will have made a statement, and the person is asked to fill in the empty cartoon “bubble” with how they think the second character will respond.

Figure 10.8 Example of a Cartoon-Completion Projective Technique

In some cases, your research might end with exploratory research. Perhaps you have discovered your organization lacks the resources needed to produce the product. In other cases, you might decide you need more in-depth, quantitative research such as descriptive research or causal research, which are discussed next. Most marketing research professionals advise using both types of research, if it’s feasible. On the one hand, the qualitative-type research used in exploratory research is often considered too “lightweight.” Remember earlier in the chapter when we discussed telephone answering machines and the hit TV sitcom Seinfeld ? Both product ideas were initially rejected by focus groups. On the other hand, relying solely on quantitative information often results in market research that lacks ideas.

The Stone Wheel—What One Focus Group Said

Watch the video to see a funny spoof on the usefulness—or lack of usefulness—of focus groups.

Descriptive Research

Anything that can be observed and counted falls into the category of descriptive research design. A study using a descriptive research design involves gathering hard numbers, often via surveys, to describe or measure a phenomenon so as to answer the questions of who , what , where , when , and how . “On a scale of 1–5, how satisfied were you with your service?” is a question that illustrates the information a descriptive research design is supposed to capture.

Physiological measurements also fall into the category of descriptive design. Physiological measurements measure people’s involuntary physical responses to marketing stimuli, such as an advertisement. Elsewhere, we explained that researchers have gone so far as to scan the brains of consumers to see what they really think about products versus what they say about them. Eye tracking is another cutting-edge type of physiological measurement. It involves recording the movements of a person’s eyes when they look at some sort of stimulus, such as a banner ad or a Web page. The Walt Disney Company has a research facility in Austin, Texas, that it uses to take physical measurements of viewers when they see Disney programs and advertisements. The facility measures three types of responses: people’s heart rates, skin changes, and eye movements (eye tracking) (Spangler, 2009).

Figure 10.9

A woman shows off her headgear for an eye-tracking study. The gear’s not exactly a fashion statement but . . .

lawrencegs – Google Glass – CC BY 2.0.

A strictly descriptive research design instrument—a survey, for example—can tell you how satisfied your customers are. It can’t, however, tell you why. Nor can an eye-tracking study tell you why people’s eyes tend to dwell on certain types of banner ads—only that they do. To answer “why” questions an exploratory research design or causal research design is needed (Wagner, 2007).

Causal Research

Causal research design examines cause-and-effect relationships. Using a causal research design allows researchers to answer “what if” types of questions. In other words, if a firm changes X (say, a product’s price, design, placement, or advertising), what will happen to Y (say, sales or customer loyalty)? To conduct causal research, the researcher designs an experiment that “controls,” or holds constant, all of a product’s marketing elements except one (or using advanced techniques of research, a few elements can be studied at the same time). The one variable is changed, and the effect is then measured. Sometimes the experiments are conducted in a laboratory using a simulated setting designed to replicate the conditions buyers would experience. Or the experiments may be conducted in a virtual computer setting.

You might think setting up an experiment in a virtual world such as the online game Second Life would be a viable way to conduct controlled marketing research. Some companies have tried to use Second Life for this purpose, but the results have been somewhat mixed as to whether or not it is a good medium for marketing research. The German marketing research firm Komjuniti was one of the first “real-world” companies to set up an “island” in Second Life upon which it could conduct marketing research. However, with so many other attractive fantasy islands in which to play, the company found it difficult to get Second Life residents, or players, to voluntarily visit the island and stay long enough so meaningful research could be conducted. (Plus, the “residents,” or players, in Second Life have been known to protest corporations invading their world. When the German firm Komjuniti created an island in Second Life to conduct marketing research, the residents showed up waving signs and threatening to boycott the island.) (Wagner, 2007)

Why is being able to control the setting so important? Let’s say you are an American flag manufacturer and you are working with Walmart to conduct an experiment to see where in its stores American flags should be placed so as to increase their sales. Then the terrorist attacks of 9/11 occur. In the days afterward, sales skyrocketed—people bought flags no matter where they were displayed. Obviously, the terrorist attacks in the United States would have skewed the experiment’s data.

An experiment conducted in a natural setting such as a store is referred to as a field experiment . Companies sometimes do field experiments either because it is more convenient or because they want to see if buyers will behave the same way in the “real world” as in a laboratory or on a computer. The place the experiment is conducted or the demographic group of people the experiment is administered to is considered the test market . Before a large company rolls out a product to the entire marketplace, it will often place the offering in a test market to see how well it will be received. For example, to compete with MillerCoors’ sixty-four-calorie beer MGD 64, Anheuser-Busch recently began testing its Select 55 beer in certain cities around the country (McWilliams, 2009).

Figure 10.10

Select 55 beer: Coming soon to a test market near you? (If you’re on a diet, you have to hope so!)

Martine – Le champagne – CC BY-NC 2.0.

Many companies use experiments to test all of their marketing communications. For example, the online discount retailer O.co (formerly called Overstock.com) carefully tests all of its marketing offers and tracks the results of each one. One study the company conducted combined twenty-six different variables related to offers e-mailed to several thousand customers. The study resulted in a decision to send a group of e-mails to different segments. The company then tracked the results of the sales generated to see if they were in line with the earlier experiment it had conducted that led it to make the offer.

Step 3: Design the Data-Collection Forms

If the behavior of buyers is being formally observed, and a number of different researchers are conducting observations, the data obviously need to be recorded on a standardized data-collection form that’s either paper or electronic. Otherwise, the data collected will not be comparable. The items on the form could include a shopper’s sex; his or her approximate age; whether the person seemed hurried, moderately hurried, or unhurried; and whether or not he or she read the label on products, used coupons, and so forth.

The same is true when it comes to surveying people with questionnaires. Surveying people is one of the most commonly used techniques to collect quantitative data. Surveys are popular because they can be easily administered to large numbers of people fairly quickly. However, to produce the best results, the questionnaire for the survey needs to be carefully designed.

Questionnaire Design

Most questionnaires follow a similar format: They begin with an introduction describing what the study is for, followed by instructions for completing the questionnaire and, if necessary, returning it to the market researcher. The first few questions that appear on the questionnaire are usually basic, warm-up type of questions the respondent can readily answer, such as the respondent’s age, level of education, place of residence, and so forth. The warm-up questions are then followed by a logical progression of more detailed, in-depth questions that get to the heart of the question being researched. Lastly, the questionnaire wraps up with a statement that thanks the respondent for participating in the survey and information and explains when and how they will be paid for participating. To see some examples of questionnaires and how they are laid out, click on the following link: http://cas.uah.edu/wrenb/mkt343/Project/Sample%20Questionnaires.htm .

How the questions themselves are worded is extremely important. It’s human nature for respondents to want to provide the “correct” answers to the person administering the survey, so as to seem agreeable. Therefore, there is always a hazard that people will try to tell you what you want to hear on a survey. Consequently, care needs to be taken that the survey questions are written in an unbiased, neutral way. In other words, they shouldn’t lead a person taking the questionnaire to answer a question one way or another by virtue of the way you have worded it. The following is an example of a leading question.

Don’t you agree that teachers should be paid more ?

The questions also need to be clear and unambiguous. Consider the following question:

Which brand of toothpaste do you use ?

The question sounds clear enough, but is it really? What if the respondent recently switched brands? What if she uses Crest at home, but while away from home or traveling, she uses Colgate’s Wisp portable toothpaste-and-brush product? How will the respondent answer the question? Rewording the question as follows so it’s more specific will help make the question clearer:

Which brand of toothpaste have you used at home in the past six months? If you have used more than one brand, please list each of them 1 .

Sensitive questions have to be asked carefully. For example, asking a respondent, “Do you consider yourself a light, moderate, or heavy drinker?” can be tricky. Few people want to admit to being heavy drinkers. You can “soften” the question by including a range of answers, as the following example shows:

How many alcoholic beverages do you consume in a week ?

• __0–5 alcoholic beverages
• __5–10 alcoholic beverages
• __10–15 alcoholic beverages

Many people don’t like to answer questions about their income levels. Asking them to specify income ranges rather than divulge their actual incomes can help.

Other research question “don’ts” include using jargon and acronyms that could confuse people. “How often do you IM?” is an example. Also, don’t muddy the waters by asking two questions in the same question, something researchers refer to as a double-barreled question . “Do you think parents should spend more time with their children and/or their teachers?” is an example of a double-barreled question.

Open-ended questions , or questions that ask respondents to elaborate, can be included. However, they are harder to tabulate than closed-ended questions , or questions that limit a respondent’s answers. Multiple-choice and yes-and-no questions are examples of closed-ended questions.

Testing the Questionnaire

You have probably heard the phrase “garbage in, garbage out.” If the questions are bad, the information gathered will be bad, too. One way to make sure you don’t end up with garbage is to test the questionnaire before sending it out to find out if there are any problems with it. Is there enough space for people to elaborate on open-ended questions? Is the font readable? To test the questionnaire, marketing research professionals first administer it to a number of respondents face to face. This gives the respondents the chance to ask the researcher about questions or instructions that are unclear or don’t make sense to them. The researcher then administers the questionnaire to a small subset of respondents in the actual way the survey is going to be disseminated, whether it’s delivered via phone, in person, by mail, or online.

Getting people to participate and complete questionnaires can be difficult. If the questionnaire is too long or hard to read, many people won’t complete it. So, by all means, eliminate any questions that aren’t necessary. Of course, including some sort of monetary incentive for completing the survey can increase the number of completed questionnaires a market researcher will receive.

Step 4: Specify the Sample

Once you have created your questionnaire or other marketing study, how do you figure out who should participate in it? Obviously, you can’t survey or observe all potential buyers in the marketplace. Instead, you must choose a sample. A sample is a subset of potential buyers that are representative of your entire target market, or population being studied. Sometimes market researchers refer to the population as the universe to reflect the fact that it includes the entire target market, whether it consists of a million people, a hundred thousand, a few hundred, or a dozen. “All unmarried people over the age of eighteen who purchased Dirt Devil steam cleaners in the United States during 2011” is an example of a population that has been defined.

Obviously, the population has to be defined correctly. Otherwise, you will be studying the wrong group of people. Not defining the population correctly can result in flawed research, or sampling error. A sampling error is any type of marketing research mistake that results because a sample was utilized. One criticism of Internet surveys is that the people who take these surveys don’t really represent the overall population. On average, Internet survey takers tend to be more educated and tech savvy. Consequently, if they solely constitute your population, even if you screen them for certain criteria, the data you collect could end up being skewed.

The next step is to put together the sampling frame , which is the list from which the sample is drawn. The sampling frame can be put together using a directory, customer list, or membership roster (Wrenn et. al., 2007). Keep in mind that the sampling frame won’t perfectly match the population. Some people will be included on the list who shouldn’t be. Other people who should be included will be inadvertently omitted. It’s no different than if you were to conduct a survey of, say, 25 percent of your friends, using friends’ names you have in your cell phone. Most of your friends’ names are likely to be programmed into your phone, but not all of them. As a result, a certain degree of sampling error always occurs.

There are two main categories of samples in terms of how they are drawn: probability samples and nonprobability samples. A probability sample is one in which each would-be participant has a known and equal chance of being selected. The chance is known because the total number of people in the sampling frame is known. For example, if every other person from the sampling frame were chosen, each person would have a 50 percent chance of being selected.

A nonprobability sample is any type of sample that’s not drawn in a systematic way. So the chances of each would-be participant being selected can’t be known. A convenience sample is one type of nonprobability sample. It is a sample a researcher draws because it’s readily available and convenient to do so. Surveying people on the street as they pass by is an example of a convenience sample. The question is, are these people representative of the target market?

For example, suppose a grocery store needed to quickly conduct some research on shoppers to get ready for an upcoming promotion. Now suppose that the researcher assigned to the project showed up between the hours of 10 a.m. and 12 p.m. on a weekday and surveyed as many shoppers as possible. The problem is that the shoppers wouldn’t be representative of the store’s entire target market. What about commuters who stop at the store before and after work? Their views wouldn’t be represented. Neither would people who work the night shift or shop at odd hours. As a result, there would be a lot of room for sampling error in this study. For this reason, studies that use nonprobability samples aren’t considered as accurate as studies that use probability samples. Nonprobability samples are more often used in exploratory research.

Lastly, the size of the sample has an effect on the amount of sampling error. Larger samples generally produce more accurate results. The larger your sample is, the more data you will have, which will give you a more complete picture of what you’re studying. However, the more people surveyed or studied, the more costly the research becomes.

Statistics can be used to determine a sample’s optimal size. If you take a marketing research or statistics class, you will learn more about how to determine the optimal size.

Of course, if you hire a marketing research company, much of this work will be taken care of for you. Many marketing research companies, like ResearchNow, maintain panels of prescreened people they draw upon for samples. In addition, the marketing research firm will be responsible for collecting the data or contracting with a company that specializes in data collection. Data collection is discussed next.

Step 5: Collect the Data

As we have explained, primary marketing research data can be gathered in a number of ways. Surveys, taking physical measurements, and observing people are just three of the ways we discussed. If you’re observing customers as part of gathering the data, keep in mind that if shoppers are aware of the fact, it can have an effect on their behavior. For example, if a customer shopping for feminine hygiene products in a supermarket aisle realizes she is being watched, she could become embarrassed and leave the aisle, which would adversely affect your data. To get around problems such as these, some companies set up cameras or two-way mirrors to observe customers. Organizations also hire mystery shoppers to work around the problem. A mystery shopper is someone who is paid to shop at a firm’s establishment or one of its competitors to observe the level of service, cleanliness of the facility, and so forth, and report his or her findings to the firm.

Make Extra Money as a Mystery Shopper

Watch the YouTube video to get an idea of how mystery shopping works.

Survey data can be collected in many different ways and combinations of ways. The following are the basic methods used:

• Face-to-face (can be computer aided)
• Telephone (can be computer aided or completely automated)
• Mail and hand delivery
• E-mail and the Web

A face-to-face survey is, of course, administered by a person. The surveys are conducted in public places such as in shopping malls, on the street, or in people’s homes if they have agreed to it. In years past, it was common for researchers in the United States to knock on people’s doors to gather survey data. However, randomly collected door-to-door interviews are less common today, partly because people are afraid of crime and are reluctant to give information to strangers (McDaniel & Gates, 1998).

Nonetheless, “beating the streets” is still a legitimate way questionnaire data is collected. When the U.S. Census Bureau collects data on the nation’s population, it hand delivers questionnaires to rural households that do not have street-name and house-number addresses. And Census Bureau workers personally survey the homeless to collect information about their numbers. Face-to-face surveys are also commonly used in third world countries to collect information from people who cannot read or lack phones and computers.

A plus of face-to-face surveys is that they allow researchers to ask lengthier, more complex questions because the people being surveyed can see and read the questionnaires. The same is true when a computer is utilized. For example, the researcher might ask the respondent to look at a list of ten retail stores and rank the stores from best to worst. The same question wouldn’t work so well over the telephone because the person couldn’t see the list. The question would have to be rewritten. Another drawback with telephone surveys is that even though federal and state “do not call” laws generally don’t prohibit companies from gathering survey information over the phone, people often screen such calls using answering machines and caller ID.

Probably the biggest drawback of both surveys conducted face-to-face and administered over the phone by a person is that they are labor intensive and therefore costly. Mailing out questionnaires is costly, too, and the response rates can be rather low. Think about why that might be so: if you receive a questionnaire in the mail, it is easy to throw it in the trash; it’s harder to tell a market researcher who approaches you on the street that you don’t want to be interviewed.

By contrast, gathering survey data collected by a computer, either over the telephone or on the Internet, can be very cost-effective and in some cases free. SurveyMonkey and Zoomerang are two Web sites that will allow you to create online questionnaires, e-mail them to up to one hundred people for free, and view the responses in real time as they come in. For larger surveys, you have to pay a subscription price of a few hundred dollars. But that still can be extremely cost-effective. The two Web sites also have a host of other features such as online-survey templates you can use to create your questionnaire, a way to set up automatic reminders sent to people who haven’t yet completed their surveys, and tools you can use to create graphics to put in your final research report. To see how easy it is to put together a survey in SurveyMonkey, click on the following link: http://help.surveymonkey.com/app/tutorials/detail/a_id/423 .

Like a face-to-face survey, an Internet survey can enable you to show buyers different visuals such as ads, pictures, and videos of products and their packaging. Web surveys are also fast, which is a major plus. Whereas face-to-face and mailed surveys often take weeks to collect, you can conduct a Web survey in a matter of days or even hours. And, of course, because the information is electronically gathered it can be automatically tabulated. You can also potentially reach a broader geographic group than you could if you had to personally interview people. The Zoomerang Web site allows you to create surveys in forty different languages.

Another plus for Web and computer surveys (and electronic phone surveys) is that there is less room for human error because the surveys are administered electronically. For instance, there’s no risk that the interviewer will ask a question wrong or use a tone of voice that could mislead the respondents. Respondents are also likely to feel more comfortable inputting the information into a computer if a question is sensitive than they would divulging the information to another person face-to-face or over the phone. Given all of these advantages, it’s not surprising that the Internet is quickly becoming the top way to collect primary data. However, like mail surveys, surveys sent to people over the Internet are easy to ignore.

Lastly, before the data collection process begins, the surveyors and observers need to be trained to look for the same things, ask questions the same way, and so forth. If they are using rankings or rating scales, they need to be “on the same page,” so to speak, as to what constitutes a high ranking or a low ranking. As an analogy, you have probably had some teachers grade your college papers harder than others. The goal of training is to avoid a wide disparity between how different observers and interviewers record the data.

Figure 10.11

Training people so they know what constitutes different ratings when they are collecting data will improve the quality of the information gathered in a marketing research study.

Ricardo Rodriquez – Satisfaction survey – CC BY-NC-ND 2.0.

For example, if an observation form asks the observers to describe whether a shopper’s behavior is hurried, moderately hurried, or unhurried, they should be given an idea of what defines each rating. Does it depend on how much time the person spends in the store or in the individual aisles? How fast they walk? In other words, the criteria and ratings need to be spelled out.

Collecting International Marketing Research Data

Gathering marketing research data in foreign countries poses special challenges. However, that doesn’t stop firms from doing so. Marketing research companies are located all across the globe, in fact. Eight of the ten largest marketing research companies in the world are headquartered in the United States. However, five of these eight firms earn more of their revenues abroad than they do in the United States. There’s a reason for this: many U.S. markets were saturated, or tapped out, long ago in terms of the amount that they can grow. Coke is an example. As you learned earlier in the book, most of the Coca-Cola Company’s revenues are earned in markets abroad. To be sure, the United States is still a huge market when it comes to the revenues marketing research firms generate by conducting research in the country: in terms of their spending, American consumers fuel the world’s economic engine. Still, emerging countries with growing middle classes, such as China, India, and Brazil, are hot new markets companies want to tap.

What kind of challenges do firms face when trying to conduct marketing research abroad? As we explained, face-to-face surveys are commonly used in third world countries to collect information from people who cannot read or lack phones and computers. However, face-to-face surveys are also common in Europe, despite the fact that phones and computers are readily available. In-home surveys are also common in parts of Europe. By contrast, in some countries, including many Asian countries, it’s considered taboo or rude to try to gather information from strangers either face-to-face or over the phone. In many Muslim countries, women are forbidden to talk to strangers.

And how do you figure out whom to research in foreign countries? That in itself is a problem. In the United States, researchers often ask if they can talk to the heads of households to conduct marketing research. But in countries in which domestic servants or employees are common, the heads of households aren’t necessarily the principal shoppers; their domestic employees are (Malhotra).

Translating surveys is also an issue. Have you ever watched the TV comedians Jay Leno and David Letterman make fun of the English translations found on ethnic menus and products? Research tools such as surveys can suffer from the same problem. Hiring someone who is bilingual to translate a survey into another language can be a disaster if the person isn’t a native speaker of the language to which the survey is being translated.

One way companies try to deal with translation problems is by using back translation. When back translation is used, a native speaker translates the survey into the foreign language and then translates it back again to the original language to determine if there were gaps in meaning—that is, if anything was lost in translation. And it’s not just the language that’s an issue. If the research involves any visual images, they, too, could be a point of confusion. Certain colors, shapes, and symbols can have negative connotations in other countries. For example, the color white represents purity in many Western cultures, but in China, it is the color of death and mourning (Zouhali-Worrall, 2008). Also, look back at the cartoon-completion exercise in Figure 10.8 “Example of a Cartoon-Completion Projective Technique” . What would women in Muslim countries who aren’t allowed to converse with male sellers think of it? Chances are, the cartoon wouldn’t provide you with the information you’re seeking if Muslim women in some countries were asked to complete it.

One way marketing research companies are dealing with the complexities of global research is by merging with or acquiring marketing research companies abroad. The Nielsen Company is the largest marketing research company in the world. The firm operates in more than a hundred countries and employs more than forty thousand people. Many of its expansions have been the result of acquisitions and mergers.

Step 6: Analyze the Data

Step 6 involves analyzing the data to ensure it’s as accurate as possible. If the research is collected by hand using a pen and pencil, it’s entered into a computer. Or respondents might have already entered the information directly into a computer. For example, when Toyota goes to an event such as a car show, the automaker’s marketing personnel ask would-be buyers to complete questionnaires directly on computers. Companies are also beginning to experiment with software that can be used to collect data using mobile phones.

Once all the data is collected, the researchers begin the data cleaning , which is the process of removing data that have accidentally been duplicated (entered twice into the computer) or correcting data that have obviously been recorded wrong. A program such as Microsoft Excel or a statistical program such as Predictive Analytics Software (PASW, which was formerly known as SPSS) is then used to tabulate, or calculate, the basic results of the research, such as the total number of participants and how collectively they answered various questions. The programs can also be used to calculate averages, such as the average age of respondents, their average satisfaction, and so forth. The same can done for percentages, and other values you learned about, or will learn about, in a statistics course, such as the standard deviation, mean, and median for each question.

The information generated by the programs can be used to draw conclusions, such as what all customers might like or not like about an offering based on what the sample group liked or did not like. The information can also be used to spot differences among groups of people. For example, the research might show that people in one area of the country like the product better than people in another area. Trends to predict what might happen in the future can also be spotted.

If there are any open-ended questions respondents have elaborated upon—for example, “Explain why you like the current brand you use better than any other brand”—the answers to each are pasted together, one on top of another, so researchers can compare and summarize the information. As we have explained, qualitative information such as this can give you a fuller picture of the results of the research.

Part of analyzing the data is to see if it seems sound. Does the way in which the research was conducted seem sound? Was the sample size large enough? Are the conclusions that become apparent from it reasonable?

The two most commonly used criteria used to test the soundness of a study are (1) validity and (2) reliability. A study is valid if it actually tested what it was designed to test. For example, did the experiment you ran in Second Life test what it was designed to test? Did it reflect what could really happen in the real world? If not, the research isn’t valid. If you were to repeat the study, and get the same results (or nearly the same results), the research is said to be reliable . If you get a drastically different result if you repeat the study, it’s not reliable. The data collected, or at least some it, can also be compared to, or reconciled with, similar data from other sources either gathered by your firm or by another organization to see if the information seems on target.

Stage 7: Write the Research Report and Present Its Findings

If you end up becoming a marketing professional and conducting a research study after you graduate, hopefully you will do a great job putting the study together. You will have defined the problem correctly, chosen the right sample, collected the data accurately, analyzed it, and your findings will be sound. At that point, you will be required to write the research report and perhaps present it to an audience of decision makers. You will do so via a written report and, in some cases, a slide or PowerPoint presentation based on your written report.

The six basic elements of a research report are as follows.

• Title Page . The title page explains what the report is about, when it was conducted and by whom, and who requested it.
• Table of Contents . The table of contents outlines the major parts of the report, as well as any graphs and charts, and the page numbers on which they can be found.
• Executive Summary . The executive summary summarizes all the details in the report in a very quick way. Many people who receive the report—both executives and nonexecutives—won’t have time to read the entire report. Instead, they will rely on the executive summary to quickly get an idea of the study’s results and what to do about those results.

Methodology and Limitations . The methodology section of the report explains the technical details of how the research was designed and conducted. The section explains, for example, how the data was collected and by whom, the size of the sample, how it was chosen, and whom or what it consisted of (e.g., the number of women versus men or children versus adults). It also includes information about the statistical techniques used to analyze the data.

Every study has errors—sampling errors, interviewer errors, and so forth. The methodology section should explain these details, so decision makers can consider their overall impact. The margin of error is the overall tendency of the study to be off kilter—that is, how far it could have gone wrong in either direction. Remember how newscasters present the presidential polls before an election? They always say, “This candidate is ahead 48 to 44 percent, plus or minus 2 percent.” That “plus or minus” is the margin of error. The larger the margin of error is, the less likely the results of the study are accurate. The margin of error needs to be included in the methodology section.

• Findings . The findings section is a longer, fleshed-out version of the executive summary that goes into more detail about the statistics uncovered by the research that bolster the study’s findings. If you have related research or secondary data on hand that back up the findings, it can be included to help show the study did what it was designed to do.
• Recommendations . The recommendations section should outline the course of action you think should be taken based on the findings of the research and the purpose of the project. For example, if you conducted a global market research study to identify new locations for stores, make a recommendation for the locations (Mersdorf, 2009).

As we have said, these are the basic sections of a marketing research report. However, additional sections can be added as needed. For example, you might need to add a section on the competition and each firm’s market share. If you’re trying to decide on different supply chain options, you will need to include a section on that topic.

As you write the research report, keep your audience in mind. Don’t use technical jargon decision makers and other people reading the report won’t understand. If technical terms must be used, explain them. Also, proofread the document to ferret out any grammatical errors and typos, and ask a couple of other people to proofread behind you to catch any mistakes you might have missed. If your research report is riddled with errors, its credibility will be undermined, even if the findings and recommendations you make are extremely accurate.

Many research reports are presented via PowerPoint. If you’re asked to create a slideshow presentation from the report, don’t try to include every detail in the report on the slides. The information will be too long and tedious for people attending the presentation to read through. And if they do go to the trouble of reading all the information, they probably won’t be listening to the speaker who is making the presentation.

Instead of including all the information from the study in the slides, boil each section of the report down to key points and add some “talking points” only the presenter will see. After or during the presentation, you can give the attendees the longer, paper version of the report so they can read the details at a convenient time, if they choose to.

Key Takeaway

Step 1 in the marketing research process is to define the problem. Businesses take a look at what they believe are symptoms and try to drill down to the potential causes so as to precisely define the problem. The next task for the researcher is to put into writing the research objective, or goal, the research is supposed to accomplish. Step 2 in the process is to design the research. The research design is the “plan of attack.” It outlines what data you are going to gather, from whom, how, and when, and how you’re going to analyze it once it has been obtained. Step 3 is to design the data-collection forms, which need to be standardized so the information gathered on each is comparable. Surveys are a popular way to gather data because they can be easily administered to large numbers of people fairly quickly. However, to produce the best results, survey questionnaires need to be carefully designed and pretested before they are used. Step 4 is drawing the sample, or a subset of potential buyers who are representative of your entire target market. If the sample is not correctly selected, the research will be flawed. Step 5 is to actually collect the data, whether it’s collected by a person face-to-face, over the phone, or with the help of computers or the Internet. The data-collection process is often different in foreign countries. Step 6 is to analyze the data collected for any obvious errors, tabulate the data, and then draw conclusions from it based on the results. The last step in the process, Step 7, is writing the research report and presenting the findings to decision makers.

Review Questions

• Explain why it’s important to carefully define the problem or opportunity a marketing research study is designed to investigate.
• Describe the different types of problems that can occur when marketing research professionals develop questions for surveys.
• How does a probability sample differ from a nonprobability sample?
• What makes a marketing research study valid? What makes a marketing research study reliable?
• What sections should be included in a marketing research report? What is each section designed to do?

1 “Questionnaire Design,” QuickMBA , http://www.quickmba.com/marketing/research/qdesign (accessed December 14, 2009).

Barnes, B., “Disney Expert Uses Science to Draw Boy Viewers,” New York Times , April 15, 2009, http://www.nytimes.com/2009/04/14/arts/television/14boys.html?pagewanted=1&_r=1 (accessed December 14, 2009).

Burns A. and Ronald Bush, Marketing Research , 6th ed. (Upper Saddle River, NJ: Prentice Hall, 2010), 85.

Malhotra, N., Marketing Research: An Applied Approach , 6th ed. (Upper Saddle River, NJ: Prentice Hall), 764.

McDaniel, C. D. and Roger H. Gates, Marketing Research Essentials , 2nd ed. (Cincinnati: South-Western College Publishing, 1998), 61.

McWilliams, J., “A-B Puts Super-Low-Calorie Beer in Ring with Miller,” St. Louis Post-Dispatch , August 16, 2009, http://www.stltoday.com/business/next-matchup-light-weights-a-b-puts-super-low-calorie/article_47511bfe-18ca-5979-bdb9-0526c97d4edf.html (accessed April 13, 2012).

Mersdorf, S., “How to Organize Your Next Survey Report,” Cvent , August 24, 2009, http://survey.cvent.com/blog/cvent-survey/0/0/how-to-organize-your-next-survey-report (accessed December 14, 2009).

Rappeport A. and David Gelles, “Facebook to Form Alliance with Nielsen,” Financial Times , September 23, 2009, 16.

Spangler, T., “Disney Lab Tracks Feelings,” Multichannel News 30, no. 30 (August 3, 2009): 26.

Wagner, J., “Marketing in Second Life Doesn’t Work…Here Is Why!” GigaOM , April 4, 2007, http://gigaom.com/2007/04/04/3-reasons-why-marketing-in-second-life-doesnt-work (accessed December 14, 2009).

Wrenn, B., Robert E. Stevens, and David L. Loudon, Marketing Research: Text and Cases , 2nd ed. (Binghamton, NY: Haworth Press, 2007), 180.

Zouhali-Worrall, M., “Found in Translation: Avoiding Multilingual Gaffes,” CNNMoney.com , July 14, 2008, http://money.cnn.com/2008/07/07/smallbusiness/language_translation.fsb/index.htm (accessed December 14, 2009).

Principles of Marketing Copyright © 2015 by University of Minnesota is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License , except where otherwise noted.

Share This Book