What would you not change about this product under any circumstances?
In this type of research, you confront the respondent with a new, innovative product or service. It is therefore important not to collect superficial opinions but to understand in depth the respondent’s attitude towards the subject of the market research.
Closed question | Open-ended question (rewording) | Comments and remarks |
Do you intend to use this product? | How do you think this product could help you? Can you describe how you would use this product? | This question is particularly critical in the case of an innovative approach. Remember that the declarative elements are unreliable. Therefore, an ethnographic approach is needed to force the respondent to think about how he or she might use a new product, how it might fit into his or her daily routine. |
Is it easy to use? | What do you find most annoying about using this product? | The open-ended question forces the respondent to find defects in the product. The flaws will be identified and will allow the interviewer to investigate the problems and to understand their origin. |
Do you like this product? | What are the 3 features you like most about this product? What are the 2 aspects of this product that you find most different from a similar product? | In these open-ended questions, we use a brainstorming technique that forces respondents to find several arguments and exhausts the most common answers. In the second rewording, we also highlight differentiating aspects. Knowing these can be interesting in terms of marketing and communication. |
Would you buy this product? | What would make you want to buy this product? What aspects of this product do you find most interesting? Imagine if you could test this product. On what basis would you judge that you need it? | Each of the open-ended rewordings in question highlights the points that differentiate the product, those that the consumer finds most attractive. Using such an open-ended question can be interesting to understand which aspects are most appealing and whether these are the same regardless of the population segment. A market segment may react differently to the arguments put forward (think of age segments, for example). Knowing which cases to put forward according to your targets can, therefore, be a considerable asset. |
As you will have understood, open-ended questions are particularly suitable for qualitative research (1-to-1 interviews and focus groups). How should they be formulated?
The Five W’s; (who did what, where, when, and why ) questioning method should be used rigorously and sparingly :
In contrast, closed-ended questions are mainly used and adapted to quantitative questionnaires since they facilitate the analysis of the results by framing the participants’ answers.
Image: Shutterstock
19 July 2021
Very useful sir….
Your email address will not be published. Required fields are marked *
Save my name, email, and website in this browser for the next time I comment.
Don't forget to check your spam folder .
You didn't receive the link?
Pour offrir les meilleures expériences, nous utilisons des technologies telles que les cookies pour stocker et/ou accéder aux informations des appareils. Le fait de consentir à ces technologies nous permettra de traiter des données telles que le comportement de navigation ou les ID uniques sur ce site. Le fait de ne pas consentir ou de retirer son consentement peut avoir un effet négatif sur certaines caractéristiques et fonctions.
Open-ended questions are invaluable for gathering meaningful insights. Unlike closed-ended questions that limit responses, open-ended questions allow people to answer in their own words.
This gives them the freedom to provide more detailed and thoughtful responses, reveal attitudes and emotions, and share unexpected perspectives.
In this comprehensive guide, you will learn what open-ended questions are, why they are so effective for research, how to phrase open-ended questions, where to use open-ended questions, tips for success with open-ended questions, etc
Whether you are conducting formal research or having an informal discussion, open-ended questions can help you explore topics more deeply, foster engaging dialogue, and develop nuanced understandings of people’s experiences and beliefs.
Let’s get started.
What are open-ended questions.
Open-ended questions are questions that require more than a simple yes/no or one-word response.
They are designed to encourage the respondent to provide an explanatory, descriptive answer using their own words. Unlike closed-ended questions that limit the response options, open-ended questions give people the flexibility to respond however they want.
Some examples of open-ended questions are:
These types of questions cannot be answered with a pre-determined set of responses. They push respondents to think deeper and share more details, opinions, and examples in their unique voice.
In contrast, closed-ended questions limit the answer to a binary yes/no, a numerical rating, or a choice among several fixed options. For example:
While closed-ended questions can be useful in some cases, they do not gather the type of rich, descriptive data that open-ended questions produce.
Open-ended questions give respondents the freedom to fully express themselves and take the conversation in new, unexpected directions.
1. allow for detailed, expansive responses.
Open-ended questions allow respondents to provide much more detail and explanation in their answers. Unlike closed-ended questions that limit responses to a few words or a rating, open-ended questions give people the flexibility to fully express themselves.
By giving respondents freedom of expression, open-ended questions reveal deeper insights about their perspectives, mindsets, and emotions.
The flexible nature of open-ended questions allows for a smoother, more natural give-and-take conversation.
By giving respondents freedom to share, open-ended questions demonstrate genuine interest in their point of view.
Open-ended questions are ideal for gathering comprehensive information on topics where closed-ended questions would fall short.
The expansive nature of responses to open-ended questions contains insights and intelligence that other question types cannot reveal. This makes them invaluable for in-depth qualitative research across fields.
1. use interrogative words.
Forming open-ended questions using interrogative words like who, what, when, where, why and how is an effective strategy to elicit detailed, explanatory responses.
These question words encourage people to provide more thoughtful answers beyond just yes/no or one-word replies. For example, asking “Why did you make that decision?” or “How did you feel when that happened?” pushes respondents to reflect more deeply instead of reacting instinctually.
They have to describe their motivations, thought processes, emotions and experiences in order to fully answer the question.
Phrasing open-ended questions without using interrogative words often enables respondents to get away with shorter, more closed responses. The interrogative wording forces them to delve deeper and share more.
Inviting descriptive responses by beginning open-ended questions with phrases like “Tell me about…” or “Describe…” is another impactful technique.
This wording establishes clear expectations that an extensive, in-depth explanation is desired. Respondents recognize they have the freedom and permission to share details, context, examples, and backstories without worrying about providing the “right” simple answer.
The “Tell me about…” or “Describe…” preamble signals that the questioner is interested in hearing their full perspective, not just surface-level facts.
Starting open-ended questions in this way empowers respondents to open up comfortably without reservations about response length or format. It gets them primed to be thoughtful and reflective.
Wording open-ended questions in an open, neutral way avoids biasing or leading respondents toward particular responses.
Closed-ended questions often have baked-in assumptions or apply pressure to answer in a socially desirable way. Open-ended questions should completely avoid this by using objective, non-judgmental language.
Don’t impose any preconceived notions or make respondents feel like there is a “correct” answer they should give. Let their experiences, thought processes, attitudes and beliefs emerge organically without being influenced.
Keeping questions open-ended both linguistically and psychologically empower respondents to share their authentic perspectives, even if unexpected or contrary to assumptions.
Following up on initial open-ended questions with probing questions is an excellent tactic to gather more details and encourage elaboration.
For example, asking “Can you expand on that concept?” or “You mentioned [X] – what exactly do you mean by that?” demonstrates interest and pushes them to build on their original response with more depth, examples, context and clarity.
Phrasing follow-ups using words like “elaborate,” “explain” or “describe” challenges respondents to dive deeper into their thought processes and unpack their statements further.
Not accepting their original response at face value pressures them to provide richer descriptions and concrete evidence to back up their claims. This develops a fruitful dialogue rather than a one-off question.
1. during jtbd interviews.
Leveraging open-ended questions is incredibly effective throughout Jobs-to-Be-Done interviews to reveal the complete backstory and motivation surrounding customers’ purchases.
The non-restrictive format gives customers the latitude to comprehensively describe the circumstances, emotions, frustrations and needs leading up to acquiring a product or service.
Skilled interviewers utilize probing open-ended follow-ups to encourage vivid narratives and details about the full context around purchase occasions, rather than just superficial factors. Customers can elaborate extensively about their decision journey, thought processes, usage situations, pain points with previous options, requirements, and perceived risks.
This provides a holistic understanding of the “job” the product was “hired” to do. Letting customers explain freely without constraints uncovers unexpected insights about usage behaviors, delighters, substitutes, and more that closed-ended questions would not organically reveal.
For qualitative market research, open-ended inquiry delivers profoundly detailed understandings of how consumers truly perceive brands, make purchasing decisions and experience products day-to-day.
The flexible format provides space for target consumers to explain in their own words their affiliations with brands, product/service usage occasions, decision motivations, pain points, moments of delight, desired outcomes and more.
Researchers can deeply explore responses using “why” and “how” probes to uncover the psychological, emotional, social and functional factors driving consumer behaviours.
This reveals strategic opportunities around positioning, messaging, feature development and customer experience design.
While quantitative data establishes surface-level consumer trends, open-ended engagement provides meaningful qualitative context and language to inform smart strategy and create deep consumer connections.
Companies use open-ended questions to gather candid qualitative customer feedback that pinpoints priorities for improvement.
Customers can explain frustrations, positive/negative experiences, emotional pain points and desires in their own words without being limited by pre-determined response options.
Probing follow-up questions explores feedback more deeply to identify root causes of pain points versus superficial irritants.
Customers also have space to provide suggestions to resolve issues and share moments that delight them. This constructive feedback is synthesized to guide enhancements across the customer journey, from marketing to product features to post-purchase experience and support.
Closed-ended satisfaction scales fail to provide the rich narratives and insights needed to address problems and identify what matters most to customers.
1. asking more than one question at a time.
Asking multiple questions at once is an extremely common mistake when using open-ended questions that significantly hinders their effectiveness.
Overwhelming respondents with compound, complex or overlapping questions leaves them confused about which aspect to focus their response on. This results in vague, generalized answers that gloss over the nuances of each inquiry rather than providing the specific, deep insights each question warrants.
Even elaborate responses to multi-part questions often lack the laser focus and structure needed to extract key themes.
Additionally, blending different lines of inquiry into one big question makes it challenging to analyze and utilize the unstructured feedback. It’s far more effective to ask one open-ended question at a time, give the respondent space to answer thoroughly, and use strategic follow-ups to progressively build understanding.
This disciplined approach avoids cognitive overload and provides the detail required to drive meaningful dialogue and derive actionable conclusions.
It’s vital to pay close attention to the exact wording used when phrasing open-ended questions. Even subtle vocabulary issues can inadvertently create closed-ended questions that limit responses to yes/no, agree/disagree or basic data.
Leading with verbs like “Do,” “Does,” “Is,” “Are,” or “Did” prompts closed responses rather than explanations. Asking “Why was that good?” or “How did you like it?” implies there was liking rather than allowing them to evaluate freely.
The language itself should remain open and non-leading to empower respondents to share whatever perspectives or experiences emerge naturally, without assumptions.
Carefully phrasing questions with neutral language like “Tell me about…” or “What factors influenced…” ensures responses contain unfiltered insights rather than confirmations of preconceived notions.
Rushing respondents to answer open-ended questions defeats their purpose of gathering in-depth insights and often results in abrupt, incomplete responses lacking meaningful substance.
After asking an open-ended question, it’s essential to proactively give respondents adequate silent time to gather thoughts, reflect on experiences, and articulate responses before interrupting.
If responses seem cursory, ask probing follow-up questions to draw out the rich details and explanations that open-ended inquiries are designed for.
Making respondents feel pressed for time can also discourage sharing personal anecdotes or discussing sensitive topics that require vulnerability. Allowing ample time upfront ultimately saves effort compared to trying to recover depth through multiple ineffective follow-up questions after initially rushing the pace. Patience pays off by enabling thorough responses and productive, unhurried dialogue.
Failing to actively listen and ask follow-up questions after posing open-ended inquiries squanders their potential for deep, revealing discussion.
Without planned follow-up, even thoughtful responses often remain surface-level and leave underlying perspectives unaddressed.
Strategic probing follow-ups based on active listening are essential to dive deeper into relevant themes, gather illuminating examples and stories, understand nuanced thinking, and uncover subtle emotions.
They show interest in the respondent’s vantage point rather than just checking a box.
Simply letting responses conclude without probing for more is a lost opportunity to build understanding and interpersonal connections. Follow-ups demonstrate curiosity, clarify ambiguities, and encourage vulnerability through elaboration in their own authentic voice.
1. listen fully without interrupting.
Allowing respondents to answer open-ended questions without interruption demonstrates exemplary active listening skills and gives space for thoughtful, unfiltered responses.
Jumping in too soon with follow-ups or tangents cuts off the initial flow of insight and risks losing unexpected revelations still percolating.
Silence after asking an open-ended question can feel awkward, but resisting the temptation to immediately fill gaps leads to stronger dialogue and understanding in the long run.
Even if responses seem slow to develop, interrupting can fluster respondents and inhibit substantive sharing.
By listening patiently and without judgment from start to conclusion, you signal genuine interest in understanding their full perspective, making them more willing to open up candidly. This level of care and focus builds crucial trust and rapport that supports ongoing vulnerable sharing.
Thoughtful, strategic open-ended follow-up questions are essential to probe initial responses more deeply for vivid examples, explanatory backstories and illuminating details that bring insight to life.
Questions like “What drove that decision?” or “How did that make you feel?” demonstrate curiosity to learn more rather than passively accepting surface-level responses.
Drawing out more textures, emotions, contexts and narratives helps co-construct meaning and perspective-taking.
Follow a logical path of inquiry without bombarding respondents with tangents. Look for gaps to fill or opportunities to clarify and expand based on active listening.
Continue probing with empathy and tact until satisfied with the depth and specificity of understanding. Mastering open-ended follow-up techniques leads to richer discoveries.
When facilitating responses to open-ended questions, it’s vital that tone, body language and verbal reactions remain completely neutral and non-judgmental, even if responses provoke internal surprise.
Any hint of subjectivity could shut down honesty, making respondents hesitant to share freely in the future.
Maintain engaged, affirmative eye contact and posture regardless of your personal feelings to foster a safe space. Never explicitly express disapproval, disagreement or shock.
The goal is unfiltered insight into the respondent’s perspectives, not conformity with your own. Leave your biases aside to have an authentic, open-minded exchange. Let responses speak for themselves without revealing your own hand through unnecessary commentary.
Successful use of open-ended questions requires reading situational contexts and adjusting questioning and follow-up techniques accordingly.
In formal research interviews, maintain more structure and focus by sticking to clear lines of inquiry. In informal dialogue, conversations can flow more organically based on responses, following intriguing tangents.
Consider factors like relationship status, power dynamics, setting formality, time constraints, response styles and emotional energy when deciding how tightly or loosely to guide the discussion.
Get clarification if responses seem unclear. With sensitive topics, tread carefully and give space. Frame questions and probe with situational awareness to enhance positive outcomes.
Both open and closed-ended questions play important complementary roles in gathering complete, multi-faceted information.
Open-ended questions uncover deep qualitative insights through descriptive responses in the respondent’s own words. Closed-ended questions efficiently gather quantifiable data, opinions and facts.
Relying solely on open-ended questions can lead to aimless rambling, while overusing closed-ended questions results in thin data lacking context.
Develop mastery in blending, sequencing and transitioning smoothly between the two approaches. For example, use open-ended questions to explore themes and closed-ended questions to confirm conclusions. Balance them artfully based on the situation.
Warm, conversational tone and friendly body language while asking open-ended questions and listening to responses help build crucial rapport and willingness to open up.
Make regular eye contact to show engagement, leaning in slightly to signal interest in learning the respondent’s perspective.
Avoid crossed arms or distracted glances at notes or devices which can seem closed-off. Reflect the respondent’s emotional tenor – if anxiety emerges around a topic, adopt a reassuring tone.
Your nonverbals should make respondents feel heard, respected and comfortable revealing their authentic self without fear of judgment. A caring presence breeds candidness.
During open-ended questioning dialogues, take concise notes on main discussion themes, powerful respondent quotes, follow-up topics, body language and insights that resonate rather than attempting to transcribe responses.
Verbatim transcription is inefficient in capturing the core essence. Prioritize highlighting the main takeaways, defined terms, compelling stories and emotional moments that leave an impression.
Review, organize and reflect on notes soon after while memory remains fresh to consolidate learnings and plan the next steps.
Quality selective note-taking aids meaningful analysis of the wealth of unstructured qualitative information generated through open-ended engagement.
1. Q: What is the difference between open-ended and closed-ended questions?
A: Open-ended questions elicit an explanatory response with detailed narrative, context and emotions. Closed-ended questions limit responses to a short phrase or numerical rating.
2. Q: When should I use open-ended questions versus closed-ended questions?
A: Use open-ended questions when seeking qualitative insights and detailed perspectives. Use closed-ended for quantifiable data or confirming hypotheses. Use both to balance breadth and depth.
3. Q: What phrases help encourage detailed responses to open-ended questions?
A: Phrases like “tell me more about “, “describe your experience”, and “explain your perspective on” encourage elaboration. Avoid yes/no phrasing.
4. Q: How can I avoid influencing the respondent’s answers to open-ended questions?
A: Use neutral language. Don’t lead towards expected or desired responses. Allow free expression without judgment or imposition of assumptions.
5. Q: How many open-ended questions should I ask at a time?
A: Ask one open-ended question at a time. Allow thorough response then ask focused follow-up questions to build understanding.
6. Q: How can I get respondents to open up more with open-ended questions?
A: Active listening, empathy, and non-judgment encourage openness. Probing gently with follow up questions signals interest in understanding their full perspective.
7. Q: What are some examples of good open-ended questions for research interviews?
A: “Tell me about your experience using this product”, “How did this make you feel?”, “What factors influenced your decision?”
8. Q: How can I tailor open-ended questions based on the situation and respondent?
A: Consider formality of setting, time constraints, rapport level, demographics, tone of conversation and emotions when crafting relevant, thoughtful questions.
9. Q: What listening skills are important for gathering the most from open-ended questions?
A: Focused, active listening without interruption. Probing follow-ups to draw out details. Objectivity. Empathy. Situational awareness.
10. Q: How can I remember to use open-ended questions more often?
A: Actively monitor your language for closed-ended phrasing. Pause after asking one question. Prepare follow-up questions in advance.
Benchmark your CRO now for immediate, free report packed with ACTIONABLE insights you and your team can implement today to increase conversion.
Takes only two minutes
If your CRO programme is not delivering the highest ROI of all of your marketing spend, then we should talk.
Before you go...
“The world’s leading companies are using experimentation to generate better results for the whole business.
Download our latest ebook to discover how businesses have made the shift from CRO to experimentation and how you can too.
Be the first to know about future events with top speakers from the CRO industry.
Nov 8, 2023 | User Acceptance Testing , User Research
Qualitative research is crucial in understanding the complexities of human behaviour, experiences, and perspectives.
Table of Contents
It allows researchers to explore the richness and depth of individuals’ thoughts, feelings, decision making process and motivations.
One of the critical tools in qualitative research is the use of open-ended questions. Open-ended questions invite respondents to provide detailed and personalised responses—allowing for a more nuanced understanding of the topic at hand.
This article aims to explore the importance of open-ended questions in qualitative research and share some actionable tips for crafting practical questions. So, let’s dig in!
Before delving into the significance of open-ended questions, let’s first understand what qualitative research entails.
Qualitative research is an exploratory approach that aims to understand the meaning and interpretation individuals attach to their experiences.
Unlike quantitative research, which focuses on numerical data and statistical analysis, qualitative research emphasises in capturing the richness and depth of human experiences through methods like interviews, think aloud usability test, focus groups, and observations.
In the context of usability testing, qualitative research helps uncover users’ thoughts, emotions, and attitudes towards a product or service.
Fundamentally, it provides valuable insights into user behaviour, preferences, pain points, and areas for improvement.
By leveraging open-ended questions, researchers can uncover the underlying reasons behind users’ actions and gain a deeper understanding of their needs and expectations.
Qualitative and quantitative research methods typically differ in their approaches, data collection techniques, and analysis.
For context, quantitative research focuses on numerical data, statistical analysis, and generalizability, while qualitative research seeks to explore and understand specific contexts, meanings, and interpretations.
Furthermore, qualitative research is more subjective, allowing for greater depth and richness of data, while quantitative research prioritises objectivity and generalizability.
Open-ended questions are questions that don’t have predefined or limited answer options. They encourage respondents to provide detailed and personalised responses, allowing them to express their thoughts, feelings, and experiences in their own words.
Unlike closed-ended questions, which may be answered with a simple “yes” or “no” or by selecting from a list of options, open-ended questions invite respondents to provide more elaborate and nuanced responses.
Open-ended questions are characterised by several key elements that distinguish them from closed-ended questions, namely:
Open-ended questions play a vital role in qualitative research for several reasons, namely:
Open-ended questions enable respondents to provide more detailed and nuanced responses. By avoiding predetermined options, researchers can capture the richness and complexity of individuals’ thoughts, feelings, and experiences.
This depth of information is invaluable in gaining a comprehensive understanding of the research topic.
Open-ended questions provide researchers with a better understanding of participants’ perspectives, beliefs, attitudes, and experiences.
By allowing individuals to express themselves freely, researchers can gain insights into the underlying reasons behind their actions and decision-making processes.
This deeper understanding is crucial for uncovering the underlying motivations and meanings that drive human behaviour.
Open-ended questions offer flexibility and adaptability in qualitative research. They give participants a platform to present fresh themes, concepts, and viewpoints that the researcher might not have anticipated.
This flexibility allows for the emergence of unexpected insights and encourages a more exploratory and dynamic research process.
Open-ended questions, designed to elicit rich and authentic responses, are essential tools for researchers seeking to unravel the depth of participant perspectives.
Here are some actionable tips to help you master the art of crafting effective, open-ended questions:
Before penning down your open-ended questions, it’s crucial to align them with the overarching objectives of your research. Clear alignment ensures that each question serves a purpose in contributing to the depth and breadth of your study.
For example, if your objective is to understand user satisfaction with a new software interface, frame questions that specifically address different aspects of the UX design , such as navigation, font readability, and functionality.
Ambiguity in questions can hinder the quality of responses. Participants should easily comprehend the intent of each question, allowing them to provide insightful and relevant answers.
Always ensure that your questions are clear, concise, and free of jargon. Test your questions beforehand on a diverse audience to identify any potential confusion and refine them accordingly.
A neutral tone in your questions is essential to minimise bias. Participants should feel free to express their genuine opinions without worrying about the researcher’s judgment.
Avoid injecting personal opinions, judgements, or assumptions into your questions. Instead, present inquiries in an objective and non-directive manner to foster an open and honest exchange.
Creating an environment that encourages participants to open up is vital for qualitative research. Open-ended questions should invite participants to share their thoughts and experiences freely.
Begin questions with phrases that signal openness, such as “Tell me about…” or “Describe your experience with…” Such prompts set the stage for participants to share their perspectives openly.
While open-ended questions provide an initial exploration, supplementing them with probing questions allows researchers to delve deeper into specific aspects.
Probing questions guide participants to elaborate on their initial responses.
After receiving an open-ended response, follow up with probing questions that seek clarification, ask for examples, or explore the participant’s feelings in more detail.
This layered approach enriches the data collected.
Human experiences are often best expressed through stories. Crafting questions that invite participants to share narratives can provide a deeper understanding of their perspectives.
Furthermore, always ask questions that prompt participants to recount specific experiences or share anecdotes related to the topic. Remember, stories add context, emotion, and a human touch to the research data.
All things considered, the effectiveness of open-ended questions lies not only in their form but in the thoughtful application of these tips.
Pitfalls lurk along this path of crafting and using open-ended questions. It is important to be mindful of the common mistakes to ensure the authenticity and reliability of the data collected.
Let’s explore these potential pitfalls and learn how to navigate around them, shall we?
Leading questions subtly guide participants toward a particular response, often unintentionally injecting the researcher’s bias into the inquiry.
These questions can steer participants away from expressing their genuine thoughts and experiences.
Craft open-ended questions with a neutral tone, avoiding any language that may suggest a preferred answer. By maintaining objectivity, researchers create a safe space for participants to share their perspectives without feeling influenced.
Example of a Leading Question:
Leading: “Don’t you think the new feature significantly improved your user experience?”
Revised: “How has the new feature impacted your user experience?”
Double-barreled questions address more than one issue in a single inquiry, potentially causing confusion for participants. This can lead to ambiguous or unreliable responses as participants may not clearly distinguish between the two issues presented.
Always break down complex inquiries into single-issue questions, as this not only enhances clarity but also allows participants to provide specific and focused responses to each component of the question.
Example of a Double-Barreled Question:
Double-barreled: “How satisfied are you with the product’s functionality and design?”
Revised: “How satisfied are you with the product’s functionality? How about its design?”
Complex questions, laden with jargon or convoluted language, can overwhelm participants. When faced with complexity, participants may struggle to comprehend the question, leading to vague or incomplete responses that do not truly reflect their experiences.
Frame questions in clear and straightforward language to ensure participants easily grasp the intent. A well-understood question encourages participants to provide thoughtful and meaningful responses.
Example of an Overly Complex Question:
Complex: “In what ways do the multifaceted functionalities of the application contribute to your overall user satisfaction?”
Revised: “How do the application’s features contribute to your overall satisfaction?”
In summary, open-ended questions are indispensable tools in qualitative research.
They allow UX researchers to explore the complexity and diversity of human experiences, thoughts, and perspectives.
Open-ended questions provide valuable insights that go beyond mere numerical data. It encourages detailed and personalised responses,.
Remember to align the questions with your research objectives, ensuring clarity and neutrality and encouraging openness and storytelling.
Researchers often learn more about their subjects and find valuable insights that drive meaningful research outcomes when they use open-ended questions.
You have successfully subscribed, recent articles, quantitative usability testing tips you should consider.
Feb 27, 2024
UI/UX designers aim to not only create visually appealing interfaces but also ensure that users can interact with their designs effortlessly. In this quest, quantitative usability testing is a fundamental tenet. This in-depth guide seeks to delve into the intricacies...
Nov 30, 2023
Usability testing is a crucial part of the UX design process that helps businesses understand how users interact with their products and identify areas for improvement. One effective approach to usability testing is qualitative testing, which focuses on gathering...
Nov 29, 2023
Within this rapidly evolving technological landscape, unique Generative AI tools and applications have emerged as invaluable companions for both seasoned UX designers and curious user researchers. These tools offer a mosaic of innovative possibilities, serving as...
Understanding user behaviour and preferences is of the utmost importance in the ever-changing field of user experience design. At this stage, user research becomes relevant, providing valuable insights that can inform design decisions. The problem with tried-and-true...
Aug 22, 2023
Human-centred research should always be an integral component of any UI/UX design process than isolated from it. Furthermore, human-centred research approaches should always be flexible, allowing appropriateness to be the key determining factor in the selection of...
Open and close-ended questions are common types of survey questions in research, which is why most people use them to gather data in a survey or questionnaire. Although open-ended and closed-ended questions look very different, many people still mistake one for the other.
Having a clear understanding of the differences between open-ended questions and close-ended questions helps you to create better surveys and get the most objective responses from your audience. This article explores both types of survey questions and explains when to use them in your research.
A close-ended question is a type of survey question that limits respondents to a fixed set of predetermined responses. In other words, it requires the respondent to choose an answer from the limited answer-options listed in the question; the respondent cannot provide answers outside these options.
Close-ended questions are typically used in quantitative research to gather statistical information from respondents. Also; the number of answer-options in close-ended questions is not fixed; there can be 2 or more listed options depending on the objective of the survey.
An open-ended question is a type of survey question that does not restrict respondents to already-provided answer options. An open-ended question requires the respondent to fully express himself or herself as they provide answers to questions.
Unlike close-ended questions, open-ended questions have a broad focus and allow respondents to provide extensive answers. They also give you better insights into the thoughts, expectations, and experiences of the respondent since they can freely express themselves.
Here are 13 differences between Close and Open-ended Questions
A closed-ended question is a survey question that restricts respondents to limited answer-options while an open-ended question is a survey question that allows respondents to communicate their answers without any restrictions. This means that unlike close-ended questions, open-ended questions allow you to provide free-form answers.
Close-ended questions help you to get specific and straight-to-the-point answers from respondents, unlike open-ended questions where you have to filter the information you need from the responses provided. Close-ended questions provoke simple responses while open-ended questions provoke complex responses.
Examples of open-ended questions include; “how do you think this fits into your work?”, “what do you think about our service delivery?” and “describe how this product meets your needs?”, among others. On the other hand, examples of close-ended questions include:
As seen in the above-listed samples, close-ended questions are precise and quite definite. Open-ended questions, as shown above, are structured in a way that they elicit a variety of responses from survey participants. This means that open-ended questions allow for more flexible responses.
Common types of close-ended questions include dichotomous questions and multiple-choice questions. A dichotomous question contains binary answer-options and is typically structured as yes/no questions or true/false questions while multiple-choice questions provide respondents with multiple answer options that can be structured as checkboxes or radio choices.
On the other hand, common types of open-ended questions include what, where, when, and how questions. These are questions that typically require the respondent to provide more than a single-word answer, and fully describe their thoughts and experiences in line with the assertion or subject matter.
The objective of close-ended questions is to help the researcher collect statistical information that can serve as quantitative data while the purpose of open-ended questions is qualitative data collection. Open-ended questions allow you to gain better insights into the minds of the respondents.
Close-ended questions aim to obtain precise and specific information from respondents on a defined subject matter. Here, you want to eliminate unnecessary information and simply focus on collecting well-tailored information that is useful to the specific research context or the assertion that is being considered.
Unlike close-ended questions, listing open-ended questions in your survey allows you to gather a variety of data from respondents. In other words, it allows for an infinite number of possible answers which lends further credibility to your research findings in the end.
Another huge advantage of open-ended questions over close-ended questions is that they allow you to collect more data from respondents. Unlike close-ended questions, open-ended questions are crafted to provide respondents with ample opportunity to express themselves fully and provide clarity on responses.
Unlike open-ended questions, close-ended questions are quick and easy to answer and this helps you to save time; especially when it comes to large-scale data collection. This means that you can gather data swiftly using close-ended questions while open-ended questions can create a time-lag during data collection.
Another advantage of close-ended questions over open-ended questions is that close-ended questions result in data that is easy to process and analyze. Since close-ended questions gather statistical information, it is easy for you to code and analyze these pieces of information.
Open-ended questions are used when you want to collect qualitative data while close-ended questions can be to collect both quantitative and qualitative data. Open-ended questions allow you to gather free-end information about the research subject matter while close-ended questions allow you to gather numerical information for statistical analysis of the research context.
Close-ended questions are used when you want to collect precise and specific information from respondents. Close-ended questions are important in quantitative research because they help you to collect numerical data from respondents.
Close-ended questions collect quantitative data while open-ended questions collect qualitative data. Quantitative data refers to data whose value is measured in the form of numbers or counts, with a unique numerical value associated with each data set while qualitative data is the type of data that describes the information.
Observation, interviews, and focus groups are common data collection methods for open-ended questions. On the other hand, close-ended questions are asked via quantitative data collection methods like surveys and questionnaires.
These qualitative data collection methods used for open-ended questions create a context that allows respondents to fully communicate their ideas and thoughts with the researcher. In the same vein, quantitative research methods like surveys and questionnaires used for close-ended questions help you to gather precise responses at the right time.
It takes a longer period for respondents to provide answers to open-ended questions. This is because open-ended questions require the respondents to provide detailed accounts of their thoughts, expectations, and experiences as is relevant to the research context.
On the other hand, close-ended questions can be completed in a shorter time frame because they are brief and straight to the point. Also, answer options are already provided in close-ended questions. So, all the respondent needs to do is choose an option that best reflects his or her position.
Data collected via open-ended questions are usually reported as an individual or grouped verbal responses while the data provided from responses to close-ended questions are typically reported as statistical information. This is because close-ended questions result in data that is quantifiable unlike what is obtainable in open-ended questions.
Asking open-ended questions in your survey or questionnaire can result in gathering a lot of irrelevant information. This is because open-ended questions are not designed to streamline responses. Instead, they allow respondents to provide as much information as they want to in response to a question.
Close-ended questions, on the other hand, allow you to collect precise and streamlined information from respondents. Close-ended questions provide a set of limited answer options that are already streamlined to suit the research contexts and needs of the systematic investigation.
Interviews and focus groups are common contexts for open-ended questions while high volume mobile surveys are common contexts for close-ended questions. This is because interviews and focus groups often require qualitative responses unlike high volume mobile surveys that require precise and specific responses.
In your Formplus surveys, you can include open-ended questions and close-ended to help you gather data from respondents in the best way. As a survey tool, Formplus has different features and form fields that make it easy for you to ask close and open-ended questions in your survey.
Here’s how to create open and close-ended questions using Formplus.
Close and open-ended questions are important in research as they help you to gather quantitative and qualitative data from respondents. Both question types apply to specific contexts that rarely overlap – close-ended questions restrict respondents to limited options while open-ended questions allow respondents to provide as much information as they want.
As a researcher, you need to know what close-ended and open-ended questions are plus how you can use each of these in your research. Getting familiar with different types of survey questions; especially knowing their strengths and weaknesses, helps you to create more effective surveys.
Connect to Formplus, Get Started Now - It's Free!
You may also like:
Everything you need to know about job evaluation. Importance, types, methods and question examples
Ultimate guide to understanding open ended questions, examples, advantages and questionnaire examples in surveys & research
Ultimate guide to understanding close ended questions, examples, advantages and questionnaire examples in surveys
This article outlines 25 great NPS survey questions to help you gather feedback from your customers
Collect data the right way with a versatile data collection tool. try formplus and transform your work productivity today..
What is an open-ended question? An open-ended question is one that can only be answered by a unique thought or statement in someone’s own words. Unlike a closed-ended question, it cannot be answered in one word, or by yes/no, or by multiple choice. Open-ended questions encourage people to incorporate more of their own information and point of view.
For stronger connections, better insights , and more business, experts recommend one conversational tool above all in the demo or discovery phase: open-ended questions. Profile writers use them all the time to elicit thoughts and anecdotes from their subjects.
Smart marketers also use them to maximize authentic engagement with new business leads and current clients. However, there’s a method and skill required to ask open-ended questions… and part of it is realizing and leveraging the other, equally important benefits of asking closed-ended questions.
In this article, we’ll go over the best habits to get into for asking open-ended questions, when to use closed-ended questions instead, scenarios when you might need to use both, the different ways they impact data collection , and some examples of open versus closed questions as used in marketing, sales, and content interviews.
But first, a little teaser of examples for each approach…
An open-ended question is one that can only be answered by a unique thought or statement in someone’s own words — it cannot be answered in one word, or by yes/no, or by multiple choice. Open-ended questions encourage people to come up with a more thoughtful and filled-out answer incorporating more of their own information and point of view.
People who want to keep an exchange of information and flow of thoughts going with whomever they’re interviewing will generally stick with open-ended questions. These questions encourage interviewees to explore their “why” and to give context to their decisions.
They illuminate the reasoning behind decisions and opinions. In interviews, they help the writer/producer get to know and understand a subject… and then pass that insight along to readers.
They can be used at any time when it’s more important to the interviewer to elicit thoughts and opinions and insights than to get definitive answers.
Situations may include:
We’ve briefly touched upon closed-ended questions just to compare with open-ended ones. Now, let’s define exactly what they are and in what scenarios it’s better to use them.
Closed-ended questions require one specific answer — either a yes/no or a choice between a few options. Sometimes they’re in pursuit of a fact, and sometimes a decision. These types of questions are used to collect quantitative data , which can be mapped out on charts or graphs.
The answers are also used to come up with numerical ratings of how a company is performing or meeting customer expectations. When used by salespeople, closed-ended questions can also be a tactic to assess how cold or warm a lead is, and to move the sales process along.
For interviewers such as writers, closed-ended questions are often used to establish background facts about a topic or person. They can also be used for winding up an exploratory Q+A session with some definitive conclusions.
You see this on reality TV interviews often. One person shares her drama with another cast member, explores the person’s possible motivations, speculates on her intentions, and then the interviewer asks: Do you trust that person? No. Do you still think of her as a friend? No.
It puts a bow on the conversation and lets viewers know where the storyline is headed.
Let’s have a look at the different purposes they serve, how they complement each other, what kind of data they garner, and how each can be used in our three scenarios (a sales call, a marketing exercise, a writers’ interview).
For sales professionals.
When you’re in sales, open-ended questions are good for understanding more about your customer and opening up a real dialogue. Closed-ended questions are good for getting prospects to let you know whether they have any intentions of signing a contract any time soon.
Sales example 1:
CLOSED : Were you happy with your former [agency/SaaS provider/other competing product or vendor]? OPEN : What was it about your former [competing product/vendor] that has you looking for a new vendor?
Sales example 2:
CLOSED: Are you satisfied with your current sales numbers? OPEN : Where would you like your business to grow from here?
Sales example 3:
CLOSED : Have you ever executed the kind of project/campaign we specialize in before, either on your own or with a different partner? OPEN : Tell me about a case study or existing campaign/project in the market that is in this category that you really like. It can be one of your own, or another company.
Sales example 4:
CLOSED : (after a product demo) Do you have any questions? OPEN : We went through a lot of information just now. What part stood out to you the most, either because you loved it or because you’d like a little more time to understand?
Sales example 5:
CLOSED : (after going through prices) Does this fall more-or-less into the budget range you have in mind? OPEN: Could you tell me how you’d want to customize a scope-of-work or what services would be important to you? That way I can come up with a price quote.
Sales example 6:
CLOSED : What’s your main goal that you’re hoping I can help with? OPEN : What are your immediate and also your big-picture goals?
Sales example 7:
CLOSED : Are you interested in buying/subscribing to/getting a membership to the product I’ve shown you today? OPEN : Now that we’ve previewed our product/service together, what are you thinking your next step will be?
Sales example 8:
CLOSED : When would you like to set a follow-up? OPEN : Can you give me a few dates for a follow-up call?
Sales example 9:
CLOSED : Do you feel like you got all the information you needed? OPEN : Before we wrap, can you tell me what you’d like to look over again — either here or as an email follow-up?
Sales example 10:
CLOSED : On a scale of 1-10, how would you rate our team’s service up to this point? OPEN : Please share anything specific that stood out to you about the service you’ve received from our team so far.
Marketers are constantly interacting with customers, stakeholders, current clients and leads — their lives are an interesting mix of collecting data and fostering connection.
Just look at a social media manager’s day-to-day: Half may be spent analyzing paid campaign results and crunching numbers. The other half may be spent following up on an angry customer’s Facebook tirade or getting people’s permission to use content for UGC.
Today’s marketer needs to be able to flip from analyzing facts to feelings, balance trends with tried-and-true, ask closed-ended to open-ended questions instantaneously, and then explain their findings to the non-marketers that they work with or are hoping to work with soon.
Marketing example 1:
CLOSED : Are you satisfied with the quantity and quality of new business leads you’re currently getting? OPEN : What are your thoughts on the new business/lead-gen process at your company as it is now?
Marketing example 2:
CLOSED : What is your #1 goal? OPEN : What would success look like to you?
Marketing example 3:
CLOSED : Have you considered putting your budget toward X channel or tactic? OPEN : What channels and tactics do you feel are important to include in your next marketing plan?
Marketing example 4:
CLOSED : Did you like your competitor’s latest campaign/commercial? OPEN : What campaigns are out there right now that caught your eye, and for what reason?
Marketing example 5:
CLOSED : Which of the four logos shown here is best in your opinion? OPEN : Why did that one stand out to you?
Marketing example 6:
CLOSED : On a scale of 1 to 10, how satisfied were you with the information provided on our website? OPEN : What areas/sections do you think we can improve and how?
Marketing example 7:
CLOSED : Did you like the first version of the video I just sent over? OPEN : If you had a chance to watch the video I sent, what’s your feedback?
Marketing example 8:
CLOSED : What’s your budget for this activation/campaign/partnership? OPEN : There are a few ways we’ve discussed that a partnership could play out. How flexible is your budget if I were to send three different options?
Marketing example 9:
CLOSED : Are you mainly looking at reach, engagement or conversion as the key metric to gauge success in this campaign? OPEN : Let’s discuss what KPIs will be used to determine success in this campaign.
Marketing example 10:
CLOSED : Can we move forward with X project at $X budget for the dates presented? OPEN : We are ready to answer any final questions you might have before moving forward with this project.
One pitfall that’s common and you really need to be cautious of with experts and executives is the false open-ended question. This is a question phrased so it could lead to a personal anecdote or insight, but could also be answered with a “No.”
While experts and execs usually like to talk about their work , they will sometimes answer something with a simple “No” because they haven’t thought about it before, and they don’t really have an opinion.
All the open-ended sample questions here are crafted to avoid the possibility of a “No.”
Interview example 1:
CLOSED : What’s your job title? OPEN : How would you describe your professional specialty/expertise /niche?
Interview example 2:
CLOSED : What’s your focus right now? OPEN : Tell me one of your key focuses right now and why you’re interested in it.
Interview example 3:
CLOSED : Do you like X trend? OPEN : Name three of your favorite trends in our industry right now and why you like them.
Interview example 4:
CLOSED : What would you consider your key accomplishment in your field to be? OPEN : Please walk us through the accomplishment that gave you the most satisfaction in your career.
Interview example 5:
CLOSED : What degrees, awards or certifications do you have? OPEN : Of the degrees and awards you’ve received, which would you say are the most meaningful, and why?
Interview example 6:
CLOSED : Was it difficult to transition from [#1 well-documented career] to [#2]? OPEN : You successfully transitioned from [#1 well-documented career] to [#2]. Explain to us how that happened.
Interview example 7:
CLOSED : Can you tell us who will be in your next project/speaking at your next event? OPEN : How do you choose collaborators or speakers for your projects/events?
Interview example 8:
CLOSED : Where can someone go to learn more about what you do? OPEN : What are a couple day-to-day practices of yours that people can implement for greater success/fulfillment in their own lives?
Interview example 9:
CLOSED : What’s new/next for you? OPEN : What upcoming project or venture are you most excited about and why?
Interview example 10:
CLOSED : What social channels can we find you at? OPEN : If we all go follow you on Instagram or Twitter, what kind of content are we going to see?
While open-ended questions are a buzzword among salespeople and business coaches right now, we think the proper mix of open- and closed-ended is essential to any discovery process.
If you understand the difference between them, know how and for what purpose to use each, and can rework a closed-ended question into an open-ended question on the fly when needed, then you’re halfway to being a great interviewer .
Whether in sales or medical research or journalism, questions are a means to create connections and explore stories. They’re also a way to get useful data. One leads to the “why,” and the other leads to the “yes.”
Now that you’re an expert on open and closed-ended questions, you’ll be a master at creating authentic engagement with your brand. But if you need some help, ClearVoice has got you covered. Our managed content creation and expert teams can help you produce content that can maximize your brand’s growth and impact. Connect with us here to see how.
We will keep you up-to-date with all the content marketing news and resources. You will be a content expert in no time. Sign up for our free newsletter.
Transform your marketing with a consistent stream of high-quality content for your brand.
surveys | December 18, 2019
Daniel Ndukwu
Customer research is a large discipline with multiple methods to get the right information from your audience or customer base.
Surveys are among the most effective ways to get deep insights from your most engaged users. It helps you understand how they feel about specific topics and give you perspectives – through open-ended questions – you might have otherwise missed.
These insights, also known as the voice of the customer , can expand your marketing , improve your products, and cancel out objections. In a world of choice, this is becoming even more important.
In this article, you’ll learn what open-ended questions are, their advantages, how to use them, and solid examples to make them easier to implement.
Table of Contents
Open-ended questions are a type of unstructured survey question that allows the respondent more room to reply in an open text format thereby providing the opportunity to give more detailed answers. The only limitation usually imposed is a character limit so open-ended questions can be divided into long answer and short answer questions.
Put another way, a respondent can draw on their knowledge, feelings, and understanding of the question and topic to give more insightful answers. They’re not limited by preset question options.
An example of an open-ended question could be “how do you feel about your new job?”
Research from Vision Critical found that 87% of consumers want to have a say in a company’s products and services. Open-ended questions give them the opportunity to share information in a way that close ended questions don’t.
As shared in the last section, open-ended questions are free-form and allow respondents to use an open text format to give replies. They’re able to say whatever they want in response to your questions.
Close ended questions, on the other hand, are structured and have a preset group of questions a respondent can answer. Though they can still help you, you’re not able to use the voice of the customer to inform your decisions.
Each one has merits and demerits. For example, an open-ended question allows you to probe much deeper but a close ended question allows you to get concise information that can be quantified. It’s much easier to quantify yes or nos than a paragraph of text.
A relatable example comes from the standardized tests most of us took in school. They usually had two parts – the multiple-choice questions which are equivalent to close ended questions and the essay questions which are equal to open-ended questions.
A close ended question: Yes or No – Was George Washington was the first president of the United States?
An open-ended question: From the perspective of the British, what was the cause of the Revolutionary War?
As you can see from the examples, the open-ended survey questions will give you a look into the thought process of your customers.
Some advantages are obvious while others aren’t but they tend to be more important than the disadvantages because the responses you get have so many direct tangible uses for your business. A few of the advantages include:
With a series of multiple-choice questions, respondents can quickly scan and choose an answer. That answer may or may not be indicative of how they feel. Open-ended questions force your respondents to slow down long enough to consider the question and give a thoughtful answer.
Even if they give a short answer that doesn’t shed much light on the situation, it’s still helpful. It tells you the respondent’s answers shouldn’t have as much weight.
The internet is crowded. The lifespan of a Tweet is about 30 minutes and that of a Facebook post is roughly 1 hour. Anything you say is lost in a short amount of time.
With surveys and open-ended questions, you give your customers an opportunity to voice their opinions and create in a way that can create change in your organization. If they like what you’re doing and care about your products then they’ll take the time to give you useful feedback.
Close ended questions are notorious for only giving you half the answer you need. For example, if you ask a customer “how was your experience with us today?” and they answer “disappointing”, there’s no room to ask them why. This can leave you wondering if you have a real problem.
An open-ended question gives them the opportunity to tell you it was disappointing and lay out the reasons why. With that information, you can determine if it was an isolated incident or something that demands immediate attention.
Open-ended questions were built to deliver qualitative information and, like we talk about in our free course , the more detailed the information you get from a respondent the more engaged they are.
That information is indicative of your hottest buyer segment and the details they reveal will help you create better messages, identify your ideal target market , and otherwise make the right decisions in your business.
The key to using the extra information these types of survey questions can give you is to look for patterns in the data. If one person says something then you may or may not be on the verge of a breakthrough. If five or ten people say something similar then there’s promise.
These questions lend themselves well to qualitative research. That means they should be used when quality is more important than the quantity of data.
In other words, it’s used when you want to use the answers to find deep insights into the mind of your target audience. For example, you’d use them in the following situations:
Unfortunately, you can’t always use open-ended questions. Sometimes, a quick answer is ideal. For example, you want to know if someone has heard of your brand before. There’s no need to wax poetic about the possible reasons why they’ve not heard of it. Yes or no will do.
There are multiple situations in which free-form questions would do more harm than good. A few of them include:
There is a right way and a wrong way to ask questions – especially open-ended questions. Like all surveys, you want to collect unbiased data so you can make decisions that move the needle in the right direction. The wording of your questions can have a big impact on how its perceived by your respondent.
Surveys are not the time to convince someone of your view or to purposely elicit a positive response. Avoid wording that would predispose someone to answer positively or negatively.
For example, a question like “we’re considered a market leader and have over 10,000 customers, what do you think about our company?” is biased. It predisposes the respondent to give you positive feedback.
Consider talking to a team member or an impartial third party and showing them your questions to ensure they’re not biased. Put yourself in the shoes of the respondent and ask yourself if the question makes you feel positively or negatively towards the person asking.
This method is a staple of consumer research. The most effective surveys ask a close-ended question and, depending on how the respondent answers, an open-ended question is used as a follow-up. It helps focus the respondent and bring out insights that would otherwise be missed by a close-ended question.
Another benefit of using these two questions together stems from getting qualitative and quantitative answers. You’re able to say X people were dissatisfied with the product and X people were satisfied. For the ones who were dissatisfied, these are the reasons and places where we can improve.
At times, it can be difficult to determine if a closed or open question will be better for your needs. There’s a quick way to determine the best type. If you want the reasons behind an answer then use open-ended. If you want the raw answer without explanations then use the close ended questions.
Of course, this should be determined on a case by case basis. When in doubt, it may be a better idea to change the question or exclude it altogether. It’s more important to get clean data.
Phrase your questions so they’ll help you understand the reasons and emotions behind an answer. Instead of “How would you describe your support experience today?” Ask “how do you feel about your support experience today?”
The difference is subtle but it can help you understand the emotions associated with an experience or product. If it’s a negative sentiment then you can take steps to change that. If it was a positive sentiment then you can focus on doubling down on what’s working.
1. how does x make you feel.
This question leans towards an emotional response instead of a purely objective one. It’s helpful when finding marketing copy that incorporates the voice of the customer.
This question is useful because it helps reveal psychographic information and can also help you uncover different ways to position your products. For example, you can be the perfect widget for bike enthusiasts.
This works on two separate levels. You can find out which advertising channels are working and the reason why people are seeking you out. This will help refine your messaging.
The question above reveals unbiased information about how your products are perceived. You’re asking the customer to say what they think is good (or bad) about your products.
This question is direct and assumes that there’s room for improvement in your products and services. Use with caution because it may force your respondent to find problems where none exist.
This, again, is a direct question that may force users to mention things they don’t truly like. Use with caution.
Questions like these help you derive insights that make your products fit seamlessly into the lives of your target market. If your people like to work out at home, you can create products that cater to that preference. If they like to travel by road, you can create relevant products.
The X here can be general or specific depending on what you chose to focus on. For example, “what do you like about our customer service or what do you like about our company?” One of the questions gives a broad answer and the other is focused.
The opposite perspective of the previous question open-ended question.
These questions focus on the direct improvement of a product or service. For example, what can we do to make your support experience better?
This question may not be ideal for a standard questionnaire because it works best in real-time. Instead, you can use it in your live chat or chatbots to engage people at the point of purchase.
There are multiple ways to go about customer research. One of the most powerful and inexpensive is surveys.
They can give you deep insights from a large number of people in a relatively short amount of time. This article has gone through everything you need to know to make effective open-ended questions to improve your business and grow your audience.
Let me know what you think in the comments and don’t forget to share it.
What is an open-ended question.
Open-ended questions are a type of unstructured survey question that allows the respondent more room to reply in an open text format and provides the opportunity to give more detailed answers
This depends on the situation and your goals. Open-ended questions give more insights but close ended can help with quantification of responses.
Good evening, My name is Cristina Raffaghello, Adjunct Professor at Eastern Piedmont University in Vercelli and online e-campus University Novedrate, Italy. In my opinion, your article is useful for teaching, as well. Do you think I may use in my course of Germanic Philology? This discipline regards the origin and development of Germanic languages (English, German, Frisian Gothic and Islandic) from linguistical, juridical, historical and literary viewpoints. I thank you for your attention. Cheers, Cristina
Of course Cristina, you’re free to use it to teach your students.
I want to write research proposal on knowledge and practices on malnutrition amongst women can I use open or closed questionnaire
Both, of course. It depends on the kind of data you’re looking for and how well-versed you are on the topic before conducting the research.
This is so interesting
Inspiring, educative. I am doing a qualitative research study, and I find both open and closed.-ended questions fitting
Your email address will not be published. Required fields are marked *
This site uses Akismet to reduce spam. Learn how your comment data is processed .
Asking questions increases your likeability. But the way you ask questions matters too. Ask open-ended questions to boost your conversations!
Did you know? When you ask someone questions about themselves, it makes you more likable 1 https://dash.harvard.edu/handle/1/35647952 !
But research shows, the way you ask a question 2 https://hbr.org/2018/05/the-surprising-power-of-questions makes a big difference, too.
Watch our video below to learn how to start a conversation with anyone using these killer conversation starters:
Some of the best conversations start with open-ended questions that lead people to open up and form deeper connections.
In this article, we’ll look at open-ended questions, their benefits, and various scenarios where you can use them to boost your conversation skills (and likeability!).
Open-ended questions are questions that are designed to encourage people to share more than a one-word response and typically start with words like “what,” “how,” or “why.” Open-ended questions help people expound on an idea or issue and carry the conversation forward without getting stunted in potentially awkward silence or little to no information for someone else to bounce off of.
Some of the best places to use open-ended questions include:
“Ask questions the other person will enjoy answering.” —Dale Carnegie
To avoid stunting your conversations, you may want to stay away from closed-ended questions. But what’s the difference? Let’s look at how to avoid those awkward silences.
Closed-ended questions lead people to give a one-word response like “yes” or “no,” whereas open-ended questions are great conversation starters or boosters that help bring energy to an interaction.
How you ask or write open-ended vs. closed-ended questions comes down to a few simple adjustments to the words you choose to ask your question.
To write a more open-ended question, think about where you want to lead the conversation and consider adjusting your opening words.
Open-ended questions often begin with words like this:
Closed-ended questions tend to start with words like this:
Closed-ended questions may not always lead to “yes” or “no” responses. Sometimes they can lead to short answers as well. For example:
Closed-ended: What’s your favorite color?
The answer to this question will likely be something short, like “blue.”
One simple way to turn this question into an open-ended question is not necessarily to dismiss the closed-ended question altogether, but to follow it up with an open-ended question as well. For example:
Open-ended: What’s your favorite color and why?
It should be noted that there is a time and place for closed-ended questions. They are not inherently “bad,” but they generally don’t work as well to keep conversations going.
Did you have fun at the party? | What did you enjoy most about the party? | |
Do you like your job? | What do you like most about your job? | |
Are you enjoying the event? | How has this event been beneficial for you? | |
Are you an organized person? | How do you stay organized in your daily tasks? | |
Do you like working here? | What do you enjoy about working at this company? | |
Did the project go well? | What aspects of the project went well? | |
Can we solve this problem? | What are some possible solutions to this problem? | |
Do you need this product? | How do you see this product benefiting you? | |
Would you recommend our service? | Why would you recommend our service? | |
Are you feeling okay? | How are you feeling today? | |
Do you have any symptoms? | What symptoms have you been experiencing? | |
Did you have a good day at school? | What was the best part of your day at school? |
Why are open-ended questions important? Some of the best conversations are generated from open-ended questions that lead people to open up and form deeper connections.
Here are some of the other benefits of open-ended questions:
Now that we understand what open-ended questions are and their benefits let’s dive into the best scenarios where we can use them with examples for each category.
Open-ended questions for any social gathering.
Open-ended questions are great for any social situation, and we have lots of great question ideas to spark conversation with anyone . Here are a few to get you started!
If you want to get to know someone on a deeper level, using thoughtful, open-ended questions is a great way to get there. They’re also a great way to boost someone’s self-esteem by making you appear more engaged and interested in what they have to share. Here are a few open-ended questions to ask on a date!
For more dating icebreakers, try one of these 131 non-awkward ideas !
Networking events are classic places for open-ended questions and icebreakers with people you’re meeting for the first time. Want to avoid awkward silence? Use an open-ended question!
Job interviews are a great place for both the interviewer and the interviewee to ask open-ended questions to help understand what each other is bringing to the table to inform better decision-making.
Questions for interviewers :
Questions for interviewees :
Fostering strong team dynamics is essential for achieving success in any collaborative environment. These open-ended questions are designed to break the ice, deepen connections, and unlock the full potential of your team during team-building activities.
Open-ended questions, when you give and receive feedback, are a great way to open up a conversation and understand where the other side is coming from more clearly. Here are some questions you can ask after a project is complete:
Pro Tip: Receiving feedback can be tough—and how you respond to it can make all the difference. Check out this goodie to learn more:
Do you struggle with small talk? Do you often run out of things to say or feel awkward and self-conscious in social situations? 💪 Speak so people listen, 🤐 No more awkward silences, 🚫 No more small talk.
Open-ended questions used in brainstorming sessions are a great way to get people’s juices and ideas flowing as they begin to open up their imaginations. Here are a few questions to get you started in your next brainstorming session.
Open-ended questions during a sales conversation help salespeople understand the needs of their customers and make them feel heard and understood. Here are some open-ended sales questions to put your potential customers at ease:
Great leaders inspire, motivate, and guide their teams to achieve remarkable goals. These open-ended questions will help you uncover insights, identify strengths, and foster growth in your leadership journey.
Open-ended questions are a great way for researchers in any industry to explore and expound upon their data, including some of the close-ended, quantitative responses.
For example, a survey might say, “Would you recommend our services to a friend?” They might then ask an open-ended question like, “Tell us why you would recommend our services to a friend.” to explore the qualitative data behind the close-ended response.
Note that most of the questions below are written in the context of a product or service. However, survey questions vary by industry and purpose (e.g., scientists!). The most important thing to remember is to keep open-ended questions specific to your intention of providing qualitative data you can learn from.
Open-ended questions are common for counselors or therapists to ask clients because they help them process their feelings and thoughts more clearly. Here are a few open-ended questions you might hear during therapy:
Open-ended medical questions 3 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8758184/ are helpful for those in healthcare 4 https://samples.jbpub.com/9781449652722/9781449645106_ch01_001_036.pdf to get a deeper understanding of the issues their patients might be experiencing. Here are some examples of open-ended questions from a doctor or nurse you might hear as a patient:
Mentorship and coaching are crucial if you want to have career success. Think of the most successful people you know, and chances are they’ve had a mentor (or two, or three…). Here are the best questions to ask any mentor.
If you’ve gotten into an argument recently, chances are you could’ve asked better questions. The next time you’re fired up, try shifting your tone and ask one of these questions:
Gathering detailed customer feedback is crucial for improving products and services. These open-ended questions will help you gain valuable insights into your customers’ experiences, needs, and expectations.
Asking kids how their day is will often receive a short response. (Any parents out there relate?!) But if you can frame your questions to inspire them to share, you might be surprised by their openness (this goes for preschoolers all the way up to high schoolers!).
Employers and potential employers ask open-ended questions to give them a better understanding of who you are and what you’re capable of. Open-ended questions during the interview process often provide an opportunity for the interviewee to share stories about how they solved problems, overcame obstacles, or succeeded in a specific project. They also provide answers that help employers better determine whether or not to hire someone. Open-ended questions are also an excellent way for employers to understand the processes their current employees go through so they can provide better feedback.
Close-ended questions should be asked when you need a specific answer. An open-ended question should be asked when you’re interested in qualitative information or a better understanding of someone’s unique experience. In a survey, for example, you might want to ask a close-ended question for a data point that needs to be measured, like, “Do you recommend this product?” However, to understand someone’s unique experience, you might ask an open-ended question like, “Why don’t you recommend this product?” In the context of social interaction, close-ended questions are OK when you’re looking for specific information: “When do you want to grab lunch?” However, you would ask an open-ended question to learn more about someone’s unique perspective: “What are your favorite lunch places in the neighborhood?”
Open-ended questions are a common tactic used by educators for inquiry-based learning 5 https://d1wqtxts1xzle7.cloudfront.net/38355914/Inquiry-Based-Learning-A-Review-of-the-Research-Literature-libre.pdf?1438472393=&response-content-disposition=inline%3B+filename%3DINQUIRY_BASED_LEARNING_LITERATURE_REVIEW.pdf&Expires=1676601224&Signature=hFKNPTf9w6x9MK2vtolCLyxTEPrToKIUbngjfUcMD1k0ysfIxdCO9e17W7fq05xuxg7PchrnhN~Hj-e1xtQLukITO8vOIdyjFixsxXJGUvbLnC5hYDLAgj57m9KnCIrtPDrmUayHcosQHKW444ZHeFyjKx5l37wdMQ13gTWL8sE68~52fGwIJjbmPceD8qriRRKhU~-~UzVU7-8KLQC-7b~qCYR0wFNnVo2-Gc8IVxZQKyyrh8RM30XENLItoxyWt2wsP2HQTSxd7Jp5YugB7qNVlEOLWxZUSzAdQxDbfJ3rxHk2I3B8XttrQ2fKvUXOrGNtBO~rxMCLc6pPbWMO9A__&Key-Pair-Id=APKAJLOHF5GGSLRBV4ZA . This method is used because open-ended questions often inspire greater curiosity and problem-solving. For example, rather than telling a student what to think, they are thoughtfully guided with open-ended questions to explore solutions to problems.
In summary, remember these benefits of open-ended questions.
For more conversation-starter ideas, check out our article for 57 killer conversation-starters to start a conversation with anyone.
Popular guides, how to deal with difficult people at work.
Do you have a difficult boss? Colleague? Client? Learn how to transform your difficult relationship. I’ll show you my science-based approach to building a strong, productive relationship with even the most difficult people.
Science of People offers over 1000+ articles on people skills and nonverbal behavior.
It’s a privilege to be in your inbox. We promise only to send the good stuff.
Discover the power of open-ended vs. closed-ended questions in research. Learn how each type influences insights, efficiency, and data collection
Do you ever feel like stakeholders undervalue your organization's impactful programs? Clearly communicating program success can be a challenge, leading to a disconnect and funding difficulties. This article tackles a critical tool for success: the art of crafting the right questions .
Well-designed questions, whether open-ended or closed-ended , are the foundation for effectively communicating your program's impact to stakeholders. Open-ended questions can capture the voices and experiences of stakeholders, while closed-ended questions provide valuable data for quantifying program effectiveness. By understanding the strengths and weaknesses of each approach, you can design surveys that:
This article will guide you through the power of question design, helping you choose the right approach to unlock stakeholder impact and secure the funding you deserve.
Open-ended questions allow respondents to provide unrestricted, qualitative responses in their own words. These questions typically begin with phrases like "how," "what," or "why," encouraging respondents to express their thoughts, feelings, and opinions freely. Examples of open-ended questions include "What factors influenced your decision?" or "How do you feel about this product?"
On the other hand, closed-ended questions offer respondents a set of predetermined response options to choose from. These questions often require a simple "yes" or "no" answer or ask respondents to select from a list of predefined options. Closed-ended questions are designed to elicit specific, quantitative responses and are often used to gather structured data efficiently. Examples of closed-ended questions include "Did you purchase this product?" or "Which of the following options best describes your experience?"
One of the primary advantages of open-ended questions is their ability to capture rich, detailed responses. By allowing respondents to elaborate on their thoughts and experiences, open-ended questions provide researchers with a deeper understanding of complex issues. These responses can reveal unexpected insights, uncovering nuances that closed-ended questions may overlook.
Moreover, open-ended questions empower respondents to express themselves in their own words, fostering a sense of ownership and authenticity in their responses. This approach can lead to more honest and insightful feedback, as respondents feel valued and heard throughout the research process.
Additionally, open-ended questions are versatile and adaptable to various research contexts. They can be used to explore a wide range of topics and are particularly well-suited for exploratory research, hypothesis generation, and qualitative data analysis. Researchers can gain valuable insights into respondents' perspectives, attitudes, and behaviors, providing a holistic view of the subject under study.
Closed-ended questions offer several advantages, particularly in terms of data collection efficiency and analysis. By providing predefined response options, these questions enable researchers to gather standardized data quickly and easily. This structured approach streamlines the data collection process, allowing researchers to collect large volumes of data efficiently.
Moreover, closed-ended questions facilitate quantitative analysis, as the responses can be easily categorized and quantified. Researchers can use statistical techniques to analyze and interpret the data, identifying patterns, trends, and correlations with precision. This quantitative approach is particularly valuable for making data-driven decisions, evaluating hypotheses, and measuring the effectiveness of interventions or treatments.
Additionally, closed-ended questions minimize respondent burden by providing clear and concise response options. Respondents can answer these questions quickly, reducing survey fatigue and improving overall response rates. This efficiency is especially beneficial in large-scale research studies or surveys conducted in time-sensitive environments.
While both open-ended and closed-ended questions offer distinct advantages, choosing the right approach depends on the research objectives, context, and target audience. In many cases, a combination of both types of questions may be most effective, allowing researchers to gather comprehensive data while balancing the need for depth and efficiency.
For exploratory research or when seeking in-depth insights into complex phenomena, open-ended questions are invaluable. They encourage respondents to share their perspectives openly, uncovering nuanced details and diverse viewpoints. Researchers can use qualitative analysis techniques, such as thematic coding or content analysis, to identify patterns and themes within the data, enriching their understanding of the subject matter.
In contrast, closed-ended questions are well-suited for research scenarios that require standardized data collection and quantitative analysis. They enable researchers to measure attitudes, behaviors, and preferences systematically, facilitating comparisons across groups or time periods. Statistical analysis techniques, such as descriptive statistics or inferential tests, can be applied to closed-ended data to draw meaningful conclusions and make evidence-based recommendations.
Open-ended and closed-ended questions are two fundamental types of questions used in surveys, interviews, and research studies. Each type has its own strengths and weaknesses, and the choice between them depends on the goals of the data collection process.
Feature | Open-Ended Questions | Closed-Ended Questions |
---|---|---|
Response Type | Descriptive, detailed | Predefined options |
Data Type | Qualitative | Quantitative |
Examples | "What are your thoughts on our new product?" | "Did you like our new product? (Yes/No)" |
Analysis | Complex, time-consuming | Simple, quick |
Depth of Insight | High, rich detail | Low, limited detail |
Ease of Response | Requires more effort | Easy, quick |
Use Case | Exploring new topics, understanding experiences | Measuring specific variables, comparing responses |
Risk of Bias | Lower, as responses are freeform | Higher, depends on how options are framed |
Open-ended questions are a cornerstone of qualitative research, providing a window into the deeper thoughts, feelings, and motivations of respondents. They are particularly effective when you need nuanced insights or varied perspectives that structured data cannot capture. To craft effective open-ended questions:
Focus on the Specific : Tailor questions to gather specific information that aligns with the research objectives. For instance, instead of asking "What do you think about our product?" refine it to "What specific features do you like most about our product, and why?"
invite detailed and descriptive answers. Consider using phrases such as "describe in detail," "explain how," or "what led you to," which guide respondents to delve deeper into their experiences and reasoning. This approach not only enriches the data but also brings forth the nuances of personal narratives and insights.
Equally crucial is the formulation of questions that remain neutral, avoiding any language that might steer respondents toward a specific answer. This practice is fundamental to preserving the objectivity of the data collected, ensuring that the insights gained are a genuine reflection of the respondent's thoughts and not influenced by the wording of the question.
Moreover, a well-designed survey question should accommodate a spectrum of perspectives. By framing questions broadly enough, researchers can capture a diverse array of responses, thereby reflecting the varied experiences and opinions of all participants. This inclusivity enriches the data set and provides a more comprehensive understanding of the surveyed group.
In gathering open-ended responses, the goal is to create a platform where each voice and experience can articulate itself freely and distinctly. This approach not only respects the diversity of the respondent pool but also enhances the depth and breadth of the insights gained from the research.
Before launching a survey broadly, it’s crucial to test the open-ended questions with a smaller, representative group. This preliminary phase aims to ensure that the questions effectively elicit the type of responses anticipated. Observing how these respondents interact with the questions provides invaluable insights, allowing for adjustments and refinements to the survey based on actual feedback. This iterative process helps fine-tune the questions to better capture the depth and variety of data needed.
To streamline and enhance this process, employing a modern qualitative data analytics platform like Sopact Sense can be transformative. Sopact Sense dramatically reduces the time and effort traditionally required for data analysis, condensing months of work into mere minutes. With its advanced capabilities, it offers 30 times better accuracy, facilitating both inductive and deductive analysis approaches. Researchers can utilize bottom-up pattern analysis to identify emerging themes without prior assumptions, or apply top-down strategies to test specific hypotheses or code responses post-collection.
Furthermore, Sopact Sense enables detailed demographic filtering, empowering researchers to dissect data layers and uncover genuine causality and correlations. This capability is particularly valuable in understanding how different groups perceive and respond to various issues, enhancing the overall quality and applicability of the research outcomes. By integrating such advanced tools into the survey design and testing phase, researchers can achieve a more dynamic, responsive, and precise exploration of the data they collect.
To ensure that analytics efforts align closely with key organizational goals and foster actionable outcomes at an individual stakeholder level, it’s essential to craft a narrative that integrates both qualitative and quantitative data. This approach allows for a comprehensive understanding of how initiatives are impacting stakeholders, highlighting necessary adjustments and future strategies.
Creating a Comprehensive Narrative:
By meticulously linking each story to the most important analytics goals and utilizing a narrative that blends qualitative depth with quantitative rigor, organizations can not only achieve a more thorough understanding of their impact but also engage stakeholders in a meaningful way that promotes sustained improvement and strategic decision-making.
Creating closed-ended questions for surveys involves a meticulous design process to ensure that the quantitative data collected is accurate, clear, and meaningful. These types of questions are pivotal for confirming hypotheses, measuring trends, and obtaining data that are straightforward to analyze statistically. Here’s how to enhance the effectiveness of closed-ended questions in your surveys:
To begin, it’s crucial that each closed-ended question provides specific, mutually exclusive categories. This step is essential to cover all possible responses, thus eliminating any potential ambiguity or overlap. For example, if you're asking about frequency of service usage, your options should range clearly from 'Never' to 'Daily' without any vague terms in between. This clarity ensures that the data you collect can be analyzed straightforwardly, leading to more reliable insights.
Using balanced rating scales, such as Likert scales, can significantly enhance the quality of the data gathered. These scales should offer an equal number of options on either side of a neutral option (if one is included) to ensure an unbiased distribution of responses. For instance, a satisfaction survey might use a scale from 'Very Dissatisfied' to 'Very Satisfied' with 'Neither Satisfied nor Dissatisfied' as a midpoint. This balance helps in minimizing response biases, providing a more accurate picture of respondent sentiments.
Each question should be formulated to be as clear and straightforward as possible. The language used needs to be simple enough that respondents do not require additional information or context to give an answer. This approach reduces the risk of misinterpretation and ensures that responses are based on the respondents’ true opinions and experiences. An example might be using "Do you agree that the customer service was helpful?" instead of a more complex phrasing that could confuse the respondent.
Sometimes, even well-designed questions might not capture all possible respondent experiences. In such cases, including an 'Other' option with a space for respondents to specify their answer can be invaluable. This option acts as a safety net, capturing data that might otherwise be missed and offering insights that could lead to new discoveries or considerations in your analysis.
Before deploying the survey to a larger audience, conduct a pre-test with a small, representative group. This testing helps ensure that the questions are understood as intended and that all potential responses are adequately covered. Gather feedback on the clarity of the questions and the adequacy of the response options. Use this feedback to make necessary adjustments, refining your survey to better meet its objectives.
When these elements are carefully integrated into the design of closed-ended questions, the resulting data becomes a powerful tool for statistical analysis and decision-making. These questions not only streamline the data collection process but also enhance the precision and applicability of the insights gained. By rigorously crafting and testing your closed-ended questions, you ensure that the survey effectively measures the intended variables and yields high-quality data that can support robust conclusions and strategic actions.
Incorporating both open and closed-ended questions in surveys can significantly enhance the data collection process by melding the depth of qualitative feedback with the quantitative data's scope. This dual approach proves invaluable in multifaceted research areas, where understanding the underlying reasons behind behaviors, decisions, or preferences is key.
Sequential Integration : Begin with closed-ended questions to collect broad data, then follow up with open-ended questions to delve into specific areas of interest more deeply. This technique helps provide a contextual backdrop for the quantitative findings through rich qualitative insights.
Parallel Integration : Simultaneously employ open and closed-ended questions regarding the same subject within a survey. This strategy captures a wide array of data, offering both statistical comprehensiveness and insightful qualitative depth.
Iterative Design : Utilize initial survey responses to refine or introduce new questions that probe deeper into significant themes that arise. This responsive design allows the survey to evolve based on real-time insights, making it highly adaptive to the research needs.
By strategically combining these approaches, researchers can leverage the strengths of both qualitative and quantitative methodologies, resulting in more rounded and actionable data.
For more detailed strategies on mixed-method surveys, refer to the guide provided by Sopact. Learn more about mixed-method surveys at Sopact .
In conclusion, the choice between open-ended and closed-ended questions is a critical consideration in research design and data collection. Each type of question offers unique advantages and limitations, influencing the depth, efficiency, and quality of insights obtained. By understanding the strengths and weaknesses of both approaches and selecting the most appropriate method for each research context, researchers can maximize the value of their findings and generate meaningful contributions to their field.
We're sorry to hear that. How can we improve?
Thanks for your feedback! Let us know how this article helped:
Still need help.
So you have decided to conduct a usability test for your product —so as to understand your product from the users’ perspective. You then realize that you have to come up with relevant questions to ask participants.
“ That sounds like a piece of cake ,” some may presume.
Writing effective usability questions seems deceptively easy, but the harsh reality is it’s not as simple as you may think it is. There are quite a number of mistakes to avoid .
How you phrase your questions will directly impact the quality and value of your user testing results. Ask your participants the wrong questions, or use the wrong words to structure the questions, and you will gather incorrect feedback. Wrong questions can contaminate the whole research —leading to misleading quantitative data and qualitative data.
Before you come up with any usability questions, there is a great need for creative thinking, which involves answering the question – what you intend to learn from the test. Begin by asking yourself this: what information do I need from this research ?
Taking time to answer that question will help you narrow down all the possible wrong directions you might head before getting to the qualitative data or quantitative data you need. The ultimate goal could be as simple as finding out if users will click on your search result listing.
When you have a clearly defined goal, writing usability questions isn’t a task that is hard to do.
By default, your usability questions could either be open-ended questions or close-ended questions.
Whenever we conduct any user research at Invesp, our conversations with our participants have a natural rhythm.
We ensure this by using open-ended questions and closed-ended questions in unison.
This article will explore open-ended questions and close-ended questions in great detail, focusing on how to write them and when to use them.
An open-ended question is what it is: a question that is open to any answer. In the context of user research, open-ended questions are questions that do not limit users to one- or two-word answers. Instead, they have multiple potential responses, and they often give room for further probing by the moderator.
Open-ended questions are versatile in nature, and they prompt users to describe their feelings and thoughts in their own voice. In this regard, the Digital Marketing Evangelist for Google, Avinash Kaushik , says:
The greatest nuggets of insights are in open ended questions because it is the Voice of the Customer speaking directly to you (not cookies and shopper_ids but customers).
There is something about asking open-ended questions that makes participants feel more comfortable during a usability test . People, in general, tend to open up and express themselves better when they are given room to answer in their own words.
For example, rather than asking, “Was the new feature easy to use?” You can try something like, “How would you describe your experience of using the new feature?”
The most common response to the first question would have been, “ Yes, it was ” or “ No, it wasn’t ” and there was no way you could have understood the context behind the user’s response. But the second question allows users to respond freely, and there is a high chance of getting unique answers that you might not have anticipated.
Open-ended questions are ideal for starting and holding a conversation in any circle. They empower users, giving them 100% control of what they intend to say —and this is something that cannot be done using closed-ended questions.
Coming up with the right kind of questions requires practice. There’s an art to asking questions that prompts people to think before giving a response. Unless it’s an open-ended question, not every question you ask your users will motivate them to give a detailed answer. Here are a few tips that will help you write effective open-ended questions.
What makes a question open-ended is the wording of the sentence. For an effective open-ended question, start the question with words such as how, what, why, and can. This way, you give your users freedom to say more, and in the process, there is a possibility of uncovering rich insights.
Avoid using more specific words such as did, would, which, when and was —these usually prompt one-worded answers.
For example, a question like “ Which part of your experience was unsatisfactory ?” does not evoke users to give in-depth details about what they found unsatisfactory with the application. Instead, you can elicit users to reflect on their experience and give a more insightful response if you ask it this way “ What challenges did you face during your experience with XYZ ?”.
Here are a couple more examples of how to attain a more precise answer by changing the wording of your question:
Was our product easy to use? | What do you think about our product? |
? | ? |
Did anything persuade you to use our product? | What persuaded you to use our product among other products? |
Ensure that your question requires users to be analytical and to clarify their points. One defining trait of an open-ended question is its ability to propel users to put more thought to their responses.
Analytical questions do not require users to generalize their answers. For instance, in a Conversion Optimization research, you might ask your participants these questions:
All these three questions are different, but they all have one thing in common: they would require participants to be clear and describe their answers in more detail.
By motivating users to give clarity in their responses, open-ended questions can also be used as a way of motivating their participants to verify their answers, especially when your previous question was closed-ended.
Suppose you ask this close-ended question: “Did you find the product you were looking for?” you can then verify the given answer by asking this follow-up open-ended question: “Why were you looking for that product?”
In any research approach, open-ended questions are asked so as to elicit valuable insights from users, not to confirm the moderator’s existing beliefs. So, if your questioning subtly prompts users to answer in a certain way or gives hints at the expected answer, then you need to revise the phrasing of your questions.
The wording of the question shouldn’t be suggestive of any answers to the participants as this biases the users into giving a predetermined answer.
Let’s say you ask this question: “ Which feature made you visit our site ?”
The problem with this question is that already suggests an answer for the users. It implies that it’s a feature that made users visit the site. Come to think of it, what if it wasn’t a feature but a service that lured the users to the site?
You can use these sample questions as conversation starters and to also make your participant explain more.
1. How satisfied or dissatisfied are you with this process?
2. What would (did) you expect to happen when you … ?
3. Did you find it?
4. How would this fit into your work?
5. How might this change the way you do that today?
6. What do you think about that?
7. What kinds of questions or difficulties have you had when doing this in the past?
8. What happened when you did this before?
9. Please describe your level of experience with …
10. What’s most confusing or annoying about … ?
11. What worked well for you?
12. How do you know … ?
13. How do you normally … ?
14. What just happened?
15. What was that?
16. What would you most want to change about … ?
17. Which things did you like the best about … ?
18. What were you expecting?
Open-ended questions in UX research are used to gather qualitative data and gain insights into users’ thoughts, feelings, and behaviors.
These types of questions allow participants to provide detailed and unstructured responses rather than simply choosing from a set of pre-determined options.
To ask open-ended questions in UX research, you can use prompts such as:
When asking open-ended questions, it is important to create a comfortable and non-threatening environment for participants and to listen and probe actively for more information as needed. Additionally, it is important to avoid leading questions and to keep the question open-ended to gather unbiased answers.
In some situations, the only way to get valuable insights is to give respondents some sense of control over the conversation by allowing them to answer in their own words. There is a high chance of bumping into something completely unique and valuable if you allow users to have the freedom to express themselves.
SalesHacker made an interesting observation about interactive discussions prompted by open ended questions: when you have a conversation with your potential customers, and they talk for at least 30% of the time, your conversion sales will likely increase. But if they talk for less than 30% of the time, your sales conversion rates will drop.
With open-ended questions, you are not only guaranteed an increase in sales, but they can also help you:
However, not all open-ended questions are good. In an article written by Business 2 Community, they gave examples of some of the “ bad open-ended questions ” that won’t work well in sales:
The essence of an effective CRO program is not only based on getting tactics right and testing this and that, but it’s also about knowing the mindset of your customers. You first have to see your product or service from the customer’s lens to deliver a product or the services they desire.
One way of getting into the customer’s head is by asking open-ended questions.
In this regard, JeremySaid put out a handy list of questions you can ask your current customers when you intend to increase your conversion rate. Here are some of the open-ended questions they recommended:
The more you let your customers feel comfortable, the more they will reveal what drove them to consider purchasing your product. So, whether you are conducting a usability test, focus group, customer interviews, or surveys , keep your customers TALKİNG and use the information to your advantage. And the best way of doing this is by opening up the conversation.
If you can imagine a question restricting participants to a set of predefined answers , then that’s a close-ended question. It aims to get precise and clear-cut answers — without leaving any room for users to express themselves.
According to Wikipedia :
A close ended question refers to any question for which a researcher provides research participants with options from which to choose a response. Close ended questions are sometimes phrased as a statement which requires a response. A close ended question contrasts with an open ended question, which cannot easily be answered with specific information .
Asking closed-ended questions will give you specific answers, aka quantitative data. Do they want to purchase your product? Are they shopping around with your competitors for the same service? The answers are simple and direct.
Although close-ended questions provide limited insights, that doesn’t make them any less important. In most cases, close-ended questions are used in a quantitative research approach where insights gathered are numerical.
Close-ended questions have their place in user research, and they are wonderfully effective in guiding participants into giving certain answers.
For example, you conduct a usability test to determine if your app store listing will convert well. So you ask your participants this question:
Which of the following pieces of information made you download this app on the Play Store?
From this example above, the question eliminates any element of surprise by setting boundaries for the participants’ responses. Participants are not expected to give an answer outside the set of predefined responses.
So, if close-ended questions do not require participants to express themselves, then isn’t that a disadvantage? Well, it is. Respondents are biased into responding in a certain way. But sometimes, it’s necessary to use these types of questions in user research as they make it easier and quicker for respondents to answer .
Although close-ended questions have different forms, they all have this in common: they are similar in the kind of answer they draw out from the respondents — clear-cut answers.
Specific questions are precise, clearly defined and they leave no room as to the intended meaning. At times, they come as multiple-choice questions that consist of two sections: (1) the stem which is the question itself and (2) a list of response alternatives, choices or answers that respondents will have to select an answer from.
Example : Suppose you want to evaluate your marketing channels and find out which platform is your brand more visible in. So you ask your participants:
How did you first learn about our product/website?
As alternative responses to the question, you can give these to your participants:
Among all kinds of questions, specific or multiple-choice questions are considered to be the most versatile type of questions. In user research, you can use specific questions to discover facts or to gain an understanding of user behavior.
If anything is said to be implicit, then it means that it is not directly pointed out, but it is somehow suggested in the statement. So, an implicit statement is as an expression that prompts a certain reaction .
With that said, what then is an implicit question ?
An implicit question can be defined as a leading question that gives hints about the type of answer needed. Think of them as leading questions , that pushes participants to respond in a specific manner.
Example : If you ask users this question: How many times do you visit our website ?
Using “ how many times” in the above question implies that the participants have visited the website before. There is an element of conjecture and assumptions and in this case, participants are persuaded to give a numerical answer.
If the question was to be phrased as a direct question, it would have been:
Have you ever visited our website?
This second question doesn’t influence the participants’ responses —and this means that the question doesn’t cultivate any biases in respondents.
Close-ended questions should not always be thought of as simple questions that anyone can easily answer merely because they do not require a detailed answer.
To make a question a close-ended, there is a certain way you should phrase it. In his book Conversationally Speaking , Alan Garner suggests that you use these few words to begin close-ended questions:
Using these words, here’s a list of some examples of close-ended questions you can use:
None of these closed-ended questions prompt participants to give detailed answers. They all can be answered with a one-word answer , as they aim to find out the ‘ what’ and not the ‘why’ .
Needless to say, when you ask a clear and simple question, you allow the possibility of a clear-cut answer. So the starting point is to remove extra verbiage that may end up distracting or confusing the respondents.
Good example : Would you recommend our website ?
Bad example : You have used the website for more than 10 minutes and you have visited all the pages and clicked on all, so does it mean that you will recommend our website to other people?
Once you frustrate users with wordy questions, you risk compromising the value of your feedback. Here’s a list of clear and simple close-ended questions :
Having clear and simple close ended questions won’t just make it easy for users to infer the intended meaning, but you, as a moderator, will understand the given answers without any hassles.
If you intend to use multiple-choice questions, then make sure that your suggested answers are plausible. Participants usually have different experiences even after using the same product, so you should have several alternative answers that best describe answers.
Use at least four alternatives in each multiple-choice question so as to give users a variety of alternatives.
Generally, an online poll can have close-ended questions and open-ended questions as long as they require short feedback. But to give users a simple experience, you can use close-ended questions as they are easy to answer and do not require a detailed answer. Since they require limited answers, Susan Farrell from Nielsen Norman Group says this:
Closed ended questions are often good for surveys , because you get higher response rates when users don’t have to type so much. Also, answers to closed ended questions can easily be analyzed statistically, which is what you usually want to do with survey data.
Here’s an example of one of the close-ended questions we use on the FigPii polls. The question asked users the reason for their visit on the site and it allowed them to select one answer from four alternatives.
Such close-ended questions which have multiple-choice forms have higher completion rates as users do not have to come up with their own responses. Although the answers given provide a general sentiment of insights, you can always follow up with an open-ended question so as to see things from the users’ perspectives.
For instance, you can ask users to further elaborate on their answers by asking this as a follow-up:
What is the most important feature of our product/service for you ? This way you can understand the context behind the users’ decisions.
Considering that they don’t demand much explanation from the respondents, close ended are perfect in quantitative usability research where you’d need to measure usability metrics such as task completion rates, error rates, and post-task satisfaction.
Insights gained using close ended questions allow researchers to categorize respondents based on the answers they have selected. How so?
Let’s say you have an online store, and you need to know the demographics of people who visit(ed) your site and left without completing a purchase. To decipher this demographic information, you can conduct an online survey that asks these close ended questions:
Question 1: Can you please specify your gender?
Question 2: You are in which age group?
Question 3: What is your annual income range?
This knowledge would help you target the right kind of marketing campaign to the exact customers you’d want to attract.
Similarly, the Nielsen Norman Group gave this list that indicates when to use close ended questions. Here are the situations where you should use this type of questions:
Whenever you hear any CRO consultant or agency saying that they will fish out all the ‘ barriers that inhibit conversion’ on your site, all they mean is that they will ask relevant questions until they achieve better results.
In this CRO business, assumptions can ruin what might have been a good relation with your customers. Foster the culture of asking questions, after all, the source of valuable knowledge is attained through asking questions.
So, whether it’s open-ended or closed-ended you decide to use, make sure you can answer Yes to the following questions before coming up with any questions:
1. Open ended questions and close ended questions: What they are, and how they affect user research.
2 . 6 DTC ecommerce websites with killer value proposition.
3. 11 customer service psychology secrets that go down the funnel, not the drain.
Join 25,000+ marketing professionals.
Subscribe to Invesp’s blog feed for future articles delivered to receive weekly updates by email.
Home Surveys Question Types
When designing surveys , we often need to describe whether to use open-ended questions versus closed-ended questions to get specific information. Yet we need to be aware that open-ended and closed-ended questions have their strengths and weaknesses and perform in different ways.
Open-ended are those questions that a sender makes to encourage one or several receivers to obtain some information in response. For example: Where is my wallet?
LEARN ABOUT: Testimonial Questions
Open-ended questions are free-form survey questions that allow and encourage respondents to answer in open-text format to answer based on their complete knowledge, feeling, and understanding. The detailed response to this question is not limited to a set of options.
Unlike a closed-ended question that leaves survey responses limited and narrow to the given options, an open-ended question allows you to probe deep into the respondent’s detailed answers, gaining valuable information about the subject or project. The responses to these qualitative research questions can be used to attain detailed and descriptive information on a subject.
LEARN ABOUT: course evaluation survey examples
They are an integral part of Qualitative Market Research . This research process depends heavily on open and subjective questions and answers on a given topic of discussion or conversation, with room for further probing by the researcher based on the answer given by the respondent. In a typical scenario, closed-ended questions are used to gather qualitative data from respondents.
Learn more: Qualitative Research- Definition, Types, Methods and Examples
Respondents like open-ended questions as they get 100% control over what they want to respond to, and they don’t feel restricted by the limited number of options. The beauty of the process is that there can never be a one-word answer. They’ll either be in the form of lists, sentences or something longer like speech/paragraph.
So, to understand this more, here are some open-ended question examples:
In a study conducted by Pew Research, respondents were asked, “What mattered most to you while deciding how you voted for president?” One group was asked this question in a close-ended question format, while the other was asked in an open-ended one. The results are displayed below:
In the close-ended questions format, 58% of respondents chose “The economy”. In the other format, only 35% wrote an answer that indicated “The economy.” Note that only 8% of respondents selected “Other” in the format of the close-ended question. With an open-ended format, 43% of respondents wrote in a response that would have been categorized as “Other.”
Open-ended questions motivate the respondents to put their feedback into words without restricting people’s thoughts. They aren’t as objective and dominant as close-ended questions.
Close-Ended Questions | Open-Ended Questions |
Do you like working with us? | Tell us about your experience with our organization so far. |
Have you been stressed lately? | Share with us what has been troubling you. |
How satisfied are you with your current job role? | What do you expect from this appraisal? |
By using these leading questions, the researcher understands the respondents’ true feelings. They have an element that will give you information about different thought processes across your clientele, troubleshooting suggestions, and getting a peek into their inhibitions too.
So what does this mean for us? If you can, do qualitative research first and ensure your close-ended questions represent the items in people’s heads. We need the list of items to be complete since few respondents will select the “Other” category. It may also be necessary to list items not readily available to respondents if they are important to you.
LEARN ABOUT: Survey Sample Sizes
When presenting results , I have found it helpful to explain the fundamental differences between open-ended and closed-ended question examples in a sentence or two. It helps them understand that these are not necessarily precise measurements but measurements that require some interpretation relative to other questions in the survey and additional information from steps in qualitative research . Hence, that is why they need an analyst like you or me!
Unrestricted opinions:.
The customers need a platform to voice their opinions without limits on the answers. Happy or unhappy. As answer options for questions aren’t provided, the respondent has the liberty to include details about good life, feelings, attitudes, and views that they usually wouldn’t get to submit in single word answers.
These questions are more appreciative of the respondents than close-ended questions as users aren’t expected to just “fill” them out for the sake of it.
Respondents may stun you with the vision and creativity they show with their more detailed answers. Links to their blogs or a verse or two of their poetry will leave you spellbound.
If there are only close-ended questions in a microsurvey, the users usually get disconnected and fill it out without giving it much thought. With the kind of freedom that open-ended questions offer, users can respond the way they’d like to, be it the number of words or the details or the tone of the message.
LEARN ABOUT: Send Surveys Using Text Message
These responses may be marketing tips for improving the organization’s branding or some creative ideas that can lead to monetary gains in future.
Knotty situations need more than just a mere Yes/No feedback. Single-select or multiple choice questions cannot do justice to the detail process or scrutiny required for some critical and complex situations.
These questions work best in situations where the respondents are expected to explain their feedback or describe the troubles they’re facing with the products.
You can learn from your respondents. The open-ended questions offer the freedom to these respondents to be vocal about their opinion that would be insightful for a company.
Respondent logic, thoughts, language, and reference choices can be known from these questions that can reveal a lot about how the respondent’s brain functions.
Always think before designing a survey as to what your objective is. Scrutinize the purpose, evaluate the positives and negatives of using an open or closed answer for your research study. Try it by sending out to a selected database, analyzing the results, and planning improvements for the next round of surveys.
LEARN ABOUT: Speaker evaluation form
Everything easy or complicated requires competence. Asking the right question is also one such thing that requires capabilities. Capability to understand and segment the target audience , determine the kind of questions that will work well with that audience, and determine the efficiency of them.
Here are four ways to create effective open-ended questions:
Before you start putting questions to paper, you need to have absolute clarity on open-ended vs closed-ended questions . Your objective of sending out an online survey should be clear, and based on that, you can evaluate the kind of questions you would want to use. These are usually used where the feelings and feedback of the customer are highly valued. To receive 100% transparent feedback on these questions, make sure that you don’t lead the respondents with your questions and give them complete liberty to fill in whatever they want.
Once you get clarity on what are open-ended questions and how to implement them, figure out a list of survey questions that you’d want to use. First, you can have a fair share of open-ended questions in your survey, which can fluctuate depending on your responses.
LEARN ABOUT: Social Communication Questionnaire
Examples of open-ended questions like these are extremely popular and give you more value-added insights:
Observation is the key here. Observe what kind of questions you usually ask your customers, prospects, and every other person you come across. Analyze whether your questions are closed-ended or open-ended. Try and convert those closed questions into open-end ones wherever you think the latter would fetch you better results and valuable insights.
This trick works wonders. It’s not always possible to convert a closed question into an open one, but you can follow up by getting a question answered.
For example, if you have a closed question like – “Do you think the product was efficient?” with the options “Yes” and “No”, you can follow it up with an open question like “How do you think we can make the product better in future?”
Regarding surveys, the advantages of open questions surpass that of closed ones.
1. Goto: Login » Surveys » Edit » Workspace
2. Click on the Add Question button to add a question.
3. Select Basic, then go to the Text section and select Comment Box.
4. Enter the question text.
5. Select the data type: Single Row Text, Multiple Rows Text, Email address, or Numeric Data.
6. Select the Text Box Location (below or next to question text). Enabling “next to question text” will put the text box to the right of the question.
1. Click on Login » Surveys » Analytics » Text Analytics » Text Report
Please note that analysis for open-ended text questions is not included in the Real-Time Summary or Analysis Report. To view the analysis of open-ended questions, you can see the Word Cloud report.
LEARN ABOUT: Easy Test Maker
You can set the limit of the number of characters that respondents can enter in the textbox.
To make the question mandatory, you can toggle the validation on and select ‘Force Response’. It is off by default. When ‘Force Response’ is not enabled, respondents can continue with the survey without selecting answers. If respondents go through all the pages in the online questionnaire without selecting answers, the response is still considered complete. You can enable the required option to make a question required so that respondents can continue with the survey only after responding to the questions.
LEARN ABOUT: Structured Questionnaire
Closed-ended questions, like open questions, are used in both spoken and written language and in formal and informal situations. It is common to find questions of this type in school or academic evaluations, interrogations, and job interviews, among many other options.
LEARN ABOUT: This or that questions
Whether you need a simple survey tool or a collaborative research solution, with our Academic licenses for universities and educational institutions, you get access to all the best features used by our Enterprise research clients.
Open-ended questions are essential to note that crafting practical open-ended questions requires skill and careful consideration. Questions should be clear, concise, and relevant to the topic. They should avoid leading or biased language, allowing individuals to express their views without undue influence.
Overall, open-ended questions are powerful to gather information, foster communication, and gain deeper insights. Whether used in research, professional settings, or personal conversations, they enable individuals to explore ideas, share perspectives, critical thinking of a person, and engage in meaningful discussions. By embracing the openness and curiosity of open ended questions, we can uncover new knowledge, challenge assumptions, and broaden our understanding of the world.
Jul 10, 2024
Jul 9, 2024
Jul 8, 2024
Are you an agency specialized in UX, digital marketing, or growth? Join our Partner Program
Learn / Blog / Article
Back to blog
Unless you’re a mind reader, the only way to find out what your users are thinking is to ask them. That's what surveys are for.
But the way you ask a question often determines the kind of answer you get—and one of the first decisions you have to make is: are you going to ask an open-ended or a closed-ended question?
Reading time.
Understanding the difference between open-ended and close-ended questions helps you ask better, more targeted questions, so you can get actionable answers. The question examples we cover in this article look at open- and closed-ended questions in the context of a website survey, but the principle applies across any type of survey you may want to run.
Start from the top or skip ahead to
What’s the difference between open-ended and closed-ended questions?
4 tips on how to craft your survey questions for a maximum response rate
5 critical open-ended questions to ask customers
When to ask open-ended questions vs. closed-ended questions
Open-ended questions are questions that cannot be answered with a simple ‘yes’ or ‘no’, and instead require the respondent to elaborate on their points.
Open-ended questions help you see things from a customer’s perspective as you get feedback in their own words instead of stock answers. You can analyze open-ended questions using spreadsheets , view qualitative research and data analysis trends, and even spot elements that stand out with word cloud visualizations.
Closed-ended questions are questions that can only be answered by selecting from a limited number of options, usually multiple-choice questions with a single-word answer (‘yes’ or ‘no’) or a rating scale (e.g. from strongly agree to strongly disagree).
Closed-ended questions give limited insight, but can easily be analyzed for quantitative data . For example, one of the most popular closed questions in market research is the Net Promoter Score® (NPS) survey, which asks people “How likely are you to recommend this product/service on a scale from 0 to 10?” and uses numerical answers to calculate overall score trends. Check out our NPS survey template to see this closed-ended question in action.
Let’s take a look at the examples of open-ended questions vs. closed-ended questions above.
All the closed questions in the left column can be responded to with a one-word answer that gives you the general sentiment of each user and a few useful data points about their satisfaction, which help you look at trends and percentages. For example, did the proportion of people who declared themselves happy with your website change in the last three, six, or 12 months?
The open-ended questions in the right column let customers provide detailed responses with additional information so you understand the context behind a problem or learn more about your unique selling points . If you’re after qualitative data like this, the easy way to convert closed-ended into open-ended questions is to consider the range of possible responses and re-word your questions to allow for a free-form answer.
💡 Pro tip : when surveying people on your website with Hotjar Surveys , our Survey Logic feature lets you ask follow-up questions that help you find out the what and the why behind your users’ actions.
For more inspiration, here are 20+ real examples of open- and closed-ended questions you can ask on your website, along with a bunch of free pre-built survey templates and 50+ more survey questions to help you craft a better questionnaire for your users.
Or, take advantage of Hotjar’s AI for Surveys , which generates insightful survey questions based on your research goal in seconds and prepares an automated summary report with key takeaways and suggested next steps once results are in.
Use Hotjar to build your survey and get the customer insights you need to grow your business.
It’s often easy to lead your customers to the answer you want, so make sure you’re following these guidelines:
Some customers may find it hard to leave negative feedback if your questions are worded poorly.
For example, “We hope there wasn’t anything bad about your experience with us, but if so, please let us know” is better phrased neutrally as “Let us know if there was anything you’d like us to do differently.” It might sting a little to hear negative comments, but it’s your biggest opportunity to really empathize with customers and fuel your UX improvements moving forward.
“You bought 300 apples over the past year. What's your favorite fruit?” is an example of a leading question . You just planted the idea of an apple in your customers' mind. Valuable survey questions are open and objective—let people answer them in their own words, from their own perspective, and you’ll get more meaningful answers.
Tacking “and why?” on at the end of a question will only give you simple answers. And, no, adding “and why?” will not turn closed-ended questions into open-ended ones!
Asking “What did you purchase today, and why?” will give you an answer like “3 pairs of socks for a gift” (and that’s if you’re lucky), whereas wording the question as “Why did you choose to make a purchase today?” allows for an open answer like, “I saw your special offer and bought socks for my niece.”
Not many folks love filling in a survey that’s 50 questions long and takes an hour to complete. For the most effective data collection (and decent response rates), you need to keep the respondents’ attention span in mind. Here’s how:
Keep question length short : good questions are one-sentence long and worded as concisely as possible
Limit the number of questions : take your list of planned questions and be ruthless when narrowing them down. Keep the questions you know will lead to direct insight and ditch the rest.
Show survey progress : a simple progress bar, or an indication of how many questions are left, motivates users to finish your survey
Now that you know how to ask good open-ended questions , it’s time to start putting the knowledge into practice.
To survey your website users, use Hotjar's feedback tools to run on-page surveys, collect answers, and visualize results. You can create surveys that run on your entire site, or choose to display them on specific pages (URLs).
Different types of Hotjar surveys
As for what to ask—if you're just getting started, the five open-ended questions below are ideal for any website, whether ecommerce or software-as-a-service:
If you missed the expectations set by a customer, you may have over-promised or under-delivered. Ask users where you missed the mark today, and you’ll know how to properly set, and meet, expectations in the future. An open platform for your customers to tell you their pain points is far more valuable for increasing customer satisfaction than guessing what improvements you should make. Issues could range from technical bugs to lack of product range.
An open “How did you find out about us?” question leaves users to answer freely, without leading them to a stock response, and gives you valuable information that might be harder to track with traditional analytics tools.
We have a traffic attribution survey template ready and waiting for you to get started.
A “What is stopping you?” question can be shown on exit pages ; the open-form answers will help you identify the barriers to conversion that stop people from taking action.
Questions like this can also be triggered in a post-purchase survey on a thank you or order confirmation page. This type of survey only focuses on confirmed customers: after asking what almost stopped them, you can address any potential obstacles they highlight and fix them for the rest of your site visitors.
Finding out the concerns and objections of potential customers on your website helps you address them in future versions of the page they’re on and the products they’ll use. It sounds simple, but you’ll be surprised by how candid and helpful your users will be when answering this one.
Do you want to gather feedback on your product specifically? Learn what to improve and understand what users really think with our product feedback survey template and this expert advice on which product questions to ask when your product isn't selling.
Learning what made a customer click ‘buy now’ or ‘sign up’ helps you identify your levers. Maybe it’s low prices, fast shipping, or excellent customer service—whatever the reason, finding out what draws customers in and convinces them to stay helps you emphasize these benefits to other users and, ultimately, increase conversions.
Whether you’re part of a marketing, product, sales, or user research team, asking the right questions through customer interviews or on-site surveys helps you collect feedback to create better user experiences and increase conversions and sales.
The type of question you choose depends on what you’re trying to achieve:
Ask a closed-ended question when you want answers that can be plotted on a graph and used to show trends and percentages. For example, answers to the closed-ended question “Do you trust the information on [website]?” helps you understand the proportion of people who find your website trustworthy versus those who do not.
Ask an open-ended question when you want in-depth answers to better understand your customers and their needs , get more context behind their actions, and investigate the reasons behind their satisfaction or dissatisfaction with your product. For example, the open-ended question “If you could change anything on this page, what would it be?” allows your customers to express, in their own words, what they think you should be working on next.
Not only is the kind of question you ask important—but the moment you ask it is equally relevant. Hotjar Surveys , our online survey tool , has a user-friendly survey builder that lets you effortlessly craft a survey and embed it anywhere on your web page to ask the right questions at the right time and place.
Related articles.
User research
Whether you’re running focus groups for your pricing strategy or conducting usability testing for a new product, user interviews are one of the most effective research methods to get the needle-moving insights you need. But to discover meaningful data that helps you reach your goals, you need to connect with high-quality participants. This article shares five tips to help you optimize your recruiting efforts and find the right people for any type of research study.
Hotjar team
After the thrill of a successful user interview, the chore of transcribing dialogue can feel like the ultimate anticlimax. Putting spoken words in writing takes several precious hours—time better invested in sharing your findings with your team or boss.
But the fact remains: you need a clear and accurate user interview transcript to analyze and report data effectively. Enter automatic transcription. This process instantly transcribes recorded dialogue in real time without human help. It ensures data integrity (and preserves your sanity), enabling you to unlock valuable insights in your research.
Shadz Loresco
Customer interviews uncover your ideal users’ challenges and needs in their own words, providing in-depth customer experience insights that inform product development, new features, and decision-making. But to get the most out of your interviews, you need to approach them with empathy. This article explains how to conduct accessible, inclusive, and—above all—insightful interviews to create a smooth (and enjoyable!) process for you and your participants.
There are many factors to consider when collecting feedback to ensure that you gather the desired information. The way you phrase a question can have a significant impact on the quality of answers and data. You can call it fascinating or simply brain-racking. In the end, you can divide survey questions into two categories: closed-ended questions (for quantitative data) or open-ended questions (for unstructured, more qualitative data).
A closed-ended question refers to any question for which a researcher provides research participants with options from which to choose a response.
On the other hand, an open-ended question is a question that cannot be answered with a “yes” or “no” response, or with selecting a predefined category.
As you might have noticed, most surveys are based on closed-ended questions, comprised of nominal, ordinal, or interval scales . Closed-ended questions are mostly easy for survey participants to answer, but obtain a limited set of data, which simplifies survey administration. Because closed-ended questions are easy to answer, they might be the preferred approach for some study designs, depending on the purpose of the survey. Furthermore, the responses can be easily coded and analysed.
Closed-ended questions are great for gathering insights, comparing results and measuring effects, but they have limitations. They don’t encourage personal reflection or explanations, leaving the “why” and deeper thoughts behind answers unexplored. Luckily, open-ended questions can unlock these insights and provide valuable context. By using open-ended questions, you can discover rich, unanticipated perspectives from respondents.
Qualitative research is now more accessible and less resource-intensive thanks to advances in technology. You can enhance your quantitative results by including qualitative questions that allow for greater depth and richness in responses. Take advantage of this by incorporating open-ended questions in your survey to unlock new insights and perspectives.
Overwhelmed by too many open text answers? You’ve got to try Text Analysis!
Asking open-ended questions in a survey can be a powerful tool for gaining deep insights into the thoughts, feelings, and experiences of your respondents. Open-ended questions allow people to share their ideas and perspectives in their own words, giving you a wealth of information that can help you make informed decisions.
Use open-ended questions when you want to dive deeper into a topic or when you’re looking for new ideas and fresh perspectives. By asking open-ended questions, you’re inviting your respondents to share their unique experiences and insights, and that’s where the magic happens.
Here are the four key benefits of collecting open-text answers:
Open-text answers allow you to eliminate guess work, giving you valuable insights into exactly what your customers and employees need to remain loyal to your business.
Take your data beyond quantitative metrics like (e)NPS and CSAT. Providing subjective opinions, ideas, feelings and emotions, open-text responses are essential for putting customer and employee numerical data and behaviour patterns into context.
When you know precisely what your customers and employees want — or what they don’t — you can take quick and targeted action.
Text Analysis enables you to provide your leadership teams with comprehensive, aggregated insights that will help to inform strategic planning and decision making.
New to Text Analysis? Download our quick start guide.
Examples of open-ended questions for qualitative research can come in many forms: as a stand-alone question, as a follow-up to a closed-ended question, as comment sections, and many more. Let’s have a look at a couple of these and in which scenarios they can be valuable.
A) at the end of a group of closed-ended questions or a grid:.
Open-ended questions are an invaluable tool for gaining a comprehensive understanding. Not only do they provide additional information, but they also reveal hidden insights that may have gone unnoticed. When combined with closed-ended questions, open-ended questions help minimize the risk of bias resulting from misinterpretation. Moreover, if a question is unclear, respondents are more likely to provide feedback in the comment box. By embracing the power of open-ended questions, you can gain a fuller understanding of the big picture.
To engage your survey respondents and gain valuable insights, consider including optional comment boxes or additional text fields. These features provide an opportunity for respondents to elaborate on sub-questions, such as those found in multiple-choice questions. However, be mindful of not overburdening your respondents and keeping the survey response time reasonable. By allowing respondents to expand on their closed-ended answers, you increase the likelihood of gaining additional insights and verifying other responses. With this approach, you can optimize your surveys for maximum engagement and data collection.
Open-ended questions are a powerful tool for collecting valuable insights from survey respondents. By asking them ahead of closed-ended questions or as standalone queries, you encourage brainstorming and spontaneous responses free from prior influences. This approach is particularly useful for addressing complex issues and evaluating surveys.
To ensure the success of your surveys and avoid mistakes, it’s important to exercise caution. Before launching a series of surveys with a similar design, take the time to evaluate your questionnaire. Are there any areas that require more in-depth details or clarification? Incorporating open-ended questions can help identify such areas and prevent future errors, leading to more successful survey outcomes.
What is text analysis.
Text Analysis is a powerful technology that leverages machine learning to extract insights from large amounts of text data. Rather than having to manually analyse this data, Text Analysis uses natural language processing to categorize responses and identify patterns in an unbiased and scalable way.
By automating this process, Text Analysis gives you a clear picture of what your customers and employees are experiencing in their own words, and helps you understand the “why” behind numerical feedback data. With Text Analysis, you can unlock the full value of open-ended questions and gain deep insights that inform your decision-making.
The good news is that you can easily get access to the power of Text Analysis in the Netigate feedback tool . There are three key ways you can leverage the value of this technology:
Sentiment analysis is an application of natural language processing that instantly reveals the emotional states behind text responses. Essentially, it’s a great tool for helping you to identify and understand how your customers and employees are feeling about you and your business.
The keyword extraction component of Netigate’s Text Analysis allows you to grasp the key concepts in text answers without having to read them all yourself.
Topics is a new deep learning component of Text Analysis that allows you to automatically sort free text answers into topic categories that you define yourself.
Being intentional and thoughtful when preparing your questions will get you high-quality, high-value open-text answers. This is essential for getting the most out of Text Analysis. Here’s how to do it.
When writing your questions, try not to start them with ‘Did’, ‘Are’, ‘Were’, ‘Do’, ‘Will’, or ‘Would’. This is because they can all be answered with ‘yes’ or ‘no’. This is going to limit the value you get out of Text Analysis.
⛔️ Did you like the product? ⛔️ Were you happy with the service you received? ⛔️ Are you satisfied with your manager?
If what you want to ask or know doesn’t quite work well in question form, you can rephrase it. Instead, use words and phrases like ‘Tell us about…’, ‘Describe…’, ‘Explain…’.
This is also a great option because these words tend to encourage people to write more. And Text Analysis loves text. It can do more with long answers than very short ones.
Think about the goal of your survey and how you plan to use the feedback data. Do you want concrete tips on how to improve a product or your office space, for example? Then you should ask ‘what’ questions that encourage respondents to provide precise details.
✅ What did you like/think about the product? ⛔️ Did you like the product?
It seems that textbox size matters. Interestingly, our insight experts have noticed that survey respondents write more if the answer field for an open-ended question is larger. Bigger textbox = potentially more detailed feedback.
As we explained in tip 2, Text Analysis performs best when it has lots of high-quality text answers to work with. Always keep this in mind when writing your questions and preparing your surveys.
Better questions = Better answers = Better analyses
Respondents don’t want to answer too many open-ended questions. Instead of asking multiple different questions about the same thing, you can use sentiment analysis to help you sort ‘negative’ and ‘positive’ answers.
⛔️ What did you like about the product? ⛔️ What didn’t you like about the product? ✅ Tell us what you thought about the product.
Click for more examples of good and bad open ended questions.
Is your business improving or standing still? While quantitative questions will give you clear insights in the form of numeric data, analysing open-ended questions will provide you with clear, in-depth insights, such as What do you need to further develop or improve? There is no optimal ratio between qualitative and quantitative questions; it often depends on the purpose of the survey and target group. For example, nordic patient surveys have shown that optional comment boxes were appreciated by 76% of the respondents. However, the best approach employs both types of questions in order to get the most value from your research.
When we think of survey, we often think of a single question to rate something…
The pretest of a questionnaire can often be done with simple means. We explain how this works.
Discover essential strategies for dealing with untruths in surveys, and unlock reliable data insights with Netigate's expertise in questionnaire design and untruth recognition.
By submitting the form, you agree to Netigate's terms and conditions and order processing agreement and acknowledge that you have read Netigate's privacy policy .
✅ Get the latest insights, reports, and eBooks ✅ See feedback management tips and best practices ✅ Be the first to hear about platform enhancements and features
Please confirm your email address by clicking the link in the email we just sent you.
Privacy overview.
Cookie | Duration | Description |
---|---|---|
cookielawinfo-checkbox-advertisement | 2 years | Records if the user has consented with marketing cookies |
cookielawinfo-checkbox-analytics | 2 years | Records if the user has consented with analytics cookies |
cookielawinfo-checkbox-functional | 2 years | Records if the user has consented with functional cookies |
cookielawinfo-checkbox-necessary | 2 years | Records if the user has consented with necessary cookies |
CookieLawInfoConsent | 2 years | Records the default button state of the corresponding category & the status of CCPA. It works only in coordination with the primary cookie. |
viewed_cookie_policy | 2 years | To record if a cookie message box has been shown. |
Cookie | Duration | Description |
---|---|---|
lpv294052 | session | This LPV cookie is set to keep Pardot from tracking multiple page views on a single asset over a 30-minute session. For example, if a visitor reloads a landing page several times over a 30-minute period, this cookie keeps each reload from being tracked as a page view. |
visitor_id# [x2] | 14 months | Unique visitor id related to Pardot account |
visitor_id#-hash [x3] | 14 months | Saves visitor id as a hash |
Cookie | Duration | Description |
---|---|---|
_ga | 14 months | The _ga cookie, installed by Google Analytics, calculates visitor, session and campaign data and also keeps track of site usage for the site's analytics report. The cookie stores information anonymously and assigns a randomly generated number to recognize unique visitors. |
_gid | 1 day | Installed by Google Analytics, _gid cookie stores information on how visitors use a website, while also creating an analytics report of the website's performance. Some of the data that are collected include the number of visitors, their source, and the pages they visit anonymously. |
AnalyticsSyncHistory | 1 month | Used to store information about the time a sync with the lms_analytics cookie took place for users in the Designated Countries |
Cookie | Duration | Description |
---|---|---|
_fbp | 3 months | This cookie is set by Facebook to display advertisements when either on Facebook or on a digital platform powered by Facebook advertising, after visiting the website. |
_gcl_au | 3 months | Provided by Google Tag Manager to experiment advertisement efficiency of websites using their services. |
_uetsid | 1 day | Stores and tracks visitors across websites |
1P_JAR, CONSENT, NID | 2 years | Collects site statistics and tracks conversion rate |
bcookie | 2 years | LinkedIn sets this cookie from LinkedIn share buttons and ad tags to recognize browser ID. |
bscookie | 2 years | This cookie is a browser ID cookie set by Linked share Buttons and ad tags. |
lang | session | LinkedIn sets this cookie to remember a user's language setting. |
lidc | 1 day | LinkedIn sets the lidc cookie to facilitate data center selection. |
MUID | 1 year 24 days | Bing sets this cookie to recognize unique web browsers visiting Microsoft sites. This cookie is used for advertising, site analytics, and other operations. |
UserMatchHistory | 1 month | Linkedin - Used to track visitors on multiple websites, in order to present relevant advertisement based on the visitor's preferences. |
What is a survey.
A survey is a set of questions administered to a population from which you would like to gain more information or insight about a topic. A survey can take many forms. It can include: questions about attitudes on a scale, open-ended questions where respondents write out long-form or short-form answers, options from a list, questions that evaluate the understanding of the respondent, heat maps or rankings of options about a topic, and many other forms. You can use surveys for assessment of pedagogy in your classroom; for example, to evaluate whether students are utilizing office hours or other student support options or to measure interest in changing how interactive your lectures are. You can also use surveys for research, where the surveys are designed with a research question in mind or as part of an intervention strategy.
In a feedback survey, you are asking for respondents’ opinions on an event or topic with the goal of identifying areas of change for improvement or assessing how previous changes are being received. In academia, the most recognizable form of this category is the course evaluation.
In a research survey, the questions are tailored to address a specific hypothesis or research question. The data is then analyzed through various means to provide more insight into the question at hand.
Whether a survey is appropriate can be determined by the question: Is the data I need to answer my research question available to me through self-reporting by the respondents? Data that is self-reported includes personal thoughts, beliefs, opinions, or anything specific to the individual that you cannot obtain from another source. If you are looking to gather data on more tangible factors such as grade improvement or demographics, a survey will not be the best method for your study due to the large margins of error and bias in reporting that should be avoided unless necessary. (This bias is discussed in more detail in the Survey Delivery & Participation section if you would like to know more.)
The purpose of a survey is not necessarily the same as the purpose of research (Davies 2020). For example, your research purpose may be to understand undergraduate study habit’s effects on test grades, but your survey purpose may be to determine how many students use each type of study methodology. Surveys are versatile tools than can be used for a variety of end goals such as acquiring information or testing a hypothesis, so it is important to identify the intended purpose before beginning to generate your survey or planning its administration. Surveys can also be as broad or as narrow as you want them to be, so ask yourself, what am I trying to achieve or learn from the responses of this survey? The answer to this question will direct the design of the survey you are writing.
When designing a survey, consider the overall purpose and the sample size that you are working with. Are you looking to assess the change in a small group of respondents’ outlooks on something or their habits over time? Or are you wanting a single batch of data from a large sample size that comes from a survey given once? Consider the feasibility of each option, not just which option you think will yield the best results.
Longitudinal.
A survey series given over a period of time to monitor changes within a population.
Allows the researcher to observe trends using data captured in the moment. | Requires more administration planning. May have lower response rates due to respondents not wanting to engage the time or mental burden associated with the taking of multiple surveys (Porter, 2004). |
A one-time occurrence to obtain a static view of a population at a single point in time.
Is easier to organize and administer than a longitudinal survey Places less of a response burden on the respondent (which may increase response rates). | Does not show any dynamic change over time, so analysis is limited to the single instance of data collection. |
A hybrid of longitudinal and cross-sectional, only given once but asks respondents about multiple points in time in the same vein as longitudinal surveys.
Allows for simplification of the survey administration while still acquiring data about changes over time. | Data may lose accuracy compared to a traditional longitudinal survey, as it relies on respondent memory of past events and emotions (DeCarlo, 2018). |
Davies, R. S. (2020). Survey Administration Planning. In Designing Surveys for Evaluations and Research. EdTech Books. https://edtechbooks.org/designing_surveys/administration
Davies, R. S. (2020). Conceptualization Phase. In Designing Surveys for Evaluations and Research. EdTech Books. https://edtechbooks.org/designing_surveys/survey_concept_Design
DeCarlo, M. (2018). Types of surveys. Scientific Inquiry in Social Work . https://pressbooks.pub/scientificinquiryinsocialwork/chapter/11-3-types-of-surveys/
Porter, S. R., Whitcomb, M. E., & Weitzer, W. H. (2004). Multiple surveys of students and survey fatigue. New Directions for Institutional Research , 2004 (121), 63–73. https://doi.org/10.1002/ir.101
Moody Library, Suite 201
One Bear Place Box 97189 Waco, TX 76798-7189
Root out friction in every digital experience, super-charge conversion rates, and optimize digital self-service
Uncover insights from any interaction, deliver AI-powered agent coaching, and reduce cost to serve
Increase revenue and loyalty with real-time insights and recommendations delivered to teams on the ground
Know how your people feel and empower managers to improve employee engagement, productivity, and retention
Take action in the moments that matter most along the employee journey and drive bottom line growth
Whatever they’re are saying, wherever they’re saying it, know exactly what’s going on with your people
Get faster, richer insights with qual and quant tools that make powerful market research available to everyone
Run concept tests, pricing studies, prototyping + more with fast, powerful studies designed by UX research experts
Track your brand performance 24/7 and act quickly to respond to opportunities and challenges in your market
Explore the platform powering Experience Management
Popular Use Cases
The annual gathering of the experience leaders at the world’s iconic brands building breakthrough business results, live in Sydney.
Your quick guide to open-ended questions in surveys.
17 min read In this guide, find out how you can use open-ended survey questions to glean more meaningful insights from your research, as well as how to analyse them and best practices.
When you want to get more comprehensive responses to a survey – answers beyond just yes or no – you’ll want to consider open-ended questions.
But what are open-ended questions? In this guide, we’ll go through what open-ended questions are, including how they can help gather information and provide greater context to your research findings.
Open-ended questions can offer you incredibly helpful insights into your respondent’s viewpoints. Here’s an explanation below of what they are and what they can do:
Free-form and not governed by simple one word answers (e.g. yes or no responses), an open-ended question allows respondents to answer in open-text format, giving them the creative thinking, freedom and space to answer in as much (or as little) detail as they like.
Open-ended questions help you to see things from the respondent’s perspective, as you get feedback in their own words instead of stock answers. Also, as you’re getting more meaningful answers and accurate responses, you can better analyse sentiment amongst your audience.
Get started with our free survey software
Open-ended questions provide more qualitative research data; contextual insights that accentuate quantitative information. With open-ended questions, you get more meaningful user research data.
Closed-ended questions, on the other hand, provide quantitative data ; limited insight but easy to analyse and compile into reports. Market researchers often add commentary to this kind of data to provide readers with background and further food for thought.
Here are the main differences with examples of open-ended and closed-ended questions:
Open-ended questions | Closed-ended questions |
---|---|
Qualitative | Quantitative |
Contextual | Data-driven |
Personalised | Manufactured |
Exploratory | Focused |
For example, an open-ended question might be: “What do you think of statistical analysis software?”.
Whereas closed-ended questions would simply be: “Do you use statistical analysis software?” or “Have you used statistical analysis software in the past?”.
Open-ended questions afford much more freedom to respondents and can result in deeper and more meaningful insights. A closed question can be useful and fast, but doesn’t provide much context. Open-ended questions are helpful for understanding the “why”.
Open-ended questions are great for going more in-depth on a topic. Closed-ended questions may tell you the “what,” but open-ended questions will tell you the “why.”
Another benefit of open-ended questions is that they allow you to get answers from your respondents in their words. For example, it can help to know the language that customers use to describe a product of feature, so that the company can match the language in their product description to increase discoverability.
Open-ended questions can also help you to learn things you didn’t expect, especially as they encourage creativity, and get answers to slightly more complex issues. For example, you could ask the question “What are the main reasons you canceled your subscription?” as a closed-ended question by providing a list of reasons (too expensive, don’t use it anymore). However, you are limited only to reasons that you can think of. But if you don’t know why people are canceling, then it might be better to ask as an open-ended question.
You might ask open-ended questions when you are doing a pilot out preliminary research to validate a product idea. You can then use that information to generate closed-ended questions for a larger follow-up study.
However, it can be wise to limit the overall number of open-ended questions in a survey because they are burdensome.
In terms of what provides more valuable information, only you can decide that based on the requirements of your research study. You also have to take into account variables such as the cost and scale of your research study, as well as when you need the information. Open-ended questions can provide you with more context, but they’re also more information to sift through, whereas closed-ended questions provide you with a tidy, finite response.
If you still prefer the invaluable responses and data from open-ended questions, using software like Qualtrics Text IQ can automate this complicated process. Through AI technology Text IQ can understand sentiment and articulate thousands of open-ended responses into simplified dashboards.
Learn More: Qualtrics Text IQ
While there are no set rules to the number of open-ended questions you can ask, of course you want to ask an open-ended question that correlates with your research objective.
Here are a few examples of open-ended survey questions related to your product:
You could even supplement closed-ended questions with an open-ended question to get more detail, e.g. “How often do you use our product?” — with a multiple choice, single word answers approach. These might be simple answers such as “Frequently”, “Sometimes”, “Never” — and if a respondent answers “Never”, you could follow with: “If you have never used our product, why not?”. This is a really easy way to understand why potential customers don’t use your product.
Also, incorporating open-ended questions into your surveys can provide useful information for salespeople throughout the sales process. For example, you might uncover insights that help your salespeople to reposition your products or improve the way they sell to new customers based on what existing customers feel. Though you might get helpful answers from a closed-ended question, open-ended questions give you more than a surface-level insight into their sentiments, emotions and thoughts.
It doesn’t need to be complicated, it can be as simple as what you see below. The survey doesn’t need to speak for itself, let your survey respondents say everything.
Open responses can be difficult to quantify. Framing them correctly is key to getting useful data from your answers. Below are some open ended questions examples of what to avoid.
Example : “What changes has your company made in the last five years due to external events?”
Problem : There are too many potential responses to this query, which means you’ll get too broad a range of answers. What kind of changes are being referred to, economic, strategic, personnel etc.? What external events are useful to know about? Don’t overwhelm your respondent with an overly broadquestion – ask the right questions and get precise answers.
Solution : Target your questions with a specific clarification of what you want. For example, “What policy changes has your company made about working from home in the last 6 months as a result of the COVID-19 pandemic?”. Alternatively, use a close-ended question, or offer examples to give respondents something to work from.
Example : “Why did you buy our product?”
Problem : This type of unclear-purpose question can lead to short, unhelpful answers. “Because I needed it” or “I fancied it” don’t necessarily give you data to work with.
Solution : Make it clear what you actually want to know. “When you bought our product, how did you intend to use it?” or “What are the main reasons you purchased [Our Brand] instead of another brand?” might be two alternatives that provide more context.
Example : “Please explain the required process that your brand uses to manage its contact centre (i.e. technical software stack, approval process, employee review, data security, management, compliance management etc.). Please be as detailed as possible.”
Problem : The higher the level of effort, the lower the chances of getting a good range of responses or high quality answers. It’s unlikely that a survey respondent will take the time to give a detailed answer on something that’s not their favourite subject. This results in either short, unhelpful answers, or even worse, the respondent quits the survey and decides not to participate after seeing the length of time and effort required. This can end up causing bias with the type of respondents that answer the survey.
Solution : If you really need the level of detail, there are a few options to try. You can break up the question into multiple questions or share some information on why you really need this insight. You could offer a different way of submitting an answer, such as a voice to text or video recording functionality, or make the question optional to help respondents to keep progressing through the survey. Possibly the best solution is to change from open-ended questions in a survey to a qualitative research method, such as focus groups or one-to-one interviews, where lengthier responses and more effort are expected.
Example : “When was the last time you used our product? How was your experience?”
Problem : Too many queries at once can cause a feeling of mental burden in your respondents, which means you risk losing their interest. Some survey takers might read the first question but miss the second, or forget about it when writing their response.
Solution : Only ask one thing at a time!
Example : “Please provide a summary of why you chose our brand over a competitor brand. [Minimum 50 characters].”
Problem : Even though making a minimum word count might seem like a way to get higher quality responses, this is often not the case. Respondents may well give up, or type gibberish to fill in the word count. Ideally, the responses you gather will be the natural response of the person you’re surveying – mandating a word count impedes this.
Solution : Leave off the word count. If you need to encourage longer responses, you can expand the text box size to fit more words in. Offer speech to text or video recording options to encourage lengthier responses, and explain why you need a detailed answer.
Example : “Where are you from?”
Problem : It’s harder to control the data you’ll collect when you use an open question when a closed one would work. For example, someone could respond to the above question with “The US”, “The United States” or “America”.
Solution : To save time and effort on both your side and the participant’s side, use a drop-down with standardised responses.
Example : “How do you feel about product 1?” “How do you feel about product 2?” “How do you feel about product 3?”
Problem : An open question requires more thought and effort than a closed one. Respondents can usually answer 4-6 closed questions in the same time as only 1 open one, and prefer to be able to answer quickly.
Solution : To reduce survey fatigue, lower drop-off rates, and save costs, only ask as many questions as you think you can get an answer for. Limit open-ended questions for ones where you really need context. Unless your respondents are highly motivated, keep it to 5 open-ended questions or fewer. Space them out to keep drop-offs to a minimum.
Example : “How could your experience today have been improved? Please provide a detailed response.”
Problem : A customer may not have any suggestions for improvements. By requiring an answer, though, the customer is now forced to think of something that can be improved even if it would not make them more likely to use the service again. Making these respondents answer means you risk bias. It could lead to prioritising unnecessary improvements.
Solution : Give respondents the option to say “No” or “Not applicable” or “I don’t know” to queries, or to skip the question entirely.
Step 1: collect and structure your responses.
Online survey tools can simplify the process of creating and sending questionnaires, as well as gathering responses to open-ended questions. These tools often have simple, customisable templates to make the process much more efficient and tailored to your requirements.
Some solutions offer different targeting variables, from geolocation to customer segments and site behaviour. This allows you to offer customised promotions to drive conversions and gather the right feedback at every stage in the online journey.
Upon receipt, your data should be in a clear, structured format and you can then export it to a CSV or Excel file before automatic analysis. At this point, you’ll want to check the data (spelling, duplication, symbols) so that it’s easier for a machine to process and analyse.
One method that’s increasingly applied to open-ended responses is automation. These new tools make it easy to extract data from open-text question responses with minimal human intervention. It makes an open-ended question response as accessible and easy to analyse as that of a closed question, but with more detail provided.
For example, you could use automated coding via artificial intelligence to look into buckets of responses to your open-ended questions and assign them accordingly for review. This can save a great deal of time, but the accuracy depends on your choice of solution.
Alternatively, you could use sentiment analysis — a form of natural language processing — to systematically identify, extract and quantify information. With sentiment analysis, you can determine whether responses are positive or negative, which can be really useful for unstructured responses or for quick, large-scale reviews.
Some solutions also offer custom programming so you can apply your own code to analyse survey results, giving complete flexibility and accuracy.
With the right data analysis and visualisation tools, you can see your survey results in the format most applicable to you and your stakeholders. For example, C-Suite may want to see information displayed using graphs rather than tables — whereas your research team might want a comprehensive breakdown of responses, including response percentages for each question.
This might be easier for a survey with closed-ended questions, but with the right analysis for open-ended questions’ responses, you can easily collate response data that’s easy to quantify.
With the survey tools that exist today, it’s incredibly easy to import and analyse data at scale to uncover trends and develop actionable insights. You can also apply your own programming code and data visualisation techniques to get the information you need. No matter whether you’re using open-ended questions or getting one-word answers in emojis, you’re able to surface the most useful insights for action.
With Qualtrics’ survey software , used by more than 13,000 brands and 99 of the top 100 business schools, you can get answers to the most important market, brand, customer, and product questions with ease. Choose from a huge range of multiple-choice questions (both open-ended questions and closed-ended) and tailor your survey to get the most in-depth responses to your queries.
You can build a positive relationship with your respondents and get a deeper understanding of what they think and feel with Qualtrics-powered surveys. The best part? It’s completely free to get started with.
Post event survey questions 10 min read, questionnaires design 15 min read, best survey software 16 min read, survey vs questionnaire 12 min read, close-ended questions 7 min read, likert scales 14 min read, response bias 13 min read, request demo.
Ready to learn more about Qualtrics?
IMAGES
VIDEO
COMMENTS
Open-Ended vs. Closed Questions. There are two types of questions we can use in research studies: open-ended and closed. Open-ended questions allow participants to give a free-form text answer. Closed questions (or closed-ended questions) restrict participants to one of a limited set of possible answers.. Open-ended questions encourage exploration of a topic; a participant can choose what to ...
Definition of Open-Ended Questions. Open-ended questions are a research tool that allows for a wide range of possible answers and encourages respondents to provide detailed and personalized responses. These types of questions typically begin with phrases such as " How ," " What ," or " Why ", and require the respondent to provide ...
Step 1: Collect and structure your responses. Online survey tools can simplify the process of creating and sending questionnaires, as well as gathering responses to open-ended questions. These tools often have simple, customisable templates to make the process much more efficient and tailored to your requirements.
In essence, the research question that guides the sciences and social sciences should do the following three things:2. 1) Post a problem. 2) Shape the problem into a testable hypothesis. 3) Report the results of the tested hypothesis. There are two types of data that can help shape research questions in the sciences and social sciences ...
The question must be "researchable" — it can be answered with accessible facts and data; Questions often start with How, Why, What, Which; The question opens the door for other areas of inquiry — it identifies a gap in existing research; Questions should be open-ended and focus on cause and effect; TRY TO AVOID:
Research questions should not be answerable with a simple "yes" or "no" or by easily-found facts. They should, instead, require both research and analysis on the part of the writer. They often begin with "How" or "Why.". Begin your research. After you've come up with a question, think about the possible paths your research ...
Introduction. Let us begin by pointing out that open and closed-ended questions do not at first glance serve the same purpose in market research. Instead, open-ended questions are used in qualitative research (see the video above for more information) and closed-ended questions are used in quantitative research. But this is not an absolute rule.
MMW2, W2009. Developing Effective Open-Ended Questions and Arguable, Research-Based Claims for Academic Essays. Asking Open-Ended, Arguable Questions. In academic papers, the thesis is typically an answer to a question about a significant issue that has more than one possible answer and requires research to provide evidence.
1. Use Interrogative Words. Forming open-ended questions using interrogative words like who, what, when, where, why and how is an effective strategy to elicit detailed, explanatory responses. These question words encourage people to provide more thoughtful answers beyond just yes/no or one-word replies.
It allows researchers to explore the richness and depth of individuals' thoughts, feelings, decision making process and motivations. One of the critical tools in qualitative research is the use of open-ended questions. Open-ended questions invite respondents to provide detailed and personalised responses—allowing for a more nuanced ...
A closed-ended question is a survey question that restricts respondents to limited answer-options while an open-ended question is a survey question that allows respondents to communicate their answers without any restrictions. This means that unlike close-ended questions, open-ended questions allow you to provide free-form answers.
Open-ended questions ask people to provide answers in their own words and are designed to elicit more information than is possible in a multiple choice or other closed-ended format. Writing a good open-ended question is a tricky balancing act: It should elicit the respondents to answer with useful information, but also give them the freedom to ...
An open-ended question opens up a topic for exploration and discussion while a closed-ended question leads to a closed-off conversational path. After "Yes" or "No" or the specific one-word answer to the question, the thread is done. Open-ended questions lead to qualitative answers while closed-ended questions lead to quantitative answers.
Customer research is a large discipline with multiple methods to get the right information from your audience or customer base. Surveys are among the most effective ways to get deep insights from your most engaged users. It helps you understand how they feel about specific topics and give you perspectives - through open-ended questions - you might have otherwise missed.
Open-Ended Questions for Surveys & Research. Open-ended questions are a great way for researchers in any industry to explore and expound upon their data, including some of the close-ended, quantitative responses. ... An open-ended question should be asked when you're interested in qualitative information or a better understanding of someone ...
Open-Ended Questions in Surveys. Open-ended questions are a cornerstone of qualitative research, providing a window into the deeper thoughts, feelings, and motivations of respondents. They are particularly effective when you need nuanced insights or varied perspectives that structured data cannot capture. To craft effective open-ended questions:
Qualitative Research with Open-Ended Questions. By incorporating open-ended questions into our surveys, we can gather data that provides valuable insights into how people experience our cities. ... Should open-ended survey questions be used in conjunction with other survey question types? A: Yes, integrating open-ended questions with closed ...
An open-ended question is what it is: a question that is open to any answer. In the context of user research, open-ended questions are questions that do not limit users to one- or two-word answers. Instead, they have multiple potential responses, and they often give room for further probing by the moderator.
Overall, open-ended questions are powerful to gather information, foster communication, and gain deeper insights. Whether used in research, professional settings, or personal conversations, they enable individuals to explore ideas, share perspectives, critical thinking of a person, and engage in meaningful discussions.
The reality is that open-ended qualitative questions can be converted into quantitative data and conversely closed-ended quantitative questions can be used to glean qualitative data. The key is the coding, so write the questions in whichever way will give you the data you are most needing to see while keeping in mind the logistical elements ...
Here are a few examples of when and why you would want to gather additional information: 1. Get context on answers to close-ended questions and take action. Asking an open-ended question directly after a close-ended question can help you learn the "why" behind a respondent's initial score or multiple choice answer.
Closed-ended questions are questions that can only be answered by selecting from a limited number of options, usually multiple-choice questions with a single-word answer ('yes' or 'no') or a rating scale (e.g. from strongly agree to strongly disagree). Closed-ended questions give limited insight, but can easily be analyzed for ...
How to use open-ended questions in your surveys. Examples of open-ended questions for qualitative research can come in many forms: as a stand-alone question, as a follow-up to a closed-ended question, as comment sections, and many more. Let's have a look at a couple of these and in which scenarios they can be valuable. 1.
Open-ended survey questions render qualitative data. They evoke genuine, free-form responses bounded only by the responders' imagination and ways to convey themselves. Adding open-ended ...
What is a Survey? A survey is a set of questions administered to a population from which you would like to gain more information or insight about a topic. A survey can take many forms. It can include: questions about attitudes on a scale, open-ended questions where respondents write out long-form or short-form answers, options from a list, questions that evaluate the understanding of the ...
Open ended questions. Open ended questions work well when you want to explore an attendees thoughts or opinions in their own words, and gather more individual responses. They want provide any statistically relevant information, but the nature of the answers can still provide valuable feedback.
Why Britain Just Ended 14 Years of Conservative Rule Last week, the center-left Labour Party won the British general election in a landslide. July 10, 2024. Share full article. 9.
Open-ended questions, on the other hand, provide qualitative data: information that helps you to understand your customers and the context behind their actions. Ebook: The Qualtrics Handbook of Question Design. A close-ended vs open-ended question. Here are the main differences between open and closed-ended questions:
Open-ended questions afford much more freedom to respondents and can result in deeper and more meaningful insights. A closed question can be useful and fast, but doesn't provide much context. Open-ended questions are helpful for understanding the "why". When and why should you use an open-ended question?