importance of methodology

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

• Knowledge Base
• Dissertation
• What Is a Research Methodology? | Steps & Tips

What Is a Research Methodology? | Steps & Tips

Published on August 25, 2022 by Shona McCombes and Tegan George. Revised on November 20, 2023.

Your research methodology discusses and explains the data collection and analysis methods you used in your research. A key part of your thesis, dissertation , or research paper , the methodology chapter explains what you did and how you did it, allowing readers to evaluate the reliability and validity of your research and your dissertation topic .

It should include:

• The type of research you conducted
• How you collected and analyzed your data
• Any tools or materials you used in the research
• How you mitigated or avoided research biases
• Why you chose these methods
• Your methodology section should generally be written in the past tense .
• Academic style guides in your field may provide detailed guidelines on what to include for different types of studies.
• Your citation style might provide guidelines for your methodology section (e.g., an APA Style methods section ).

Instantly correct all language mistakes in your text

Upload your document to correct all your mistakes in minutes

Table of contents

How to write a research methodology, why is a methods section important, step 1: explain your methodological approach, step 2: describe your data collection methods, step 3: describe your analysis method, step 4: evaluate and justify the methodological choices you made, tips for writing a strong methodology chapter, other interesting articles, frequently asked questions about methodology.

The only proofreading tool specialized in correcting academic writing - try for free!

The academic proofreading tool has been trained on 1000s of academic texts and by native English editors. Making it the most accurate and reliable proofreading tool for students.

Try for free

Your methods section is your opportunity to share how you conducted your research and why you chose the methods you chose. It’s also the place to show that your research was rigorously conducted and can be replicated .

It gives your research legitimacy and situates it within your field, and also gives your readers a place to refer to if they have any questions or critiques in other sections.

You can start by introducing your overall approach to your research. You have two options here.

Option 1: Start with your “what”

What research problem or question did you investigate?

• Aim to describe the characteristics of something?
• Explore an under-researched topic?
• Establish a causal relationship?

And what type of data did you need to achieve this aim?

• Quantitative data , qualitative data , or a mix of both?
• Primary data collected yourself, or secondary data collected by someone else?
• Experimental data gathered by controlling and manipulating variables, or descriptive data gathered via observations?

Option 2: Start with your “why”

Depending on your discipline, you can also start with a discussion of the rationale and assumptions underpinning your methodology. In other words, why did you choose these methods for your study?

• Why is this the best way to answer your research question?
• Is this a standard methodology in your field, or does it require justification?
• Were there any ethical considerations involved in your choices?
• What are the criteria for validity and reliability in this type of research ? How did you prevent bias from affecting your data?

Once you have introduced your reader to your methodological approach, you should share full details about your data collection methods .

Quantitative methods

In order to be considered generalizable, you should describe quantitative research methods in enough detail for another researcher to replicate your study.

Here, explain how you operationalized your concepts and measured your variables. Discuss your sampling method or inclusion and exclusion criteria , as well as any tools, procedures, and materials you used to gather your data.

Surveys Describe where, when, and how the survey was conducted.

• How did you design the questionnaire?
• What form did your questions take (e.g., multiple choice, Likert scale )?
• Were your surveys conducted in-person or virtually?
• What sampling method did you use to select participants?
• What was your sample size and response rate?

Experiments Share full details of the tools, techniques, and procedures you used to conduct your experiment.

• How did you design the experiment ?
• How did you recruit participants?
• How did you manipulate and measure the variables ?
• What tools did you use?

Existing data Explain how you gathered and selected the material (such as datasets or archival data) that you used in your analysis.

• Where did you source the material?
• How was the data originally produced?
• What criteria did you use to select material (e.g., date range)?

The survey consisted of 5 multiple-choice questions and 10 questions measured on a 7-point Likert scale.

The goal was to collect survey responses from 350 customers visiting the fitness apparel company’s brick-and-mortar location in Boston on July 4–8, 2022, between 11:00 and 15:00.

Here, a customer was defined as a person who had purchased a product from the company on the day they took the survey. Participants were given 5 minutes to fill in the survey anonymously. In total, 408 customers responded, but not all surveys were fully completed. Due to this, 371 survey results were included in the analysis.

• Information bias
• Omitted variable bias
• Regression to the mean
• Survivorship bias
• Undercoverage bias
• Sampling bias

Qualitative methods

In qualitative research , methods are often more flexible and subjective. For this reason, it’s crucial to robustly explain the methodology choices you made.

Be sure to discuss the criteria you used to select your data, the context in which your research was conducted, and the role you played in collecting your data (e.g., were you an active participant, or a passive observer?)

Interviews or focus groups Describe where, when, and how the interviews were conducted.

• How did you find and select participants?
• How many participants took part?
• What form did the interviews take ( structured , semi-structured , or unstructured )?
• How long were the interviews?
• How were they recorded?

Participant observation Describe where, when, and how you conducted the observation or ethnography .

• What group or community did you observe? How long did you spend there?
• How did you gain access to this group? What role did you play in the community?
• How long did you spend conducting the research? Where was it located?
• How did you record your data (e.g., audiovisual recordings, note-taking)?

Existing data Explain how you selected case study materials for your analysis.

• What type of materials did you analyze?
• How did you select them?

In order to gain better insight into possibilities for future improvement of the fitness store’s product range, semi-structured interviews were conducted with 8 returning customers.

Here, a returning customer was defined as someone who usually bought products at least twice a week from the store.

Surveys were used to select participants. Interviews were conducted in a small office next to the cash register and lasted approximately 20 minutes each. Answers were recorded by note-taking, and seven interviews were also filmed with consent. One interviewee preferred not to be filmed.

• The Hawthorne effect
• Observer bias
• The placebo effect
• Response bias and Nonresponse bias
• The Pygmalion effect
• Recall bias
• Social desirability bias
• Self-selection bias

Mixed methods

Mixed methods research combines quantitative and qualitative approaches. If a standalone quantitative or qualitative study is insufficient to answer your research question, mixed methods may be a good fit for you.

Mixed methods are less common than standalone analyses, largely because they require a great deal of effort to pull off successfully. If you choose to pursue mixed methods, it’s especially important to robustly justify your methods.

Prevent plagiarism. Run a free check.

Next, you should indicate how you processed and analyzed your data. Avoid going into too much detail: you should not start introducing or discussing any of your results at this stage.

In quantitative research , your analysis will be based on numbers. In your methods section, you can include:

• How you prepared the data before analyzing it (e.g., checking for missing data , removing outliers , transforming variables)
• Which software you used (e.g., SPSS, Stata or R)
• Which statistical tests you used (e.g., two-tailed t test , simple linear regression )

In qualitative research, your analysis will be based on language, images, and observations (often involving some form of textual analysis ).

Specific methods might include:

• Content analysis : Categorizing and discussing the meaning of words, phrases and sentences
• Thematic analysis : Coding and closely examining the data to identify broad themes and patterns
• Discourse analysis : Studying communication and meaning in relation to their social context

Mixed methods combine the above two research methods, integrating both qualitative and quantitative approaches into one coherent analytical process.

Above all, your methodology section should clearly make the case for why you chose the methods you did. This is especially true if you did not take the most standard approach to your topic. In this case, discuss why other methods were not suitable for your objectives, and show how this approach contributes new knowledge or understanding.

In any case, it should be overwhelmingly clear to your reader that you set yourself up for success in terms of your methodology’s design. Show how your methods should lead to results that are valid and reliable, while leaving the analysis of the meaning, importance, and relevance of your results for your discussion section .

• Quantitative: Lab-based experiments cannot always accurately simulate real-life situations and behaviors, but they are effective for testing causal relationships between variables .
• Qualitative: Unstructured interviews usually produce results that cannot be generalized beyond the sample group , but they provide a more in-depth understanding of participants’ perceptions, motivations, and emotions.
• Mixed methods: Despite issues systematically comparing differing types of data, a solely quantitative study would not sufficiently incorporate the lived experience of each participant, while a solely qualitative study would be insufficiently generalizable.

Remember that your aim is not just to describe your methods, but to show how and why you applied them. Again, it’s critical to demonstrate that your research was rigorously conducted and can be replicated.

1. Focus on your objectives and research questions

The methodology section should clearly show why your methods suit your objectives and convince the reader that you chose the best possible approach to answering your problem statement and research questions .

2. Cite relevant sources

Your methodology can be strengthened by referencing existing research in your field. This can help you to:

• Show that you followed established practice for your type of research
• Discuss how you decided on your approach by evaluating existing research
• Present a novel methodological approach to address a gap in the literature

3. Write for your audience

Consider how much information you need to give, and avoid getting too lengthy. If you are using methods that are standard for your discipline, you probably don’t need to give a lot of background or justification.

Regardless, your methodology should be a clear, well-structured text that makes an argument for your approach, not just a list of technical details and procedures.

If you want to know more about statistics , methodology , or research bias , make sure to check out some of our other articles with explanations and examples.

• Normal distribution
• Measures of central tendency
• Chi square tests
• Confidence interval
• Quartiles & Quantiles

Methodology

• Cluster sampling
• Stratified sampling
• Thematic analysis
• Cohort study
• Peer review
• Ethnography

Research bias

• Implicit bias
• Cognitive bias
• Conformity bias
• Hawthorne effect
• Availability heuristic
• Attrition bias

Methodology refers to the overarching strategy and rationale of your research project . It involves studying the methods used in your field and the theories or principles behind them, in order to develop an approach that matches your objectives.

Methods are the specific tools and procedures you use to collect and analyze data (for example, experiments, surveys , and statistical tests ).

In shorter scientific papers, where the aim is to report the findings of a specific study, you might simply describe what you did in a methods section .

In a longer or more complex research project, such as a thesis or dissertation , you will probably include a methodology section , where you explain your approach to answering the research questions and cite relevant sources to support your choice of methods.

In a scientific paper, the methodology always comes after the introduction and before the results , discussion and conclusion . The same basic structure also applies to a thesis, dissertation , or research proposal .

Depending on the length and type of document, you might also include a literature review or theoretical framework before the methodology.

Quantitative research deals with numbers and statistics, while qualitative research deals with words and meanings.

Quantitative methods allow you to systematically measure variables and test hypotheses . Qualitative methods allow you to explore concepts and experiences in more detail.

Reliability and validity are both about how well a method measures something:

• Reliability refers to the  consistency of a measure (whether the results can be reproduced under the same conditions).
• Validity   refers to the  accuracy of a measure (whether the results really do represent what they are supposed to measure).

If you are doing experimental research, you also have to consider the internal and external validity of your experiment.

A sample is a subset of individuals from a larger population . Sampling means selecting the group that you will actually collect data from in your research. For example, if you are researching the opinions of students in your university, you could survey a sample of 100 students.

In statistics, sampling allows you to test a hypothesis about the characteristics of a population.

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

McCombes, S. & George, T. (2023, November 20). What Is a Research Methodology? | Steps & Tips. Scribbr. Retrieved April 9, 2024, from https://www.scribbr.com/dissertation/methodology/

Is this article helpful?

Shona McCombes

Other students also liked, what is a theoretical framework | guide to organizing, what is a research design | types, guide & examples, qualitative vs. quantitative research | differences, examples & methods, unlimited academic ai-proofreading.

✔ Document error-free in 5minutes ✔ Unlimited document corrections ✔ Specialized in correcting academic texts

Get science-backed answers as you write with Paperpal's Research feature

What is Research Methodology? Definition, Types, and Examples

Research methodology 1,2 is a structured and scientific approach used to collect, analyze, and interpret quantitative or qualitative data to answer research questions or test hypotheses. A research methodology is like a plan for carrying out research and helps keep researchers on track by limiting the scope of the research. Several aspects must be considered before selecting an appropriate research methodology, such as research limitations and ethical concerns that may affect your research.

The research methodology section in a scientific paper describes the different methodological choices made, such as the data collection and analysis methods, and why these choices were selected. The reasons should explain why the methods chosen are the most appropriate to answer the research question. A good research methodology also helps ensure the reliability and validity of the research findings. There are three types of research methodology—quantitative, qualitative, and mixed-method, which can be chosen based on the research objectives.

What is research methodology ?

A research methodology describes the techniques and procedures used to identify and analyze information regarding a specific research topic. It is a process by which researchers design their study so that they can achieve their objectives using the selected research instruments. It includes all the important aspects of research, including research design, data collection methods, data analysis methods, and the overall framework within which the research is conducted. While these points can help you understand what is research methodology, you also need to know why it is important to pick the right methodology.

Why is research methodology important?

Having a good research methodology in place has the following advantages: 3

• Helps other researchers who may want to replicate your research; the explanations will be of benefit to them.
• You can easily answer any questions about your research if they arise at a later stage.
• A research methodology provides a framework and guidelines for researchers to clearly define research questions, hypotheses, and objectives.
• It helps researchers identify the most appropriate research design, sampling technique, and data collection and analysis methods.
• A sound research methodology helps researchers ensure that their findings are valid and reliable and free from biases and errors.
• It also helps ensure that ethical guidelines are followed while conducting research.
• A good research methodology helps researchers in planning their research efficiently, by ensuring optimum usage of their time and resources.

Writing the methods section of a research paper? Let Paperpal help you achieve perfection

Types of research methodology.

There are three types of research methodology based on the type of research and the data required. 1

• Quantitative research methodology focuses on measuring and testing numerical data. This approach is good for reaching a large number of people in a short amount of time. This type of research helps in testing the causal relationships between variables, making predictions, and generalizing results to wider populations.
• Qualitative research methodology examines the opinions, behaviors, and experiences of people. It collects and analyzes words and textual data. This research methodology requires fewer participants but is still more time consuming because the time spent per participant is quite large. This method is used in exploratory research where the research problem being investigated is not clearly defined.
• Mixed-method research methodology uses the characteristics of both quantitative and qualitative research methodologies in the same study. This method allows researchers to validate their findings, verify if the results observed using both methods are complementary, and explain any unexpected results obtained from one method by using the other method.

What are the types of sampling designs in research methodology?

Sampling 4 is an important part of a research methodology and involves selecting a representative sample of the population to conduct the study, making statistical inferences about them, and estimating the characteristics of the whole population based on these inferences. There are two types of sampling designs in research methodology—probability and nonprobability.

• Probability sampling

In this type of sampling design, a sample is chosen from a larger population using some form of random selection, that is, every member of the population has an equal chance of being selected. The different types of probability sampling are:

• Systematic —sample members are chosen at regular intervals. It requires selecting a starting point for the sample and sample size determination that can be repeated at regular intervals. This type of sampling method has a predefined range; hence, it is the least time consuming.
• Stratified —researchers divide the population into smaller groups that don’t overlap but represent the entire population. While sampling, these groups can be organized, and then a sample can be drawn from each group separately.
• Cluster —the population is divided into clusters based on demographic parameters like age, sex, location, etc.
• Convenience —selects participants who are most easily accessible to researchers due to geographical proximity, availability at a particular time, etc.
• Purposive —participants are selected at the researcher’s discretion. Researchers consider the purpose of the study and the understanding of the target audience.
• Snowball —already selected participants use their social networks to refer the researcher to other potential participants.
• Quota —while designing the study, the researchers decide how many people with which characteristics to include as participants. The characteristics help in choosing people most likely to provide insights into the subject.

What are data collection methods?

During research, data are collected using various methods depending on the research methodology being followed and the research methods being undertaken. Both qualitative and quantitative research have different data collection methods, as listed below.

Qualitative research 5

• One-on-one interviews: Helps the interviewers understand a respondent’s subjective opinion and experience pertaining to a specific topic or event
• Document study/literature review/record keeping: Researchers’ review of already existing written materials such as archives, annual reports, research articles, guidelines, policy documents, etc.
• Focus groups: Constructive discussions that usually include a small sample of about 6-10 people and a moderator, to understand the participants’ opinion on a given topic.
• Qualitative observation : Researchers collect data using their five senses (sight, smell, touch, taste, and hearing).

Quantitative research 6

• Sampling: The most common type is probability sampling.
• Interviews: Commonly telephonic or done in-person.
• Observations: Structured observations are most commonly used in quantitative research. In this method, researchers make observations about specific behaviors of individuals in a structured setting.
• Document review: Reviewing existing research or documents to collect evidence for supporting the research.
• Surveys and questionnaires. Surveys can be administered both online and offline depending on the requirement and sample size.

Let Paperpal help you write the perfect research methods section. Start now!

What are data analysis methods.

The data collected using the various methods for qualitative and quantitative research need to be analyzed to generate meaningful conclusions. These data analysis methods 7 also differ between quantitative and qualitative research.

Quantitative research involves a deductive method for data analysis where hypotheses are developed at the beginning of the research and precise measurement is required. The methods include statistical analysis applications to analyze numerical data and are grouped into two categories—descriptive and inferential.

Descriptive analysis is used to describe the basic features of different types of data to present it in a way that ensures the patterns become meaningful. The different types of descriptive analysis methods are:

• Measures of frequency (count, percent, frequency)
• Measures of central tendency (mean, median, mode)
• Measures of dispersion or variation (range, variance, standard deviation)
• Measure of position (percentile ranks, quartile ranks)

Inferential analysis is used to make predictions about a larger population based on the analysis of the data collected from a smaller population. This analysis is used to study the relationships between different variables. Some commonly used inferential data analysis methods are:

• Correlation: To understand the relationship between two or more variables.
• Cross-tabulation: Analyze the relationship between multiple variables.
• Regression analysis: Study the impact of independent variables on the dependent variable.
• Frequency tables: To understand the frequency of data.
• Analysis of variance: To test the degree to which two or more variables differ in an experiment.

Qualitative research involves an inductive method for data analysis where hypotheses are developed after data collection. The methods include:

• Content analysis: For analyzing documented information from text and images by determining the presence of certain words or concepts in texts.
• Narrative analysis: For analyzing content obtained from sources such as interviews, field observations, and surveys. The stories and opinions shared by people are used to answer research questions.
• Discourse analysis: For analyzing interactions with people considering the social context, that is, the lifestyle and environment, under which the interaction occurs.
• Grounded theory: Involves hypothesis creation by data collection and analysis to explain why a phenomenon occurred.
• Thematic analysis: To identify important themes or patterns in data and use these to address an issue.

How to choose a research methodology?

Here are some important factors to consider when choosing a research methodology: 8

• Research objectives, aims, and questions —these would help structure the research design.
• Review existing literature to identify any gaps in knowledge.
• Check the statistical requirements —if data-driven or statistical results are needed then quantitative research is the best. If the research questions can be answered based on people’s opinions and perceptions, then qualitative research is most suitable.
• Sample size —sample size can often determine the feasibility of a research methodology. For a large sample, less effort- and time-intensive methods are appropriate.
• Constraints —constraints of time, geography, and resources can help define the appropriate methodology.

Got writer’s block? Kickstart your research paper writing with Paperpal now!

How to write a research methodology .

A research methodology should include the following components: 3,9

• Research design —should be selected based on the research question and the data required. Common research designs include experimental, quasi-experimental, correlational, descriptive, and exploratory.
• Research method —this can be quantitative, qualitative, or mixed-method.
• Reason for selecting a specific methodology —explain why this methodology is the most suitable to answer your research problem.
• Research instruments —explain the research instruments you plan to use, mainly referring to the data collection methods such as interviews, surveys, etc. Here as well, a reason should be mentioned for selecting the particular instrument.
• Sampling —this involves selecting a representative subset of the population being studied.
• Data collection —involves gathering data using several data collection methods, such as surveys, interviews, etc.
• Data analysis —describe the data analysis methods you will use once you’ve collected the data.
• Research limitations —mention any limitations you foresee while conducting your research.
• Validity and reliability —validity helps identify the accuracy and truthfulness of the findings; reliability refers to the consistency and stability of the results over time and across different conditions.
• Ethical considerations —research should be conducted ethically. The considerations include obtaining consent from participants, maintaining confidentiality, and addressing conflicts of interest.

Streamline Your Research Paper Writing Process with Paperpal

The methods section is a critical part of the research papers, allowing researchers to use this to understand your findings and replicate your work when pursuing their own research. However, it is usually also the most difficult section to write. This is where Paperpal can help you overcome the writer’s block and create the first draft in minutes with Paperpal Copilot, its secure generative AI feature suite.  

With Paperpal you can get research advice, write and refine your work, rephrase and verify the writing, and ensure submission readiness, all in one place. Here’s how you can use Paperpal to develop the first draft of your methods section.  

• Generate an outline: Input some details about your research to instantly generate an outline for your methods section 
• Develop the section: Use the outline and suggested sentence templates to expand your ideas and develop the first draft.  
• P araph ras e and trim : Get clear, concise academic text with paraphrasing that conveys your work effectively and word reduction to fix redundancies. 
• Choose the right words: Enhance text by choosing contextual synonyms based on how the words have been used in previously published work.  
• Check and verify text : Make sure the generated text showcases your methods correctly, has all the right citations, and is original and authentic. .   

You can repeat this process to develop each section of your research manuscript, including the title, abstract and keywords. Ready to write your research papers faster, better, and without the stress? Sign up for Paperpal and start writing today!

Frequently Asked Questions

Q1. What are the key components of research methodology?

A1. A good research methodology has the following key components:

• Research design
• Data collection procedures
• Data analysis methods
• Ethical considerations

Q2. Why is ethical consideration important in research methodology?

A2. Ethical consideration is important in research methodology to ensure the readers of the reliability and validity of the study. Researchers must clearly mention the ethical norms and standards followed during the conduct of the research and also mention if the research has been cleared by any institutional board. The following 10 points are the important principles related to ethical considerations: 10

• Participants should not be subjected to harm.
• Respect for the dignity of participants should be prioritized.
• Full consent should be obtained from participants before the study.
• Participants’ privacy should be ensured.
• Confidentiality of the research data should be ensured.
• Anonymity of individuals and organizations participating in the research should be maintained.
• The aims and objectives of the research should not be exaggerated.
• Affiliations, sources of funding, and any possible conflicts of interest should be declared.
• Communication in relation to the research should be honest and transparent.
• Misleading information and biased representation of primary data findings should be avoided.

Q3. What is the difference between methodology and method?

A3. Research methodology is different from a research method, although both terms are often confused. Research methods are the tools used to gather data, while the research methodology provides a framework for how research is planned, conducted, and analyzed. The latter guides researchers in making decisions about the most appropriate methods for their research. Research methods refer to the specific techniques, procedures, and tools used by researchers to collect, analyze, and interpret data, for instance surveys, questionnaires, interviews, etc.

Research methodology is, thus, an integral part of a research study. It helps ensure that you stay on track to meet your research objectives and answer your research questions using the most appropriate data collection and analysis tools based on your research design.

Accelerate your research paper writing with Paperpal. Try for free now!

• Research methodologies. Pfeiffer Library website. Accessed August 15, 2023. https://library.tiffin.edu/researchmethodologies/whatareresearchmethodologies
• Types of research methodology. Eduvoice website. Accessed August 16, 2023. https://eduvoice.in/types-research-methodology/
• The basics of research methodology: A key to quality research. Voxco. Accessed August 16, 2023. https://www.voxco.com/blog/what-is-research-methodology/
• Sampling methods: Types with examples. QuestionPro website. Accessed August 16, 2023. https://www.questionpro.com/blog/types-of-sampling-for-social-research/
• What is qualitative research? Methods, types, approaches, examples. Researcher.Life blog. Accessed August 15, 2023. https://researcher.life/blog/article/what-is-qualitative-research-methods-types-examples/
• What is quantitative research? Definition, methods, types, and examples. Researcher.Life blog. Accessed August 15, 2023. https://researcher.life/blog/article/what-is-quantitative-research-types-and-examples/
• Data analysis in research: Types & methods. QuestionPro website. Accessed August 16, 2023. https://www.questionpro.com/blog/data-analysis-in-research/#Data_analysis_in_qualitative_research
• Factors to consider while choosing the right research methodology. PhD Monster website. Accessed August 17, 2023. https://www.phdmonster.com/factors-to-consider-while-choosing-the-right-research-methodology/
• What is research methodology? Research and writing guides. Accessed August 14, 2023. https://paperpile.com/g/what-is-research-methodology/
• Ethical considerations. Business research methodology website. Accessed August 17, 2023. https://research-methodology.net/research-methodology/ethical-considerations/

Paperpal is a comprehensive AI writing toolkit that helps students and researchers achieve 2x the writing in half the time. It leverages 21+ years of STM experience and insights from millions of research articles to provide in-depth academic writing, language editing, and submission readiness support to help you write better, faster.  

Get accurate academic translations, rewriting support, grammar checks, vocabulary suggestions, and generative AI assistance that delivers human precision at machine speed. Try for free or upgrade to Paperpal Prime starting at US$19 a month to access premium features, including consistency, plagiarism, and 30+ submission readiness checks to help you succeed.  

Experience the future of academic writing – Sign up to Paperpal and start writing for free!  

Related Reads:

• Dangling Modifiers and How to Avoid Them in Your Writing 
• Webinar: How to Use Generative AI Tools Ethically in Your Academic Writing
• Research Outlines: How to Write An Introduction Section in Minutes with Paperpal Copilot
• How to Paraphrase Research Papers Effectively

Language and Grammar Rules for Academic Writing

Climatic vs. climactic: difference and examples, you may also like, what is hedging in academic writing  , how to use ai to enhance your college..., how to use paperpal to generate emails &..., ai in education: it’s time to change the..., is it ethical to use ai-generated abstracts without..., do plagiarism checkers detect ai content, word choice problems: how to use the right..., how to avoid plagiarism when using generative ai..., what are journal guidelines on using generative ai..., types of plagiarism and 6 tips to avoid....

• USC Libraries
• Research Guides

Organizing Your Social Sciences Research Paper

• 6. The Methodology
• Purpose of Guide
• Design Flaws to Avoid
• Independent and Dependent Variables
• Glossary of Research Terms
• Reading Research Effectively
• Narrowing a Topic Idea
• Broadening a Topic Idea
• Extending the Timeliness of a Topic Idea
• Academic Writing Style
• Applying Critical Thinking
• Choosing a Title
• Making an Outline
• Paragraph Development
• Research Process Video Series
• Executive Summary
• The C.A.R.S. Model
• Background Information
• The Research Problem/Question
• Theoretical Framework
• Citation Tracking
• Content Alert Services
• Evaluating Sources
• Primary Sources
• Secondary Sources
• Tiertiary Sources
• Scholarly vs. Popular Publications
• Qualitative Methods
• Quantitative Methods
• Insiderness
• Using Non-Textual Elements
• Limitations of the Study
• Common Grammar Mistakes
• Writing Concisely
• Avoiding Plagiarism
• Footnotes or Endnotes?
• Further Readings
• Generative AI and Writing
• USC Libraries Tutorials and Other Guides
• Bibliography

The methods section describes actions taken to investigate a research problem and the rationale for the application of specific procedures or techniques used to identify, select, process, and analyze information applied to understanding the problem, thereby, allowing the reader to critically evaluate a study’s overall validity and reliability. The methodology section of a research paper answers two main questions: How was the data collected or generated? And, how was it analyzed? The writing should be direct and precise and always written in the past tense.

Kallet, Richard H. "How to Write the Methods Section of a Research Paper." Respiratory Care 49 (October 2004): 1229-1232.

Importance of a Good Methodology Section

You must explain how you obtained and analyzed your results for the following reasons:

• Readers need to know how the data was obtained because the method you chose affects the results and, by extension, how you interpreted their significance in the discussion section of your paper.
• Methodology is crucial for any branch of scholarship because an unreliable method produces unreliable results and, as a consequence, undermines the value of your analysis of the findings.
• In most cases, there are a variety of different methods you can choose to investigate a research problem. The methodology section of your paper should clearly articulate the reasons why you have chosen a particular procedure or technique.
• The reader wants to know that the data was collected or generated in a way that is consistent with accepted practice in the field of study. For example, if you are using a multiple choice questionnaire, readers need to know that it offered your respondents a reasonable range of answers to choose from.
• The method must be appropriate to fulfilling the overall aims of the study. For example, you need to ensure that you have a large enough sample size to be able to generalize and make recommendations based upon the findings.
• The methodology should discuss the problems that were anticipated and the steps you took to prevent them from occurring. For any problems that do arise, you must describe the ways in which they were minimized or why these problems do not impact in any meaningful way your interpretation of the findings.
• In the social and behavioral sciences, it is important to always provide sufficient information to allow other researchers to adopt or replicate your methodology. This information is particularly important when a new method has been developed or an innovative use of an existing method is utilized.

Bem, Daryl J. Writing the Empirical Journal Article. Psychology Writing Center. University of Washington; Denscombe, Martyn. The Good Research Guide: For Small-Scale Social Research Projects . 5th edition. Buckingham, UK: Open University Press, 2014; Lunenburg, Frederick C. Writing a Successful Thesis or Dissertation: Tips and Strategies for Students in the Social and Behavioral Sciences . Thousand Oaks, CA: Corwin Press, 2008.

Structure and Writing Style

I.  Groups of Research Methods

There are two main groups of research methods in the social sciences:

• The e mpirical-analytical group approaches the study of social sciences in a similar manner that researchers study the natural sciences . This type of research focuses on objective knowledge, research questions that can be answered yes or no, and operational definitions of variables to be measured. The empirical-analytical group employs deductive reasoning that uses existing theory as a foundation for formulating hypotheses that need to be tested. This approach is focused on explanation.
• The i nterpretative group of methods is focused on understanding phenomenon in a comprehensive, holistic way . Interpretive methods focus on analytically disclosing the meaning-making practices of human subjects [the why, how, or by what means people do what they do], while showing how those practices arrange so that it can be used to generate observable outcomes. Interpretive methods allow you to recognize your connection to the phenomena under investigation. However, the interpretative group requires careful examination of variables because it focuses more on subjective knowledge.

II.  Content

The introduction to your methodology section should begin by restating the research problem and underlying assumptions underpinning your study. This is followed by situating the methods you used to gather, analyze, and process information within the overall “tradition” of your field of study and within the particular research design you have chosen to study the problem. If the method you choose lies outside of the tradition of your field [i.e., your review of the literature demonstrates that the method is not commonly used], provide a justification for how your choice of methods specifically addresses the research problem in ways that have not been utilized in prior studies.

The remainder of your methodology section should describe the following:

• Decisions made in selecting the data you have analyzed or, in the case of qualitative research, the subjects and research setting you have examined,
• Tools and methods used to identify and collect information, and how you identified relevant variables,
• The ways in which you processed the data and the procedures you used to analyze that data, and
• The specific research tools or strategies that you utilized to study the underlying hypothesis and research questions.

In addition, an effectively written methodology section should:

• Introduce the overall methodological approach for investigating your research problem . Is your study qualitative or quantitative or a combination of both (mixed method)? Are you going to take a special approach, such as action research, or a more neutral stance?
• Indicate how the approach fits the overall research design . Your methods for gathering data should have a clear connection to your research problem. In other words, make sure that your methods will actually address the problem. One of the most common deficiencies found in research papers is that the proposed methodology is not suitable to achieving the stated objective of your paper.
• Describe the specific methods of data collection you are going to use , such as, surveys, interviews, questionnaires, observation, archival research. If you are analyzing existing data, such as a data set or archival documents, describe how it was originally created or gathered and by whom. Also be sure to explain how older data is still relevant to investigating the current research problem.
• Explain how you intend to analyze your results . Will you use statistical analysis? Will you use specific theoretical perspectives to help you analyze a text or explain observed behaviors? Describe how you plan to obtain an accurate assessment of relationships, patterns, trends, distributions, and possible contradictions found in the data.
• Provide background and a rationale for methodologies that are unfamiliar for your readers . Very often in the social sciences, research problems and the methods for investigating them require more explanation/rationale than widely accepted rules governing the natural and physical sciences. Be clear and concise in your explanation.
• Provide a justification for subject selection and sampling procedure . For instance, if you propose to conduct interviews, how do you intend to select the sample population? If you are analyzing texts, which texts have you chosen, and why? If you are using statistics, why is this set of data being used? If other data sources exist, explain why the data you chose is most appropriate to addressing the research problem.
• Provide a justification for case study selection . A common method of analyzing research problems in the social sciences is to analyze specific cases. These can be a person, place, event, phenomenon, or other type of subject of analysis that are either examined as a singular topic of in-depth investigation or multiple topics of investigation studied for the purpose of comparing or contrasting findings. In either method, you should explain why a case or cases were chosen and how they specifically relate to the research problem.
• Describe potential limitations . Are there any practical limitations that could affect your data collection? How will you attempt to control for potential confounding variables and errors? If your methodology may lead to problems you can anticipate, state this openly and show why pursuing this methodology outweighs the risk of these problems cropping up.

NOTE :   Once you have written all of the elements of the methods section, subsequent revisions should focus on how to present those elements as clearly and as logically as possibly. The description of how you prepared to study the research problem, how you gathered the data, and the protocol for analyzing the data should be organized chronologically. For clarity, when a large amount of detail must be presented, information should be presented in sub-sections according to topic. If necessary, consider using appendices for raw data.

ANOTHER NOTE : If you are conducting a qualitative analysis of a research problem , the methodology section generally requires a more elaborate description of the methods used as well as an explanation of the processes applied to gathering and analyzing of data than is generally required for studies using quantitative methods. Because you are the primary instrument for generating the data [e.g., through interviews or observations], the process for collecting that data has a significantly greater impact on producing the findings. Therefore, qualitative research requires a more detailed description of the methods used.

YET ANOTHER NOTE :   If your study involves interviews, observations, or other qualitative techniques involving human subjects , you may be required to obtain approval from the university's Office for the Protection of Research Subjects before beginning your research. This is not a common procedure for most undergraduate level student research assignments. However, i f your professor states you need approval, you must include a statement in your methods section that you received official endorsement and adequate informed consent from the office and that there was a clear assessment and minimization of risks to participants and to the university. This statement informs the reader that your study was conducted in an ethical and responsible manner. In some cases, the approval notice is included as an appendix to your paper.

III.  Problems to Avoid

Irrelevant Detail The methodology section of your paper should be thorough but concise. Do not provide any background information that does not directly help the reader understand why a particular method was chosen, how the data was gathered or obtained, and how the data was analyzed in relation to the research problem [note: analyzed, not interpreted! Save how you interpreted the findings for the discussion section]. With this in mind, the page length of your methods section will generally be less than any other section of your paper except the conclusion.

Unnecessary Explanation of Basic Procedures Remember that you are not writing a how-to guide about a particular method. You should make the assumption that readers possess a basic understanding of how to investigate the research problem on their own and, therefore, you do not have to go into great detail about specific methodological procedures. The focus should be on how you applied a method , not on the mechanics of doing a method. An exception to this rule is if you select an unconventional methodological approach; if this is the case, be sure to explain why this approach was chosen and how it enhances the overall process of discovery.

Problem Blindness It is almost a given that you will encounter problems when collecting or generating your data, or, gaps will exist in existing data or archival materials. Do not ignore these problems or pretend they did not occur. Often, documenting how you overcame obstacles can form an interesting part of the methodology. It demonstrates to the reader that you can provide a cogent rationale for the decisions you made to minimize the impact of any problems that arose.

Literature Review Just as the literature review section of your paper provides an overview of sources you have examined while researching a particular topic, the methodology section should cite any sources that informed your choice and application of a particular method [i.e., the choice of a survey should include any citations to the works you used to help construct the survey].

It’s More than Sources of Information! A description of a research study's method should not be confused with a description of the sources of information. Such a list of sources is useful in and of itself, especially if it is accompanied by an explanation about the selection and use of the sources. The description of the project's methodology complements a list of sources in that it sets forth the organization and interpretation of information emanating from those sources.

Azevedo, L.F. et al. "How to Write a Scientific Paper: Writing the Methods Section." Revista Portuguesa de Pneumologia 17 (2011): 232-238; Blair Lorrie. “Choosing a Methodology.” In Writing a Graduate Thesis or Dissertation , Teaching Writing Series. (Rotterdam: Sense Publishers 2016), pp. 49-72; Butin, Dan W. The Education Dissertation A Guide for Practitioner Scholars . Thousand Oaks, CA: Corwin, 2010; Carter, Susan. Structuring Your Research Thesis . New York: Palgrave Macmillan, 2012; Kallet, Richard H. “How to Write the Methods Section of a Research Paper.” Respiratory Care 49 (October 2004):1229-1232; Lunenburg, Frederick C. Writing a Successful Thesis or Dissertation: Tips and Strategies for Students in the Social and Behavioral Sciences . Thousand Oaks, CA: Corwin Press, 2008. Methods Section. The Writer’s Handbook. Writing Center. University of Wisconsin, Madison; Rudestam, Kjell Erik and Rae R. Newton. “The Method Chapter: Describing Your Research Plan.” In Surviving Your Dissertation: A Comprehensive Guide to Content and Process . (Thousand Oaks, Sage Publications, 2015), pp. 87-115; What is Interpretive Research. Institute of Public and International Affairs, University of Utah; Writing the Experimental Report: Methods, Results, and Discussion. The Writing Lab and The OWL. Purdue University; Methods and Materials. The Structure, Format, Content, and Style of a Journal-Style Scientific Paper. Department of Biology. Bates College.

Writing Tip

Statistical Designs and Tests? Do Not Fear Them!

Don't avoid using a quantitative approach to analyzing your research problem just because you fear the idea of applying statistical designs and tests. A qualitative approach, such as conducting interviews or content analysis of archival texts, can yield exciting new insights about a research problem, but it should not be undertaken simply because you have a disdain for running a simple regression. A well designed quantitative research study can often be accomplished in very clear and direct ways, whereas, a similar study of a qualitative nature usually requires considerable time to analyze large volumes of data and a tremendous burden to create new paths for analysis where previously no path associated with your research problem had existed.

To locate data and statistics, GO HERE .

Another Writing Tip

Knowing the Relationship Between Theories and Methods

There can be multiple meaning associated with the term "theories" and the term "methods" in social sciences research. A helpful way to delineate between them is to understand "theories" as representing different ways of characterizing the social world when you research it and "methods" as representing different ways of generating and analyzing data about that social world. Framed in this way, all empirical social sciences research involves theories and methods, whether they are stated explicitly or not. However, while theories and methods are often related, it is important that, as a researcher, you deliberately separate them in order to avoid your theories playing a disproportionate role in shaping what outcomes your chosen methods produce.

Introspectively engage in an ongoing dialectic between the application of theories and methods to help enable you to use the outcomes from your methods to interrogate and develop new theories, or ways of framing conceptually the research problem. This is how scholarship grows and branches out into new intellectual territory.

Reynolds, R. Larry. Ways of Knowing. Alternative Microeconomics . Part 1, Chapter 3. Boise State University; The Theory-Method Relationship. S-Cool Revision. United Kingdom.

Yet Another Writing Tip

Methods and the Methodology

Do not confuse the terms "methods" and "methodology." As Schneider notes, a method refers to the technical steps taken to do research . Descriptions of methods usually include defining and stating why you have chosen specific techniques to investigate a research problem, followed by an outline of the procedures you used to systematically select, gather, and process the data [remember to always save the interpretation of data for the discussion section of your paper].

The methodology refers to a discussion of the underlying reasoning why particular methods were used . This discussion includes describing the theoretical concepts that inform the choice of methods to be applied, placing the choice of methods within the more general nature of academic work, and reviewing its relevance to examining the research problem. The methodology section also includes a thorough review of the methods other scholars have used to study the topic.

Bryman, Alan. "Of Methods and Methodology." Qualitative Research in Organizations and Management: An International Journal 3 (2008): 159-168; Schneider, Florian. “What's in a Methodology: The Difference between Method, Methodology, and Theory…and How to Get the Balance Right?” PoliticsEastAsia.com. Chinese Department, University of Leiden, Netherlands.

• << Previous: Scholarly vs. Popular Publications
• Next: Qualitative Methods >>
• Last Updated: Apr 11, 2024 1:27 PM
• URL: https://libguides.usc.edu/writingguide

What Is Research Methodology? A Plain-Language Explanation & Definition (With Examples)

By Derek Jansen (MBA)  and Kerryn Warren (PhD) | June 2020 (Last updated April 2023)

If you’re new to formal academic research, it’s quite likely that you’re feeling a little overwhelmed by all the technical lingo that gets thrown around. And who could blame you – “research methodology”, “research methods”, “sampling strategies”… it all seems never-ending!

In this post, we’ll demystify the landscape with plain-language explanations and loads of examples (including easy-to-follow videos), so that you can approach your dissertation, thesis or research project with confidence. Let’s get started.

Research Methodology 101

• What exactly research methodology means
• What qualitative , quantitative and mixed methods are
• What sampling strategy is
• What data collection methods are
• What data analysis methods are
• How to choose your research methodology
• Example of a research methodology

What is research methodology?

Research methodology simply refers to the practical “how” of a research study. More specifically, it’s about how  a researcher  systematically designs a study  to ensure valid and reliable results that address the research aims, objectives and research questions . Specifically, how the researcher went about deciding:

• What type of data to collect (e.g., qualitative or quantitative data )
• Who  to collect it from (i.e., the sampling strategy )
• How to  collect  it (i.e., the data collection method )
• How to  analyse  it (i.e., the data analysis methods )

Within any formal piece of academic research (be it a dissertation, thesis or journal article), you’ll find a research methodology chapter or section which covers the aspects mentioned above. Importantly, a good methodology chapter explains not just   what methodological choices were made, but also explains  why they were made. In other words, the methodology chapter should justify  the design choices, by showing that the chosen methods and techniques are the best fit for the research aims, objectives and research questions. 

So, it’s the same as research design?

Not quite. As we mentioned, research methodology refers to the collection of practical decisions regarding what data you’ll collect, from who, how you’ll collect it and how you’ll analyse it. Research design, on the other hand, is more about the overall strategy you’ll adopt in your study. For example, whether you’ll use an experimental design in which you manipulate one variable while controlling others. You can learn more about research design and the various design types here .

Need a helping hand?

What are qualitative, quantitative and mixed-methods?

Qualitative, quantitative and mixed-methods are different types of methodological approaches, distinguished by their focus on words , numbers or both . This is a bit of an oversimplification, but its a good starting point for understanding.

Let’s take a closer look.

Qualitative research refers to research which focuses on collecting and analysing words (written or spoken) and textual or visual data, whereas quantitative research focuses on measurement and testing using numerical data . Qualitative analysis can also focus on other “softer” data points, such as body language or visual elements.

It’s quite common for a qualitative methodology to be used when the research aims and research questions are exploratory  in nature. For example, a qualitative methodology might be used to understand peoples’ perceptions about an event that took place, or a political candidate running for president. 

Contrasted to this, a quantitative methodology is typically used when the research aims and research questions are confirmatory  in nature. For example, a quantitative methodology might be used to measure the relationship between two variables (e.g. personality type and likelihood to commit a crime) or to test a set of hypotheses .

As you’ve probably guessed, the mixed-method methodology attempts to combine the best of both qualitative and quantitative methodologies to integrate perspectives and create a rich picture. If you’d like to learn more about these three methodological approaches, be sure to watch our explainer video below.

What is sampling strategy?

Simply put, sampling is about deciding who (or where) you’re going to collect your data from . Why does this matter? Well, generally it’s not possible to collect data from every single person in your group of interest (this is called the “population”), so you’ll need to engage a smaller portion of that group that’s accessible and manageable (this is called the “sample”).

How you go about selecting the sample (i.e., your sampling strategy) will have a major impact on your study.  There are many different sampling methods  you can choose from, but the two overarching categories are probability   sampling and  non-probability   sampling .

Probability sampling  involves using a completely random sample from the group of people you’re interested in. This is comparable to throwing the names all potential participants into a hat, shaking it up, and picking out the “winners”. By using a completely random sample, you’ll minimise the risk of selection bias and the results of your study will be more generalisable  to the entire population. 

Non-probability sampling , on the other hand,  doesn’t use a random sample . For example, it might involve using a convenience sample, which means you’d only interview or survey people that you have access to (perhaps your friends, family or work colleagues), rather than a truly random sample. With non-probability sampling, the results are typically not generalisable .

To learn more about sampling methods, be sure to check out the video below.

What are data collection methods?

As the name suggests, data collection methods simply refers to the way in which you go about collecting the data for your study. Some of the most common data collection methods include:

• Interviews (which can be unstructured, semi-structured or structured)
• Focus groups and group interviews
• Surveys (online or physical surveys)
• Observations (watching and recording activities)
• Biophysical measurements (e.g., blood pressure, heart rate, etc.)
• Documents and records (e.g., financial reports, court records, etc.)

The choice of which data collection method to use depends on your overall research aims and research questions , as well as practicalities and resource constraints. For example, if your research is exploratory in nature, qualitative methods such as interviews and focus groups would likely be a good fit. Conversely, if your research aims to measure specific variables or test hypotheses, large-scale surveys that produce large volumes of numerical data would likely be a better fit.

What are data analysis methods?

Data analysis methods refer to the methods and techniques that you’ll use to make sense of your data. These can be grouped according to whether the research is qualitative  (words-based) or quantitative (numbers-based).

Popular data analysis methods in qualitative research include:

• Qualitative content analysis
• Thematic analysis
• Discourse analysis
• Narrative analysis
• Interpretative phenomenological analysis (IPA)
• Visual analysis (of photographs, videos, art, etc.)

Qualitative data analysis all begins with data coding , after which an analysis method is applied. In some cases, more than one analysis method is used, depending on the research aims and research questions . In the video below, we explore some  common qualitative analysis methods, along with practical examples.  

Moving on to the quantitative side of things, popular data analysis methods in this type of research include:

• Descriptive statistics (e.g. means, medians, modes )
• Inferential statistics (e.g. correlation, regression, structural equation modelling)

Again, the choice of which data collection method to use depends on your overall research aims and objectives , as well as practicalities and resource constraints. In the video below, we explain some core concepts central to quantitative analysis.

How do I choose a research methodology?

As you’ve probably picked up by now, your research aims and objectives have a major influence on the research methodology . So, the starting point for developing your research methodology is to take a step back and look at the big picture of your research, before you make methodology decisions. The first question you need to ask yourself is whether your research is exploratory or confirmatory in nature.

If your research aims and objectives are primarily exploratory in nature, your research will likely be qualitative and therefore you might consider qualitative data collection methods (e.g. interviews) and analysis methods (e.g. qualitative content analysis). 

Conversely, if your research aims and objective are looking to measure or test something (i.e. they’re confirmatory), then your research will quite likely be quantitative in nature, and you might consider quantitative data collection methods (e.g. surveys) and analyses (e.g. statistical analysis).

Designing your research and working out your methodology is a large topic, which we cover extensively on the blog . For now, however, the key takeaway is that you should always start with your research aims, objectives and research questions (the golden thread). Every methodological choice you make needs align with those three components. 

Example of a research methodology chapter

In the video below, we provide a detailed walkthrough of a research methodology from an actual dissertation, as well as an overview of our free methodology template .

Psst… there’s more (for free)

This post is part of our dissertation mini-course, which covers everything you need to get started with your dissertation, thesis or research project. 

You Might Also Like:

199 Comments

Thank you for this simple yet comprehensive and easy to digest presentation. God Bless!

You’re most welcome, Leo. Best of luck with your research!

I found it very useful. many thanks

This is really directional. A make-easy research knowledge.

Thank you for this, I think will help my research proposal

Thanks for good interpretation,well understood.

Good morning sorry I want to the search topic

Thank u more

Thank you, your explanation is simple and very helpful.

Very educative a.nd exciting platform. A bigger thank you and I’ll like to always be with you

That’s the best analysis

So simple yet so insightful. Thank you.

This really easy to read as it is self-explanatory. Very much appreciated…

Thanks for this. It’s so helpful and explicit. For those elements highlighted in orange, they were good sources of referrals for concepts I didn’t understand. A million thanks for this.

Good morning, I have been reading your research lessons through out a period of times. They are important, impressive and clear. Want to subscribe and be and be active with you.

Thankyou So much Sir Derek…

Good morning thanks so much for the on line lectures am a student of university of Makeni.select a research topic and deliberate on it so that we’ll continue to understand more.sorry that’s a suggestion.

Beautiful presentation. I love it.

please provide a research mehodology example for zoology

It’s very educative and well explained

Thanks for the concise and informative data.

This is really good for students to be safe and well understand that research is all about

Thank you so much Derek sir🖤🙏🤗

Very simple and reliable

This is really helpful. Thanks alot. God bless you.

very useful, Thank you very much..

thanks a lot its really useful

in a nutshell..thank you!

Thanks for updating my understanding on this aspect of my Thesis writing.

thank you so much my through this video am competently going to do a good job my thesis

Thanks a lot. Very simple to understand. I appreciate 🙏

Very simple but yet insightful Thank you

This has been an eye opening experience. Thank you grad coach team.

Very useful message for research scholars

Really very helpful thank you

yes you are right and i’m left

Research methodology with a simplest way i have never seen before this article.

wow thank u so much

Good morning thanks so much for the on line lectures am a student of university of Makeni.select a research topic and deliberate on is so that we will continue to understand more.sorry that’s a suggestion.

Very precise and informative.

Thanks for simplifying these terms for us, really appreciate it.

Thanks this has really helped me. It is very easy to understand.

I found the notes and the presentation assisting and opening my understanding on research methodology

Good presentation

Im so glad you clarified my misconceptions. Im now ready to fry my onions. Thank you so much. God bless

Thank you a lot.

thanks for the easy way of learning and desirable presentation.

Thanks a lot. I am inspired

Well written

I am writing a APA Format paper . I using questionnaire with 120 STDs teacher for my participant. Can you write me mthology for this research. Send it through email sent. Just need a sample as an example please. My topic is ” impacts of overcrowding on students learning

Thanks for your comment.

We can’t write your methodology for you. If you’re looking for samples, you should be able to find some sample methodologies on Google. Alternatively, you can download some previous dissertations from a dissertation directory and have a look at the methodology chapters therein.

All the best with your research.

Thank you so much for this!! God Bless

Thank you. Explicit explanation

Thank you, Derek and Kerryn, for making this simple to understand. I’m currently at the inception stage of my research.

Thnks a lot , this was very usefull on my assignment

excellent explanation

I’m currently working on my master’s thesis, thanks for this! I’m certain that I will use Qualitative methodology.

Thanks a lot for this concise piece, it was quite relieving and helpful. God bless you BIG…

I am currently doing my dissertation proposal and I am sure that I will do quantitative research. Thank you very much it was extremely helpful.

Very interesting and informative yet I would like to know about examples of Research Questions as well, if possible.

I’m about to submit a research presentation, I have come to understand from your simplification on understanding research methodology. My research will be mixed methodology, qualitative as well as quantitative. So aim and objective of mixed method would be both exploratory and confirmatory. Thanks you very much for your guidance.

OMG thanks for that, you’re a life saver. You covered all the points I needed. Thank you so much ❤️ ❤️ ❤️

Thank you immensely for this simple, easy to comprehend explanation of data collection methods. I have been stuck here for months 😩. Glad I found your piece. Super insightful.

I’m going to write synopsis which will be quantitative research method and I don’t know how to frame my topic, can I kindly get some ideas..

Thanks for this, I was really struggling.

This was really informative I was struggling but this helped me.

Thanks a lot for this information, simple and straightforward. I’m a last year student from the University of South Africa UNISA South Africa.

its very much informative and understandable. I have enlightened.

An interesting nice exploration of a topic.

Thank you. Accurate and simple🥰

This article was really helpful, it helped me understanding the basic concepts of the topic Research Methodology. The examples were very clear, and easy to understand. I would like to visit this website again. Thank you so much for such a great explanation of the subject.

Thanks dude

Thank you Doctor Derek for this wonderful piece, please help to provide your details for reference purpose. God bless.

Many compliments to you

Great work , thank you very much for the simple explanation

Thank you. I had to give a presentation on this topic. I have looked everywhere on the internet but this is the best and simple explanation.

thank you, its very informative.

Well explained. Now I know my research methodology will be qualitative and exploratory. Thank you so much, keep up the good work

Well explained, thank you very much.

This is good explanation, I have understood the different methods of research. Thanks a lot.

Great work…very well explanation

Thanks Derek. Kerryn was just fantastic!

Great to hear that, Hyacinth. Best of luck with your research!

Its a good templates very attractive and important to PhD students and lectuter

Thanks for the feedback, Matobela. Good luck with your research methodology.

Thank you. This is really helpful.

You’re very welcome, Elie. Good luck with your research methodology.

Well explained thanks

This is a very helpful site especially for young researchers at college. It provides sufficient information to guide students and equip them with the necessary foundation to ask any other questions aimed at deepening their understanding.

Thanks for the kind words, Edward. Good luck with your research!

Thank you. I have learned a lot.

Great to hear that, Ngwisa. Good luck with your research methodology!

Thank you for keeping your presentation simples and short and covering key information for research methodology. My key takeaway: Start with defining your research objective the other will depend on the aims of your research question.

My name is Zanele I would like to be assisted with my research , and the topic is shortage of nursing staff globally want are the causes , effects on health, patients and community and also globally

Thanks for making it simple and clear. It greatly helped in understanding research methodology. Regards.

This is well simplified and straight to the point

Thank you Dr

I was given an assignment to research 2 publications and describe their research methodology? I don’t know how to start this task can someone help me?

Sure. You’re welcome to book an initial consultation with one of our Research Coaches to discuss how we can assist – https://gradcoach.com/book/new/ .

Thanks a lot I am relieved of a heavy burden.keep up with the good work

I’m very much grateful Dr Derek. I’m planning to pursue one of the careers that really needs one to be very much eager to know. There’s a lot of research to do and everything, but since I’ve gotten this information I will use it to the best of my potential.

Thank you so much, words are not enough to explain how helpful this session has been for me!

Thanks this has thought me alot.

Very concise and helpful. Thanks a lot

Thank Derek. This is very helpful. Your step by step explanation has made it easier for me to understand different concepts. Now i can get on with my research.

I wish i had come across this sooner. So simple but yet insightful

really nice explanation thank you so much

I’m so grateful finding this site, it’s really helpful…….every term well explained and provide accurate understanding especially to student going into an in-depth research for the very first time, even though my lecturer already explained this topic to the class, I think I got the clear and efficient explanation here, much thanks to the author.

It is very helpful material

I would like to be assisted with my research topic : Literature Review and research methodologies. My topic is : what is the relationship between unemployment and economic growth?

Its really nice and good for us.

THANKS SO MUCH FOR EXPLANATION, ITS VERY CLEAR TO ME WHAT I WILL BE DOING FROM NOW .GREAT READS.

Short but sweet.Thank you

Informative article. Thanks for your detailed information.

I’m currently working on my Ph.D. thesis. Thanks a lot, Derek and Kerryn, Well-organized sequences, facilitate the readers’ following.

great article for someone who does not have any background can even understand

I am a bit confused about research design and methodology. Are they the same? If not, what are the differences and how are they related?

Thanks in advance.

concise and informative.

Thank you very much

How can we site this article is Harvard style?

Very well written piece that afforded better understanding of the concept. Thank you!

Am a new researcher trying to learn how best to write a research proposal. I find your article spot on and want to download the free template but finding difficulties. Can u kindly send it to my email, the free download entitled, “Free Download: Research Proposal Template (with Examples)”.

Thank too much

Thank you very much for your comprehensive explanation about research methodology so I like to thank you again for giving us such great things.

Good very well explained.Thanks for sharing it.

Thank u sir, it is really a good guideline.

so helpful thank you very much.

Thanks for the video it was very explanatory and detailed, easy to comprehend and follow up. please, keep it up the good work

It was very helpful, a well-written document with precise information.

how do i reference this?

MLA Jansen, Derek, and Kerryn Warren. “What (Exactly) Is Research Methodology?” Grad Coach, June 2021, gradcoach.com/what-is-research-methodology/.

APA Jansen, D., & Warren, K. (2021, June). What (Exactly) Is Research Methodology? Grad Coach. https://gradcoach.com/what-is-research-methodology/

Your explanation is easily understood. Thank you

Very help article. Now I can go my methodology chapter in my thesis with ease

I feel guided ,Thank you

This simplification is very helpful. It is simple but very educative, thanks ever so much

The write up is informative and educative. It is an academic intellectual representation that every good researcher can find useful. Thanks

Wow, this is wonderful long live.

Nice initiative

thank you the video was helpful to me.

Thank you very much for your simple and clear explanations I’m really satisfied by the way you did it By now, I think I can realize a very good article by following your fastidious indications May God bless you

Thanks very much, it was very concise and informational for a beginner like me to gain an insight into what i am about to undertake. I really appreciate.

very informative sir, it is amazing to understand the meaning of question hidden behind that, and simple language is used other than legislature to understand easily. stay happy.

This one is really amazing. All content in your youtube channel is a very helpful guide for doing research. Thanks, GradCoach.

research methodologies

Please send me more information concerning dissertation research.

Nice piece of knowledge shared….. #Thump_UP

This is amazing, it has said it all. Thanks to Gradcoach

This is wonderful,very elaborate and clear.I hope to reach out for your assistance in my research very soon.

This is the answer I am searching about…

realy thanks a lot

Thank you very much for this awesome, to the point and inclusive article.

Thank you very much I need validity and reliability explanation I have exams

Thank you for a well explained piece. This will help me going forward.

Very simple and well detailed Many thanks

This is so very simple yet so very effective and comprehensive. An Excellent piece of work.

I wish I saw this earlier on! Great insights for a beginner(researcher) like me. Thanks a mil!

Thank you very much, for such a simplified, clear and practical step by step both for academic students and general research work. Holistic, effective to use and easy to read step by step. One can easily apply the steps in practical terms and produce a quality document/up-to standard

Thanks for simplifying these terms for us, really appreciated.

Thanks for a great work. well understood .

This was very helpful. It was simple but profound and very easy to understand. Thank you so much!

Great and amazing research guidelines. Best site for learning research

hello sir/ma’am, i didn’t find yet that what type of research methodology i am using. because i am writing my report on CSR and collect all my data from websites and articles so which type of methodology i should write in dissertation report. please help me. i am from India.

how does this really work?

perfect content, thanks a lot

As a researcher, I commend you for the detailed and simplified information on the topic in question. I would like to remain in touch for the sharing of research ideas on other topics. Thank you

Impressive. Thank you, Grad Coach 😍

Thank you Grad Coach for this piece of information. I have at least learned about the different types of research methodologies.

Very useful content with easy way

Thank you very much for the presentation. I am an MPH student with the Adventist University of Africa. I have successfully completed my theory and starting on my research this July. My topic is “Factors associated with Dental Caries in (one District) in Botswana. I need help on how to go about this quantitative research

I am so grateful to run across something that was sooo helpful. I have been on my doctorate journey for quite some time. Your breakdown on methodology helped me to refresh my intent. Thank you.

thanks so much for this good lecture. student from university of science and technology, Wudil. Kano Nigeria.

It’s profound easy to understand I appreciate

Thanks a lot for sharing superb information in a detailed but concise manner. It was really helpful and helped a lot in getting into my own research methodology.

Comment * thanks very much

This was sooo helpful for me thank you so much i didn’t even know what i had to write thank you!

You’re most welcome 🙂

Simple and good. Very much helpful. Thank you so much.

This is very good work. I have benefited.

Thank you so much for sharing

This is powerful thank you so much guys

I am nkasa lizwi doing my research proposal on honors with the university of Walter Sisulu Komani I m on part 3 now can you assist me.my topic is: transitional challenges faced by educators in intermediate phase in the Alfred Nzo District.

Appreciate the presentation. Very useful step-by-step guidelines to follow.

I appreciate sir

wow! This is super insightful for me. Thank you!

Indeed this material is very helpful! Kudos writers/authors.

I want to say thank you very much, I got a lot of info and knowledge. Be blessed.

I want present a seminar paper on Optimisation of Deep learning-based models on vulnerability detection in digital transactions.

Need assistance

Dear Sir, I want to be assisted on my research on Sanitation and Water management in emergencies areas.

I am deeply grateful for the knowledge gained. I will be getting in touch shortly as I want to be assisted in my ongoing research.

The information shared is informative, crisp and clear. Kudos Team! And thanks a lot!

hello i want to study

Hello!! Grad coach teams. I am extremely happy in your tutorial or consultation. i am really benefited all material and briefing. Thank you very much for your generous helps. Please keep it up. If you add in your briefing, references for further reading, it will be very nice.

All I have to say is, thank u gyz.

Good, l thanks

thank you, it is very useful

Trackbacks/Pingbacks

• What Is A Literature Review (In A Dissertation Or Thesis) - Grad Coach - […] the literature review is to inform the choice of methodology for your own research. As we’ve discussed on the Grad Coach blog,…
• Free Download: Research Proposal Template (With Examples) - Grad Coach - […] Research design (methodology) […]
• Dissertation vs Thesis: What's the difference? - Grad Coach - […] and thesis writing on a daily basis – everything from how to find a good research topic to which…

Submit a Comment Cancel reply

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

• Print Friendly

Reference management. Clean and simple.

What is research methodology?

The basics of research methodology

Why do you need a research methodology, what needs to be included, why do you need to document your research method, what are the different types of research instruments, qualitative / quantitative / mixed research methodologies, how do you choose the best research methodology for you, frequently asked questions about research methodology, related articles.

When you’re working on your first piece of academic research, there are many different things to focus on, and it can be overwhelming to stay on top of everything. This is especially true of budding or inexperienced researchers.

If you’ve never put together a research proposal before or find yourself in a position where you need to explain your research methodology decisions, there are a few things you need to be aware of.

Once you understand the ins and outs, handling academic research in the future will be less intimidating. We break down the basics below:

A research methodology encompasses the way in which you intend to carry out your research. This includes how you plan to tackle things like collection methods, statistical analysis, participant observations, and more.

You can think of your research methodology as being a formula. One part will be how you plan on putting your research into practice, and another will be why you feel this is the best way to approach it. Your research methodology is ultimately a methodological and systematic plan to resolve your research problem.

In short, you are explaining how you will take your idea and turn it into a study, which in turn will produce valid and reliable results that are in accordance with the aims and objectives of your research. This is true whether your paper plans to make use of qualitative methods or quantitative methods.

The purpose of a research methodology is to explain the reasoning behind your approach to your research - you'll need to support your collection methods, methods of analysis, and other key points of your work.

Think of it like writing a plan or an outline for you what you intend to do.

When carrying out research, it can be easy to go off-track or depart from your standard methodology.

Tip: Having a methodology keeps you accountable and on track with your original aims and objectives, and gives you a suitable and sound plan to keep your project manageable, smooth, and effective.

With all that said, how do you write out your standard approach to a research methodology?

As a general plan, your methodology should include the following information:

• Your research method.  You need to state whether you plan to use quantitative analysis, qualitative analysis, or mixed-method research methods. This will often be determined by what you hope to achieve with your research.
• Explain your reasoning. Why are you taking this methodological approach? Why is this particular methodology the best way to answer your research problem and achieve your objectives?
• Explain your instruments.  This will mainly be about your collection methods. There are varying instruments to use such as interviews, physical surveys, questionnaires, for example. Your methodology will need to detail your reasoning in choosing a particular instrument for your research.
• What will you do with your results?  How are you going to analyze the data once you have gathered it?
• Advise your reader.  If there is anything in your research methodology that your reader might be unfamiliar with, you should explain it in more detail. For example, you should give any background information to your methods that might be relevant or provide your reasoning if you are conducting your research in a non-standard way.
• How will your sampling process go?  What will your sampling procedure be and why? For example, if you will collect data by carrying out semi-structured or unstructured interviews, how will you choose your interviewees and how will you conduct the interviews themselves?
• Any practical limitations?  You should discuss any limitations you foresee being an issue when you’re carrying out your research.

In any dissertation, thesis, or academic journal, you will always find a chapter dedicated to explaining the research methodology of the person who carried out the study, also referred to as the methodology section of the work.

A good research methodology will explain what you are going to do and why, while a poor methodology will lead to a messy or disorganized approach.

You should also be able to justify in this section your reasoning for why you intend to carry out your research in a particular way, especially if it might be a particularly unique method.

Having a sound methodology in place can also help you with the following:

• When another researcher at a later date wishes to try and replicate your research, they will need your explanations and guidelines.
• In the event that you receive any criticism or questioning on the research you carried out at a later point, you will be able to refer back to it and succinctly explain the how and why of your approach.
• It provides you with a plan to follow throughout your research. When you are drafting your methodology approach, you need to be sure that the method you are using is the right one for your goal. This will help you with both explaining and understanding your method.
• It affords you the opportunity to document from the outset what you intend to achieve with your research, from start to finish.

A research instrument is a tool you will use to help you collect, measure and analyze the data you use as part of your research.

The choice of research instrument will usually be yours to make as the researcher and will be whichever best suits your methodology.

There are many different research instruments you can use in collecting data for your research.

Generally, they can be grouped as follows:

• Interviews (either as a group or one-on-one). You can carry out interviews in many different ways. For example, your interview can be structured, semi-structured, or unstructured. The difference between them is how formal the set of questions is that is asked of the interviewee. In a group interview, you may choose to ask the interviewees to give you their opinions or perceptions on certain topics.
• Surveys (online or in-person). In survey research, you are posing questions in which you ask for a response from the person taking the survey. You may wish to have either free-answer questions such as essay-style questions, or you may wish to use closed questions such as multiple choice. You may even wish to make the survey a mixture of both.
• Focus Groups.  Similar to the group interview above, you may wish to ask a focus group to discuss a particular topic or opinion while you make a note of the answers given.
• Observations.  This is a good research instrument to use if you are looking into human behaviors. Different ways of researching this include studying the spontaneous behavior of participants in their everyday life, or something more structured. A structured observation is research conducted at a set time and place where researchers observe behavior as planned and agreed upon with participants.

These are the most common ways of carrying out research, but it is really dependent on your needs as a researcher and what approach you think is best to take.

It is also possible to combine a number of research instruments if this is necessary and appropriate in answering your research problem.

There are three different types of methodologies, and they are distinguished by whether they focus on words, numbers, or both.

➡️ Want to learn more about the differences between qualitative and quantitative research, and how to use both methods? Check out our guide for that!

If you've done your due diligence, you'll have an idea of which methodology approach is best suited to your research.

It’s likely that you will have carried out considerable reading and homework before you reach this point and you may have taken inspiration from other similar studies that have yielded good results.

Still, it is important to consider different options before setting your research in stone. Exploring different options available will help you to explain why the choice you ultimately make is preferable to other methods.

If proving your research problem requires you to gather large volumes of numerical data to test hypotheses, a quantitative research method is likely to provide you with the most usable results.

If instead you’re looking to try and learn more about people, and their perception of events, your methodology is more exploratory in nature and would therefore probably be better served using a qualitative research methodology.

It helps to always bring things back to the question: what do I want to achieve with my research?

Once you have conducted your research, you need to analyze it. Here are some helpful guides for qualitative data analysis:

➡️  How to do a content analysis

➡️  How to do a thematic analysis

➡️  How to do a rhetorical analysis

Research methodology refers to the techniques used to find and analyze information for a study, ensuring that the results are valid, reliable and that they address the research objective.

Data can typically be organized into four different categories or methods: observational, experimental, simulation, and derived.

Writing a methodology section is a process of introducing your methods and instruments, discussing your analysis, providing more background information, addressing your research limitations, and more.

Your research methodology section will need a clear research question and proposed research approach. You'll need to add a background, introduce your research question, write your methodology and add the works you cited during your data collecting phase.

The research methodology section of your study will indicate how valid your findings are and how well-informed your paper is. It also assists future researchers planning to use the same methodology, who want to cite your study or replicate it.

• Resources Home 🏠
• Try SciSpace Copilot
• Search research papers
• Add Copilot Extension
• Try AI Detector
• Try Paraphraser
• Try Citation Generator
• April Papers
• June Papers
• July Papers

A Comprehensive Guide to Methodology in Research

Table of Contents

Research methodology plays a crucial role in any study or investigation. It provides the framework for collecting, analyzing, and interpreting data, ensuring that the research is reliable, valid, and credible. Understanding the importance of research methodology is essential for conducting rigorous and meaningful research.

In this article, we'll explore the various aspects of research methodology, from its types to best practices, ensuring you have the knowledge needed to conduct impactful research.

What is Research Methodology?

Research methodology refers to the system of procedures, techniques, and tools used to carry out a research study. It encompasses the overall approach, including the research design, data collection methods, data analysis techniques, and the interpretation of findings.

Research methodology plays a crucial role in the field of research, as it sets the foundation for any study. It provides researchers with a structured framework to ensure that their investigations are conducted in a systematic and organized manner. By following a well-defined methodology, researchers can ensure that their findings are reliable, valid, and meaningful.

When defining research methodology, one of the first steps is to identify the research problem. This involves clearly understanding the issue or topic that the study aims to address. By defining the research problem, researchers can narrow down their focus and determine the specific objectives they want to achieve through their study.

How to Define Research Methodology

Once the research problem is identified, researchers move on to defining the research questions. These questions serve as a guide for the study, helping researchers to gather relevant information and analyze it effectively. The research questions should be clear, concise, and aligned with the overall goals of the study.

After defining the research questions, researchers need to determine how data will be collected and analyzed. This involves selecting appropriate data collection methods, such as surveys, interviews, observations, or experiments. The choice of data collection methods depends on various factors, including the nature of the research problem, the target population, and the available resources.

Once the data is collected, researchers need to analyze it using appropriate data analysis techniques. This may involve statistical analysis, qualitative analysis, or a combination of both, depending on the nature of the data and the research questions. The analysis of data helps researchers to draw meaningful conclusions and make informed decisions based on their findings.

Role of Methodology in Research

Methodology plays a crucial role in research, as it ensures that the study is conducted in a systematic and organized manner. It provides a clear roadmap for researchers to follow, ensuring that the research objectives are met effectively. By following a well-defined methodology, researchers can minimize bias, errors, and inconsistencies in their study, thus enhancing the reliability and validity of their findings.

In addition to providing a structured approach, research methodology also helps in establishing the reliability and validity of the study. Reliability refers to the consistency and stability of the research findings, while validity refers to the accuracy and truthfulness of the findings. By using appropriate research methods and techniques, researchers can ensure that their study produces reliable and valid results, which can be used to make informed decisions and contribute to the existing body of knowledge.

Steps in Choosing the Right Research Methodology

Choosing the appropriate research methodology for your study is a critical step in ensuring the success of your research. Let's explore some steps to help you select the right research methodology:

Identifying the Research Problem

The first step in choosing the right research methodology is to clearly identify and define the research problem. Understanding the research problem will help you determine which methodology will best address your research questions and objectives.

Identifying the research problem involves a thorough examination of the existing literature in your field of study. This step allows you to gain a comprehensive understanding of the current state of knowledge and identify any gaps that your research can fill. By identifying the research problem, you can ensure that your study contributes to the existing body of knowledge and addresses a significant research gap.

Once you have identified the research problem, you need to consider the scope of your study. Are you focusing on a specific population, geographic area, or time frame? Understanding the scope of your research will help you determine the appropriate research methodology to use.

Reviewing Previous Research

Before finalizing the research methodology, it is essential to review previous research conducted in the field. This will allow you to identify gaps, determine the most effective methodologies used in similar studies, and build upon existing knowledge.

Reviewing previous research involves conducting a systematic review of relevant literature. This process includes searching for and analyzing published studies, articles, and reports that are related to your research topic. By reviewing previous research, you can gain insights into the strengths and limitations of different methodologies and make informed decisions about which approach to adopt.

During the review process, it is important to critically evaluate the quality and reliability of the existing research. Consider factors such as the sample size, research design, data collection methods, and statistical analysis techniques used in previous studies. This evaluation will help you determine the most appropriate research methodology for your own study.

Formulating Research Questions

Once the research problem is identified, formulate specific and relevant research questions. These questions will guide your methodology selection process by helping you determine what type of data you need to collect and how to analyze it.

Formulating research questions involves breaking down the research problem into smaller, more manageable components. These questions should be clear, concise, and measurable. They should also align with the objectives of your study and provide a framework for data collection and analysis.

When formulating research questions, consider the different types of data that can be collected, such as qualitative or quantitative data. Depending on the nature of your research questions, you may need to employ different data collection methods, such as interviews, surveys, observations, or experiments. By carefully formulating research questions, you can ensure that your chosen methodology will enable you to collect the necessary data to answer your research questions effectively.

Implementing the Research Methodology

After choosing the appropriate research methodology, it is time to implement it. This stage involves collecting data using various techniques and analyzing the gathered information. Let's explore two crucial aspects of implementing the research methodology:

Data Collection Techniques

Data collection techniques depend on the chosen research methodology. They can include surveys, interviews, observations, experiments, or document analysis. Selecting the most suitable data collection techniques will ensure accurate and relevant data for your study.

Data Analysis Methods

Data analysis is a critical part of the research process. It involves interpreting and making sense of the collected data to draw meaningful conclusions. Depending on the research methodology, data analysis methods can include statistical analysis, content analysis, thematic analysis, or grounded theory.

Ensuring the Validity and Reliability of Your Research

In order to ensure the validity and reliability of your research findings, it is important to address these two key aspects:

Understanding Validity in Research

Validity refers to the accuracy and soundness of a research study. It is crucial to ensure that the research methods used effectively measure what they intend to measure. Researchers can enhance validity by using proper sampling techniques, carefully designing research instruments, and ensuring accurate data collection.

Ensuring Reliability in Your Study

Reliability refers to the consistency and stability of the research results. It is important to ensure that the research methods and instruments used yield consistent and reproducible results. Researchers can enhance reliability by using standardized procedures, ensuring inter-rater reliability, and conducting pilot studies.

A comprehensive understanding of research methodology is essential for conducting high-quality research. By selecting the right research methodology, researchers can ensure that their studies are rigorous, reliable, and valid. It is crucial to follow the steps in choosing the appropriate methodology, implement the chosen methodology effectively, and address validity and reliability concerns throughout the research process. By doing so, researchers can contribute valuable insights and advances in their respective fields.

You might also like

AI for Meta Analysis — A Comprehensive Guide

How To Write An Argumentative Essay

Beyond Google Scholar: Why SciSpace is the best alternative

• Research Process

Choosing the Right Research Methodology: A Guide for Researchers

• 3 minute read

Table of Contents

Choosing an optimal research methodology is crucial for the success of any research project. The methodology you select will determine the type of data you collect, how you collect it, and how you analyse it. Understanding the different types of research methods available along with their strengths and weaknesses, is thus imperative to make an informed decision.

Understanding different research methods:

There are several research methods available depending on the type of study you are conducting, i.e., whether it is laboratory-based, clinical, epidemiological, or survey based . Some common methodologies include qualitative research, quantitative research, experimental research, survey-based research, and action research. Each method can be opted for and modified, depending on the type of research hypotheses and objectives.

Qualitative vs quantitative research:

When deciding on a research methodology, one of the key factors to consider is whether your research will be qualitative or quantitative. Qualitative research is used to understand people’s experiences, concepts, thoughts, or behaviours . Quantitative research, on the contrary, deals with numbers, graphs, and charts, and is used to test or confirm hypotheses, assumptions, and theories. 

Qualitative research methodology:

Qualitative research is often used to examine issues that are not well understood, and to gather additional insights on these topics. Qualitative research methods include open-ended survey questions, observations of behaviours described through words, and reviews of literature that has explored similar theories and ideas. These methods are used to understand how language is used in real-world situations, identify common themes or overarching ideas, and describe and interpret various texts. Data analysis for qualitative research typically includes discourse analysis, thematic analysis, and textual analysis. 

Quantitative research methodology:

The goal of quantitative research is to test hypotheses, confirm assumptions and theories, and determine cause-and-effect relationships. Quantitative research methods include experiments, close-ended survey questions, and countable and numbered observations. Data analysis for quantitative research relies heavily on statistical methods.

Analysing qualitative vs quantitative data:

The methods used for data analysis also differ for qualitative and quantitative research. As mentioned earlier, quantitative data is generally analysed using statistical methods and does not leave much room for speculation. It is more structured and follows a predetermined plan. In quantitative research, the researcher starts with a hypothesis and uses statistical methods to test it. Contrarily, methods used for qualitative data analysis can identify patterns and themes within the data, rather than provide statistical measures of the data. It is an iterative process, where the researcher goes back and forth trying to gauge the larger implications of the data through different perspectives and revising the analysis if required.

When to use qualitative vs quantitative research:

The choice between qualitative and quantitative research will depend on the gap that the research project aims to address, and specific objectives of the study. If the goal is to establish facts about a subject or topic, quantitative research is an appropriate choice. However, if the goal is to understand people’s experiences or perspectives, qualitative research may be more suitable. 

Conclusion:

In conclusion, an understanding of the different research methods available, their applicability, advantages, and disadvantages is essential for making an informed decision on the best methodology for your project. If you need any additional guidance on which research methodology to opt for, you can head over to Elsevier Author Services (EAS). EAS experts will guide you throughout the process and help you choose the perfect methodology for your research goals.

Why is data validation important in research?

When Data Speak, Listen: Importance of Data Collection and Analysis Methods

You may also like.

Descriptive Research Design and Its Myriad Uses

Five Common Mistakes to Avoid When Writing a Biomedical Research Paper

Making Technical Writing in Environmental Engineering Accessible

To Err is Not Human: The Dangers of AI-assisted Academic Writing

Writing a good review article

Scholarly Sources: What are They and Where can You Find Them?

Input your search keywords and press Enter.

Methodological Approaches in Integrated Geography pp 1–8 Cite as

The Importance of Methodology in Geography

• Firuza Begham Mustafa 2  
• First Online: 12 May 2023

157 Accesses

Part of the book series: Springer Texts in Social Sciences ((STSS))

A research methodology is an important framework that explains a study’s methods and procedures. The selection of a research method is crucial since it determines the direction of the research results and the reliability of the research findings. Each study begins with a problem that emerges into a research question and is then processed to generate the study’s objective. The methodology encompasses the entire process of conducting a study, beginning with the selection of the research method, moving on to the parameters to be measured or calculated, the type of data required, the amount of data, the method of data collection, the method of analysis, and the procedure for data description, interpretation, and explanation. The role of research methodology in geographic research is at the core of research efficiency, with the use of precise and systematic research procedures, which streamlines research activities and increases the potential for research success. Research methodology is the backbone of any research, and it determines the level of success of the research. This paper was prepared based on a paper published in the Malay language by Universiti Malaya Press.

This is a preview of subscription content, log in via an institution .

Buying options

• Available as PDF
• Read on any device
• Instant download
• Own it forever
• Available as EPUB and PDF
• Compact, lightweight edition
• Dispatched in 3 to 5 business days
• Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Degu, G., & Yigzaw, T. (2006). Research methodology . University of Gondar. In collaboration with the Ethiopia Public Health Training Initiative, The Carter Center, The Ethiopia Ministry of Health, and the Ethiopia Ministry of Education.

Google Scholar  

Goundar, S. (2012). Research methodology and research methods. In S. Goundar (Ed.), Cloud computing . Victoria University of Wellington (Chapter 3). Available at http://www.researchgate.net/publication/333015026333015026

Kothari, C. R. (1999). Research methodology—Methods & techniques (2nd ed.). Wishwa Prakashan.

Mustafa, F. B. (2022). Peranan Metodologi dalam Kajian Geografi . In F. B. Mustafa (Ed.), Metodologi Terpilih dalam Geografi . Universiti Malaya Press.

Sileyew, K. J. (2019). In E. Abu-Taieh, A. El Mouatasim, I. H. Al Hadid (Eds.), Research design and methodology, cyberspace . IntechOpen. https://doi.org/10.5772/intechopen.85731 . Available from: https://www.intechopen.com/books/cyberspace/research-design-and-methodology

Slesinger, D., & Stephenson, M. (1930). The encyclopaedia of social sciences (Vol. IX). MacMillan Publications.

Woody, C. (1927). The values of educational research to the classroom teacher. The Journal of Educational Research, 16 (3). https://doi.org/10.1080/00220671.1927.10879779

Download references

Acknowledgements

This article is prepared based on a paper entitled “ Peranan Metodologi dalam Kajian Geografi ” published by Universiti Malaya Press (Firuza Begham Mustafa (ed.). 2022).

Author information

Authors and affiliations.

Department of Geography, Faculty of Arts and Social Sciences, Universiti Malaya, Kuala Lumpur, Malaysia

Firuza Begham Mustafa

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Firuza Begham Mustafa .

Editor information

Editors and affiliations.

Department of Geography, Universiti Malaya, Kuala Lumpur, Malaysia

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Cite this chapter.

Mustafa, F.B. (2023). The Importance of Methodology in Geography. In: Mustafa, F.B. (eds) Methodological Approaches in Integrated Geography. Springer Texts in Social Sciences. Springer, Cham. https://doi.org/10.1007/978-3-031-28784-8_1

Download citation

DOI : https://doi.org/10.1007/978-3-031-28784-8_1

Published : 12 May 2023

Publisher Name : Springer, Cham

Print ISBN : 978-3-031-28783-1

Online ISBN : 978-3-031-28784-8

eBook Packages : Social Sciences Social Sciences (R0)

Share this chapter

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Publish with us

Policies and ethics

• Find a journal
• Track your research

The Importance of Research Methodology and How to Incorporate it in Your Writing

Home » The Importance of Research Methodology and How to Incorporate it in Your Writing

• May 22, 2022

Introduction

Research is an important step in the process of writing a paper. It provides the writer with a clear understanding of what they are writing about, and it gives them an idea of how to best write about their topic. Research is not necessary for all papers, but it can be helpful for writers who need to write about topics that they have never written about before.

What is Research Methodology?

Research methodology is a set of rules, principles and guidelines that researchers follow to conduct research. The first step in establishing a research methodology is to determine the type of research that will be conducted.

There are two types of research: qualitative and quantitative. Qualitative research studies involve the examination of the subjective meanings, interpretations and experiences of participants, while quantitative studies involve the measurement or counting of objective phenomena.

Why is Research Important?

Research is important because it can help us find out what is happening in the world. It can provide evidence for or against a certain idea.

The relevance of data helps us make decisions about whether a study is valid. For example, if we are trying to decide whether or not a study is valid, we would want to know what kind of research was done and how it was done.

What are the Benefits and Risks Associated with Poorly Applied Research Methodology?

The main benefit of doing a good study is that it can provide you with reliable evidence to support your argument. The risks associated with poorly applied research methodology are that you will not be able to answer your research question, or the study will be biased.

In today’s world, it is absolutely necessary for students to be able to access high quality research materials. When students make the decision to pursue higher education, they are making a decision that will impact the rest of their lives.

Researching the best options for higher education is one of the most important decisions that a student can make because choosing an institution with poor research standards will lead to less success in school and real life.

How Do I Select the Best Method for Me?

Qualitative data is more exploratory and provides a deeper understanding of the topic. Quantitative data is more rigorous and provides a high level overview of the topic.

Qualitative research is better for exploring attitudes, needs, and desires. Quantitative research is better for providing statistical information about what people do or think.

The decision to use qualitative or quantitative research will depend on the type of question you want to answer, who you want to answer it, and what kind of information you need to make an informed decision about your topic.

The Best Tools for Effective Data Collection and Analysis

Surveys are one of the most popular methods for gathering information from a large group of people. They are a great way to get feedback or opinion from people who may not be able to attend an event in person.

There are many ways to design surveys. The best way to design a survey is by using a questionnaire design tool that will help you create the survey with no coding skills needed and will also help you analyze the data collected in the survey afterwards.

There are a number of tools available for data collection and analysis. Survey tools such as Google Forms , SurveyMonkey , and Typeform are used for creating surveys with questions. Questionnaire design tools such as Wufoo and Survey Monkey can be used to create online surveys without coding skills. Online survey tools that are free to use include Google Forms , Typeform , Polldaddy , SurveyMonkey Audience , and Qualtrics .

In this article we have talked about what is research methodology and why is it  important? at the same time benefits and risks associated with poorly applied research methodology how to select the best method for your writing, and finally the best tools for effective data collection and analysis.

Skilful Academy prepared for you a full course about research methods and skills, which you’ll learn all the necessary knowledge and skills required by a researcher in addition to that  you will get a full mentorship by our professors if needed. To get the course click here .

Nicely summarized and helpful too.

Academic writing Skills.

And Non-Academic writing Skills.

The reflection has been more supportive and helpful for beginers to be able to step up their academic research journey….

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

• Courses (2)
• Research (5)
• Research Blogs (2)
• Training (1)
• Uncategorized (1)

© 2023 Skilful Academy. All Rights Reserved

Made with ❤ in Hamar

Insert/edit link

Enter the destination URL

Or link to existing content

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Indian J Ophthalmol
• v.57(3); May-Jun 2009

Why learn research methodology?

Barun kumar nayak.

P. D. Hinduja National Hospital and Medical Research Centre, Veer Savarkar Marg, Mahim, Mumbai - 400 016, India. E-mail: [email protected]

At the first glance, most of us would assume that this editorial is only for those who are involved in research and is certainly not for me. However, we should realize that medical science is not an exact science like physics or many other branches of science. For example we have been successful in sending unmanned space craft to the moon with precision and can accurately predict a lunar eclipse even 500 years from now. On the other hand when it comes to medicine we are dealing with human beings and no two humans are similar. The effects of our interventions are variable. It is an ever evolving science based on research. We have entered into an era of evidence-based medicine (EBM)[ 1 ] which aims to apply evidence gained by a scientific method to change current medical practice. It seeks to assess the quality of evidence relevant to the risks and benefits of treatment (including lack of treatment).[ 2 ] “EBM is the conscientious, explicit and judicious use of the current best evidence in making decisions about the care of individual patients” according to the center for EBM.[ 2 ] The basis of EBM is constant research. The aim of this editorial is to emphasize that each and every doctor needs to understand the basics of the science and art of research methodology. Conduction of research involves science and subsequent publication requires scientific writing which is an art in itself.

Why should I do research? In the era of EBM, all decisions regarding investigations, diagnosis and treatment are taken on the basis of research. We constantly strive to improve, through research, the management of a particular case. The wider cause for conducting research is to improve patient care, a great service to the mankind. The other narrower reasons could be personal satisfaction of contributing to science and the society, recognition and appreciation by peer in the profession, acquiring a job, getting a job promotion or even to retain a job. We are fast approaching towards the publish or perish principle adopted by the west.

Who should learn Research Methodology? Undergraduate medical students need to learn it for a stronger foundation for their future; postgraduate students have no choice as a thesis/dissertation is the requirement for a Masters degree. General practitioners or consultants involved in private practice cannot shy away from understanding research as they have to deal with different types of cases which may not be straight forward enough. Consultants holding teaching posts, have to guide their students for conducting their thesis. All those who hold administrative posts have to take decisions for their organizations and the research outcomes help them to a large extent in this regard. Policy makers take the help of research while framing policies. Hence, anyone who is related to medical science needs to understand research.

Why should I learn Research Methodology? From initiation of a research idea to the ultimate culmination in publication there are many segments; initiation of a research idea, thorough literature search, formulation of a research question, proper study design, possible source of funding, conduction of research, analysis of data obtained, proper interpretation of results and publication in a peer-reviewed journal. For those who are involved in conduction of research, it is mandatory that they perform the research well to curtail wastage of time and money. They are also expected to publish it later in a peer-reviewed journal so that the research can be presented to the world without any ambiguity. Those who are not involved in conducting research themselves, are the end users of the fruit of such tedious efforts and should at least be able to differentiate between good and bad science. Only good science needs to be adopted and followed. There are many examples of biased researches in literature.[ 3 , 4 ] It is not possible to differentiate between biased research outcomes from unbiased ones without a proper understanding of each aspect of research. Having a good foundation of research at any level may help in pursuing a research career in the future. Any treatment instituted on the basis of published evidence in a peer- reviewed journal becomes a very good defence for doctors in the court of law in cases of dispute.

When it is obvious that everyone should learn research methodology, then where is the lucuna? In the undergraduate curriculum research methodology and epidemiology is covered under preventive and social medicine. Unfortunately, not too much importance is given either by the teachers or by the students at the undergraduate level of learning. This lacuna is carried forward during the postgraduate course where a thesis / dissertation is the mandatory requirement. This is pushed in the background due to casual attitude aided by the lack of infrastructure and knowledge.[ 5 – 7 ] After this stage, the opportunities are few and far between most of us who are not involved in postgraduate teaching. However, it is crystal clear with the earlier discussion that research is of paramount importance for all of us without any exception.

The Indian Journal of Ophthalmology (IJO) in association with P.D. Hinduja National Hospital and Medical Research Center, Mumbai, has taken the initiative to bridge this gap by conducting comprehensive workshops on “Medical Research and Scientific Writing”. The 5 th workshop in the series has been slated for 30 th and 31 st May, 2009 in Mumbai. It will deal with focused literature search, conduction of proper research, art of scientific writing and critical analysis of published papers. It is recommended for medical practitioners, teachers and undergraduate as well as postgraduate students of any discipline.

The article by Parikh et al ,[ 8 ] entitled “Likelihood ratios: Clinical application in day to day to practice” in this issue of IJO is another step towards bridging the gap. The authors need to be complemented for presenting this difficult topic in a simplified and lucid manner. “This is the best write up on likelihood ratios that I have ever read” was the comment by one of the reviewer of this article.

I wish and hope to infuse interest amongst the medical fraternity on an important and relevant but relatively neglected area that is medical research.

• Open access
• Published: 07 September 2020

A tutorial on methodological studies: the what, when, how and why

• Lawrence Mbuagbaw   ORCID: orcid.org/0000-0001-5855-5461 1 , 2 , 3 ,
• Daeria O. Lawson 1 ,
• Livia Puljak 4 ,
• David B. Allison 5 &
• Lehana Thabane 1 , 2 , 6 , 7 , 8  

BMC Medical Research Methodology volume  20 , Article number:  226 ( 2020 ) Cite this article

37k Accesses

52 Citations

58 Altmetric

Metrics details

Methodological studies – studies that evaluate the design, analysis or reporting of other research-related reports – play an important role in health research. They help to highlight issues in the conduct of research with the aim of improving health research methodology, and ultimately reducing research waste.

We provide an overview of some of the key aspects of methodological studies such as what they are, and when, how and why they are done. We adopt a “frequently asked questions” format to facilitate reading this paper and provide multiple examples to help guide researchers interested in conducting methodological studies. Some of the topics addressed include: is it necessary to publish a study protocol? How to select relevant research reports and databases for a methodological study? What approaches to data extraction and statistical analysis should be considered when conducting a methodological study? What are potential threats to validity and is there a way to appraise the quality of methodological studies?

Appropriate reflection and application of basic principles of epidemiology and biostatistics are required in the design and analysis of methodological studies. This paper provides an introduction for further discussion about the conduct of methodological studies.

Peer Review reports

The field of meta-research (or research-on-research) has proliferated in recent years in response to issues with research quality and conduct [ 1 , 2 , 3 ]. As the name suggests, this field targets issues with research design, conduct, analysis and reporting. Various types of research reports are often examined as the unit of analysis in these studies (e.g. abstracts, full manuscripts, trial registry entries). Like many other novel fields of research, meta-research has seen a proliferation of use before the development of reporting guidance. For example, this was the case with randomized trials for which risk of bias tools and reporting guidelines were only developed much later – after many trials had been published and noted to have limitations [ 4 , 5 ]; and for systematic reviews as well [ 6 , 7 , 8 ]. However, in the absence of formal guidance, studies that report on research differ substantially in how they are named, conducted and reported [ 9 , 10 ]. This creates challenges in identifying, summarizing and comparing them. In this tutorial paper, we will use the term methodological study to refer to any study that reports on the design, conduct, analysis or reporting of primary or secondary research-related reports (such as trial registry entries and conference abstracts).

In the past 10 years, there has been an increase in the use of terms related to methodological studies (based on records retrieved with a keyword search [in the title and abstract] for “methodological review” and “meta-epidemiological study” in PubMed up to December 2019), suggesting that these studies may be appearing more frequently in the literature. See Fig.  1 .

Trends in the number studies that mention “methodological review” or “meta-

epidemiological study” in PubMed.

The methods used in many methodological studies have been borrowed from systematic and scoping reviews. This practice has influenced the direction of the field, with many methodological studies including searches of electronic databases, screening of records, duplicate data extraction and assessments of risk of bias in the included studies. However, the research questions posed in methodological studies do not always require the approaches listed above, and guidance is needed on when and how to apply these methods to a methodological study. Even though methodological studies can be conducted on qualitative or mixed methods research, this paper focuses on and draws examples exclusively from quantitative research.

The objectives of this paper are to provide some insights on how to conduct methodological studies so that there is greater consistency between the research questions posed, and the design, analysis and reporting of findings. We provide multiple examples to illustrate concepts and a proposed framework for categorizing methodological studies in quantitative research.

What is a methodological study?

Any study that describes or analyzes methods (design, conduct, analysis or reporting) in published (or unpublished) literature is a methodological study. Consequently, the scope of methodological studies is quite extensive and includes, but is not limited to, topics as diverse as: research question formulation [ 11 ]; adherence to reporting guidelines [ 12 , 13 , 14 ] and consistency in reporting [ 15 ]; approaches to study analysis [ 16 ]; investigating the credibility of analyses [ 17 ]; and studies that synthesize these methodological studies [ 18 ]. While the nomenclature of methodological studies is not uniform, the intents and purposes of these studies remain fairly consistent – to describe or analyze methods in primary or secondary studies. As such, methodological studies may also be classified as a subtype of observational studies.

Parallel to this are experimental studies that compare different methods. Even though they play an important role in informing optimal research methods, experimental methodological studies are beyond the scope of this paper. Examples of such studies include the randomized trials by Buscemi et al., comparing single data extraction to double data extraction [ 19 ], and Carrasco-Labra et al., comparing approaches to presenting findings in Grading of Recommendations, Assessment, Development and Evaluations (GRADE) summary of findings tables [ 20 ]. In these studies, the unit of analysis is the person or groups of individuals applying the methods. We also direct readers to the Studies Within a Trial (SWAT) and Studies Within a Review (SWAR) programme operated through the Hub for Trials Methodology Research, for further reading as a potential useful resource for these types of experimental studies [ 21 ]. Lastly, this paper is not meant to inform the conduct of research using computational simulation and mathematical modeling for which some guidance already exists [ 22 ], or studies on the development of methods using consensus-based approaches.

When should we conduct a methodological study?

Methodological studies occupy a unique niche in health research that allows them to inform methodological advances. Methodological studies should also be conducted as pre-cursors to reporting guideline development, as they provide an opportunity to understand current practices, and help to identify the need for guidance and gaps in methodological or reporting quality. For example, the development of the popular Preferred Reporting Items of Systematic reviews and Meta-Analyses (PRISMA) guidelines were preceded by methodological studies identifying poor reporting practices [ 23 , 24 ]. In these instances, after the reporting guidelines are published, methodological studies can also be used to monitor uptake of the guidelines.

These studies can also be conducted to inform the state of the art for design, analysis and reporting practices across different types of health research fields, with the aim of improving research practices, and preventing or reducing research waste. For example, Samaan et al. conducted a scoping review of adherence to different reporting guidelines in health care literature [ 18 ]. Methodological studies can also be used to determine the factors associated with reporting practices. For example, Abbade et al. investigated journal characteristics associated with the use of the Participants, Intervention, Comparison, Outcome, Timeframe (PICOT) format in framing research questions in trials of venous ulcer disease [ 11 ].

How often are methodological studies conducted?

There is no clear answer to this question. Based on a search of PubMed, the use of related terms (“methodological review” and “meta-epidemiological study”) – and therefore, the number of methodological studies – is on the rise. However, many other terms are used to describe methodological studies. There are also many studies that explore design, conduct, analysis or reporting of research reports, but that do not use any specific terms to describe or label their study design in terms of “methodology”. This diversity in nomenclature makes a census of methodological studies elusive. Appropriate terminology and key words for methodological studies are needed to facilitate improved accessibility for end-users.

Why do we conduct methodological studies?

Methodological studies provide information on the design, conduct, analysis or reporting of primary and secondary research and can be used to appraise quality, quantity, completeness, accuracy and consistency of health research. These issues can be explored in specific fields, journals, databases, geographical regions and time periods. For example, Areia et al. explored the quality of reporting of endoscopic diagnostic studies in gastroenterology [ 25 ]; Knol et al. investigated the reporting of p -values in baseline tables in randomized trial published in high impact journals [ 26 ]; Chen et al. describe adherence to the Consolidated Standards of Reporting Trials (CONSORT) statement in Chinese Journals [ 27 ]; and Hopewell et al. describe the effect of editors’ implementation of CONSORT guidelines on reporting of abstracts over time [ 28 ]. Methodological studies provide useful information to researchers, clinicians, editors, publishers and users of health literature. As a result, these studies have been at the cornerstone of important methodological developments in the past two decades and have informed the development of many health research guidelines including the highly cited CONSORT statement [ 5 ].

Where can we find methodological studies?

Methodological studies can be found in most common biomedical bibliographic databases (e.g. Embase, MEDLINE, PubMed, Web of Science). However, the biggest caveat is that methodological studies are hard to identify in the literature due to the wide variety of names used and the lack of comprehensive databases dedicated to them. A handful can be found in the Cochrane Library as “Cochrane Methodology Reviews”, but these studies only cover methodological issues related to systematic reviews. Previous attempts to catalogue all empirical studies of methods used in reviews were abandoned 10 years ago [ 29 ]. In other databases, a variety of search terms may be applied with different levels of sensitivity and specificity.

Some frequently asked questions about methodological studies

In this section, we have outlined responses to questions that might help inform the conduct of methodological studies.

Q: How should I select research reports for my methodological study?

A: Selection of research reports for a methodological study depends on the research question and eligibility criteria. Once a clear research question is set and the nature of literature one desires to review is known, one can then begin the selection process. Selection may begin with a broad search, especially if the eligibility criteria are not apparent. For example, a methodological study of Cochrane Reviews of HIV would not require a complex search as all eligible studies can easily be retrieved from the Cochrane Library after checking a few boxes [ 30 ]. On the other hand, a methodological study of subgroup analyses in trials of gastrointestinal oncology would require a search to find such trials, and further screening to identify trials that conducted a subgroup analysis [ 31 ].

The strategies used for identifying participants in observational studies can apply here. One may use a systematic search to identify all eligible studies. If the number of eligible studies is unmanageable, a random sample of articles can be expected to provide comparable results if it is sufficiently large [ 32 ]. For example, Wilson et al. used a random sample of trials from the Cochrane Stroke Group’s Trial Register to investigate completeness of reporting [ 33 ]. It is possible that a simple random sample would lead to underrepresentation of units (i.e. research reports) that are smaller in number. This is relevant if the investigators wish to compare multiple groups but have too few units in one group. In this case a stratified sample would help to create equal groups. For example, in a methodological study comparing Cochrane and non-Cochrane reviews, Kahale et al. drew random samples from both groups [ 34 ]. Alternatively, systematic or purposeful sampling strategies can be used and we encourage researchers to justify their selected approaches based on the study objective.

Q: How many databases should I search?

A: The number of databases one should search would depend on the approach to sampling, which can include targeting the entire “population” of interest or a sample of that population. If you are interested in including the entire target population for your research question, or drawing a random or systematic sample from it, then a comprehensive and exhaustive search for relevant articles is required. In this case, we recommend using systematic approaches for searching electronic databases (i.e. at least 2 databases with a replicable and time stamped search strategy). The results of your search will constitute a sampling frame from which eligible studies can be drawn.

Alternatively, if your approach to sampling is purposeful, then we recommend targeting the database(s) or data sources (e.g. journals, registries) that include the information you need. For example, if you are conducting a methodological study of high impact journals in plastic surgery and they are all indexed in PubMed, you likely do not need to search any other databases. You may also have a comprehensive list of all journals of interest and can approach your search using the journal names in your database search (or by accessing the journal archives directly from the journal’s website). Even though one could also search journals’ web pages directly, using a database such as PubMed has multiple advantages, such as the use of filters, so the search can be narrowed down to a certain period, or study types of interest. Furthermore, individual journals’ web sites may have different search functionalities, which do not necessarily yield a consistent output.

Q: Should I publish a protocol for my methodological study?

A: A protocol is a description of intended research methods. Currently, only protocols for clinical trials require registration [ 35 ]. Protocols for systematic reviews are encouraged but no formal recommendation exists. The scientific community welcomes the publication of protocols because they help protect against selective outcome reporting, the use of post hoc methodologies to embellish results, and to help avoid duplication of efforts [ 36 ]. While the latter two risks exist in methodological research, the negative consequences may be substantially less than for clinical outcomes. In a sample of 31 methodological studies, 7 (22.6%) referenced a published protocol [ 9 ]. In the Cochrane Library, there are 15 protocols for methodological reviews (21 July 2020). This suggests that publishing protocols for methodological studies is not uncommon.

Authors can consider publishing their study protocol in a scholarly journal as a manuscript. Advantages of such publication include obtaining peer-review feedback about the planned study, and easy retrieval by searching databases such as PubMed. The disadvantages in trying to publish protocols includes delays associated with manuscript handling and peer review, as well as costs, as few journals publish study protocols, and those journals mostly charge article-processing fees [ 37 ]. Authors who would like to make their protocol publicly available without publishing it in scholarly journals, could deposit their study protocols in publicly available repositories, such as the Open Science Framework ( https://osf.io/ ).

Q: How to appraise the quality of a methodological study?

A: To date, there is no published tool for appraising the risk of bias in a methodological study, but in principle, a methodological study could be considered as a type of observational study. Therefore, during conduct or appraisal, care should be taken to avoid the biases common in observational studies [ 38 ]. These biases include selection bias, comparability of groups, and ascertainment of exposure or outcome. In other words, to generate a representative sample, a comprehensive reproducible search may be necessary to build a sampling frame. Additionally, random sampling may be necessary to ensure that all the included research reports have the same probability of being selected, and the screening and selection processes should be transparent and reproducible. To ensure that the groups compared are similar in all characteristics, matching, random sampling or stratified sampling can be used. Statistical adjustments for between-group differences can also be applied at the analysis stage. Finally, duplicate data extraction can reduce errors in assessment of exposures or outcomes.

Q: Should I justify a sample size?

A: In all instances where one is not using the target population (i.e. the group to which inferences from the research report are directed) [ 39 ], a sample size justification is good practice. The sample size justification may take the form of a description of what is expected to be achieved with the number of articles selected, or a formal sample size estimation that outlines the number of articles required to answer the research question with a certain precision and power. Sample size justifications in methodological studies are reasonable in the following instances:

Comparing two groups

Determining a proportion, mean or another quantifier

Determining factors associated with an outcome using regression-based analyses

For example, El Dib et al. computed a sample size requirement for a methodological study of diagnostic strategies in randomized trials, based on a confidence interval approach [ 40 ].

Q: What should I call my study?

A: Other terms which have been used to describe/label methodological studies include “ methodological review ”, “methodological survey” , “meta-epidemiological study” , “systematic review” , “systematic survey”, “meta-research”, “research-on-research” and many others. We recommend that the study nomenclature be clear, unambiguous, informative and allow for appropriate indexing. Methodological study nomenclature that should be avoided includes “ systematic review” – as this will likely be confused with a systematic review of a clinical question. “ Systematic survey” may also lead to confusion about whether the survey was systematic (i.e. using a preplanned methodology) or a survey using “ systematic” sampling (i.e. a sampling approach using specific intervals to determine who is selected) [ 32 ]. Any of the above meanings of the words “ systematic” may be true for methodological studies and could be potentially misleading. “ Meta-epidemiological study” is ideal for indexing, but not very informative as it describes an entire field. The term “ review ” may point towards an appraisal or “review” of the design, conduct, analysis or reporting (or methodological components) of the targeted research reports, yet it has also been used to describe narrative reviews [ 41 , 42 ]. The term “ survey ” is also in line with the approaches used in many methodological studies [ 9 ], and would be indicative of the sampling procedures of this study design. However, in the absence of guidelines on nomenclature, the term “ methodological study ” is broad enough to capture most of the scenarios of such studies.

Q: Should I account for clustering in my methodological study?

A: Data from methodological studies are often clustered. For example, articles coming from a specific source may have different reporting standards (e.g. the Cochrane Library). Articles within the same journal may be similar due to editorial practices and policies, reporting requirements and endorsement of guidelines. There is emerging evidence that these are real concerns that should be accounted for in analyses [ 43 ]. Some cluster variables are described in the section: “ What variables are relevant to methodological studies?”

A variety of modelling approaches can be used to account for correlated data, including the use of marginal, fixed or mixed effects regression models with appropriate computation of standard errors [ 44 ]. For example, Kosa et al. used generalized estimation equations to account for correlation of articles within journals [ 15 ]. Not accounting for clustering could lead to incorrect p -values, unduly narrow confidence intervals, and biased estimates [ 45 ].

Q: Should I extract data in duplicate?

A: Yes. Duplicate data extraction takes more time but results in less errors [ 19 ]. Data extraction errors in turn affect the effect estimate [ 46 ], and therefore should be mitigated. Duplicate data extraction should be considered in the absence of other approaches to minimize extraction errors. However, much like systematic reviews, this area will likely see rapid new advances with machine learning and natural language processing technologies to support researchers with screening and data extraction [ 47 , 48 ]. However, experience plays an important role in the quality of extracted data and inexperienced extractors should be paired with experienced extractors [ 46 , 49 ].

Q: Should I assess the risk of bias of research reports included in my methodological study?

A : Risk of bias is most useful in determining the certainty that can be placed in the effect measure from a study. In methodological studies, risk of bias may not serve the purpose of determining the trustworthiness of results, as effect measures are often not the primary goal of methodological studies. Determining risk of bias in methodological studies is likely a practice borrowed from systematic review methodology, but whose intrinsic value is not obvious in methodological studies. When it is part of the research question, investigators often focus on one aspect of risk of bias. For example, Speich investigated how blinding was reported in surgical trials [ 50 ], and Abraha et al., investigated the application of intention-to-treat analyses in systematic reviews and trials [ 51 ].

Q: What variables are relevant to methodological studies?

A: There is empirical evidence that certain variables may inform the findings in a methodological study. We outline some of these and provide a brief overview below:

Country: Countries and regions differ in their research cultures, and the resources available to conduct research. Therefore, it is reasonable to believe that there may be differences in methodological features across countries. Methodological studies have reported loco-regional differences in reporting quality [ 52 , 53 ]. This may also be related to challenges non-English speakers face in publishing papers in English.

Authors’ expertise: The inclusion of authors with expertise in research methodology, biostatistics, and scientific writing is likely to influence the end-product. Oltean et al. found that among randomized trials in orthopaedic surgery, the use of analyses that accounted for clustering was more likely when specialists (e.g. statistician, epidemiologist or clinical trials methodologist) were included on the study team [ 54 ]. Fleming et al. found that including methodologists in the review team was associated with appropriate use of reporting guidelines [ 55 ].

Source of funding and conflicts of interest: Some studies have found that funded studies report better [ 56 , 57 ], while others do not [ 53 , 58 ]. The presence of funding would indicate the availability of resources deployed to ensure optimal design, conduct, analysis and reporting. However, the source of funding may introduce conflicts of interest and warrant assessment. For example, Kaiser et al. investigated the effect of industry funding on obesity or nutrition randomized trials and found that reporting quality was similar [ 59 ]. Thomas et al. looked at reporting quality of long-term weight loss trials and found that industry funded studies were better [ 60 ]. Kan et al. examined the association between industry funding and “positive trials” (trials reporting a significant intervention effect) and found that industry funding was highly predictive of a positive trial [ 61 ]. This finding is similar to that of a recent Cochrane Methodology Review by Hansen et al. [ 62 ]

Journal characteristics: Certain journals’ characteristics may influence the study design, analysis or reporting. Characteristics such as journal endorsement of guidelines [ 63 , 64 ], and Journal Impact Factor (JIF) have been shown to be associated with reporting [ 63 , 65 , 66 , 67 ].

Study size (sample size/number of sites): Some studies have shown that reporting is better in larger studies [ 53 , 56 , 58 ].

Year of publication: It is reasonable to assume that design, conduct, analysis and reporting of research will change over time. Many studies have demonstrated improvements in reporting over time or after the publication of reporting guidelines [ 68 , 69 ].

Type of intervention: In a methodological study of reporting quality of weight loss intervention studies, Thabane et al. found that trials of pharmacologic interventions were reported better than trials of non-pharmacologic interventions [ 70 ].

Interactions between variables: Complex interactions between the previously listed variables are possible. High income countries with more resources may be more likely to conduct larger studies and incorporate a variety of experts. Authors in certain countries may prefer certain journals, and journal endorsement of guidelines and editorial policies may change over time.

Q: Should I focus only on high impact journals?

A: Investigators may choose to investigate only high impact journals because they are more likely to influence practice and policy, or because they assume that methodological standards would be higher. However, the JIF may severely limit the scope of articles included and may skew the sample towards articles with positive findings. The generalizability and applicability of findings from a handful of journals must be examined carefully, especially since the JIF varies over time. Even among journals that are all “high impact”, variations exist in methodological standards.

Q: Can I conduct a methodological study of qualitative research?

A: Yes. Even though a lot of methodological research has been conducted in the quantitative research field, methodological studies of qualitative studies are feasible. Certain databases that catalogue qualitative research including the Cumulative Index to Nursing & Allied Health Literature (CINAHL) have defined subject headings that are specific to methodological research (e.g. “research methodology”). Alternatively, one could also conduct a qualitative methodological review; that is, use qualitative approaches to synthesize methodological issues in qualitative studies.

Q: What reporting guidelines should I use for my methodological study?

A: There is no guideline that covers the entire scope of methodological studies. One adaptation of the PRISMA guidelines has been published, which works well for studies that aim to use the entire target population of research reports [ 71 ]. However, it is not widely used (40 citations in 2 years as of 09 December 2019), and methodological studies that are designed as cross-sectional or before-after studies require a more fit-for purpose guideline. A more encompassing reporting guideline for a broad range of methodological studies is currently under development [ 72 ]. However, in the absence of formal guidance, the requirements for scientific reporting should be respected, and authors of methodological studies should focus on transparency and reproducibility.

Q: What are the potential threats to validity and how can I avoid them?

A: Methodological studies may be compromised by a lack of internal or external validity. The main threats to internal validity in methodological studies are selection and confounding bias. Investigators must ensure that the methods used to select articles does not make them differ systematically from the set of articles to which they would like to make inferences. For example, attempting to make extrapolations to all journals after analyzing high-impact journals would be misleading.

Many factors (confounders) may distort the association between the exposure and outcome if the included research reports differ with respect to these factors [ 73 ]. For example, when examining the association between source of funding and completeness of reporting, it may be necessary to account for journals that endorse the guidelines. Confounding bias can be addressed by restriction, matching and statistical adjustment [ 73 ]. Restriction appears to be the method of choice for many investigators who choose to include only high impact journals or articles in a specific field. For example, Knol et al. examined the reporting of p -values in baseline tables of high impact journals [ 26 ]. Matching is also sometimes used. In the methodological study of non-randomized interventional studies of elective ventral hernia repair, Parker et al. matched prospective studies with retrospective studies and compared reporting standards [ 74 ]. Some other methodological studies use statistical adjustments. For example, Zhang et al. used regression techniques to determine the factors associated with missing participant data in trials [ 16 ].

With regard to external validity, researchers interested in conducting methodological studies must consider how generalizable or applicable their findings are. This should tie in closely with the research question and should be explicit. For example. Findings from methodological studies on trials published in high impact cardiology journals cannot be assumed to be applicable to trials in other fields. However, investigators must ensure that their sample truly represents the target sample either by a) conducting a comprehensive and exhaustive search, or b) using an appropriate and justified, randomly selected sample of research reports.

Even applicability to high impact journals may vary based on the investigators’ definition, and over time. For example, for high impact journals in the field of general medicine, Bouwmeester et al. included the Annals of Internal Medicine (AIM), BMJ, the Journal of the American Medical Association (JAMA), Lancet, the New England Journal of Medicine (NEJM), and PLoS Medicine ( n  = 6) [ 75 ]. In contrast, the high impact journals selected in the methodological study by Schiller et al. were BMJ, JAMA, Lancet, and NEJM ( n  = 4) [ 76 ]. Another methodological study by Kosa et al. included AIM, BMJ, JAMA, Lancet and NEJM ( n  = 5). In the methodological study by Thabut et al., journals with a JIF greater than 5 were considered to be high impact. Riado Minguez et al. used first quartile journals in the Journal Citation Reports (JCR) for a specific year to determine “high impact” [ 77 ]. Ultimately, the definition of high impact will be based on the number of journals the investigators are willing to include, the year of impact and the JIF cut-off [ 78 ]. We acknowledge that the term “generalizability” may apply differently for methodological studies, especially when in many instances it is possible to include the entire target population in the sample studied.

Finally, methodological studies are not exempt from information bias which may stem from discrepancies in the included research reports [ 79 ], errors in data extraction, or inappropriate interpretation of the information extracted. Likewise, publication bias may also be a concern in methodological studies, but such concepts have not yet been explored.

A proposed framework

In order to inform discussions about methodological studies, the development of guidance for what should be reported, we have outlined some key features of methodological studies that can be used to classify them. For each of the categories outlined below, we provide an example. In our experience, the choice of approach to completing a methodological study can be informed by asking the following four questions:

What is the aim?

Methodological studies that investigate bias

A methodological study may be focused on exploring sources of bias in primary or secondary studies (meta-bias), or how bias is analyzed. We have taken care to distinguish bias (i.e. systematic deviations from the truth irrespective of the source) from reporting quality or completeness (i.e. not adhering to a specific reporting guideline or norm). An example of where this distinction would be important is in the case of a randomized trial with no blinding. This study (depending on the nature of the intervention) would be at risk of performance bias. However, if the authors report that their study was not blinded, they would have reported adequately. In fact, some methodological studies attempt to capture both “quality of conduct” and “quality of reporting”, such as Richie et al., who reported on the risk of bias in randomized trials of pharmacy practice interventions [ 80 ]. Babic et al. investigated how risk of bias was used to inform sensitivity analyses in Cochrane reviews [ 81 ]. Further, biases related to choice of outcomes can also be explored. For example, Tan et al investigated differences in treatment effect size based on the outcome reported [ 82 ].

Methodological studies that investigate quality (or completeness) of reporting

Methodological studies may report quality of reporting against a reporting checklist (i.e. adherence to guidelines) or against expected norms. For example, Croituro et al. report on the quality of reporting in systematic reviews published in dermatology journals based on their adherence to the PRISMA statement [ 83 ], and Khan et al. described the quality of reporting of harms in randomized controlled trials published in high impact cardiovascular journals based on the CONSORT extension for harms [ 84 ]. Other methodological studies investigate reporting of certain features of interest that may not be part of formally published checklists or guidelines. For example, Mbuagbaw et al. described how often the implications for research are elaborated using the Evidence, Participants, Intervention, Comparison, Outcome, Timeframe (EPICOT) format [ 30 ].

Methodological studies that investigate the consistency of reporting

Sometimes investigators may be interested in how consistent reports of the same research are, as it is expected that there should be consistency between: conference abstracts and published manuscripts; manuscript abstracts and manuscript main text; and trial registration and published manuscript. For example, Rosmarakis et al. investigated consistency between conference abstracts and full text manuscripts [ 85 ].

Methodological studies that investigate factors associated with reporting

In addition to identifying issues with reporting in primary and secondary studies, authors of methodological studies may be interested in determining the factors that are associated with certain reporting practices. Many methodological studies incorporate this, albeit as a secondary outcome. For example, Farrokhyar et al. investigated the factors associated with reporting quality in randomized trials of coronary artery bypass grafting surgery [ 53 ].

Methodological studies that investigate methods

Methodological studies may also be used to describe methods or compare methods, and the factors associated with methods. Muller et al. described the methods used for systematic reviews and meta-analyses of observational studies [ 86 ].

Methodological studies that summarize other methodological studies

Some methodological studies synthesize results from other methodological studies. For example, Li et al. conducted a scoping review of methodological reviews that investigated consistency between full text and abstracts in primary biomedical research [ 87 ].

Methodological studies that investigate nomenclature and terminology

Some methodological studies may investigate the use of names and terms in health research. For example, Martinic et al. investigated the definitions of systematic reviews used in overviews of systematic reviews (OSRs), meta-epidemiological studies and epidemiology textbooks [ 88 ].

Other types of methodological studies

In addition to the previously mentioned experimental methodological studies, there may exist other types of methodological studies not captured here.

What is the design?

Methodological studies that are descriptive

Most methodological studies are purely descriptive and report their findings as counts (percent) and means (standard deviation) or medians (interquartile range). For example, Mbuagbaw et al. described the reporting of research recommendations in Cochrane HIV systematic reviews [ 30 ]. Gohari et al. described the quality of reporting of randomized trials in diabetes in Iran [ 12 ].

Methodological studies that are analytical

Some methodological studies are analytical wherein “analytical studies identify and quantify associations, test hypotheses, identify causes and determine whether an association exists between variables, such as between an exposure and a disease.” [ 89 ] In the case of methodological studies all these investigations are possible. For example, Kosa et al. investigated the association between agreement in primary outcome from trial registry to published manuscript and study covariates. They found that larger and more recent studies were more likely to have agreement [ 15 ]. Tricco et al. compared the conclusion statements from Cochrane and non-Cochrane systematic reviews with a meta-analysis of the primary outcome and found that non-Cochrane reviews were more likely to report positive findings. These results are a test of the null hypothesis that the proportions of Cochrane and non-Cochrane reviews that report positive results are equal [ 90 ].

What is the sampling strategy?

Methodological studies that include the target population

Methodological reviews with narrow research questions may be able to include the entire target population. For example, in the methodological study of Cochrane HIV systematic reviews, Mbuagbaw et al. included all of the available studies ( n  = 103) [ 30 ].

Methodological studies that include a sample of the target population

Many methodological studies use random samples of the target population [ 33 , 91 , 92 ]. Alternatively, purposeful sampling may be used, limiting the sample to a subset of research-related reports published within a certain time period, or in journals with a certain ranking or on a topic. Systematic sampling can also be used when random sampling may be challenging to implement.

What is the unit of analysis?

Methodological studies with a research report as the unit of analysis

Many methodological studies use a research report (e.g. full manuscript of study, abstract portion of the study) as the unit of analysis, and inferences can be made at the study-level. However, both published and unpublished research-related reports can be studied. These may include articles, conference abstracts, registry entries etc.

Methodological studies with a design, analysis or reporting item as the unit of analysis

Some methodological studies report on items which may occur more than once per article. For example, Paquette et al. report on subgroup analyses in Cochrane reviews of atrial fibrillation in which 17 systematic reviews planned 56 subgroup analyses [ 93 ].

This framework is outlined in Fig.  2 .

A proposed framework for methodological studies

Conclusions

Methodological studies have examined different aspects of reporting such as quality, completeness, consistency and adherence to reporting guidelines. As such, many of the methodological study examples cited in this tutorial are related to reporting. However, as an evolving field, the scope of research questions that can be addressed by methodological studies is expected to increase.

In this paper we have outlined the scope and purpose of methodological studies, along with examples of instances in which various approaches have been used. In the absence of formal guidance on the design, conduct, analysis and reporting of methodological studies, we have provided some advice to help make methodological studies consistent. This advice is grounded in good contemporary scientific practice. Generally, the research question should tie in with the sampling approach and planned analysis. We have also highlighted the variables that may inform findings from methodological studies. Lastly, we have provided suggestions for ways in which authors can categorize their methodological studies to inform their design and analysis.

Availability of data and materials

Data sharing is not applicable to this article as no new data were created or analyzed in this study.

Abbreviations

Consolidated Standards of Reporting Trials

Evidence, Participants, Intervention, Comparison, Outcome, Timeframe

Grading of Recommendations, Assessment, Development and Evaluations

Participants, Intervention, Comparison, Outcome, Timeframe

Preferred Reporting Items of Systematic reviews and Meta-Analyses

Studies Within a Review

Studies Within a Trial

Chalmers I, Glasziou P. Avoidable waste in the production and reporting of research evidence. Lancet. 2009;374(9683):86–9.

PubMed   Google Scholar  

Chan AW, Song F, Vickers A, Jefferson T, Dickersin K, Gotzsche PC, Krumholz HM, Ghersi D, van der Worp HB. Increasing value and reducing waste: addressing inaccessible research. Lancet. 2014;383(9913):257–66.

PubMed   PubMed Central   Google Scholar  

Ioannidis JP, Greenland S, Hlatky MA, Khoury MJ, Macleod MR, Moher D, Schulz KF, Tibshirani R. Increasing value and reducing waste in research design, conduct, and analysis. Lancet. 2014;383(9912):166–75.

Higgins JP, Altman DG, Gotzsche PC, Juni P, Moher D, Oxman AD, Savovic J, Schulz KF, Weeks L, Sterne JA. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928.

Moher D, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 2001;357.

Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009;6(7):e1000100.

Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J, Henry DA, Boers M. AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol. 2009;62(10):1013–20.

Shea BJ, Reeves BC, Wells G, Thuku M, Hamel C, Moran J, Moher D, Tugwell P, Welch V, Kristjansson E, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. Bmj. 2017;358:j4008.

Lawson DO, Leenus A, Mbuagbaw L. Mapping the nomenclature, methodology, and reporting of studies that review methods: a pilot methodological review. Pilot Feasibility Studies. 2020;6(1):13.

Puljak L, Makaric ZL, Buljan I, Pieper D. What is a meta-epidemiological study? Analysis of published literature indicated heterogeneous study designs and definitions. J Comp Eff Res. 2020.

Abbade LPF, Wang M, Sriganesh K, Jin Y, Mbuagbaw L, Thabane L. The framing of research questions using the PICOT format in randomized controlled trials of venous ulcer disease is suboptimal: a systematic survey. Wound Repair Regen. 2017;25(5):892–900.

Gohari F, Baradaran HR, Tabatabaee M, Anijidani S, Mohammadpour Touserkani F, Atlasi R, Razmgir M. Quality of reporting randomized controlled trials (RCTs) in diabetes in Iran; a systematic review. J Diabetes Metab Disord. 2015;15(1):36.

Wang M, Jin Y, Hu ZJ, Thabane A, Dennis B, Gajic-Veljanoski O, Paul J, Thabane L. The reporting quality of abstracts of stepped wedge randomized trials is suboptimal: a systematic survey of the literature. Contemp Clin Trials Commun. 2017;8:1–10.

Shanthanna H, Kaushal A, Mbuagbaw L, Couban R, Busse J, Thabane L: A cross-sectional study of the reporting quality of pilot or feasibility trials in high-impact anesthesia journals Can J Anaesthesia 2018, 65(11):1180–1195.

Kosa SD, Mbuagbaw L, Borg Debono V, Bhandari M, Dennis BB, Ene G, Leenus A, Shi D, Thabane M, Valvasori S, et al. Agreement in reporting between trial publications and current clinical trial registry in high impact journals: a methodological review. Contemporary Clinical Trials. 2018;65:144–50.

Zhang Y, Florez ID, Colunga Lozano LE, Aloweni FAB, Kennedy SA, Li A, Craigie S, Zhang S, Agarwal A, Lopes LC, et al. A systematic survey on reporting and methods for handling missing participant data for continuous outcomes in randomized controlled trials. J Clin Epidemiol. 2017;88:57–66.

CAS   PubMed   Google Scholar  

Hernández AV, Boersma E, Murray GD, Habbema JD, Steyerberg EW. Subgroup analyses in therapeutic cardiovascular clinical trials: are most of them misleading? Am Heart J. 2006;151(2):257–64.

Samaan Z, Mbuagbaw L, Kosa D, Borg Debono V, Dillenburg R, Zhang S, Fruci V, Dennis B, Bawor M, Thabane L. A systematic scoping review of adherence to reporting guidelines in health care literature. J Multidiscip Healthc. 2013;6:169–88.

Buscemi N, Hartling L, Vandermeer B, Tjosvold L, Klassen TP. Single data extraction generated more errors than double data extraction in systematic reviews. J Clin Epidemiol. 2006;59(7):697–703.

Carrasco-Labra A, Brignardello-Petersen R, Santesso N, Neumann I, Mustafa RA, Mbuagbaw L, Etxeandia Ikobaltzeta I, De Stio C, McCullagh LJ, Alonso-Coello P. Improving GRADE evidence tables part 1: a randomized trial shows improved understanding of content in summary-of-findings tables with a new format. J Clin Epidemiol. 2016;74:7–18.

The Northern Ireland Hub for Trials Methodology Research: SWAT/SWAR Information [ https://www.qub.ac.uk/sites/TheNorthernIrelandNetworkforTrialsMethodologyResearch/SWATSWARInformation/ ]. Accessed 31 Aug 2020.

Chick S, Sánchez P, Ferrin D, Morrice D. How to conduct a successful simulation study. In: Proceedings of the 2003 winter simulation conference: 2003; 2003. p. 66–70.

Google Scholar  

Mulrow CD. The medical review article: state of the science. Ann Intern Med. 1987;106(3):485–8.

Sacks HS, Reitman D, Pagano D, Kupelnick B. Meta-analysis: an update. Mount Sinai J Med New York. 1996;63(3–4):216–24.

CAS   Google Scholar  

Areia M, Soares M, Dinis-Ribeiro M. Quality reporting of endoscopic diagnostic studies in gastrointestinal journals: where do we stand on the use of the STARD and CONSORT statements? Endoscopy. 2010;42(2):138–47.

Knol M, Groenwold R, Grobbee D. P-values in baseline tables of randomised controlled trials are inappropriate but still common in high impact journals. Eur J Prev Cardiol. 2012;19(2):231–2.

Chen M, Cui J, Zhang AL, Sze DM, Xue CC, May BH. Adherence to CONSORT items in randomized controlled trials of integrative medicine for colorectal Cancer published in Chinese journals. J Altern Complement Med. 2018;24(2):115–24.

Hopewell S, Ravaud P, Baron G, Boutron I. Effect of editors' implementation of CONSORT guidelines on the reporting of abstracts in high impact medical journals: interrupted time series analysis. BMJ. 2012;344:e4178.

The Cochrane Methodology Register Issue 2 2009 [ https://cmr.cochrane.org/help.htm ]. Accessed 31 Aug 2020.

Mbuagbaw L, Kredo T, Welch V, Mursleen S, Ross S, Zani B, Motaze NV, Quinlan L. Critical EPICOT items were absent in Cochrane human immunodeficiency virus systematic reviews: a bibliometric analysis. J Clin Epidemiol. 2016;74:66–72.

Barton S, Peckitt C, Sclafani F, Cunningham D, Chau I. The influence of industry sponsorship on the reporting of subgroup analyses within phase III randomised controlled trials in gastrointestinal oncology. Eur J Cancer. 2015;51(18):2732–9.

Setia MS. Methodology series module 5: sampling strategies. Indian J Dermatol. 2016;61(5):505–9.

Wilson B, Burnett P, Moher D, Altman DG, Al-Shahi Salman R. Completeness of reporting of randomised controlled trials including people with transient ischaemic attack or stroke: a systematic review. Eur Stroke J. 2018;3(4):337–46.

Kahale LA, Diab B, Brignardello-Petersen R, Agarwal A, Mustafa RA, Kwong J, Neumann I, Li L, Lopes LC, Briel M, et al. Systematic reviews do not adequately report or address missing outcome data in their analyses: a methodological survey. J Clin Epidemiol. 2018;99:14–23.

De Angelis CD, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, Kotzin S, Laine C, Marusic A, Overbeke AJPM, et al. Is this clinical trial fully registered?: a statement from the International Committee of Medical Journal Editors*. Ann Intern Med. 2005;143(2):146–8.

Ohtake PJ, Childs JD. Why publish study protocols? Phys Ther. 2014;94(9):1208–9.

Rombey T, Allers K, Mathes T, Hoffmann F, Pieper D. A descriptive analysis of the characteristics and the peer review process of systematic review protocols published in an open peer review journal from 2012 to 2017. BMC Med Res Methodol. 2019;19(1):57.

Grimes DA, Schulz KF. Bias and causal associations in observational research. Lancet. 2002;359(9302):248–52.

Porta M (ed.): A dictionary of epidemiology, 5th edn. Oxford: Oxford University Press, Inc.; 2008.

El Dib R, Tikkinen KAO, Akl EA, Gomaa HA, Mustafa RA, Agarwal A, Carpenter CR, Zhang Y, Jorge EC, Almeida R, et al. Systematic survey of randomized trials evaluating the impact of alternative diagnostic strategies on patient-important outcomes. J Clin Epidemiol. 2017;84:61–9.

Helzer JE, Robins LN, Taibleson M, Woodruff RA Jr, Reich T, Wish ED. Reliability of psychiatric diagnosis. I. a methodological review. Arch Gen Psychiatry. 1977;34(2):129–33.

Chung ST, Chacko SK, Sunehag AL, Haymond MW. Measurements of gluconeogenesis and Glycogenolysis: a methodological review. Diabetes. 2015;64(12):3996–4010.

CAS   PubMed   PubMed Central   Google Scholar  

Sterne JA, Juni P, Schulz KF, Altman DG, Bartlett C, Egger M. Statistical methods for assessing the influence of study characteristics on treatment effects in 'meta-epidemiological' research. Stat Med. 2002;21(11):1513–24.

Moen EL, Fricano-Kugler CJ, Luikart BW, O’Malley AJ. Analyzing clustered data: why and how to account for multiple observations nested within a study participant? PLoS One. 2016;11(1):e0146721.

Zyzanski SJ, Flocke SA, Dickinson LM. On the nature and analysis of clustered data. Ann Fam Med. 2004;2(3):199–200.

Mathes T, Klassen P, Pieper D. Frequency of data extraction errors and methods to increase data extraction quality: a methodological review. BMC Med Res Methodol. 2017;17(1):152.

Bui DDA, Del Fiol G, Hurdle JF, Jonnalagadda S. Extractive text summarization system to aid data extraction from full text in systematic review development. J Biomed Inform. 2016;64:265–72.

Bui DD, Del Fiol G, Jonnalagadda S. PDF text classification to leverage information extraction from publication reports. J Biomed Inform. 2016;61:141–8.

Maticic K, Krnic Martinic M, Puljak L. Assessment of reporting quality of abstracts of systematic reviews with meta-analysis using PRISMA-A and discordance in assessments between raters without prior experience. BMC Med Res Methodol. 2019;19(1):32.

Speich B. Blinding in surgical randomized clinical trials in 2015. Ann Surg. 2017;266(1):21–2.

Abraha I, Cozzolino F, Orso M, Marchesi M, Germani A, Lombardo G, Eusebi P, De Florio R, Luchetta ML, Iorio A, et al. A systematic review found that deviations from intention-to-treat are common in randomized trials and systematic reviews. J Clin Epidemiol. 2017;84:37–46.

Zhong Y, Zhou W, Jiang H, Fan T, Diao X, Yang H, Min J, Wang G, Fu J, Mao B. Quality of reporting of two-group parallel randomized controlled clinical trials of multi-herb formulae: A survey of reports indexed in the Science Citation Index Expanded. Eur J Integrative Med. 2011;3(4):e309–16.

Farrokhyar F, Chu R, Whitlock R, Thabane L. A systematic review of the quality of publications reporting coronary artery bypass grafting trials. Can J Surg. 2007;50(4):266–77.

Oltean H, Gagnier JJ. Use of clustering analysis in randomized controlled trials in orthopaedic surgery. BMC Med Res Methodol. 2015;15:17.

Fleming PS, Koletsi D, Pandis N. Blinded by PRISMA: are systematic reviewers focusing on PRISMA and ignoring other guidelines? PLoS One. 2014;9(5):e96407.

Balasubramanian SP, Wiener M, Alshameeri Z, Tiruvoipati R, Elbourne D, Reed MW. Standards of reporting of randomized controlled trials in general surgery: can we do better? Ann Surg. 2006;244(5):663–7.

de Vries TW, van Roon EN. Low quality of reporting adverse drug reactions in paediatric randomised controlled trials. Arch Dis Child. 2010;95(12):1023–6.

Borg Debono V, Zhang S, Ye C, Paul J, Arya A, Hurlburt L, Murthy Y, Thabane L. The quality of reporting of RCTs used within a postoperative pain management meta-analysis, using the CONSORT statement. BMC Anesthesiol. 2012;12:13.

Kaiser KA, Cofield SS, Fontaine KR, Glasser SP, Thabane L, Chu R, Ambrale S, Dwary AD, Kumar A, Nayyar G, et al. Is funding source related to study reporting quality in obesity or nutrition randomized control trials in top-tier medical journals? Int J Obes. 2012;36(7):977–81.

Thomas O, Thabane L, Douketis J, Chu R, Westfall AO, Allison DB. Industry funding and the reporting quality of large long-term weight loss trials. Int J Obes. 2008;32(10):1531–6.

Khan NR, Saad H, Oravec CS, Rossi N, Nguyen V, Venable GT, Lillard JC, Patel P, Taylor DR, Vaughn BN, et al. A review of industry funding in randomized controlled trials published in the neurosurgical literature-the elephant in the room. Neurosurgery. 2018;83(5):890–7.

Hansen C, Lundh A, Rasmussen K, Hrobjartsson A. Financial conflicts of interest in systematic reviews: associations with results, conclusions, and methodological quality. Cochrane Database Syst Rev. 2019;8:Mr000047.

Kiehna EN, Starke RM, Pouratian N, Dumont AS. Standards for reporting randomized controlled trials in neurosurgery. J Neurosurg. 2011;114(2):280–5.

Liu LQ, Morris PJ, Pengel LH. Compliance to the CONSORT statement of randomized controlled trials in solid organ transplantation: a 3-year overview. Transpl Int. 2013;26(3):300–6.

Bala MM, Akl EA, Sun X, Bassler D, Mertz D, Mejza F, Vandvik PO, Malaga G, Johnston BC, Dahm P, et al. Randomized trials published in higher vs. lower impact journals differ in design, conduct, and analysis. J Clin Epidemiol. 2013;66(3):286–95.

Lee SY, Teoh PJ, Camm CF, Agha RA. Compliance of randomized controlled trials in trauma surgery with the CONSORT statement. J Trauma Acute Care Surg. 2013;75(4):562–72.

Ziogas DC, Zintzaras E. Analysis of the quality of reporting of randomized controlled trials in acute and chronic myeloid leukemia, and myelodysplastic syndromes as governed by the CONSORT statement. Ann Epidemiol. 2009;19(7):494–500.

Alvarez F, Meyer N, Gourraud PA, Paul C. CONSORT adoption and quality of reporting of randomized controlled trials: a systematic analysis in two dermatology journals. Br J Dermatol. 2009;161(5):1159–65.

Mbuagbaw L, Thabane M, Vanniyasingam T, Borg Debono V, Kosa S, Zhang S, Ye C, Parpia S, Dennis BB, Thabane L. Improvement in the quality of abstracts in major clinical journals since CONSORT extension for abstracts: a systematic review. Contemporary Clin trials. 2014;38(2):245–50.

Thabane L, Chu R, Cuddy K, Douketis J. What is the quality of reporting in weight loss intervention studies? A systematic review of randomized controlled trials. Int J Obes. 2007;31(10):1554–9.

Murad MH, Wang Z. Guidelines for reporting meta-epidemiological methodology research. Evidence Based Med. 2017;22(4):139.

METRIC - MEthodological sTudy ReportIng Checklist: guidelines for reporting methodological studies in health research [ http://www.equator-network.org/library/reporting-guidelines-under-development/reporting-guidelines-under-development-for-other-study-designs/#METRIC ]. Accessed 31 Aug 2020.

Jager KJ, Zoccali C, MacLeod A, Dekker FW. Confounding: what it is and how to deal with it. Kidney Int. 2008;73(3):256–60.

Parker SG, Halligan S, Erotocritou M, Wood CPJ, Boulton RW, Plumb AAO, Windsor ACJ, Mallett S. A systematic methodological review of non-randomised interventional studies of elective ventral hernia repair: clear definitions and a standardised minimum dataset are needed. Hernia. 2019.

Bouwmeester W, Zuithoff NPA, Mallett S, Geerlings MI, Vergouwe Y, Steyerberg EW, Altman DG, Moons KGM. Reporting and methods in clinical prediction research: a systematic review. PLoS Med. 2012;9(5):1–12.

Schiller P, Burchardi N, Niestroj M, Kieser M. Quality of reporting of clinical non-inferiority and equivalence randomised trials--update and extension. Trials. 2012;13:214.

Riado Minguez D, Kowalski M, Vallve Odena M, Longin Pontzen D, Jelicic Kadic A, Jeric M, Dosenovic S, Jakus D, Vrdoljak M, Poklepovic Pericic T, et al. Methodological and reporting quality of systematic reviews published in the highest ranking journals in the field of pain. Anesth Analg. 2017;125(4):1348–54.

Thabut G, Estellat C, Boutron I, Samama CM, Ravaud P. Methodological issues in trials assessing primary prophylaxis of venous thrombo-embolism. Eur Heart J. 2005;27(2):227–36.

Puljak L, Riva N, Parmelli E, González-Lorenzo M, Moja L, Pieper D. Data extraction methods: an analysis of internal reporting discrepancies in single manuscripts and practical advice. J Clin Epidemiol. 2020;117:158–64.

Ritchie A, Seubert L, Clifford R, Perry D, Bond C. Do randomised controlled trials relevant to pharmacy meet best practice standards for quality conduct and reporting? A systematic review. Int J Pharm Pract. 2019.

Babic A, Vuka I, Saric F, Proloscic I, Slapnicar E, Cavar J, Pericic TP, Pieper D, Puljak L. Overall bias methods and their use in sensitivity analysis of Cochrane reviews were not consistent. J Clin Epidemiol. 2019.

Tan A, Porcher R, Crequit P, Ravaud P, Dechartres A. Differences in treatment effect size between overall survival and progression-free survival in immunotherapy trials: a Meta-epidemiologic study of trials with results posted at ClinicalTrials.gov. J Clin Oncol. 2017;35(15):1686–94.

Croitoru D, Huang Y, Kurdina A, Chan AW, Drucker AM. Quality of reporting in systematic reviews published in dermatology journals. Br J Dermatol. 2020;182(6):1469–76.

Khan MS, Ochani RK, Shaikh A, Vaduganathan M, Khan SU, Fatima K, Yamani N, Mandrola J, Doukky R, Krasuski RA: Assessing the Quality of Reporting of Harms in Randomized Controlled Trials Published in High Impact Cardiovascular Journals. Eur Heart J Qual Care Clin Outcomes 2019.

Rosmarakis ES, Soteriades ES, Vergidis PI, Kasiakou SK, Falagas ME. From conference abstract to full paper: differences between data presented in conferences and journals. FASEB J. 2005;19(7):673–80.

Mueller M, D’Addario M, Egger M, Cevallos M, Dekkers O, Mugglin C, Scott P. Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations. BMC Med Res Methodol. 2018;18(1):44.

Li G, Abbade LPF, Nwosu I, Jin Y, Leenus A, Maaz M, Wang M, Bhatt M, Zielinski L, Sanger N, et al. A scoping review of comparisons between abstracts and full reports in primary biomedical research. BMC Med Res Methodol. 2017;17(1):181.

Krnic Martinic M, Pieper D, Glatt A, Puljak L. Definition of a systematic review used in overviews of systematic reviews, meta-epidemiological studies and textbooks. BMC Med Res Methodol. 2019;19(1):203.

Analytical study [ https://medical-dictionary.thefreedictionary.com/analytical+study ]. Accessed 31 Aug 2020.

Tricco AC, Tetzlaff J, Pham B, Brehaut J, Moher D. Non-Cochrane vs. Cochrane reviews were twice as likely to have positive conclusion statements: cross-sectional study. J Clin Epidemiol. 2009;62(4):380–6 e381.

Schalken N, Rietbergen C. The reporting quality of systematic reviews and Meta-analyses in industrial and organizational psychology: a systematic review. Front Psychol. 2017;8:1395.

Ranker LR, Petersen JM, Fox MP. Awareness of and potential for dependent error in the observational epidemiologic literature: A review. Ann Epidemiol. 2019;36:15–9 e12.

Paquette M, Alotaibi AM, Nieuwlaat R, Santesso N, Mbuagbaw L. A meta-epidemiological study of subgroup analyses in cochrane systematic reviews of atrial fibrillation. Syst Rev. 2019;8(1):241.

Download references

Acknowledgements

This work did not receive any dedicated funding.

Author information

Authors and affiliations.

Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON, Canada

Lawrence Mbuagbaw, Daeria O. Lawson & Lehana Thabane

Biostatistics Unit/FSORC, 50 Charlton Avenue East, St Joseph’s Healthcare—Hamilton, 3rd Floor Martha Wing, Room H321, Hamilton, Ontario, L8N 4A6, Canada

Lawrence Mbuagbaw & Lehana Thabane

Centre for the Development of Best Practices in Health, Yaoundé, Cameroon

Lawrence Mbuagbaw

Center for Evidence-Based Medicine and Health Care, Catholic University of Croatia, Ilica 242, 10000, Zagreb, Croatia

Livia Puljak

Department of Epidemiology and Biostatistics, School of Public Health – Bloomington, Indiana University, Bloomington, IN, 47405, USA

David B. Allison

Departments of Paediatrics and Anaesthesia, McMaster University, Hamilton, ON, Canada

Lehana Thabane

Centre for Evaluation of Medicine, St. Joseph’s Healthcare-Hamilton, Hamilton, ON, Canada

Population Health Research Institute, Hamilton Health Sciences, Hamilton, ON, Canada

You can also search for this author in PubMed   Google Scholar

Contributions

LM conceived the idea and drafted the outline and paper. DOL and LT commented on the idea and draft outline. LM, LP and DOL performed literature searches and data extraction. All authors (LM, DOL, LT, LP, DBA) reviewed several draft versions of the manuscript and approved the final manuscript.

Corresponding author

Correspondence to Lawrence Mbuagbaw .

Ethics declarations

Ethics approval and consent to participate.

Not applicable.

Consent for publication

Competing interests.

DOL, DBA, LM, LP and LT are involved in the development of a reporting guideline for methodological studies.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Mbuagbaw, L., Lawson, D.O., Puljak, L. et al. A tutorial on methodological studies: the what, when, how and why. BMC Med Res Methodol 20 , 226 (2020). https://doi.org/10.1186/s12874-020-01107-7

Download citation

Received : 27 May 2020

Accepted : 27 August 2020

Published : 07 September 2020

DOI : https://doi.org/10.1186/s12874-020-01107-7

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Methodological study
• Meta-epidemiology
• Research methods
• Research-on-research

BMC Medical Research Methodology

ISSN: 1471-2288

• General enquiries: [email protected]

Find Study Materials for

• Business Studies
• Combined Science
• Computer Science
• Engineering
• English Literature
• Environmental Science
• Human Geography
• Macroeconomics
• Microeconomics
• Social Studies
• Browse all subjects
• Read our Magazine

Create Study Materials

Every research project looks a little bit different. While research questions can span a wide breadth of topics, it is important that researchers follow specific procedures and protocols when conducting their research. Methodology , or making sure you have documented the steps you took, is therefore important in research. The procedure a person follows to conduct research is called a  research methodology .  It is important to understand the parts of a research methodology to ensure research is organized, credible, and impactful.

Explore our app and discover over 50 million learning materials for free.

• Research Methodology
• Explanations
• StudySmarter AI
• Textbook Solutions
• 5 Paragraph Essay
• Argumentative Essay
• Cues and Conventions
• English Grammar
• English Language Study
• Essay Prompts
• Essay Writing Skills
• Global English
• History of English Language
• International English
• Key Concepts in Language and Linguistics
• Language Acquisition
• Language Analysis
• Language and Social Groups
• Lexis and Semantics
• Linguistic Terms
• Listening and Speaking
• Multiple Choice Questions
• Research and Composition
• Rhetorical Analysis Essay
• Single Paragraph Essay
• Sociolinguistics
• Methodology
• Synthesis Essay
• Textual Analysis

Lerne mit deinen Freunden und bleibe auf dem richtigen Kurs mit deinen persönlichen Lernstatistiken

Nie wieder prokastinieren mit unseren Lernerinnerungen.

Every research project looks a little bit different. While research questions can span a wide breadth of topics, it is important that researchers follow specific procedures and protocols when conducting their research. Methodology , or making sure you have documented the steps you took, is therefore important in research. The procedure a person follows to conduct research is called a research methodology . It is important to understand the parts of a research methodology to ensure research is organized, credible, and impactful.

Research Methodology Definition

As the name suggests, a research methodology is a way of conducting research. The methodology a researcher chooses will depend on the research question(s) asked. The definition, then, is:

A research methodology is a procedure a researcher chooses for carrying out research.

To choose a research methodology, researchers need to reflect on the goals of their research and the type of data they want to collect and analyze.

Research Methodology Types

While there are different types of research methodology, most research falls under the umbrella of either qualitative or quantitative research. Within each category, there are sub-types that researchers will choose. There is also mixed-method research which combines both qualitative and quantitative approaches.

Quantitative Research Methodology

Quantitative research is about the collection and analysis of numerical data. It typically involves the collection of data through methods like surveys. Researchers analyze that data through various methods of mathematical and statistical analysis. Quantitative research is done in a wide range of fields, such as economics, marketing, public health, and psychology, and includes methods like the following:

Descriptive Quantitative Research

Descriptive quantitative research aims to describe a phenomenon through quantifiable data. For example, a descriptive research question might ask how many women vote for a certain presidential candidate. Researchers conducting descriptive quantitative research typically do not start with a hypothesis , but rather with systematic data collection.

A hypothesis is a statement that makes a prediction about the research at hand.

Experimental Quantitative Research

Experimental quantitative research follows the scientific method. Researchers conducting experimental research craft a hypothesis , which makes a prediction about the research at hand. One of the variables is called the independent variable , which means it is not impacted by the other. The other variable is called the dependent variable , which may be impacted by the other.

Experimental researchers design and conduct an experiment in which they manipulate the independent variable to examine the impact on the dependent variable. The numerical data they collect tests their hypothesis to determine if it was true or not.

Qualitative Research Methodology

Qualitative research is about the collection and analysis of non-numerical data, like written or spoken words. It typically involves interviews and participant observation in order to examine people’s lived experiences. Qualitative research is typically rooted in social theory and used in social sciences such as social anthropology and sociology. There are also several research approaches within qualitative research, including the following:

Ethnography

The Greek root word ethno- means “culture” or “race” and - graphy means "study." Thus, ethnography is the study of cultures and social relations. Qualitative researchers who conduct ethnographies are called ethnographers. They use in-depth direct observations to investigate cultural patterns and behaviors. During these observations, they take detailed field notes which are their main source of data.

Narrative Research

Qualitative researchers who conduct narrative research are interested in the lived experiences of specific individuals. These researchers typically conduct long interviews with a couple of people to better understand their life stories.

Case Studies

Qualitative case studies are used to research a specific phenomenon in a distinct context . For instance, a qualitative researcher interested in how natural disasters impact elementary students might conduct a case study of an elementary school that was affected by a natural disaster. Case studies typically involve multiple data collection methods including observations and interviews.

Mixed-Method Research

Mixed-method research is research that involves both qualitative and quantitative methods. For example, imagine a researcher is interested in the impact of the Covid-19 pandemic on fifth-grade classrooms. To address this research question he might interview teachers about their experiences teaching during the pandemic, but they may also conduct student assessments to analyze students' academic performance. Mixed-method research is often done in fields such as healthcare, education, and sociology.

When choosing which type of research to conduct, researchers should consider what the goal of their research is. For instance, will numerical data help answer the research question? If so, the researcher should probably take a quantitative approach. Will observing or interviewing participants from a particular group address the topic? If so the researcher will likely take a qualitative approach.

Parts of Research Methodology

After researchers select the research methodology they are going to use, they need to outline the various parts of it. To do this, they should address the following questions:

Why have I chosen this method?

The first key part of a research methodology is the explanation for why it was chosen . It is important that researchers reflect on their method to ensure it is logical.

When choosing a research method for a literary research paper, researchers should ask themselves what the goal of their research is. For instance, perhaps a writer is interested in how well a book about a historical event represents people's lived experiences of that event. This writer could meet these goals by conducting qualitative interviews of people who lived through the event. Or perhaps a researcher wants to understand how a text was perceived when it was written.

This researcher could benefit from an analysis of historical archives from the time period the book was published.

Where will I conduct my research?

The second critical part of a research methodology is the research setting , which is where they going to conduct their research. For instance, if they are doing a qualitative study that involves interviews, they will need to select where the interviews will take place and when. Or if they are conducting a survey for a quantitative study they will need to decide how that survey will be conducted, such as on the internet or on paper in a classroom.

When choosing a research setting researchers should again consider their research goals. For instance, the researcher conducting interviews about people's experiences of a historical event would collect detailed information by speaking to people in person to observe their facial expressions and body language. They might therefore choose to conduct interviews in participants' homes where they are comfortable.

Who will my participants be and how will I select them?

In addition to determining where the study will take place, researchers also have to review who they want to participate in their study and how they will select those participants . It is critical that the participants are from a group of people whose participation can help address the research question.

For example, if a qualitative researcher is interested in teachers’ experiences during the Covid-19 pandemic, they will have to interview teachers who taught during that time period. In order to decide which participants to choose, researchers should consider age, gender, race, socioeconomic background, or job experience as relevant factors.

In some cases, researchers will not need to select any participants. For instance, a researcher might be conducting data analysis on a set of data from a secondary source . This means that they did not collect the data themselves and the dataset already existed.

The researcher should identify people who can provide insight into the topic they want to know about. For instance, recall the researcher who is collecting data about a historical event to compare reality to the book's representation. This researcher should strive to ensure they are speaking to participants who have first-hand knowledge.

Depending on the research method, researchers will also have to choose a method of selecting participants. For instance in quantitative research, participant selection could be random to ensure the sample of participants is diverse. However, sometimes researchers need people from hard-to-reach populations to participate, such as people in prison. In such cases, random sampling might not be possible because there might not be as many available participants. No matter what method researchers use to select participants, they have to make sure they specify how the participants were chosen and why.

What instruments will I use to collect data?

Researchers will have to decide if they will collect data. First, they should choose if they will use primary or secondary sources.

• Primary sources are original sources of information. These can include first-hand accounts from qualitative interviews or results of a survey created for a quantitative study.
• Secondary sources are sources of information that are not based on first-hand experience, but they provide information about one. For instance, articles from scholarly journals and textbooks are secondary sources.

Once researchers have decided to use primary or secondary sources, they will have to select which data collection instruments to use. The term "instrument” is used to describe the method used for data collection.

For example, a qualitative researcher might choose to use interviews to collect data. The script and list of questions the researchers use to conduct those interviews are called the interview protocol. This protocol is the data collection instrument.

When writing an English paper, one of the main sources of data will likely be the text or texts that motivated the research. Researchers might also use historical sources about the text such as reviews or newspaper articles from the time the text was written.

How will I use the data?

The next crucial part of a research methodology is the procedure for data analysis . Depending on the type of data and the information a researcher hopes to collect from the data, the data analysis process will be different. For instance, in qualitative research, researchers often “code” their data thematically, which means they try to identify the main ideas in it. In quantitative research, researchers often visualize the data they collect in charts or graphs and look for trends and their implications.

Analyzing data for a literary research paper may look different than analyzing data for a quantitative social science study. For instance, it may involve more thematic reflection and the analysis of secondary sources about a text.

What are the limitations of this research?

Finally, it is important for researchers to reflect on the potential imitations of their researcher and their ethical implications for it. No research project can cover the entire scope of a topic, and there are therefore limitations to all studies.

For instance, financial limitations or time constraints might limit the number of participants the researcher could select. Noting limitations and reflecting on their implications is a key part of a reflexive, transparent research paper.

It is also important for researchers to note the ethical guidelines for the type of research they are conducting and explain that they were acknowledged and followed.

Importance of Research Methodology

Research methodology is important because it structures the research proce ss and ensures valid, effective research is conducted. The methodology is also important in research to make sure no steps have been missed (which may undermine your hypothesis) and to prove you followed the ethical guidelines concerning the type of participant chosen.

It is then important that researchers understand how to describe their research methodology to their readers. Writers typically introduce their research methodology in an abstract, which is a brief summary of their research at the beginning of their paper.

Briefly describing the research methodology will tell other researchers looking at the paper whether or not it is relevant to the type of research they are searching for. It will also help them get a short, comprehensive understanding of your study right from the start.

When introducing the research methodology in the abstract, it is important that researchers mention:

The type of research and why it was chosen

The research setting and participants

The data collection process

The data analysis process

Limitations to the research

After referencing the research methodology in the abstract, writers will later devote a section of their paper to the research methodology. The research methodology section is where the researcher goes into more detail about each part of the methodology.

Research Methodology Example

The following is an example of an abstract that provides a brief, effective summary of the chosen research methodology. Read through the abstract and think about the why, where, who, what, and how as well as the all-important what limitations.

Research Methodology - Key Takeaways

• The research methodology is a procedure a researcher chooses for carrying out research.
• Common research methodologies include qualitative, quantitative, and mixed methods.
• Parts of a research methodology include the explanation for the choice of the method, the research setting, the data collection methods, the data analysis methods, and mentions of limitations or ethical considerations.
• Researchers should introduce their research methodology in their abstract and then include a more detailed section on the topic in the body of their paper.

Frequently Asked Questions about Research Methodology

--> what is research methodology, --> why is research methodology important.

It is important to follow the parts of a research methodology to ensure research is organized, credible, impactful, and to make sure that the hypothesis is fully supported by the evidence collected and analysed.

--> What is an example of research methodology?

An example of research methodology is a qualitative case study that uses observational field notes and interview transcripts as data.

--> What are the types of research methodology?

The types of research methodology are quantitative, qualitative, and mixed-method.

--> What are the important parts to describe in a research methodology?

The parts of a research methodology to describe are:

• the explanation for the research method
• the research setting and participant selection
• the data collection process
• the data analysis process
• the limitations and ethical considerations

Test your knowledge with multiple choice flashcards

What is the difference between quantitative and qualitative research methodology? 

Which type of research seeks to describe a research phenomenon in detail through quantifiable data?

Which of the following is not a part of a research methodology? 

Your score:

Join the StudySmarter App and learn efficiently with millions of flashcards and more!

Learn with 20 research methodology flashcards in the free studysmarter app.

Already have an account? Log in

What is a research methodology?

Quantitative research is based on numerical data and qualitative is based on non-numerical data.

Descriptive

Personal experience with the topic

What is ethnography?

The qualitative study of cultural and social phenomena.

What is a hypothesis?

• Free Response Essay

of the users don't pass the Research Methodology quiz! Will you pass the quiz?

How would you like to learn this content?

Free english cheat sheet!

Everything you need to know on . A perfect summary so you can easily remember everything.

Join over 22 million students in learning with our StudySmarter App

The first learning app that truly has everything you need to ace your exams in one place

• Flashcards & Quizzes
• AI Study Assistant
• Study Planner
• Smart Note-Taking

Sign up to highlight and take notes. It’s 100% free.

This is still free to read, it's not a paywall.

You need to register to keep reading, create a free account to save this explanation..

Save explanations to your personalised space and access them anytime, anywhere!

By signing up, you agree to the Terms and Conditions and the Privacy Policy of StudySmarter.

Entdecke Lernmaterial in der StudySmarter-App

1 Chapter 1: The Importance of Research Methods and Becoming an Informed Consumer of Research

Case study : student apprehension regarding research methods.

Research Study

Understanding and Measuring Student Apprehension in Criminal Justice Research Methods Courses 1

Research Question

How do we measure disinterest, relevance argumentation, and math anxiety experienced by students enrolled in research methods courses?

Methodology

It is said that “misery loves company,” so you are not alone in your apprehension and anxiety regarding your research methods course. The problem of student apprehension and anxiety related to taking a research methods course is not new and has been studied for over 25 years. Previously, such apprehension and anxiety appeared to be caused by math anxiety, especially as it applies to statistics. The authors of this article believe that student apprehension goes beyond math anxiety; that math anxiety is too simplistic of an explanation of student fear of research methods courses. Besides math anxiety, the researchers think that apprehension is caused by student indifference to the subject matter and irrelevance of the course because it does not apply to the “real world.” They state that student apprehension in research methods and statistics courses is due to three main factors:

Disinterest (D.);

Relevance Argumentation (RA.), and;

Math Anxiety (MA.).

Taken together, the reconceptualization is known as D.RA.MA., and the combination of these three factors constitutes the D.RA.MA. scale for research methods and statistics courses.

The researchers developed the D.RA.MA. scale by constructing survey questions to measure each factor in the scale (i.e., disinterest, relevance argumentation, and math anxiety). After they developed the survey, they tested it by distributing the survey to three criminal justice classes, totaling 80 students, from a midsized regional comprehensive university in the southern region of the United States. Higher scale scores demonstrate more disinterest, more relevance argumentation, or more math anxiety.

The D.RA.MA. scale consists of 20 survey questions. Ten questions were borrowed from an existing Math Anxiety scale developed by Betz 2 . The researchers then created five items to assess Disinterest and five items intended to measure Relevance Argumentation. The items for the D.RA.MA. scale are illustrated below.

Math Anxiety 3

I usually have been at ease in math classes.

Math does not scare me at all.

I am no good at math.

I don’t think that I could do advanced math.

Generally, I have been secure about attempting math.

For some reason, even though I study, math seems unusually hard for me.

Math has been my worst subject.

My mind goes blank and I am unable to think clearly when working in mathematics.

I think I could handle more difficult math.

I am not the type to do well in mathematics.

Relevance Argumentation 4

I will need research methods for my future work.

I view research methods as a subject that I will rarely use.

Research methods is not really useful for students who intend to work in Criminal Justice.

Knowing research methods will help me earn a living.

Research methods does not reflect the “real world.”

Research Disinterest 5

I am excited about taking research methods.

It would not bother me at all to take more research methods courses.

I expect a research methods class to be boring.

I don’t expect to learn much in research methods.

I really don’t care if I learn anything in research methods, as long as I get the requirement completed.

The Math Anxiety Scale responses for the 80 students ranged from 0 to 30 with a mean of 14, demonstrating a moderate level of math anxiety among the study participants. The responses for Relevance Argumentation ranged from 0 to 12 with a mean of 5.4 while those for Disinterest ranged from 1 to 15 with a mean of 7.0, demonstrating a moderate level of disinterest and relevance argumentation among students regarding research methods. Based on these findings, the study demonstrated that student apprehension regarding research methods courses goes beyond math anxiety and includes two additional factors; disinterest in the subject matter and irrelevance of research methods to the “real world.”

Limitations with the Study Procedure

This research study was designed to develop a broader measure of student apprehension in criminal justice research methods courses. Moving beyond just math anxiety, the researchers accomplished their objective by developing the D.RA.MA. scale; adding disinterest and relevance argumentation to the understanding of student apprehension regarding research methods. As is true for all research, this study is not without limitations. The biggest limitation of this study is the limited sample size. Only 80 students completed the survey. Although this is certainly a good start, similar research (i.e., replication) needs to be completed with larger student samples in different locations throughout the country before the actual quality of the D.RA.MA. scale can be determined.

Impact on Criminal Justice

The D.RA.MA. scale developed in this study identifies disinterest and relevance argumentation, in addition to math anxiety, as part of student apprehension and resistance to research methods. A variety of instructional strategies can be inferred from the D.RA.MA. survey. However, it is important for professors to recognize that no single approach will reduce research methods resistance and apprehension for all students. For example, discussing research methods in a popular culture framework may resonate with students and lead to engaged students who are more interested in the subject matter and identify with the relevance of research methods to criminal justice in general and the future careers of students, in particular. This approach may provide an effective means for combating student disinterest and relevance argumentation in criminal justice research methods courses. At a minimum, it is critical for professors to explain the relevance of research methods to the policies and practices of police, courts, and corrections. Students need to realize that research methods are essential tools for assessing agency policies and practices. Professors will always have D.RA.MA.-plagued students, but recognizing the problem and then developing effective strategies to connect with these students is the challenge all professors face. Experimenting with a multitude of teaching strategies to alleviate the math anxiety, relevance argumentation, and disinterest of criminal justice research methods students will result in more effective teaching and learning.

In This Chapter You Will Learn

What research is and why it is important to be an informed consumer of research

The sources of knowledge development and problems with each

How research methods can dispel myths about crime and the criminal justice system

The steps in the research process

How research has impacted criminal justice operations

Introduction

As noted in the chapter opening case study, it is expected that you have some anxiety and apprehension about taking this criminal justice research methods course. But, you have taken a significant step toward success in this course by opening up your research methods book, so congratulations are in order. You might have opened this book for a number of reasons. Perhaps it is the first day of class and you are ready to get started on the course material. Perhaps you have a quiz or exam soon. Perhaps the book has been gathering dust on your shelf since the first day of class and you are not doing well in your research methods class and are looking for the book to help with course improvement. Perhaps you are taking a research methods class in the future and are seeing if all the chatter among students is true.

No matter how you got here, two things are probably true. First, you are taking this research methods course because it is a requirement for your major. The bottom line is that most of the students who read this text are required to take a research methods course. While you may think studying research methods is irrelevant to your career goals, unnecessary, overly academic, or perhaps even intimidating, you probably must finish this course in order to graduate. Second, you have heard negative comments about this course. The negative comments mention the difficulty of the course and the relevance of the course (e.g., “I am going to be a police officer, so why do I need to take a research methods course?”). If you are like most students we have experienced in our research methods courses in the past, you are not initially interested in this course and are concerned about whether you will do well in it.

If you are concerned about the course, realize that you are not alone because most students are anxious about taking a research methods course. Also realize that your professor is well aware of student anxiety and apprehension regarding research methods. So, relax and do not think about the entire course and the entire book. Take the course content one chapter, one week at a time. One of the advantages of taking a research methods course is that you learn about the process of research methods. Each chapter builds upon the previous chapters, illustrating and discussing more about the research process. This is certainly an advantage, but it is also critical that you understand the initial chapters in this book so you are not confused with the content discussed in later chapters. In addition to anxiety and apprehension over the course material, research methods can be boring if you only read and learn about it with no particular purpose in mind. Although examples are prevalent throughout the book, as you read this material, it is recommended that you think about the relevancy and application of the topics covered in this book to your specific criminal justice interests. As you continue to read the book, think about how you might use the information you are reading in your current position or your intended profession.

The goal of this research methods book is to develop you into an informed consumer of research. Most, if not all, of your fellow classmates will never conduct their own research studies. However, every one of you will be exposed to research findings in your professional and personal lives for the remainder of your lives. You are exposed to research findings in the media (e.g., television, newspapers, and online), in personal interaction with others (e.g., friends and family, doctors, and professors), as well as in class. You should challenge yourself for this semester to keep a journal and document exposure to research in your daily life outside of college whether through the nightly news, newspapers, magazine articles, Internet, personal conversations, or other means. At the end of the semester, you will be amazed at the amount of research you are exposed to in a short period of time. This book is focused on research exposure and assisting you to become an educated consumer of research by providing you the skills necessary to differentiate between good and not so good research. Why should you believe research findings if the study is faulty? Without being an educated consumer of research, you will not be able to differentiate between useful and not useful research. This book is designed to remedy this problem.

This book was written to make your first encounter with research methods relevant and successful while providing you the tools necessary to become an educated consumer of research. Therefore, this book is written with the assumption that students have not had a prior class on research methods. In addition, this book assumes that practical and evaluative knowledge of research methods is more useful than theoretical knowledge of the development of research methods and the relationship between theory and research. Since the focus of this book is on consumerism, not researcher training, practical and evaluative knowledge is more useful than theoretical knowledge.

It is also important to understand that the professors who design academic programs in criminal justice at the associate and bachelor level believe that an understanding of research methods is important for students. That is why, more than likely, this research methods course is a required course in your degree program. These professors understand that a solid understanding of research methods will enrich the qualifications of students for employment and performance in their criminal justice careers.

As previously stated, the basic goal of this book is to make students, as future and possibly even current practitioners in the criminal justice system, better informed and more capable consumers of the results of criminal justice research. This goal is based on the belief that an understanding of research methods allows criminal justice practitioners to be better able to make use of the results of research as it applies to their work-related duties. In fact, thousands of research questions are asked and answered each year in research involving criminal justice and criminological topics. In addition, thousands of articles are published, papers presented at conferences, and reports prepared that provide answers to these questions. The ability to understand research gives practitioners knowledge of the most current information in their respective fields and the ability to use this knowledge to improve the effectiveness of criminal justice agencies.

How Do We Know What We Know? Sources of Knowledge

The reality is the understanding of crime and criminal justice system operations by the public is frequently the product of misguided assumptions, distorted interpretations, outright myths, and hardened ideological positions. 6 This is a bold statement that basically contends that most people’s knowledge of crime and criminal justice is inaccurate. But, how do these inaccuracies occur? Most people have learned what they know about crime and criminal justice system operations through some other means besides scientific research results and findings. Some of that knowledge is based on personal experience and common sense. Much of it is based on the information and images supported by politicians, governmental agencies, and especially the media. This section will discuss the mechanisms used to understand crime and criminal justice operations by the public. It is important to note that although this section will focus on the failings of these knowledge sources, they each can be, and certainly are, accurate at times, and thus are valuable sources of knowledge.

Knowledge from Authority

We gain knowledge from parents, teachers, experts, and others who are in positions of authority in our lives. When we accept something as being correct and true just because someone in a position of authority says it is true, we are using what is referred to as authority knowledge as a means of knowing. Authorities often expend significant time and effort to learn something, and we can benefit from their experience and work.

However, relying on authority as a means of knowing has limitations. It is easy to overestimate the expertise of other people. A person’s expertise is typically limited to a few core areas of significant knowledge; a person is not an expert in all areas. More specifically, criminal justice professors are not experts on all topics related to criminal justice. One professor may be an expert on corrections but know little about policing. If this professor discusses topics in policing in which he is not an expert, we may still assume he is right when he may be wrong. Authority figures may speak on fields they know little about. They can be completely wrong but we may believe them because of their status as an expert. Furthermore, an expert in one area may try to use his authority in an unrelated area. Other times, we have no idea of how the experts arrived at their knowledge. We just know they are experts in the topic area.

As I am writing this, I recall an example of authority knowledge that was wrong during my police academy training in the late 1980s. My academy training was about four years after the U.S. Supreme Court decision in Tennessee v. Garner. 7 In this case, the Court limited the use of deadly force by police to defense of life situations and incidents where the suspect committed a violent offense. Prior to the decision, the police in several states could use deadly force on any fleeing suspect accused of a felony offense. One day, the academy class was practicing mock traffic stops. During one of my mock traffic stops, I received information that the vehicle I stopped was stolen. The driver and passenger exited the vehicle and fled on foot. I did not use deadly force (this was a training exercise so was not real) against the suspects and was chastised by my instructor who insisted that I should have shot the suspects as they were fleeing. Training instructors, just like professors, convey authority knowledge but, in this case, the instructor was wrong. I was not legally authorized to use deadly force in the traffic stop scenario despite the insistence of my instructor to the contrary.

Politicians are sometimes taken as a source of authority knowledge about the law, crime, and criminal justice issues. Since they enact laws that directly impact the operations of the criminal justice system, we may assume they are an authority on crime and criminal justice. More specifically, we may assume that politicians know best about how to reduce crime and increase the effectiveness of the criminal justice system. However, history is rife with laws that sounded good on paper but had no impact on crime. For example, there is little evidence that sex offender registration protects the public from sexual predators or acts as a deterrent to repeat sex offenders even though every state has a law requiring convicted sex offenders to register with local authorities. Perhaps politicians are not the criminal justice experts some perceive them to be.

History is also full of criminal justice authorities that we now see as being misinformed. For example, Cesare Lombroso is the father of the positivist school of criminology. He is most readily recognized for his idea that some individuals are born criminal. He stated that criminals have certain unique biological characteristics, including large protruding jaws, high foreheads, flattened noses, and asymmetrical faces, to name a few. 8 These characteristics were similar to those found in primitive humans. Therefore, Lombroso argued that some individuals were genetic “throwbacks” to a more primitive time and were less evolved than other people and thus, were more likely to be criminals. Lombroso’s research has been discredited because he failed to compare criminals with noncriminals. By studying only criminals, he found characteristics that were common to criminals. However, if Lombroso had studied a group of noncriminals, he would have discovered that these biological characteristics are just as prevalent among noncriminals. This example involves authority knowledge that is supported by research but the research methods used were flawed. The errors of Lombroso seem obvious now, but what do we know today through authority knowledge that is inaccurate or will be proven wrong in the future?

Knowledge from Tradition

In addition to authority knowledge, people often rely on tradition for knowledge. Tradition knowledge relies on the knowledge of the past. Individuals accept something as true because that is the way things have always been so it must be right. A good example of tradition knowledge is preventive/random patrol. Ever since vehicles were brought into the police patrol function, police administrators assumed that having patrol officers drive around randomly in the communities they serve, while they are not answering calls for service, would prevent crime. If you were a patrol officer in the early 1970s and asked your supervisor, “Why do I drive around randomly throughout my assigned area when I am not answering a call for service?” the answer would have been, “That is the way we have always done patrol and random patrol reduces crime through deterrence.” The Kansas City Preventive Patrol Experiment challenged the tradition knowledge that preventive/random patrol reduces crime. The results of the study made it clear that the traditional practice of preventive/random patrol had little to no impact on reducing crime. This allowed police departments to develop other patrol deployment strategies such as directed patrol and “hot spots” policing since preventive patrol was seen as ineffective. The development of effective patrol deployment strategies continues today.

Knowledge from Common Sense

We frequently rely on common sense knowledge for what we know about crime and the criminal justice system because it “just makes sense.” For example, it “just makes sense” that if we send juvenile delinquents on a field trip to prison where they will see first hand the prison environment as well as be yelled at by actual prisoners, they will refrain from future delinquency. That is exactly what the program Scared Straight, originally developed in the 1970s, is designed to do. Scared Straight programs are still in existence today and are even the premise for the television show Beyond Scared Straight on the A&E television network. As originally created, the program was designed to decrease juvenile delinquency by bringing at-risk and delinquent juveniles into prison where they would be “scared straight” by inmates serving life sentences. Participants in the program were talked to and yelled at by the inmates in an effort to scare them. It was believed that the fear felt by the participants would lead to a discontinuation of their delinquent behavior so that they would not end up in prison themselves. This sounds like a good idea. It makes sense, and the program was initially touted as a success due to anecdotal evidence based on a few delinquents who turned their lives around after participation in the program.

However, evaluations of the program and others like it showed that the program was in fact unsuccessful. In the initial evaluation of the Scared Straight program, Finckenauer used a classic experimental design (discussed in Chapter 5), to evaluate the original “Lifer’s Program” at Rahway State Prison in New Jersey where the program was initially developed. 13 Juveniles were randomly assigned to an experimental group that attended the Scared Straight program and a control group that did not participate in the program. Results of the evaluation were not positive. Post-test measures revealed that juveniles who were assigned to the experimental group and participated in the program were actually more seriously delinquent afterwards than those who did not participate in the program. Also using an experimental design with random assignment, Yarborough evaluated the “Juvenile Offenders Learn Truth” (JOLT) program at the State Prison of Southern Michigan at Jackson. 14 This program was similar to that of the “Lifer’s Program,” only with fewer obscenities used by inmates. Post-test measurements were taken at two intervals, three and six months after program completion. Again, results were not positive. Findings revealed no significant differences in delinquency between those juveniles who attended the program and those who did not. Other experiments conducted on Scared Straight- type programs further revealed their inability to deter juveniles from further delinquency. 15 Despite the common sense popularity of these programs, the evaluations showed that Scared Straight programs do not reduce delinquency and, in some instances, may actually increase delinquency. The programs may actually do more harm than good. I guess that begs the question, “Why do we still do these types of programs?”

Scared Straight programs and other widely held common sense beliefs about crime and the criminal justice system are questionable, based on the available research evidence. Common sense is important in our daily lives and is frequently correct, but, at times, it also contains inaccuracies, misinformation, and even prejudice.

CLASSICS IN CJ RESEARCH

Is It Safe to Put Felons on Probation?

Research Study 9

In the mid-1970s, the number of offenders on probation began to significantly increase. By the mid-1980s, probation was the most frequently used sentence in most states and its use was becoming more common for felons, whereas previously, probation was typically limited to misdemeanor crimes and offenses committed by juveniles. Increasing numbers of felony offenders were being placed on probation because judges had no other alternative forms of punishment. Prisons were already operating above capacity due to rising crime rates. Despite the increase in the use of probation in the 1980s, few empirical studies of probation (particularly its use with felony offenders) had been published. In the early 1980s, the Rand Corporation conducted an extensive study of probation to learn more about the offenders sentenced to probation and the effectiveness of probation as a criminal sanction. At the time the study began, over one-third of California’s probation population were convicted felons. 10 This was the first large-scale study of felony probation.

Is it safe to put felons on probation?

Data for the study were obtained from the California Board of Prison Terms (CBPT). The Board had been collecting comprehensive data on all offenders sentenced to prison since 1978 and on a sample of adult males from 17 counties who received probation. From these two data sources, researchers selected a sample of male offenders who had been convicted of the following crimes: robbery, assault, burglary, theft, forgery, and drug offenses. These crimes were selected because an offender could receive either prison or probation if convicted. Approximately 16,500 male felony offenders were included in the study. For each offender, researchers had access to their personal characteristics, information on their crimes, court proceedings, and disposition.

Two main research questions were answered in this study. First, what were the recidivism rates for felony offenders who received probation? When assessing recidivism rates, the study found that the majority of offenders sentenced to probation recidivated during the follow-up period, which averaged 31 months. Overall, 65% of the sample of probationers were re-arrested and 51 % were charged with and convicted of another offense. A total of 18% were convicted of a violent crime.

The second research question asked, what were the characteristics of the probationers who recidivated? Property offenders were more likely to recidivate compared to violent or drug offenders. Researchers also discovered that probationers tended to recidivate by committing the same crime that placed them on probation. Rand researchers included time to recidivism in their analysis and found that property and violent offenders recidivated sooner than drug offenders. The median time to the first filed charge was five months for property offenders and eight months for violent offenders.

The issue of whether or not the findings would generalize to other counties in California and to other states was raised. Data for the study came from probation and prison records from two counties in California. These two counties were not randomly selected, but were chosen because of their large probation populations and the willingness of departments to provide information. Further, the probation departments in these counties had experienced significant budget cuts. Supervision may have become compromised as a result and this could have explained why these counties had high rates of recidivism. Studies of probation recidivism in other states have found recidivism rates to be much lower, suggesting the Rand results may not have applied elsewhere. 11 Several studies examining the effectiveness of probation and the factors correlated with probation outcomes were published after 1985. Much of this research failed to produce results consistent with the Rand study.

The Rand study of felony probation received a considerable amount of attention within the field of corrections. According to one scholar, the study was acclaimed as “the most important criminological research to be reported since World War II.” 12 The National Institute of Justice disseminated the report to criminal justice agencies across the country and even highlighted the study in their monthly newsletter. Today, the study remains one of the most highly cited pieces of corrections research.

According to Rand researchers, these findings raised serious doubts about the effectiveness of probation for felony offenders. Most of the felons sentenced to probation recidivated and researchers were unable to develop an accurate prediction model to improve the courts’ decision-making. The continued use of probation as a sanction for felony offenders appeared to be putting the public at risk. However, without adequate prison space, the courts had no other alternatives besides probation when sentencing offenders.

The researchers made several recommendations to address the limitations of using probation for felony offenders. First, it was recommended that states formally acknowledge that the purpose of probation had changed. Probation was originally used as a means of furthering the goal of rehabilitation in the correctional system. As the United States moved away from that goal in the late 1960s, the expectations of probation changed. Probation was now used as a way to exercise “restrictive supervision” over more serious offenders. Second, probation departments needed to redefine the responsibilities of their probation officers. Probation officers were now expected to be surveillance officers instead of treatment personnel, which required specialized training. In addition, states needed to explore the possibility of broadening the legal authority of its probation officers by allowing them to act as law enforcement officers if necessary. Third, states were advised to adopt a formal client management system that included risk/need assessments of every client. Such a system would help establish uniform, consistent treatment of those on probation and would also help departments allocate their resources efficiently and effectively. Fourth, researchers encouraged states to develop alternative forms of community punishment that offered more public protection than regular probation, which led to the development and use of intensive supervision probation, house arrest, electronic monitoring, day reporting centers, and other intermediate punishments.

Knowledge from Personal Experience

If you personally see something or if it actually happens to you, then you are likely to accept it as true and gain knowledge from the experience. Gaining knowledge through actual experiences is known as personal experience knowledge, and it has a powerful and lasting impact on everyone. Personal experiences are essential building blocks of knowledge and of what we believe to be true. The problem with knowledge gained from personal experiences is that personal experiences can be unique and unreliable, which can distort reality and lead us to believe things that are actually false.

How can events that someone personally experienced be wrong? The events are not wrong. Instead, the knowledge gained from the experience is wrong. For example, the research consistently shows that a person’s demeanor significantly impacts the decision-making of police officers. During a traffic stop, if a person is rude, disrespectful, and uncooperative to the officer, then the driver is more likely to receive a traffic citation than a warning. That is what the research on police discretion shows. However, if a person was rude and uncooperative to a police officer during a traffic stop and was let go without a citation, the person will gain knowledge from this personal experience. The knowledge gained may include that being disrespectful during future traffic stops will get this person out of future tickets. Not likely. The event is not wrong. Instead, the knowledge gained from the experience is wrong because being disrespectful to the police usually leads to more enforcement action taken by the police, not less.

As a student in criminal justice, you have probably experienced something similar in interaction with friends, relatives, and neighbors. Your knowledge of criminal justice that you have developed in your criminal justice classes is trumped by one experience your friend, relative, or neighbor had with the criminal justice system. They believe they are right because they experienced it. However, there are four errors that occur in the knowledge gained from personal experiences: overgeneralization, selective observation, illogical reasoning, and resistance to change.

Overgeneralization happens when people conclude that what they have observed in one or a few cases is true for all cases. For example, you may see that a wealthy businesswomen in your community is acquitted of bribery and may conclude that “wealthy people, especially women, are never convicted in our criminal justice system,” which is an overgeneralization. It is common to draw conclusions about people and society from our personal interactions, but, in reality, our experiences are limited because we interact with just a small percentage of people in society.

The same is true for practitioners in the criminal justice system. Practitioners have a tendency to believe that because something was done a particular way in their agency, it is done that way in all agencies. That may not be true. Although there are certainly operational similarities across criminal justice agencies, there are also nuances that exist across the over 50,000 criminal justice agencies in the United States. Believing that just because it was that way in your agency, it must be that way in all agencies leads to overgeneralization.

Selective observation is choosing, either consciously or unconsciously, to pay attention to and remember events that support our personal preferences and beliefs. In fact, with selective observation, we will seek out evidence that confirms what we believe to be true and ignore the events that provide contradictory evidence. We are more likely to notice pieces of evidence that reinforce and support our ideology. As applied to the criminal justice system, when we are inclined to be critical of the criminal justice system, it is pretty easy to notice its every failing and ignore its successes. For example, if someone believes the police commonly use excessive force, the person is more likely to pay attention to and remember a police brutality allegation on the nightly news than a police pursuit that led to the apprehension of the suspect without incident on the same nightly news. As another example, if you believe treatment efforts on sex offenders are futile, you will pay attention to and remember each sex offender you hear about that recidivates but will pay little attention to any successes. It is easy to find instances that confirm our beliefs, but with selective observation, the complete picture is not being viewed. Therefore, if we only acknowledge the events that confirm our beliefs and ignore those that challenge them, we are falling victim to selective observation.

Besides selective observation, some of our observations may simply be wrong. Consider eyewitness identification. It is a common practice in the criminal justice system, but research has consistently demonstrated inaccuracies in eyewitness identification. The witness feels certain that the person viewed is the person who committed the offense, but sometimes the witness is wrong. Even when our senses of sight, hearing, taste, touch, and smell are fully operational, our minds have to interpret what we have sensed, which may lead to an inaccurate observation.

RESEARCH IN THE NEWS

When Your Criminal Past Isn’t Yours 16

The business of background checks on prospective employees is increasing significantly. According to the Society for Human Resource Management, since the events of September 11, 2001, the percentage of companies that conduct criminal history checks during the hiring process has risen past 90%. Employers spend at least $2 billion a year to look into the pasts of their prospective employees. Problems with the business of background checks were identified through research that included a review of thousands of pages of court filings and interviews with dozens of court officials, data providers, lawyers, victims, and regulators.

The business of background checks is a system weakened by the conversion to digital files and compromised by the significant number of private companies that profit by amassing public records and selling them to employers. The private companies create a system in which a computer program scrapes the public files of court systems around the country to retrieve personal data. Basically, these are automated data-mining programs. Today, half the courts in the United States put criminal records on their public websites. So, the data are there for the taking, but the records that are retrieved typically are not checked for errors—errors that would be obvious to human eyes.

The errors can start with a mistake entered into the logs of a law enforcement agency or a court file. The biggest culprits, though, are companies that compile databases using public information. In some instances, their automated formulas misinterpret the information provided them. Other times, records wind up assigned to the wrong people with a common name. Furthermore, when a government agency erases a criminal conviction after a designated period of good behavior, many of the commercial databases don’t perform the updates required to purge offenses that have been removed from public record. It is clear that these errors can have substantial ramifications, including damaged reputations and loss of job opportunities.

Illogical reasoning occurs when someone jumps to premature conclusions or presents an argument that is based on invalid assumptions. Premature conclusions occur when we feel we have the answer based on a few pieces of evidence and do not need to seek additional information that may invalidate our conclusion. Think of a detective who, after examining only a few pieces of evidence, quickly narrows in on a murder suspect. It is common for a detective to assess the initial evidence and make an initial determination of who committed the murder. However, it is hoped that the detective will continue to sort through all the evidence for confirmation or rejection of his original conclusion regarding the murder suspect. Illogical reasoning by jumping to premature conclusions is common in everyday life. We look for evidence to confirm or reject our beliefs and stop when a small amount of evidence is present; we jump to conclusions. If a person states, “I know four people who have dropped out of high school, and each one of them ended up addicted to drugs, so all dropouts abuse drugs,” the person is jumping to conclusions.

Illogical reasoning also occurs when an argument, based on invalid assumptions, is presented. Let’s revisit the Scared Straight example previously discussed. Program developers assumed that brief exposure to the harsh realities of prison would deter juveniles from future delinquency. The Scared Straight program is an example of illogical reasoning. Four hours of exposure to prison life is not going to counteract years of delinquency and turn a delinquent into a nondelinquent. The program is based on a false assumption and fails to recognize the substantial risk factors present in the lives of most delinquents that must be mediated before the juvenile can live a crime-free lifestyle. A fear of prison, developed through brief exposure, is not enough to counteract the risk factors present in the lives of most delinquents. Although the Scared Straight program sounds good, it is illogical to assume that a brief experience with prison life will have a stronger impact on the decisions made by delinquents than peer support for delinquency, drug abuse, lack of education, poor parental supervision, and other factors that influence delinquency.

Resistance to change is the reluctance to change our beliefs in light of new, accurate, and valid information to the contrary. Resistance to change is common and it occurs for several reasons. First, even though our personal experience may be counter to our belief system, it is hard to admit we were wrong after we have taken a position on an issue. Even when the research evidence shows otherwise, people who work within programs may still believe they are effective. As previously stated, even though the research evidence shows otherwise, Scared Straight programs still exist and there is even a television show devoted to the program. Second, too much devotion to tradition and the argument that this is the way it has always been done inhibits change and hinders our ability to accept new directions and develop new knowledge. Third, uncritical agreement with authority inhibits change. Although authority knowledge is certainly an important means of gaining knowledge, we must critically evaluate the ideas, beliefs, and statements of those in positions of authority and be willing to challenge those statements where necessary. However, people often accept the beliefs of those in positions of authority without question, which hinders change.

Knowledge from Media Portrayals

Television shows, movies, websites, newspapers, and magazine articles are important sources of information. This is especially true for information about crime and the criminal justice system since most people have not had much contact with criminals or the criminal justice system. Instead of gaining knowledge about the criminal justice system through personal experience, most people learn about crime and the operations of the criminal justice system through media outlets. Since the primary goal of many of these media outlets is to entertain, they may not accurately reflect the reality of crime and criminal justice. Despite their inaccuracies, the media has a substantial impact on what people know about crime and the criminal justice system. Most people know what they know about crime and criminal justice through the media, and this knowledge even has an impact on criminal justice system operations.

An example of the potential impact of the media on the actual operations of the criminal justice system involves the CSI: Crime Scene Investigation television shows. The shows have been criticized for their unrealistic portrayal of the role of forensic science in solving criminal cases. Critics claim that CSI viewers accept what they see on the show as an accurate representation of how forensic science works. When summoned for jury duty, they bring with them unrealistic expectations of the forensic evidence they will see in trial. When the expected sophisticated forensic evidence is not presented in the real trial, the juror is more likely to vote to acquit the defendant. This phenomenon is known as the CSI Effect. Has the research shown that the CSI Effect exists and is impacting the criminal justice system? Most of the research shows that the CSI Effect does not exist and thus does not impact juror decision-making, but other research has shown that viewers of CSI have higher expectations related to evidence presented at trial. 17

There are several instances in which media attention on a particular topic created the idea that a major problem existed when it did not. An example is Halloween sadism. Halloween sadism is the practice of giving contaminated treats to children during trick or treating. 18 In 1985, Joel Best wrote an article entitled, “The Myth of the Halloween Sadist.” 19 His article reviewed press coverage of Halloween sadism in the leading papers in the three largest metropolitan areas ( New York Times, Los Angeles Times, and Chicago Tribune ) from 1958–1984. Although the belief in Halloween sadism is widespread, Best found few reported incidents and few reports of children being injured by Halloween sadism. Follow-ups on these reported incidents led to the conclusion that most of these reports were hoaxes. Best concluded, “I have been unable to find a substantiated report of a child being killed or seriously injured by a contaminated treat picked up in the course of trick or treating.” 20 Since 1985, Best has kept his research up to date and has come to the same conclusion. Halloween sadism is an urban legend; it is a story that is told as true, even though there is little or no evidence that the events in the story ever occurred.

Dispelling Myths: The Power of Research Methods

In the prior section, sources of knowledge were discussed along with the limitations of each. A researcher (e.g., criminologist), ideally, takes no knowledge claim for granted, but instead relies on research methods to discover the truth. In the attempt to generate new knowledge, a researcher is skeptical of knowledge that is generated by the sources discussed in the prior section, and this skepticism leads to the questioning of conventional thinking. Through this process, existing knowledge claims are discredited, modified, or substantiated. Research methods provide the researcher with the tools necessary to test current knowledge and discover new knowledge.

Although knowledge developed through research methods is by no means perfect and infallible, it is definitely a more systematic, structured, precise, and evidence-based process than the knowledge sources previously discussed. However, researchers should not dismiss all knowledge from the prior sources discussed, because, as mentioned, these sources of knowledge are sometimes accurate and certainly have their place in the development of knowledge. Researchers should guard against an elitist mind-set in which all knowledge, unless it is research-based knowledge, is dismissed.

To further discuss the importance of research methods in the development of knowledge, this section will discuss myths about crime and criminal justice. Myths are beliefs that are based on emotion rather than rigorous analysis. Take the myth of the Halloween sadist previously discussed. Many believe that there are real examples of children being harmed by razor blades, poison, or other nefarious objects placed in Halloween candy. This belief has changed the practices of many parents on Halloween; not allowing their children to trick-or-treat in their neighborhood and forbidding them from going to the doors of strangers. After careful analysis by Best, there is not a single, known example of children being seriously injured or killed by contaminated candy given by strangers. The Halloween sadist is a myth but it is still perpetuated today, and as the definition states, it is a belief based upon emotion rather than rigorous analysis. People accept myths as accurate knowledge of reality when, in fact, the knowledge is false.

The power of research is the ability to dispel myths. If someone were to assess the research literature on a myth or do their own research, she would find that the knowledge based on the myth is wrong. Perceived reality is contradicted by the facts developed through research. But that does not mean that the myth still doesn’t exist. It is important to keep in mind that the perpetuation and acceptance of myths by the public, politicians, and criminal justice personnel has contributed to the failure of criminal justice practices and policies designed to reduce crime and improve the operations of the criminal justice system. In this section, a detailed example of a myth about crime, police, courts, and corrections will be presented to demonstrate how the myth has been dispelled through research. In addition, several additional myths about crime, police, courts, and corrections will be briefly presented.

The Health Benefits of Alcohol Consumption 21

The press release from Oregon State University is titled “Beer Compound Shows Potent Promise in Prostate Cancer Battle.” The press release leads to several newspaper articles throughout the country written on the preventative nature of drinking beer on prostate cancer development with titles such as “Beer Protects Your Prostate” and “Beer May Help Men Ward Off Prostate Cancer.” By the titles alone, this sounds great; one of the main ingredients in beer appears to thwart prostate cancer.

The study that generated these headlines was conducted by a group of researchers at Oregon State University using cultured cells with purified compounds in a laboratory setting. The research showed that xanthohumol, a compound found in hops, slowed the growth of prostate cancer cells and also the growth of cells that cause enlarged prostates. But you would have to drink more than 17 pints of beer to consume a medically effective dose of xanthohumol, which is almost a case of beer. In addition, although the research is promising, further study is necessary to determine xanthohumol’s true impact on prostate cancer.

These are the types of headlines that people pay attention to and want to believe as true, even if disproven by later research. People want to believe that there are health benefits to alcohol consumption. You have probably heard about the health benefits of drinking red wine, but here is something you should consider. Recently, the University of Connecticut released a statement describing an extensive research misconduct investigation involving a member of its faculty. The investigation was sparked by an anonymous allegation of research irregularities. The comprehensive report of the investigation, which totals approximately 60,000 pages, concludes that the professor is guilty of 145 counts of fabrication and falsification of data. The professor had gained international notoriety for his research into the beneficial properties of resveratrol, which is found in red wine, especially its impact on aging. Obviously, this throws his research conclusions, that red wine has a beneficial impact on the aging process, into question.

Myths about Crime—Drug Users Are Violent

The myth of drug users as violent offenders continues to be perpetuated by media accounts of violent drug users. The public sees drug users as violent offenders who commit violent crimes to get money for drugs or who commit violent crimes while under the intoxicating properties of drugs. The public also recognizes the violent nature of the drug business with gangs and cartels using violence to protect their turf. In May 2012, extensive media attention was given to the case of the Miami man who ate the face of a homeless man for an agonizing 18 minutes until police shot and killed the suspect. The police believed that the suspect was high on the street drug known as “bath salts.” This horrific case definitely leaves the image in the public’s mind about the relationship between violence and drug use.

In recent years, media reports have focused on the relationship between methamphetamine use and violence; before then it was crack cocaine use and violence. 32 However, media portrayals regarding the violent tendencies of drug users date back to the 1930s and the release of Reefer Madness. In 1985, Goldstein suggested that drugs and violence could be related in three different ways:

1. violence could be the direct result of drug ingestion;

2. violence could be a product of the instability of drug market activity; and

3. violence could be the consequence of people having a compulsive need for drugs or money for drugs. 33

So, what does the research show? Studies have found that homicides related to crack cocaine were usually the product of the instability of drug market activity (i.e., buying and selling drugs can be a violent activity) and rarely the result of drug ingestion. 34 After an extensive review of research studies on alcohol, drugs, and violence, Parker and Auerhahn concluded, “Despite a number of published statements to the contrary, we find no significant evidence suggesting that drug use is associated with violence. There is substantial evidence to suggest that alcohol use is significantly associated with violence of all kinds.” 35 The reality is not everyone who uses drugs becomes violent and users who do become violent do not do so every time they use drugs; therefore, the relationship between violence and drug use is a myth.

MYTHS ABOUT CRIME

Some additional myths about crime that research does not support include:

•Crime statistics accurately show what crimes are being committed and what crimes are most harmful. 22

•Most criminals—especially the dangerous ones—are mentally ill. 23

•White-collar crime is only about financial loss and does not hurt anyone. 24

•Serial murderers are middle-aged, white males. 25

•Criminals are significantly different from noncriminals. 26

•People are more likely to be a victim of violent crime committed by a stranger than by someone they know. 27

•Older adults are more likely to be victimized than people in any other age group. 28

•Sex offender registration protects the public from sexual predators. 29

•Juvenile crime rates are significantly increasing. 30

•Only the most violent juveniles are tried as adults. 31

Myths about Police—Female Police Officers Do Not Perform as Well as Males

Female police officers still face the myth that they cannot perform as well as male police officers. Throughout history, females have faced significant difficulties even becoming police officers. In the past, it was common for police agencies to require all police applicants to meet a minimum height requirement to be considered for employment. The minimum height requirement was 5′8″ for most agencies, which limited the ability of females to successfully meet the minimum standards to become a police officer. Even if women could meet the minimum height requirements, they were typically faced with a physical-abilities test that emphasized upper body strength (e.g., push-ups and bench presses). Women failed these tests more often than men, and thus were not eligible to be police officers. Minimum height requirements are no longer used in law enforcement, but the perception that female police officers are not as good as males still exists. Today, the myth that women cannot be effective police officers is based largely on the belief that the need to demonstrate superior physical strength is a daily, common occurrence in law enforcement along with the belief that police work is routinely dangerous, violent, and crime-related.

So, what does the research show? On occasion, it is useful for police officers to be able to overpower suspects by demonstrating superior physical strength, but those types of activities are rare in law enforcement. In addition, it is fairly rare for a police officer to have to deal with a dangerous and violent encounter or even an incident involving a crime. The Police Services Study conducted in the 1970s analyzed 26,418 calls for service in three metropolitan areas and found that only 19% of calls for service involve crime and only 2% of the total calls for service involve violent crime. 43 This research study was among the first to assess the types of calls for service received by police agencies.

Despite the belief that women do not make good police officers, consistent research findings show that women are extremely capable as police officers, and in some respects, outperform their male counterparts. 44 Research has demonstrated several advantages to the hiring, retention, and promotion of women in law enforcement. First, female officers are as competent as their male counterparts. Research does not show any consistent differences in how male and female patrol officers perform their duties. Second, female officers are less likely to use excessive force. Research has shown that female patrol officers are less likely to be involved in high-speed pursuits, incidents of deadly force, and the use of excessive force. Female officers are more capable at calming potentially violent situations through communication and also demonstrate heightened levels of caution. Third, female officers can help implement community-oriented policing. Studies have shown that female officers are more supportive of the community-policing philosophy than are their male counterparts. Fourth, female officers can improve law enforcement’s response to violence against women. Studies have shown that female officers are more patient and understanding in handling domestic violence calls, and female victims of domestic violence are more likely to provide positive evaluations of female officers than their male counterparts. 52

MYTHS ABOUT POLICE

Some additional myths about the police that research does not support include:

•Police target minorities for traffic stops and arrests. 36

•Most crimes are solved through forensic science. 37

•COMPSTAT reduces crime. 38

•Intensive law enforcement efforts at the street level will lead to the control of illicit drug use and abuse. 39

•Police work primarily entails responding to crimes in progress or crimes that have just occurred. 40

•Police presence reduces crime. 41

•Detectives are most responsible for solving crimes and arresting offenders. 42

Myths about Courts—The Death Penalty Is Administered Fairly

According to a recent Gallup poll, 52% of Americans say the death penalty is applied fairly in the United States, the lowest mark in almost 40 years. 53 The issue of fairness and the death penalty typically concerns whether the punishment is equally imposed on offenders who are equally deserving based on legal factors (i.e., similar offense, similar prior criminal history, similar aggravating circumstances, and similar mitigating circumstances). 54 Unfairness can be shown if similarly situated offenders are more or less likely to receive death sentences based on age, gender, and race.

So, what does the research show? First, has research shown that a defendant’s age influences his or her chances of being sentenced to death? A study of about 5,000 homicides, controlling for legally relevant variables, found that defendants over the age of 25 were more than twice as likely to receive the death penalty in comparison to those 25 years of age or younger. 55

Second, has research shown that a defendant’s gender influences his or her chance of being sentenced to death? Capital punishment is almost exclusively reserved for male defendants. On December 31, 2010, there were 3,158 prisoners under a sentence of death in the United States: 58 were women, or 1.8%. 56 However, women account for 10–12% of all murders in the United States. 57 One research study found that male defendants were 2.6 times more likely than females to receive a death sentence after controlling for legally relevant factors. 58

Third, has research shown that a defendant’s race influences his or her chance of being sentenced to death? Most of the research on the biased nature of the death penalty has focused on racial inequities in the sentence. Although some research has shown that a defendant’s race has an impact on the likelihood of receiving a death sentence, a significant amount of research has shown that the race of the victim has the most substantial impact on death sentences. The research evidence clearly shows that offenders who murder white victims are more likely to receive a death sentence than offenders who murder black victims. 59 When assessing the race of both the victim and offender, the composition most likely to receive the death penalty is when a black offender murders a white victim. 60

MYTHS ABOUT COURTS

Some additional myths about courts that research does not support include:

•Many criminals escape justice because of the exclusionary rule. 45

•Subjecting juvenile offenders to harsh punishments can reduce crime committed by juveniles. 46

•Public opinion is overwhelmingly in favor of imprisonment and harsh punishment for offenders. 47

•The death penalty brings closure and a sense of justice to the family and friends of murder victims. 48

•Insanity is a common verdict in criminal courts in the United States. 49

•Eyewitness identification is reliable evidence. 50

•Most people who commit crimes based on hatred, bias, or discrimination face hate crime charges and longer sentencing. 51

Myths about Corrections—Imprisonment Is the Most Severe Form of Punishment

It seems clear that besides the death penalty, the most severe punishment available in our criminal justice system is to lock up offenders in prison. On a continuum, it is perceived that sentence severity increases as one moves from fines, to probation, to intermediate sanctions such as boot camps, and finally, to incarceration in prison. The public and politicians support this perception as well.

So, what does the research show? What do criminals think is the most severe form of punishment? A growing body of research has assessed how convicted offenders perceive and experience the severity of sentences in our criminal justice system. 61 Research suggests that alternatives to incarceration in prison (i.e., probation and intermediate sanctions) are perceived by many offenders as more severe due to a greater risk of program failure (e.g., probation revocation). In comparison, serving prison time is easier. 62  

For example, one study found that about one-third of nonviolent offenders given the option of participating in an Intensive Supervision Probation (ISP) program, chose prison instead because the prospects of working every day and submitting to random drug tests was more punitive than serving time in prison. 73 Prisoners also stated that they would likely be caught violating probation conditions (i.e., high risk of program failure) and be sent to prison anyway. 74 In another research study involving survey responses from 415 inmates serving a brief prison sentence for a nonviolent crime, prison was considered the eighth most severe sanction, with only community service and probation seen as less punitive. Electronic monitoring (seventh), intensive supervision probation (sixth), halfway house (fifth), intermittent incarceration (fourth), day reporting (third), county jail (second), and boot camp (first) were all rated by inmates as more severe sanctions than prison. 75

MYTHS ABOUT CORRECTIONS

Some additional myths about corrections that research does not support include:

•Punishing criminals reduces crime. 63

•Prisons are too lenient in their day-to-day operations (prisons as country clubs). 64

•Prisons can be self-supporting if only prisoners were forced to work. 65

•Private prisons are more cost effective than state-run prisons. 66

•Focus of community corrections is rehabilitation rather than punishment. 67

•Correctional rehabilitation does not work. 68

•Drug offenders are treated leniently by the criminal justice system. 69

•Most death row inmates will be executed eventually. 70

•If correctional sanctions are severe enough, people will think twice about committing crimes. 71

•Sexual violence against and exploitation of inmates of the same gender are primarily the result of lack of heterosexual opportunities. 72

What is Research and Why is It Important to be an Informed Consumer of Research?

We probably should have started the chapter with the question “What is research?” but we wanted to initially lay a foundation for the question with a discussion of the problems with how knowledge is developed and the power of research in discovering the truth. Research methods are tools that allow criminology and criminal justice researchers to systematically study crime and the criminal justice system. The study of research methods is the study of the basic rules, appropriate techniques, and relevant procedures for conducting research. Research methods provide the tools necessary to approach issues in criminal justice from a rigorous standpoint and challenge opinions based solely on nonscientific observations and experiences. Similarly, research is the scientific investigation of an issue, problem, or subject utilizing research methods. Research is a means of knowledge development that is designed to assist in discovering answers to research questions and leads to the creation of new questions.

How Is Knowledge Development through Research Different?

Previously, sources of knowledge development were discussed, including authority, tradition, common sense, personal experience, and media portrayals. The problems generated by each knowledge source were also discussed. Research is another source of knowledge development, but it is different than those previously discussed in several ways. First, research relies on logical and systematic methods and observations to answer questions. Researchers use systematic, well-established research practices to seek answers to their questions. The methods and observations are completed in such a way that others can inspect and assess the methods and observations and offer feedback and criticism. Researchers develop, refine, and report their understanding of crime and the criminal justice system more systematically than the public does through casual observation. Those who conduct scientific research employ much more rigorous methods to gather the information/knowledge they are seeking.

Second, in order to prove that a research finding is correct, a researcher must be able to replicate the finding using the same methods. Only through replication can we have confidence in our original finding. For researchers, it may be important to replicate findings many times over so that we are assured our original finding was not a coincidence or chance occurrence. The Minneapolis Domestic Violence Experiment is an example of this and will be discussed in detail in Chapter 5. In the experiment, the researchers found that arrests for domestic violence lead to fewer repeat incidences in comparison to separation of the people involved and mediation. Five replication studies were conducted and none were able to replicate the findings in the Minneapolis study. In fact, three of the replications found that those arrested for domestic violence had higher levels of continued domestic violence, so arrest did not have the deterrent effect found in the Minneapolis study.

Third, research is objective. Objectivity indicates a neutral and nonbiased perspective when conducting research. Although there are examples to the contrary, the researcher should not have a vested interest in what findings are discovered from the research. The researcher is expected to remain objective and report the findings of the study regardless of whether the findings support their personal opinion or agenda. In addition, research ensures objectivity by allowing others to examine and be critical of the methodology, findings, and results of research studies.

It should be clear that using research methods to answer questions about crime and the criminal justice system will greatly reduce the errors in the development of knowledge previously discussed. For example, research methods reduces the likelihood of overgeneralization by using systematic procedures for selecting individuals or groups to study that are representative of the individuals or groups that we wish to generalize. This is the topic of Chapter 3, which covers sampling procedures. In addition, research methods reduces the risk of selective observation by requiring that we measure and observe our research subjects systematically.

Being an Informed Consumer of Research

Criminal justice and criminological research is important for several reasons. First, it can provide better and more objective information. Second, it can promote better decision-making. Today, more than ever, we live in a world driven by data and in which there is an increasing dependence on the assessment of data when making decisions. As well as possible, research ensures that our decisions are based on data and not on an arbitrary or personal basis. Third, it allows for the objective assessment of programs. Fourth, it has often been the source of innovation within criminal justice agencies. Fifth, it can be directly relevant to criminal justice practice and have a significant impact on criminal justice operations.

Before we apply research results to practices in the criminal justice system, and before we even accept those research results as reasonable, we need to be able to know whether or not they are worthwhile. In other words, should we believe the results of the study? Research has its own limitations, so we need to evaluate research results and the methods used to produce them, and we do so through critical evaluation. Critical evaluation involves identifying both positive and negative aspects of the research study—both the good and the bad. Critical evaluation involves comparing the methodology used in the research with the standards established in research methods.

Through critical evaluation, consumers of research break studies down into their essential elements. What are the research questions and hypotheses? What were the independent and dependent variables? What research design was used? Was probability sampling used? What data-gathering procedures were employed? What type of data analysis was conducted and what conclusions were made? These are some of the questions that are asked by informed consumers of research. The evaluation of research ranges from the manner in which one obtains an idea to the ways in which one writes about the research results, and understanding each step in the research process is useful in our attempts to consume research conducted by others. Located between these two activities are issues concerning ethics, sampling, research design, data analyses, and interpretations.

The research design and procedures are typically the most critically evaluated aspects of research and will likewise receive the greatest amount of attention in this text. Informed consumers of research don’t just take the results of a research study at face value because the study is in an academic journal or written by someone with a Ph.D. Instead, informed consumers critically evaluate research. Taking what is learned throughout this text, critical evaluation of research is covered in Chapter 8, and upon completing this text, it is hoped that you will be an informed consumer of research and will put your research knowledge to use throughout your career.

Although many students will never undertake their own research, all will be governed by policies based upon research and exposed to research findings in their chosen professional positions. Most government agencies, including the criminal justice system, as well as private industry, routinely rely on data analysis. Criminal justice students employed with these agencies will be challenged if not prepared for quantitative tasks. Unfortunately, it is not unusual to find students as well as professionals in criminal justice who are unable to fully understand research reports and journal articles in their own field.

Beyond our criminal justice careers, we are all exposed to and use research to help us understand issues and to make personal decisions. For example, we know that cigarette smoking causes lung cancer and has other significant health impacts, so we don’t smoke. Your doctor tells you that your cholesterol is too high and you need to limit your red meat intake because research shows that consumption of red meat raises cholesterol; so, you quit eating red meat. That is why not all the examples in this text are criminal justice research examples. Some come from the medical field while others come from psychology and other disciplines. This is to remind you that you are probably exposed to much more research than you thought on day one of this class.

Overall, knowledge of research methods will allow you to more appropriately consider and consume information that is important to your career in criminal justice. It will help you better understand the process of asking and answering a question systematically and be a better consumer of the kind of information that you really need to be the best criminal justice professional you can. Once familiar with research methods, your anxiety about reviewing technical reports and research findings can be minimized. As discussed in the next section, research methods involve a process and once you understand the process, you can apply your knowledge to any research study, even those in other disciplines.

The Research Process

One of the nice things about studying research methods is it is about learning a process. Research methods can be seen as a sequential process with the first step being followed by the second step, and so on. There are certainly times when the order of the steps may be modified, but researchers typically follow the same process for each research study they complete regardless of the research topic (as depicted in Figure 2.1 in Chapter 2). Very simply, a research problem or question is identified, and a methodology is selected, developed, and implemented to answer the research question. This sequential process is one of the advantages of understanding research methods, because once you understand the process, you can apply that process to any research question that interests you. In addition, research methods are the same across disciplines. So, sampling is the same in business as it is in health education and as it is in criminal justice. Certainly the use of a particular method will be more common in one discipline in comparison to another, but the protocol for implementing the method to complete the research study is the same. For example, field research (discussed in Chapter 6) is used much more frequently in anthropology than in criminal justice. However, the research protocol to implement field research is the same whether you are studying an indigenous Indian tribe in South America in anthropology or a group of heroin users in St. Louis in criminal justice.

Some authors have presented the research process as a wheel or circle, with no specific beginning or end. Typically, the research process begins with the selection of a research problem and the development of research questions or hypotheses (discussed further in Chapter 2). It is common for the results of previous research to generate new research questions and hypotheses for the researcher. This suggests that research is cyclical, a vibrant and continuous process. When a research study answers one question, the result is often the generation of additional questions, which plunges the researcher right back into the research process to complete additional research to answer these new questions.

In this section, a brief overview of the research process will be presented. The chapters that follow address various aspects of the research process, but it is critical that you keep in mind the overall research process as you read this book, which is why is it presented here. Although you will probably not be expected to conduct a research study on your own, it is important for an educated consumer of research to understand the steps in the research process. The steps are presented in chronological order and appear neatly ordered. In practice, the researcher can go back and forth between the steps in the research process.

Step 1: Select a Topic and Conduct a Literature Review

The first step in the research process is typically the identification of a problem or topic that the researcher is interested in studying. Research topics can arise from a wide variety of sources, including the findings of a current study, a question that a criminal justice agency needs to have answered, or the result of intellectual curiosity. Once the researcher has identified a particular problem or topic, the researcher assesses the current state of the literature related to the problem or topic. The researcher will often spend a considerable amount of time in determining what the existing literature has to say about the topic. Has the topic already been studied to the point that the questions in which the researcher is interested have been sufficiently answered? If so, can the researcher approach the subject from a previously unexamined perspective? Many times, research topics have been previously explored but not brought to completion. If this is the case, it is certainly reasonable to examine the topic again. It is even appropriate to replicate a previous study to determine whether the findings reported in the prior research continue to be true in different settings with different participants. This step in the research process is also discussed in Chapter 2.

Step 2: Develop a Research Question

After a topic has been identified and a comprehensive literature review has been completed on the topic, the next step is the development of a research question or questions. The research question marks the beginning of your research study and is critical to the remaining steps in the research process. The research question determines the research plan and methodology that will be employed in the study, the data that will be collected, and the data analysis that will be performed. Basically, the remaining steps in the process are completed in order to answer the research question or questions established in this step. The development of research questions is discussed in more detail in Chapter 2.

Step 3: Develop a Hypothesis

After the research questions have been established, the next step is the formulation of hypotheses, which are statements about the expected relationship between two variables. For example, a hypothesis may state that there is no relationship between heavy metal music preference and violent delinquency. The two variables stated in the hypothesis are music preference and violent delinquency. Hypothesis development is discussed in more detail in Chapter 2.

Step 4: Operationalize Concepts

Operationalization involves the process of giving the concepts in your study a working definition and determining how each concept in your study will be measured. For example, in Step 3, the variables were music preference and violent delinquency. The process of operationalization involves determining how music preference and violent delinquency will be measured. Operationalization is further discussed in Chapter 2.

Step 5: Develop the Research Plan and Methodology

The next step is to develop the methodology that will be employed to answer the research questions and test the hypotheses. The research methodology is the blueprint for the study, which outlines how the research is to be conducted. The research questions will determine the appropriate methodology for the study. The research design selected should be driven by the research questions asked. In other words, the research questions dictate the methods used to answer them. The methodology is basically a research plan on how the research questions will be answered and will detail:

1. What group, subjects, or population will be studied and selected? Sampling will be discussed in Chapter 3.

2 . What research design will be used to collect data to answer the research questions? Various research designs will be covered in Chapters 4–7.

You need to have familiarity with all research designs so that you can become an educated consumer of research. A survey cannot answer all research questions, so knowing a lot about surveys but not other research designs will not serve you well as you assess research studies. There are several common designs used in criminal justice and criminology research. Brief descriptions of several common research designs are presented below, but each is discussed in detail in later chapters.

Survey research is one of the most common research designs employed in criminal justice research. It obtains data directly from research participants by asking them questions and is often conducted through self-administered questionnaires and personal interviews. For example, a professor might have her students complete a survey during class to understand the relationship between drug use and self-esteem. Survey research is discussed in Chapter 4.

Experimental designs are used when researchers are interested in determining whether a program, policy, practice, or intervention is effective. For example, a researcher may use an experimental design to determine if boot camps are effective at reducing juvenile delinquency. Experimental design is discussed in Chapter 5.

Field research involves researchers studying individuals or groups of individuals in their natural environment. The researcher is observing closely or acting as part of the group under study and is able to describe in depth not only the subject’s behaviors, but also consider the motivations that drive those behaviors. For example, if a researcher wanted to learn more about gangs and their activities, he may “hang out” with a gang in order to observe their behavior. Field research is discussed in Chapter 6.

A case study is an in-depth analysis of one or a few illustrative cases. This design allows the story behind an individual, a particular offender, to be told and then information from cases studies can be extrapolated to a larger group. Often these studies require the review and analysis of documents such as police reports and court records and interviews with the offender and others. For example, a researcher may explore the life history of a serial killer to try and understand why the offender killed. Case studies are discussed in Chapter 6.

Secondary data analysis occurs when researchers obtain and reanalyze data that was originally collected for a different purpose. This can include reanalyzing data collected from a prior research study, using criminal justice agency records to answer a research question, or historical research. For example, a researcher using secondary data analysis may analyze inmate files from a nearby prison to understand the relationship between custody level assignment and disciplinary violations inside prison. Secondary data analysis is discussed in Chapter 7.

Content analysis requires the assessment of content contained in mass communication outlets such as newspapers, television, magazines, and the like. In this research design, documents, publications, or presentations are reviewed and analyzed. For example, a researcher utilizing content analysis might review true crime books involving murder to see how the characteristics of the offender and victim in the true crime books match reality as depicted in the FBI’s Supplemental Homicide Reports. Content analysis is discussed in Chapter 7.

Despite the options these designs offer, other research designs are available and will be discussed later in the text. Ultimately, the design used will depend on the nature of the study and the research questions asked.

Step 6: Execute the Research Plan and Collect Data

The next step in the research process is the collection of the data based on the research design developed. For example, if a survey is developed to study the relationship between gang membership and violent delinquency, the distribution and collection of surveys from a group of high school students would occur in this step. Data collection is discussed in several chapters throughout this text.

Step 7: Analyze Data

After the data have been collected, the next phase in the research process involves analyzing the data through various and appropriate statistical techniques. The most common means for data analysis today is through the use of a computer and statistically oriented software. Data analysis and statistics are discussed in Chapter 9.

Step 8: Report Findings, Results, and Limitations

Reporting and interpreting the results of the study make up the final step in the research process. The findings and results of the study can be communicated through reports, journals, books, or computer presentations. At this step, the results are reported and the research questions are answered. In addition, an assessment is made regarding the support or lack of support for the hypotheses tested. It is also at this stage that the researcher can pose additional research questions that may now need to be answered as a result of the research study. In addition, the limitations of the study, as well as the impact those limitations may have on the results of the study, will be described by the researcher. All research has limitations, so it is incumbent on the researcher to identify those limitations for the reader. The process of assessing the quality of research will be discussed in Chapter 8.

Research in Action: Impacting Criminal Justice Operations

Research in the criminal justice system has had significant impacts on its operations. The following sections provide an example of research that has significantly impacted each of the three main components of the criminal justice system: police, courts, and corrections. The purpose of this section is to demonstrate that research has aided the positive development and progression of the criminal justice system.

Police Research Example 76

The efforts of criminal justice researchers in policing have been important and have created the initial and critical foundation necessary for the further development of effective and productive law enforcement. One seminal study asked: How important is it for the police to respond quickly when a citizen calls? The importance of rapid response was conveyed in a 1973 National Commission on Productivity Report despite the fact that there was very little empirical evidence upon which to base this assumption. In fact, the Commission stated “there is no definitive relationship between response time and deterrence, but professional judgment and logic do suggest that the two are related in a strong enough manner to make more rapid response important.” 77 Basically the Commission members were stating that we don’t have any research evidence that response times are important, but we “know” that they are. Police departments allocated substantial resources to the patrol function and deployed officers in an effort to improve response time through the use of the 9-1-1 telephone number, computer-assisted dispatch, and beat assignment systems. Officers were typically assigned to a patrol beat. When the officers were not answering calls for service, they remained in their assigned beats so they could immediately respond to an emergency.

The data for the project were collected as part of a larger experiment on preventive patrol carried out in Kansas City, Missouri, between October 1972 and September 1973. 78 To determine the impact of response time, researchers speculated that the following variables would be influenced by response time: 1) the outcome of the response, 2) citizen satisfaction with response time, and 3) citizen satisfaction with the responding officer. Several data sources were used in the study. First, surveys were completed after all citizen-initiated calls (excluding automobile accidents) that involved contact with a police officer. The survey instrument consisted of questions to assess the length of time to respond to a call and the outcome of the call (i.e., arrest). Over 1,100 surveys were completed. Second, a follow-up survey was mailed to citizens whom the police had contacted during their response. These surveys asked questions to assess citizen satisfaction with response time and outcome. Over 425 of these surveys were returned.

The data collected during the study showed that response time did not determine whether or not the police made an arrest or recovered stolen property. This was the most surprising finding from the study because it challenged one of the basic underlying principles of police patrol. Researchers attributed the lack of significance to the fact that most citizens waited before calling the police. Rapid response simply did not matter in situations where citizens delayed in reporting the crime.

Rapid response time was not only believed to be important in determining the outcome of a response (i.e., more likely to lead to an arrest), it was also considered an important predictor of citizen satisfaction. Data from the study showed that when the police arrived sooner than expected, citizens were more satisfied with response time. However, subsequent research has shown that citizens are also satisfied with a delayed response as long as the dispatcher sets a reasonable expectation for when the patrol officer will arrive. Response time was also the best predictor of how satisfied a citizen was with the responding officer. It was further revealed that citizens became dissatisfied with the police when they were not informed of the outcome (i.e., someone was arrested). Again, these findings indicate the need for dispatchers and patrol officers to communicate with complainants regarding when they should expect an officer to arrive and the outcome of the call.

Based on the results of the response time study, the researchers concluded that rapid response was not as important as police administrators had thought. Response time was not related to an officer’s ability to make an arrest or recover stolen property. Results from the response time study challenged traditional beliefs about the allocation of patrol in our communities. Based on tradition knowledge, as previously discussed, rapidly responding to calls for service is what the police had always done since they started using patrol vehicles. In addition, common sense, as previously discussed, played a role in the practice of rapid response to calls for service; it just made sense that if a patrol officer arrives sooner, she will be more likely to make an arrest.

Prior to the research, police departments operated under the assumption that rapid response was a crucial factor in the ability of an officer to solve a crime and an important predictor of citizen satisfaction. In response to the research on rapid response, many police departments changed the way they responded to calls for service. Many departments adopted a differential police response approach. Differential police response protocols allow police departments to prioritize calls and rapidly dispatch an officer only when an immediate response is needed (i.e., crimes in progress). For crimes in progress, rapid response is critical and may reduce the injuries sustained by the victim as well, but these emergency calls usually account for less than 2% of all 9-1-1 calls for police service. For nonemergency calls, an officer is either dispatched at a later time when the officer is available or a report is taken over the phone or through some other means. Differential police response has been shown to save departments money and give patrol officers more time to engage in community-oriented and proactive policing activities. The benefits for a department are not at the expense of the public. In fact, a study by Robert Worden found a high degree of citizen satisfaction with differential police response. 79

Courts Research Example 80

Research on the courts component of the criminal justice system, while far from complete, has produced direct effects on the operations of the criminal justice system. The study reviewed in this section asked the following research question: Are jurors able to understand different legal rules for establishing a defendant’s criminal responsibility? The study described below explored the issue of criminal responsibility as it applies to the insanity defense in the United States. For several years, the M ’ Naghten rule was the legal rule applied in all courts of the United States. Under M ’ Naghten, criminal responsibility was absent when the offender did not understand the nature of his actions due to failure to distinguish “right” from “wrong.” This is known as the “right/wrong test” for criminal responsibility. The case of Durham v. United States was heard in the U.S. Court of Appeals for the District of Columbia and offered an alternative test for criminal responsibility and insanity. The legal rule emerging from Durham was that criminal responsibility was absent if the offense was a product of mental disease or defect. This ruling provided psychiatrists with a more important role at trial because of the requirement that the behavior be linked to a mental disorder that only a psychiatrist could officially determine.

At the time of Simon’s 1967 study, most courts across the country still followed the M ’ Naghten rule. Questions arose, however, regarding whether juries differed in their understanding of M ’ Naghten versus Durham and, in turn, whether this resulted in differences in their ability to make informed decisions regarding criminal responsibility in cases involving the insanity defense. The study was designed to determine the effect of different legal rules on jurors’ decision-making in cases where the defense was insanity. There was a question of whether there was a difference between the rules to the extent that jurors understood each rule and could capably apply it.

Simon conducted an experimental study on jury deliberations in cases where the only defense was insanity. 81 Utilizing a mock jury approach, Simon took the transcripts of two actual trials with one reflecting the use of the M ’ Naghten rule and the other the Durham rule. Both cases were renamed and the transcripts were edited to constitute a trial of 60–90 minutes in length. These edited transcripts were then recorded, with University of Chicago Law School faculty as the attorneys, judges, and witnesses involved in each case. Groups of 12 jurors listened to each trial with instruction provided at the end regarding the particular rule of law ( M ’ Naghten or Durham) for determining criminal responsibility. Each juror submitted a written statement with his or her initial decision on the case before jury deliberations, and the juries’ final decisions after deliberation were also reported.

Simon found significant differences in the verdicts across the two groups ( M ’ Naghten rule applied and Durham rule applied) even when the case was the same. For the M ’ Naghten version of the case, the psychiatrists stated that the defendant was mentally ill yet knew right from wrong during the crime. These statements/instructions should have led to a guilty verdict on the part of the mock jury. As expected, the M ’ Naghten juries delivered guilty verdicts in 19 of the 20 trials, with one hung jury. For the Durham version of the case, the psychiatrists stated that the crime resulted from the defendant’s mental illness, which should have lead to acquittal. However, the defendant was acquitted in only five of the 26 Durham trials. Twenty-six groups of 12 jurors were exposed to the Durham version of the trial and the case was the same each time. Simon interpreted these results as suggesting that jurors were unambiguous in their interpretations and applications of M ’ Naghten (due to the consistency in guilty verdicts), but they were less clear on the elements of Durham and how to apply it (reflected by the mix of guilty, not guilty, and hung verdicts). 82

After Simon’s study, most states rejected the Durham test. Recall her finding that the Durham rule produced inconsistent verdicts. She interpreted this finding as Durham being no better than providing no guidance to jurors on how to decide the issue of insanity. The observation helped to fuel arguments against the use of Durham, which, in turn, contributed to its demise as a legal rule. Today, only New Hampshire uses a version of the Durham rule in insanity cases.

WHAT RESEARCH SHOWS: IMPACTING CRIMINAL JUSTICE OPERATIONS

The Punishment Cost of Being Young, Black, and Male

Steffensmeier, Ulmer, and Kramer 83 hypothesized that African Americans overall were not likely to be treated more harshly than white defendants by the courts because it was only particular subgroups of minority defendants that fit with court actors’ stereotypes of “more dangerous” offenders. In particular, they argued that younger African American males not only fulfilled this stereotype more than any other age, race, and gender combination, they were also more likely to be perceived by judges as being able to handle incarceration better than other subgroups.

In order to test their hypotheses, the researchers examined sentencing data from Pennsylvania spanning four years (1989–1992). Almost 139,000 cases were examined. The sentences they examined included whether a convicted defendant was incarcerated in prison or jail, and the length of incarceration in prison or jail. The researchers found that offense severity and prior record were the most important predictors of whether a convicted defendant was incarcerated and the length of incarceration. The authors found that the highest likelihood of incarceration and the longest sentences for males were distributed to African Americans aged 18–29 years. Their analysis of females revealed that white females were much less likely than African American females to be incarcerated, regardless of the age group examined. Taken altogether, the analysis revealed that African American males aged 18–29 years maintained the highest odds of incarceration and the longest sentences relative to any other race, sex, and age group.

Overall, this research showed that judges focused primarily on legal factors (offense severity and prior record) when determining the sentences of convicted offenders. These are the factors we expect judges to consider when making sentencing decisions. However, the research also found that judges base their decisions in part on extralegal factors, particularly the interaction of a defendant’s age, race, and gender. This research expanded our knowledge beyond the impact of singular factors on sentencing to expose the interaction effects of several variables (race, gender, and age). Court personnel are aware of these interaction effects based on this study, and others that followed, as well as their personal experiences in the criminal justice system. Identification and recognition of inequities in our justice system (in this case that young, African American males are punished more severely in our justice system) is the first step in mitigating this inequity.

Corrections Research Example 84

Although the research in corrections is far from complete, it has contributed greatly to the development of innovative programs and the professional development of correctional personnel. The contributions of academic and policy-oriented research can be seen across the whole range of correctional functions from pretrial services through probation, institutional corrections, and parole.

Rehabilitation remained the goal of our correctional system until the early 1970s, when the efficacy of rehabilitation was questioned. Violent crime was on the rise, and many politicians placed the blame on the criminal justice system. Some believed the system was too lenient on offenders. Interest in researching the effectiveness of correctional treatment remained low until 1974 when an article written by Robert Martinson and published in Public Interest titled “What Works? Questions and Answers about Prison Reform” generated enormous political and public attention to the effectiveness of correctional treatment. 85

Over a six-month period, Martinson and his colleagues reviewed all of the existing literature on correctional treatment published in English from 1945 to 1967. Each of the articles was evaluated according to traditional standards of social science research. Only studies that utilized an experimental design, included a sufficient sample size, and could be replicated were selected for review. A total of 231 studies examining a variety of different types of treatment were chosen, including educational and vocational training, individual and group counseling, therapeutic milieus, medical treatment, differences in length and type of incarceration, and community corrections. All of the treatment studies included at least one measure of offender recidivism, such as whether or not offenders were rearrested or violated their parole. The recidivism measures were used to examine the success or failure of a program in terms of reducing crime.

After reviewing all 231 studies, Martinson reported that there was no consistent evidence that correctional treatment reduced recidivism. Specifically, he wrote, “with few and isolated exceptions, the rehabilitative efforts that have been reported so far have had no appreciable effect on recidivism.” 86 Martinson further indicated that the lack of empirical support for correctional treatment could be a consequence of poorly implemented programs. If the quality of the programs were improved, the results may have proved more favorable, but this conclusion was for the most part ignored by the media and policy-makers.

Martinson’s report became commonly referred to as “nothing works” and was subsequently used as the definitive study detailing the failures of rehabilitation. The article had implications beyond questioning whether or not specific types of correctional treatment reduced recidivism. The entire philosophy of rehabilitation was now in doubt because of Martinson’s conclusion that “our present strategies … cannot overcome, or even appreciably reduce, the powerful tendencies of offenders to continue in criminal behavior.” 87

Martinson’s article provided policy makers the evidence to justify spending cuts on rehabilitative programs. Furthermore, it allowed politicians to respond to growing concerns about crime with punitive, get-tough strategies. States began implementing strict mandatory sentences that resulted in more criminals being sent to prison and for longer periods of time. Over the next several years, Martinson’s article was used over and over to support abandoning efforts to treat offenders until rehabilitation became virtually nonexistent in our correctional system.

Chapter Summary

This chapter began with a discussion of sources of knowledge development and the problems with each. To depict the importance of research methods in knowledge development, myths about crime and the criminal justice system were reviewed along with research studies that have dispelled myths. As the introductory chapter in this text, this chapter also provided an overview of the steps in the research process from selecting a topic and conducting a literature review at the beginning of a research study to reporting findings, results, and limitations at the end of the study. Examples of actual research studies in the areas of police, courts, and corrections were also provided in this chapter to demonstrate the research process in action and to illustrate how research has significantly impacted practices within the criminal justice system. In addition, this chapter demonstrated the critical importance of becoming an informed consumer of research in both your personal and professional lives.

Critical Thinking Questions

1. What are the primary sources of knowledge development, and what are the problems with each?

2. How is knowledge developed through research methods different from other sources of knowledge?

3. What myths about crime and criminal justice have been dispelled through research? Give an example of a research study that dispelled a myth.

4. Why is it important to be an informed consumer of research?

5. What are the steps in the research process, and what activities occur at each step?

authority knowledge: Knowledge developed when we accept something as being correct and true just because someone in a position of authority says it is true

case study: An in-depth analysis of one or a few illustrative cases

common sense knowledge: Knowledge developed when the information “just makes sense”

content analysis: A method requiring the analyzing of content contained in mass communication outlets such as newspapers, television, magazines, and the like

CSI Effect: Due to the unrealistic portrayal of the role of forensic science in solving criminal cases in television shows, jurors are more likely to vote to acquit a defendant when the expected sophisticated forensic evidence is not presented

differential police response: Methods that allow police departments to prioritize calls and rapidly dispatch an officer only when an immediate response is needed (i.e., crimes in progress)

experimental designs: Used when researchers are interested in determining whether a program, policy, practice, or intervention is effective

field research: Research that involves researchers studying individuals or groups of individuals in their natural environment

Halloween sadism: The practice of giving contaminated treats to children during trick or treating

hypotheses: Statements about the expected relationship between two concepts

illogical reasoning: Occurs when someone jumps to premature conclusions or presents an argument that is based on invalid assumptions

myths: Beliefs that are based on emotion rather than rigorous analysis

operationalization: The process of giving a concept a working definition; determining how each concept in your study will be measured

overgeneralization: Occurs when people conclude that what they have observed in one or a few cases is true for all cases

personal experience knowledge: Knowledge developed through actual experiences

research: The scientific investigation of an issue, problem, or subject utilizing research methods

research methods: The tools that allow criminology and criminal justice researchers to systematically study crime and the criminal justice system and include the basic rules, appropriate techniques, and relevant procedures for conducting research

resistance to change: The reluctance to change our beliefs in light of new, accurate, and valid information to the contrary

secondary data analysis: Occurs when researchers obtain and reanalyze data that were originally collected for a different purpose

selective observation: Choosing, either consciously or unconsciously, to pay attention to and remember events that support our personal preferences and beliefs

survey research: Obtaining data directly from research participants by asking them questions, often conducted through self-administered questionnaires and personal interviews

tradition knowledge: Knowledge developed when we accept something as true because that is the way things have always been, so it must be right

variables: Concepts that have been given a working definition and can take on different values

1 Briggs, Lisa T., Stephen E. Brown, Robert B. Gardner, and Robert L. Davidson. (2009). “D.RA.MA: An extended conceptualization of student anxiety in criminal justice research methods courses.” Journal of Criminal Justice Education 20 (3), 217–226.

2 Betz, N. E. (1978). “Prevalence, distribution, and correlates of math anxiety in college students. Journal of Counseling Psychology 25 (5), 441–448.

3 Briggs, et al., 2009, p. 221.

4 Ibid, p. 221.

5 Ibid, p. 221.

6 Kappeler, Victor E., and Gary W. Potter. (2005). The mythology of crime and criminal justice. Prospect Heights, IL: Waveland.

7 Tennessee v. Gamer, 471 U.S. 1 (1985).

8 Lombroso-Ferrero, Gina. (1911). Criminal man, according to the classification of Cesare Lombroso. New York: Putnam.

9 This study was included in Amy B. Thistlethwaite and John D. Wooldredge. (2010). Forty studies that changed criminal justice: Explorations into the history of criminal justice research. Upper Saddle River, NJ: Prentice Hall.

10 Petersilia, J., S. Turner, J. Kahan, and J. Peterson. (1985). Granting felons probation: Public risks and alternatives. Santa Monica, CA: Rand.

11 Vito, G. (1986). “Felony probation and recidivism: Replication and response.” Federal Probation 50, 17–25.

12 Conrad, J. (1985). “Research and development in corrections.” Federal Probation 49, 69–71.

13 Finckenauer, James O. (1982). Scared straight! and the panacea phenomenon. Englewood Cliffs, NJ: Prentice Hall.

14 Yarborough, J.C. (1979). Evaluation of JOLT (Juvenile Offenders Learn Truth) as a deterrence program. Lansing, MI: Michigan Department of Corrections.

15 Petrosino, Anthony, Carolyn Turpin-Petrosino, and James O. Finckenauer. (2000). “Well-meaning programs can have harmful effects! Lessons from experiments of programs such as Scared Straight,” Crime & Delinquency 46, 354–379.

16 Robertson, Jordan. “I’m being punished for living right”: Background check system is haunted by errors. December 20, 2011. http://finance.yahoo.com/news /ap-impact-criminal-past-isnt-182335059.html. Retrieved on December 29, 2011.

17 Shelton, D. E. (2008). “The ‘CSI Effect’: Does it really exist?” NIJ Journal 259 [NCJ 221501].

18 Best, Joel. (2011). “Halloween sadism: The evidence.” http://dspace.udel.edu:8080/dspace/bitstream/handle/ 19716/726/Halloween%20sadism.revised%20thru%20201l.pdf?sequence=6. Retrieved on May 7, 2012.

19 Best, Joel. (1985, November). “The myth of the Halloween sadist. Psychology Today 19 (11), p. 14.

21 “Beer compound shows potent promise in prostate cancer battle.” Press release from Oregon State University May 30, 2006. http://oregonstate.edu/ua/ncs/archives/2006/ may/beer-compound-shows-potent-promise-prostate-cancer-battle. Retrieved on January 6, 2012; Colgate, Emily C., Cristobal L. Miranda, Jan F. Stevens, Tammy M. Bray, and Emily Ho. (2007). “Xanthohumol, a prenylflavonoid derived from hops induces apoptosis and inhibits NF-kappaB activation in prostate epithelial cells,” Cancer Letters 246, 201–209; “Health benefits of red wine exaggerated” http://health.yahoo.net/articles /nutrition/health-benefits-red-wine-exaggerated. Retrieved on January 14, 2012; “Scientific journals notified following research misconduct investigation.” January 11, 2012. http://today.uconn.edu/blog/2012/01/scientific-journals -notified-following-research-misconduct-investigation/. Retrieved on January 14, 2012.

22 Pepinsky, Hal. “The myth that crime and criminality can be measured.” 3–11 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

23 Bullock, Jennifer L., and Bruce A. Arrigo. “The myth that mental illness causes crime.” 12–19 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

24 Friedrichs, David O. “The myth that white-collar crime is only about financial loss.” 20–28 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

25 Kuhns III, Joseph B., and Charisse T. M. Coston. “The myth that serial murderers are disproportionately white males.” 37–44 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

26 Longmire, Dennis R., Jacqueline Buffington-Vollum, and Scott Vollum. “The myth of positive differentiation in the classification of dangerous offenders.” 123–131 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

27 Masters, Ruth E., Lori Beth Way, Phyllis B. Gerstenfeld, Bernadette T. Muscat, Michael Hooper, John P. J. Dussich, Lester Pincu, and Candice A. Skrapec. (2013). CJ realities and challenges, 2nd ed. New York: McGraw-Hill.

32 Brownstein, Henry H. “The myth of drug users as violent offenders.” 45–53 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

33 Goldstein, P. (1985). “The drugs/violence nexus: A tripartite conceptual framework.” Journal of Drug Issues 15, 493–506.

34 Goldstein, P, H. Brownstein, and P. Ryan. (1992). “Drug-related homicide in New York City: 1984 and 1988.” Crime & Delinquency 38, 459–476.

35 Parker, R., and K. Auerhahn. (1998). “Alcohol, drugs, and violence.” Annual Review of Sociology 24, 291–311, p. 291.

36 Buerger, Michael. “The myth of racial profiling.” 97–103 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

37 Cordner, Gary, and Kathryn E. Scarborough. “The myth that science solves crimes.” 104–110 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

38 Willis, James J., Stephen D. Mastrofski, and David Weisburd. “The myth that COMPSTAT reduces crime and transforms police organizations.” 111–119 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

39 Masters, et al., 2013.

43 Scott, Eric J. (1981). Calls for service: Citizen demand and initial police response. Washington, DC: Government Printing Office.

44 Lersch, Kim. “The myth of policewomen on patrol.” 89–96 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

45 Janikowski, Richard. “The myth that the exclusionary rule allows many criminals to escape justice.” 132–139 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

46 Bishop, Donna M. “The myth that harsh punishments reduce juvenile crime.” 140–148 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

47 Immarigeon, Russ. “The myth that public attitudes are punitive.” 149–157 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

48 Acker, James R. “The myth of closure and capital punishment.” 167–175 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

49 Masters, et al., 2013.

52 Lersch, 2006.

53 Newport, Frank. “In U.S., support for death penalty falls to 39-year low.” October 13, 2011. http://www.gallup .com/poll/150089/support-death-penalty-falls-year-low.aspx. Retrieved on April 16, 2012.

54 Applegate, Brandon. “The myth that the death penalty is administered fairly.” 158–166 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

55 Williams, M. R., and J. E. Holcomb. (2001). “Racial disparity and death sentences in Ohio.” Journal of Criminal Justice 29, 207–218.

56 Snell, Tracy L. (2011, December). Capital punishment, 2010—statistical tables. Washington, DC: Bureau of Justice Statistics.

57 Applegate, 2006.

58 Williams and Holcomb, 2001.

59 Applegate, 2006.

61 Wood, Peter B. “The myth that imprisonment is the most severe form of punishment.” 192–200 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

63 Michalowski, Raymond. “The myth that punishment reduces crime.” 179–191 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

64 McShane, Marilyn, Frank P. Williams III, and Beth Pelz. “The myth of prisons as country clubs.” 201–208 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

65 Parker, Mary. “The myth that prisons can be self-supporting.” 209–213 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

66 Blakely, Curtis, and John Ortiz Smykla. “Correctional privatization and the myth of inherent efficiency.” 214–220 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

67 Jones, G. Mark. “The myth that the focus of community corrections is rehabilitation.” 221–226 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

68 Cullen, Francis T., and Paula Smith. “The myth that correctional rehabilitation does not work.” 227–238 in Bohm, Robert M., and Jeffrey T. Walker. (2006). Demystifying crime and criminal justice. Los Angeles: Roxbury.

69 Masters, et al., 2013.

73 Petersilia, Joan. (1990). “When probation becomes more dreaded than prison. Federal Probation 54, 23–27.

75 Wood, P. B., and H. G. Grasmick. (1999). “Toward the development of punishment equivalencies: Male and female inmates rate the severity of alternative sanctions compared to prison.” Justice Quarterly 16, 19–50.

76 Example is excerpted from Amy B. Thistlethwaite and John D. Wooldredge. (2010). Forty studies that changed criminal justice: Explorations into the history of criminal justice research. Upper Saddle River, NJ: Prentice Hall. This is an excellent book that demonstrates the impact research has had on criminal justice operations.

77 National Commission on Productivity. (1973). Opportunities for improving productivity in police services. Washington, DC: United States Government Printing Office, p. 19.

78 Pate, T., A. Ferrara, R. Bowers, and J. Lorence. (1976). Police response time: Its determinants and effects. Washington, DC: Police Foundation.

79 Worden, R. (1993). “Toward equity and efficiency in law enforcement: Differential police response. American Journal of Police 12, 1–32.

80 Example is excerpted from Amy B. Thistlethwaite and John D. Wooldredge. (2010). Forty studies that changed criminal justice: Explorations into the history of criminal justice research. Upper Saddle River, NJ: Prentice Hall.

81 Simon, R. (1967). The jury and the defense of insanity. Boston: Little, Brown.

83 Steffensmeier, D., J. Ulmer, & J. Kramer. (1998). “The interaction of race, gender, and age in criminal sentencing: The punishment cost of being young, black, and male. Criminology 36, 763–797.

84 Example is excerpted from Amy B. Thistlethwaite and John D. Wooldredge. (2010). Forty studies that changed criminal justice: Explorations into the history of criminal justice research. Upper Saddle River, NJ: Prentice Hall.

85 Martinson, R. (1974). “What works? Questions and answers about prison reform.” The Public Interest 10, 22–54.

86 Ibid, p. 25.

87 Ibid, p. 49.

Applied Research Methods in Criminal Justice and Criminology by University of North Texas is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License , except where otherwise noted.

Share This Book

JAMS ADR Insights

Empowering leadership and the importance of conflict resolution skills in management.

April 9, 2024

If only leadership were one-size-fits-all. The truth is, there is no cookie cutter-methodology to effective, empowering and essential leadership qualities. Yet effective conflict management strategies are often recognized in retrospect, guiding us to reverse-engineer our paths to success. So, as goals change, so must the leadership strategy designed to move an organization in the desired direction. Here, we’ll explore three leadership keys that are applicable to both an organization and its people.

First, culture should be a top-down phenomenon. My experience in an organization where the entire leadership team went to annual conferences with multiple opportunities for professional growth is a testament to this. These multiday conferences required the top staff to attend several trainings per day with curriculums designed to bolster particular skill sets with overlapping issues for the whole team. What stood out is that the CEO always attended and always sat at the front of the seminar.

If you’re wondering why the CEO always sat at the front, his answer was simple: “If I can take back just one new action, principle or methodology, the whole conference would pay for itself.” Imagine that you are watching this person and seeing how he innovates and improves the organization with intentionality every day. It normalizes change and the recognition of the need for adaptability.

Secondly, almost every challenge in the workplace involves some form of conflict. Whether it’s interdepartmental disputes or friction with outside forces, every challenge carries an element of disagreement. When there is a difference of opinion on how to resolve a conflict between team members, what is the culture for dispute resolution? Who sets the tone? It's not just about settling disputes; it’s about establishing a process that’s as productive as the outcomes it aims to achieve.

Ironically, we expect people to resolve disputes, internal and external, even though they have absolutely no training, no experience and no frame of reference for how to resolve a dispute. Think of it this way. If there were a huge fire in a building, everyone inside would know to walk swiftly to safety. But there is one group of people who would run toward the fire: highly trained professionals who know what to do in the event of a fire.

Yes, you guessed it. Trained fire professionals would employ the quickest, safest way to extinguish the fire. Similarly, there are people who use these skills in the corporate setting to resolve disputes, soothe clients and save the day. But how many of these people are trained to use their natural talent to keep the organization moving forward?

Imagine a workplace where many of the professionals revel in their ability to resolve conflict consistent with the goals of the company rather than personal ego, power trips or misdirection. Just as work is not static, neither is the ability to assess a situation and make the appropriate adjustments.

By investing in conflict resolution training , we set up the organization for success with leaders equipped to recognize when it’s time to collaborate or adjust for the overall benefit of the team. The shift in the focus from individual leadership to collaboration and execution will enable and support a culture of best practices.

Finally, every new leadership tool requires a check-in. Is it working? More importantly, does it need refinement so it can be a more effective tool for the organization? Adjusting training and rollout—transitioning from a conflict avoidance stance to one of proactive conflict management leadership —can mean the difference between a culture that thrives and one that stumbles.

EXPLORE MORE ON THESE TOPICS

Disclaimer: This page is for general information purposes. JAMS makes no representations or warranties regarding its accuracy or completeness. Interested persons should conduct their own research regarding information on this website before deciding to use JAMS, including investigation and research of JAMS neutrals. See More

RELATED STORIES

Virtual Mediation, Arbitration and ADR Services

Proficient neutrals. On-demand tech support. Innovative processes. Optimal results.

Help | Advanced Search

Computer Science > Machine Learning

Title: tfb: towards comprehensive and fair benchmarking of time series forecasting methods.

Abstract: Time series are generated in diverse domains such as economic, traffic, health, and energy, where forecasting of future values has numerous important applications. Not surprisingly, many forecasting methods are being proposed. To ensure progress, it is essential to be able to study and compare such methods empirically in a comprehensive and reliable manner. To achieve this, we propose TFB, an automated benchmark for Time Series Forecasting (TSF) methods. TFB advances the state-of-the-art by addressing shortcomings related to datasets, comparison methods, and evaluation pipelines: 1) insufficient coverage of data domains, 2) stereotype bias against traditional methods, and 3) inconsistent and inflexible pipelines. To achieve better domain coverage, we include datasets from 10 different domains: traffic, electricity, energy, the environment, nature, economic, stock markets, banking, health, and the web. We also provide a time series characterization to ensure that the selected datasets are comprehensive. To remove biases against some methods, we include a diverse range of methods, including statistical learning, machine learning, and deep learning methods, and we also support a variety of evaluation strategies and metrics to ensure a more comprehensive evaluations of different methods. To support the integration of different methods into the benchmark and enable fair comparisons, TFB features a flexible and scalable pipeline that eliminates biases. Next, we employ TFB to perform a thorough evaluation of 21 Univariate Time Series Forecasting (UTSF) methods on 8,068 univariate time series and 14 Multivariate Time Series Forecasting (MTSF) methods on 25 datasets. The benchmark code and data are available at this https URL .

Submission history

Access paper:.

• HTML (experimental)
• Other Formats

References & Citations

• Google Scholar
• Semantic Scholar

BibTeX formatted citation

Bibliographic and Citation Tools

Code, data and media associated with this article, recommenders and search tools.

• Institution

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .

• Open supplemental data
• Reference Manager
• Simple TEXT file

People also looked at

Original research article, associations between monitor-independent movement summary (mims) and fall risk appraisal combining fear of falling and physiological fall risk in community-dwelling older adults.

• 1 Department of Mechanical Engineering, University of Central Florida, Orlando, FL, United States
• 2 Disability, Aging and Technology Cluster, University of Central Florida, Orlando, FL, United States
• 3 College of Medicine, University of Central Florida, Orlando, FL, United States
• 4 School of Kinesiology and Rehabilitation Sciences, College of Health Professions and Sciences, University of Central Florida, Orlando, FL, United States
• 5 Department of Statistics and Data Science, University of Central Florida, Orlando, FL, United States
• 6 College of Nursing, University of Central Florida, Orlando, FL, United States

Introduction: Fall Risk Appraisal (FRA), a process that integrates perceived and objective fall risk measures, serves as a crucial component for understanding the incongruence between fear of falling (FOF) and physiological fall risk in older adults. Despite its importance, scant research has been undertaken to investigate how habitual physical activity (PA) levels, quantified in Monitor-Independent Movement Summary (MIMS), vary across FRA categories. MIMS is a device-independent acceleration summary metric that helps standardize data analysis across studies by accounting for discrepancies in raw data among research-grade and consumer devices.

Objective: This cross-sectional study explores the associations between MIMS (volume and intensity) and FRA in a sample of older adults in the United States.

Methods: We assessed FOF (Short Falls Efficacy Scale-International), physiological fall risk (balance: BTrackS Balance, leg strength: 30-s sit-to-stand test) and 7-day free-living PA (ActiGraph GT9X) in 178 community-dwelling older adults. PA volume was summarized as average daily MIMS (MIMS/day). PA intensity was calculated as peak 30-min MIMS (average of highest 30 non-consecutive MIMS minutes/day), representing a PA index of higher-intensity epochs. FRA categorized participants into following four groups: Rational (low FOF-low physiological fall risk), Irrational (high FOF-low physiological fall risk), Incongruent (low FOF-high physiological fall risk) and Congruent (high FOF-high physiological fall risk).

Results: Compared to rational group, average MIMS/day and peak 30-min MIMS were, respectively, 15.8% ( p = .025) and 14.0% ( p = .004) lower in irrational group, and 16.6% ( p = .013) and 17.5% ( p < .001) lower in congruent group. No significant differences were detected between incongruent and rational groups. Multiple regression analyses showed that, after adjusting for age, gender, and BMI (reference: rational), only irrational FRA was significantly associated with lower PA volume (β = −1,452.8 MIMS/day, p = .034); whereas irrational and congruent FRAs were significantly associated with lower “peak PA intensity” (irrational: β = −5.40 MIMS/day, p = .007; congruent: β = −5.43 MIMS/day, p = .004).

Conclusion: These findings highlight that FOF is a significant barrier for older adults to participate in high-intensity PA, regardless of their balance and strength. Therefore, PA programs for older adults should develop tailored intervention strategies (cognitive reframing, balance and strength exercises, or both) based on an individual’s FOF and physiological fall risk.

Introduction

In the United States (US), over 14 million adults aged 65 years or older fall each year ( Moreland et al., 2020 ; Kakara et al., 2023 ). According to the US Centers for Disease Control and Prevention, about 20% of falls in older adults cause serious injuries, which results in limited functional mobility, loss of independence, reduced quality of life, and premature death ( Ambrose et al., 2013 ). Fear of falling (FOF) has been recognized as an important psychological aspect associated with falls in older adults ( Jansen et al., 2021 ). However, studies report that many older adults might show a discrepancy between their FOF and physiological fall risk, known as maladaptive fall risk appraisal (FRA) ( Thiamwong et al., 2021a ), and such discrepancies can lead to adverse consequences. For example, individuals with low physiological fall risk but high FOF may overestimate their actual fall risk and restrict their daily activities, which can further lead to physical deconditioning and loss of muscle strength ( Deshpande et al., 2008 ). On the contrary, those with high physiological fall risk but low FOF may underestimate their actual fall risk and engage in unnecessary risky behavior beyond their physical capacity, making them even more vulnerable to falling ( Delbaere et al., 2010 ).

Therefore, FRA combining subjective and objective fall risk measures is important for understanding the discrepancy between FOF and physiological fall risk in older adults to inform more targeted interventions for fall prevention ( Thiamwong et al., 2020a ; Thiamwong et al., 2020b ). FRA is a two-dimensional fall risk assessment matrix that classifies older adults into four groups based on their FOF and physiological fall risk status ( Thiamwong, 2020 ). In FRA matrix, as shown in Figure 1 , two groups have their FOF level aligned with their physiological fall risk status, which are denoted as Rational (low FOF-low physiological fall risk) and Congruent (high FOF-high physiological fall risk). The other two groups show a mismatch between their FOF level and physiological fall risk status and are denoted as Incongruent (low FOF-high physiological fall risk) and Irrational (high FOF-low physiological fall risk).

Figure 1 . Fall Risk Appraisal (FRA) based on Fear of Falling (FOF) and physiological fall risk. Maladaptive FRA = mismatch between FOF and physiological fall risk; Adaptive FRA = FOF aligned with physiological fall risk.

Prior research has mostly focused on exploring the independent associations of FOF and objective fall risk measures with physical activity (PA) participation in older adults ( Gregg et al., 2000 ; Chan et al., 2007 ; Zijlstra et al., 2007 ; Heesch et al., 2008 ; Mendes da Costa et al., 2012 ). To date, only a small number of studies have investigated the combined effects of FOF and objective fall risk on PA engagement. For example, one study examined the joint associations of FOF and objective fall risk with everyday walking activities in older adults. This study used a four-group categorization from ( Delbaere et al., 2010 ), and found that the number of steps/day in their study sample was in accordance with objective fall risk rather than FOF ( Jansen et al., 2021 ). Another study examined accelerometry-based PA levels between FRA categories using the intensity cut-point approach and found that participants with high FOF accumulated significantly less time in moderate-to-vigorous PA (MVPA) compared to those with rational FRA, regardless of their balance performance ( Thiamwong et al., 2023 ). However, there exists a lack of evidence on how habitual PA levels, expressed in Monitor-Independent Movement Summary (MIMS) units, differ between FRA categories in older adults.

MIMS is used to summarize the acceleration measurements obtained on the x-, y-, and z-axes of wrist-worn activity monitors. This PA metric was first introduced in 2019 to summarize participant-level PA data for the 2011-2012 and 2013-2014 cycles of the US National Health and Nutrition Examination Survey (NHANES) ( John et al., 2019 ). The major benefit of using MIMS is that it is generated by a nonproprietary device–independent universal algorithm, allowing us to compare the total movement across studies regardless of the heterogeneity introduced by different brands, models and device types (such as consumer vs. research-grade) ( John et al., 2019 ). Similar to other traditional PA metrics such as steps/day or daily activity counts, PA volume can be expressed as daily MIMS (i.e., total MIMS unit accumulated per day) across valid days of assessment, where larger MIMS/day indicates higher daily PA volume ( Wolff-Hughes et al., 2014 ).

Traditionally, quantification of accelerometer-measured PA intensity has been predominantly based on minutes/day (or minutes/week) spent in MVPA, using either manufacturer-specific or device-specific cut points corresponding with ≥3 Metabolic Equivalents of Task (METs) ( Troiano et al., 2008 ). Recently, to establish an intensity-based expression for MIMS units, the concept of peak 30-min MIMS has been introduced ( Zheng et al., 2023 ). It is analogous to the concept of peak 30-min cadence, i.e., the average of 30 highest cadence (steps/minutes) values within a day, representing an individual’s best efforts ( Tudor-Locke et al., 2012 ). Similar to cadence (steps/minutes), MIMS/minutes values were shown to have a strong correlation with higher PA intensity ( John et al., 2019 ). Therefore, peak 30-min MIMS (i.e., the average of the highest 30 non-consecutive MIMS [minutes/day] values within a day) can be used as a measure of higher-intensity epochs across the PA monitoring period ( Zheng et al., 2023 ). Evaluating daily MIMS (volume) and peak 30-min MIMS (intensity) can facilitate a more comprehensive assessment of PA and its relationship with FRA.

Thus, the aim of this study is to investigate the associations between wrist-worn accelerometer-measured PA (expressed as daily MIMS and peak 30-min MIMS) and FRA in a sample of community-dwelling older adults. We are particularly interested in the question: “Which of the maladaptive FRA groups, i.e., Incongruent (low FOF-high physiological fall risk) and Irrational (high FOF-low physiological fall risk), differ more from the Rational (low FOF-low physiological fall risk) group in terms of habitual PA level?.” This will allow us to understand which of the two factors—FOF or physiological fall risk—has a stronger relationship with reduced PA participation among older adults.

Materials and methods

Study design and participants.

In this cross-sectional study, purposive sampling was used to recruit 178 community-dwelling older adults from the region of Central Florida, United States, between February 2021 and March 2023. The inclusion criteria were: i) 60 years of age or older; ii) being able to walk with or without an assistive device (but without the assistance of another person); iii) no marked cognitive impairment [i.e., Memory Impairment Screen score ≥5 ( Buschke et al., 1999 )], iv) fluency in English or Spanish, and v) living in their own homes or apartments. The exclusion criteria were: i) medical conditions that prevent PA engagement (e.g., shortness of breath, tightness in the chest, dizziness, or unusual fatigue at light exertion), ii) unable to stand on the balance plate, iii) currently receiving treatment from a rehabilitation facility, and iv) having medical implants (e.g., pacemakers). This study was approved by the Institutional Review Board at the University of Central Florida (Protocol No: 2189; 10 September 2020). All subjects provided written informed consent to participate. This cross-sectional assessment required one visit to the study site during which participants completed a demographic survey and anthropometric measurements, followed by assessments of FOF and physiological fall risk. At the end of the visit, each participant was fitted with a wrist-worn accelerometer for 7-day PA monitoring in free-living conditions.

Measurements

Fear of falling (fof).

FOF was assessed using the Short Falls Efficacy Scale-International (FES-I) questionnaire ( Yardley et al., 2005 ; Kempen et al., 2008 ). It is a 7-item, self-administered tool that uses a 4-point Likert scale to measure the level of concern about falling while performing seven activities (1 = not at all concerned to 4 = very concerned). The total scores ranged from 7 to 28. Short FES-I scores of 7–10 indicated low FOF, while scores of 11–28 indicated high FOF.

Physiological fall risk

Physiological fall risk was assessed using balance test and lower limb strength assessment. BTrackS Balance System (Balance Tracking Systems, San Diego, CA, United States) was used to measure static balance. This system includes a portable BTrackS Balance Plate and BTrackS Assess Balance Software running on a computer. It has shown high test–retest reliability (intraclass correlation coefficient, ICC = 0.83) and excellent validity (Pearson’s product-moment correlations, r > 0.90) in evaluating static balance ( Levy et al., 2018 ). The test protocol included four trials (each trial taking 20 s) with less than 10 s of inter-trial delays. During the trials, participants were asked to stand still on the BTrackS Balance Plate with their eyes closed, hands on their hips, and feet placed shoulder-width apart. BTrackS balance plate is an FDA-registered, lightweight force plate that measures center of pressure (COP) excursions during the static stance. The first trial was done for familiarization only. Results from the remaining three trials were used to calculate the average COP path length (in cm) across trials. COP path length is considered as a proxy measure for postural sway magnitude; thus, the larger the COP path length, the greater the postural sway is ( Goble et al., 2017 ). COP path length of 0–30  cm was used to indicate normal balance, while ≥31  cm indicated poor balance ( Thiamwong et al., 2021b ).

Lower limb strength was assessed using the 30-s sit-to-stand (STS) test, in accordance with the established protocol ( Yee et al., 2021 ; Choudhury et al., 2023 ). Participants were instructed to keep their arms folded across their chest, rise from a seated position on a chair to a standing posture and return to the sitting position as many times as possible within 30 s. The number of chair stands completed was counted and recorded. If a participant used his/her arms to stand, the test was stopped, and the score was recorded as zero. Age- and gender-specific STS normative scores were used as cut-offs to classify participants into below-average and average STS scores, as shown in Table 1 ( Rikli and Jones, 1999 ). A below-average STS score was indicative of a higher risk of fall. Meeting both normal balance and average STS score criteria was defined as low physiological fall risk, while not meeting either or both criteria was defined as high physiological fall risk.

Table 1 . Age and gender-specific below average scores for 30-s sit-to-stand test.

Fall risk appraisal (FRA) matrix

The FRA matrix was obtained using a combination of FOF and physiological fall risk status. Participants were grouped into the following four categories based on their FOF and physiological fall risk according to existing literature ( Thiamwong et al., 2020a ): i) Rational (low FOF-low physiological fall risk), ii) Irrational (high FOF-low physiological fall risk), iii) Incongruent (low FOF-high physiological fall risk), and iv) Congruent (high FOF-high physiological fall risk).

Physical activity (PA)

PA was assessed using ActiGraph GT9X Link (ActiGraph LLC., Pensacola, FL, United States), which contains a triaxial accelerometer with a dynamic range of ±8 gravitational units (g). The device was initialized to record acceleration data at 30  Hz sampling frequency. Participants wore the ActiGraph on their non-dominant wrists for seven consecutive days in free-living conditions. They were given instructions to wear it during waking hours and remove it only during sleeping, showering, swimming and medical imaging tests. After 7-day of PA monitoring, ActiGraph devices were collected from participants. Participants with ≥4 valid days were included in the analysis, and a day was considered valid if participants wore the device for at least 14 h or more ( Choudhury et al., 2023 ).

Raw acceleration data were downloaded as “.csv” files using ActiLife software v6.13.4 (ActiGraph LLC, Pensacola, FL, United States) and converted into MIMS units using MIMSunit package ( John et al., 2019 ) in R statistical software (R Core Team, Vienna, Austria). The data processing steps included: i) interpolating data to a consistent sampling rate (i.e., 100  Hz ) to account for inter-device variability in sampling rate, ii) extrapolating data to extend maxed-out signals to account for inter-device variability in dynamic range, iii) band-pass filtering to remove artifacts from acceleration signals that do not pertain to voluntary human movement, and iv) aggregation of processed signals from each axis into a sum of MIMS-units that represents the total amount of movement activity [details on MIMS-unit algorithm are published elsewhere ( John et al., 2019 )].

PA volume, denoted by daily MIMS (MIMS/day), was calculated by summing up all triaxial MIMS/minutes accumulated throughout a day and averaged across all valid days. PA intensity, expressed as peak 30-min MIMS, was obtained by (a) first rank ordering a participant’s triaxial MIMS/minutes values within each valid day, (b) calculating the average of the highest 30 MIMS/minutes values within each day, and (c) finally taking the average of the resulting MIMS/minutes values across all valid wear days.

Anthropometric measurements

Height (in cm) was measured using a stadiometer. Body mass (in kilograms) was measured using a digital scale with no shoes. Body mass index (BMI) was calculated as the weight (kg) divided by the square of height (m 2 ).

Statistical analyses

All statistical analyses were performed in R statistical software (version 4.1.2, R Core Team, Vienna, Austria) with statistical significance level set at .05. Descriptive characteristics of participants were summarized as mean (standard deviation, SD) for normally distributed continuous variables, as median (Interquartile Range, IQR) for non-normally distributed continuous variables, and as frequency (percentage) for categorical variables, stratified by FRA categories. The Shapiro-Wilk test was performed to check if a continuous variable followed a normal distribution. Differences across groups were examined using one-way analysis of variance (ANOVA) for normally distributed data and Kruskal–Wallis test for non-normally distributed data, with Bonferroni adjustment for post hoc comparisons.

Multiple linear regression was conducted for each outcome variable (i.e., daily MIMS and peak 30-min MIMS) using the four FRA groups—“Rational,” “Irrational,” “Incongruent” and “Congruent”—as explanatory variables, controlled by age, gender and BMI. A priori sample size calculation for multiple linear regression revealed that the minimum number of samples for 8 explanatory variables at a statistical power level of 0.8, α = 0.05, and a medium effect size (Cohen f 2 = 0.15) would be 108; therefore, our sample size (i.e., N = 178) had sufficient statistical power for multiple regression. The rational group (i.e., low FOF-low physiological fall risk) was selected as the reference group in the regression analysis.

Among 178 participants, 163 samples were included in the analyses, after retaining only those who had at least 4 days of valid PA data and completed both FOF and physiological fall risk assessments. The mean (SD) age of participants was 75.3 (7.1) years, and 73.6% of participants were in 60–79 years of age group ( n = 120) and 26.4% were above 80 years of age ( n = 43). Figure 2 shows the scatterplot of participants’ age (years) and FOF scores, stratified by physiological fall risk status. The proportion of participants with low FOF was 71.7% ( n = 86) in the 60–79 years of age group and 48.8% ( n = 21) in the ≥80 years of age group. The median (IQR) BMI of participants was 26.6 (6.3) kg/m 2 and majority of participants were female (79.1%). The median (IQR) Short FES-I score was 9 (5) and 34.4% of participants had high FOF. The median (IQR) COP path length was 27 (15) cm , and the median (IQR) sit-to-stand score was 13 (6) reps. 38.0% of participants had poor balance, 27.0% had below average lower limb strength, and 48.5% showed both poor balance and below average lower limb strength. Finally, 37.4% of participants were screened as rational ( n = 61), 14.2% were irrational ( n = 23), 28.2% were incongruent ( n = 46) and 20.2% were congruent ( n = 37). Table 2 summarizes the characteristics of study participants according to FRA categories.

Figure 2 . Scatterplot of Age (years) across Fear of Falling scores, stratified by physiological fall risk status. Low physiological fall risk = meeting both normal static balance cut-off and average sit-to-stand score cut-off. High physiological fall risk = not meeting normal static balance cut-off or average sit-to-stand score cut-off or both.

Table 2 . Participant characteristics stratified by Fall Risk Appraisal matrix.

In Figure 3A , the variations in average MIMS (MIMS/hours) over 24-h by FRA categories are shown. The average MIMS across all groups was in general low at night, then substantially increased during morning hours and gradually decreased as the day progressed and evening approached. In Figure 3B , the mean (line) and standard error (shaded area) of MIMS/hours for each FRA group is shown. Overall, rational group showed the highest average MIMS/hours across the day hours, while congruent had the lowest average MIMS/hours. Among maladaptive FRA groups, the peak was higher in incongruent group than their irrational counterparts, which indicates the potential role of FOF in limiting high-intensity PA participation.

Figure 3 . (A) Daily patterns of average MIMS per hour by Fall Risk Appraisal (FRA) groups. (B) Mean (line) and standard error (shaded area) of MIMS per hour for each FRA group.

The mean (SD) age in congruent group was 78.8 (7.6) years, which was higher than both rational (74.3 [5.8] years, p = .005) and incongruent (74.3 [7.0] years, p = .010) groups, as shown in Supplementary Figure S1 . This suggests that prevalence of high FOF, irrespective of balance performance and lower limb strength, may increase with advanced age. Also, the median (IQR) BMI in congruent group (28.9 [5.8]) kg/m 2 ) was higher in comparison to rational (24.9 [6.4] kg/m 2 , p = .001) and incongruent (26.9 [4.7] kg/m 2 , p = .018) groups (shown in Supplementary Figure S2 ), indicating that higher BMI in older adults may result in high FOF. However, no significant group differences were observed between rational and irrational groups in terms of age and BMI.

The mean (SD) daily MIMS in rational group was 10,408 (2,439) MIMS/day, which was 15.8% higher than irrational ( p = .025) and 16.6% higher than congruent ( p = .013) groups, as shown in Figure 4 . Also, the mean (SD) peak 30-min MIMS in rational group was 39.9 (8.3) MIMS/day, which was 14.0% higher than irrational ( p = .004) and 17.5% higher than congruent ( p < .001) groups ( Figure 5 ). Compared to rational group, incongruent participants showed no significant differences in PA volume and intensity, despite having poor balance and below average lower limb strength.

Figure 4 . Average daily MIMS (MIMS/day) across categories of Fall Risk Appraisal combining FOF and physiological fall risk, * p < .05.

Figure 5 . Peak 30-min MIMS per day across categories of Fall Risk Appraisal combining FOF and physiological fall risk, ** p < .01, *** p < .001.

Table 2 presents the regression models for daily MIMS. In comparison to reference group (i.e., rational), lower PA volume was associated with irrational ( β [SE] = −1,463.2 [687.7] MIMS/day, p = .035) and congruent ( β [SE] = −1,579.5 [582.9] MIMS/day, p = .007) FRAs in Model 1 (unadjusted). In model 2, after adjusting for age, gender and BMI, only irrational FRA was significantly associated with lower PA volume ( β [SE] = −1,476.41 [582.26] MIMS/day, p = .025; regression coefficients of covariates are presented in Supplementary Table S1 ).

Results for regression analysis for peak 30-min MIMS are presented in Table 3 . In model 1 (unadjusted), lower ‘peak PA intensity’ was associated with irrational ( β [SE] = −5.63 [1.99] MIMS/day, p = .005) and congruent FRAs ( β [SE] = −7.06 [1.76] MIMS/day, p < .001) compared to the reference group. In Model 2 ( Table 4 ), after adjusting for age, gender and BMI, both irrational and congruent FRAs were still significantly associated with lower “peak PA intensity”(irrational: β [SE] = −5.40 [1.97] MIMS/day, p = .007; congruent: β [SE] = −5.43 [1.86] MIMS/day, p = .004; regression coefficients of covariates are presented in Supplementary Table S2 ).

Table 3 . Association between Fall Risk Appraisal groups and average daily MIMS (MIMS/day) using linear regression. Model 2 was adjusted for age, gender and BMI.

Table 4 . Association between Fall Risk Appraisal groups and peak 30-min MIMS per day (MIMS/day) using linear regression. Model 2 was adjusted for age, gender and BMI.

This is the first study, to our knowledge, to evaluate the associations of FRA with daily MIMS and peak 30-min MIMS in a sample of community-dwelling US older adults. In general, both the volume and intensity of PA were highest in the rational group and lowest in the congruent group. In maladaptive FRA groups, high FOF (i.e., irrational FRA) was associated with lower PA volume and intensity compared to the reference group (i.e., rational FRA), but no significant differences were observed for high physiological fall risk (i.e., incongruent FRA).

Prior research has shown that FOF is associated with reduced PA levels in community-dwelling older adults using objectively measured PA data ( Jefferis et al., 2014 ; Choudhury et al., 2022 ). Our results broadly agree with it, showing that total daily PA volume was significantly lower in two high FOF groups (i.e., irrational and congruent) than the rational group. This suggests that regardless of balance performance and lower limb strength, low FOF was associated with high PA volume in our study sample. In linear regression analysis, after accounting for age, gender and BMI, reduced daily MIMS was significantly associated with irrational FRA, but not with congruent FRA. It can be attributed to the fact that the average age and BMI of congruent participants were higher than all other groups, and evidence suggests that that increasing older age and higher BMI contribute to lower PA levels in older adults ( Smith et al., 2015 ).

We did not observe any significant difference between two low FOF groups (i.e., rational and incongruent) in terms of daily PA volume. This suggests that, for maladaptive FRA, high physiological fall risk (not high FOF) had a stronger association with reduced daily PA accumulation in our study sample. In contrast to our findings, a recent study found that low physiological fall risk was more strongly associated with increased walking activity (steps/day) than low perceived fall risk in a sample of community-dwelling German older adults ( n = 294) ( Jansen et al., 2021 ). However, it should be noted that Jansen et al. used multiple independent risk factors (i.e., previous falls, balance impairment, gait impairment, and multimedication) to distinguish between high and low physiological fall risk, whereas they used only one tool (Short FES-I) to assess perceived fall risk. Furthermore, participants with low FOF and high physiological fall risk in that German older adult cohort ( Jansen et al., 2021 ) were relatively older than those in our study sample [mean (SD) age: 81.6 (5.5) years vs. 74.3 (7.0) years in our study]. Previous studies indicate that the likelihood of reduced participation in PA gradually increases with advanced age, because of age-related declines in muscle mass, muscle strength, and functional fitness (i.e., the physical capacity to perform activities of daily living independently and without the early onset of fatigue) ( Milanović et al., 2013 ; Westerterp, 2018 ; Suryadinata et al., 2020 ). Therefore, future research should examine how age-related functional declines mediate the relationship between maladaptive FRA and daily PA volume in older adults.

In our study, the peak PA intensity in both high FOF groups (i.e., irrational and congruent) was significantly lower than the rational group. Despite the differences in the PA metrics, this is in general agreement with the previous findings that showed older adults with irrational and congruent FRAs were more likely to spend less time in MVPA ( Thiamwong et al., 2023 ). Interestingly, after adjusting for confounders, the decrease in peak 30-min MIMS for irrational and congruent groups was almost equivalent in our study. This suggests that older adults with high FOF may restrict their participation in high intensity PA, irrespective of their physiological fall risk status. Our findings extend the previously reported association between PA intensity and FOF in older adults ( Sawa et al., 2020 ), highlighting the need to integrate cognitive behavioral therapy to reduce FOF in fall intervention programs.

For peak 30-min MIMS, we did not find any significant difference between two low FOF groups (i.e., rational and incongruent). This suggests that, similar to total PA volume, peak PA intensity was more strongly associated with high FOF (rather than high physiological fall risk) for maladaptive FRA in our sample. Unlike MVPA cut points that exclude PA intensities ≤3 METs or equivalent, peak 30-min MIMS considers acceleration magnitudes ranging from lower to higher peak efforts within a day, enabling comparison over the whole spectrum of PA intensity levels (e.g., light vs. vigorous) ( Zheng et al., 2023 ). Further research should investigate domains of peak PA efforts across different FRA groups, so that informed strategies can be developed to promote high-intensity PA participation according to the perceived and physiological risk of fall.

Based on the findings of our study, it can be conferred that the FRA assessment may be useful in designing customized PA interventions to promote an active lifestyle in older adults. For example, to increase PA participation in older adults with irrational FRA, cognitive behavioral therapy can be integrated into PA programs to improve their self-efficacy and sense of control over falling ( Tennstedt et al., 1998 ). For incongruent FRA, PA recommendations should include exercise regimens specifically designed to reduce physiological fall risk, such as high intensity balance and strength training, in addition to aerobic activities ( Sherrington et al., 2008 ). On the other hand, older adults with congruent FRA may benefit from PA programs that combine both balance and strength exercises, and cognitive behavioral therapy ( Brouwer et al., 2003 ).

A strength of our study is the use of MIMS metric to provide a comprehensive PA assessment (volume and intensity) enabling reliable, cross-study comparisons of our findings with other MIMS-based studies regardless of the device type, model or manufacturer. Furthermore, we used evidence-based cut-off points to determine FOF level (low vs. high FOF), balance status (poor vs. normal balance) and lower limb strength (below average vs. average strength) to categorize participants into FRA groups. However, our study has several limitations. First, to determine physiological fall risk status, we didn’t use the Physiological Profile Assessment ( Delbaere et al., 2010 ) or multiple independent risk factors ( Jansen et al., 2021 ), which might have led to different group formations than those studies. Instead, we used static balance and lower limb strength as physiological fall risk indicators. While balance and strength deficits are important predictors of falls in older adults, they might not account for all aspects of physiological fall risk (such as gait impairment, visual and sensory deficits, use of multi-medications etc.) ( Fabre et al., 2010 ). Second, it is to be noted that the balance performance measure (i.e., static balance) used in this study may not capture the full spectrum of an individual’s balance capabilities. There are different measures of balance performance, including static steady-state balance (i.e., the ability to maintain a steady position while standing or sitting), dynamic steady-state balance (i.e., the ability to maintain a steady position while performing postural transitions and walking), proactive balance (i.e., the ability to anticipate and mitigate a predicted postural disturbance), and reactive balance (i.e., the ability to recover a stable position following an unexpected postural disturbance) ( Shumway-Cook and Woollacott, 2007 ). Therefore, future studies may consider using more comprehensive assessments of balance performance in older adults to define physiological fall risk in FRA. Third, our study only considered FOF as the psychological fall risk measure in FRA and did not investigate other psychological constructs such as falls efficacy or balance confidence ( Moore et al., 2011 ). FOF and falls efficacy are two major fall-related psychological constructs in preventing and managing fall risks in older adults. It is to be noted that, though FOF and falls efficacy are correlated, they represent theoretically distinct concepts ( Hadjistavropoulos et al., 2011 ). FOF is defined as “the lasting concerns about falling that leads to an individual avoiding activities that one remains capable of performing.” Some common instruments for FOF measurement include FES-I, Short FES-I, Iconographical Falls Efficacy Scale (ICON-FES), Geriatric Fear of Falling Measure (GFFM), Survey of Activities and Fear of Falling in the Elderly (SAFE), Fear of Falling Avoidance Behaviour Questionnaire (FFABQ) etc., ( Soh et al., 2021 ). On the other hand, falls efficacy is defined as the perceived confidence in one’s ability to carry out activities of daily living without experiencing a fall ( Moore and Ellis, 2008 ). Existing instruments for measuring falls efficacy include Falls Efficacy Scale (FES), modified FES (MFES), Perceived Ability to Prevent and Manage Fall Risks (PAPMFR), and Perceived Ability to Manage Risk of Falls or Actual Falls (PAMF) ( Soh et al., 2021 ). Prior research has reported that, compared to FOF, falls efficacy shows stronger relationship with measures of basic and instrumental activities of daily living (ADL-IADL), and physical and social functioning ( Tinetti et al., 1994 ). Therefore, future studies should consider exploring the combined effects of falls efficacy and physiological fall risk measures on habitual PA level to determine whether FOF or fall efficacy should be considered as a target for PA interventions in older adults. Fourth, to date, there exists no established cut-offs for the MIMS metric to categorize total PA volume and intensity that correspond to meeting national PA guidelines, and it is still unknown how well MIMS/minute can estimate energy expenditure ( Vilar-Gomez et al., 2023 ). Our study just provided a first step toward the use of a standardized metric to associate PA behavior with FRA in a community-dwelling older adult sample in the US. Future studies should examine such associations in large, nationally representative populations to establish benchmark values for daily MIMS and peak 30-min MIMS in different FRA categories. Fifth, the cross-sectional design of the study didn’t allow us to determine a causal relationship between FRA and PA, so reverse and/or bidirectional causality might still be present. Sixth, although we controlled for age, gender, and BMI in the regression analyses, there remains the possibility of additional residual confounding [such as neuropsychological constructs that have been associated with FOF, which include depression, anxiety, neuroticism, attention, and executive function ( Delbaere et al., 2010 )]. Finally, our sample size was relatively small and 79% of participants were female. The generalizability of our findings might be restricted by the small, female dominant nature of our sample.

In conclusion, compared to rational FRA, the habitual PA level (daily MIMS and peak 30-min MIMS) was lower in both high FOF groups (i.e., irrational and congruent), but not in incongruent group. This suggests that, for maladaptive FRA in our study sample, high perceived fall risk had a stronger association with reduced PA level, rather than high physiological fall risk. When controlled for covariates, decrease in peak PA intensity remained significantly associated with irrational and congruent FRAs, indicating that older adults with high FOF performed PA at lower peak efforts, irrespective of their physiological fall status. Future prospective studies should focus on identifying the optimal habitual PA level (total PA volume and peak PA intensity) in accordance with an older adult’s FOF and physiological fall risk to better inform public health policies for sustainable, effective PA framework.

Data availability statement

The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by the Institutional Review Board, University of Central Florida. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

RC: Data curation, Formal Analysis, Investigation, Methodology, Software, Visualization, Writing–original draft. J-HP: Conceptualization, Funding acquisition, Investigation, Methodology, Resources, Supervision, Writing–review and editing. CB: Formal Analysis, Visualization, Writing–review and editing. MC: Data curation, Investigation, Writing–review and editing. DF: Conceptualization, Funding acquisition, Writing–review and editing. RX: Conceptualization, Funding acquisition, Writing–review and editing. JS: Conceptualization, Funding acquisition, Supervision, Writing–review and editing. LT: Conceptualization, Funding acquisition, Project administration, Resources, Supervision, Writing–review and editing.

The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. The research was funded by the National Institute on Aging (R03AG06799) and the National Institute on Minority Health and Health Disparities (R01MD018025) of National Institutes of Health. This research also received financial support from the University of Central Florida CONNECT CENTRAL (Interdisciplinary research seed grant; AWD00001720 and AWD00005378).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fragi.2024.1284694/full#supplementary-material

Ambrose, A. F., Paul, G., and Hausdorff, J. M. (2013). Risk factors for falls among older adults: a review of the literature. Maturitas 75 (1), 51–61. doi:10.1016/j.maturitas.2013.02.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Brouwer, B. J., Walker, C., Rydahl, S. J., and Culham, E. G. (2003). Reducing fear of falling in seniors through education and activity programs: a randomized trial. J. Am. Geriatr. Soc. 51 (6), 829–834. doi:10.1046/j.1365-2389.2003.51265.x

Buschke, H., Kuslansky, G., Katz, M., Stewart, W. F., Sliwinski, M. J., Eckholdt, H. M., et al. (1999). Screening for dementia with the memory impairment screen. Neurology 52 (2), 231–238. doi:10.1212/wnl.52.2.231

Chan, B. K., Marshall, L. M., Winters, K. M., Faulkner, K. A., Schwartz, A. V., and Orwoll, E. S. (2007). Incident fall risk and physical activity and physical performance among older men: the Osteoporotic Fractures in Men Study. Am. J. Epidemiol. 165 (6), 696–703. doi:10.1093/aje/kwk050

Choudhury, R., Park, J. H., Banarjee, C., Thiamwong, L., Xie, R., and Stout, J. R. (2023). Associations of mutually exclusive categories of physical activity and sedentary behavior with body composition and fall risk in older women: a cross-sectional study. Int. J. Environ. Res. Public Health 20 (4), 3595. doi:10.3390/ijerph20043595

Choudhury, R., Park, J. H., Thiamwong, L., Xie, R., and Stout, J. R. (2022). Objectively measured physical activity levels and associated factors in older US women during the COVID-19 pandemic: cross-sectional study. JMIR Aging 5 (3), e38172. doi:10.2196/38172

Delbaere, K., Close, J. C., Brodaty, H., Sachdev, P., and Lord, S. R. (2010). Determinants of disparities between perceived and physiological risk of falling among elderly people: cohort study. Bmj 341, c4165. doi:10.1136/bmj

Deshpande, N., Metter, E. J., Lauretani, F., Bandinelli, S., Guralnik, J., and Ferrucci, L. (2008). Activity restriction induced by fear of falling and objective and subjective measures of physical function: a prospective cohort study. J. Am. Geriatr. Soc. 56 (4), 615–620. doi:10.1111/j.1532-5415.2007.01639.x

Fabre, J. M., Ellis, R., Kosma, M., and Wood, R. H. (2010). Falls risk factors and a compendium of falls risk screening instruments. J. Geriatr. Phys. Ther. 33 (4), 184–197. doi:10.1519/jpt.0b013e3181ff2a24

Goble, D. J., Hearn, M. C., and Baweja, H. S. (2017). Combination of BTrackS and Geri-Fit as a targeted approach for assessing and reducing the postural sway of older adults with high fall risk. Clin. Interv. Aging 12, 351–357. doi:10.2147/cia.S131047

Gregg, E. W., Pereira, M. A., and Caspersen, C. J. (2000). Physical activity, falls, and fractures among older adults: a review of the epidemiologic evidence. J. Am. Geriatr. Soc. 48 (8), 883–893. doi:10.1111/j.1532-5415.2000.tb06884.x

Hadjistavropoulos, T., Delbaere, K., and Fitzgerald, T. D. (2011). Reconceptualizing the role of fear of falling and balance confidence in fall risk. J. Aging Health 23 (1), 3–23. doi:10.1177/0898264310378039

Heesch, K. C., Byles, J. E., and Brown, W. J. (2008). Prospective association between physical activity and falls in community-dwelling older women. J. Epidemiol. Community Health 62 (5), 421–426. doi:10.1136/jech.2007.064147

Jansen, C. P., Klenk, J., Nerz, C., Todd, C., Labudek, S., Kramer-Gmeiner, F., et al. (2021). Association between everyday walking activity, objective and perceived risk of falling in older adults. Age Ageing 50 (5), 1586–1592. doi:10.1093/ageing/afab037

Jefferis, B. J., Iliffe, S., Kendrick, D., Kerse, N., Trost, S., Lennon, L. T., et al. (2014). How are falls and fear of falling associated with objectively measured physical activity in a cohort of community-dwelling older men? BMC Geriatr. 14, 114. doi:10.1186/1471-2318-14-114

John, D., Tang, Q., Albinali, F., and Intille, S. (2019). An open-source monitor-independent movement summary for accelerometer data processing. J. Meas. Phys. Behav. 2 (4), 268–281. doi:10.1123/jmpb.2018-0068

Kakara, R., Bergen, G., Burns, E., and Stevens, M. (2023). Nonfatal and fatal falls among adults aged ≥65 Years - United States, 2020-2021. MMWR Morb. Mortal. Wkly. Rep. 72 (35), 938–943. doi:10.15585/mmwr.mm7235a1

Kempen, G. I., Yardley, L., van Haastregt, J. C., Zijlstra, G. A., Beyer, N., Hauer, K., et al. (2008). The Short FES-I: a shortened version of the falls efficacy scale-international to assess fear of falling. Age Ageing 37 (1), 45–50. doi:10.1093/ageing/afm157

Levy, S. S., Thralls, K. J., and Kviatkovsky, S. A. (2018). Validity and reliability of a portable balance tracking system, BTrackS, in older adults. J. Geriatr. Phys. Ther. 41 (2), 102–107. doi:10.1519/jpt.0000000000000111

Mendes da Costa, E., Pepersack, T., Godin, I., Bantuelle, M., Petit, B., and Levêque, A. (2012). Fear of falling and associated activity restriction in older people. results of a cross-sectional study conducted in a Belgian town. Arch. Public Health 70 (1), 1. doi:10.1186/0778-7367-70-1

Milanović, Z., Pantelić, S., Trajković, N., Sporiš, G., Kostić, R., and James, N. (2013). Age-related decrease in physical activity and functional fitness among elderly men and women. Clin. Interv. Aging 8, 549–556. doi:10.2147/cia.S44112

Moore, D. S., and Ellis, R. (2008). Measurement of fall-related psychological constructs among independent-living older adults: a review of the research literature. Aging Ment. Health 12 (6), 684–699. doi:10.1080/13607860802148855

Moore, D. S., Ellis, R., Kosma, M., Fabre, J. M., McCarter, K. S., and Wood, R. H. (2011). Comparison of the validity of four fall-related psychological measures in a community-based falls risk screening. Res. Q. Exerc. Sport 82 (3), 545–554. doi:10.1080/02701367.2011.10599787

Moreland, B., Kakara, R., and Henry, A. (2020). Trends in nonfatal falls and fall-related injuries among adults aged ≥65 Years - United States, 2012-2018. MMWR Morb. Mortal. Wkly. Rep. 69 (27), 875–881. doi:10.15585/mmwr.mm6927a5

Rikli, R. E., and Jones, C. J. (1999). Functional fitness normative scores for community-residing older adults, ages 60-94. J. Aging Phys. Act. 7 (2), 162–181. doi:10.1123/japa.7.2.162

CrossRef Full Text | Google Scholar

Sawa, R., Asai, T., Doi, T., Misu, S., Murata, S., and Ono, R. (2020). The association between physical activity, including physical activity intensity, and fear of falling differs by fear severity in older adults living in the community. J. Gerontol. B Psychol. Sci. Soc. Sci. 75 (5), 953–960. doi:10.1093/geronb/gby103

Sherrington, C., Whitney, J. C., Lord, S. R., Herbert, R. D., Cumming, R. G., and Close, J. C. (2008). Effective exercise for the prevention of falls: a systematic review and meta-analysis. J. Am. Geriatr. Soc. 56 (12), 2234–2243. doi:10.1111/j.1532-5415.2008.02014.x

Shumway-Cook, A., and Woollacott, M. H. (2007). Motor control: translating research into clinical practice . United States: Lippincott Williams & Wilkins .

Google Scholar

Smith, L., Gardner, B., Fisher, A., and Hamer, M. (2015). Patterns and correlates of physical activity behaviour over 10 years in older adults: prospective analyses from the English Longitudinal Study of Ageing. BMJ Open 5 (4), e007423. doi:10.1136/bmjopen-2014-007423

Soh, S. L., Tan, C. W., Thomas, J. I., Tan, G., Xu, T., Ng, Y. L., et al. (2021). Falls efficacy: extending the understanding of self-efficacy in older adults towards managing falls. J. Frailty Sarcopenia Falls 6 (3), 131–138. doi:10.22540/jfsf-06-131

Suryadinata, R. V., Wirjatmadi, B., Adriani, M., and Lorensia, A. (2020). Effect of age and weight on physical activity. J. Public Health Res. 9 (2), 1840. doi:10.4081/jphr.2020.1840

Tennstedt, S., Howland, J., Lachman, M., Peterson, E., Kasten, L., and Jette, A. (1998). A randomized, controlled trial of a group intervention to reduce fear of falling and associated activity restriction in older adults. J. Gerontol. B Psychol. Sci. Soc. Sci. 53 (6), P384–P392. doi:10.1093/geronb/53b.6.p384

Thiamwong, L. (2020). A hybrid concept analysis of fall risk appraisal: integration of older adults' perspectives with an integrative literature review. Nurs. Forum 55 (2), 190–196. doi:10.1111/nuf.12415

Thiamwong, L., Huang, H. J., Ng, B. P., Yan, X., Sole, M. L., Stout, J. R., et al. (2020a). Shifting maladaptive fall risk appraisal in older adults through an in-home physio-fEedback and exercise pRogram (peer): a pilot study. Clin. Gerontol. 43 (4), 378–390. doi:10.1080/07317115.2019.1692120

Thiamwong, L., Ng, B. P., Kwan, R. Y. C., and Suwanno, J. (2021a). Maladaptive fall risk appraisal and falling in community-dwelling adults aged 60 and older: implications for screening. Clin. Gerontol. 44 (5), 552–561. doi:10.1080/07317115.2021.1950254

Thiamwong, L., Sole, M. L., Ng, B. P., Welch, G. F., Huang, H. J., and Stout, J. R. (2020b). Assessing fall risk appraisal through combined physiological and perceived fall risk measures using innovative Technology. J. Gerontol. Nurs. 46 (4), 41–47. doi:10.3928/00989134-20200302-01

Thiamwong, L., Stout, J. R., Park, J. H., and Yan, X. (2021b). Technology-based fall risk assessments for older adults in low-income settings: protocol for a cross-sectional study. JMIR Res. Protoc. 10 (4), e27381. doi:10.2196/27381

Thiamwong, L., Xie, R., Park, J. H., Choudhury, R., Malatyali, A., Li, W., et al. (2023). Levels of accelerometer-based physical activity in older adults with a mismatch between physiological fall risk and fear of falling. J. Gerontol. Nurs. 49 (6), 41–49. doi:10.3928/00989134-20230512-06

Tinetti, M. E., Mendes de Leon, C. F., Doucette, J. T., and Baker, D. I. (1994). Fear of falling and fall-related efficacy in relationship to functioning among community-living elders. J. Gerontol. 49 (3), M140–M147. doi:10.1093/geronj/49.3.m140

Troiano, R. P., Berrigan, D., Dodd, K. W., Mâsse, L. C., Tilert, T., and McDowell, M. (2008). Physical activity in the United States measured by accelerometer. Med. Sci. Sports Exerc. 40 (1), 181–188. doi:10.1249/mss.0b013e31815a51b3

Tudor-Locke, C., Brashear, M. M., Katzmarzyk, P. T., and Johnson, W. D. (2012). Peak stepping cadence in free-living adults: 2005-2006 NHANES. J. Phys. Act. Health 9 (8), 1125–1129. doi:10.1123/jpah.9.8.1125

Vilar-Gomez, E., Vuppalanchi, R., Gawrieh, S., Pike, F., Samala, N., and Chalasani, N. (2023). Significant dose-response association of physical activity and diet quality with mortality in adults with suspected NAFLD in a population study. Am. J. Gastroenterol. 118 (9), 1576–1591. doi:10.14309/ajg.0000000000002222

Westerterp, K. R. (2018). Changes in physical activity over the lifespan: impact on body composition and sarcopenic obesity. Obes. Rev. 19 (1), 8–13. doi:10.1111/obr.12781

Wolff-Hughes, D. L., Bassett, D. R., and Fitzhugh, E. C. (2014). Population-referenced percentiles for waist-worn accelerometer-derived total activity counts in U.S. youth: 2003 - 2006 NHANES. PLoS One 9 (12), e115915. doi:10.1371/journal.pone.0115915

Yardley, L., Beyer, N., Hauer, K., Kempen, G., Piot-Ziegler, C., and Todd, C. (2005). Development and initial validation of the falls efficacy scale-international (FES-I). Age Ageing 34 (6), 614–619. doi:10.1093/ageing/afi196

Yee, X. S., Ng, Y. S., Allen, J. C., Latib, A., Tay, E. L., Abu Bakar, H. M., et al. (2021). Performance on sit-to-stand tests in relation to measures of functional fitness and sarcopenia diagnosis in community-dwelling older adults. Eur. Rev. Aging Phys. Act. 18 (1), 1. doi:10.1186/s11556-020-00255-5

Zheng, P., Pleuss, J. D., Turner, D. S., Ducharme, S. W., and Aguiar, E. J. (2023). Dose-response association between physical activity (daily MIMS, peak 30-minute MIMS) and cognitive function among older adults: NHANES 2011-2014. J. Gerontol. A Biol. Sci. Med. Sci. 78 (2), 286–291. doi:10.1093/gerona/glac076

Zijlstra, G. A., van Haastregt, J. C., van Eijk, J. T., van Rossum, E., Stalenhoef, P. A., and Kempen, G. I. (2007). Prevalence and correlates of fear of falling, and associated avoidance of activity in the general population of community-living older people. Age Ageing 36 (3), 304–309. doi:10.1093/ageing/afm021

Keywords: falls, physical activity, accelerometry, aging, fear of falling, fall risk, MIMS

Citation: Choudhury R, Park J-H, Banarjee C, Coca MG, Fukuda DH, Xie R, Stout JR and Thiamwong L (2024) Associations between monitor-independent movement summary (MIMS) and fall risk appraisal combining fear of falling and physiological fall risk in community-dwelling older adults. Front. Aging 5:1284694. doi: 10.3389/fragi.2024.1284694

Received: 28 August 2023; Accepted: 20 March 2024; Published: 09 April 2024.

Reviewed by:

Copyright © 2024 Choudhury, Park, Banarjee, Coca, Fukuda, Xie, Stout and Thiamwong. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Joon-Hyuk Park, [email protected]

This article is part of the Research Topic

Insights into Falls Efficacy and Fear of Falling

• MyU : For Students, Faculty, and Staff

2024 Minnesota Crucible Prize Results

Congratulations to the winners of the 2024 Minnesota Crucible Prize, sponsored by Navjot Singh (PhD ChE ’94) and Nithya Iyer Singh (MS Pharmaceutics ’94). The Minnesota Crucible Prize competition invited participants to present a 10-minute pitch followed by five minutes of Q&A to a panel of two commercialization experts. The top three teams were awarded prizes of $2,000, $500, and $250.

This year's winner is CEMS graduate student Emmanuel Onuoha with his pitch for "Renewable Ammonia Production," which enables the production of ammonia onsite at a small scale with zero carbon emissions.

Congratulations to all the finalists. Below are listed the top 3 teams along with an honorable mention.

1st Place: Emmanuel Onuoha with "Renewable Ammonia Production" "Our product technology enables the production of ammonia onsite at small scale with zero carbon emissions. Due to a growing global demand for food and clean energy, this alternative path to ammonia production is unique and better suited for sustainable synthesis of this important chemical for farmers for onsite fertilizer and fuel, as well as onsite renewable energy storage and production for industrial or housing complexes. Our technology utilizes renewables like wind or solar resources for energy supply while water and air will serve as sources for raw materials for our process. This method is preferred because it does not contribute to greenhouse gas emissions and has a higher energy and cost efficiency compared with traditional processes for making this commodity chemical. It can also be deployed at the site of demand, which is an additional advantage as it eliminates transportation costs for the end user. For example, this process can be installed on a farm or owned by an apartment complex."

2nd Place: Colin Wadsworth, Yukai Shi, and Jayamathangi Srinivasan with "SSW Advanced Films & Coatings" The technology that we aim to commercialize is “Environmentally-friendly, enzymatic anti-corrosion and anti-fouling coating”. Resistance to corrosion, stains and bacteria is a topic of common interest in both industry and medical fields. Among them, bacteria are our worst enemies: For steel structures that are submerged underwater, bacteria can form biofilms that greatly accelerate the corrosion. In healthcare, pathogenic bacteria can attach to contaminated surfaces or medical devices, leading to infections. Currently, commonly used anti-fouling and antimicrobial coatings include heavy metals (e.g., Cu, Ag), or bactericidal compounds. However, they are all toxic and have an impact on the environment. Therefore, our company aims to commercialize an enzyme-based, eco-friendly, anti-fouling coating. This coating consists of the engineered version of an enzyme called lactonase, which degrades an essential molecule secreted by bacteria for biofilm formation. This technology can be used not only as coatings in major components of infrastructure prone to bio-corrosion, but also as an antimicrobial agent or cleaner in daily life.

3rd Place: Aratrika Ghose with "On Track" Our easy-to-use, fast-setting material takes less than 30 minutes to dry up on a day that’s 55 degrees or higher, resulting in shorter traffic diversions and closure for repair work. It has also been tested to last twice as long as ordinary patches. Our formula uses tactonite tailings, which is a mining pollutant currently disposed of in large waterbodies. As a result, it can be obtained at low prices and is completely free of cement, which contributes to ~ 8% of global greenhouse gas emissions. Over 40% of America’s roads are in poor or mediocre condition and the current backlog for road repair is estimated to be $485B. The average motorist pays $1000/yr in wasted time and fuel. Rising temperatures are estimated to add $19B/year to pavement costs by 2040. We want to address this growing concern by offering a cost-effective and sustainable solution to bring us back “On Track” to drive towards a greener future.

Honorable mention: Ayaka Moriyama, Krista Hauseman, and Ananya Sahu with "AKA Innovation" Cooking traditional meat comes with concerns regarding food safety, perishability, and intensive meal preparation. Our company aims to commercialize ReadyGo Crumbles—an instant, plant-based protein packet that can be rehydrated to resemble ground meat and flavored to create a quick, easy meal. ReadyGo Crumbles comes in a package containing textured pea protein, along with flavoring packets containing sauces and/or spice blends. Textured pea protein (TPP) can be manufactured via extrusion, and subsequent rehydration imparts texture and chew to the protein, allowing for “crumbles” with the shape and appearance of ground beef and pork. ReadyGo Crumbles will be sold in its dry form, and consumers can add hot water and the accompanying flavor packet to prepare a protein dish in approximately five minutes, without the need for any cooking facilities or tools. The final protein dish can be eaten alone, or combined with any carbohydrate or vegetable, for a more complete, balanced meal. Compared with traditional meats, ReadyGo Crumbles is shelf-stable and easy to prepare, minimizing the time and effort needed to cook meals. Further, this product is sustainable, reducing the carbon footprint associated with meat consumption, and eliminating issues associated with meat storage and safety. Given that our primary value proposition is convenience, we aim to market towards busy college students, commuters, and adults on-the-go.

• Future undergraduate students
• Future transfer students
• Future graduate students
• Future international students
• Diversity and Inclusion Opportunities
• Learn abroad
• Living Learning Communities
• Mentor programs
• Programs for women
• Student groups
• Visit, Apply & Next Steps
• Information for current students
• Departments and majors overview
• Departments
• Undergraduate majors
• Graduate programs
• Integrated Degree Programs
• Additional degree-granting programs
• Online learning
• Academic Advising overview
• Academic Advising FAQ
• Academic Advising Blog
• Appointments and drop-ins
• Academic support
• Commencement
• Four-year plans
• Honors advising
• Policies, procedures, and forms
• Career Services overview
• Resumes and cover letters
• Jobs and internships
• Interviews and job offers
• CSE Career Fair
• Major and career exploration
• Graduate school
• Collegiate Life overview
• Scholarships
• Diversity & Inclusivity Alliance
• Anderson Student Innovation Labs
• Information for alumni
• Get engaged with CSE
• Upcoming events
• CSE Alumni Society Board
• Alumni volunteer interest form
• Golden Medallion Society Reunion
• 50-Year Reunion
• Alumni honors and awards
• Outstanding Achievement
• Alumni Service
• Distinguished Leadership
• Honorary Doctorate Degrees
• Nobel Laureates
• Alumni resources
• Alumni career resources
• Alumni news outlets
• CSE branded clothing
• International alumni resources
• Inventing Tomorrow magazine
• Update your info
• CSE giving overview
• Why give to CSE?
• College priorities
• Give online now
• External relations
• Giving priorities
• Donor stories
• Impact of giving
• Ways to give to CSE
• Matching gifts
• CSE directories
• Invest in your company and the future
• Recruit our students
• Connect with researchers
• K-12 initiatives
• Diversity initiatives
• Research news
• Give to CSE
• CSE priorities
• Corporate relations
• Information for faculty and staff
• Administrative offices overview
• Office of the Dean
• Academic affairs
• Finance and Operations
• Communications
• Human resources
• Undergraduate programs and student services
• CSE Committees
• CSE policies overview
• Academic policies
• Faculty hiring and tenure policies
• Finance policies and information
• Graduate education policies
• Human resources policies
• Research policies
• Research overview
• Research centers and facilities
• Research proposal submission process
• Research safety
• Award-winning CSE faculty
• National academies
• University awards
• Honorary professorships
• Collegiate awards
• Other CSE honors and awards
• Staff awards
• Performance Management Process
• Work. With Flexibility in CSE
• K-12 outreach overview
• Summer camps
• Outreach events
• Enrichment programs
• Field trips and tours
• CSE K-12 Virtual Classroom Resources
• Educator development
• Sponsor an event

Chemical Communications

Accessing pyrrolo[1,2-a]indole derivatives via visible-light-induced dearomatizative cyclization of indoles.

Pyrrolo[1,2-a]indoles are structurally important scaffolds in many natural products and bioactive compounds. Herein, we report a novel synthetic method for pyrrolo[1,2-a]indole derivatives through visible-light-induced cascade dearomatizative cyclization of indoles with external nucleophiles. Moderate yields, good diastereoselectivities, and excellent regioselectivities were generally observed with the resultant indole-fused polycyclic compounds.

Supplementary files

• Supplementary information PDF (6729K)
• Crystal structure data CIF (1784K)

Article information

Download citation, permissions.

Z. Liu, X. Ji, L. Duan, G. Deng and H. Huang, Chem. Commun. , 2024, Accepted Manuscript , DOI: 10.1039/D4CC01215A

To request permission to reproduce material from this article, please go to the Copyright Clearance Center request page .

If you are an author contributing to an RSC publication, you do not need to request permission provided correct acknowledgement is given.

If you are the author of this article, you do not need to request permission to reproduce figures and diagrams provided correct acknowledgement is given. If you want to reproduce the whole article in a third-party publication (excluding your thesis/dissertation for which permission is not required) please go to the Copyright Clearance Center request page .

Read more about how to correctly acknowledge RSC content .

Social activity

Search articles by author.

This article has not yet been cited.

Advertisements

🏀 WAY-too-early men's hoops Power 36

🐐 VanDerveer announces retirement

⚾️ How Parker Byrd returned to baseball with a prosthetic leg

Andy Katz | NCAA.com | April 10, 2024

Way-too-early 2024-25 men's basketball power 36 rankings.

I know it’s educated guessing, but so be it! Coaching changes still loom along with NBA decisions, and of course, the transfer portal. All are due to shake up teams across the country. Nevertheless, here is my way-too-early Power 36 for the 2024-25 season following UConn's second-straight and sixth national championship win. 

🏆 UCONN WINS 2024 TITLE:  How it happened

• Houston: J'Wan Roberts and L.J. Cryer are both expected to return and keep Houston near the top of the Big 12 and the nation's best. 
• Duke: Despite a few losses, the Blue Devils have the nation's No. 1 recruit in Cooper Flagg. 
• UConn: The back-to-back defending champs look to make it three in a row.
• Alabama: Nate Oates is poised to continue the momentum for the Crimson Tide after leading Alabama to its first Final Four. 
• Creighton: The Big East is loaded but Creighton always seems to find a way near the top under Greg McDermott. 
• North Carolina: Replacing the production of Armando Bacot and Cromac Ryan will be key, but Hubert Davis added five players from the portal last year and will likely be active again. 
• Iowa State: T.J. Otzelberger led the Cyclones to a second-place finish in the Big 12 in 2023-24 and has taken Iowa State to the Sweet 16 in two of his first three seasons as head coach. The Clones are in good hands.  
• Gonzaga: The Zags return most of their roster including their leading scorer in Graham Ike. 
• Kansas: Bill Self admitted to looking ahead to the 2024-25 season following KU's exit in the Round of 32. Look for Self to be active in the portal and the Jayhawks to have a bounce-back season. 
• Clemson: Ian Schieffelin is expected to return this fall and the Tigers look to build on the success from the 2023-24 season
• Tennessee: The Volunteers finished fifth in both the final AP poll and coaches poll of the season. Expect them to be near the top of the SEC again next season. 
• Arizona: Under Tommy Lloyd, the Wildcats have finished in the top 15 in offensive efficiency in each of Lloyd's first three seasons at the helm. 
• Purdue: The national runner-ups lose the national player of the year in Zach Edey, but do return key players in their backcourt such as Fletcher Loyer and Braden Smith who made up one of the most dynamic backcourts in the country.  
• Auburn: Perhaps the biggest question mark for the Tigers is whether Johni Broome will declare for the NBA draft. If he returns to Auburn, look out. 
• Illinois: The 2024 Big Ten tournament champs are in good hands under Brad Underwood who has rebuilt the program. 
• Baylor: The Bears have a good incoming freshmen class headlined by five-star VJ Edgecombe. 
• Florida: The biggest question mark is Walter Clayton Jr. who is testing NBA waters. 
• Texas A&M: Aggies return Wade Taylor who was named to the Naismith Player of the Year midseason team. 
• Dayton: The Flyers ranked 25th in the final AP poll of the 2024 season and starters Javon Bennett, Enoch Cheeks and Nate Santos all expected to return. 
• Boise State: A record six teams from the Mountain West got into the 2024 NCAA tournament including Boise State. Leon Rice has guided the Broncos to 10, 20-win seasons and has the program in good shape to build off of a strong 2023-24 season.
• Wisconsin: A.J. Storr entered the portal and Wisconsin will have to replace the production from the guard, but incoming freshman Daniel Freitag might see significant time and help returning Chucky Hepburn in another solid Greg Gard-led backcourt. 
• Xavier: The Musketeers had six freshmen who logged over 30% of the minutes played this season. That will pay dividends next season. 
• Ohio State : A new era for Ohio State (sort of) with former assistant Jake Diebler having his interim tag removed following the season. 
• Marquette: The Golden Eagles are expected to lose Tyler Kolek, but with Kam Jones and David Joplin back, Marquette will still be a very good team. 
• Michigan State: Tom Izzo always seems to find a way into the tournament. 
• Oregon: Will be interesting to see who makes it out of a tough Big Ten with realignment taking its shape in the fall, but Oregon has something to build on after winning the Pac-12 tournament in its final year.
• Seton Hall: The 2024 NIT champs return three starters under Shaheen Holloway who went 25-12 in his first year with a solid conference record of 13-7. 
• San Diego State: Brian Dutcher lost five key players following their run to the 2023 title game but that didn't stop them from putting together a solid 2023-2024 campaign. Look for them to do the same next season. 
• UCLA: Mick Cronin labeled 2023-24 as a "rebuilding year" for the Bruins but the foundation has been set once again and Cronin returns star sophomore Dylan Andrews and will likely be active in the portal. 
• Texas: The Longhorns bring in a good freshman class that ranked in the nation's top 75. 
• Saint Mary’s:  Star guards Augustas Marčiulionis and Aidan Mahaney should be back next season. 
• Nebraska: F red Hoiberg brought the Huskers back to the NCAA tournament for the first time since 2014 and returned two key starters Juwan Gary and Brice Williams.  
• Wake Forest: The Demon Deacons went 11-9 in what was a loaded ACC, and were an incredible 17-2 at home. I expect them to have a good offseason and be able to compete once again. 
• NC State: Kevin Keatts has a lot of work to do replacing DJ Horne and DJ Burns, but the Wolfpack should be able to continue to build off of 2023-24's tremendous tournament run to the Final Four.
• BYU: Looking to build off a successful first season in the Big 12 with the Cougars finishing 23-11 and earning a trip to the tournament. 
• Rutgers: The Scarlet Knights have two of the top five players in the freshmen class in Ace Bailey and Dylan Harper.

NCAA men's basketball champions from 1939 ➡️ today

Under consideration : Cincinnati, Villanova, Mississippi State, Maryland, Providence, Indiana, UNLV, New Mexico, Kansas State, Syracuse, Memphis, Minnesota, St. John’s, Colorado, Loyola-Chicago, VCU, Pitt, Northwestern, UAB, South Florida, Colorado State, Kentucky, Arkansas, Princeton, Vermont, Saint Louis, Miami, Georgia, South Carolina, Massachusetts, Richmond, Bradley, Northern Iowa.

College basketball rankings: Even unranked teams find success in the NCAA tournament

• What March Madness looked like the year you were born

March Madness: One stat shows AP No. 1 is far from a championship lock

March madness.

• 🗓️ 2024 March Madness schedule, dates
• 👀 Everything to know about March Madness
• ❓ How the field of 68 is picked
• 📓 College basketball dictionary: 51 terms defined

Greatest buzzer beaters in March Madness history

Relive Laettner's historic performance against Kentucky

The deepest game-winning buzzer beaters in March Madness history

College basketball's NET rankings, explained

DI Men's Basketball News

• 2025 Selection Sunday: Date, schedule, TV times
• From unranked to NCAA champion
• Way-too-early 2024-25 men's basketball Power 36 rankings
• Why the AP No. 1 team is far from a national championship lock
• Recapping all 67 March Madness games from 2024
• UConn builds a longstanding legacy with 6th national title, 'old school' methods
• Watch every ‘One Shining Moment’
• Men's Final Four Most Outstanding Players from 1939 to present
• Tracking 2024 March Madness men's records by conference

Follow NCAA March Madness