critical thinking requires a degree view of the situation

A Guide To Critical Thinking think.maresh.info

What is Critical Thinking?

Critical thinking is the art of analyzing and evaluating thinking with a view to improving it in order to make an informed decision that is most likely to result in desired effects .

Critical thinking describes a process of uncovering and checking our assumptions and reasoning. First, we analyze to discover the assumptions that guide our decisions, actions, and choices. Next, we check the accuracy of these assumptions by exploring as many different perspectives, viewpoints, and sources as possible. Finally, we make informed decisions or judgments that are based on these researched assumptions.

Life is a series of decisions, some small, some much larger. Whom we date or choose as friends, the work or career we pursue, which political candidates we support, what we choose to eat, where we live, what consumer goods we buy, if and whom we marry, if and how we raise children—all these decisions are based on assumptions. We assume our friends will be trustworthy and won't talk about us behind our backs. We assume our career choices will be personally fulfilling or financially remunerative. We assume politicians we vote for have our, or the community's, best interests at heart. We assume that the foods we choose to eat are healthy for us, and so on.

These assumptions are sometimes correct. At other times, however, the assumptions we base our decisions on have never been examined. Sometimes we hold these assumptions because people we respect (friends, parents, teachers, religious leaders) have told us they are right. At other times we have picked these assumptions up as we travel through life but can't say exactly where they've come from. To make good decisions in life we need to be sure that these assumptions are accurate and valid – that they fit the situations and decisions we are facing. Critical thinking describes the process we use to uncover and check our assumptions. Decisions based on critical thinking are more likely to be ones we feel confident about and to have the effects we want them to have.

Your Mental Models

Mental models are the filters we use to understand the world. A mental model is a representation of how something works. Everyday we encounter so much information that we cannot store it all and the phenomena we encounter are too complex to understand every detail. Therefore, we use filtering models to simplify the complex into organizable and understandable chunks, conceptual models to file and organize new information, and reasoning models to create new ideas and make decisions.

Mental models shape what we think, how we interpret what we value most, where we direct our attention, how we reason, and where we perceive opportunities. The quality of our thinking is only as good as the models in our head and their usefulness in a given situation. The best models improve our likelihood of making the best decisions. By critically examining our assumptions, we can adjust them to be in better accord with reality and they become more powerful mental models in the toolkit through which we understand reality.

All of us go through life with many incorrect core assumptions about reality. For example, most of us believe (1) we are perceiving reality accurately, (2) our perceptions are valid, and (3) that what is obvious to us must be obvious to others. Let that sink in for a minute: these are incorrect assumptions. It is simply not possible to perceive reality accurately and everyone's reality is different. Our sensory nervous system sends gigabytes per minute of data to the brain but the brain has the attentional bandwidth to process megabytes per minute. On top of that, we are always allocating some of our bandwidth to our thoughts (have you every been lost in thought and missed an important detail?). To improve our thinking, first we have to accept that our perceptions of the moment are filtered through mental models , that our most dearly held beliefs may not correctly describe reality, and be open to improving them.

Building your toolkit of mental models is a lifelong project. Stick with it, and you'll find that your ability to understand reality, accomplish your goals, deepen your relationships, and make the best decisions will always improve. Critical thinking is a set of reasoning tools that we use to improve our other models about the world. They are the foundation upon which we can build our best mental models. In the next section, you will find an overview of the reasoning tools described in this website.

Organization of this Resource

Learn to analyze the elements of reasoning.

The Critical Analysis page is dedicated to the first step in the process of developing critical thinking skills, recognizing elements of reasoning that are present in the mind whenever we reason. I categorize six elements of reasoning: purposes, questions, points of view, information, assumptions, and reasoning. Note how these elements are related in the following paragraph.

To take command of our thinking, first we need to clearly formulate both our purpose and the question at issue. To uncover truths, we need to make logical inferences based on sound assumptions and information that is both accurate and relevant to the question we are dealing with. We need to understand our own point of view and fully consider other relevant viewpoints. We also need to recognize problems created by bugs in the human operating system by formally working around them. These bugs can be categorized into two major categories, each of which has it's own page.

Fallacies of reasoning are found in unsound arguments that may sound persuasive on the surface.

Cognitive biases are a predictably systematic patterns of deviation rationality in judgment. Cognitive biases can lead to irrational thought through distortions of perceived reality, inaccurate judgment, or illogical interpretation. For example, confirmation bias is the tendency to interpret new evidence as confirmation of one's existing beliefs and filter-out information that does not confirm one's existing beliefs.

Learn to evaluate reasoning

The Critical Evaluation page describes the second step in the process of critical thinking, evaluating the quality of thought. We need to use concepts justifiably and follow out the implications of decisions we are considering.

Learn to avoid other common mistakes

No one is a master of every discipline, however there are some common misconceptions that people have of other disciplines that you should learn to avoid.

Additionally, I have created a page of common writing errors that I have observed in developing student writing.

Before submitting your writing, I suggest that you please consult these resources as checklists and verify that you have done your best to avoid these mistakes.

Critical Analysis

Analysis is the act of breaking something complex down into simpler parts that you examine in detail. To critically analyze a text or idea, identify its purpose, the question at issue, the author's point of view, the kinds of information involved, the reasoning, and the conclusions.

Unless a text is simply presenting information, it will often contain arguments. An argument is a series of statements that reach a logical conclusion that is intended to reveal the degree of truth of another statement. Arguments begin with premises (kinds of information) that are related to each other using valid forms of reasoning (a process) to arrive at a logical conclusion, new information. A logical conclusion is a new kind of information that is true in light of premises being true (if the premises are all facts) or seeming to be true (if the premises contain some opinions). A logical conclusion may be false, if the premises are false or the reasoning is poor.

1. Identify the Purposes

All texts or ideas have a purpose .

• What do you think the author wants us to do, think about, or believe?
• Periodically check that the text or you are still on target with the purpose

2. Identify the Questions at Issue

When reasoning is present, the author is attempting to figure something out, to answer some question, or to solve a problem.

• Take time to clearly and precisely state the question at issue
• Express the question in several ways to clarify its meaning and scope
• Break down the question into sub questions
• Identify if the question has one right answer, is a matter of opinion, or requires reasoning from more than one point of view

3. Identify Points of View

All reasoning is done from some point of view. We often experience the world in such a way as to assume that we are observing things just as they are, as though we were seeing the world without the filter of a point of view. Nonetheless, we also recognize that others have points of view that lead them to conclusions we fundamentally disagree with. One of the key dispositions of critical thinking is the on-going sense that, as humans, we always think within a perspective, that we virtually never experience things totally and absolutely. There is a connection, therefore, between thinking so as to be aware of our assumptions and intellectual humility. Therefore, it is often helpful to open your mind and involve other people (friends, family, work colleagues) who help us see ourselves and our actions from unfamiliar perspectives. Sometimes reading books, watching videos, or having new experiences such as traveling to other cultures, going to college, or being an intern help us become aware of our assumptions. It is equally important to recognize that one person's is biased by their world view and experiences, and therefore all points of view should be examined critically.

• Identify your point of view
• Identify author's point of view
• Compare and contrast differing points of view

4. Distinguish Types of Information

Uncritical thinkers treat their conclusions as something given to them through experience, as something they directly observes in the world. As a result, they find it difficult to see why anyone might disagree with their conclusions. After all, they believe that the truth of their views is right there for everyone to see! Such people find it difficult to describe evidence without interpreting it through their point of view. Critical thinking requires the ability to label types of information and evaluate their quality before accepting an argument.

Information is true if it is accord accord with reality. Since our knowledge of reality is always incomplete, in practice truth is measured by its accord with the best information we have about reality. All information has an associated degree of belief (a feeling about truth) or confidence (the scientific term for statistical likelihood of truth) in its truth value. When analyzing, we are simply categorizing rather than evaluating the quality of the information.

All arguments are based on information. Premises are information that is used in the context of an argument. Information can be classified with four characteristics that describe the context in which it is used.

1. Evidence is information upon which conclusions are based. There are two categories of evidence:

• Facts (objective truth)
• Opinions (a feeling about the truth)

2. Assumptions are statements that we accept as true without proof or demonstration.

3. Conclusions are the results or reasoning, irrespective of their truth value.

4. Propaganda is information that is not objective and is used primarily to influence an audience and further an agenda

4A. Identify Evidence

Evidence is information that is relevant to question at issue. Both facts and opinions are evidence.

• Unless necessary facts unavailable, you should restrict your evidence to facts, verifiable information.
• Restrict your conclusions to those supported by the evidence you have.

A fact is an accurate description of an object, event, or statement that is independently verifiable by empirical means .

There are two distinct senses of the word "factual." The word may refer to a verified fact. However, "factual" may also refer to claims that are "factual in nature" in the sense that they can be verified or disproven by observation or empirical study, but those claims must be evaluated to determine if they are true. People often confuse these two senses, even to the point of accepting as true, statements which merely "seem factual", for example, "29.23 % of Americans suffer from depression." Before I accept this as true, I should assess it. I should ask such questions as "How do you know? How could this be known? Did you merely ask people if they were depressed and extrapolate those results? How exactly did you arrive at this figure?"

Purported facts should be assessed for their accuracy, completeness, and relevance to the issue. Sources of purported facts should be assessed for their qualifications, track records, and impartiality. Many students have experienced an education which stressed retention and repetition of factual claims. Such an emphasis stunts students' desire and ability to assess alleged facts, leaving them open to manipulation. Likewise, activities in which students "distinguish fact from opinion" often confuse these two senses. They encourage students to accept as true statements which merely "look like" facts.

To identify facts, look for these signal words in italics: "The annual report confirms ...," "Scientists have recently discovered ...," " According to the results of the tests...," "The investigation demonstrated ... "

Credible facts reference the observer of the information. You should accept a fact only after you have identified confirmation by many different independent observers and evaluated their credibility and potential bias. Even before this evaluation, you should reject a fact that does not have a clear source

As an example, in the debate we watched, Nick Gillespie says, "[drugs are] not addictive for 99 percent of people." This is factual only in the sense that may be empirically possible to measure, but you should not accept this as fact without more context such as a source.

If you have the opportunity, ask someone, "where did you get that information?" to give them the chance to confirm a fact. Until, you actually understand the limits and source of the fact, you should regard the information as suspicious and categorize it as an opinion that someone believes is true.

An opinion is a statement that expresses either how a person feels about something or what a person thinks is true . With objective verification, opinions can become facts. If they cannot be proven or disproven, they will always be opinions.

Since we cannot examine the facts in all situations, sometimes we must rely on an opinion as evidence in an argument. Any conclusion derived from an argument that uses an opinion in place of a fact will generally be less reliable. You should always acknowledge such uncertainty when presenting such a conclusion.

• Look for these signal words in italics: "He claimed that...," "It is the officer's view that...," "The report argues that...," "Many scientists suspect that... "
• Some opinions are more reliable than others. An opinion that is based on the objective consideration of a large amount of incomplete information will be more reliable than an opinion based on one observation and a feeling.
• Understand that things are not always as they appear to be. At times, writers, whether consciously or not, will frame opinion as fact and vice versa.
• Note that statements can contain both fact and opinion. They should be separately when analyzing an argument.

4B. Identify Assumptions

An assumption is a statement that we accept as true without proof or demonstration. It is an unstated premise, presupposition, or opinion that is required to connect data to conclusions.

All human thought and experience is based on assumptions. Our thought must begin with something we believe to be true in a particular context. We are typically unaware of what we assume and therefore rarely question our assumptions. Much of what is wrong with human thought can be found in the uncritical or unexamined assumptions that underlie it. Identifying and evaluating accuracy and validity of assumptions is arguably the most important application of critical thinking. Accurate and valid assumptions can become facts.

Assumptions are often very difficult to identify. Usually they are something we previously learned and do not question. They are part of our system of beliefs. We assume our beliefs to be true and use them to interpret the world about us.

This packet of exercises has many excellent examples assumptions identified in short scenarios.

4C. Identify Conclusions

Conclusions are the results or reasoning.

In logic, conclusions can be categorized based on their truth value:

• Sound conclusions result from true premises and valid reasoning.
• Unsound conclusions result from false premises and/or invalid reasoning.

Additionally, conclusions are often categorized as either:

• accurate/inaccurate based on the truth of the premises
• logical/illogical based on the quality of the reasoning
• justified/unjustified based on whether or not the truth value has been critically evaluated

Conclusions also can be categorized based on their role in an argument:

• Inferences (conclusions from a single step of reasoning that are used as a premise in a successive argument)
• Drawn conclusions (conclusions that relate back to the question at issue)

It should be noted that different disciplines that study human thought (i.e. philosophy, cognitive psychology, artificial intelligence, etc.) define the distinction between a conclusion and an inference differently. To avoid confusion, I will make the following distinctions. When analyzing reasoning, a logical conclusion refers to the result of any argument. When analyzing a complex argument focused on a question at issue, an inference is a logical conclusion drawn from a single step in reasoning and may be used as information in the premise of a successive step of reasoning. A drawn conclusion describes a logical conclusion that specifically answers the question at issue by logically relating many inferences as premises. The example in this article, effectively illustrates my distinction between an inference and drawn conclusion (Note that other sources may define these word in the exact opposite way!).

Conclusions are generally straight-forward to identify in context. When analyzing a complex argument focused on a complex question at issue, inferences are often made implicitly in the course of reasoning. For this reason, an inference may be more difficult to identify. Critical thinkers try to monitor their inferences to keep them in line with what is actually implied by what they know. When speaking, critical thinkers try to use words that imply only what they can legitimately justify. They recognize that there are established word usages which generate established implications.

• If we assume that it is dangerous to walk late at night in big cities and we move to Chicago, we will infer that it is dangerous to go for a walk late at night in Chicago. We probably take for granted our assumption that it is dangerous to walk late at night in big cities and in Chicago implicitly.
• To infer that an act that was murder, is to infer that it was intentional and unjustified. The implications of this inference are severe, thus sufficient evidence must exist to justify this opinion or fact.

A helpful tool is to first identify an inference (what do we infer from the situation being evaluated?) then identify an assumption that is the premise to that inference ("If the inference is true, what did I assume about the situation?"). Often an assumption you identify this way is an inference that can be further unpacked by repeating the second step to identify deeper core assumptions.

Situation: I heard a scratch at the door. I got up to let the cat in.

Inference: I inferred that the cat was at the door.

Ask: If that is true, what did I infer about the situation?

Assumptions: Only the cat makes that noise, and he makes it only when he wants to be let in.

Since different people can have difference assumptions, they will make different inferences about the reality of the same situation.

4D. Identify Propaganda

Propaganda is a special category of information that is not objective and is used primarily to influence an audience to reach a specific conclusion. Propaganda attempts to arouse emotions and biases to short-circuit rational judgment. The author of propaganda deliberately designs an argument that does not hold up to critical thinking. It's use indicates an intent to, at worst mislead, or at best persuade without the use of reasoning. Whether or not propaganda is ethical is a personal and context-dependent value judgment that is separate from critical thinking.

Students often find analysis of propaganda to be confusing because it is an extra feature of information, rather than its own type. Information that is propaganda can be any non-objective type (opinion, assumption, and/or inference) if it is deliberately used to manipulate opinions using poor reasoning. Moreover, propaganda quite utilizes poor reasoning—it often employs logical fallacies or takes advantage of cognitive biases to mislead.

The following is a list of common propaganda techniques:

• Bandwagon . It aims at persuading people to do a certain thing because many other people are doing it. An example can be a soft drink advertisement wherein a large group of people is shown drinking the same soft drink. People feel induced to opt for that drink as it is shown to be consumed by many. Similarly, by simply declaring without evidence that something is America's Favorite, significantly increases sales. Snob appeal is the reverse of bandwagon. It indicates that buying a certain product will make you stand out from the rest, as the masses won't afford to buy it.
• Card Stacking Propaganda. Now, this technique is perhaps most popularly used. It involves the deliberate omission of certain facts to fool the target audience. The term card stacking originates from gambling and occurs when players try to stack decks in their favor. A similar ideology is used by companies to make their products appear better than they actually are. Most brands use this propaganda technique to downplay unsavory details about their products and services. For instance, some companies may cleverly conceal "hidden charges" and only talk about the benefits of their products and services. Changing the shape of french fries so that one pays more for less food, still doesn't change the fact that eating fried food is unhealthy.
• Glittering Generalities Propaganda uses emotional appeal or/and vague statements to influence the audience. Advertising agencies thus use of phrases like as "inspiring you from within" or "to kick-start your day" to create positive anecdotes. This makes the product look more appealing, resulting in better sales.
• Hacking Identity: The Pride-Fear-Outrage-Hatred Formula. Critically examine when identity categories become significant to an argument. In some cases it may be appropriate, in others it may be an emotionally manipulative red herring.
• Example: In recent years, the Russian government has planted appeals to pride to amplify difference and strengthen online social communities. This is then followed by stories designed to invoke fear and outrage. A 2018 report to the United States Senate Select Committee on Intelligence details how these tactics are apparently designed to "hack" the minds of citizens in democratic nations into feeling disillusioned with social and political institutions. The goal is to weaken democratic participation and nudge countries towards increasingly pro-authoritarian values.
• Repetition. It is when the product name is repeated many times during an advertisement. This technique may use a jingle, which is appealing to the masses and fits in their minds. This takes advantage of the illusory truth effect, a cognitive bias that is encapsulated in the old adage, "if you tell a lie big enough and keep repeating it, people will eventually come to believe it." It is an unfortunate reality that the Internet is often used to make make untrue information seem true by repetition.
• Slogans. A slogan is a brief, striking phrase that may include labeling and stereotyping. Although slogans may be enlisted to support reasoned ideas, in practice they tend to act only as emotional appeals. Opponents of the US's invasion and occupation of Iraq use the slogan "blood for oil" to suggest that the invasion and its human losses was done to access Iraq's oil riches. On the other hand, supporters who argue that the US should continue to fight in Iraq use the slogan "cut and run" to suggest withdrawal is cowardly or weak. Similarly, the names of the military campaigns, such as "enduring freedom" or "just cause" can also be considered slogans, devised to influence people.
• Testimonial propaganda is popular advertising technique that uses renowned or celebrity figures to endorse products and services. Now in this case, when a famous person vouches for something, viewers are likely to take account of the credibility and popularity of that person. Watch Drake's Sprite commercial as an example.

Wikipedia has an extensive list of propaganda techniques with numerous examples.

5. Analyze Reasoning

The identification of poor reasoning invalidates the conclusion of an argument. The conclusion of the argument may or may not be true. You must formulate an alternative valid argue ment to support the conclusion.

5A. Identify Logical Fallacies

Fallacies are faulty reasoning used in the construction of an argument. This topic is so vast that I have created a separate fallacies of reasoning page.

5B. Identify Cognitive Biases

A cognitive bias is a cognitive shortcut that leads to a loss of objectivity. Cognitive biases can lead to irrational thought through distortions of perceived reality, inaccurate judgment, or illogical interpretation. By learning about some of the most common biases, you can learn and how to avoid falling victim to them.

The identification of cognitive biases at work in an argument should make you skeptical. Like fallacies, this topic is so vast that I have created a separate cognitive biases page to explain them.

Critical Evaluation

After we have cataloged the elements of reasoning, we must evaluate texts and our own reasoning for clarity, accuracy, precision, relevance, depth, breadth, significance, logic, and fairness. When making a decision with incomplete information, it is critical to recognize that truth is often a degree of belief based on our evaluation of the quality of the information and reasoning .

1. Evaluate point of view

• Playing the devil's advocate by arguing from a different point of view is a powerful exercise
• After reading a text, examine how much influence the author's point of view had on you

 Critically evaluate the reliability of an author (and publisher):

• What qualifications does the author have for writing on this subject? (Or what are the qualifications of the people the author quotes?)
• Based on your research on the author's background, what factors may have influenced his or her point of view?
• When and where was the article first published? Does this information affect the credibility of the article?

  Compare and contrast points of view to reveal how related material is presented by different authors and different purposes of their writing. After reading two texts on the same topic, ask yourself:

• What is the author's point of view in each of these articles?
• Why do you think that the points of view presented are so different?
• How much influence did each author's point of view have on you?

1A. Evaluate a Scientific Author's Qualifications

• Examine the primary source of information . ls there a reference to the source of information? If not, it cannot be verified. If so, is the source reputable?
• Examine the reputation of the author . Do the author(s) have training in science? If so, have they had formal training leading to an advanced degree such as a Master's degree or doctorate, and have they published widely in reputable journals? If not, then are they working with a reputable scientist(s) to evaluate the data?
• Does the discoverer say that a powerful establishment is trying to suppress his or her work? Often, the discoverer describes mainstream science as part of a larger conspiracy that includes industry and government. The idea is that the establishment will presumably stop at nothing to suppress discoveries that might shift the balance of wealth and power in society. This is not how science actually works. Science is an open and international enterprise focused on uncovering true descriptions of reality.
• Determine if the work was published in a peer-reviewed journal . Peer review is the standard process for scientific publications. Peer-reviewed manuscripts have been read by several scholars in the same field (called peers), and these peers have indicated that the experiments and conclusions meets the standards of their discipline and are suitable for publication. In the absence of peer-review the significance and quality of the data cannot be assessed.
• Has the discovery been pitched directly to the media? The integrity of science rests on the willingness of scientists to expose new ideas and findings to the scrutiny of other scientists. Thus, scientists expect their colleagues to reveal new findings to them initially. An attempt to bypass peer review by taking a new result directly to the media, and thence to the public, suggests that the work is unlikely to stand up to close examination by other scientists.
• Check if the journal has a good reputation for scientific research . If a peer-reviewed paper is cited, where was it published? Is the journal widely respected? One tool that is commonly used for ranking, evaluating, categorizing, and comparing journals is the frequency with which the "average article" in a journal has been cited in a particular year or period. The frequency of citation reflects acknowledgment of importance by the scientific community. High-impact and widely respected journals include Science and Nature. Therefore, a citation in Science generally suggests scholarly acceptance, whereas publication in a nonscientific or little-known journal does not.
• Determine if there is an independent confirmation by another published study . Even if a study is peer-reviewed and published in a reputable journal, independent assessment is critical to confirm or extend the findings. Even the best journals or scientists will occasionally make mistakes and publish papers that are later retracted. Sometimes there may be outright fabrication that is overlooked by the reviewers and not detected until later. In other cases, the scientific report may be accurate but its significance may be misrepresented by the media. Although it is a slow process ro establish a scientific "truth," a particular scientific conclusion will eventually either gain broad acceptance or be discarded.
• Assess whether a potential conflict of interest exists . Most of the high-impact journals require a conflict of interest statment on the first page of an article.
• Assess the quality of institution or panel . Does the report emanate from a University accredited by the U.S. Department of Education or equivalent society? Such information is generally more reliable than that issued from a single individual putting information out on the web. In the United States, government research arms such as the National Science Foundation and the National Institute of Health and professional scientific societies generally provide up-to-date, high-quality information.

2. Evaluate of Degree of Truth in Information

After analyzing to identify the different kinds of information, we must be explicit about the quality of each piece of information used in the text or our own thinking. Using the highest quality information in arguments increases the degree of belief in the truth of the argument. We must acknowledge when poor quality information is used in an argument and clearly state that we have low confidence in the truth of the argument.

• Search for information that opposes your position as well as information that supports it
• Make sure that all information used is clear, accurate, and relevant to the question at issue
• Make sure you have gathered sufficient information
• We can have the most confidence in facts that have been confirmed by many different independent observers.

A scientist's perspective on facts

In everyday language most of us consider a confirmed fact to be truth. However, scientists consider all truth to be provisional, the current facts serve as description of truth only for the time being. Scientists assume that all knowledge has the potential to be overturned if new information suggests that it should be. Scientists use the uncertainty and percent confidence to describe the statistical likelihood that a fact is true.

Physicist Richard P. Feynman once said, "In physics and in human affairs... whatever is not surrounded by uncertainty, cannot be the truth." He said this in reference to a newspaper article that asserted absolute belief in a scandalous rumor regarding a colleague. He observed that a responsible reporter should have referred to an "alleged incident." With no reference to a process that had first evaluated the quality of the truth, he considered accusation to be opinion, not fact.

• Is a particular measurement 78 ± 50 or 78 ± 1 meters? As you can see, the uncertainty deeply affects how you will use that information.
• It is a scientific formalism that any measurement missing a stated uncertainty has an uncertainty of ±1 in a last significant digit. Therefore, 78 seconds is understood to be 78 ± 1 seconds and 78.0 seconds is 78.0 ± 0.1 seconds.
• "The crash test results indicate a 98% chance that a head-on collision will kill you. As a professional scientist I cannot say that a head-on collision will kill you."

This last example highlight the property that all scientific information is actually a statement probability . Nothing in science is ever "proven" or "100% certain." Always avoid saying that science has proven something. This is a discipline-specific error in reasoning commonly made by non-scientists. Non-scientists sometimes misinterpret when scientists attach uncertainty to every fact. If there is 95% confidence that climate change is being caused by human activity, people with a psychological bias to avoid taking action around this crisis may focus on the 5% uncertainty in the truth value. On the other hand, people who are convinced of this fact and want to take action get frustrated that scientists refuse to say that it has been proven, we are certain. In practice, 95% confidence in science is the gold standard for a complex phenomenon being "as good as proven," but scientists always keep open the possibility that they don't have all the data and keep open the possibility that this fact may be more nuanced or simply wrong in the future.

Comparing and Contrasting Information

By comparing and contrasting information, you can identify facts, make inferences, and draw conclusions that would not otherwise be possible. After reading two texts, ask yourself:

• How do the articles differ in the information each one presents?
• Are the articles different in how they present information?
• Does the information appear to be complete and accurate? Why or why not?

2. Evaluate assumptions

[Unfinished]

Contrasting Assumptions

If two sides are arguing from different assumptions, it is very effective to focus on these in critical evaluation. Controversies generally rest on different sides interpreting the same information through different assumptions.

Assumptions, can be unjustified or justified, depending upon whether we do or do not have good reasons for them. Likewise, if two sides of a controversy share assumptions that are found faulty, both arguments become invalid.

• Ethan Nadelmann, founder and executive director of the Drug Policy Foundation, argues that law enforcement officials are overzealous in prosecuting individuals for marijuana possession citing that 87% of marijuana arrests are for possession of small amounts.
• The Office of National Drug Control Policy (ONDCP) contends that marijuana is not a harmless drug and must remain restricted. Besides causing physical problems, marijuana affects academic performance and emotional adjustment.
• Underlying both of their arguments is the assumption that adults cannot be permitted to make their own decisions about the use of particular drugs as they choose. A libertarian who worries about governmental restrictions on personal liberty would immediately recognize this shared deep assumption and challenge it. If convincingly challenged, both arguments lose validity.

3. Evaluate reasoning

When an argument doesn't "feel" right, first analyze it as follows. Write down the information that forms each premise of the argument and categorize them. Write down the conclusion and label it. Write your best general description of the reasoning that links them. The mechanics of the reasoning are usually found in a "therefore" type statement. To unmask the logic, replace the premise statements with letters that represent concepts and properties. Example: "It's raining and the sun is shining, therefore it's raining." The logical form is "X has property Q and P, therefore X has property Q". The logic is sound. [I will link some more examples later.]

3A. Logical Fallacies

Fallacies are faulty reasoning used in the construction of an argument. This topic is so vast that I have created a separate fallacies of reasoning page. The identification of fallacious reasoning invalidates an argument and we then forced to formulate our own arguments to uncover truth.

3B. Evaluate Propaganda

Propaganda is information that is not objective and is used primarily to influence an audience to reach a specific conclusion. Propaganda attempts to arouse emotions to short-circuit rational judgment. It is not by definition "good" or "bad." However, it's use indicates possible intent to, at worst mislead, or at best persuade without the use of reasoning. The techniques of propaganda are utilized in some logical fallacies and you will find some conceptual overlap. The following is a list of common propaganda techniques:

• Hacking Identity: The Pride, Fear, Outrage, Hatred Formula. Critically examine when identity categories become significant to an argument. In some cases it may be appropriate, in others it may be an emotionally manipulative red herring. Example: In recent years, the Russian government has planted appeals to pride to amplify difference and strengthen online social communities. This is then followed by stories designed to invoke fear and outrage. The effort is apparently designed to "hack" the minds of people in democratic nations into feeling disillusioned with social and political institutions.
• Stereotyping. People or objects are lumped together under simplistic labels, also called labeling. Example: Blonde women are beautiful, but dumb.
• Overgeneralizations . Treating a complex general thing as if it were a concrete thing. Example: " The UN's bureaucracy has forsaken its commitment... " or " The City extends strike deadline."

3C. Evaluate Cognitive Biases

A cognitive bias is a cognitive shortcut that leads to a loss of objectivity. Cognitive biases can lead to irrational thought through distortions of perceived reality, inaccurate judgment, or illogical interpretation. By learning about some of the most common biases, you can learn and how to avoid falling victim to them. The identification of cognitive biases at work in an argument should make you skeptical. Like fallacies, this topic is so vast that I have created a separate cognitive biases page to explain them.

4. Evaluate Judgments and Conclusions

After you read an article, you should be able to answer these questions:

• What judgments and conclusions were drawn by the author of this article?
• Are their faults of reasoning that make the drawn conclusion unjustified?
• Does the drawn conclusion challenge your assumptions?
• What other drawn conclusions are possible to draw using the same information?
• What other information might be important to know before making any judgment on the value and importance of this text?

5. Predict future Implications and Consequences

The alignment of reasonable future implications and consequences of a conclusion or judgment with your values should inform your reasoning.

• Trace the implications and consequences that follow from your reasoning
• Search for negative as well as positive implications
• Attempt to consider all possible consequences

Fallacies are faulty reasoning used in the construction of an argument . They make an argument appear to be better than it is. Here are some major fallacies of reasoning that you be able to recognize. All of the following fallacies are known as informal fallacies because they originate in a reasoning error. In contrast, formal fallacies , also known as non sequiturs, arise from the logical form of the argument. The following article introduces the most common fallacies.

In this video example we see rapid fire deployment of straw man, false dichotomy, and some formal fallacies on a kid who, impressively, recognizes each flaw of reasoning.

Identifying fallacies

Remember that arguments begin with premises that are related to each other using valid forms of reasoning to arrive at a logical conclusion .

Once you have analyzed the parts of an argument, evaluate:

Is the reasoning faulty?

• If the error in the argument is in the logical connection between two premises in drawing a conclusion it is likely to be a formal fallacy, also known as a non sequitur.
• If the truth revealed by the conclusion is a cause-effect relationship, it may be a questionable cause fallacy.
• Does the reasoning neglect many other possibilities? The argument might be a false dilemma or slippery slope fallacy.

Is/are the premise(s) faulty?

• If the premise of the argument must assume the conclusion to be true then read the section on improper premise fallacies.
• If weak premises and incomplete information lead to a strong conclusion, the argument contains a weak premise fallacy, also known as a faulty generalization.

Are the premises and/or the arguments a distraction from the actual issue in question?

• If any part of the argument is irrelevant to the actual issue, a relevance fallacy or red herring is at work.

Are you still not able to identify the error in reasoning?

• Consult the comprehensive list of fallacies at Wikipedia or ask your instructor for assistance.

Formal Fallacies (Non Sequiturs)

An error in the argument's form. Invalid logic is applied to the premises.

Fallacy fallacy. This is the inferrence that an argument containing a fallacy must have a false conclusion. It is entirely possible for someone to pose a bad argument for something that is true. Try not to get so caught-up in identification of logical fallacies that you are quick to dismiss a flawed argument—instead, try to make the argument reasonable.

• Example: "Some of your key evidence is missing, incomplete, or even faked! That proves I'm right!"

Syllogistic fallacies. There are many kinds of these. Syllogisms are generally three step arguments that use two premises to derive a conclusion. The premises and conclusion all take the form of categorical propositions that somehow relate two categories. These fallacies derive from incorrect application of logic. These fallacies are often more obvious if you draw a Venn diagram of the categories and shared features.

• Example: "All birds have beaks. That creature has a beak. Therefore, that creature is a bird."
• Form: All Z is B. This Y is B. Therefore, all Y is Z.
• Problem: B cannot be generalized as an exclusive feature of Z. Y could be an octopus.
• Example: "People in Kentucky support a border fence. People in New York do not support a border fence. Therefore, people in New York do not support people in Kentucky."
• Form: All Z is B. All Y is not B. Therefore, all Y is not Z.
• Problem: From the lack of shared B, nothing more can be logically implied about the features of either Z or Y. Z and Y may in fact agree on the desired outcomes for the question at issue but disagree over the means for achieving the outcomes.

Informal Fallacies

The proposed conclusion is not supported by the premises.

Whereas formal fallacies can be identified by form, informal fallacies are identified by examining the argument's content. There are many subcategories.

Improper Premise Fallacies

Any form of argument in which the conclusion occurs as one of the premises.

Begging the question. Providing what is essentially the conclusion of the argument as a premise. You assume without proof the stand/position that is in question. To "beg the question" is to put forward an argument whose validity requires that its own conclusion is true. Formally, begging the question statements are not structured as an argument and are harder to detect than circular arguments. Some authors consider circular reasoning to be a special case of begging the question. In the following examples, notice that the question at issue answers itself without argument.

• Example: "This whole abortion debate about when human life begins is ridiculous. We should be thinking about the rights of the baby."
• The question at issue: Should with examine when rights begin under the law? Premise: Rights begin after a baby is born. Conclusion: The debate is ridiculous.

Circular reasoning. Formally, circular reasoning differs from begging the question by specifically referring to arguments in which the reasoner simply repeats what they already assumed beforehand in different words without actually arriving at any new conclusion. Circular reasoning is not persuasive because a listener who doubts the conclusion will also doubt the premise that leads to it. This may sound silly, but people make such statements quite often when put under pressure.

• "Whatever is less dense than water will float, because such objects don't sink in water."
• "Of course smoking causes cancer. The smoke from cigarettes is a carcinogen."
• "The rights of the minority are every bit as sacred as the rights of the majority, for the majority's rights have no greater value than those of the minority."
• "Everyone wants the new iPhone because it is the hottest new gadget on the market!"
• Note that this could be factually true in the situation that popularity was the sole driver of consumer desire for the new iPhone. Even so, it is still a fallacy of circular reasoning because its popularity must be logically explainable for reasons other than the conclusion.
• Video example

Loaded question . Asking a question that has an assumption built into it so that it can't be answered without appearing guilty.

• Example: Prosecutor to defendant: "So how did you feel when you murdered your wife?"
• The question at issue: Did the suspect murder his wife? Premise: "you murdered your wife." Conclusion: "you murdered your wife." Possible responses: Any answer that the defendant gives to "how did you feel?" could construed as admission that he murdered his wife. The best response is to point-out the fallacy and refuse to answer the question as stated.

Weak Premise Fallacies

These reach a conclusion from weak premises. Unlike fallacies of relevance, the premises are related to the conclusions and yet only weakly support the conclusions. A faulty generalization is thus produced.

Cherry Picking / Card Stacking. The presentation of only that information or those arguments most favorable to a particular point of view.

• Example: "I'm a really good driver. In the past thirty years, I have gotten only four speeding tickets." (What other kind of tickets has he gotten? How long has he been driving?)

Faulty/Weak analogy. Comparison is carried too far, or the things compared have nothing in common.

• Example: Apples and oranges are both fruit. Both grow on trees. Therefore, apples and oranges taste the same.

Hasty Generalization (from an Unrepresentitve Sample). A judgment is made on the basis of inaccurate or insufficient evidence. They are extremely common because there is often no agreement about what constitutes sufficient evidence. Generalization from one person's experience is a common example of this fallacy.

• Example: "My grandfather smoked four packs of cigarettes a day since age fourteen and lived until age ninety-two. Therefore, smoking really can't be that bad for you."
• Example: "Ducks and geese migrate south for the winter. Therefore, all water-fowl migrate south for the winter."

No True Scotsman . Making what could be called an appeal to purity as a way to dismiss relevant criticisms or flaws of an argument.

• Example: Angus declares that Scotsmen do not put sugar on their porridge, to which Lachlan points out that he is a Scotsman and puts sugar on his porridge. Furious, like a true Scot, Angus yells that no true Scotsman sugars his porridge.

Questionable Cause Fallacies

The primary basis for these errors is either inappropriate deduction (or rejection) of causation or a broader failure to properly investigate the cause of an observed effect.

Correlation Without Causation / Cum Hoc. A faulty assumption that, because there is a correlation between two variables, one caused the other.

• Coincidence. The two variables aren't related at all, but correlate by chance.
• Third Cause. A third factor is the cause of the correlation. Example: Young children who sleep with the light on are much more likely to develop myopia in later life. Therefore, sleeping with the light on causes myopia. (In 1999, this was conclusion was popularized by the media from a study containing such a correlation. It is more likely that myopia has a genetic cause and myopic parents use nightlights because they have poor night vision without their glasses.)
• Wrong direction . Cause and effect are reversed. Example: The faster windmills are observed to rotate, the more wind is observed to be. Therefore wind is caused by the rotation of windmills. Real Life Example: When a country's debt rises above 90% of GDP, growth slows. Therefore, high debt causes slow growth.

Gamblers Fallacy. The incorrect belief that separate, independent events can affect the likelihood of another random event.

• Example: After having multiple children of the same sex, some parents may believe that they are due to have a child of the opposite sex. (In reality, the probability is still 0.5.)

False Cause / Post Hoc. Treating coincidence of one event following another as causation.

• Example: Every time we wash our car, it rains. Therefore, if we wash our car today, it will rain.
• Example: Specific vaccinations are given at the same age that obvious symptoms of autism typically manifest. When some parents see their children diagnosed with autism shortly after receiving vaccinations they assume that the vaccinations caused the autism (even though the autism could have been diagnosed by a professional

Single Cause Fallacy / Causal Oversimplification. It is assumed that there is one, simple cause of an outcome when in reality it may have been caused by a number of only jointly sufficient causes or a third cause.

• Example: The "Gateway Drug Theory" argues that marijuana usage leads to usage of harder drugs and has been a major justification for why marijuana laws should be highly restrictive. However, the same data could be explained by marijuana simply being easier to obtain and therefore more likely to be the first drug tried by people who were likely to become hard drug users for many other reasons such as genetic factors or simple illegality of marijuana making it attractive to risk-taking people.
• Example: Traffic fatalities were cut when the highway speed limit was reduced to 55 mph Therefore, the lower speed limit has resulted in safer highways. (The fact that people are driving less and seat belt laws were also passed may be equally or more important.)

Relevance Fallacies

These are distractions from the argument typically with some distracting sentiment that seems to be relevant but isn't really on-topic. Red Herrings are a specific sub-category Relevance fallacy that is distinguished by an intent to mislead often due the lack of a real argument.

Ad Hominem Argument . Rejection of a person's view on the basis of personal characteristics, background, physical appearance, or other features irrelevant to the argument at issue. Pay close attention to words that question an opponent's character. Examples: slob, prude, moron, embarrassing, stubborn.

Ambiguity . Using double meanings or other ambiguities of language to mislead or misrepresent the truth. Meaning in language can be so slippery that there are at least a dozen sub-fallacies including ambiguous grammar, equivocation, and quoting out of context (a tactic most often encountered on the Internet).

Appeal to Authority. This fallacy happens when we misuse an authority. This misuse of authority can occur in a number of ways. We can cite only authorities — steering conveniently away from other testable and concrete evidence as if expert opinion is always correct. Or we can cite irrelevant authorities, poor authorities, or false authorities.

Appeal to Emotion. The use of non-objective words, phrases, or expressions that arouse emotion having the effect of short-circuiting reason. Common examples include appeals to fear, flattery, outrage, pity, pride, ridicule of opponent's argument, spite, wishful thinking. Emotional appeals are also a powerful tool in propaganda.

• Example: A commercial for a security company that shows someone breaking into a home in the middle of the night.
• Example: "Any intelligent person knows... " (appeal to pride).

Appeal to Nature. Any argument that assumes "natural" things are "good" and "unnatural" things are "bad" is flawed because concepts of the natural, good, and bad are all vague and ambiguous. The person creating the argument can define these in any way that supports their position. Appeals to Nature also employ the begging the question fallacy (above).

• Example: This tobacco ad claims that their product is more natural and thus better for you.
• Example: This ad attempts to convince the reader that margarine, one the most processed foods in a grocery store, is natural and aligns with the readers assumed yearning for a simpler, better life in the country.
• The marketing copy for products in a store like Whole Foods is rife of appeals to Nature. Practice spotting them.

Argument from ignorance / burden of proof. It asserts that a proposition is true because it has not yet been proven false or a proposition is false because it has not yet been proven true. This type of argument asserts a truth and shifts the burden of providing counter-evidence onto someone else. Logically, we should remain skeptical and demand legitimate evidence from the person asserting the proposition.

• Example of two contradictory positions using this fallacy: "No one has ever been able to prove definitively that extra-terrestrials exist, so they must not be real." "No one has ever been able to prove definitively that extra-terrestrials do not exist, so they must be real."
• Video Example

Argument from incredulity (appeal to common sense) . Saying that because one finds something difficult to understand that it's therefore not true.

Association fallacy. Inferring either guilt or honor by association. It is an irrelevant attempt to transfer the qualities of one thing to another by merely invoking them together. Sometimes fallacies of this kind may also be appeals to emotion, hasty generalizations, and/or ad hominem arguments.

• Example: An attractive spokesperson will say that a specific product is good. The attractiveness of the spokesperson gives the product good associations.
• Example: "Galileo was ridiculed in his time but later acknowledged to be right. Likewise, Dr. Andrew Wakefield's work demonstrating that vaccines cause autism will later be recognized as correct too." (Taking an unpopular position is no guarantee of its correctness. Additionally, the two scenarios are not comparable. Galileo was ridiculed by the Catholic Church. His scientific peers generally confirmed his work. In contrast, Dr. Wakefield's scientific peers have failed to replicate his observations and have invalidate his conclusions based on methodological flaws. The source of negative public opinion around Dr. Wakefield derives from valid expert criticism.)

Bandwagon / FOMO. The use of the fear of being "different" or "missing-out" is used to influence behavior.

• Example: "Twenty million people jog for their health. Shouldn't you?

Genetic fallacy . Judging something good or bad on the basis of where it comes from, or from whom it comes.

• Example: "You're not going to wear a wedding ring, are you? Don't you know that the wedding ring originally symbolized ankle chains worn by women to prevent them from running away from their husbands? I would not have thought you would be a party to such a sexist practice." There are numerous motives explaining why people choose to wear wedding rings, but it would be a fallacy to presume those who continue the tradition are promoting sexism. (page 196 of ref)

Ignoring The Question. Digression, obfuscation, or similar techniques are used to avoid answering a question.

• Example: When asked about the possibility of a tax increase, a senator replies: "I have always met my obligations to those I represent."

Missing the point / Irrelevant Conclusion. Presenting an argument that may or may not be logically valid and sound, but whose conclusion fails to address the issue in question.

• Example: The Chewbacca Defense from South Park .

Straw Man Argument. Appearing to refute an opponent's argument by instead creating an oversimplified or extreme version of the argument (a "straw man") and refuting that instead.

Texas sharpshooter . A conclusion is drawn from data with a stress on similarities while ignoring differences. An example is seeing localized patterns where none exist. The name comes from a joke about a Texan who fires some gunshots at the side of a barn, then paints a target centered on the tightest cluster of hits and claims to be a sharpshooter.

Tu Quoque Fallacy. Latin for "you too," is also called the "appeal to hypocrisy" because it distracts from the argument by pointing out hypocrisy in the opponent. This tactic doesn't prove one's point, because even hypocrites can tell the truth.

Informal Fallacies with Multiple Structural Problems

Composition / Division . The fallacy of composition infers that something is true of the whole from the fact that it is true of a part of the whole. The opposite reasoning is the fallacy of division.

False dilemma / false dichotomy / black and white. Reducing an issue to only two possible decisions.

• Example: Either we go to war, or we appear weak.

Middle ground / false compromise / argument to moderation . Arguing that a compromise, or middle point, between two extremes is the truth.

• Example: Holly said that vaccinations caused autism in children, but her scientifically well-read friend Caleb said that this claim had been debunked and proven false. Their friend Alice offered a compromise that vaccinations cause some autism. (ref)

Slippery Slope. Moving from a seemingly benign premise or starting point and working through a number of small steps to an improbable extreme when many other outcomes could have been possible. Although this form of slippery slope is a sub-type of the formal appeal of probability fallacy (it assumes something will occur based on probability and thus breaks rules of formal logic), slippery slope arguments can take on many other forms and should are generally categorized as informal fallacies.

• Video examples: Don't Wake Up In A Roadside Ditch commercial and the children's book If You Give a Mouse a Cookie .

Special pleading . Moving the goalposts to create exceptions when a claim is shown to be false. Applying a double standard, generally to oneself.

"The first principle is that you must not fool yourself – and you are the easiest person to fool." –Richard Feynman

As we examine our assumptions and improve our mental models , we have to confront the reality that we all have inescapable hardwired biases that we cannot change through critical thinking. Because we all have them, science can teach us a lot about our biases. Biases are an inescapable feature of being human. No training will stop you from commiting them. However, learning about them can help you second guess the validity of your judgment, think more critically, consider other points-of-view, and develop empathy for the biases in others.

The operating system of our brains uses biologically evolved shortcuts in our thinking. Many of these shortcuts are useful and essential. However, we have also inherited bugs in the code that make many of our judgments irrational. A cognitive bias is a cognitive shortcut that leads to a loss of objectivity. By learning about some of the most common biases, you can learn and how to avoid falling victim to them. For example many of the biases below occur because the brain tends to find patterns where none exist and uses irrational biases to reduce cognitive dissonance when stressed with contradictory ideas. To learn more, I recommend reading Thinking Fast and Slow and You Are Not So Smart .

Common Cognitive Biases

Anchoring . The first thing you judge influences your judgment of all that follows.

Human minds are associative in nature, so the order in which we receive information helps determine the course of our judgments and perceptions. For instance, the first price offered for a used car sets an 'anchor' price which will influence how reasonable or unreasonable a counter-offer might seem. Even if we feel like an initial price is far too high, it can make a slightly less-than-reasonable offer seem entirely reasonable in contrast to the anchor price.

Be especially mindful of this bias during financial negotiations such as houses, cars, and salaries. The initial price offered has proven to have a significant effect.

Availability heuristic . Your judgments are influenced by what springs most easily to mind.

How recent, emotionally powerful, or unusual your memories are can make them seem more relevant. This, in turn, can cause you to apply them too readily. For instance, when we see news reports about homicides, child abductions, and other terrible crimes it can make us believe that these events are much more common and threatening to us than is actually the case.

Try to gain different perspectives and relevant statistical information rather than relying purely on first judgments and emotive influences.

Barnum effect . You see personal specifics in vague statements by filling in the gaps (e.g. interpreting your horoscope).

Because our minds are given to making connections, it's easy for us to take nebulous statements and find ways to interpret them so that they seem specific and personal. The combination of our egos wanting validation with our strong inclination to see patterns and connections means that when someone is telling us a story about ourselves, we look to find the signal and ignore all the noise.

Psychics, astrologers and others use this bias to make it seem like they're telling you something relevant. Consider how things might be interpreted to apply to anyone, not just you.

Belief bias . You are more likely to accept an argument that supports a conclusion that aligns with his values, beliefs and prior knowledge, while rejecting counter arguments to the conclusion.

It's difficult for us to set aside our existing beliefs to consider the true merits of an argument. In practice this means that our ideas become impervious to criticism, and are perpetually reinforced. Instead of thinking about our beliefs in terms of 'true or false' it's probably better to think of them in terms of probability. For example we might assign a 95%+ chance that thinking in terms of probability will help us think better, and a less than 1% chance that our existing beliefs have no room for any doubt. Thinking probabalistically forces us to evaluate more rationally.

A useful thing to ask is 'when and how did I get this belief?' We tend to automatically defend our ideas without ever really questioning them.

Belief perserverance . When some aspect of your core beliefs is challenged, it can cause you to believe even more strongly.

We can experience being wrong about some ideas as an attack upon our very selves, or our tribal identity. This can lead to motivated reasoning which causes a reinforcement of beliefs, despite disconfirming evidence. Recent research shows that the backfire effect certainly doesn't happen all the time. Most people will accept a correction relating to specific facts, however the backfire effect may reinforce a related or 'parent' belief as people attempt to reconcile a new narrative in their understanding.

"It ain't what you don't know that gets you into trouble. It's what you know for sure that just ain't so." —Mark Twain

Bystander effect . You presume someone else is going to do something in an emergency situation.

When something terrible is happening in a public setting we can experience a kind of shock and mental paralysis that distracts us from a sense of personal responsibility. The problem is that everyone can experience this sense of deindividuation in a crowd. This same sense of losing our sense of self in a crowd has been linked to violent and anti-social behaviors. Remaining self-aware requires some amount of effortful reflection in group situations.

If there's an emergency situation, presume to be the one who will help or call for help. Be the change you want to see in the world.

Confirmation bias . You favor things that confirm your existing beliefs.

We are primed to see and agree with ideas that fit our preconceptions, and to ignore and dismiss information that conflicts with them. You could say that this is the mother of all biases, as it affects so much of our thinking through motivated reasoning. To help counteract its influence we ought to presume ourselves wrong until proven right. "When you are studying any matter, or considering any philosophy, ask yourself only what are the facts and what is the truth that the facts bear out. Never let yourself be diverted either by what you wish to believe or by what you think would have beneficent social effects if it were believed." – Bertrand Russell

Think of your ideas and beliefs as software you're actively trying to find problems with rather than things to be defended.

Curse of knowledge . Once you understand something you presume it to be obvious to everyone.

Things makes sense once they make sense, so it can be hard to remember why they didn't. We build complex networks of understanding and forget how intricate the path to our available knowledge really is. This bias is closely related to the hindsight bias wherein you will tend to believe that an event was predictable all along once it has occurred. We have difficulty reconstructing our own prior mental states of confusion and ignorance once we have clear knowledge.

When teaching someone something new, go slow and explain like they're ten years old (without being patronizing). Repeat key points and facilitate active practice to help embed knowledge.

Declinism . You remember the past as better than it was, and expect the future to be worse than it will likely be.

Despite living in the most peaceful and prosperous time in history, many people believe things are getting worse. The 24 hour news cycle, with its reporting of overtly negative and violent events, may account for some of this effect. We can also look to the generally optimistic view of the future in the early 20th century as being shifted to a dystopian and apocalyptic expectation after the world wars, and during the cold war. The greatest tragedy of this bias may be that our collective expectation of decline may contribute to a real-world self-fulfilling prophecy. For some real data,

Instead of relying on nostalgic impressions of how great things used to be, use measurable metrics such as life expectancy, levels of crime and violence, and prosperity statistics.

Dunning-Kruger effect . The more you know, the less confident you're likely to be. The less you know, the more confident you are likely to be.

Because experts know just how much they don't know, they tend to underestimate their ability; but it's easy to be over-confident when you have only a simple idea of how things are. Try not to mistake the cautiousness of experts as a lack of understanding, nor to give much credence to lay-people who appear confident but have only superficial knowledge.

"The whole problem with the world is that fools and fanatics are so certain of themselves, yet wiser people so full of doubts." —Bertrand Russell

Framing effect . You allow yourself to be unduly influenced by context and delivery.

We all like to think that we think independently, but the truth is that all of us are, in fact, influenced by delivery, framing and subtle cues. This is why the ad industry is a thing, despite almost everyone believing they're not affected by advertising messages. The phrasing of how a question is posed, such as for a proposed law being voted on, has been shown to have a significant effect on the outcome.

Only when we have the intellectual humility to accept the fact that we can be manipulated, can we hope to limit how much we are. Try to be mindful of how things are being put to you.

Fundamental attribution error . You judge others on their character, but yourself on the situation.

If you haven't had a good night's sleep, you know why you're being a bit slow; but if you observe someone else being slow you don't have such knowledge and so you might presume them to just be a slow person. Because of this disparity in knowledge we often overemphasize the influence of circumstance for our own failings, as well as underestimating circumstantial factors to explain other people's problems.

It's not only kind to view others' situations with charity, it's more objective too. Be mindful to also err on the side of taking personal responsibility rather than justifying and blaming.

Groupthink . You let the social dynamics of a group situation override the best outcomes.

Dissent can be uncomfortable and dangerous to one's social standing, and so often the most confident or first voice will determine group decisions. Because of the Dunning-Kruger effect, the most confident voices are also often the most ignorant.

Rather than openly contradicting others, seek to facilitate objective means of evaluation and critical thinking practices as a group activity.

In-group bias . You unfairly favor those who belong to your group.

We presume that we're fair and impartial, but the truth is that we automatically favor those who are most like us, or belong to our groups. This blind tribalism has evolved to strengthen social cohesion, however in a modern and multicultural world it can have the opposite effect.

Try to imagine yourself in the position of those in out-groups; whilst also attempting to be dispassionate when judging those who belong to your in-groups.

Just world hypothesis . Your preference for justice makes you presume it exists.

A world in which people don't always get what they deserve, hard work doesn't always pay off, and injustice happens is an uncomfortable one that threatens our preferred narrative. However, it is also the reality. This bias is often manifest in ideas such as 'what goes around comes around' or an expectation of 'karmic balance', and can also lead to blaming victims of crime and circumstance.

A more just world requires understanding rather than blame. Remember that everyone has their own life story, we're all fallible, and bad things happen to good people.

Halo effect . How much you like someone, or how attractive they are, influences your other judgments of them.

Our judgments are associative and automatic, and so if we want to be objective we need to consciously control for irrelevant influences. This is especially important in a professional setting. Things like attractiveness can unduly influence issues as important as a jury deciding someone's guilt or innocence. If someone is successful or fails in one area, this can also unfairly color our expectations of them in another area.

If you notice that you're giving consistently high or low marks across the board, it's worth considering that your judgment may be suffering from the halo effect.

Negativity bias . You allow negative things to disproportionately influence your thinking.

The pain of loss and hurt are felt more keenly and persistently than the fleeting gratification of pleasant things. We are primed for survival, and our aversion to pain can distort our judgment for a modern world. In an evolutionary context it makes sense for us to be heavily biased to avoid threats, but because this bias affects our judgments in other ways it means we aren't giving enough weight to the positives.

Pro-and-con lists, as well as thinking in terms of probabilities, can help you evaluate things more objectively than relying on a cognitive impression.

Optimism bias . You overestimate the likelihood of positive outcomes.

There can be benefits to a positive attitude, but it's unwise to allow such an attitude to adversely affect our ability to make rational judgments (they're not mutually exclusive). Wishful thinking can be a tragic irony insofar as it can create more negative outcomes, such as in the case of problem gambling.

If you make rational, realistic judgments you'll have a lot more to feel positive about.

Pessimism bias . You overestimate the likelihood of negative outcomes.

Pessimism is often a defense mechanism against disappointment, or it can be the result of depression and anxiety disorders. Pessimists often justify their attitude by saying that they'll either be vindicated or pleasantly surprised, however a pessimistic attitude may also limit potential positive outcomes. It should also be noted that pessimism is something very different to skepticism: the latter is a rational approach that seeks to remain impartial, while the former is an expectation of bad outcomes.

Perhaps the worst aspect of pessimism is that even if something good happens, you'll probably feel pessimistic about it anyway.

Placebo effect . If you believe you're taking medicine it can sometimes 'work' even if it's fake.

The placebo effect can work for stuff that our mind influences (such as pain) but not so much for things like viruses or broken bones. Things like the size and color of pills can have an influence on how strong the effect is and may even result in real physiological outcomes. We can also falsely attribute getting better to an inert substance simply because our immune system has fought off an infection i.e. we would have recovered in the same amount of time anyway.

Homeopathy, acupuncture, and many other forms of natural 'medicine' have been proven to be no more effective than placebo. Keep a healthy body and bank balance by using evidence-based medicine from a qualified doctor.

Reactance . You'd rather do the opposite of what someone is trying to make you do.

When we feel our liberty is being constrained, our inclination is to resist, however in doing so we can over-compensate. While blind conformity is far from an ideal way to approach things, neither is being a knee-jerk contrarian.

Be careful not to lose objectivity when someone is being coercive/manipulative, or trying to force you do something. Wisdom springs from reflection, folly from reaction.

Self-serving bias . You believe your failures are due to external factors, yet you're responsible for your successes.

Many of us enjoy unearned privileges, luck and advantages that others do not. It's easy to tell ourselves that we deserve these things, whilst blaming circumstance when things don't go our way. Our desire to protect and exalt our own egos is a powerful force in our psychology. Fostering humility can help countermand this tendency, whilst also making us nicer humans.

When judging others, be mindful of how this bias interacts with the just-world hypothesis, fundamental attribution error, and the in-group bias.

Spotlight effect . You overestimate how much people notice how you look and act.

Most people are much more concerned about themselves than they are about you. Absent overt prejudices, people generally want to like and get along with you as it gives them validation too. It's healthy to remember that although we're the main character in the story of our own life, everyone else is center-stage in theirs too. This bias causes so many people to attribute to motives of malice when there may have been a simple misunderstanding.

Instead of worrying about how you're being judged, consider how you make others feel. They'll remember this much more, and you'll make the world a better place.

Sunk cost fallacy . You irrationally cling to things that have already cost you something.

When we've invested our time, money, or emotion into something, it hurts us to let it go. This aversion to pain can distort our better judgment and cause us to make unwise investments. A sunk cost means that we can't recover it, so it's rational to disregard the cost when evaluating. For instance, if you've spent money on a meal but you only feel like eating half of it, it's irrational to continue to stuff your face just because 'you've already paid for it'; especially considering the fact that you're wasting actual time doing so.

To regain objectivity, ask yourself: had I not already invested something, would I still do so now? What would I counsel a friend to do if they were in the same situation?

Discipline-specific misconceptions often made in arguments

• Everything is made of chemicals. Avoid saying that chemicals are "unnatural" or "dangerous."
• Medicine is not strictly a scientific profession. It can be, but is not required to be. A lot of what doctors actually do is non-scientific. The art of medicine is just as important as the science. For example, simply creating the feeling that the doctor understands a patient's problem and shares the patient's values increases the likelihood of positive health outcomes. Avoid the assumption that doctors are scientists.
• It can be just as dangerous to over-medicalize mental illness as it is to moralize about it. This is why recent writers like Johann Hari focus on non-medical aspects of addiction. From his popular TED Talk you might conclude that he dismisses the model that addiction is a physical medical condition. But if you read his book Chasing The Scream, you would learn that he actually accepts the medical model as part of a bigger picture, considers it mainstream in medicine, and has chosen to make a case for the significance of the social contributors to addiction. From Hari's point-of-view, the American medical system is incentivized to offer the lowest-cost quick fix (like a pill) so treating addiction as a solely medical condition can lead to oversimplified treatments that are less effective that complex, tailored treatments that consider an addict's social circumstances. His slogan, "the opposite of addiction is connection," is effective because it is memorable, however it is just as oversimplified as the purely medical model.

Neuroscience

• Everything alters the brain. Reading these words physically alters your brain by creating memories. In your writing, it is not enough to say the "repeated cocaine use alters the brain." Be specific about how the brain is altered and what the consequence is.
• Every human quality we care about has a dual nature . On one hand its character is limited by biology and the laws of physics. And on the other hand its experience is shaped by culture and personal experience. Thinkers who amplify the importance of biology in shaping behavior are making essentialist arguments. Thinkers who focus on the culturally constructed nature of a human quality are making constructivist arguments. It is important to study and understand the essential and constructed qualities of such concepts as gender, intelligence, athletic ability, extroversion, honesty, mental illness, etc. By separating "nature" from "nurture" we can learn how each contributes to the total phenomenon. But by taking either position, without acknowledging the role of the other, ignores the complexity of reality and leads to weak models. Avoid such overly simplifying models in your own thinking and question them in others.
• Avoid the words "prove," "proven," "proof," etc. Outside of mathematics, nothing is actually "proven" in life. Instead of writing, "It's been proven..." try "It's been observed..." or "Scientists have support for the theory..."

A longer list of misconceptions

Wikipedia has a great list of common misconceptions on many other topics.

Writing Tips

General style tips .

• For essays, refer to the MLA Writing guidelines.
• For scientific and technical writing, refer to the ACS Style Guide .

Citing and Referencing

• If you do not reference a fact in your writing, assume that a critical thinker will give it low likely hood of being true.
• When you quote someone, state their title and credentials. Give context to who they are to help your reader determine if the person being quoted is trustworthy and/or qualified.
• Cite the page number when citing a book.
• Avoid citing websites whenever possible. With the exception of a few online academic journals, assume that anything published online may be gone tomorrow and your reader will not be able to find it.
• A website is not a journal. Before citing a website, try to locate a print citation.
• Google is not a dictionary. If you cite a definition you got from Google, visit the "Google Dictionary" Wikipedia entry to discover who their current content provider is for definitions.
• Google is not a book publisher. Books you find in Google Books, were published somewhere else. Check the title page.

Presenting Information

• When you quote someone , always explain who they are. If they are an expert or researcher, state their qualifications and connect them to reputable organizations that sponsor their work. Doing this makes your writing more persuasive and makes it easier for your reader to research this person to come to their own conclusions.
• Example: "Michael Kuhar, an addiction researcher at the Emory University School of Medicine, explains that..."
• Give credit to the primary source of an idea , even if you encountered it in a secondary source. You should make an effort to read the primary source before quoting it's information and conclusion. If you are unable to, then be clear that you are repeating another author's interpretation of the primary source.

Glossary 

Why are precise definitions of concepts and ideas important.

Humans think within concepts or ideas. We can never achieve command over our thoughts unless we learn how to achieve command over our concepts or ideas. Thus we must learn how to identify the concepts or ideas we are using, contrast them with alternative concepts or ideas, and clarify what we include and exclude by means of them. For example, most people say they believe strongly in democracy, but few can clarify with examples what that word does and does not imply. Most people confuse the meaning of words with cultural associations, with the result that "democracy" means to people whatever we do in running our government—any country that is different is undemocratic. We must distinguish the concepts implicit in the English language from the psychological associations surrounding that concept in a given social group or culture. The failure to develop this ability is a major cause of uncritical thought and selfish critical thought.

• Consider alternative concepts
• Consider that others may be using alternative definitions of concepts
• Make sure you are using concepts with care and precision
• If you suspect a difference in definitions betwen you and another person, attempt to clarify each other's meaning

Fundamental Definitions

Argument. An argument is a series of statements that reach a conclusion that is intended to reveal the degree of truth of another statement. Arguments begin with premises (kinds of information) that are related to each other using valid forms of reasoning (a process) to arrive at the logical conclusion , new information. A logical conclusion is a new kind of information that is true in light of premises being true (if the premises are all facts) or seeming to be true (if the premises contain opinions).

Critical thinker. A well-cultivated critical thinker raises vital questions and problems, formulating them clearly and precisely; gathers and assesses relevant information, using abstract ideas to interpret it effectively; comes to well-reasoned conclusions and solutions, testing them against relevant criteria and standards; thinks open mindedly within alternative systems of thought, recognizing and assessing, as need be, their assumptions, implications, and practical consequences; is committed to overcoming our native confirmation bias, egocentrism, and sociocentrism; and communicates effectively with others in figuring out solutions to complex problems. ( https://www.criticalthinking.org )

Concept . A concept is a generalized idea of a thing or of a class of things that make up the fundamental building blocks of thoughts. Concepts are your brain's representations of past experiences (Barsalou 2003 and 2008). Using concepts, your brain groups some things together and separates others. You can look at three mounds of dirt and perceive two of them as "Hills" and one as a "Mountain," based on your concepts. The dominant psychological/philosophical school of thought known as constructivism assumes that the world like a sheet of pastry and your concepts are cookie cutters that carve boundaries, not because the boundaries are natural , but because they're useful or desirable . These boundaries have physical limitations of course; you'd never perceive a mountain as a lake (Boghossian 2006).

Empirical. Relying on or derived from experiment, observation, or experience as opposed to conceptual or evaluative.

Idea. An idea is anything existing in the mind as an object of knowledge or thought based on concepts regarding particular instances of a class of things. The word specifically refers to something conceived in the mind or imagined. An idea can be specific whereas concepts are generalized.

Thought refers to any idea, whether or not expressed, that occurs to the mind in reasoning or contemplation.

Additional Definitions

For additional definitions of the objects of mind and parts of thinking, I suggest this glossary: https://www.criticalthinking.org/pages/glossary-of-critical-thinking-terms/4

• Online Degree Explore Bachelor’s & Master’s degrees
• MasterTrack™ Earn credit towards a Master’s degree
• University Certificates Advance your career with graduate-level learning
• Top Courses
• Join for Free

What Are Critical Thinking Skills and Why Are They Important?

Learn what critical thinking skills are, why they’re important, and how to develop and apply them in your workplace and everyday life.

We often use critical thinking skills without even realizing it. When you make a decision, such as which cereal to eat for breakfast, you're using critical thinking to determine the best option for you that day.

Critical thinking is like a muscle that can be exercised and built over time. It is a skill that can help propel your career to new heights. You'll be able to solve workplace issues, use trial and error to troubleshoot ideas, and more.

We'll take you through what it is and some examples so you can begin your journey in mastering this skill.

What is critical thinking?

Critical thinking is the ability to interpret, evaluate, and analyze facts and information that are available, to form a judgment or decide if something is right or wrong.

More than just being curious about the world around you, critical thinkers make connections between logical ideas to see the bigger picture. Building your critical thinking skills means being able to advocate your ideas and opinions, present them in a logical fashion, and make decisions for improvement.

Build job-ready skills with a Coursera Plus subscription

• Get access to 7,000+ learning programs from world-class universities and companies, including Google, Yale, Salesforce, and more
• Try different courses and find your best fit at no additional cost
• Earn certificates for learning programs you complete
• A subscription price of $59/month, cancel anytime

Why is critical thinking important?

Critical thinking is useful in many areas of your life, including your career. It makes you a well-rounded individual, one who has looked at all of their options and possible solutions before making a choice.

According to the University of the People in California, having critical thinking skills is important because they are [ 1 ]:

Crucial for the economy

Essential for improving language and presentation skills

Very helpful in promoting creativity

Important for self-reflection

The basis of science and democracy 

Critical thinking skills are used every day in a myriad of ways and can be applied to situations such as a CEO approaching a group project or a nurse deciding in which order to treat their patients.

Examples of common critical thinking skills

Critical thinking skills differ from individual to individual and are utilized in various ways. Examples of common critical thinking skills include:

Identification of biases: Identifying biases means knowing there are certain people or things that may have an unfair prejudice or influence on the situation at hand. Pointing out these biases helps to remove them from contention when it comes to solving the problem and allows you to see things from a different perspective.

Research: Researching details and facts allows you to be prepared when presenting your information to people. You’ll know exactly what you’re talking about due to the time you’ve spent with the subject material, and you’ll be well-spoken and know what questions to ask to gain more knowledge. When researching, always use credible sources and factual information.

Open-mindedness: Being open-minded when having a conversation or participating in a group activity is crucial to success. Dismissing someone else’s ideas before you’ve heard them will inhibit you from progressing to a solution, and will often create animosity. If you truly want to solve a problem, you need to be willing to hear everyone’s opinions and ideas if you want them to hear yours.

Analysis: Analyzing your research will lead to you having a better understanding of the things you’ve heard and read. As a true critical thinker, you’ll want to seek out the truth and get to the source of issues. It’s important to avoid taking things at face value and always dig deeper.

Problem-solving: Problem-solving is perhaps the most important skill that critical thinkers can possess. The ability to solve issues and bounce back from conflict is what helps you succeed, be a leader, and effect change. One way to properly solve problems is to first recognize there’s a problem that needs solving. By determining the issue at hand, you can then analyze it and come up with several potential solutions.

How to develop critical thinking skills

You can develop critical thinking skills every day if you approach problems in a logical manner. Here are a few ways you can start your path to improvement:

1. Ask questions.

Be inquisitive about everything. Maintain a neutral perspective and develop a natural curiosity, so you can ask questions that develop your understanding of the situation or task at hand. The more details, facts, and information you have, the better informed you are to make decisions.

2. Practice active listening.

Utilize active listening techniques, which are founded in empathy, to really listen to what the other person is saying. Critical thinking, in part, is the cognitive process of reading the situation: the words coming out of their mouth, their body language, their reactions to your own words. Then, you might paraphrase to clarify what they're saying, so both of you agree you're on the same page.

3. Develop your logic and reasoning.

This is perhaps a more abstract task that requires practice and long-term development. However, think of a schoolteacher assessing the classroom to determine how to energize the lesson. There's options such as playing a game, watching a video, or challenging the students with a reward system. Using logic, you might decide that the reward system will take up too much time and is not an immediate fix. A video is not exactly relevant at this time. So, the teacher decides to play a simple word association game.

Scenarios like this happen every day, so next time, you can be more aware of what will work and what won't. Over time, developing your logic and reasoning will strengthen your critical thinking skills.

Learn tips and tricks on how to become a better critical thinker and problem solver through online courses from notable educational institutions on Coursera. Start with Introduction to Logic and Critical Thinking from Duke University or Mindware: Critical Thinking for the Information Age from the University of Michigan.

Article sources

University of the People, “ Why is Critical Thinking Important?: A Survival Guide , https://www.uopeople.edu/blog/why-is-critical-thinking-important/.” Accessed May 18, 2023.

Keep reading

Coursera staff.

Editorial Team

Coursera’s editorial team is comprised of highly experienced professional editors, writers, and fact...

This content has been made available for informational purposes only. Learners are advised to conduct additional research to ensure that courses and other credentials pursued meet their personal, professional, and financial goals.

Defining Critical Thinking

• A Brief History of the Idea of Critical Thinking
• Critical Thinking: Basic Questions & Answers
• Our Conception of Critical Thinking
• Sumner’s Definition of Critical Thinking
• Research in Critical Thinking
• Critical Societies: Thoughts from the Past

Translate this page from English...

*Machine translated pages not guaranteed for accuracy. Click Here for our professional translations.

For full copies of this and many other critical thinking articles, books, videos, and more, join us at the Center for Critical Thinking Community Online - the world's leading online community dedicated to critical thinking!   Also featuring interactive learning activities, study groups, and even a social media component, this learning platform will change your conception of intellectual development.

1 Introduction to Critical Thinking

I. what is c ritical t hinking [1].

Critical thinking is the ability to think clearly and rationally about what to do or what to believe.  It includes the ability to engage in reflective and independent thinking. Someone with critical thinking skills is able to do the following:

• Understand the logical connections between ideas.
• Identify, construct, and evaluate arguments.
• Detect inconsistencies and common mistakes in reasoning.
• Solve problems systematically.
• Identify the relevance and importance of ideas.
• Reflect on the justification of one’s own beliefs and values.

Critical thinking is not simply a matter of accumulating information. A person with a good memory and who knows a lot of facts is not necessarily good at critical thinking. Critical thinkers are able to deduce consequences from what they know, make use of information to solve problems, and to seek relevant sources of information to inform themselves.

Critical thinking should not be confused with being argumentative or being critical of other people. Although critical thinking skills can be used in exposing fallacies and bad reasoning, critical thinking can also play an important role in cooperative reasoning and constructive tasks. Critical thinking can help us acquire knowledge, improve our theories, and strengthen arguments. We can also use critical thinking to enhance work processes and improve social institutions.

Some people believe that critical thinking hinders creativity because critical thinking requires following the rules of logic and rationality, whereas creativity might require breaking those rules. This is a misconception. Critical thinking is quite compatible with thinking “out-of-the-box,” challenging consensus views, and pursuing less popular approaches. If anything, critical thinking is an essential part of creativity because we need critical thinking to evaluate and improve our creative ideas.

II. The I mportance of C ritical T hinking

Critical thinking is a domain-general thinking skill. The ability to think clearly and rationally is important whatever we choose to do. If you work in education, research, finance, management or the legal profession, then critical thinking is obviously important. But critical thinking skills are not restricted to a particular subject area. Being able to think well and solve problems systematically is an asset for any career.

Critical thinking is very important in the new knowledge economy.  The global knowledge economy is driven by information and technology. One has to be able to deal with changes quickly and effectively. The new economy places increasing demands on flexible intellectual skills, and the ability to analyze information and integrate diverse sources of knowledge in solving problems. Good critical thinking promotes such thinking skills, and is very important in the fast-changing workplace.

Critical thinking enhances language and presentation skills. Thinking clearly and systematically can improve the way we express our ideas. In learning how to analyze the logical structure of texts, critical thinking also improves comprehension abilities.

Critical thinking promotes creativity. To come up with a creative solution to a problem involves not just having new ideas. It must also be the case that the new ideas being generated are useful and relevant to the task at hand. Critical thinking plays a crucial role in evaluating new ideas, selecting the best ones and modifying them if necessary.

Critical thinking is crucial for self-reflection. In order to live a meaningful life and to structure our lives accordingly, we need to justify and reflect on our values and decisions. Critical thinking provides the tools for this process of self-evaluation.

Good critical thinking is the foundation of science and democracy. Science requires the critical use of reason in experimentation and theory confirmation. The proper functioning of a liberal democracy requires citizens who can think critically about social issues to inform their judgments about proper governance and to overcome biases and prejudice.

Critical thinking is a   metacognitive skill . What this means is that it is a higher-level cognitive skill that involves thinking about thinking. We have to be aware of the good principles of reasoning, and be reflective about our own reasoning. In addition, we often need to make a conscious effort to improve ourselves, avoid biases, and maintain objectivity. This is notoriously hard to do. We are all able to think but to think well often requires a long period of training. The mastery of critical thinking is similar to the mastery of many other skills. There are three important components: theory, practice, and attitude.

III. Improv ing O ur T hinking S kills

If we want to think correctly, we need to follow the correct rules of reasoning. Knowledge of theory includes knowledge of these rules. These are the basic principles of critical thinking, such as the laws of logic, and the methods of scientific reasoning, etc.

Also, it would be useful to know something about what not to do if we want to reason correctly. This means we should have some basic knowledge of the mistakes that people make. First, this requires some knowledge of typical fallacies. Second, psychologists have discovered persistent biases and limitations in human reasoning. An awareness of these empirical findings will alert us to potential problems.

However, merely knowing the principles that distinguish good and bad reasoning is not enough. We might study in the classroom about how to swim, and learn about the basic theory, such as the fact that one should not breathe underwater. But unless we can apply such theoretical knowledge through constant practice, we might not actually be able to swim.

Similarly, to be good at critical thinking skills it is necessary to internalize the theoretical principles so that we can actually apply them in daily life. There are at least two ways to do this. One is to perform lots of quality exercises. These exercises don’t just include practicing in the classroom or receiving tutorials; they also include engaging in discussions and debates with other people in our daily lives, where the principles of critical thinking can be applied. The second method is to think more deeply about the principles that we have acquired. In the human mind, memory and understanding are acquired through making connections between ideas.

Good critical thinking skills require more than just knowledge and practice. Persistent practice can bring about improvements only if one has the right kind of motivation and attitude. The following attitudes are not uncommon, but they are obstacles to critical thinking:

• I prefer being given the correct answers rather than figuring them out myself.
• I don’t like to think a lot about my decisions as I rely only on gut feelings.
• I don’t usually review the mistakes I have made.
• I don’t like to be criticized.

To improve our thinking we have to recognize the importance of reflecting on the reasons for belief and action. We should also be willing to engage in debate, break old habits, and deal with linguistic complexities and abstract concepts.

The  California Critical Thinking Disposition Inventory  is a psychological test that is used to measure whether people are disposed to think critically. It measures the seven different thinking habits listed below, and it is useful to ask ourselves to what extent they describe the way we think:

• Truth-Seeking—Do you try to understand how things really are? Are you interested in finding out the truth?
• Open-Mindedness—How receptive are you to new ideas, even when you do not intuitively agree with them? Do you give new concepts a fair hearing?
• Analyticity—Do you try to understand the reasons behind things? Do you act impulsively or do you evaluate the pros and cons of your decisions?
• Systematicity—Are you systematic in your thinking? Do you break down a complex problem into parts?
• Confidence in Reasoning—Do you always defer to other people? How confident are you in your own judgment? Do you have reasons for your confidence? Do you have a way to evaluate your own thinking?
• Inquisitiveness—Are you curious about unfamiliar topics and resolving complicated problems? Will you chase down an answer until you find it?
• Maturity of Judgment—Do you jump to conclusions? Do you try to see things from different perspectives? Do you take other people’s experiences into account?

Finally, as mentioned earlier, psychologists have discovered over the years that human reasoning can be easily affected by a variety of cognitive biases. For example, people tend to be over-confident of their abilities and focus too much on evidence that supports their pre-existing opinions. We should be alert to these biases in our attitudes towards our own thinking.

IV. Defining Critical Thinking

There are many different definitions of critical thinking. Here we list some of the well-known ones. You might notice that they all emphasize the importance of clarity and rationality. Here we will look at some well-known definitions in chronological order.

1) Many people trace the importance of critical thinking in education to the early twentieth-century American philosopher John Dewey. But Dewey did not make very extensive use of the term “critical thinking.” Instead, in his book  How We Think (1910), he argued for the importance of what he called “reflective thinking”:

…[when] the ground or basis for a belief is deliberately sought and its adequacy to support the belief examined. This process is called reflective thought; it alone is truly educative in value…

Active, persistent and careful consideration of any belief or supposed form of knowledge in light of the grounds that support it, and the further conclusions to which it tends, constitutes reflective thought.

There is however one passage from How We Think where Dewey explicitly uses the term “critical thinking”:

The essence of critical thinking is suspended judgment; and the essence of this suspense is inquiry to determine the nature of the problem before proceeding to attempts at its solution. This, more than any other thing, transforms mere inference into tested inference, suggested conclusions into proof.

2) The  Watson-Glaser Critical Thinking Appraisal  (1980) is a well-known psychological test of critical thinking ability. The authors of this test define critical thinking as:

…a composite of attitudes, knowledge and skills. This composite includes: (1) attitudes of inquiry that involve an ability to recognize the existence of problems and an acceptance of the general need for evidence in support of what is asserted to be true; (2) knowledge of the nature of valid inferences, abstractions, and generalizations in which the weight or accuracy of different kinds of evidence are logically determined; and (3) skills in employing and applying the above attitudes and knowledge.

3) A very well-known and influential definition of critical thinking comes from philosopher and professor Robert Ennis in his work “A Taxonomy of Critical Thinking Dispositions and Abilities” (1987):

Critical thinking is reasonable reflective thinking that is focused on deciding what to believe or do.

4) The following definition comes from a statement written in 1987 by the philosophers Michael Scriven and Richard Paul for the  National Council for Excellence in Critical Thinking (link), an organization promoting critical thinking in the US:

Critical thinking is the intellectually disciplined process of actively and skillfully conceptualizing, applying, analyzing, synthesizing, and/or evaluating information gathered from, or generated by, observation, experience, reflection, reasoning, or communication, as a guide to belief and action. In its exemplary form, it is based on universal intellectual values that transcend subject matter divisions: clarity, accuracy, precision, consistency, relevance, sound evidence, good reasons, depth, breadth, and fairness. It entails the examination of those structures or elements of thought implicit in all reasoning: purpose, problem, or question-at-issue, assumptions, concepts, empirical grounding; reasoning leading to conclusions, implications and consequences, objections from alternative viewpoints, and frame of reference.

The following excerpt from Peter A. Facione’s “Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction” (1990) is quoted from a report written for the American Philosophical Association:

We understand critical thinking to be purposeful, self-regulatory judgment which results in interpretation, analysis, evaluation, and inference, as well as explanation of the evidential, conceptual, methodological, criteriological, or contextual considerations upon which that judgment is based. CT is essential as a tool of inquiry. As such, CT is a liberating force in education and a powerful resource in one’s personal and civic life. While not synonymous with good thinking, CT is a pervasive and self-rectifying human phenomenon. The ideal critical thinker is habitually inquisitive, well-informed, trustful of reason, open-minded, flexible, fairminded in evaluation, honest in facing personal biases, prudent in making judgments, willing to reconsider, clear about issues, orderly in complex matters, diligent in seeking relevant information, reasonable in the selection of criteria, focused in inquiry, and persistent in seeking results which are as precise as the subject and the circumstances of inquiry permit. Thus, educating good critical thinkers means working toward this ideal. It combines developing CT skills with nurturing those dispositions which consistently yield useful insights and which are the basis of a rational and democratic society.

V. Two F eatures of C ritical T hinking

A. how not what .

Critical thinking is concerned not with what you believe, but rather how or why you believe it. Most classes, such as those on biology or chemistry, teach you what to believe about a subject matter. In contrast, critical thinking is not particularly interested in what the world is, in fact, like. Rather, critical thinking will teach you how to form beliefs and how to think. It is interested in the type of reasoning you use when you form your beliefs, and concerns itself with whether you have good reasons to believe what you believe. Therefore, this class isn’t a class on the psychology of reasoning, which brings us to the second important feature of critical thinking.

B. Ought N ot Is ( or Normative N ot Descriptive )

There is a difference between normative and descriptive theories. Descriptive theories, such as those provided by physics, provide a picture of how the world factually behaves and operates. In contrast, normative theories, such as those provided by ethics or political philosophy, provide a picture of how the world should be. Rather than ask question such as why something is the way it is, normative theories ask how something should be. In this course, we will be interested in normative theories that govern our thinking and reasoning. Therefore, we will not be interested in how we actually reason, but rather focus on how we ought to reason.

In the introduction to this course we considered a selection task with cards that must be flipped in order to check the validity of a rule. We noted that many people fail to identify all the cards required to check the rule. This is how people do in fact reason (descriptive). We then noted that you must flip over two cards. This is how people ought to reason (normative).

• Section I-IV are taken from http://philosophy.hku.hk/think/ and are in use under the creative commons license. Some modifications have been made to the original content. ↵

Critical Thinking Copyright © 2019 by Brian Kim is licensed under a Creative Commons Attribution 4.0 International License , except where otherwise noted.

Share This Book

Study Strategies and Resources

• Meet the Alumni Navigators
• Meet With Us Power Hours
• Navigator Chat
• Critical Thinking Skills
• Overcoming Coursework Challenges
• Faculty Feedback
• Identifying and Leveraging your Support Systems
• Time Management
• Reading Comprehension
• Note Taking
• Goal Setting
• NU Brightspace Navigation
• NCUOne Navigation
• Timely Care This link opens in a new window
• Understanding the Commitment

Defining Critical Thinking

“Critical thinking relies on content, because you can't navigate masses of information if you have nothing to navigate to.” -Dr. Kathy Hirsh-Pasek, Professor of Psychology, Temple University

One of the most sought-after skills in nearly every workplace is critical thinking (Doyle, 2018, October 30). But what is critical thinking, exactly? Better yet … what does it take to think critically? To some, it is the ability to analyze information objectively and make a reasoned judgment; for others, it simply involves thinking “outside-the-box”. Either way, to think critically is to possess the unique ability to think reflectively and independently in order to make thoughtful decisions (Figliuolo, 2016, August 2). In other words, critical thinking is not just the accumulation of facts and knowledge; rather, it’s a process of approaching whatever is on your mind in order to come up with the best possible conclusion (Patel, 2018, October 24). Figure 1 illustrates the critical thinking process.

Figure 1. Critical thinking process

Three Essential Skills

To think critically, it begins with three essential skills:

• linking ideas,
• structuring arguments, and
• recognizing incongruences.

In order for you to become a better critical thinker, each of the three skills needs to be practiced and applied accordingly. The first skill, linking ideas, involves finding connections between seemly unrelatable, even irrelevant ideas, thoughts, etc. The second skill involves creating structured practical, relevant, and sound arguments. Lastly, to recognize incongruences is to find the real truth by being able to find holes in a theory or argument (MindValley, n.d.).

Food for Thought “No problem can withstand the assault of sustained thinking.” -Voltaire, French philosopher

Six Low-Level Questions

Once you have the three essential skills down, then you can ask yourself six low-level questions that you can use in nearly any situation (TeachThought Staff, 2018, July 29):

• What’s happening? Here, you will need to establish the basics and begin forming questions.
• Why is it important? Ask yourself why the situation at hand is or is not significant.
• What don’t I see? Ask yourself whether or not there is any important information you might be missing.
• How do I know? Ponder on not only how you know what you think you know, but how that thought process was generated.
• Who is saying it? Identify the speaker and their position on the situation, then consider how that position could be influencing that person’s thinking.
• What else? What if? Think of anything else you be considering when making your decision. In addition, ponder the repercussions of what you’ve considered that might change/alter the outcome of your decision.

Food for Thought “Learn to use your brain power. Critical thinking is the key to creative problem solving in business.” -Richard Branson, Entrepreneur

Blooms Taxonomy

In order to better understand higher-level critical thinking, it helps to be familiar with Bloom’s Taxonomy, a classification of educational objectives and skills that educators establish for their students. In Bloom’s Taxonomy, there are three overarching domains known as KSA: (a) Knowledge [cognitive], (b) Skills [psychomotor], and (c) Attitudes [affective]. This taxonomy of learning behaviors is referred to as “the goals of the learning process.” In other words, after a period of learning, the student will have acquired a new knowledge, skill and/or attitude (Bloom et al., 1956). In this resource, we will focus on the Knowledge (cognitive) domain. According to Bloom et al. (1956), the cognitive domain involves the development of intellectual skills. There are six major categories of the cognitive process (Figure 2), beginning with the development with the simplest skills (e.g., remembering basic facts and concepts), through a learning of procedural patterns and concepts that facilitate the development of intellectual abilities, before eventually moving to the highest, most complex skills (e.g., creation of new or original ideas).

Figure 2. Bloom's Taxonomy

• To further explain, the first level of Bloom’s Taxonomy involves remembering specific information. This includes recalling basic vocabulary, dates, and math facts.
• Moving up the taxonomy, understanding is demonstrated by a student’s ability to comprehend, organize, compare and to verbalize main concepts. At this level, questions require the ability to understand meaning, not just basic facts. For example, a study might be asked to explain the difference between apples and oranges.
• The third level, application, is being able to actually use the new knowledge. Within this level, questions often require the student taking what s/he just learned, then applying it in a different way. For example, the student may be asked to take a list of food items, then select four items to make a healthy breakfast.
• The next level, analysis, involves breaking down information into different parts for a more thorough examination. Here, questions require proven facts (evidence) to support the answer. For example, the student is asked to compare and contrast Republicans to Democrats with regard to their views on supporting or repealing the Affordable Care Act.
• Evaluation, the fifth level, is the ability to make judgments about information by presenting and defending one’s own opinions. It is important to note that at this level, questions don’t necessarily have a right (or wrong) answer. For example, a student may be asked how s/he would handle observing a friend who cheated on a final exam.
• The top of the taxonomy involves the synthesis of new information and compiling it in new ways. It is at this level where more abstract, creative, “outside-the-box” thinking comes into play. For example, a student may be asked to design and construct a robot that can walk a certain distance.

While the first three levels of the taxonomy are important to solidify core knowledge, it is within the last three levels – analysis, evaluation, and creativity – that require critical thinking skills. (Anderson et al., 2001).

Practice Activity

In a study by Gottfried and Shearer (2016, May 26), the authors stated that 62% of adults get their news from social networking sites. In fact, the results show that 70% of Reddit users, 66% of Facebook users, and 59% of Twitter users get their news from one or more of these platforms. According to the study, among these three social networking sites, Facebook had the greatest reach with 67% of American adults using the platform. This suggests that the two-thirds of adults who use Facebook to get their news, which amount to 44% of the general population. Unfortunately, social media platforms don’t go through the stringent review process to which most major news outlets are required in order to be in compliance with Federal Communications Commission (FCC) regulations. Therefore, information can be shared publicly without “fact-checking” to make sure that what’s being shared is truly accurate. With this in mind, one can’t help but ask: What’s the truth versus what isn’t? Better yet … what’s real news and what’s fake?

Your task involves the use of Bloom’s Taxonomy to decipher “fake news” from real news. Using the eight-step infographic on the International Federation of Library Associations and Institutions (IFLA) website (https://www.ifla.org/publications/node/11174) as a guide, review the following news stories to determine which are real and which are fake. Explain your rationale.

1. Strasbourg market attacker ‘pledged allegiance to ISIS’ – source.

2. Lawmakers in California propose a new law called the “Check Your Oxygen Privilege Act”.

3. Four AI-controlled robots kill 29 scientists in Japan.

4. North Korea says it will not denuclearize until the US eliminates ‘nuclear threat’.

5. Two men found living underneath the Calico Mine Ride at Knott’s Berry Farm.

6. Scientists find a brain circuit that could explain seasonal depression.

7. Amazon customer receives 1,700 audio files of a stranger who used Alexa.

8. NFL fines Pittsburgh Steelers $1M each for skipping National Anthem.

9. FBI raids CDC for data on vaccines and autism.

10. Only 60 of 1,566 churches in Houston opened to help Hurricane Harvey victims.

References:

Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., Raths, J., & Wittrock, M.C. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom's Taxonomy of Educational Objectives. New York, NY: Pearson, Allyn & Bacon. Bloom, B. (Ed.), Englehart, M., Furst, E., Hill, W., & Krathwohl, D. (1956). Taxonomy of educational objectives, Handbook I: Cognitive domain. New York, NY: McCay. Doyle, A. (2018, October 30). Critical thinking definition, skills, and examples. Retrieved from https://www.thebalancecareers.com/critical-thinking-definition-with-examples-2063745 Figliuolo, M. (2016, August 2). Critical thinking. Retrieved from https://www.lynda.com/Business-Skills-tutorials/Critical-Thinking/424116-2.html Gottfried, J., & Shearer, E. (2016, May 26). News use across social media platforms 2016. Pew Research Center. Retrieved from http://www.journalism.org/2016/05/26/news-use-across-social-media-platforms-2016/ MindValley. (n.d.). How to solve the biggest problems with critical thinking exercises [blog]. Retrieved from https://blog.mindvalley.com/critical-thinking-exercises/# Patel, D. (2018, October 24). 16 characteristics of critical thinkers. Retrieved from https://www.entrepreneur.com/article/321660 TeachThought Staff. (2018, July 29). 6 critical thinking questions for any situation. Retrieved from https://www.teachthought.com/critical-thinking/6-critical-thinking-questions-situation/

Student Experience Feedback Buttons

Was this resource helpful.

• << Previous: Mindset
• Next: Overcoming Coursework Challenges >>
• Last Updated: Apr 2, 2024 11:19 AM
• URL: https://resources.nu.edu/studystrategiesandresources

© Copyright 2024 National University. All Rights Reserved.

Privacy Policy | Consumer Information

• The Open University
• Guest user / Sign out
• Study with The Open University

My OpenLearn Profile

Personalise your OpenLearn profile, save your favourite content and get recognition for your learning

Critical thinking – A skill and a process

Now, that oversimplified approach to learning certainly is the first step to studying as well. However, in order to be successful in our studies, we need to do more than just contain and repeat information. We need to be able to assess the value of the information, its correctness, and its contribution to any given debate. Ideally, we are able to put it into context with other aspects of our knowledge, too. This is what makes us students, this is what makes us critical thinkers.

Critical thinking is not just one skill, rather it is the result of a number of skills applied effectively. In order to be able to think critically, you’ll need to be able reason. You’ll need to be able to assess the source of the information you’re given and you’ll be able to reflect on its accuracy or validity, depending on your task.

By thinking critically, you are applying each of those skills in order to evaluate the information in front of you. This can be a theory, a new research result, or even a news item. Critical thinking allows you to apply an objective approach to your learning, rather than subjectively following either the proposed information you’re given, or your own opinion rather than clear and convincing arguments and facts.

Critical thinking is a process of continuing evaluation and reflection. It is most powerful, when leading to a change of view in ourselves or in others.

This is where critical thinking becomes relevant outside the world of studying. By being critical of what we read, hear and see, we are engaging with the society we live in actively. We are not perceiving anything as given, but are rather reflecting on the value and correctness of the way society works.

This helps us to be better employees, by reflecting on where processes and ways of working can be improved. It helps us to more engaged citizens, as we are reflecting on political campaigns and their truthfulness and value for us when we are asked to participate in an election. Critical thinking pushes ourselves and our environment to continuously adapt and improve.

When you think critically, you open up a whole new way of engaging with the world around you.

Find out more about 'Go the Distance'

Am I ready to be a distance learner?

Distance learning can open up opportunities for study. You might have not studied for a while, you might be returning to education, or you might not have had the chance to study at a higher level before. This free course, Am I ready to be a distance learner?, will help to boost your confidence. You'll explore useful skills so you can discover ...

Free course

Level: 1 Introductory

Taking your first steps into higher education

What is university study like? Is it for me? If you are asking yourself these questions, this free course is for you. Taking your first steps into higher education provides insights into how subjects are studied at university. This introduction to carefully selected materials helps you decide what you might want to study. You will be ...

Are you ready for postgraduate study?

This free course, Are you ready for postgraduate study, will help you to become familiar with the requirements and demands of postgraduate study and ensure you are ready to develop the skills and confidence to pursue your learning further.

Level: 3 Advanced

Become an OU student

Ratings & comments, share this free course, copyright information, publication details.

• Originally published: Wednesday, 15 November 2017
• Body text - Creative Commons BY-NC-SA 4.0 : The Open University
• Image 'angels with a book statue' - Copyright free
• Image 'Am I ready to be a distance learner?' - Copyright free
• Image 'Are you ready for postgraduate study?' - Copyright free
• Image 'Taking your first steps into higher education' - Copyright: Image courtesy of chanpipat at FreeDigitalPhotos.net

Rate and Review

Rate this article, review this article.

Log into OpenLearn to leave reviews and join in the conversation.

Article reviews

For further information, take a look at our frequently asked questions which may give you the support you need.

JavaScript seems to be disabled in your browser. For the best experience on our site, be sure to turn on Javascript in your browser.

• Order Tracking
• Create an Account

200+ Award-Winning Educational Textbooks, Activity Books, & Printable eBooks!

• Compare Products

Reading, Writing, Math, Science, Social Studies

• Search by Book Series
• Algebra I & II  Gr. 7-12+
• Algebra Magic Tricks  Gr. 2-12+
• Algebra Word Problems  Gr. 7-12+
• Balance Benders  Gr. 2-12+
• Balance Math & More!  Gr. 2-12+
• Basics of Critical Thinking  Gr. 4-7
• Brain Stretchers  Gr. 5-12+
• Building Thinking Skills  Gr. Toddler-12+
• Building Writing Skills  Gr. 3-7
• Bundles - Critical Thinking  Gr. PreK-9
• Bundles - Language Arts  Gr. K-8
• Bundles - Mathematics  Gr. PreK-9
• Bundles - Multi-Subject Curriculum  Gr. PreK-12+
• Bundles - Test Prep  Gr. Toddler-12+
• Can You Find Me?  Gr. PreK-1
• Complete the Picture Math  Gr. 1-3
• Cornell Critical Thinking Tests  Gr. 5-12+
• Cranium Crackers  Gr. 3-12+
• Creative Problem Solving  Gr. PreK-2
• Critical Thinking Activities to Improve Writing  Gr. 4-12+
• Critical Thinking Coloring  Gr. PreK-2
• Critical Thinking Detective  Gr. 3-12+
• Critical Thinking Tests  Gr. PreK-6
• Critical Thinking for Reading Comprehension  Gr. 1-5
• Critical Thinking in United States History  Gr. 6-12+
• CrossNumber Math Puzzles  Gr. 4-10
• Crypt-O-Words  Gr. 2-7
• Crypto Mind Benders  Gr. 3-12+
• Daily Mind Builders  Gr. 5-12+
• Dare to Compare Math  Gr. 2-7
• Developing Critical Thinking through Science  Gr. 1-8
• Dr. DooRiddles  Gr. PreK-12+
• Dr. Funster's  Gr. 2-12+
• Editor in Chief  Gr. 2-12+
• Fun-Time Phonics!  Gr. PreK-2
• Half 'n Half Animals  Gr. K-4
• Hands-On Thinking Skills  Gr. K-1
• Inference Jones  Gr. 1-6
• James Madison  Gr. 10-12+
• Jumbles  Gr. 3-5
• Language Mechanic  Gr. 4-7
• Language Smarts  Gr. 1-4
• Mastering Logic & Math Problem Solving  Gr. 6-9
• Math Analogies  Gr. K-9
• Math Detective  Gr. 3-8
• Math Games  Gr. 3-8
• Math Mind Benders  Gr. 5-12+
• Math Ties  Gr. 4-8
• Math Word Problems  Gr. 4-10
• Mathematical Reasoning  Gr. Toddler-11
• Middle School Science  Gr. 6-8
• Mind Benders  Gr. PreK-12+
• Mind Building Math  Gr. K-1
• Mind Building Reading  Gr. K-1
• Novel Thinking  Gr. 3-6
• OLSAT® Test Prep  Gr. PreK-K
• Organizing Thinking  Gr. 2-8
• Pattern Explorer  Gr. 3-9
• Practical Critical Thinking  Gr. 8-12+
• Punctuation Puzzler  Gr. 3-8
• Reading Detective  Gr. 3-12+
• Red Herring Mysteries  Gr. 4-12+
• Red Herrings Science Mysteries  Gr. 4-9
• Science Detective  Gr. 3-6
• Science Mind Benders  Gr. PreK-3
• Science Vocabulary Crossword Puzzles  Gr. 4-6
• Sciencewise  Gr. 4-12+
• Scratch Your Brain  Gr. 2-12+
• Sentence Diagramming  Gr. 3-12+
• Smarty Pants Puzzles  Gr. 3-12+
• Snailopolis  Gr. K-4
• Something's Fishy at Lake Iwannafisha  Gr. 5-9
• Teaching Technology  Gr. 3-12+
• Tell Me a Story  Gr. PreK-1
• Think Analogies  Gr. 3-12+
• Think and Write  Gr. 3-8
• Think-A-Grams  Gr. 4-12+
• Thinking About Time  Gr. 3-6
• Thinking Connections  Gr. 4-12+
• Thinking Directionally  Gr. 2-6
• Thinking Skills & Key Concepts  Gr. PreK-2
• Thinking Skills for Tests  Gr. PreK-5
• U.S. History Detective  Gr. 8-12+
• Understanding Fractions  Gr. 2-6
• Visual Perceptual Skill Building  Gr. PreK-3
• Vocabulary Riddles  Gr. 4-8
• Vocabulary Smarts  Gr. 2-5
• Vocabulary Virtuoso  Gr. 2-12+
• What Would You Do?  Gr. 2-12+
• Who Is This Kid? Colleges Want to Know!  Gr. 9-12+
• Word Explorer  Gr. 6-8
• Word Roots  Gr. 3-12+
• World History Detective  Gr. 6-12+
• Writing Detective  Gr. 3-6
• You Decide!  Gr. 6-12+

• Special of the Month
• Sign Up for our Best Offers
• Bundles = Greatest Savings!
• Sign Up for Free Puzzles
• Sign Up for Free Activities
• Toddler (Ages 0-3)
• PreK (Ages 3-5)
• Kindergarten (Ages 5-6)
• 1st Grade (Ages 6-7)
• 2nd Grade (Ages 7-8)
• 3rd Grade (Ages 8-9)
• 4th Grade (Ages 9-10)
• 5th Grade (Ages 10-11)
• 6th Grade (Ages 11-12)
• 7th Grade (Ages 12-13)
• 8th Grade (Ages 13-14)
• 9th Grade (Ages 14-15)
• 10th Grade (Ages 15-16)
• 11th Grade (Ages 16-17)
• 12th Grade (Ages 17-18)
• 12th+ Grade (Ages 18+)
• Test Prep Directory
• Test Prep Bundles
• Test Prep Guides
• Preschool Academics
• Store Locator
• Submit Feedback/Request
• Sales Alerts Sign-Up
• Technical Support
• Mission & History
• Articles & Advice
• Testimonials
• Our Guarantee
• New Products
• Free Activities
• Libros en Español

What is Critical Thinking?

Critical Thinking Definition

September 2, 2005, by The Critical Thinking Co. Staff

The Critical Thinking Co.™ "Critical thinking is the identification and evaluation of evidence to guide decision making. A critical thinker uses broad in-depth analysis of evidence to make decisions and communicate their beliefs clearly and accurately."

Other Definitions of Critical Thinking: Robert H. Ennis , Author of The Cornell Critical Thinking Tests "Critical thinking is reasonable, reflective thinking that is focused on deciding what to believe and do."

A SUPER-STREAMLINED CONCEPTION OF CRITICAL THINKING Robert H. Ennis, 6/20/02

Assuming that critical thinking is reasonable reflective thinking focused on deciding what to believe or do, a critical thinker:

1. Is open-minded and mindful of alternatives 2. Tries to be well-informed 3. Judges well the credibility of sources 4. Identifies conclusions, reasons, and assumptions 5. Judges well the quality of an argument, including the acceptability of its reasons, assumptions, and evidence 6. Can well develop and defend a reasonable position 7. Asks appropriate clarifying questions 8. Formulates plausible hypotheses; plans experiments well 9. Defines terms in a way appropriate for the context 10. Draws conclusions when warranted, but with caution 11. Integrates all items in this list when deciding what to believe or do

Critical Thinkers are disposed to:

1. Care that their beliefs be true, and that their decisions be justified; that is, care to "get it right" to the extent possible. This includes the dispositions to

a. Seek alternative hypotheses, explanations, conclusions, plans, sources, etc., and be open to them b. Endorse a position to the extent that, but only to the extent that, it is justified by the information that is available c. Be well informed d. Consider seriously other points of view than their own

2. Care to present a position honestly and clearly, theirs as well as others'. This includes the dispositions to

a. Be clear about the intended meaning of what is said, written, or otherwise communicated, seeking as much precision as the situation requires b. Determine, and maintain focus on, the conclusion or question c. Seek and offer reasons d. Take into account the total situation e. Be reflectively aware of their own basic beliefs

3. Care about the dignity and worth of every person (a correlative disposition). This includes the dispositions to

a. Discover and listen to others' view and reasons b. Avoid intimidating or confusing others with their critical thinking prowess, taking into account others' feelings and level of understanding c. Be concerned about others' welfare

Critical Thinking Abilities:

Ideal critical thinkers have the ability to (The first three items involve elementary clarification.)

1. Focus on a question

a. Identify or formulate a question b. Identify or formulate criteria for judging possible answers c. Keep the situation in mind

2. Analyze arguments

a. Identify conclusions b. Identify stated reasons c. Identify unstated reasons d. Identify and handle irrelevance e. See the structure of an argument f. Summarize

3. Ask and answer questions of clarification and/or challenge, such as,

a. Why? b. What is your main point? c. What do you mean by…? d. What would be an example? e. What would not be an example (though close to being one)? f. How does that apply to this case (describe a case, which might well appear to be a counter example)? g. What difference does it make? h. What are the facts? i. Is this what you are saying: ____________? j. Would you say some more about that?

(The next two involve the basis for the decision.)

4. Judge the credibility of a source. Major criteria (but not necessary conditions):

a. Expertise b. Lack of conflict of interest c. Agreement among sources d. Reputation e. Use of established procedures f. Known risk to reputation g. Ability to give reasons h. Careful habits

5. Observe, and judge observation reports. Major criteria (but not necessary conditions, except for the first):

a. Minimal inferring involved b. Short time interval between observation and report c. Report by the observer, rather than someone else (that is, the report is not hearsay) d. Provision of records. e. Corroboration f. Possibility of corroboration g. Good access h. Competent employment of technology, if technology is useful i. Satisfaction by observer (and reporter, if a different person) of the credibility criteria in Ability # 4 above.

(The next three involve inference.)

6. Deduce, and judge deduction

a. Class logic b. Conditional logic c. Interpretation of logical terminology in statements, including (1) Negation and double negation (2) Necessary and sufficient condition language (3) Such words as "only", "if and only if", "or", "some", "unless", "not both".

7. Induce, and judge induction

a. To generalizations. Broad considerations: (1) Typicality of data, including sampling where appropriate (2) Breadth of coverage (3) Acceptability of evidence b. To explanatory conclusions (including hypotheses) (1) Major types of explanatory conclusions and hypotheses: (a) Causal claims (b) Claims about the beliefs and attitudes of people (c) Interpretation of authors’ intended meanings (d) Historical claims that certain things happened (including criminal accusations) (e) Reported definitions (f) Claims that some proposition is an unstated reason that the person actually used (2) Characteristic investigative activities (a) Designing experiments, including planning to control variables (b) Seeking evidence and counter-evidence (c) Seeking other possible explanations (3) Criteria, the first five being essential, the sixth being desirable (a) The proposed conclusion would explain the evidence (b) The proposed conclusion is consistent with all known facts (c) Competitive alternative explanations are inconsistent with facts (d) The evidence on which the hypothesis depends is acceptable. (e) A legitimate effort should have been made to uncover counter-evidence (f) The proposed conclusion seems plausible

8. Make and judge value judgments: Important factors:

a. Background facts b. Consequences of accepting or rejecting the judgment c. Prima facie application of acceptable principles d. Alternatives e. Balancing, weighing, deciding

(The next two abilities involve advanced clarification.)

9. Define terms and judge definitions. Three dimensions are form, strategy, and content.

a. Form. Some useful forms are: (1) Synonym (2) Classification (3) Range (4) Equivalent expression (5) Operational (6) Example and non-example b. Definitional strategy (1) Acts (a) Report a meaning (b) Stipulate a meaning (c) Express a position on an issue (including "programmatic" and "persuasive" definitions) (2) Identifying and handling equivocation c. Content of the definition

10. Attribute unstated assumptions (an ability that belongs under both clarification and, in a way, inference)

(The next two abilities involve supposition and integration.)

11. Consider and reason from premises, reasons, assumptions, positions, and other propositions with which they disagree or about which they are in doubt -- without letting the disagreement or doubt interfere with their thinking ("suppositional thinking")

12. Integrate the other abilities and dispositions in making and defending a decision

(The first twelve abilities are constitutive abilities. The next three are auxiliary critical thinking abilities: Having them, though very helpful in various ways, is not constitutive of being a critical thinker.)

13. Proceed in an orderly manner appropriate to the situation. For example:

a. Follow problem solving steps b. Monitor one's own thinking (that is, engage in metacognition) c. Employ a reasonable critical thinking checklist

14. Be sensitive to the feelings, level of knowledge, and degree of sophistication of others

15. Employ appropriate rhetorical strategies in discussion and presentation (orally and in writing), including employing and reacting to "fallacy" labels in an appropriate manner.

Examples of fallacy labels are "circularity," "bandwagon," "post hoc," "equivocation," "non sequitur," and "straw person."

Dewey, John Critical thinking is "active, persistent, and careful consideration of any belief or supposed form of knowledge in the light of the grounds that support it and the further conclusions to which it tends (Dewey 1933: 118)."

Glaser (1) an attitude of being disposed to consider in a thoughtful way the problems and subjects that come within the range of one's experiences, (2) knowledge of the methods of logical inquiry and reasoning, and (3) some skill in applying those methods. Critical thinking calls for a persistent effort to examine any belief or supposed form of knowledge in the light of the evidence that supports it and the further conclusions to which it tends. (Glaser 1941, pp. 5-6).

Abilities include: "(a) to recognize problems, (b) to find workable means for meeting those problems, (c) to gather and marshal pertinent information, (d) to recognize unstated assumptions and values, (e) to comprehend and use language with accuracy, clarity and discrimination, (f) to interpret data, (g) to appraise evidence and evaluate statements, (h) to recognize the existence of logical relationships between propositions, (i) to draw warranted conclusions and generalizations, (j) to put to test the generalizations and conclusions at which one arrives, (k) to reconstruct one's patterns of beliefs on the basis of wider experience; and (l) to render accurate judgments about specific things and qualities in everyday life." (p.6)

MCC General Education Initiatives "Critical thinking includes the ability to respond to material by distinguishing between facts and opinions or personal feelings, judgments and inferences, inductive and deductive arguments, and the objective and subjective. It also includes the ability to generate questions, construct, and recognize the structure of arguments, and adequately support arguments; define, analyze, and devise solutions for problems and issues; sort, organize, classify, correlate, and analyze materials and data; integrate information and see relationships; evaluate information, materials, and data by drawing inferences, arriving at reasonable and informed conclusions, applying understanding and knowledge to new and different problems, developing rational and reasonable interpretations, suspending beliefs and remaining open to new information, methods, cultural systems, values and beliefs and by assimilating information."

Nickerson, Perkins and Smith (1985) "The ability to judge the plausibility of specific assertions, to weigh evidence, to assess the logical soundness of inferences, to construct counter-arguments and alternative hypotheses."

Moore and Parker , Critical Thinking Critical Thinking is "the careful, deliberate determination of whether we should accept, reject, or suspend judgment about a claim, and the degree of confidence with which we accept or reject it."

Delphi Report "We understand critical thinking to be purposeful, self-regulatory judgment which results in interpretation, analysis, evaluation, and inference, as well as explanation of the evidential, conceptual, methodological, criteriological, or contextual considerations upon which that judgment is based. CT is essential as a tool of inquiry. As such, CT is a liberating force in education and a powerful resource in one's personal and civic life. While not synonymous with good thinking, CT is a pervasive and self-rectifying human phenomenon. The ideal critical thinker is habitually inquisitive, well-informed, trustful of reason, open-minded, flexible, fair-minded in evaluation, honest in facing personal biases, prudent in making judgments, willing to reconsider, clear about issues, orderly in complex matters, diligent in seeking relevant information, reasonable in the selection of criteria, focused in inquiry, and persistent in seeking results which are as precise as the subject and the circumstances of inquiry permit. Thus, educating good critical thinkers means working toward this ideal. It combines developing CT skills with nurturing those dispositions which consistently yield useful insights and which are the basis of a rational and democratic society."

A little reformatting helps make this definition more comprehensible:

We understand critical thinking to be purposeful, self-regulatory judgment which results in

• interpretation

as well as explanation of the

• methodological
• criteriological

considerations upon which that judgment is based.

Francis Bacon (1605) "For myself, I found that I was fitted for nothing so well as for the study of Truth; as having a mind nimble and versatile enough to catch the resemblances of things … and at the same time steady enough to fix and distinguish their subtler differences; as being gifted by nature with desire to seek, patience to doubt, fondness to meditate, slowness to assert, readiness to consider, carefulness to dispose and set in order; and as being a man that neither affects what is new nor admires what is old, and that hates every kind of imposture."

A shorter version is "the art of being right."

Or, more prosaically: critical thinking is "the skillful application of a repertoire of validated general techniques for deciding the level of confidence you should have in a proposition in the light of the available evidence."

HELPFUL REFERENCE: http://plato.stanford.edu/entries/logic-informal/

You are using an outdated browser. Please upgrade your browser to improve your experience.

Health & Nursing

Courses and certificates.

• Bachelor's Degrees
• View all Business Bachelor's Degrees
• Business Management – B.S. Business Administration
• Healthcare Administration – B.S.
• Human Resource Management – B.S. Business Administration
• Information Technology Management – B.S. Business Administration
• Marketing – B.S. Business Administration
• Accounting – B.S. Business Administration
• Finance – B.S.
• Supply Chain and Operations Management – B.S.
• Accelerated Information Technology Bachelor's and Master's Degree (from the School of Technology)
• Health Information Management – B.S. (from the Leavitt School of Health)

Master's Degrees

• View all Business Master's Degrees
• Master of Business Administration (MBA)
• MBA Information Technology Management
• MBA Healthcare Management
• Management and Leadership – M.S.
• Accounting – M.S.
• Marketing – M.S.
• Human Resource Management – M.S.
• Master of Healthcare Administration (from the Leavitt School of Health)
• Data Analytics – M.S. (from the School of Technology)
• Information Technology Management – M.S. (from the School of Technology)
• Education Technology and Instructional Design – M.Ed. (from the School of Education)

Certificates

• View all Business Degrees

Bachelor's Preparing For Licensure

• View all Education Bachelor's Degrees
• Elementary Education – B.A.
• Special Education and Elementary Education (Dual Licensure) – B.A.
• Special Education (Mild-to-Moderate) – B.A.
• Mathematics Education (Middle Grades) – B.S.
• Mathematics Education (Secondary)– B.S.
• Science Education (Middle Grades) – B.S.
• Science Education (Secondary Chemistry) – B.S.
• Science Education (Secondary Physics) – B.S.
• Science Education (Secondary Biological Sciences) – B.S.
• Science Education (Secondary Earth Science)– B.S.
• View all Education Degrees

Bachelor of Arts in Education Degrees

• Educational Studies – B.A.

Master of Science in Education Degrees

• View all Education Master's Degrees
• Curriculum and Instruction – M.S.
• Educational Leadership – M.S.
• Education Technology and Instructional Design – M.Ed.

Master's Preparing for Licensure

• Teaching, Elementary Education – M.A.
• Teaching, English Education (Secondary) – M.A.
• Teaching, Mathematics Education (Middle Grades) – M.A.
• Teaching, Mathematics Education (Secondary) – M.A.
• Teaching, Science Education (Secondary) – M.A.
• Teaching, Special Education (K-12) – M.A.

Licensure Information

• State Teaching Licensure Information

Master's Degrees for Teachers

• Mathematics Education (K-6) – M.A.
• Mathematics Education (Middle Grade) – M.A.
• Mathematics Education (Secondary) – M.A.
• English Language Learning (PreK-12) – M.A.
• Endorsement Preparation Program, English Language Learning (PreK-12)
• Science Education (Middle Grades) – M.A.
• Science Education (Secondary Chemistry) – M.A.
• Science Education (Secondary Physics) – M.A.
• Science Education (Secondary Biological Sciences) – M.A.
• Science Education (Secondary Earth Science)– M.A.
• View all Technology Bachelor's Degrees
• Cloud Computing – B.S.
• Computer Science – B.S.
• Cybersecurity and Information Assurance – B.S.
• Data Analytics – B.S.
• Information Technology – B.S.
• Network Engineering and Security – B.S.
• Software Engineering – B.S.
• Accelerated Information Technology Bachelor's and Master's Degree
• Information Technology Management – B.S. Business Administration (from the School of Business)
• View all Technology Master's Degrees
• Cybersecurity and Information Assurance – M.S.
• Data Analytics – M.S.
• Information Technology Management – M.S.
• MBA Information Technology Management (from the School of Business)
• Full Stack Engineering
• Web Application Deployment and Support
• Front End Web Development
• Back End Web Development

3rd Party Certifications

• IT Certifications Included in WGU Degrees
• View all Technology Degrees
• View all Health & Nursing Bachelor's Degrees
• Nursing (RN-to-BSN online) – B.S.
• Nursing (Prelicensure) – B.S. (Available in select states)
• Health Information Management – B.S.
• Health and Human Services – B.S.
• Psychology – B.S.
• Health Science – B.S.
• Healthcare Administration – B.S. (from the School of Business)
• View all Nursing Post-Master's Certificates
• Nursing Education—Post-Master's Certificate
• Nursing Leadership and Management—Post-Master's Certificate
• Family Nurse Practitioner—Post-Master's Certificate
• Psychiatric Mental Health Nurse Practitioner —Post-Master's Certificate
• View all Health & Nursing Degrees
• View all Nursing & Health Master's Degrees
• Nursing – Education (BSN-to-MSN Program) – M.S.
• Nursing – Leadership and Management (BSN-to-MSN Program) – M.S.
• Nursing – Nursing Informatics (BSN-to-MSN Program) – M.S.
• Nursing – Family Nurse Practitioner (BSN-to-MSN Program) – M.S. (Available in select states)
• Nursing – Psychiatric Mental Health Nurse Practitioner (BSN-to-MSN Program) – M.S. (Available in select states)
• Nursing – Education (RN-to-MSN Program) – M.S.
• Nursing – Leadership and Management (RN-to-MSN Program) – M.S.
• Nursing – Nursing Informatics (RN-to-MSN Program) – M.S.
• Master of Healthcare Administration
• MBA Healthcare Management (from the School of Business)
• Business Leadership (with the School of Business)
• Supply Chain (with the School of Business)
• Back End Web Development (with the School of Technology)
• Front End Web Development (with the School of Technology)
• Web Application Deployment and Support (with the School of Technology)
• Full Stack Engineering (with the School of Technology)
• Single Courses
• Course Bundles

Apply for Admission

Admission requirements.

• New Students
• WGU Returning Graduates
• WGU Readmission
• Enrollment Checklist
• Accessibility
• Accommodation Request
• School of Education Admission Requirements
• School of Business Admission Requirements
• School of Technology Admission Requirements
• Leavitt School of Health Admission Requirements

Additional Requirements

• Computer Requirements
• No Standardized Testing
• Clinical and Student Teaching Information

Transferring

• FAQs about Transferring
• Transfer to WGU
• Transferrable Certifications
• Request WGU Transcripts
• International Transfer Credit
• Tuition and Fees
• Financial Aid
• Scholarships

Other Ways to Pay for School

• Tuition—School of Business
• Tuition—School of Education
• Tuition—School of Technology
• Tuition—Leavitt School of Health
• Your Financial Obligations
• Tuition Comparison
• Applying for Financial Aid
• State Grants
• Consumer Information Guide
• Responsible Borrowing Initiative
• Higher Education Relief Fund

FAFSA Support

• Net Price Calculator
• FAFSA Simplification
• See All Scholarships
• Military Scholarships
• State Scholarships
• Scholarship FAQs

Payment Options

• Payment Plans
• Corporate Reimbursement
• Current Student Hardship Assistance
• Military Tuition Assistance

WGU Experience

• How You'll Learn
• Scheduling/Assessments
• Accreditation
• Student Support/Faculty
• Military Students
• Part-Time Options
• Virtual Military Education Resource Center
• Student Outcomes
• Return on Investment
• Students and Gradutes
• Career Growth
• Student Resources
• Communities
• Testimonials
• Career Guides
• Skills Guides
• Online Degrees
• All Degrees
• Explore Your Options

Admissions & Transfers

• Admissions Overview

Tuition & Financial Aid

Student Success

• Prospective Students
• Current Students
• Military and Veterans
• Commencement
• Careers at WGU
• Advancement & Giving
• Partnering with WGU

WESTERN GOVERNORS UNIVERSITY

Developing your critical thinking skills, critical thinking skills, critical thinking skills are the navigational tools needed for everyday life and in any professional journey. they enable you to analyze and solve complex problems effectively, allowing you to gain a competitive edge and empowering you to make smarter decisions.    .

With these skills, you’ll be able to think outside the box, adapt to change, and handle risks with greater efficiency. By improving your critical thinking abilities, you're setting yourself up to succeed in any field. 

This guide explores different types of critical thinking skills and how you can learn and apply them in your everyday life.

What Are Critical Thinking Skills?

Critical thinking skills refer to your ability to analyze, evaluate, and interpret information in a logical and systematic manner to determine possible solutions. Think of it as employing objective reasoning and sound judgment to assess situations, solve problems, make decisions, and draw meaningful conclusions.

These skills assist you in thinking clearly and making sensible decisions when needed to solve problems, make better choices, think independently, consider multiple viewpoints, and apply thoughtful analysis to complex issues.

Why Are Critical Thinking Skills Important?

Critical thinking skills are highly valued by employers and are crucial in today's job market for several reasons. Let’s have a look at why these skills are important:

• Decision-making: You can make informed decisions based on careful analysis, which leads to more effective decision-making, minimizing risks and maximizing opportunities. 
• Effective problem-solving: These skills provide the foundation for effective problem-solving in different professional contexts. These skills equip you to effectively identify, define, and analyze problems from different perspectives.
• Promote open-mindedness: Critical thinking leads to innovative ideas and approaches that will make you challenge assumptions. These challenges lead to innovative ideas and approaches. 
• Effective communication: By enabling you to clearly organize your thoughts and articulate ideas, critical thinking skills promote effective communication.

What are the Benefits of Having Critical Thinking Skills?

As mentioned above, critical thinking skills are crucial in every profession and enable you to stand out and succeed in your field. Let’s explore some of the benefits of critical thinking skills and how they add value to your profession:

Stronger analytical abilities: You enhance your analytical thinking capabilities, allowing you to gather, assess, and interpret data effectively. Using logical reasoning, you can identify patterns, extract relevant insights, and draw meaningful conclusions from complex information. This skill is valuable in problem-solving, decision-making, and strategic planning.  

Flexibility: Being flexible enables you to adapt to changing circumstances and swiftly navigate uncertainties. By considering multiple perspectives, evaluating information gathered, and adjusting your thinking, you can adapt your strategies and approaches to respond effectively to evolving situations. This adaptability is crucial in today's fast-changing work environments. 

Lifelong learning: By embracing a growth mindset and engaging in lifelong learning, you can acquire new skills, question assumptions, seek new knowledge, critically evaluate your beliefs, and stay relevant in your chosen field.  

Vision clarity: Having a clear vision enables you to forecast situations and goals. Critical thinking skills provide a framework for purposeful action. This concept also guarantees that your efforts are consistently directed toward achieving the desired outcomes.

Endless possibilities: Solid critical thinking skills allow you to uncover an array of potential outcomes, ideas, and opportunities to go beyond the familiar. 

Examples of Critical Thinking Skills in the Workplace

Critical thinking skills can be applied in many ways across various professions. Here are some practical examples:

Analysis: You can ask relevant questions, evaluate evidence, and draw logical conclusions based on available information. You can uncover a trend or problem through analysis and make a well-informed decision based on your findings. 

Evaluation: You can weigh different perspectives, consider biases or limitations, and make informed judgments about the quality and validity of information or claims presented. You can distinguish between credible and unreliable sources by evaluating evidence, claims, or proposals and determining the best cause of action.

Creative thinking: Thinking creatively means being innovative, embracing new perspectives, and engaging in divergent thinking to discover fresh insights and possibilities.  

Inference: You can draw logical conclusions based on available evidence, observations, or patterns. By making reasoned judgments and connecting pieces of information, you can delve deeper into complex situations leading to better solutions. 

Reflection: You can critically examine your thoughts, beliefs, and experiences. By displaying self-awareness and introspection, you enhance self-directed learning and promote continuous improvement.  

How Will I Use Critical Thinking Skills?

By developing and applying critical thinking skills, you will be better equipped to navigate complex work environments, contribute to organizational success, and excel in your chosen career path. 

These skills are applicable across various professional roles and industries. For example, with IT careers, you can use critical thinking skills in the following fields:

IT Career: In the IT industry, critical thinking skills are essential for problem-solving and troubleshooting. For example, you’ll be able to analyze the symptoms, gather relevant information, and evaluate potential causes. IT careers such as risk analysts , information manager and IT manager require solid critical thinking skills.

With health careers you can use critical thinking skills in the workplace. This includes:

Accurate diagnoses and treatment decisions: Critical thinking skills are crucial for the hospital environment and beyond.  For instance, as a nurse or doctor with strong critical thinking skills, you will carefully assess a patient's symptoms, review medical history, and analyze test results. Most careers in healthcare such as community health workers , ICU nurses , medical records manager , etc., require these skills.

With education careers, you’ll discover how critical thinking skills are useful in the classroom and beyond:

Designing engaging classroom activities: As a teacher with strong critical thinking skills, you’ll design engaging classroom activities and questions. You can promote problem-solving and creative learning. Most careers in education such as teaching assistants , preschool teachers , and even high school teachers need these skills.

With business professions you incorporate critical thinking skills into everyday decisions in the workplace:

Evaluating market trends: As a decision-maker in business, critical thinking skills help you evaluate market trends, analyze financial data, and assess potential risks and opportunities. You’ll use logical reasoning and sound judgment to make informed business-related decisions such as product development, resource allocation, and business strategies. Most business-related careers such as project management, actuary , human resources management , etc., need these skills.

Critical thinking skills provide a foundation for thoughtful approaches in each field.

How Can I Learn Critical Thinking Skills?

At WGU, our curriculum is designed to foster critical thinking skills by incorporating interactive and thought-provoking course content. 

Our courses are structured to encourage active learning and provide opportunities to apply critical thinking skills in different subject areas.  

For example, in the Leavitt School of Health , the following degree programs teach critical thinking as part of the coursework:

• BS Nursing (BSRN) 
• BS Nursing (RN- to BSN Degree), BSNU
• BS Nursing-Prelicensure (BSPRN) 

In nursing and other health-related degrees, you’ll learn to:

• Identify reliable and credible sources of information. 
• Identify different academic arguments concerning a particular issue.
• Identify potential sources of bias when analyzing a given issue. 
• Gather relevant facts to form a judgment.
• Analyze data from various sources and contexts. 

In critical thinking courses, you’ll encounter challenging concepts, case studies, and real-world scenarios that require critical analysis and problem-solving. 

You’ll be able to engage in collaborative learning activities, such as group projects, discussions, and simulations. You’ll also complete a capstone project that integrates and applies the knowledge and skills you’ve acquired. 

These activities encourage you to share ideas, consider diverse perspectives, and provide an opportunity to demonstrate your proficiency in critical thinking while also showcasing your ability to apply it practically. 

Our goal at WGU is to provide a comprehensive learning experience that enhances your critical thinking skills.

Frequently Asked Questions

How is critical thinking used in everyday life?

You can apply critical thinking to various aspects of everyday life, such as:

• Making logical decisions when solving problems. 
• Assessing the credibility of the information you encounter online to avoid being misled or scammed.
• Understanding and questioning norms, biases, and stereotypes leading to a change in policies and social justice. 

How do you say you’re good at critical thinking in your résumé?

You must provide concrete examples to demonstrate your abilities as a critical thinker in your résumé. 

For example, you can describe situations where you successfully applied critical thinking to solve problems or make decisions. 

You can also provide relevant certifications or coursework if you’ve completed any courses or certifications related to critical thinking. Make sure that you highlight them in the education section of your résumé.

What are the barriers to critical thinking?

There are various factors that can limit your ability to think critically:

• Allowing emotions to influence your thinking process.
• Conforming to cultural and social norms.
• Lacking access to accurate information about a subject. 
• Having insufficient time to thoroughly evaluate information.
• Lacking exposure to situations that require critical thinking.

Find Your Degree

Are you ready to embark on an exciting journey where your analytical reasoning and problem-solving abilities set you apart? 

Take the degree quiz and find the perfect degree program for you. Prepare to embrace a future of exciting possibilities and success in every facet of your life.

The University

For students.

• Student Portal
• Alumni Services

Most Visited Links

• Business Programs
• Student Experience
• Diversity, Equity, and Inclusion
• Student Communities

• Reference Manager
• Simple TEXT file

People also looked at

Original research article, performance assessment of critical thinking: conceptualization, design, and implementation.

• 1 Lynch School of Education and Human Development, Boston College, Chestnut Hill, MA, United States
• 2 Graduate School of Education, Stanford University, Stanford, CA, United States
• 3 Department of Business and Economics Education, Johannes Gutenberg University, Mainz, Germany

Enhancing students’ critical thinking (CT) skills is an essential goal of higher education. This article presents a systematic approach to conceptualizing and measuring CT. CT generally comprises the following mental processes: identifying, evaluating, and analyzing a problem; interpreting information; synthesizing evidence; and reporting a conclusion. We further posit that CT also involves dealing with dilemmas involving ambiguity or conflicts among principles and contradictory information. We argue that performance assessment provides the most realistic—and most credible—approach to measuring CT. From this conceptualization and construct definition, we describe one possible framework for building performance assessments of CT with attention to extended performance tasks within the assessment system. The framework is a product of an ongoing, collaborative effort, the International Performance Assessment of Learning (iPAL). The framework comprises four main aspects: (1) The storyline describes a carefully curated version of a complex, real-world situation. (2) The challenge frames the task to be accomplished (3). A portfolio of documents in a range of formats is drawn from multiple sources chosen to have specific characteristics. (4) The scoring rubric comprises a set of scales each linked to a facet of the construct. We discuss a number of use cases, as well as the challenges that arise with the use and valid interpretation of performance assessments. The final section presents elements of the iPAL research program that involve various refinements and extensions of the assessment framework, a number of empirical studies, along with linkages to current work in online reading and information processing.

Introduction

In their mission statements, most colleges declare that a principal goal is to develop students’ higher-order cognitive skills such as critical thinking (CT) and reasoning (e.g., Shavelson, 2010 ; Hyytinen et al., 2019 ). The importance of CT is echoed by business leaders ( Association of American Colleges and Universities [AACU], 2018 ), as well as by college faculty (for curricular analyses in Germany, see e.g., Zlatkin-Troitschanskaia et al., 2018 ). Indeed, in the 2019 administration of the Faculty Survey of Student Engagement (FSSE), 93% of faculty reported that they “very much” or “quite a bit” structure their courses to support student development with respect to thinking critically and analytically. In a listing of 21st century skills, CT was the most highly ranked among FSSE respondents ( Indiana University, 2019 ). Nevertheless, there is considerable evidence that many college students do not develop these skills to a satisfactory standard ( Arum and Roksa, 2011 ; Shavelson et al., 2019 ; Zlatkin-Troitschanskaia et al., 2019 ). This state of affairs represents a serious challenge to higher education – and to society at large.

In view of the importance of CT, as well as evidence of substantial variation in its development during college, its proper measurement is essential to tracking progress in skill development and to providing useful feedback to both teachers and learners. Feedback can help focus students’ attention on key skill areas in need of improvement, and provide insight to teachers on choices of pedagogical strategies and time allocation. Moreover, comparative studies at the program and institutional level can inform higher education leaders and policy makers.

The conceptualization and definition of CT presented here is closely related to models of information processing and online reasoning, the skills that are the focus of this special issue. These two skills are especially germane to the learning environments that college students experience today when much of their academic work is done online. Ideally, students should be capable of more than naïve Internet search, followed by copy-and-paste (e.g., McGrew et al., 2017 ); rather, for example, they should be able to critically evaluate both sources of evidence and the quality of the evidence itself in light of a given purpose ( Leu et al., 2020 ).

In this paper, we present a systematic approach to conceptualizing CT. From that conceptualization and construct definition, we present one possible framework for building performance assessments of CT with particular attention to extended performance tasks within the test environment. The penultimate section discusses some of the challenges that arise with the use and valid interpretation of performance assessment scores. We conclude the paper with a section on future perspectives in an emerging field of research – the iPAL program.

Conceptual Foundations, Definition and Measurement of Critical Thinking

In this section, we briefly review the concept of CT and its definition. In accordance with the principles of evidence-centered design (ECD; Mislevy et al., 2003 ), the conceptualization drives the measurement of the construct; that is, implementation of ECD directly links aspects of the assessment framework to specific facets of the construct. We then argue that performance assessments designed in accordance with such an assessment framework provide the most realistic—and most credible—approach to measuring CT. The section concludes with a sketch of an approach to CT measurement grounded in performance assessment .

Concept and Definition of Critical Thinking

Taxonomies of 21st century skills ( Pellegrino and Hilton, 2012 ) abound, and it is neither surprising that CT appears in most taxonomies of learning, nor that there are many different approaches to defining and operationalizing the construct of CT. There is, however, general agreement that CT is a multifaceted construct ( Liu et al., 2014 ). Liu et al. (2014) identified five key facets of CT: (i) evaluating evidence and the use of evidence; (ii) analyzing arguments; (iii) understanding implications and consequences; (iv) developing sound arguments; and (v) understanding causation and explanation.

There is empirical support for these facets from college faculty. A 2016–2017 survey conducted by the Higher Education Research Institute (HERI) at the University of California, Los Angeles found that a substantial majority of faculty respondents “frequently” encouraged students to: (i) evaluate the quality or reliability of the information they receive; (ii) recognize biases that affect their thinking; (iii) analyze multiple sources of information before coming to a conclusion; and (iv) support their opinions with a logical argument ( Stolzenberg et al., 2019 ).

There is general agreement that CT involves the following mental processes: identifying, evaluating, and analyzing a problem; interpreting information; synthesizing evidence; and reporting a conclusion (e.g., Erwin and Sebrell, 2003 ; Kosslyn and Nelson, 2017 ; Shavelson et al., 2018 ). We further suggest that CT includes dealing with dilemmas of ambiguity or conflict among principles and contradictory information ( Oser and Biedermann, 2020 ).

Importantly, Oser and Biedermann (2020) posit that CT can be manifested at three levels. The first level, Critical Analysis , is the most complex of the three levels. Critical Analysis requires both knowledge in a specific discipline (conceptual) and procedural analytical (deduction, inclusion, etc.) knowledge. The second level is Critical Reflection , which involves more generic skills “… necessary for every responsible member of a society” (p. 90). It is “a basic attitude that must be taken into consideration if (new) information is questioned to be true or false, reliable or not reliable, moral or immoral etc.” (p. 90). To engage in Critical Reflection, one needs not only apply analytic reasoning, but also adopt a reflective stance toward the political, social, and other consequences of choosing a course of action. It also involves analyzing the potential motives of various actors involved in the dilemma of interest. The third level, Critical Alertness , involves questioning one’s own or others’ thinking from a skeptical point of view.

Wheeler and Haertel (1993) categorized higher-order skills, such as CT, into two types: (i) when solving problems and making decisions in professional and everyday life, for instance, related to civic affairs and the environment; and (ii) in situations where various mental processes (e.g., comparing, evaluating, and justifying) are developed through formal instruction, usually in a discipline. Hence, in both settings, individuals must confront situations that typically involve a problematic event, contradictory information, and possibly conflicting principles. Indeed, there is an ongoing debate concerning whether CT should be evaluated using generic or discipline-based assessments ( Nagel et al., 2020 ). Whether CT skills are conceptualized as generic or discipline-specific has implications for how they are assessed and how they are incorporated into the classroom.

In the iPAL project, CT is characterized as a multifaceted construct that comprises conceptualizing, analyzing, drawing inferences or synthesizing information, evaluating claims, and applying the results of these reasoning processes to various purposes (e.g., solve a problem, decide on a course of action, find an answer to a given question or reach a conclusion) ( Shavelson et al., 2019 ). In the course of carrying out a CT task, an individual typically engages in activities such as specifying or clarifying a problem; deciding what information is relevant to the problem; evaluating the trustworthiness of information; avoiding judgmental errors based on “fast thinking”; avoiding biases and stereotypes; recognizing different perspectives and how they can reframe a situation; considering the consequences of alternative courses of actions; and communicating clearly and concisely decisions and actions. The order in which activities are carried out can vary among individuals and the processes can be non-linear and reciprocal.

In this article, we focus on generic CT skills. The importance of these skills derives not only from their utility in academic and professional settings, but also the many situations involving challenging moral and ethical issues – often framed in terms of conflicting principles and/or interests – to which individuals have to apply these skills ( Kegan, 1994 ; Tessier-Lavigne, 2020 ). Conflicts and dilemmas are ubiquitous in the contexts in which adults find themselves: work, family, civil society. Moreover, to remain viable in the global economic environment – one characterized by increased competition and advances in second generation artificial intelligence (AI) – today’s college students will need to continually develop and leverage their CT skills. Ideally, colleges offer a supportive environment in which students can develop and practice effective approaches to reasoning about and acting in learning, professional and everyday situations.

Measurement of Critical Thinking

Critical thinking is a multifaceted construct that poses many challenges to those who would develop relevant and valid assessments. For those interested in current approaches to the measurement of CT that are not the focus of this paper, consult Zlatkin-Troitschanskaia et al. (2018) .

In this paper, we have singled out performance assessment as it offers important advantages to measuring CT. Extant tests of CT typically employ response formats such as forced-choice or short-answer, and scenario-based tasks (for an overview, see Liu et al., 2014 ). They all suffer from moderate to severe construct underrepresentation; that is, they fail to capture important facets of the CT construct such as perspective taking and communication. High fidelity performance tasks are viewed as more authentic in that they provide a problem context and require responses that are more similar to what individuals confront in the real world than what is offered by traditional multiple-choice items ( Messick, 1994 ; Braun, 2019 ). This greater verisimilitude promises higher levels of construct representation and lower levels of construct-irrelevant variance. Such performance tasks have the capacity to measure facets of CT that are imperfectly assessed, if at all, using traditional assessments ( Lane and Stone, 2006 ; Braun, 2019 ; Shavelson et al., 2019 ). However, these assertions must be empirically validated, and the measures should be subjected to psychometric analyses. Evidence of the reliability, validity, and interpretative challenges of performance assessment (PA) are extensively detailed in Davey et al. (2015) .

We adopt the following definition of performance assessment:

A performance assessment (sometimes called a work sample when assessing job performance) … is an activity or set of activities that requires test takers, either individually or in groups, to generate products or performances in response to a complex, most often real-world task. These products and performances provide observable evidence bearing on test takers’ knowledge, skills, and abilities—their competencies—in completing the assessment ( Davey et al., 2015 , p. 10).

A performance assessment typically includes an extended performance task and short constructed-response and selected-response (i.e., multiple-choice) tasks (for examples, see Zlatkin-Troitschanskaia and Shavelson, 2019 ). In this paper, we refer to both individual performance- and constructed-response tasks as performance tasks (PT) (For an example, see Table 1 in section “iPAL Assessment Framework”).

Table 1. The iPAL assessment framework.

An Approach to Performance Assessment of Critical Thinking: The iPAL Program

The approach to CT presented here is the result of ongoing work undertaken by the International Performance Assessment of Learning collaborative (iPAL 1 ). iPAL is an international consortium of volunteers, primarily from academia, who have come together to address the dearth in higher education of research and practice in measuring CT with performance tasks ( Shavelson et al., 2018 ). In this section, we present iPAL’s assessment framework as the basis of measuring CT, with examples along the way.

iPAL Background

The iPAL assessment framework builds on the Council of Aid to Education’s Collegiate Learning Assessment (CLA). The CLA was designed to measure cross-disciplinary, generic competencies, such as CT, analytic reasoning, problem solving, and written communication ( Klein et al., 2007 ; Shavelson, 2010 ). Ideally, each PA contained an extended PT (e.g., examining a range of evidential materials related to the crash of an aircraft) and two short PT’s: one in which students either critique an argument or provide a solution in response to a real-world societal issue.

Motivated by considerations of adequate reliability, in 2012, the CLA was later modified to create the CLA+. The CLA+ includes two subtests: a PT and a 25-item Selected Response Question (SRQ) section. The PT presents a document or problem statement and an assignment based on that document which elicits an open-ended response. The CLA+ added the SRQ section (which is not linked substantively to the PT scenario) to increase the number of student responses to obtain more reliable estimates of performance at the student-level than could be achieved with a single PT ( Zahner, 2013 ; Davey et al., 2015 ).

iPAL Assessment Framework

Methodological foundations.

The iPAL framework evolved from the Collegiate Learning Assessment developed by Klein et al. (2007) . It was also informed by the results from the AHELO pilot study ( Organisation for Economic Co-operation and Development [OECD], 2012 , 2013 ), as well as the KoKoHs research program in Germany (for an overview see, Zlatkin-Troitschanskaia et al., 2017 , 2020 ). The ongoing refinement of the iPAL framework has been guided in part by the principles of Evidence Centered Design (ECD) ( Mislevy et al., 2003 ; Mislevy and Haertel, 2006 ; Haertel and Fujii, 2017 ).

In educational measurement, an assessment framework plays a critical intermediary role between the theoretical formulation of the construct and the development of the assessment instrument containing tasks (or items) intended to elicit evidence with respect to that construct ( Mislevy et al., 2003 ). Builders of the assessment framework draw on the construct theory and operationalize it in a way that provides explicit guidance to PT’s developers. Thus, the framework should reflect the relevant facets of the construct, where relevance is determined by substantive theory or an appropriate alternative such as behavioral samples from real-world situations of interest (criterion-sampling; McClelland, 1973 ), as well as the intended use(s) (for an example, see Shavelson et al., 2019 ). By following the requirements and guidelines embodied in the framework, instrument developers strengthen the claim of construct validity for the instrument ( Messick, 1994 ).

An assessment framework can be specified at different levels of granularity: an assessment battery (“omnibus” assessment, for an example see below), a single performance task, or a specific component of an assessment ( Shavelson, 2010 ; Davey et al., 2015 ). In the iPAL program, a performance assessment comprises one or more extended performance tasks and additional selected-response and short constructed-response items. The focus of the framework specified below is on a single PT intended to elicit evidence with respect to some facets of CT, such as the evaluation of the trustworthiness of the documents provided and the capacity to address conflicts of principles.

From the ECD perspective, an assessment is an instrument for generating information to support an evidentiary argument and, therefore, the intended inferences (claims) must guide each stage of the design process. The construct of interest is operationalized through the Student Model , which represents the target knowledge, skills, and abilities, as well as the relationships among them. The student model should also make explicit the assumptions regarding student competencies in foundational skills or content knowledge. The Task Model specifies the features of the problems or items posed to the respondent, with the goal of eliciting the evidence desired. The assessment framework also describes the collection of task models comprising the instrument, with considerations of construct validity, various psychometric characteristics (e.g., reliability) and practical constraints (e.g., testing time and cost). The student model provides grounds for evidence of validity, especially cognitive validity; namely, that the students are thinking critically in responding to the task(s).

In the present context, the target construct (CT) is the competence of individuals to think critically, which entails solving complex, real-world problems, and clearly communicating their conclusions or recommendations for action based on trustworthy, relevant and unbiased information. The situations, drawn from actual events, are challenging and may arise in many possible settings. In contrast to more reductionist approaches to assessment development, the iPAL approach and framework rests on the assumption that properly addressing these situational demands requires the application of a constellation of CT skills appropriate to the particular task presented (e.g., Shavelson, 2010 , 2013 ). For a PT, the assessment framework must also specify the rubric by which the responses will be evaluated. The rubric must be properly linked to the target construct so that the resulting score profile constitutes evidence that is both relevant and interpretable in terms of the student model (for an example, see Zlatkin-Troitschanskaia et al., 2019 ).

iPAL Task Framework

The iPAL ‘omnibus’ framework comprises four main aspects: A storyline , a challenge , a document library , and a scoring rubric . Table 1 displays these aspects, brief descriptions of each, and the corresponding examples drawn from an iPAL performance assessment (Version adapted from original in Hyytinen and Toom, 2019 ). Storylines are drawn from various domains; for example, the worlds of business, public policy, civics, medicine, and family. They often involve moral and/or ethical considerations. Deriving an appropriate storyline from a real-world situation requires careful consideration of which features are to be kept in toto , which adapted for purposes of the assessment, and which to be discarded. Framing the challenge demands care in wording so that there is minimal ambiguity in what is required of the respondent. The difficulty of the challenge depends, in large part, on the nature and extent of the information provided in the document library , the amount of scaffolding included, as well as the scope of the required response. The amount of information and the scope of the challenge should be commensurate with the amount of time available. As is evident from the table, the characteristics of the documents in the library are intended to elicit responses related to facets of CT. For example, with regard to bias, the information provided is intended to play to judgmental errors due to fast thinking and/or motivational reasoning. Ideally, the situation should accommodate multiple solutions of varying degrees of merit.

The dimensions of the scoring rubric are derived from the Task Model and Student Model ( Mislevy et al., 2003 ) and signal which features are to be extracted from the response and indicate how they are to be evaluated. There should be a direct link between the evaluation of the evidence and the claims that are made with respect to the key features of the task model and student model . More specifically, the task model specifies the various manipulations embodied in the PA and so informs scoring, while the student model specifies the capacities students employ in more or less effectively responding to the tasks. The score scales for each of the five facets of CT (see section “Concept and Definition of Critical Thinking”) can be specified using appropriate behavioral anchors (for examples, see Zlatkin-Troitschanskaia and Shavelson, 2019 ). Of particular importance is the evaluation of the response with respect to the last dimension of the scoring rubric; namely, the overall coherence and persuasiveness of the argument, building on the explicit or implicit characteristics related to the first five dimensions. The scoring process must be monitored carefully to ensure that (trained) raters are judging each response based on the same types of features and evaluation criteria ( Braun, 2019 ) as indicated by interrater agreement coefficients.

The scoring rubric of the iPAL omnibus framework can be modified for specific tasks ( Lane and Stone, 2006 ). This generic rubric helps ensure consistency across rubrics for different storylines. For example, Zlatkin-Troitschanskaia et al. (2019 , p. 473) used the following scoring scheme:

Based on our construct definition of CT and its four dimensions: (D1-Info) recognizing and evaluating information, (D2-Decision) recognizing and evaluating arguments and making decisions, (D3-Conseq) recognizing and evaluating the consequences of decisions, and (D4-Writing), we developed a corresponding analytic dimensional scoring … The students’ performance is evaluated along the four dimensions, which in turn are subdivided into a total of 23 indicators as (sub)categories of CT … For each dimension, we sought detailed evidence in students’ responses for the indicators and scored them on a six-point Likert-type scale. In order to reduce judgment distortions, an elaborate procedure of ‘behaviorally anchored rating scales’ (Smith and Kendall, 1963) was applied by assigning concrete behavioral expectations to certain scale points (Bernardin et al., 1976). To this end, we defined the scale levels by short descriptions of typical behavior and anchored them with concrete examples. … We trained four raters in 1 day using a specially developed training course to evaluate students’ performance along the 23 indicators clustered into four dimensions (for a description of the rater training, see Klotzer, 2018).

Shavelson et al. (2019) examined the interrater agreement of the scoring scheme developed by Zlatkin-Troitschanskaia et al. (2019) and “found that with 23 items and 2 raters the generalizability (“reliability”) coefficient for total scores to be 0.74 (with 4 raters, 0.84)” ( Shavelson et al., 2019 , p. 15). In the study by Zlatkin-Troitschanskaia et al. (2019 , p. 478) three score profiles were identified (low-, middle-, and high-performer) for students. Proper interpretation of such profiles requires care. For example, there may be multiple possible explanations for low scores such as poor CT skills, a lack of a disposition to engage with the challenge, or the two attributes jointly. These alternative explanations for student performance can potentially pose a threat to the evidentiary argument. In this case, auxiliary information may be available to aid in resolving the ambiguity. For example, student responses to selected- and short-constructed-response items in the PA can provide relevant information about the levels of the different skills possessed by the student. When sufficient data are available, the scores can be modeled statistically and/or qualitatively in such a way as to bring them to bear on the technical quality or interpretability of the claims of the assessment: reliability, validity, and utility evidence ( Davey et al., 2015 ; Zlatkin-Troitschanskaia et al., 2019 ). These kinds of concerns are less critical when PT’s are used in classroom settings. The instructor can draw on other sources of evidence, including direct discussion with the student.

Use of iPAL Performance Assessments in Educational Practice: Evidence From Preliminary Validation Studies

The assessment framework described here supports the development of a PT in a general setting. Many modifications are possible and, indeed, desirable. If the PT is to be more deeply embedded in a certain discipline (e.g., economics, law, or medicine), for example, then the framework must specify characteristics of the narrative and the complementary documents as to the breadth and depth of disciplinary knowledge that is represented.

At present, preliminary field trials employing the omnibus framework (i.e., a full set of documents) indicated that 60 min was generally an inadequate amount of time for students to engage with the full set of complementary documents and to craft a complete response to the challenge (for an example, see Shavelson et al., 2019 ). Accordingly, it would be helpful to develop modified frameworks for PT’s that require substantially less time. For an example, see a short performance assessment of civic online reasoning, requiring response times from 10 to 50 min ( Wineburg et al., 2016 ). Such assessment frameworks could be derived from the omnibus framework by focusing on a reduced number of facets of CT, and specifying the characteristics of the complementary documents to be included – or, perhaps, choices among sets of documents. In principle, one could build a ‘family’ of PT’s, each using the same (or nearly the same) storyline and a subset of the full collection of complementary documents.

Paul and Elder (2007) argue that the goal of CT assessments should be to provide faculty with important information about how well their instruction supports the development of students’ CT. In that spirit, the full family of PT’s could represent all facets of the construct while affording instructors and students more specific insights on strengths and weaknesses with respect to particular facets of CT. Moreover, the framework should be expanded to include the design of a set of short answer and/or multiple choice items to accompany the PT. Ideally, these additional items would be based on the same narrative as the PT to collect more nuanced information on students’ precursor skills such as reading comprehension, while enhancing the overall reliability of the assessment. Areas where students are under-prepared could be addressed before, or even in parallel with the development of the focal CT skills. The parallel approach follows the co-requisite model of developmental education. In other settings (e.g., for summative assessment), these complementary items would be administered after the PT to augment the evidence in relation to the various claims. The full PT taking 90 min or more could serve as a capstone assessment.

As we transition from simply delivering paper-based assessments by computer to taking full advantage of the affordances of a digital platform, we should learn from the hard-won lessons of the past so that we can make swifter progress with fewer missteps. In that regard, we must take validity as the touchstone – assessment design, development and deployment must all be tightly linked to the operational definition of the CT construct. Considerations of reliability and practicality come into play with various use cases that highlight different purposes for the assessment (for future perspectives, see next section).

The iPAL assessment framework represents a feasible compromise between commercial, standardized assessments of CT (e.g., Liu et al., 2014 ), on the one hand, and, on the other, freedom for individual faculty to develop assessment tasks according to idiosyncratic models. It imposes a degree of standardization on both task development and scoring, while still allowing some flexibility for faculty to tailor the assessment to meet their unique needs. In so doing, it addresses a key weakness of the AAC&U’s VALUE initiative 2 (retrieved 5/7/2020) that has achieved wide acceptance among United States colleges.

The VALUE initiative has produced generic scoring rubrics for 15 domains including CT, problem-solving and written communication. A rubric for a particular skill domain (e.g., critical thinking) has five to six dimensions with four ordered performance levels for each dimension (1 = lowest, 4 = highest). The performance levels are accompanied by language that is intended to clearly differentiate among levels. 3 Faculty are asked to submit student work products from a senior level course that is intended to yield evidence with respect to student learning outcomes in a particular domain and that, they believe, can elicit performances at the highest level. The collection of work products is then graded by faculty from other institutions who have been trained to apply the rubrics.

A principal difficulty is that there is neither a common framework to guide the design of the challenge, nor any control on task complexity and difficulty. Consequently, there is substantial heterogeneity in the quality and evidential value of the submitted responses. This also causes difficulties with task scoring and inter-rater reliability. Shavelson et al. (2009) discuss some of the problems arising with non-standardized collections of student work.

In this context, one advantage of the iPAL framework is that it can provide valuable guidance and an explicit structure for faculty in developing performance tasks for both instruction and formative assessment. When faculty design assessments, their focus is typically on content coverage rather than other potentially important characteristics, such as the degree of construct representation and the adequacy of their scoring procedures ( Braun, 2019 ).

Concluding Reflections

Challenges to interpretation and implementation.

Performance tasks such as those generated by iPAL are attractive instruments for assessing CT skills (e.g., Shavelson, 2010 ; Shavelson et al., 2019 ). The attraction mainly rests on the assumption that elaborated PT’s are more authentic (direct) and more completely capture facets of the target construct (i.e., possess greater construct representation) than the widely used selected-response tests. However, as Messick (1994) noted authenticity is a “promissory note” that must be redeemed with empirical research. In practice, there are trade-offs among authenticity, construct validity, and psychometric quality such as reliability ( Davey et al., 2015 ).

One reason for Messick (1994) caution is that authenticity does not guarantee construct validity. The latter must be established by drawing on multiple sources of evidence ( American Educational Research Association et al., 2014 ). Following the ECD principles in designing and developing the PT, as well as the associated scoring rubrics, constitutes an important type of evidence. Further, as Leighton (2019) argues, response process data (“cognitive validity”) is needed to validate claims regarding the cognitive complexity of PT’s. Relevant data can be obtained through cognitive laboratory studies involving methods such as think aloud protocols or eye-tracking. Although time-consuming and expensive, such studies can yield not only evidence of validity, but also valuable information to guide refinements of the PT.

Going forward, iPAL PT’s must be subjected to validation studies as recommended in the Standards for Psychological and Educational Testing by American Educational Research Association et al. (2014) . With a particular focus on the criterion “relationships to other variables,” a framework should include assumptions about the theoretically expected relationships among the indicators assessed by the PT, as well as the indicators’ relationships to external variables such as intelligence or prior (task-relevant) knowledge.

Complementing the necessity of evaluating construct validity, there is the need to consider potential sources of construct-irrelevant variance (CIV). One pertains to student motivation, which is typically greater when the stakes are higher. If students are not motivated, then their performance is likely to be impacted by factors unrelated to their (construct-relevant) ability ( Lane and Stone, 2006 ; Braun et al., 2011 ; Shavelson, 2013 ). Differential motivation across groups can also bias comparisons. Student motivation might be enhanced if the PT is administered in the context of a course with the promise of generating useful feedback on students’ skill profiles.

Construct-irrelevant variance can also occur when students are not equally prepared for the format of the PT or fully appreciate the response requirements. This source of CIV could be alleviated by providing students with practice PT’s. Finally, the use of novel forms of documentation, such as those from the Internet, can potentially introduce CIV due to differential familiarity with forms of representation or contents. Interestingly, this suggests that there may be a conflict between enhancing construct representation and reducing CIV.

Another potential source of CIV is related to response evaluation. Even with training, human raters can vary in accuracy and usage of the full score range. In addition, raters may attend to features of responses that are unrelated to the target construct, such as the length of the students’ responses or the frequency of grammatical errors ( Lane and Stone, 2006 ). Some of these sources of variance could be addressed in an online environment, where word processing software could alert students to potential grammatical and spelling errors before they submit their final work product.

Performance tasks generally take longer to administer and are more costly than traditional assessments, making it more difficult to reliably measure student performance ( Messick, 1994 ; Davey et al., 2015 ). Indeed, it is well known that more than one performance task is needed to obtain high reliability ( Shavelson, 2013 ). This is due to both student-task interactions and variability in scoring. Sources of student-task interactions are differential familiarity with the topic ( Hyytinen and Toom, 2019 ) and differential motivation to engage with the task. The level of reliability required, however, depends on the context of use. For use in formative assessment as part of an instructional program, reliability can be lower than use for summative purposes. In the former case, other types of evidence are generally available to support interpretation and guide pedagogical decisions. Further studies are needed to obtain estimates of reliability in typical instructional settings.

With sufficient data, more sophisticated psychometric analyses become possible. One challenge is that the assumption of unidimensionality required for many psychometric models might be untenable for performance tasks ( Davey et al., 2015 ). Davey et al. (2015) provide the example of a mathematics assessment that requires students to demonstrate not only their mathematics skills but also their written communication skills. Although the iPAL framework does not explicitly address students’ reading comprehension and organization skills, students will likely need to call on these abilities to accomplish the task. Moreover, as the operational definition of CT makes evident, the student must not only deploy several skills in responding to the challenge of the PT, but also carry out component tasks in sequence. The former requirement strongly indicates the need for a multi-dimensional IRT model, while the latter suggests that the usual assumption of local item independence may well be problematic ( Lane and Stone, 2006 ). At the same time, the analytic scoring rubric should facilitate the use of latent class analysis to partition data from large groups into meaningful categories ( Zlatkin-Troitschanskaia et al., 2019 ).

Future Perspectives

Although the iPAL consortium has made substantial progress in the assessment of CT, much remains to be done. Further refinement of existing PT’s and their adaptation to different languages and cultures must continue. To this point, there are a number of examples: The refugee crisis PT (cited in Table 1 ) was translated and adapted from Finnish to US English and then to Colombian Spanish. A PT concerning kidney transplants was translated and adapted from German to US English. Finally, two PT’s based on ‘legacy admissions’ to US colleges were translated and adapted to Colombian Spanish.

With respect to data collection, there is a need for sufficient data to support psychometric analysis of student responses, especially the relationships among the different components of the scoring rubric, as this would inform both task development and response evaluation ( Zlatkin-Troitschanskaia et al., 2019 ). In addition, more intensive study of response processes through cognitive laboratories and the like are needed to strengthen the evidential argument for construct validity ( Leighton, 2019 ). We are currently conducting empirical studies, collecting data on both iPAL PT’s and other measures of CT. These studies will provide evidence of convergent and discriminant validity.

At the same time, efforts should be directed at further development to support different ways CT PT’s might be used—i.e., use cases—especially those that call for formative use of PT’s. Incorporating formative assessment into courses can plausibly be expected to improve students’ competency acquisition ( Zlatkin-Troitschanskaia et al., 2017 ). With suitable choices of storylines, appropriate combinations of (modified) PT’s, supplemented by short-answer and multiple-choice items, could be interwoven into ordinary classroom activities. The supplementary items may be completely separate from the PT’s (as is the case with the CLA+), loosely coupled with the PT’s (as in drawing on the same storyline), or tightly linked to the PT’s (as in requiring elaboration of certain components of the response to the PT).

As an alternative to such integration, stand-alone modules could be embedded in courses to yield evidence of students’ generic CT skills. Core curriculum courses or general education courses offer ideal settings for embedding performance assessments. If these assessments were administered to a representative sample of students in each cohort over their years in college, the results would yield important information on the development of CT skills at a population level. For another example, these PA’s could be used to assess the competence profiles of students entering Bachelor’s or graduate-level programs as a basis for more targeted instructional support.

Thus, in considering different use cases for the assessment of CT, it is evident that several modifications of the iPAL omnibus assessment framework are needed. As noted earlier, assessments built according to this framework are demanding with respect to the extensive preliminary work required by a task and the time required to properly complete it. Thus, it would be helpful to have modified versions of the framework, focusing on one or two facets of the CT construct and calling for a smaller number of supplementary documents. The challenge to the student should be suitably reduced.

Some members of the iPAL collaborative have developed PT’s that are embedded in disciplines such as engineering, law and education ( Crump et al., 2019 ; for teacher education examples, see Jeschke et al., 2019 ). These are proving to be of great interest to various stakeholders and further development is likely. Consequently, it is essential that an appropriate assessment framework be established and implemented. It is both a conceptual and an empirical question as to whether a single framework can guide development in different domains.

Performance Assessment in Online Learning Environment

Over the last 15 years, increasing amounts of time in both college and work are spent using computers and other electronic devices. This has led to formulation of models for the new literacies that attempt to capture some key characteristics of these activities. A prominent example is a model proposed by Leu et al. (2020) . The model frames online reading as a process of problem-based inquiry that calls on five practices to occur during online research and comprehension:

1. Reading to identify important questions,

2. Reading to locate information,

3. Reading to critically evaluate information,

4. Reading to synthesize online information, and

5. Reading and writing to communicate online information.

The parallels with the iPAL definition of CT are evident and suggest there may be benefits to closer links between these two lines of research. For example, a report by Leu et al. (2014) describes empirical studies comparing assessments of online reading using either open-ended or multiple-choice response formats.

The iPAL consortium has begun to take advantage of the affordances of the online environment (for examples, see Schmidt et al. and Nagel et al. in this special issue). Most obviously, Supplementary Materials can now include archival photographs, audio recordings, or videos. Additional tasks might include the online search for relevant documents, though this would add considerably to the time demands. This online search could occur within a simulated Internet environment, as is the case for the IEA’s ePIRLS assessment ( Mullis et al., 2017 ).

The prospect of having access to a wealth of materials that can add to task authenticity is exciting. Yet it can also add ambiguity and information overload. Increased authenticity, then, should be weighed against validity concerns and the time required to absorb the content in these materials. Modifications of the design framework and extensive empirical testing will be required to decide on appropriate trade-offs. A related possibility is to employ some of these materials in short-answer (or even selected-response) items that supplement the main PT. Response formats could include highlighting text or using a drag-and-drop menu to construct a response. Students’ responses could be automatically scored, thereby containing costs. With automated scoring, feedback to students and faculty, including suggestions for next steps in strengthening CT skills, could also be provided without adding to faculty workload. Therefore, taking advantage of the online environment to incorporate new types of supplementary documents should be a high priority and, perhaps, to introduce new response formats as well. Finally, further investigation of the overlap between this formulation of CT and the characterization of online reading promulgated by Leu et al. (2020) is a promising direction to pursue.

Data Availability Statement

All datasets generated for this study are included in the article/supplementary material.

Author Contributions

HB wrote the article. RS, OZ-T, and KB were involved in the preparation and revision of the article and co-wrote the manuscript. All authors contributed to the article and approved the submitted version.

This study was funded in part by the Spencer Foundation (Grant No. #201700123).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We would like to thank all the researchers who have participated in the iPAL program.

• ^ https://www.ipal-rd.com/
• ^ https://www.aacu.org/value
• ^ When test results are reported by means of substantively defined categories, the scoring is termed “criterion-referenced”. This is, in contrast to results, reported as percentiles; such scoring is termed “norm-referenced”.

American Educational Research Association, American Psychological Association, and National Council on Measurement in Education (2014). Standards for Educational and Psychological Testing. Washington, D.C: American Educational Research Association.

Google Scholar

Arum, R., and Roksa, J. (2011). Academically Adrift: Limited Learning on College Campuses. Chicago, IL: University of Chicago Press.

Association of American Colleges and Universities (n.d.). VALUE: What is value?. Available online at:: https://www.aacu.org/value (accessed May 7, 2020).

Association of American Colleges and Universities [AACU] (2018). Fulfilling the American Dream: Liberal Education and the Future of Work. Available online at:: https://www.aacu.org/research/2018-future-of-work (accessed May 1, 2020).

Braun, H. (2019). Performance assessment and standardization in higher education: a problematic conjunction? Br. J. Educ. Psychol. 89, 429–440. doi: 10.1111/bjep.12274

PubMed Abstract | CrossRef Full Text | Google Scholar

Braun, H. I., Kirsch, I., and Yamoto, K. (2011). An experimental study of the effects of monetary incentives on performance on the 12th grade NAEP reading assessment. Teach. Coll. Rec. 113, 2309–2344.

Crump, N., Sepulveda, C., Fajardo, A., and Aguilera, A. (2019). Systematization of performance tests in critical thinking: an interdisciplinary construction experience. Rev. Estud. Educ. 2, 17–47.

Davey, T., Ferrara, S., Shavelson, R., Holland, P., Webb, N., and Wise, L. (2015). Psychometric Considerations for the Next Generation of Performance Assessment. Washington, DC: Center for K-12 Assessment & Performance Management, Educational Testing Service.

Erwin, T. D., and Sebrell, K. W. (2003). Assessment of critical thinking: ETS’s tasks in critical thinking. J. Gen. Educ. 52, 50–70. doi: 10.1353/jge.2003.0019

CrossRef Full Text | Google Scholar

Haertel, G. D., and Fujii, R. (2017). “Evidence-centered design and postsecondary assessment,” in Handbook on Measurement, Assessment, and Evaluation in Higher Education , 2nd Edn, eds C. Secolsky and D. B. Denison (Abingdon: Routledge), 313–339. doi: 10.4324/9781315709307-26

Hyytinen, H., and Toom, A. (2019). Developing a performance assessment task in the Finnish higher education context: conceptual and empirical insights. Br. J. Educ. Psychol. 89, 551–563. doi: 10.1111/bjep.12283

Hyytinen, H., Toom, A., and Shavelson, R. J. (2019). “Enhancing scientific thinking through the development of critical thinking in higher education,” in Redefining Scientific Thinking for Higher Education: Higher-Order Thinking, Evidence-Based Reasoning and Research Skills , eds M. Murtonen and K. Balloo (London: Palgrave MacMillan).

Indiana University (2019). FSSE 2019 Frequencies: FSSE 2019 Aggregate. Available online at:: http://fsse.indiana.edu/pdf/FSSE_IR_2019/summary_tables/FSSE19_Frequencies_(FSSE_2019).pdf (accessed May 1, 2020).

Jeschke, C., Kuhn, C., Lindmeier, A., Zlatkin-Troitschanskaia, O., Saas, H., and Heinze, A. (2019). Performance assessment to investigate the domain specificity of instructional skills among pre-service and in-service teachers of mathematics and economics. Br. J. Educ. Psychol. 89, 538–550. doi: 10.1111/bjep.12277

Kegan, R. (1994). In Over Our Heads: The Mental Demands of Modern Life. Cambridge, MA: Harvard University Press.

Klein, S., Benjamin, R., Shavelson, R., and Bolus, R. (2007). The collegiate learning assessment: facts and fantasies. Eval. Rev. 31, 415–439. doi: 10.1177/0193841x07303318

Kosslyn, S. M., and Nelson, B. (2017). Building the Intentional University: Minerva and the Future of Higher Education. Cambridge, MAL: The MIT Press.

Lane, S., and Stone, C. A. (2006). “Performance assessment,” in Educational Measurement , 4th Edn, ed. R. L. Brennan (Lanham, MA: Rowman & Littlefield Publishers), 387–432.

Leighton, J. P. (2019). The risk–return trade-off: performance assessments and cognitive validation of inferences. Br. J. Educ. Psychol. 89, 441–455. doi: 10.1111/bjep.12271

Leu, D. J., Kiili, C., Forzani, E., Zawilinski, L., McVerry, J. G., and O’Byrne, W. I. (2020). “The new literacies of online research and comprehension,” in The Concise Encyclopedia of Applied Linguistics , ed. C. A. Chapelle (Oxford: Wiley-Blackwell), 844–852.

Leu, D. J., Kulikowich, J. M., Kennedy, C., and Maykel, C. (2014). “The ORCA Project: designing technology-based assessments for online research,” in Paper Presented at the American Educational Research Annual Meeting , Philadelphia, PA.

Liu, O. L., Frankel, L., and Roohr, K. C. (2014). Assessing critical thinking in higher education: current state and directions for next-generation assessments. ETS Res. Rep. Ser. 1, 1–23. doi: 10.1002/ets2.12009

McClelland, D. C. (1973). Testing for competence rather than for “intelligence.”. Am. Psychol. 28, 1–14. doi: 10.1037/h0034092

McGrew, S., Ortega, T., Breakstone, J., and Wineburg, S. (2017). The challenge that’s bigger than fake news: civic reasoning in a social media environment. Am. Educ. 4, 4-9, 39.

Mejía, A., Mariño, J. P., and Molina, A. (2019). Incorporating perspective analysis into critical thinking performance assessments. Br. J. Educ. Psychol. 89, 456–467. doi: 10.1111/bjep.12297

Messick, S. (1994). The interplay of evidence and consequences in the validation of performance assessments. Educ. Res. 23, 13–23. doi: 10.3102/0013189x023002013

Mislevy, R. J., Almond, R. G., and Lukas, J. F. (2003). A brief introduction to evidence-centered design. ETS Res. Rep. Ser. 2003, i–29. doi: 10.1002/j.2333-8504.2003.tb01908.x

Mislevy, R. J., and Haertel, G. D. (2006). Implications of evidence-centered design for educational testing. Educ. Meas. Issues Pract. 25, 6–20. doi: 10.1111/j.1745-3992.2006.00075.x

Mullis, I. V. S., Martin, M. O., Foy, P., and Hooper, M. (2017). ePIRLS 2016 International Results in Online Informational Reading. Available online at:: http://timssandpirls.bc.edu/pirls2016/international-results/ (accessed May 1, 2020).

Nagel, M.-T., Zlatkin-Troitschanskaia, O., Schmidt, S., and Beck, K. (2020). “Performance assessment of generic and domain-specific skills in higher education economics,” in Student Learning in German Higher Education , eds O. Zlatkin-Troitschanskaia, H. A. Pant, M. Toepper, and C. Lautenbach (Berlin: Springer), 281–299. doi: 10.1007/978-3-658-27886-1_14

Organisation for Economic Co-operation and Development [OECD] (2012). AHELO: Feasibility Study Report , Vol. 1. Paris: OECD. Design and implementation.

Organisation for Economic Co-operation and Development [OECD] (2013). AHELO: Feasibility Study Report , Vol. 2. Paris: OECD. Data analysis and national experiences.

Oser, F. K., and Biedermann, H. (2020). “A three-level model for critical thinking: critical alertness, critical reflection, and critical analysis,” in Frontiers and Advances in Positive Learning in the Age of Information (PLATO) , ed. O. Zlatkin-Troitschanskaia (Cham: Springer), 89–106. doi: 10.1007/978-3-030-26578-6_7

Paul, R., and Elder, L. (2007). Consequential validity: using assessment to drive instruction. Found. Crit. Think. 29, 31–40.

Pellegrino, J. W., and Hilton, M. L. (eds) (2012). Education for life and work: Developing Transferable Knowledge and Skills in the 21st Century. Washington DC: National Academies Press.

Shavelson, R. (2010). Measuring College Learning Responsibly: Accountability in a New Era. Redwood City, CA: Stanford University Press.

Shavelson, R. J. (2013). On an approach to testing and modeling competence. Educ. Psychol. 48, 73–86. doi: 10.1080/00461520.2013.779483

Shavelson, R. J., Zlatkin-Troitschanskaia, O., Beck, K., Schmidt, S., and Marino, J. P. (2019). Assessment of university students’ critical thinking: next generation performance assessment. Int. J. Test. 19, 337–362. doi: 10.1080/15305058.2018.1543309

Shavelson, R. J., Zlatkin-Troitschanskaia, O., and Marino, J. P. (2018). “International performance assessment of learning in higher education (iPAL): research and development,” in Assessment of Learning Outcomes in Higher Education: Cross-National Comparisons and Perspectives , eds O. Zlatkin-Troitschanskaia, M. Toepper, H. A. Pant, C. Lautenbach, and C. Kuhn (Berlin: Springer), 193–214. doi: 10.1007/978-3-319-74338-7_10

Shavelson, R. J., Klein, S., and Benjamin, R. (2009). The limitations of portfolios. Inside Higher Educ. Available online at: https://www.insidehighered.com/views/2009/10/16/limitations-portfolios

Stolzenberg, E. B., Eagan, M. K., Zimmerman, H. B., Berdan Lozano, J., Cesar-Davis, N. M., Aragon, M. C., et al. (2019). Undergraduate Teaching Faculty: The HERI Faculty Survey 2016–2017. Los Angeles, CA: UCLA.

Tessier-Lavigne, M. (2020). Putting Ethics at the Heart of Innovation. Stanford, CA: Stanford Magazine.

Wheeler, P., and Haertel, G. D. (1993). Resource Handbook on Performance Assessment and Measurement: A Tool for Students, Practitioners, and Policymakers. Palm Coast, FL: Owl Press.

Wineburg, S., McGrew, S., Breakstone, J., and Ortega, T. (2016). Evaluating Information: The Cornerstone of Civic Online Reasoning. Executive Summary. Stanford, CA: Stanford History Education Group.

Zahner, D. (2013). Reliability and Validity–CLA+. Council for Aid to Education. Available online at:: https://pdfs.semanticscholar.org/91ae/8edfac44bce3bed37d8c9091da01d6db3776.pdf .

Zlatkin-Troitschanskaia, O., and Shavelson, R. J. (2019). Performance assessment of student learning in higher education [Special issue]. Br. J. Educ. Psychol. 89, i–iv, 413–563.

Zlatkin-Troitschanskaia, O., Pant, H. A., Lautenbach, C., Molerov, D., Toepper, M., and Brückner, S. (2017). Modeling and Measuring Competencies in Higher Education: Approaches to Challenges in Higher Education Policy and Practice. Berlin: Springer VS.

Zlatkin-Troitschanskaia, O., Pant, H. A., Toepper, M., and Lautenbach, C. (eds) (2020). Student Learning in German Higher Education: Innovative Measurement Approaches and Research Results. Wiesbaden: Springer.

Zlatkin-Troitschanskaia, O., Shavelson, R. J., and Pant, H. A. (2018). “Assessment of learning outcomes in higher education: international comparisons and perspectives,” in Handbook on Measurement, Assessment, and Evaluation in Higher Education , 2nd Edn, eds C. Secolsky and D. B. Denison (Abingdon: Routledge), 686–697.

Zlatkin-Troitschanskaia, O., Shavelson, R. J., Schmidt, S., and Beck, K. (2019). On the complementarity of holistic and analytic approaches to performance assessment scoring. Br. J. Educ. Psychol. 89, 468–484. doi: 10.1111/bjep.12286

Keywords : critical thinking, performance assessment, assessment framework, scoring rubric, evidence-centered design, 21st century skills, higher education

Citation: Braun HI, Shavelson RJ, Zlatkin-Troitschanskaia O and Borowiec K (2020) Performance Assessment of Critical Thinking: Conceptualization, Design, and Implementation. Front. Educ. 5:156. doi: 10.3389/feduc.2020.00156

Received: 30 May 2020; Accepted: 04 August 2020; Published: 08 September 2020.

Reviewed by:

Copyright © 2020 Braun, Shavelson, Zlatkin-Troitschanskaia and Borowiec. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY) . The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Henry I. Braun, [email protected]

This article is part of the Research Topic

Assessing Information Processing and Online Reasoning as a Prerequisite for Learning in Higher Education

The Salesforce Consultant’s Guide pp 151–160 Cite as

Critical Thinking and Problem-Solving Skills

• Heather Negley 2  
• First Online: 28 April 2022

496 Accesses

Critical thinking is a type of systematic thinking that is used to solve problems using logic. The first step is to gather the information needed to help you solve your problem. You start by analyzing and evaluating sources for authority to give you the best shot at finding something truthful and unbiased. Watch Out For information overload. Access to information is easier than ever these days, and it is easy to get overwhelmed by it all. As you conduct your research, keep your information organized by filtering, synthesizing, and distilling it. And keep your effort timeboxed. Start broad enough to obtain a wide berth, like a fisherman casting a large net into an ocean. This helps find multiple points of view. But don’t spend more time than necessary. Practicing collecting what is sufficient to answer your questions.

This is a preview of subscription content, log in via an institution .

Buying options

• Available as PDF
• Read on any device
• Instant download
• Own it forever
• Available as EPUB and PDF
• Compact, lightweight edition
• Dispatched in 3 to 5 business days
• Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Reitz, Joan. Online Dictionary for Library and Information Science: Accessed 11/07/2021

Author information

Authors and affiliations.

Fairfax, VA, USA

Heather Negley

You can also search for this author in PubMed   Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature

About this chapter

Cite this chapter.

Negley, H. (2022). Critical Thinking and Problem-Solving Skills. In: The Salesforce Consultant’s Guide. Apress, Berkeley, CA. https://doi.org/10.1007/978-1-4842-7960-1_13

Download citation

DOI : https://doi.org/10.1007/978-1-4842-7960-1_13

Published : 28 April 2022

Publisher Name : Apress, Berkeley, CA

Print ISBN : 978-1-4842-7959-5

Online ISBN : 978-1-4842-7960-1

eBook Packages : Professional and Applied Computing Professional and Applied Computing (R0) Apress Access Books

Share this chapter

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Publish with us

Policies and ethics

• Find a journal
• Track your research

Critical Thinking

Introduction, learning objectives.

• define critical thinking
• identify the role that logic plays in critical thinking
• apply critical thinking skills to problem-solving scenarios
• apply critical thinking skills to evaluation of information

Consider these thoughts about the critical thinking process, and how it applies not just to our school lives but also our personal and professional lives.

“Thinking Critically and Creatively”

Critical thinking skills are perhaps the most fundamental skills involved in making judgments and solving problems. You use them every day, and you can continue improving them.

The ability to think critically about a matter—to analyze a question, situation, or problem down to its most basic parts—is what helps us evaluate the accuracy and truthfulness of statements, claims, and information we read and hear. It is the sharp knife that, when honed, separates fact from fiction, honesty from lies, and the accurate from the misleading. We all use this skill to one degree or another almost every day. For example, we use critical thinking every day as we consider the latest consumer products and why one particular product is the best among its peers. Is it a quality product because a celebrity endorses it? Because a lot of other people may have used it? Because it is made by one company versus another? Or perhaps because it is made in one country or another? These are questions representative of critical thinking.

The academic setting demands more of us in terms of critical thinking than everyday life. It demands that we evaluate information and analyze myriad issues. It is the environment where our critical thinking skills can be the difference between success and failure. In this environment we must consider information in an analytical, critical manner. We must ask questions—What is the source of this information? Is this source an expert one and what makes it so? Are there multiple perspectives to consider on an issue? Do multiple sources agree or disagree on an issue? Does quality research substantiate information or opinion? Do I have any personal biases that may affect my consideration of this information?

It is only through purposeful, frequent, intentional questioning such as this that we can sharpen our critical thinking skills and improve as students, learners and researchers.

—Dr. Andrew Robert Baker,  Foundations of Academic Success: Words of Wisdom

Defining Critical Thinking

Thinking comes naturally. You don’t have to make it happen—it just does. But you can make it happen in different ways. For example, you can think positively or negatively. You can think with “heart” and you can think with rational judgment. You can also think strategically and analytically, and mathematically and scientifically. These are a few of multiple ways in which the mind can process thought.

What are some forms of thinking you use? When do you use them, and why?

As a college student, you are tasked with engaging and expanding your thinking skills. One of the most important of these skills is critical thinking. Critical thinking is important because it relates to nearly all tasks, situations, topics, careers, environments, challenges, and opportunities. It’s not restricted to a particular subject area.

Imagine, for example, that you’re reading a history textbook. You wonder who wrote it and why, because you detect certain assumptions in the writing. You find that the author has a limited scope of research focused only on a particular group within a population. In this case, your critical thinking reveals that there are “other sides to the story.”

Who are critical thinkers, and what characteristics do they have in common? Critical thinkers are usually curious and reflective people. They like to explore and probe new areas and seek knowledge, clarification, and new solutions. They ask pertinent questions, evaluate statements and arguments, and they distinguish between facts and opinion. They are also willing to examine their own beliefs, possessing a manner of humility that allows them to admit lack of knowledge or understanding when needed. They are open to changing their mind. Perhaps most of all, they actively enjoy learning, and seeking new knowledge is a lifelong pursuit.

This may well be you!

No matter where you are on the road to being a critical thinker, you can always more fully develop your skills. Doing so will help you develop more balanced arguments, express yourself clearly, read critically, and absorb important information efficiently. Critical thinking skills will help you in any profession or any circumstance of life, from science to art to business to teaching.

Critical Thinking in Action

The following video, from Lawrence Bland, presents the major concepts and benefits of critical thinking.

Critical Thinking and Logic

Critical thinking is fundamentally a process of questioning information and data. You may question the information you read in a textbook, or you may question what a politician or a professor or a classmate says. You can also question a commonly-held belief or a new idea. With critical thinking, anything and everything is subject to question and examination.

Logic’s Relationship to Critical Thinking

The word logic comes from the Ancient Greek logike , referring to the science or art of reasoning. Using logic, a person evaluates arguments and strives to distinguish between good and bad reasoning, or between truth and falsehood. Using logic, you can evaluate ideas or claims people make, make good decisions, and form sound beliefs about the world. [1]

Questions of Logic in Critical Thinking

Let’s use a simple example of applying logic to a critical-thinking situation. In this hypothetical scenario, a man has a PhD in political science, and he works as a professor at a local college. His wife works at the college, too. They have three young children in the local school system, and their family is well known in the community.

The man is now running for political office. Are his credentials and experience sufficient for entering public office? Will he be effective in the political office? Some voters might believe that his personal life and current job, on the surface, suggest he will do well in the position, and they will vote for him.

In truth, the characteristics described don’t guarantee that the man will do a good job. The information is somewhat irrelevant. What else might you want to know? How about whether the man had already held a political office and done a good job? In this case, we want to ask, How much information is adequate in order to make a decision based on logic instead of assumptions?

The following questions, presented in Figure 1, below, are ones you may apply to formulating a logical, reasoned perspective in the above scenario or any other situation:

• What’s happening? Gather the basic information and begin to think of questions.
• Why is it important? Ask yourself why it’s significant and whether or not you agree.
• What don’t I see? Is there anything important missing?
• How do I know? Ask yourself where the information came from and how it was constructed.
• Who is saying it? What’s the position of the speaker and what is influencing them?
• What else? What if? What other ideas exist and are there other possibilities?

Problem-Solving With Critical Thinking

For most people, a typical day is filled with critical thinking and problem-solving challenges. In fact, critical thinking and problem-solving go hand-in-hand. They both refer to using knowledge, facts, and data to solve problems effectively. But with problem-solving, you are specifically identifying, selecting, and defending your solution. Below are some examples of using critical thinking to problem-solve:

• Your roommate was upset and said some unkind words to you, which put a crimp in your relationship. You try to see through the angry behaviors to determine how you might best support your roommate and help bring your relationship back to a comfortable spot.
• Your campus club has been languishing on account of lack of participation and funds. The new club president, though, is a marketing major and has identified some strategies to interest students in joining and supporting the club. Implementation is forthcoming.
• Your final art class project challenges you to conceptualize form in new ways. On the last day of class when students present their projects, you describe the techniques you used to fulfill the assignment. You explain why and how you selected that approach.
• Your math teacher sees that the class is not quite grasping a concept. She uses clever questioning to dispel anxiety and guide you to new understanding of the concept.
• You have a job interview for a position that you feel you are only partially qualified for, although you really want the job and you are excited about the prospects. You analyze how you will explain your skills and experiences in a way to show that you are a good match for the prospective employer.
• You are doing well in college, and most of your college and living expenses are covered. But there are some gaps between what you want and what you feel you can afford. You analyze your income, savings, and budget to better calculate what you will need to stay in college and maintain your desired level of spending.

Problem-Solving Action Checklist

Problem-solving can be an efficient and rewarding process, especially if you are organized and mindful of critical steps and strategies. Remember, too, to assume the attributes of a good critical thinker. If you are curious, reflective, knowledge-seeking, open to change, probing, organized, and ethical, your challenge or problem will be less of a hurdle, and you’ll be in a good position to find intelligent solutions.

Evaluating Information With Critical Thinking

Evaluating information can be one of the most complex tasks you will be faced with in college. But if you utilize the following four strategies, you will be well on your way to success:

• Read for understanding by using text coding
• Examine arguments
• Clarify thinking
• Cultivate “habits of mind”

1. Read for Understanding Using Text Coding

When you read and take notes, use the text coding strategy . Text coding is a way of tracking your thinking while reading. It entails marking the text and recording what you are thinking either in the margins or perhaps on Post-it notes. As you make connections and ask questions in response to what you read,  you monitor your comprehension and enhance your long-term understanding of the material.

With text coding, mark important arguments and key facts. Indicate where you agree and disagree or have further questions. You don’t necessarily need to read every word, but make sure you understand the concepts or the intentions behind what is written. Feel free to develop your own shorthand style when reading or taking notes. The following are a few options to consider using while coding text.

See more text coding from PBWorks and Collaborative for Teaching and Learning .

2. Examine Arguments

When you examine arguments or claims that an author, speaker, or other source is making, your goal is to identify and examine the hard facts. You can use the spectrum of authority strategy for this purpose. The spectrum of authority strategy assists you in identifying the “hot” end of an argument—feelings, beliefs, cultural influences, and societal influences—and the “cold” end of an argument—scientific influences. The following video explains this strategy.

3. Clarify Thinking

When you use critical thinking to evaluate information, you need to clarify your thinking to yourself and likely to others. Doing this well is mainly a process of asking and answering probing questions, such as the logic questions discussed earlier. Design your questions to fit your needs, but be sure to cover adequate ground. What is the purpose? What question are we trying to answer? What point of view is being expressed? What assumptions are we or others making? What are the facts and data we know, and how do we know them? What are the concepts we’re working with? What are the conclusions, and do they make sense? What are the implications?

4. Cultivate “Habits of Mind”

“Habits of mind” are the personal commitments, values, and standards you have about the principle of good thinking. Consider your intellectual commitments, values, and standards. Do you approach problems with an open mind, a respect for truth, and an inquiring attitude? Some good habits to have when thinking critically are being receptive to having your opinions changed, having respect for others, being independent and not accepting something is true until you’ve had the time to examine the available evidence, being fair-minded, having respect for a reason, having an inquiring mind, not making assumptions, and always, especially, questioning your own conclusions—in other words, developing an intellectual work ethic. Try to work these qualities into your daily life.

• "logic." Wordnik . n.d. Web. 16 Feb 2016 . ↵
• "Student Success-Thinking Critically In Class and Online."  Critical Thinking Gateway . St Petersburg College, n.d. Web. 16 Feb 2016. ↵
• Outcome: Critical Thinking. Provided by : Lumen Learning. License : CC BY: Attribution
• Self Check: Critical Thinking. Provided by : Lumen Learning. License : CC BY: Attribution
• Foundations of Academic Success. Authored by : Thomas C. Priester, editor. Provided by : Open SUNY Textbooks. Located at : http://textbooks.opensuny.org/foundations-of-academic-success/ . License : CC BY-NC-SA: Attribution-NonCommercial-ShareAlike
• Image of woman thinking. Authored by : Moyan Brenn. Located at : https://flic.kr/p/8YV4K5 . License : CC BY: Attribution
• Critical Thinking. Provided by : Critical and Creative Thinking Program. Located at : http://cct.wikispaces.umb.edu/Critical+Thinking . License : CC BY: Attribution
• Critical Thinking Skills. Authored by : Linda Bruce. Provided by : Lumen Learning. Project : https://courses.lumenlearning.com/lumencollegesuccess/chapter/critical-thinking-skills/. License : CC BY: Attribution
• Image of critical thinking poster. Authored by : Melissa Robison. Located at : https://flic.kr/p/bwAzyD . License : CC BY: Attribution
• Thinking Critically. Authored by : UBC Learning Commons. Provided by : The University of British Columbia, Vancouver Campus. Located at : http://www.oercommons.org/courses/learning-toolkit-critical-thinking/view . License : CC BY: Attribution
• Critical Thinking 101: Spectrum of Authority. Authored by : UBC Leap. Located at : https://youtu.be/9G5xooMN2_c . License : CC BY: Attribution
• Image of students putting post-its on wall. Authored by : Hector Alejandro. Located at : https://flic.kr/p/7b2Ax2 . License : CC BY: Attribution
• Image of man thinking. Authored by : Chad Santos. Located at : https://flic.kr/p/phLKY . License : CC BY: Attribution
• Critical Thinking.wmv. Authored by : Lawrence Bland. Located at : https://youtu.be/WiSklIGUblo . License : All Rights Reserved . License Terms : Standard YouTube License

Privacy Policy

• Departments, units, and programs
• College leadership
• Diversity, equity, and inclusion
• Faculty and staff resources
• LAS Strategic Plan

• Apply to LAS
• Liberal arts & sciences majors
• LAS Insider blog
• Admissions FAQs
• Parent resources
• Pre-college summer programs

Quick Links

Request info

• Academic policies and standing
• Advising and support
• College distinctions
• Dates and deadlines
• Intercollegiate transfers
• LAS Lineup student newsletter
• Programs of study
• Scholarships
• Certificates
• Student emergencies

Student resources

• Access and Achievement Program
• Career services
• First-Year Experience
• Honors program
• International programs
• Internship opportunities
• Paul M. Lisnek LAS Hub
• Student research opportunities
• Expertise in LAS
• Research facilities and centers
• Dean's Distinguished Lecture series
• Alumni advice
• Alumni award programs
• Get involved
• LAS Alumni Council
• LAS@Work: Alumni careers
• Study Abroad Alumni Networks
• Update your information
• Nominate an alumnus for an LAS award
• Faculty honors
• The Quadrangle Online
• LAS News email newsletter archive
• LAS social media
• Media contact in the College of LAS
• LAS Landmark Day of Giving
• About giving to LAS
• Building projects
• Corporate engagement
• Faculty support
• Lincoln Scholars Initiative
• Impact of giving

Why is critical thinking important?

What do lawyers, accountants, teachers, and doctors all have in common?

What is critical thinking?

The Oxford English Dictionary defines critical thinking as “The objective, systematic, and rational analysis and evaluation of factual evidence in order to form a judgment on a subject, issue, etc.” Critical thinking involves the use of logic and reasoning to evaluate available facts and/or evidence to come to a conclusion about a certain subject or topic. We use critical thinking every day, from decision-making to problem-solving, in addition to thinking critically in an academic context!

Why is critical thinking important for academic success?

You may be asking “why is critical thinking important for students?” Critical thinking appears in a diverse set of disciplines and impacts students’ learning every day, regardless of major.

Critical thinking skills are often associated with the value of studying the humanities. In majors such as English, students will be presented with a certain text—whether it’s a novel, short story, essay, or even film—and will have to use textual evidence to make an argument and then defend their argument about what they’ve read. However, the importance of critical thinking does not only apply to the humanities. In the social sciences, an economics major , for example, will use what they’ve learned to figure out solutions to issues as varied as land and other natural resource use, to how much people should work, to how to develop human capital through education. Problem-solving and critical thinking go hand in hand. Biology is a popular major within LAS, and graduates of the biology program often pursue careers in the medical sciences. Doctors use critical thinking every day, tapping into the knowledge they acquired from studying the biological sciences to diagnose and treat different diseases and ailments.

Students in the College of LAS take many courses that require critical thinking before they graduate. You may be asked in an Economics class to use statistical data analysis to evaluate the impact on home improvement spending when the Fed increases interest rates (read more about real-world experience with Datathon ). If you’ve ever been asked “How often do you think about the Roman Empire?”, you may find yourself thinking about the Roman Empire more than you thought—maybe in an English course, where you’ll use text from Shakespeare’s Antony and Cleopatra to make an argument about Roman imperial desire.  No matter what the context is, critical thinking will be involved in your academic life and can take form in many different ways.

The benefits of critical thinking in everyday life

Building better communication.

One of the most important life skills that students learn as early as elementary school is how to give a presentation. Many classes require students to give presentations, because being well-spoken is a key skill in effective communication. This is where critical thinking benefits come into play: using the skills you’ve learned, you’ll be able to gather the information needed for your presentation, narrow down what information is most relevant, and communicate it in an engaging way. 

Typically, the first step in creating a presentation is choosing a topic. For example, your professor might assign a presentation on the Gilded Age and provide a list of figures from the 1870s—1890s to choose from. You’ll use your critical thinking skills to narrow down your choices. You may ask yourself:

• What figure am I most familiar with?
• Who am I most interested in? 
• Will I have to do additional research? 

After choosing your topic, your professor will usually ask a guiding question to help you form a thesis: an argument that is backed up with evidence. Critical thinking benefits this process by allowing you to focus on the information that is most relevant in support of your argument. By focusing on the strongest evidence, you will communicate your thesis clearly.

Finally, once you’ve finished gathering information, you will begin putting your presentation together. Creating a presentation requires a balance of text and visuals. Graphs and tables are popular visuals in STEM-based projects, but digital images and graphics are effective as well. Critical thinking benefits this process because the right images and visuals create a more dynamic experience for the audience, giving them the opportunity to engage with the material.

Presentation skills go beyond the classroom. Students at the University of Illinois will often participate in summer internships to get professional experience before graduation. Many summer interns are required to present about their experience and what they learned at the end of the internship. Jobs frequently also require employees to create presentations of some kind—whether it’s an advertising pitch to win an account from a potential client, or quarterly reporting, giving a presentation is a life skill that directly relates to critical thinking. 

Fostering independence and confidence

An important life skill many people start learning as college students and then finessing once they enter the “adult world” is how to budget. There will be many different expenses to keep track of, including rent, bills, car payments, and groceries, just to name a few! After developing your critical thinking skills, you’ll put them to use to consider your salary and budget your expenses accordingly. Here’s an example:

• You earn a salary of $75,000 a year. Assume all amounts are before taxes.
• 1,800 x 12 = 21,600
• 75,000 – 21,600 = 53,400
• This leaves you with $53,400
• 320 x 12 = 3,840 a year
• 53,400-3,840= 49,560
• 726 x 12 = 8,712
• 49,560 – 8,712= 40,848
• You’re left with $40,848 for miscellaneous expenses. You use your critical thinking skills to decide what to do with your $40,848. You think ahead towards your retirement and decide to put $500 a month into a Roth IRA, leaving $34,848. Since you love coffee, you try to figure out if you can afford a daily coffee run. On average, a cup of coffee will cost you $7. 7 x 365 = $2,555 a year for coffee. 34,848 – 2,555 = 32,293
• You have $32,293 left. You will use your critical thinking skills to figure out how much you would want to put into savings, how much you want to save to treat yourself from time to time, and how much you want to put aside for emergency funds. With the benefits of critical thinking, you will be well-equipped to budget your lifestyle once you enter the working world.

Enhancing decision-making skills

Choosing the right university for you.

One of the biggest decisions you’ll make in your life is what college or university to go to. There are many factors to consider when making this decision, and critical thinking importance will come into play when determining these factors.

Many high school seniors apply to colleges with the hope of being accepted into a certain program, whether it’s biology, psychology, political science, English, or something else entirely. Some students apply with certain schools in mind due to overall rankings. Students also consider the campus a school is set in. While some universities such as the University of Illinois are nestled within college towns, New York University is right in Manhattan, in a big city setting. Some students dream of going to large universities, and other students prefer smaller schools. The diversity of a university’s student body is also a key consideration. For many 17- and 18-year-olds, college is a time to meet peers from diverse racial and socio-economic backgrounds and learn about life experiences different than one’s own.

With all these factors in mind, you’ll use critical thinking to decide which are most important to you—and which school is the right fit for you.

Develop your critical thinking skills at the University of Illinois

At the University of Illinois, not only will you learn how to think critically, but you will put critical thinking into practice. In the College of LAS, you can choose from 70+ majors where you will learn the importance and benefits of critical thinking skills. The College of Liberal Arts & Sciences at U of I offers a wide range of undergraduate and graduate programs in life, physical, and mathematical sciences; humanities; and social and behavioral sciences. No matter which program you choose, you will develop critical thinking skills as you go through your courses in the major of your choice. And in those courses, the first question your professors may ask you is, “What is the goal of critical thinking?” You will be able to respond with confidence that the goal of critical thinking is to help shape people into more informed, more thoughtful members of society.

With such a vast representation of disciplines, an education in the College of LAS will prepare you for a career where you will apply critical thinking skills to real life, both in and outside of the classroom, from your undergraduate experience to your professional career. If you’re interested in becoming a part of a diverse set of students and developing skills for lifelong success, apply to LAS today!

Read more first-hand stories from our amazing students at the LAS Insider blog .

• Privacy Notice
• Accessibility

Critical thinking definition

Critical thinking, as described by Oxford Languages, is the objective analysis and evaluation of an issue in order to form a judgement.

Active and skillful approach, evaluation, assessment, synthesis, and/or evaluation of information obtained from, or made by, observation, knowledge, reflection, acumen or conversation, as a guide to belief and action, requires the critical thinking process, which is why it's often used in education and academics.

Some even may view it as a backbone of modern thought.

However, it's a skill, and skills must be trained and encouraged to be used at its full potential.

People turn up to various approaches in improving their critical thinking, like:

• Developing technical and problem-solving skills
• Engaging in more active listening
• Actively questioning their assumptions and beliefs
• Seeking out more diversity of thought
• Opening up their curiosity in an intellectual way etc.

Is critical thinking useful in writing?

Critical thinking can help in planning your paper and making it more concise, but it's not obvious at first. We carefully pinpointed some the questions you should ask yourself when boosting critical thinking in writing:

• What information should be included?
• Which information resources should the author look to?
• What degree of technical knowledge should the report assume its audience has?
• What is the most effective way to show information?
• How should the report be organized?
• How should it be designed?
• What tone and level of language difficulty should the document have?

Usage of critical thinking comes down not only to the outline of your paper, it also begs the question: How can we use critical thinking solving problems in our writing's topic?

Let's say, you have a Powerpoint on how critical thinking can reduce poverty in the United States. You'll primarily have to define critical thinking for the viewers, as well as use a lot of critical thinking questions and synonyms to get them to be familiar with your methods and start the thinking process behind it.

Are there any services that can help me use more critical thinking?

We understand that it's difficult to learn how to use critical thinking more effectively in just one article, but our service is here to help.

We are a team specializing in writing essays and other assignments for college students and all other types of customers who need a helping hand in its making. We cover a great range of topics, offer perfect quality work, always deliver on time and aim to leave our customers completely satisfied with what they ordered.

The ordering process is fully online, and it goes as follows:

• Select the topic and the deadline of your essay.
• Provide us with any details, requirements, statements that should be emphasized or particular parts of the essay writing process you struggle with.
• Leave the email address, where your completed order will be sent to.
• Select your prefered payment type, sit back and relax!

With lots of experience on the market, professionally degreed essay writers , online 24/7 customer support and incredibly low prices, you won't find a service offering a better deal than ours.

• Table of Contents
• New in this Archive
• Chronological
• Editorial Information
• About the SEP
• Editorial Board
• How to Cite the SEP
• Special Characters
• Support the SEP
• PDFs for SEP Friends
• Make a Donation
• SEPIA for Libraries
• Entry Contents

Bibliography

Academic tools.

• Friends PDF Preview
• Author and Citation Info
• Back to Top

Critical Thinking

Critical thinking is a widely accepted educational goal. Its definition is contested, but the competing definitions can be understood as differing conceptions of the same basic concept: careful thinking directed to a goal. Conceptions differ with respect to the scope of such thinking, the type of goal, the criteria and norms for thinking carefully, and the thinking components on which they focus. Its adoption as an educational goal has been recommended on the basis of respect for students’ autonomy and preparing students for success in life and for democratic citizenship. “Critical thinkers” have the dispositions and abilities that lead them to think critically when appropriate. The abilities can be identified directly; the dispositions indirectly, by considering what factors contribute to or impede exercise of the abilities. Standardized tests have been developed to assess the degree to which a person possesses such dispositions and abilities. Educational intervention has been shown experimentally to improve them, particularly when it includes dialogue, anchored instruction, and mentoring. Controversies have arisen over the generalizability of critical thinking across domains, over alleged bias in critical thinking theories and instruction, and over the relationship of critical thinking to other types of thinking.

2.1 Dewey’s Three Main Examples

2.2 dewey’s other examples, 2.3 further examples, 2.4 non-examples, 3. the definition of critical thinking, 4. its value, 5. the process of thinking critically, 6. components of the process, 7. contributory dispositions and abilities, 8.1 initiating dispositions, 8.2 internal dispositions, 9. critical thinking abilities, 10. required knowledge, 11. educational methods, 12.1 the generalizability of critical thinking, 12.2 bias in critical thinking theory and pedagogy, 12.3 relationship of critical thinking to other types of thinking, other internet resources, related entries.

Use of the term ‘critical thinking’ to describe an educational goal goes back to the American philosopher John Dewey (1910), who more commonly called it ‘reflective thinking’. He defined it as

active, persistent and careful consideration of any belief or supposed form of knowledge in the light of the grounds that support it, and the further conclusions to which it tends. (Dewey 1910: 6; 1933: 9)

and identified a habit of such consideration with a scientific attitude of mind. His lengthy quotations of Francis Bacon, John Locke, and John Stuart Mill indicate that he was not the first person to propose development of a scientific attitude of mind as an educational goal.

In the 1930s, many of the schools that participated in the Eight-Year Study of the Progressive Education Association (Aikin 1942) adopted critical thinking as an educational goal, for whose achievement the study’s Evaluation Staff developed tests (Smith, Tyler, & Evaluation Staff 1942). Glaser (1941) showed experimentally that it was possible to improve the critical thinking of high school students. Bloom’s influential taxonomy of cognitive educational objectives (Bloom et al. 1956) incorporated critical thinking abilities. Ennis (1962) proposed 12 aspects of critical thinking as a basis for research on the teaching and evaluation of critical thinking ability.

Since 1980, an annual international conference in California on critical thinking and educational reform has attracted tens of thousands of educators from all levels of education and from many parts of the world. Also since 1980, the state university system in California has required all undergraduate students to take a critical thinking course. Since 1983, the Association for Informal Logic and Critical Thinking has sponsored sessions in conjunction with the divisional meetings of the American Philosophical Association (APA). In 1987, the APA’s Committee on Pre-College Philosophy commissioned a consensus statement on critical thinking for purposes of educational assessment and instruction (Facione 1990a). Researchers have developed standardized tests of critical thinking abilities and dispositions; for details, see the Supplement on Assessment . Educational jurisdictions around the world now include critical thinking in guidelines for curriculum and assessment. Political and business leaders endorse its importance.

For details on this history, see the Supplement on History .

2. Examples and Non-Examples

Before considering the definition of critical thinking, it will be helpful to have in mind some examples of critical thinking, as well as some examples of kinds of thinking that would apparently not count as critical thinking.

Dewey (1910: 68–71; 1933: 91–94) takes as paradigms of reflective thinking three class papers of students in which they describe their thinking. The examples range from the everyday to the scientific.

Transit : “The other day, when I was down town on 16th Street, a clock caught my eye. I saw that the hands pointed to 12:20. This suggested that I had an engagement at 124th Street, at one o'clock. I reasoned that as it had taken me an hour to come down on a surface car, I should probably be twenty minutes late if I returned the same way. I might save twenty minutes by a subway express. But was there a station near? If not, I might lose more than twenty minutes in looking for one. Then I thought of the elevated, and I saw there was such a line within two blocks. But where was the station? If it were several blocks above or below the street I was on, I should lose time instead of gaining it. My mind went back to the subway express as quicker than the elevated; furthermore, I remembered that it went nearer than the elevated to the part of 124th Street I wished to reach, so that time would be saved at the end of the journey. I concluded in favor of the subway, and reached my destination by one o’clock.” (Dewey 1910: 68-69; 1933: 91-92)

Ferryboat : “Projecting nearly horizontally from the upper deck of the ferryboat on which I daily cross the river is a long white pole, having a gilded ball at its tip. It suggested a flagpole when I first saw it; its color, shape, and gilded ball agreed with this idea, and these reasons seemed to justify me in this belief. But soon difficulties presented themselves. The pole was nearly horizontal, an unusual position for a flagpole; in the next place, there was no pulley, ring, or cord by which to attach a flag; finally, there were elsewhere on the boat two vertical staffs from which flags were occasionally flown. It seemed probable that the pole was not there for flag-flying.

“I then tried to imagine all possible purposes of the pole, and to consider for which of these it was best suited: (a) Possibly it was an ornament. But as all the ferryboats and even the tugboats carried poles, this hypothesis was rejected. (b) Possibly it was the terminal of a wireless telegraph. But the same considerations made this improbable. Besides, the more natural place for such a terminal would be the highest part of the boat, on top of the pilot house. (c) Its purpose might be to point out the direction in which the boat is moving.

“In support of this conclusion, I discovered that the pole was lower than the pilot house, so that the steersman could easily see it. Moreover, the tip was enough higher than the base, so that, from the pilot's position, it must appear to project far out in front of the boat. Morevoer, the pilot being near the front of the boat, he would need some such guide as to its direction. Tugboats would also need poles for such a purpose. This hypothesis was so much more probable than the others that I accepted it. I formed the conclusion that the pole was set up for the purpose of showing the pilot the direction in which the boat pointed, to enable him to steer correctly.” (Dewey 1910: 69-70; 1933: 92-93)

Bubbles : “In washing tumblers in hot soapsuds and placing them mouth downward on a plate, bubbles appeared on the outside of the mouth of the tumblers and then went inside. Why? The presence of bubbles suggests air, which I note must come from inside the tumbler. I see that the soapy water on the plate prevents escape of the air save as it may be caught in bubbles. But why should air leave the tumbler? There was no substance entering to force it out. It must have expanded. It expands by increase of heat, or by decrease of pressure, or both. Could the air have become heated after the tumbler was taken from the hot suds? Clearly not the air that was already entangled in the water. If heated air was the cause, cold air must have entered in transferring the tumblers from the suds to the plate. I test to see if this supposition is true by taking several more tumblers out. Some I shake so as to make sure of entrapping cold air in them. Some I take out holding mouth downward in order to prevent cold air from entering. Bubbles appear on the outside of every one of the former and on none of the latter. I must be right in my inference. Air from the outside must have been expanded by the heat of the tumbler, which explains the appearance of the bubbles on the outside. But why do they then go inside? Cold contracts. The tumbler cooled and also the air inside it. Tension was removed, and hence bubbles appeared inside. To be sure of this, I test by placing a cup of ice on the tumbler while the bubbles are still forming outside. They soon reverse” (Dewey 1910: 70–71; 1933: 93–94).

Dewey (1910, 1933) sprinkles his book with other examples of critical thinking. We will refer to the following.

Weather : A man on a walk notices that it has suddenly become cool, thinks that it is probably going to rain, looks up and sees a dark cloud obscuring the sun, and quickens his steps (1910: 6–10; 1933: 9–13).

Disorder : A man finds his rooms on his return to them in disorder with his belongings thrown about, thinks at first of burglary as an explanation, then thinks of mischievous children as being an alternative explanation, then looks to see whether valuables are missing, and discovers that they are (1910: 82–83; 1933: 166–168).

Typhoid : A physician diagnosing a patient whose conspicuous symptoms suggest typhoid avoids drawing a conclusion until more data are gathered by questioning the patient and by making tests (1910: 85–86; 1933: 170).

Blur : A moving blur catches our eye in the distance, we ask ourselves whether it is a cloud of whirling dust or a tree moving its branches or a man signaling to us, we think of other traits that should be found on each of those possibilities, and we look and see if those traits are found (1910: 102, 108; 1933: 121, 133).

Suction pump : In thinking about the suction pump, the scientist first notes that it will draw water only to a maximum height of 33 feet at sea level and to a lesser maximum height at higher elevations, selects for attention the differing atmospheric pressure at these elevations, sets up experiments in which the air is removed from a vessel containing water (when suction no longer works) and in which the weight of air at various levels is calculated, compares the results of reasoning about the height to which a given weight of air will allow a suction pump to raise water with the observed maximum height at different elevations, and finally assimilates the suction pump to such apparently different phenomena as the siphon and the rising of a balloon (1910: 150–153; 1933: 195–198).

Diamond : A passenger in a car driving in a diamond lane reserved for vehicles with at least one passenger notices that the diamond marks on the pavement are far apart in some places and close together in others. Why? The driver suggests that the reason may be that the diamond marks are not needed where there is a solid double line separating the diamond line from the adjoining lane, but are needed when there is a dotted single line permitting crossing into the diamond lane. Further observation confirms that the diamonds are close together when a dotted line separates the diamond lane from its neighbour, but otherwise far apart.

Rash : A woman suddenly develops a very itchy red rash on her throat and upper chest. She recently noticed a mark on the back of her right hand, but was not sure whether the mark was a rash or a scrape. She lies down in bed and thinks about what might be causing the rash and what to do about it. About two weeks before, she began taking blood pressure medication that contained a sulfa drug, and the pharmacist had warned her, in view of a previous allergic reaction to a medication containing a sulfa drug, to be on the alert for an allergic reaction; however, she had been taking the medication for two weeks with no such effect. The day before, she began using a new cream on her neck and upper chest; against the new cream as the cause was mark on the back of her hand, which had not been exposed to the cream. She began taking probiotics about a month before. She also recently started new eye drops, but she supposed that manufacturers of eye drops would be careful not to include allergy-causing components in the medication. The rash might be a heat rash, since she recently was sweating profusely from her upper body. Since she is about to go away on a short vacation, where she would not have access to her usual physician, she decides to keep taking the probiotics and using the new eye drops but to discontinue the blood pressure medication and to switch back to the old cream for her neck and upper chest. She forms a plan to consult her regular physician on her return about the blood pressure medication.

Candidate : Although Dewey included no examples of thinking directed at appraising the arguments of others, such thinking has come to be considered a kind of critical thinking. We find an example of such thinking in the performance task on the Collegiate Learning Assessment (CLA+), which its sponsoring organization describes as

a performance-based assessment that provides a measure of an institution’s contribution to the development of critical-thinking and written communication skills of its students. (Council for Aid to Education 2017)

A sample task posted on its website requires the test-taker to write a report for public distribution evaluating a fictional candidate’s policy proposals and their supporting arguments, using supplied background documents, with a recommendation on whether to endorse the candidate.

Immediate acceptance of an idea that suggests itself as a solution to a problem (e.g., a possible explanation of an event or phenomenon, an action that seems likely to produce a desired result) is “uncritical thinking, the minimum of reflection” (Dewey 1910: 13). On-going suspension of judgment in the light of doubt about a possible solution is not critical thinking (Dewey 1910: 108). Critique driven by a dogmatically held political or religious ideology is not critical thinking; thus Paulo Freire (1968 [1970]) is using the term (e.g., at 1970: 71, 81, 100, 146) in a more politically freighted sense that includes not only reflection but also revolutionary action against oppression. Derivation of a conclusion from given data using an algorithm is not critical thinking.

What is critical thinking? There are many definitions. Ennis (2016) lists 14 philosophically oriented scholarly definitions and three dictionary definitions. Following Rawls (1971), who distinguished his conception of justice from a utilitarian conception but regarded them as rival conceptions of the same concept, Ennis maintains that the 17 definitions are different conceptions of the same concept. Rawls articulated the shared concept of justice as

a characteristic set of principles for assigning basic rights and duties and for determining… the proper distribution of the benefits and burdens of social cooperation. (Rawls 1971: 5)

Bailin et al. (1999b) claim that, if one considers what sorts of thinking an educator would take not to be critical thinking and what sorts to be critical thinking, one can conclude that educators typically understand critical thinking to have at least three features.

• It is done for the purpose of making up one’s mind about what to believe or do.
• The person engaging in the thinking is trying to fulfill standards of adequacy and accuracy appropriate to the thinking.
• The thinking fulfills the relevant standards to some threshold level.

One could sum up the core concept that involves these three features by saying that critical thinking is careful goal-directed thinking. This core concept seems to apply to all the examples of critical thinking described in the previous section. As for the non-examples, their exclusion depends on construing careful thinking as excluding jumping immediately to conclusions, suspending judgment no matter how strong the evidence, reasoning from an unquestioned ideological or religious perspective, and routinely using an algorithm to answer a question.

If the core of critical thinking is careful goal-directed thinking, conceptions of it can vary according to its presumed scope, its presumed goal, one’s criteria and threshold for being careful, and the thinking component on which one focuses As to its scope, some conceptions (e.g., Dewey 1910, 1933) restrict it to constructive thinking on the basis of one’s own observations and experiments, others (e.g., Ennis 1962; Fisher & Scriven 1997; Johnson 1992) to appraisal of the products of such thinking. Ennis (1991) and Bailin et al. (1999b) take it to cover both construction and appraisal. As to its goal, some conceptions restrict it to forming a judgment (Dewey 1910, 1933; Lipman 1987; Facione 1990a). Others allow for actions as well as beliefs as the end point of a process of critical thinking (Ennis 1991; Bailin et al. 1999b). As to the criteria and threshold for being careful, definitions vary in the term used to indicate that critical thinking satisfies certain norms: “intellectually disciplined” (Scriven & Paul 1987), “reasonable” (Ennis 1991), “skillful” (Lipman 1987), “skilled” (Fisher & Scriven 1997), “careful” (Bailin & Battersby 2009). Some definitions specify these norms, referring variously to “consideration of any belief or supposed form of knowledge in the light of the grounds that support it and the further conclusions to which it tends” (Dewey 1910, 1933); “the methods of logical inquiry and reasoning” (Glaser 1941); “conceptualizing, applying, analyzing, synthesizing, and/or evaluating information gathered from, or generated by, observation, experience, reflection, reasoning, or communication” (Scriven & Paul 1987); the requirement that “it is sensitive to context, relies on criteria, and is self-correcting” (Lipman 1987); “evidential, conceptual, methodological, criteriological, or contextual considerations” (Facione 1990a); and “plus-minus considerations of the product in terms of appropriate standards (or criteria)” (Johnson 1992). Stanovich and Stanovich (2010) propose to ground the concept of critical thinking in the concept of rationality, which they understand as combining epistemic rationality (fitting one’s beliefs to the world) and instrumental rationality (optimizing goal fulfillment); a critical thinker, in their view, is someone with “a propensity to override suboptimal responses from the autonomous mind” (2010: 227). These variant specifications of norms for critical thinking are not necessarily incompatible with one another, and in any case presuppose the core notion of thinking carefully. As to the thinking component singled out, some definitions focus on suspension of judgment during the thinking (Dewey 1910; McPeck 1981), others on inquiry while judgment is suspended (Bailin & Battersby 2009), others on the resulting judgment (Facione 1990a), and still others on the subsequent emotive response (Siegel 1988).

In educational contexts, a definition of critical thinking is a “programmatic definition” (Scheffler 1960: 19). It expresses a practical program for achieving an educational goal. For this purpose, a one-sentence formulaic definition is much less useful than articulation of a critical thinking process, with criteria and standards for the kinds of thinking that the process may involve. The real educational goal is recognition, adoption and implementation by students of those criteria and standards. That adoption and implementation in turn consists in acquiring the knowledge, abilities and dispositions of a critical thinker.

Conceptions of critical thinking generally do not include moral integrity as part of the concept. Dewey, for example, took critical thinking to be the ultimate intellectual goal of education, but distinguished it from the development of social cooperation among school children, which he took to be the central moral goal. Ennis (1996, 2011) added to his previous list of critical thinking dispositions a group of dispositions to care about the dignity and worth of every person, which he described as a “correlative” (1996) disposition without which critical thinking would be less valuable and perhaps harmful. An educational program that aimed at developing critical thinking but not the correlative disposition to care about the dignity and worth of every person, he asserted, “would be deficient and perhaps dangerous” (Ennis 1996: 172).

Dewey thought that education for reflective thinking would be of value to both the individual and society; recognition in educational practice of the kinship to the scientific attitude of children’s native curiosity, fertile imagination and love of experimental inquiry “would make for individual happiness and the reduction of social waste” (Dewey 1910: iii). Schools participating in the Eight-Year Study took development of the habit of reflective thinking and skill in solving problems as a means to leading young people to understand, appreciate and live the democratic way of life characteristic of the United States (Aikin 1942: 17–18, 81). Harvey Siegel (1988: 55–61) has offered four considerations in support of adopting critical thinking as an educational ideal. (1) Respect for persons requires that schools and teachers honour students’ demands for reasons and explanations, deal with students honestly, and recognize the need to confront students’ independent judgment; these requirements concern the manner in which teachers treat students. (2) Education has the task of preparing children to be successful adults, a task that requires development of their self-sufficiency. (3) Education should initiate children into the rational traditions in such fields as history, science and mathematics. (4) Education should prepare children to become democratic citizens, which requires reasoned procedures and critical talents and attitudes. To supplement these considerations, Siegel (1988: 62–90) responds to two objections: the ideology objection that adoption of any educational ideal requires a prior ideological commitment and the indoctrination objection that cultivation of critical thinking cannot escape being a form of indoctrination.

Despite the diversity of our 11 examples, one can recognize a common pattern. Dewey analyzed it as consisting of five phases:

• suggestions , in which the mind leaps forward to a possible solution;
• an intellectualization of the difficulty or perplexity into a problem to be solved, a question for which the answer must be sought;
• the use of one suggestion after another as a leading idea, or hypothesis , to initiate and guide observation and other operations in collection of factual material;
• the mental elaboration of the idea or supposition as an idea or supposition ( reasoning , in the sense on which reasoning is a part, not the whole, of inference); and
• testing the hypothesis by overt or imaginative action. (Dewey 1933: 106–107; italics in original)

The process of reflective thinking consisting of these phases would be preceded by a perplexed, troubled or confused situation and followed by a cleared-up, unified, resolved situation (Dewey 1933: 106). The term ‘phases’ replaced the term ‘steps’ (Dewey 1910: 72), thus removing the earlier suggestion of an invariant sequence. Variants of the above analysis appeared in (Dewey 1916: 177) and (Dewey 1938: 101–119).

The variant formulations indicate the difficulty of giving a single logical analysis of such a varied process. The process of critical thinking may have a spiral pattern, with the problem being redefined in the light of obstacles to solving it as originally formulated. For example, the person in Transit might have concluded that getting to the appointment at the scheduled time was impossible and have reformulated the problem as that of rescheduling the appointment for a mutually convenient time. Further, defining a problem does not always follow after or lead immediately to an idea of a suggested solution. Nor should it do so, as Dewey himself recognized in describing the physician in Typhoid as avoiding any strong preference for this or that conclusion before getting further information (Dewey 1910: 85; 1933: 170). People with a hypothesis in mind, even one to which they have a very weak commitment, have a so-called “confirmation bias” (Nickerson 1998): they are likely to pay attention to evidence that confirms the hypothesis and to ignore evidence that counts against it or for some competing hypothesis. Detectives, intelligence agencies, and investigators of airplane accidents are well advised to gather relevant evidence systematically and to postpone even tentative adoption of an explanatory hypothesis until the collected evidence rules out with the appropriate degree of certainty all but one explanation. Dewey’s analysis of the critical thinking process can be faulted as well for requiring acceptance or rejection of a possible solution to a defined problem, with no allowance for deciding in the light of the available evidence to suspend judgment. Further, given the great variety of kinds of problems for which reflection is appropriate, there is likely to be variation in its component events. Perhaps the best way to conceptualize the critical thinking process is as a checklist whose component events can occur in a variety of orders, selectively, and more than once. These component events might include (1) noticing a difficulty, (2) defining the problem, (3) dividing the problem into manageable sub-problems, (4) formulating a variety of possible solutions to the problem or sub-problem, (5) determining what evidence is relevant to deciding among possible solutions to the problem or sub-problem, (6) devising a plan of systematic observation or experiment that will uncover the relevant evidence, (7) carrying out the plan of systematic observation or experimentation, (8) noting the results of the systematic observation or experiment, (9) gathering relevant testimony and information from others, (10) judging the credibility of testimony and information gathered from others, (11) drawing conclusions from gathered evidence and accepted testimony, and (12) accepting a solution that the evidence adequately supports (cf. Hitchcock 2017: 485).

Checklist conceptions of the process of critical thinking are open to the objection that they are too mechanical and procedural to fit the multi-dimensional and emotionally charged issues for which critical thinking is urgently needed (Paul 1984). For such issues, a more dialectical process is advocated, in which competing relevant world views are identified, their implications explored, and some sort of creative synthesis attempted.

If one considers the critical thinking process illustrated by the 11 examples, one can identify distinct kinds of mental acts and mental states that form part of it. To distinguish, label and briefly characterize these components is a useful preliminary to identifying abilities, skills, dispositions, attitudes, habits and the like that contribute causally to thinking critically. Identifying such abilities and habits is in turn a useful preliminary to setting educational goals. Setting the goals is in its turn a useful preliminary to designing strategies for helping learners to achieve the goals and to designing ways of measuring the extent to which learners have done so. Such measures provide both feedback to learners on their achievement and a basis for experimental research on the effectiveness of various strategies for educating people to think critically. Let us begin, then, by distinguishing the kinds of mental acts and mental events that can occur in a critical thinking process.

• Observing : One notices something in one’s immediate environment (sudden cooling of temperature in Weather , bubbles forming outside a glass and then going inside in Bubbles , a moving blur in the distance in Blur , a rash in Rash ). Or one notes the results of an experiment or systematic observation (valuables missing in Disorder , no suction without air pressure in Suction pump )
• Feeling : One feels puzzled or uncertain about something (how to get to an appointment on time in Transit , why the diamonds vary in frequency in Diamond ). One wants to resolve this perplexity. One feels satisfaction once one has worked out an answer (to take the subway express in Transit , diamonds closer when needed as a warning in Diamond ).
• Wondering : One formulates a question to be addressed (why bubbles form outside a tumbler taken from hot water in Bubbles , how suction pumps work in Suction pump , what caused the rash in Rash ).
• Imagining : One thinks of possible answers (bus or subway or elevated in Transit , flagpole or ornament or wireless communication aid or direction indicator in Ferryboat , allergic reaction or heat rash in Rash ).
• Inferring : One works out what would be the case if a possible answer were assumed (valuables missing if there has been a burglary in Disorder , earlier start to the rash if it is an allergic reaction to a sulfa drug in Rash ). Or one draws a conclusion once sufficient relevant evidence is gathered (take the subway in Transit , burglary in Disorder , discontinue blood pressure medication and new cream in Rash ).
• Knowledge : One uses stored knowledge of the subject-matter to generate possible answers or to infer what would be expected on the assumption of a particular answer (knowledge of a city’s public transit system in Transit , of the requirements for a flagpole in Ferryboat , of Boyle’s law in Bubbles , of allergic reactions in Rash ).
• Experimenting : One designs and carries out an experiment or a systematic observation to find out whether the results deduced from a possible answer will occur (looking at the location of the flagpole in relation to the pilot’s position in Ferryboat , putting an ice cube on top of a tumbler taken from hot water in Bubbles , measuring the height to which a suction pump will draw water at different elevations in Suction pump , noticing the frequency of diamonds when movement to or from a diamond lane is allowed in Diamond ).
• Consulting : One finds a source of information, gets the information from the source, and makes a judgment on whether to accept it. None of our 11 examples include searching for sources of information. In this respect they are unrepresentative, since most people nowadays have almost instant access to information relevant to answering any question, including many of those illustrated by the examples. However, Candidate includes the activities of extracting information from sources and evaluating its credibility.
• Identifying and analyzing arguments : One notices an argument and works out its structure and content as a preliminary to evaluating its strength. This activity is central to Candidate . It is an important part of a critical thinking process in which one surveys arguments for various positions on an issue.
• Judging : One makes a judgment on the basis of accumulated evidence and reasoning, such as the judgment in Ferryboat that the purpose of the pole is to provide direction to the pilot.
• Deciding : One makes a decision on what to do or on what policy to adopt, as in the decision in Transit to take the subway.

By definition, a person who does something voluntarily is both willing and able to do that thing at that time. Both the willingness and the ability contribute causally to the person’s action, in the sense that the voluntary action would not occur if either (or both) of these were lacking. For example, suppose that one is standing with one’s arms at one’s sides and one voluntarily lifts one’s right arm to an extended horizontal position. One would not do so if one were unable to lift one’s arm, if for example one’s right side was paralyzed as the result of a stroke. Nor would one do so if one were unwilling to lift one’s arm, if for example one were participating in a street demonstration at which a white supremacist was urging the crowd to lift their right arm in a Nazi salute and one were unwilling to express support in this way for the racist Nazi ideology. The same analysis applies to a voluntary mental process of thinking critically. It requires both willingness and ability to think critically, including willingness and ability to perform each of the mental acts that compose the process and to coordinate those acts in a sequence that is directed at resolving the initiating perplexity.

Consider willingness first. We can identify causal contributors to willingness to think critically by considering factors that would cause a person who was able to think critically about an issue nevertheless not to do so (Hamby 2014). For each factor, the opposite condition thus contributes causally to willingness to think critically on a particular occasion. For example, people who habitually jump to conclusions without considering alternatives will not think critically about issues that arise, even if they have the required abilities. The contrary condition of willingness to suspend judgment is thus a causal contributor to thinking critically.

Now consider ability. In contrast to the ability to move one’s arm, which can be completely absent because a stroke has left the arm paralyzed, the ability to think critically is a developed ability, whose absence is not a complete absence of ability to think but absence of ability to think well. We can identify the ability to think well directly, in terms of the norms and standards for good thinking. In general, to be able do well the thinking activities that can be components of a critical thinking process, one needs to know the concepts and principles that characterize their good performance, to recognize in particular cases that the concepts and principles apply, and to apply them. The knowledge, recognition and application may be procedural rather than declarative. It may be domain-specific rather than widely applicable, and in either case may need subject-matter knowledge, sometimes of a deep kind.

Reflections of the sort illustrated by the previous two paragraphs have led scholars to identify the knowledge, abilities and dispositions of a “critical thinker”, i.e., someone who thinks critically whenever it is appropriate to do so. We turn now to these three types of causal contributors to thinking critically. We start with dispositions, since arguably these are the most powerful contributors to being a critical thinker, can be fostered at an early stage of a child’s development, and are susceptible to general improvement (Glaser 1941: 175)

8. Critical Thinking Dispositions

Educational researchers use the term ‘dispositions’ broadly for the habits of mind and attitudes that contribute causally to being a critical thinker. Some writers (e.g., Paul & Elder 2006; Hamby 2014; Bailin & Battersby 2016) propose to use the term ‘virtues’ for this dimension of a critical thinker. The virtues in question, although they are virtues of character, concern the person’s ways of thinking rather than the person’s ways of behaving towards others. They are not moral virtues but intellectual virtues, of the sort articulated by Zagzebski (1996) and discussed by Turri, Alfano, and Greco (2017).

On a realistic conception, thinking dispositions or intellectual virtues are real properties of thinkers. They are general tendencies, propensities, or inclinations to think in particular ways in particular circumstances, and can be genuinely explanatory (Siegel 1999). Sceptics argue that there is no evidence for a specific mental basis for the habits of mind that contribute to thinking critically, and that it is pedagogically misleading to posit such a basis (Bailin et al. 1999a). Whatever their status, critical thinking dispositions need motivation for their initial formation in a child—motivation that may be external or internal. As children develop, the force of habit will gradually become important in sustaining the disposition (Nieto & Valenzuela 2012). Mere force of habit, however, is unlikely to sustain critical thinking dispositions. Critical thinkers must value and enjoy using their knowledge and abilities to think things through for themselves. They must be committed to, and lovers of, inquiry.

A person may have a critical thinking disposition with respect to only some kinds of issues. For example, one could be open-minded about scientific issues but not about religious issues. Similarly, one could be confident in one’s ability to reason about the theological implications of the existence of evil in the world but not in one’s ability to reason about the best design for a guided ballistic missile.

Critical thinking dispositions can usefully be divided into initiating dispositions (those that contribute causally to starting to think critically about an issue) and internal dispositions (those that contribute causally to doing a good job of thinking critically once one has started) (Facione 1990a: 25). The two categories are not mutually exclusive. For example, open-mindedness, in the sense of willingness to consider alternative points of view to one’s own, is both an initiating and an internal disposition.

Using the strategy of considering factors that would block people with the ability to think critically from doing so, we can identify as initiating dispositions for thinking critically attentiveness, a habit of inquiry, self-confidence, courage, open-mindedness, willingness to suspend judgment, trust in reason, wanting evidence for one’s beliefs, and seeking the truth. We consider briefly what each of these dispositions amounts to, in each case citing sources that acknowledge them.

• Attentiveness : One will not think critically if one fails to recognize an issue that needs to be thought through. For example, the pedestrian in Weather would not have looked up if he had not noticed that the air was suddenly cooler. To be a critical thinker, then, one needs to be habitually attentive to one’s surroundings, noticing not only what one senses but also sources of perplexity in messages received and in one’s own beliefs and attitudes (Facione 1990a: 25; Facione, Facione, & Giancarlo 2001).
• Habit of inquiry : Inquiry is effortful, and one needs an internal push to engage in it. For example, the student in Bubbles could easily have stopped at idle wondering about the cause of the bubbles rather than reasoning to a hypothesis, then designing and executing an experiment to test it. Thus willingness to think critically needs mental energy and initiative. What can supply that energy? Love of inquiry, or perhaps just a habit of inquiry. Hamby (2015) has argued that willingness to inquire is the central critical thinking virtue, one that encompasses all the others. It is recognized as a critical thinking disposition by Dewey (1910: 29; 1933: 35), Glaser (1941: 5), Ennis (1987: 12; 1991: 8), Facione (1990a: 25), Bailin et al. (1999b: 294), Halpern (1998: 452), and Facione, Facione, & Giancarlo (2001).
• Self-confidence : Lack of confidence in one’s abilities can block critical thinking. For example, if the woman in Rash lacked confidence in her ability to figure things out for herself, she might just have assumed that the rash on her chest was the allergic reaction to her medication against which the pharmacist had warned her. Thus willingness to think critically requires confidence in one’s ability to inquire (Facione 1990a: 25; Facione, Facione, & Giancarlo 2001).
• Courage : Fear of thinking for oneself can stop one from doing it. Thus willingness to think critically requires intellectual courage (Paul & Elder 2006: 16).
• Open-mindedness : A dogmatic attitude will impede thinking critically. For example, a person who adheres rigidly to a “pro-choice” position on the issue of the legal status of induced abortion is likely to be unwilling to consider seriously the issue of when in its development an unborn child acquires a moral right to life. Thus willingness to think critically requires open-mindedness, in the sense of a willingness to examine questions to which one already accepts an answer but which further evidence or reasoning might cause one to answer differently (Dewey 1933; Facione 1990a; Ennis 1991; Bailin et al. 1999b; Halpern 1998, Facione, Facione, & Giancarlo 2001). Paul (1981) emphasizes open-mindedness about alternative world-views, and recommends a dialectical approach to integrating such views as central to what he calls “strong sense” critical thinking.
• Willingness to suspend judgment : Premature closure on an initial solution will block critical thinking. Thus willingness to think critically requires a willingness to suspend judgment while alternatives are explored (Facione 1990a; Ennis 1991; Halpern 1998).
• Trust in reason : Since distrust in the processes of reasoned inquiry will dissuade one from engaging in it, trust in them is an initiating critical thinking disposition (Facione 1990a, 25; Bailin et al. 1999b: 294; Facione, Facione, & Giancarlo 2001; Paul & Elder 2006). In reaction to an allegedly exclusive emphasis on reason in critical thinking theory and pedagogy, Thayer-Bacon (2000) argues that intuition, imagination, and emotion have important roles to play in an adequate conception of critical thinking that she calls “constructive thinking”. From her point of view, critical thinking requires trust not only in reason but also in intuition, imagination, and emotion.
• Seeking the truth : If one does not care about the truth but is content to stick with one’s initial bias on an issue, then one will not think critically about it. Seeking the truth is thus an initiating critical thinking disposition (Bailin et al. 1999b: 294; Facione, Facione, & Giancarlo 2001). A disposition to seek the truth is implicit in more specific critical thinking dispositions, such as trying to be well-informed, considering seriously points of view other than one’s own, looking for alternatives, suspending judgment when the evidence is insufficient, and adopting a position when the evidence supporting it is sufficient.

Some of the initiating dispositions, such as open-mindedness and willingness to suspend judgment, are also internal critical thinking dispositions, in the sense of mental habits or attitudes that contribute causally to doing a good job of critical thinking once one starts the process. But there are many other internal critical thinking dispositions. Some of them are parasitic on one’s conception of good thinking. For example, it is constitutive of good thinking about an issue to formulate the issue clearly and to maintain focus on it. For this purpose, one needs not only the corresponding ability but also the corresponding disposition. Ennis (1991: 8) describes it as the disposition “to determine and maintain focus on the conclusion or question”, Facione (1990a: 25) as “clarity in stating the question or concern”. Other internal dispositions are motivators to continue or adjust the critical thinking process, such as willingness to persist in a complex task and willingness to abandon nonproductive strategies in an attempt to self-correct (Halpern 1998: 452). For a list of identified internal critical thinking dispositions, see the Supplement on Internal Critical Thinking Dispositions .

Some theorists postulate skills, i.e., acquired abilities, as operative in critical thinking. It is not obvious, however, that a good mental act is the exercise of a generic acquired skill. Inferring an expected time of arrival, as in Transit , has some generic components but also uses non-generic subject-matter knowledge. Bailin et al. (1999a) argue against viewing critical thinking skills as generic and discrete, on the ground that skilled performance at a critical thinking task cannot be separated from knowledge of concepts and from domain-specific principles of good thinking. Talk of skills, they concede, is unproblematic if it means merely that a person with critical thinking skills is capable of intelligent performance.

Despite such scepticism, theorists of critical thinking have listed as general contributors to critical thinking what they variously call abilities (Glaser 1941; Ennis 1962, 1991), skills (Facione 1990a; Halpern 1998) or competencies (Fisher & Scriven 1997). Amalgamating these lists would produce a confusing and chaotic cornucopia of more than 50 possible educational objectives, with only partial overlap among them. It makes sense instead to try to understand the reasons for the multiplicity and diversity, and to make a selection according to one’s own reasons for singling out abilities to be developed in a critical thinking curriculum. Two reasons for diversity among lists of critical thinking abilities are the underlying conception of critical thinking and the envisaged educational level. Appraisal-only conceptions, for example, involve a different suite of abilities than constructive-only conceptions. Some lists, such as those in (Glaser 1941), are put forward as educational objectives for secondary school students, whereas others are proposed as objectives for college students (e.g., Facione 1990a).

The abilities described in the remaining paragraphs of this section emerge from reflection on the general abilities needed to do well the thinking activities identified in section 6 as components of the critical thinking process described in section 5 . The derivation of each collection of abilities is accompanied by citation of sources that list such abilities and of standardized tests that claim to test them.

Observational abilities : Careful and accurate observation sometimes requires specialist expertise and practice, as in the case of observing birds and observing accident scenes. However, there are general abilities of noticing what one’s senses are picking up from one’s environment and of being able to articulate clearly and accurately to oneself and others what one has observed. It helps in exercising them to be able to recognize and take into account factors that make one’s observation less trustworthy, such as prior framing of the situation, inadequate time, deficient senses, poor observation conditions, and the like. It helps as well to be skilled at taking steps to make one’s observation more trustworthy, such as moving closer to get a better look, measuring something three times and taking the average, and checking what one thinks one is observing with someone else who is in a good position to observe it. It also helps to be skilled at recognizing respects in which one’s report of one’s observation involves inference rather than direct observation, so that one can then consider whether the inference is justified. These abilities come into play as well when one thinks about whether and with what degree of confidence to accept an observation report, for example in the study of history or in a criminal investigation or in assessing news reports. Observational abilities show up in some lists of critical thinking abilities (Ennis 1962: 90; Facione 1990a: 16; Ennis 1991: 9). There are items testing a person’s ability to judge the credibility of observation reports in the Cornell Critical Thinking Tests, Levels X and Z (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005). Norris and King (1983, 1985, 1990a, 1990b) is a test of ability to appraise observation reports.

Emotional abilities : The emotions that drive a critical thinking process are perplexity or puzzlement, a wish to resolve it, and satisfaction at achieving the desired resolution. Children experience these emotions at an early age, without being trained to do so. Education that takes critical thinking as a goal needs only to channel these emotions and to make sure not to stifle them. Collaborative critical thinking benefits from ability to recognize one’s own and others’ emotional commitments and reactions.

Questioning abilities : A critical thinking process needs transformation of an inchoate sense of perplexity into a clear question. Formulating a question well requires not building in questionable assumptions, not prejudging the issue, and using language that in context is unambiguous and precise enough (Ennis 1962: 97; 1991: 9).

Imaginative abilities : Thinking directed at finding the correct causal explanation of a general phenomenon or particular event requires an ability to imagine possible explanations. Thinking about what policy or plan of action to adopt requires generation of options and consideration of possible consequences of each option. Domain knowledge is required for such creative activity, but a general ability to imagine alternatives is helpful and can be nurtured so as to become easier, quicker, more extensive, and deeper (Dewey 1910: 34–39; 1933: 40–47). Facione (1990a) and Halpern (1998) include the ability to imagine alternatives as a critical thinking ability.

Inferential abilities : The ability to draw conclusions from given information, and to recognize with what degree of certainty one’s own or others’ conclusions follow, is universally recognized as a general critical thinking ability. All 11 examples in section 2 of this article include inferences, some from hypotheses or options (as in Transit , Ferryboat and Disorder ), others from something observed (as in Weather and Rash ). None of these inferences is formally valid. Rather, they are licensed by general, sometimes qualified substantive rules of inference (Toulmin 1958) that rest on domain knowledge—that a bus trip takes about the same time in each direction, that the terminal of a wireless telegraph would be located on the highest possible place, that sudden cooling is often followed by rain, that an allergic reaction to a sulfa drug generally shows up soon after one starts taking it. It is a matter of controversy to what extent the specialized ability to deduce conclusions from premisses using formal rules of inference is needed for critical thinking. Dewey (1933) locates logical forms in setting out the products of reflection rather than in the process of reflection. Ennis (1981a), on the other hand, maintains that a liberally-educated person should have the following abilities: to translate natural-language statements into statements using the standard logical operators, to use appropriately the language of necessary and sufficient conditions, to deal with argument forms and arguments containing symbols, to determine whether in virtue of an argument’s form its conclusion follows necessarily from its premisses, to reason with logically complex propositions, and to apply the rules and procedures of deductive logic. Inferential abilities are recognized as critical thinking abilities by Glaser (1941: 6), Facione (1990a: 9), Ennis (1991: 9), Fisher & Scriven (1997: 99, 111), and Halpern (1998: 452). Items testing inferential abilities constitute two of the five subtests of the Watson Glaser Critical Thinking Appraisal (Watson & Glaser 1980a, 1980b, 1994), two of the four sections in the Cornell Critical Thinking Test Level X (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005), three of the seven sections in the Cornell Critical Thinking Test Level Z (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005), 11 of the 34 items on Forms A and B of the California Critical Thinking Skills Test (Facione 1990b, 1992), and a high but variable proportion of the 25 selected-response questions in the Collegiate Learning Assessment (Council for Aid to Education 2017).

Experimenting abilities : Knowing how to design and execute an experiment is important not just in scientific research but also in everyday life, as in Rash . Dewey devoted a whole chapter of his How We Think (1910: 145–156; 1933: 190–202) to the superiority of experimentation over observation in advancing knowledge. Experimenting abilities come into play at one remove in appraising reports of scientific studies. Skill in designing and executing experiments includes the acknowledged abilities to appraise evidence (Glaser 1941: 6), to carry out experiments and to apply appropriate statistical inference techniques (Facione 1990a: 9), to judge inductions to an explanatory hypothesis (Ennis 1991: 9), and to recognize the need for an adequately large sample size (Halpern 1998). The Cornell Critical Thinking Test Level Z (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005) includes four items (out of 52) on experimental design. The Collegiate Learning Assessment (Council for Aid to Education 2017) makes room for appraisal of study design in both its performance task and its selected-response questions.

Consulting abilities : Skill at consulting sources of information comes into play when one seeks information to help resolve a problem, as in Candidate . Ability to find and appraise information includes ability to gather and marshal pertinent information (Glaser 1941: 6), to judge whether a statement made by an alleged authority is acceptable (Ennis 1962: 84), to plan a search for desired information (Facione 1990a: 9), and to judge the credibility of a source (Ennis 1991: 9). Ability to judge the credibility of statements is tested by 24 items (out of 76) in the Cornell Critical Thinking Test Level X (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005) and by four items (out of 52) in the Cornell Critical Thinking Test Level Z (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005). The College Learning Assessment’s performance task requires evaluation of whether information in documents is credible or unreliable (Council for Aid to Education 2017).

Argument analysis abilities : The ability to identify and analyze arguments contributes to the process of surveying arguments on an issue in order to form one’s own reasoned judgment, as in Candidate . The ability to detect and analyze arguments is recognized as a critical thinking skill by Facione (1990a: 7–8), Ennis (1991: 9) and Halpern (1998). Five items (out of 34) on the California Critical Thinking Skills Test (Facione 1990b, 1992) test skill at argument analysis. The College Learning Assessment (Council for Aid to Education 2017) incorporates argument analysis in its selected-response tests of critical reading and evaluation and of critiquing an argument.

Judging skills and deciding skills : Skill at judging and deciding is skill at recognizing what judgment or decision the available evidence and argument supports, and with what degree of confidence. It is thus a component of the inferential skills already discussed.

Lists and tests of critical thinking abilities often include two more abilities: identifying assumptions and constructing and evaluating definitions.

In addition to dispositions and abilities, critical thinking needs knowledge: of critical thinking concepts, of critical thinking principles, and of the subject-matter of the thinking.

We can derive a short list of concepts whose understanding contributes to critical thinking from the critical thinking abilities described in the preceding section. Observational abilities require an understanding of the difference between observation and inference. Questioning abilities require an understanding of the concepts of ambiguity and vagueness. Inferential abilities require an understanding of the difference between conclusive and defeasible inference (traditionally, between deduction and induction), as well as of the difference between necessary and sufficient conditions. Experimenting abilities require an understanding of the concepts of hypothesis, null hypothesis, assumption and prediction, as well as of the concept of statistical significance and of its difference from importance. They also require an understanding of the difference between an experiment and an observational study, and in particular of the difference between a randomized controlled trial, a prospective correlational study and a retrospective (case-control) study. Argument analysis abilities require an understanding of the concepts of argument, premiss, assumption, conclusion and counter-consideration. Additional critical thinking concepts are proposed by Bailin et al. (1999b: 293), Fisher & Scriven (1997: 105–106), and Black (2012).

According to Glaser (1941: 25), ability to think critically requires knowledge of the methods of logical inquiry and reasoning. If we review the list of abilities in the preceding section, however, we can see that some of them can be acquired and exercised merely through practice, possibly guided in an educational setting, followed by feedback. Searching intelligently for a causal explanation of some phenomenon or event requires that one consider a full range of possible causal contributors, but it seems more important that one implements this principle in one’s practice than that one is able to articulate it. What is important is “operational knowledge” of the standards and principles of good thinking (Bailin et al. 1999b: 291–293). But the development of such critical thinking abilities as designing an experiment or constructing an operational definition can benefit from learning their underlying theory. Further, explicit knowledge of quirks of human thinking seems useful as a cautionary guide. Human memory is not just fallible about details, as people learn from their own experiences of misremembering, but is so malleable that a detailed, clear and vivid recollection of an event can be a total fabrication (Loftus 2017). People seek or interpret evidence in ways that are partial to their existing beliefs and expectations, often unconscious of their “confirmation bias” (Nickerson 1998). Not only are people subject to this and other cognitive biases (Kahneman 2011), of which they are typically unaware, but it may be counter-productive for one to make oneself aware of them and try consciously to counteract them or to counteract social biases such as racial or sexual stereotypes (Kenyon & Beaulac 2014). It is helpful to be aware of these facts and of the superior effectiveness of blocking the operation of biases—for example, by making an immediate record of one’s observations, refraining from forming a preliminary explanatory hypothesis, blind refereeing, double-blind randomized trials, and blind grading of students’ work.

Critical thinking about an issue requires substantive knowledge of the domain to which the issue belongs. Critical thinking abilities are not a magic elixir that can be applied to any issue whatever by somebody who has no knowledge of the facts relevant to exploring that issue. For example, the student in Bubbles needed to know that gases do not penetrate solid objects like a glass, that air expands when heated, that the volume of an enclosed gas varies directly with its temperature and inversely with its pressure, and that hot objects will spontaneously cool down to the ambient temperature of their surroundings unless kept hot by insulation or a source of heat. Critical thinkers thus need a rich fund of subject-matter knowledge relevant to the variety of situations they encounter. This fact is recognized in the inclusion among critical thinking dispositions of a concern to become and remain generally well informed.

Experimental educational interventions, with control groups, have shown that education can improve critical thinking skills and dispositions, as measured by standardized tests. For information about these tests, see the Supplement on Assessment .

What educational methods are most effective at developing the dispositions, abilities and knowledge of a critical thinker? Abrami et al. (2015) found that in the experimental and quasi-experimental studies that they analyzed dialogue, anchored instruction, and mentoring each increased the effectiveness of the educational intervention, and that they were most effective when combined. They also found that in these studies a combination of separate instruction in critical thinking with subject-matter instruction in which students are encouraged to think critically was more effective than either by itself. However, the difference was not statistically significant; that is, it might have arisen by chance.

Most of these studies lack the longitudinal follow-up required to determine whether the observed differential improvements in critical thinking abilities or dispositions continue over time, for example until high school or college graduation. For details on studies of methods of developing critical thinking skills and dispositions, see the Supplement on Educational Methods .

12. Controversies

Scholars have denied the generalizability of critical thinking abilities across subject domains, have alleged bias in critical thinking theory and pedagogy, and have investigated the relationship of critical thinking to other kinds of thinking.

McPeck (1981) attacked the thinking skills movement of the 1970s, including the critical thinking movement. He argued that there are no general thinking skills, since thinking is always thinking about some subject-matter. It is futile, he claimed, for schools and colleges to teach thinking as if it were a separate subject. Rather, teachers should lead their pupils to become autonomous thinkers by teaching school subjects in a way that brings out their cognitive structure and that encourages and rewards discussion and argument. As some of his critics (e.g., Paul 1985; Siegel 1985) pointed out, McPeck’s central argument needs elaboration, since it has obvious counter-examples in writing and speaking, for which (up to a certain level of complexity) there are teachable general abilities even though they are always about some subject-matter. To make his argument convincing, McPeck needs to explain how thinking differs from writing and speaking in a way that does not permit useful abstraction of its components from the subject-matters with which it deals. He has not done so. Nevertheless, his position that the dispositions and abilities of a critical thinker are best developed in the context of subject-matter instruction is shared by many theorists of critical thinking, including Dewey (1910, 1933), Glaser (1941), Passmore (1980), Weinstein (1990), and Bailin et al. (1999b).

McPeck’s challenge prompted reflection on the extent to which critical thinking is subject-specific. McPeck argued for a strong subject-specificity thesis, according to which it is a conceptual truth that all critical thinking abilities are specific to a subject. (He did not however extend his subject-specificity thesis to critical thinking dispositions. In particular, he took the disposition to suspend judgment in situations of cognitive dissonance to be a general disposition.) Conceptual subject-specificity is subject to obvious counter-examples, such as the general ability to recognize confusion of necessary and sufficient conditions. A more modest thesis, also endorsed by McPeck, is epistemological subject-specificity, according to which the norms of good thinking vary from one field to another. Epistemological subject-specificity clearly holds to a certain extent; for example, the principles in accordance with which one solves a differential equation are quite different from the principles in accordance with which one determines whether a painting is a genuine Picasso. But the thesis suffers, as Ennis (1989) points out, from vagueness of the concept of a field or subject and from the obvious existence of inter-field principles, however broadly the concept of a field is construed. For example, the principles of hypothetico-deductive reasoning hold for all the varied fields in which such reasoning occurs. A third kind of subject-specificity is empirical subject-specificity, according to which as a matter of empirically observable fact a person with the abilities and dispositions of a critical thinker in one area of investigation will not necessarily have them in another area of investigation.

The thesis of empirical subject-specificity raises the general problem of transfer. If critical thinking abilities and dispositions have to be developed independently in each school subject, how are they of any use in dealing with the problems of everyday life and the political and social issues of contemporary society, most of which do not fit into the framework of a traditional school subject? Proponents of empirical subject-specificity tend to argue that transfer is more likely to occur if there is critical thinking instruction in a variety of domains, with explicit attention to dispositions and abilities that cut across domains. But evidence for this claim is scanty. There is a need for well-designed empirical studies that investigate the conditions that make transfer more likely.

It is common ground in debates about the generality or subject-specificity of critical thinking dispositions and abilities that critical thinking about any topic requires background knowledge about the topic. For example, the most sophisticated understanding of the principles of hypothetico-deductive reasoning is of no help unless accompanied by some knowledge of what might be plausible explanations of some phenomenon under investigation.

Critics have objected to bias in the theory, pedagogy and practice of critical thinking. Commentators (e.g., Alston 1995; Ennis 1998) have noted that anyone who takes a position has a bias in the neutral sense of being inclined in one direction rather than others. The critics, however, are objecting to bias in the pejorative sense of an unjustified favoring of certain ways of knowing over others, frequently alleging that the unjustly favoured ways are those of a dominant sex or culture (Bailin 1995). These ways favour:

• reinforcement of egocentric and sociocentric biases over dialectical engagement with opposing world-views (Paul 1981, 1984; Warren 1998)
• distancing from the object of inquiry over closeness to it (Martin 1992; Thayer-Bacon 1992)
• indifference to the situation of others over care for them (Martin 1992)
• orientation to thought over orientation to action (Martin 1992)
• being reasonable over caring to understand people’s ideas (Thayer-Bacon 1993)
• being neutral and objective over being embodied and situated (Thayer-Bacon 1995a)
• doubting over believing (Thayer-Bacon 1995b)
• reason over emotion, imagination and intuition (Thayer-Bacon 2000)
• solitary thinking over collaborative thinking (Thayer-Bacon 2000)
• written and spoken assignments over other forms of expression (Alston 2001)
• attention to written and spoken communications over attention to human problems (Alston 2001)
• winning debates in the public sphere over making and understanding meaning (Alston 2001)

A common thread in this smorgasbord of accusations is dissatisfaction with focusing on the logical analysis and evaluation of reasoning and arguments. While these authors acknowledge that such analysis and evaluation is part of critical thinking and should be part of its conceptualization and pedagogy, they insist that it is only a part. Paul (1981), for example, bemoans the tendency of atomistic teaching of methods of analyzing and evaluating arguments to turn students into more able sophists, adept at finding fault with positions and arguments with which they disagree but even more entrenched in the egocentric and sociocentric biases with which they began. Martin (1992) and Thayer-Bacon (1992) cite with approval the self-reported intimacy with their subject-matter of leading researchers in biology and medicine, an intimacy that conflicts with the distancing allegedly recommended in standard conceptions and pedagogy of critical thinking. Thayer-Bacon (2000) contrasts the embodied and socially embedded learning of her elementary school students in a Montessori school, who used their imagination, intuition and emotions as well as their reason, with conceptions of critical thinking as

thinking that is used to critique arguments, offer justifications, and make judgments about what are the good reasons, or the right answers. (Thayer-Bacon 2000: 127–128)

Alston (2001) reports that her students in a women’s studies class were able to see the flaws in the Cinderella myth that pervades much romantic fiction but in their own romantic relationships still acted as if all failures were the woman’s fault and still accepted the notions of love at first sight and living happily ever after. Students, she writes, should

be able to connect their intellectual critique to a more affective, somatic, and ethical account of making risky choices that have sexist, racist, classist, familial, sexual, or other consequences for themselves and those both near and far… critical thinking that reads arguments, texts, or practices merely on the surface without connections to feeling/desiring/doing or action lacks an ethical depth that should infuse the difference between mere cognitive activity and something we want to call critical thinking. (Alston 2001: 34)

Some critics portray such biases as unfair to women. Thayer-Bacon (1992), for example, has charged modern critical thinking theory with being sexist, on the ground that it separates the self from the object and causes one to lose touch with one’s inner voice, and thus stigmatizes women, who (she asserts) link self to object and listen to their inner voice. Her charge does not imply that women as a group are on average less able than men to analyze and evaluate arguments. Facione (1990c) found no difference by sex in performance on his California Critical Thinking Skills Test. Kuhn (1991: 280–281) found no difference by sex in either the disposition or the competence to engage in argumentative thinking.

The critics propose a variety of remedies for the biases that they allege. In general, they do not propose to eliminate or downplay critical thinking as an educational goal. Rather, they propose to conceptualize critical thinking differently and to change its pedagogy accordingly. Their pedagogical proposals arise logically from their objections. They can be summarized as follows:

• Focus on argument networks with dialectical exchanges reflecting contesting points of view rather than on atomic arguments, so as to develop “strong sense” critical thinking that transcends egocentric and sociocentric biases (Paul 1981, 1984).
• Foster closeness to the subject-matter and feeling connected to others in order to inform a humane democracy (Martin 1992).
• Develop “constructive thinking” as a social activity in a community of physically embodied and socially embedded inquirers with personal voices who value not only reason but also imagination, intuition and emotion (Thayer-Bacon 2000).
• In developing critical thinking in school subjects, treat as important neither skills nor dispositions but opening worlds of meaning (Alston 2001).
• Attend to the development of critical thinking dispositions as well as skills, and adopt the “critical pedagogy” practised and advocated by Freire (1968 [1970]) and hooks (1994) (Dalgleish, Girard, & Davies 2017).

A common thread in these proposals is treatment of critical thinking as a social, interactive, personally engaged activity like that of a quilting bee or a barn-raising (Thayer-Bacon 2000) rather than as an individual, solitary, distanced activity symbolized by Rodin’s The Thinker . One can get a vivid description of education with the former type of goal from the writings of bell hooks (1994, 2010). Critical thinking for her is open-minded dialectical exchange across opposing standpoints and from multiple perspectives, a conception similar to Paul’s “strong sense” critical thinking (Paul 1981). She abandons the structure of domination in the traditional classroom. In an introductory course on black women writers, for example, she assigns students to write an autobiographical paragraph about an early racial memory, then to read it aloud as the others listen, thus affirming the uniqueness and value of each voice and creating a communal awareness of the diversity of the group’s experiences (hooks 1994: 84). Her “engaged pedagogy” is thus similar to the “freedom under guidance” implemented in John Dewey’s Laboratory School of Chicago in the late 1890s and early 1900s. It incorporates the dialogue, anchored instruction, and mentoring that Abrami (2015) found to be most effective in improving critical thinking skills and dispositions.

What is the relationship of critical thinking to problem solving, decision-making, higher-order thinking, creative thinking, and other recognized types of thinking? One’s answer to this question obviously depends on how one defines the terms used in the question. If critical thinking is conceived broadly to cover any careful thinking about any topic for any purpose, then problem solving and decision making will be kinds of critical thinking, if they are done carefully. Historically, ‘critical thinking’ and ‘problem solving’ were two names for the same thing. If critical thinking is conceived more narrowly as consisting solely of appraisal of intellectual products, then it will be disjoint with problem solving and decision making, which are constructive.

Bloom’s taxonomy of educational objectives used the phrase “intellectual abilities and skills” for what had been labeled “critical thinking” by some, “reflective thinking” by Dewey and others, and “problem solving” by still others (Bloom et al. 1956: 38). Thus, the so-called “higher-order thinking skills” at the taxonomy’s top levels of analysis, synthesis and evaluation are just critical thinking skills, although they do not come with general criteria for their assessment (Ennis 1981b). The revised version of Bloom’s taxonomy (Anderson et al. 2001) likewise treats critical thinking as cutting across those types of cognitive process that involve more than remembering (Anderson et al. 2001: 269–270). For details, see the Supplement on History .

As to creative thinking, it overlaps with critical thinking (Bailin 1987, 1988). Thinking about the explanation of some phenomenon or event, as in Ferryboat , requires creative imagination in constructing plausible explanatory hypotheses. Likewise, thinking about a policy question, as in Candidate , requires creativity in coming up with options. Conversely, creativity in any field needs to be balanced by critical appraisal of the draft painting or novel or mathematical theory.

• Abrami, Philip C., Robert M. Bernard, Eugene Borokhovski, David I. Waddington, C. Anne Wade, and Tonje Person, 2015, “Strategies for Teaching Students to Think Critically: A Meta-analysis”, Review of Educational Research , 85(2): 275–314. doi:10.3102/0034654314551063
• Aikin, Wilford M., 1942, The Story of the Eight-year Study, with Conclusions and Recommendations , Volume I of Adventure in American Education , New York and London: Harper & Brothers. [ Aikin 1942 available online ]
• Alston, Kal, 1995, “Begging the Question: Is Critical Thinking Biased?”, Educational Theory , 45(2): 225–233. doi:10.1111/j.1741-5446.1995.00225.x
• –––, 2001, “Re/Thinking Critical Thinking: The Seductions of Everyday Life”, Studies in Philosophy and Education , 20(1): 27–40. doi:10.1023/A:1005247128053
• American Educational Research Association, 2014, Standards for Educational and Psychological Testing / American Educational Research Association, American Psychological Association, National Council on Measurement in Education , Washington, DC: American Educational Research Association.
• Anderson, Lorin W., David R. Krathwohl, Peter W. Airiasian, Kathleen A. Cruikshank, Richard E. Mayer, Paul R. Pintrich, James Raths, and Merlin C. Wittrock, 2001, A Taxonomy for Learning, Teaching and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives , New York: Longman, complete edition.
• Bailin, Sharon, 1987, “Critical and Creative Thinking”, Informal Logic , 9(1): 23–30. [ Bailin 1987 available online ]
• –––, 1988, Achieving Extraordinary Ends: An Essay on Creativity , Dordrecht: Kluwer. doi:10.1007/978-94-009-2780-3
• –––, 1995, “Is Critical Thinking Biased? Clarifications and Implications”, Educational Theory , 45(2): 191–197. doi:10.1111/j.1741-5446.1995.00191.x
• Bailin, Sharon and Mark Battersby, 2009, “Inquiry: A Dialectical Approach to Teaching Critical Thinking”, in Juho Ritola (ed.), Argument Cultures: Proceedings of OSSA 09 , CD-ROM (pp. 1–10), Windsor, ON: OSSA. [ Bailin & Battersby 2009 available online ]
• –––, 2016, “Fostering the Virtues of Inquiry”, Topoi , 35(2): 367–374. doi:10.1007/s11245-015-9307-6
• Bailin, Sharon, Roland Case, Jerrold R. Coombs, and Leroi B. Daniels, 1999a, “Common Misconceptions of Critical Thinking”, Journal of Curriculum Studies , 31(3): 269–283. doi:10.1080/002202799183124
• –––, 1999b, “Conceptualizing Critical Thinking”, Journal of Curriculum Studies , 31(3): 285–302. doi:10.1080/002202799183133
• Berman, Alan M., Seth J. Schwartz, William M. Kurtines, and Steven L. Berman, 2001, “The Process of Exploration in Identity Formation: The Role of Style and Competence”, Journal of Adolescence , 24(4): 513–528. doi:10.1006/jado.2001.0386
• Black, Beth (ed.), 2012, An A to Z of Critical Thinking , London: Continuum International Publishing Group.
• Bloom, Benjamin Samuel, Max D. Engelhart, Edward J. Furst, Walter H. Hill, and David R. Krathwohl, 1956, Taxonomy of Educational Objectives. Handbook I: Cognitive Domain , New York: David McKay.
• Casserly, Megan, 2012, “The 10 Skills That Will Get You Hired in 2013”, Forbes , Dec. 10, 2012. Available at https://www.forbes.com/sites/meghancasserly/2012/12/10/the-10-skills-that-will-get-you-a-job-in-2013/#79e7ff4e633d ; accessed 2017 11 06.
• Center for Assessment & Improvement of Learning, 2017, Critical Thinking Assessment Test , Cookeville, TN: Tennessee Technological University.
• Cohen, Jacob, 1988, Statistical Power Analysis for the Behavioral Sciences , Hillsdale, NJ: Lawrence Erlbaum Associates, 2nd edition.
• College Board, 1983, Academic Preparation for College. What Students Need to Know and Be Able to Do , New York: College Entrance Examination Board, ERIC document ED232517.
• Commission on the Relation of School and College of the Progressive Education Association, 1943, Thirty Schools Tell Their Story , Volume V of Adventure in American Education , New York and London: Harper & Brothers.
• Council for Aid to Education, 2017, CLA+ Student Guide . Available at http://cae.org/images/uploads/pdf/CLA_Student_Guide_Institution.pdf ; accessed 2017 09 26.
• Dalgleish, Adam, Patrick Girard, and Maree Davies, 2017, “Critical Thinking, Bias and Feminist Philosophy: Building a Better Framework through Collaboration”, Informal Logic , 37(4): 351–369. [ Dalgleish et al. available online ]
• Dewey, John, 1910, How We Think , Boston: D.C. Heath. [ Dewey 1910 available online ]
• –––, 1916, Democracy and Education: An Introduction to the Philosophy of Education , New York: Macmillan.
• –––, 1933, How We Think: A Restatement of the Relation of Reflective Thinking to the Educative Process , Lexington, MA: D.C. Heath.
• –––, 1936, “The Theory of the Chicago Experiment”, Appendix II of Mayhew & Edwards 1936: 463–477.
• –––, 1938, Logic: The Theory of Inquiry , New York: Henry Holt and Company.
• Dominguez, Caroline (coord.), 2018a, A European Collection of the Critical Thinking Skills and Dispositions Needed in Different Professional Fields for the 21st Century , Vila Real, Portugal: UTAD. Available at http://bit.ly/CRITHINKEDUO1 ; accessed 2018 04 09.
• ––– (coord.), 2018b, A European Review on Critical Thinking Educational Practices in Higher Education Institutions , Vila Real: UTAD. Available at http://bit.ly/CRITHINKEDUO2 ; accessed 2018 04 14.
• Dumke, Glenn S., 1980, Chancellor’s Executive Order 338 , Long Beach, CA: California State University, Chancellor’s Office. Available at https://www.calstate.edu/eo/EO-338.pdf ; accessed 2017 11 16.
• Ennis, Robert H., 1958, “An Appraisal of the Watson-Glaser Critical Thinking Appraisal”, The Journal of Educational Research , 52(4): 155–158. doi:10.1080/00220671.1958.10882558
• –––, 1962, “A Concept of Critical Thinking: A Proposed Basis for Research on the Teaching and Evaluation of Critical Thinking Ability”, Harvard Educational Review , 32(1): 81–111.
• –––, 1981a, “A Conception of Deductive Logical Competence”, Teaching Philosophy , 4(3/4): 337–385. doi:10.5840/teachphil198143/429
• –––, 1981b, “Eight Fallacies in Bloom’s Taxonomy”, in C. J. B. Macmillan (ed.), Philosophy of Education 1980: Proceedings of the Thirty-seventh Annual Meeting of the Philosophy of Education Society , Bloomington, IL: Philosophy of Education Society, pp. 269–273.
• –––, 1984, “Problems in Testing Informal Logic, Critical Thinking, Reasoning Ability”. Informal Logic , 6(1): 3–9. [ Ennis 1984 available online ]
• –––, 1987, “A Taxonomy of Critical Thinking Dispositions and Abilities”, in Joan Boykoff Baron and Robert J. Sternberg (eds.), Teaching Thinking Skills: Theory and Practice , New York: W. H. Freeman, pp. 9–26.
• –––, 1989, “Critical Thinking and Subject Specificity: Clarification and Needed Research”, Educational Researcher , 18(3): 4–10. doi:10.3102/0013189X018003004
• –––, 1991, “Critical Thinking: A Streamlined Conception”, Teaching Philosophy , 14(1): 5–24. doi:10.5840/teachphil19911412
• –––, 1996, “Critical Thinking Dispositions: Their Nature and Assessability”, Informal Logic , 18(2–3): 165–182. [ Ennis 1996 available online ]
• –––, 1998, “Is Critical Thinking Culturally Biased?”, Teaching Philosophy , 21(1): 15–33. doi:10.5840/teachphil19982113
• –––, 2011, “Critical Thinking: Reflection and Perspective Part I”, Inquiry: Critical Thinking across the Disciplines , 26(1): 4–18. doi:10.5840/inquiryctnews20112613
• –––, 2013, “Critical Thinking across the Curriculum: The Wisdom CTAC Program”, Inquiry: Critical Thinking across the Disciplines , 28(2): 25–45. doi:10.5840/inquiryct20132828
• –––, 2016, “Definition: A Three-Dimensional Analysis with Bearing on Key Concepts”, in Patrick Bondy and Laura Benacquista (eds.), Argumentation, Objectivity, and Bias: Proceedings of the 11th International Conference of the Ontario Society for the Study of Argumentation (OSSA), 18–21 May 2016 , Windsor, ON: OSSA, pp. 1–19. Available at http://scholar.uwindsor.ca/ossaarchive/OSSA11/papersandcommentaries/105 ; accessed 2017 12 02.
• –––, 2018, “Critical Thinking Across the Curriculum: A Vision”, Topoi , 37(1): 165–184. doi:10.1007/s11245-016-9401-4
• Ennis, Robert H., and Jason Millman, 1971, Manual for Cornell Critical Thinking Test, Level X, and Cornell Critical Thinking Test, Level Z , Urbana, IL: Critical Thinking Project, University of Illinois.
• Ennis, Robert H., Jason Millman, and Thomas Norbert Tomko, 1985, Cornell Critical Thinking Tests Level X & Level Z: Manual , Pacific Grove, CA: Midwest Publication, 3rd edition.
• –––, 2005, Cornell Critical Thinking Tests Level X & Level Z: Manual , Seaside, CA: Critical Thinking Company, 5th edition.
• Ennis, Robert H. and Eric Weir, 1985, The Ennis-Weir Critical Thinking Essay Test: Test, Manual, Criteria, Scoring Sheet: An Instrument for Teaching and Testing , Pacific Grove, CA: Midwest Publications.
• Facione, Peter A., 1990a, Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction , Research Findings and Recommendations Prepared for the Committee on Pre-College Philosophy of the American Philosophical Association, ERIC Document ED315423.
• –––, 1990b, California Critical Thinking Skills Test, CCTST – Form A , Millbrae, CA: The California Academic Press.
• –––, 1990c, The California Critical Thinking Skills Test--College Level. Technical Report #3. Gender, Ethnicity, Major, CT Self-Esteem, and the CCTST , ERIC Document ED326584.
• –––, 1992, California Critical Thinking Skills Test: CCTST – Form B, Millbrae, CA: The California Academic Press.
• –––, 2000, “The Disposition Toward Critical Thinking: Its Character, Measurement, and Relationship to Critical Thinking Skill”, Informal Logic , 20(1): 61–84. [ Facione 2000 available online ]
• Facione, Peter A. and Noreen C. Facione, 1992, CCTDI: A Disposition Inventory , Millbrae, CA: The California Academic Press.
• Facione, Peter A., Noreen C. Facione, and Carol Ann F. Giancarlo, 2001, California Critical Thinking Disposition Inventory: CCTDI: Inventory Manual , Millbrae, CA: The California Academic Press.
• Facione, Peter A., Carol A. Sánchez, and Noreen C. Facione, 1994, Are College Students Disposed to Think? , Millbrae, CA: The California Academic Press. ERIC Document ED368311.
• Fisher, Alec, and Michael Scriven, 1997, Critical Thinking: Its Definition and Assessment , Norwich: Centre for Research in Critical Thinking, University of East Anglia.
• Freire, Paulo, 1968 [1970], Pedagogia do Oprimido . Translated as Pedagogy of the Oppressed , Myra Bergman Ramos (trans.), New York: Continuum, 1970.
• Glaser, Edward Maynard, 1941, An Experiment in the Development of Critical Thinking , New York: Bureau of Publications, Teachers College, Columbia University.
• Halpern, Diane F., 1998, “Teaching Critical Thinking for Transfer Across Domains: Disposition, Skills, Structure Training, and Metacognitive Monitoring”, American Psychologist , 53(4): 449–455. doi:10.1037/0003-066X.53.4.449
• –––, 2016, Manual: Halpern Critical Thinking Assessment , Mödling, Austria: Schuhfried. Available at https://drive.google.com/file/d/0BzUoP_pmwy1gdEpCR05PeW9qUzA/view ; accessed 2017 12 01.
• Hamby, Benjamin, 2014, The Virtues of Critical Thinkers , Doctoral dissertation, Philosophy, McMaster University. [ Hamby 2014 available online ]
• –––, 2015, “Willingness to Inquire: The Cardinal Critical Thinking Virtue”, in Martin Davies and Ronald Barnett (eds.), The Palgrave Handbook of Critical Thinking in Higher Education , New York: Palgrave Macmillan, pp. 77–87.
• Haynes, Ada, Elizabeth Lisic, Kevin Harris, Katie Leming, Kyle Shanks, and Barry Stein, 2015, “Using the Critical Thinking Assessment Test (CAT) as a Model for Designing Within-Course Assessments: Changing How Faculty Assess Student Learning”, Inquiry: Critical Thinking Across the Disciplines , 30(3): 38–48. doi:10.5840/inquiryct201530316
• Hitchcock, David, 2017, “Critical Thinking as an Educational Ideal”, in his On Reasoning and Argument: Essays in Informal Logic and on Critical Thinking , Dordrecht: Springer, pp. 477–497. doi:10.1007/978-3-319-53562-3_30
• hooks, bell, 1994, Teaching to Transgress: Education as the Practice of Freedom , New York and London: Routledge.
• –––, 2010, Teaching Critical Thinking: Practical Wisdom , New York and London: Routledge.
• Johnson, Ralph H., 1992, “The Problem of Defining Critical Thinking”, in Stephen P, Norris (ed.), The Generalizability of Critical Thinking , New York: Teachers College Press, pp. 38–53.
• Kahane, Howard, 1971, Logic and Contemporary Rhetoric: The Use of Reason in Everyday Life , Belmont, CA: Wadsworth.
• Kahneman, Daniel, 2011, Thinking, Fast and Slow , New York: Farrar, Straus and Giroux.
• Kenyon, Tim, and Guillaume Beaulac, 2014, “Critical Thinking Education and Debasing”, Informal Logic , 34(4): 341–363. [ Kenyon & Beaulac 2014 available online ]
• Krathwohl, David R., Benjamin S. Bloom, and Bertram B. Masia, 1964, Taxonomy of Educational Objectives, Handbook II: Affective Domain , New York: David McKay.
• Kuhn, Deanna, 1991, The Skills of Argument , New York: Cambridge University Press. doi:10.1017/CBO9780511571350
• Lipman, Matthew, 1987, “Critical Thinking–What Can It Be?”, Analytic Teaching , 8(1): 5–12. [ Lipman 1987 available online ]
• Loftus, Elizabeth F., 2017, “Eavesdropping on Memory”, Annual Review of Psychology , 68: 1–18. doi:10.1146/annurev-psych-010416-044138
• Martin, Jane Roland, 1992, “Critical Thinking for a Humane World”, in Stephen P. Norris (ed.), The Generalizability of Critical Thinking , New York: Teachers College Press, pp. 163–180.
• Mayhew, Katherine Camp, and Anna Camp Edwards, 1936, The Dewey School: The Laboratory School of the University of Chicago, 1896–1903 , New York: Appleton-Century. [ Mayhew & Edwards 1936 available online ]
• McPeck, John E., 1981, Critical Thinking and Education , New York: St. Martin’s Press.
• Nickerson, Raymond S., 1998, “Confirmation Bias: A Ubiquitous Phenomenon in Many Guises”, Review of General Psychology , 2(2): 175–220. doi:10.1037/1089-2680.2.2.175
• Nieto, Ana Maria, and Jorge Valenzuela, 2012, “A Study of the Internal Structure of Critical Thinking Dispositions”, Inquiry: Critical Thinking across the Disciplines , 27(1): 31–38. doi:10.5840/inquiryct20122713
• Norris, Stephen P., 1985, “Controlling for Background Beliefs When Developing Multiple-choice Critical Thinking Tests”, Educational Measurement: Issues and Practice , 7(3): 5–11. doi:10.1111/j.1745-3992.1988.tb00437.x
• Norris, Stephen P. and Robert H. Ennis, 1989, Evaluating Critical Thinking (The Practitioners’ Guide to Teaching Thinking Series), Pacific Grove, CA: Midwest Publications.
• Norris, Stephen P. and Ruth Elizabeth King, 1983, Test on Appraising Observations , St. John’s, NL: Institute for Educational Research and Development, Memorial University of Newfoundland.
• –––, 1984, The Design of a Critical Thinking Test on Appraising Observations , St. John’s, NL: Institute for Educational Research and Development, Memorial University of Newfoundland. ERIC Document ED260083.
• –––, 1985, Test on Appraising Observations: Manual , St. John’s, NL: Institute for Educational Research and Development, Memorial University of Newfoundland.
• –––, 1990a, Test on Appraising Observations , St. John’s, NL: Institute for Educational Research and Development, Memorial University of Newfoundland, 2nd edition.
• –––, 1990b, Test on Appraising Observations: Manual , St. John’s, NL: Institute for Educational Research and Development, Memorial University of Newfoundland, 2nd edition.
• Obama, Barack, 2014, State of the Union Address , January 28, 2014. [ Obama 2014 available online ]
• OCR [Oxford, Cambridge and RSA Examinations], 2011, AS/A Level GCE: Critical Thinking – H052, H452 , Cambridge: OCR. Information available at http://www.ocr.org.uk/qualifications/as-a-level-gce-critical-thinking-h052-h452/ ; accessed 2017 10 12.
• OECD [Organization for Economic Cooperation and Development] Centre for Educational Research and Innovation, 2018, Fostering and Assessing Students’ Creative and Critical Thinking Skills in Higher Education , Paris: OECD. Available at http://www.oecd.org/education/ceri/Fostering-and-assessing-students-creative-and-critical-thinking-skills-in-higher-education.pdf ; accessed 2018 04 22.
• Ontario Ministry of Education, 2013, The Ontario Curriculum Grades 9 to 12: Social Sciences and Humanities . Available at http://www.edu.gov.on.ca/eng/curriculum/secondary/ssciences9to122013.pdf ; accessed 2017 11 16.
• Passmore, John Arthur, 1980, The Philosophy of Teaching , London: Duckworth.
• Paul, Richard W., 1981, “Teaching Critical Thinking in the ‘Strong’ Sense: A Focus on Self-Deception, World Views, and a Dialectical Mode of Analysis”, Informal Logic , 4(2): 2–7. [ Paul 1981 available online ]
• –––, 1984, “Critical Thinking: Fundamental to Education for a Free Society”, Educational Leadership , 42(1): 4–14.
• –––, 1985, “McPeck’s Mistakes”, Informal Logic , 7(1): 35–43. [ Paul 1985 available online ]
• Paul, Richard W. and Linda Elder, 2006, The Miniature Guide to Critical Thinking: Concepts and Tools , Dillon Beach, CA: Foundation for Critical Thinking, 4th edition.
• Payette, Patricia, and Edna Ross, 2016, “Making a Campus-Wide Commitment to Critical Thinking: Insights and Promising Practices Utilizing the Paul-Elder Approach at the University of Louisville”, Inquiry: Critical Thinking Across the Disciplines , 31(1): 98–110. doi:10.5840/inquiryct20163118
• Possin, Kevin, 2008, “A Field Guide to Critical-Thinking Assessment”, Teaching Philosophy , 31(3): 201–228. doi:10.5840/teachphil200831324
• –––, 2013a, “Some Problems with the Halpern Critical Thinking Assessment (HCTA) Test”, Inquiry: Critical Thinking across the Disciplines , 28(3): 4–12. doi:10.5840/inquiryct201328313
• –––, 2013b, “A Serious Flaw in the Collegiate Learning Assessment (CLA) Test”, Informal Logic , 33(3): 390–405. [ Possin 2013b available online ]
• –––, 2014, “Critique of the Watson-Glaser Critical Thinking Appraisal Test: The More You Know, the Lower Your Score”, Informal Logic , 34(4): 393–416. [ Possin 2014 available online ]
• Rawls, John, 1971, A Theory of Justice , Cambridge, MA: Harvard University Press.
• Rousseau, Jean-Jacques, 1762, Émile , Amsterdam: Jean Néaulme.
• Scheffler, Israel, 1960, The Language of Education , Springfield, IL: Charles C. Thomas.
• Scriven, Michael, and Richard W. Paul, 1987, Defining Critical Thinking , Draft statement written for the National Council for Excellence in Critical Thinking Instruction. Available at http://www.criticalthinking.org/pages/defining-critical-thinking/766 ; accessed 2017 11 29.
• Sheffield, Clarence Burton Jr., 2018, “Promoting Critical Thinking in Higher Education: My Experiences as the Inaugural Eugene H. Fram Chair in Applied Critical Thinking at Rochester Institute of Technology”, Topoi , 37(1): 155–163. doi:10.1007/s11245-016-9392-1
• Siegel, Harvey, 1985, “McPeck, Informal Logic and the Nature of Critical Thinking”, in David Nyberg (ed.), Philosophy of Education 1985: Proceedings of the Forty-First Annual Meeting of the Philosophy of Education Society , Normal, IL: Philosophy of Education Society, pp. 61–72.
• –––, 1988, Educating Reason: Rationality, Critical Thinking, and Education , New York: Routledge.
• –––, 1999, “What (Good) Are Thinking Dispositions?”, Educational Theory , 49(2): 207–221. doi:10.1111/j.1741-5446.1999.00207.x
• Simpson, Elizabeth, 1966–67, “The Classification of Educational Objectives: Psychomotor Domain”, Illinois Teacher of Home Economics , 10(4): 110–144, ERIC document ED0103613. [ Simpson 1966–67 available online ]
• Skolverket, 2011, Curriculum for the Compulsory School, Preschool Class and the Recreation Centre , Stockholm: Ordförrådet AB. Available at http://malmo.se/download/18.29c3b78a132728ecb52800034181/pdf2687.pdf ; accessed 2017 11 16.
• Smith, B. Othanel, 1953, “The Improvement of Critical Thinking”, Progressive Education , 30(5): 129–134.
• Smith, Eugene Randolph, Ralph Winfred Tyler, and the Evaluation Staff, 1942, Appraising and Recording Student Progress , Volume III of Adventure in American Education , New York and London: Harper & Brothers.
• Splitter, Laurance J., 1987, “Educational Reform through Philosophy for Children”, Thinking: The Journal of Philosophy for Children , 7(2): 32–39. doi:10.5840/thinking1987729
• Stanovich Keith E., and Paula J. Stanovich, 2010, “A Framework for Critical Thinking, Rational Thinking, and Intelligence”, in David D. Preiss and Robert J. Sternberg (eds), Innovations in Educational Psychology: Perspectives on Learning, Teaching and Human Development , New York: Springer Publishing, pp 195–237.
• Stanovich Keith E., Richard F. West, and Maggie E. Toplak, 2011, “Intelligence and Rationality”, in Robert J. Sternberg and Scott Barry Kaufman (eds.), Cambridge Handbook of Intelligence , Cambridge: Cambridge University Press, 3rd edition, pp. 784–826. doi:10.1017/CBO9780511977244.040
• Tankersley, Karen, 2005, Literacy Strategies for Grades 4–12: Reinforcing the Threads of Reading , Alexandria, VA: Association for Supervision and Curriculum Development.
• Thayer-Bacon, Barbara J., 1992, “Is Modern Critical Thinking Theory Sexist?”, Inquiry: Critical Thinking Across the Disciplines , 10(1): 3–7. doi:10.5840/inquiryctnews199210123
• –––, 1993, “Caring and Its Relationship to Critical Thinking”, Educational Theory , 43(3): 323–340. doi:10.1111/j.1741-5446.1993.00323.x
• –––, 1995a, “Constructive Thinking: Personal Voice”, Journal of Thought , 30(1): 55–70.
• –––, 1995b, “Doubting and Believing: Both are Important for Critical Thinking”, Inquiry: Critical Thinking across the Disciplines , 15(2): 59–66. doi:10.5840/inquiryctnews199515226
• –––, 2000, Transforming Critical Thinking: Thinking Constructively , New York: Teachers College Press.
• Toulmin, Stephen Edelston, 1958, The Uses of Argument , Cambridge: Cambridge University Press.
• Turri, John, Mark Alfano, and John Greco, 2017, “Virtue Epistemology”, in Edward N. Zalta (ed.), The Stanford Encyclopedia of Philosophy (Winter 2017 Edition). URL = < https://plato.stanford.edu/archives/win2017/entries/epistemology-virtue/ >
• Warren, Karen J. 1988. “Critical Thinking and Feminism”, Informal Logic , 10(1): 31–44. [ Warren 1988 available online ]
• Watson, Goodwin, and Edward M. Glaser, 1980a, Watson-Glaser Critical Thinking Appraisal, Form A , San Antonio, TX: Psychological Corporation.
• –––, 1980b, Watson-Glaser Critical Thinking Appraisal: Forms A and B; Manual , San Antonio, TX: Psychological Corporation,
• –––, 1994, Watson-Glaser Critical Thinking Appraisal, Form B , San Antonio, TX: Psychological Corporation.
• Weinstein, Mark, 1990, “Towards a Research Agenda for Informal Logic and Critical Thinking”, Informal Logic , 12(3): 121–143. [ Weinstein 1990 available online ]
• –––, 2013, Logic, Truth and Inquiry , London: College Publications.
• Zagzebski, Linda Trinkaus, 1996, Virtues of the Mind: An Inquiry into the Nature of Virtue and the Ethical Foundations of Knowledge , Cambridge: Cambridge University Press. doi:10.1017/CBO9781139174763

How to cite this entry . Preview the PDF version of this entry at the Friends of the SEP Society . Look up this entry topic at the Internet Philosophy Ontology Project (InPhO). Enhanced bibliography for this entry at PhilPapers , with links to its database.

• Association for Informal Logic and Critical Thinking (AILACT)
• Center for Teaching Thinking (CTT)
• Critical Thinking Across the European Higher Education Curricula (CRITHINKEDU)
• Critical Thinking Definition, Instruction, and Assessment: A Rigorous Approach (criticalTHINKING.net)
• Critical Thinking Research (RAIL)
• Foundation for Critical Thinking
• Insight Assessment
• Partnership for 21st Century Learning (P21)
• The Critical Thinking Consortium
• The Nature of Critical Thinking: An Outline of Critical Thinking Dispositions and Abilities , by Robert H. Ennis

abilities | bias, implicit | children, philosophy for | civic education | decision-making capacity | Dewey, John | dispositions | education, philosophy of | epistemology: virtue | logic: informal

Copyright © 2018 by David Hitchcock < hitchckd @ mcmaster . ca >

Support SEP

Mirror sites.

View this site from another server:

• Info about mirror sites

The Stanford Encyclopedia of Philosophy is copyright © 2016 by The Metaphysics Research Lab , Center for the Study of Language and Information (CSLI), Stanford University

Library of Congress Catalog Data: ISSN 1095-5054

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Microb Biotechnol
• v.16(10); 2023 Oct
• PMC10527184

Science, method and critical thinking

Antoine danchin.

1 School of Biomedical Sciences, Li KaShing Faculty of Medicine, Hong Kong University, Pokfulam Hong Kong, China

Science is founded on a method based on critical thinking. A prerequisite for this is not only a sufficient command of language but also the comprehension of the basic concepts underlying our understanding of reality. This constraint implies an awareness of the fact that the truth of the World is not directly accessible to us, but can only be glimpsed through the construction of models designed to anticipate its behaviour. Because the relationship between models and reality rests on the interpretation of founding postulates and instantiations of their predictions (and is therefore deeply rooted in language and culture), there can be no demarcation between science and non‐science. However, critical thinking is essential to ensure that the link between models and reality is gradually made more adequate to reality, based on what has already been established, thus guaranteeing that science progresses on this basis and excluding any form of relativism.

Science understands that we only can reach the truth of the World via creation of models. The method, based on critical thinking, is embedded in the scientific method, named here the Critical Generative Method.

Before illustrating the key requirements for critical thinking, one point must be made clear from the outset: thinking involves using language, and the depth of thought is directly related to the ‘active’ vocabulary (Magyar,  1942 ) used by the thinker. A recent study of young students in France showed that a significant percentage of the population had a very limited vocabulary. This unfortunate situation is shared by many countries (Fournier & Rakocevic,  2023 ). This omnipresent fact, which precludes any attempt to improve critical thinking in the general population, is very visible in a great many texts published on social networks. This is the more concerning because science uses a vocabulary that lies well beyond that available to most people. For example, a word such as ‘metabolism’ is generally not understood. As a consequence, it is essential to agree on a minimal vocabulary before teaching paths to critical thinking. This may look trivial, but this is an essential prerequisite. Typically, words such as analysis and synthesis must be understood (and the idea of what a ‘concept’ is not widely shared). It must also be remembered that the way the scientific vocabulary kept creating neologisms in the most creative times of science was based on using the Ancient Greek language, and for a good reason: a considerable advantage of that unsaid rule is that this makes scientific objects and concepts prominent for scientists from all over the world, while precluding implicit domination by any country over the others when science is at stake (Iliopoulos et al.,  2019 ). Unfortunately, and this demonstrates how the domination of an ignorant subset of the research community gains ground, this rule is now seldom followed. This also highlights the lack of extensive scientific background of the majority of researchers: the creation of new words now follows the rule of the self‐assertive. Interestingly, the very observation that a neologism in a scientific paper does not follow the traditional rule provides us with a critical way to identify either ignorance of the scientific background of the work or the presence in the text of hidden agendas that have nothing to do with science.

In practice, the initiation of the process of critical thinking ought to begin with a step similar to the ‘due diligence’ required by investors when they study whether they will invest, or not, in a start‐up company. The first expected action should be ‘verify’, ‘verify’, ‘verify’… any statement which is used as a basis for the reasoning that follows. This asks not only for understanding what is said or written (hence the importance of language), but also for checking the origins of the statement, not only by investigating who is involved but also by checking that the historical context is well known.

Of course, nobody has complete knowledge of everything, not even anything in fact, which means that at some point people have to accept that they will base their reasoning on some kind of ‘belief’. This inevitable imperative forces future scientists asking a question about reality to resort to a set of assertions called ‘postulates’ in conventional science, that is, beliefs temporarily accepted without further discussion but understood as such. The way in which postulates are formulated is therefore key to their subsequent role in science. Similarly, the fact that they are temporary is essential to understanding their role. A fundamental feature of critical thinking is to be able to identify these postulates and then remember that they are provisional in nature. When needed this enables anyone to return to the origins of reasoning and then decide whether it is reasonable to retain the postulates or modify or even abandon them.

Here is an example illustrated with the famous greenhouse effect that allows our planet not to be a snowball (Arrhenius,  1896 ). Note that understanding this phenomenon requires a fair amount of basic physics, as well as a trait that is often forgotten: common sense. There is no doubt that carbon dioxide is a greenhouse gas (this is based on well‐established physics, which, nevertheless must be accepted as a postulate by the majority, as they would not be able to demonstrate that). However, a straightforward question arises, which is almost never asked in its proper details. There are many gases in the atmosphere, and the obvious preliminary question should be to ask what they all are, and each of their relative contribution to greenhouse effect. This is partially understood by a fraction of the general public as asking for the contribution of methane, and sometimes N 2 O and ozone. However, this is far from enough, because the gas which contributes the most to the greenhouse effect on our planet is … water vapour (about 60% of the total effect: https://www.acs.org/climatescience/climatesciencenarratives/its‐water‐vapor‐not‐the‐co2.html )! This fact is seldom highlighted. Yet it is extremely important because water is such a strange molecule. Around 300 K water can evolve rapidly to form a liquid, a gas, or a solid (ice). The transitions between these different states (with only the gas having a greenhouse effect, while water droplets in clouds have generally a cooling effect) make that water is unable to directly control the Earth's temperature. Worse, in fact, these phase transitions will amplify the fluctuations around a given temperature, generally in a feedforward way. We know very well the situation in deserts, where the night temperature is very low, with a very high temperature during the day. In fact, this explains why ‘global warming’ (i.e. shifting upwards the average temperature of the planet) is also parallel with an amplification of weather extremes. It is quite remarkable that the role of water, which is well established, does not belong to popular knowledge. Standard ‘due diligence’ would have made this knowledge widely shared.

Another straightforward example of the need to have a clear knowledge of the thought of our predecessors is illustrated in the following. When we see expressions such as ‘paradigm change’, ‘change of paradigm’, ‘paradigm shift’ or ‘shift of paradigm’ (12,424 articles listed in PubMed as of June 26, 2023), we should be aware that the subject of interest of these articles has nothing to do with a paradigm shift, simply because such a change in paradigm is extremely rare, being distributed over centuries, at best (Kuhn,  1962 ). Worse, the use of the word implies that the authors of the works have most probably never read Thomas Kuhn's work, and are merely using a fashionable hearsay. As a consequence, critical thinking should lead authentic scientists to put aside all these works before further developing their investigation (Figure  1 ).

Number of articles identified in the PubMed database with the keywords ‘paradigm change’ or ‘change of paradigm’ or ‘paradigm shift’ or ‘shift of paradigm’. A very low number of articles, generally reporting information consistent with the Kuhnian view of scientific revolutions is published before 1993. Between 1993 and 2000 a looser view of the term paradigm begins to be used in a metaphoric way. Since then the word has become fashionable while losing entirely its original meaning, while carrying over lack of epistemological knowledge. This example of common behaviour illustrates the decadence of contemporary science.

This being understood, we can now explore the general way science proceeds. This has been previously discussed at a conference meant to explain the scientific method to an audience of Chinese philosophers, anthropologists and scientists and held at Sun Yat Sen (Zhong Shan) University in Canton (Guangzhou) in 1991. This discussion is expanded in The Delphic Boat (Danchin,  2002 ). For a variety of reasons, it would be useful to anticipate the future of our world. This raises an unlimited number of questions and the aim of the scientific method is to try and answer those. The way in which questions emerge is a subject in itself. This is not addressed here, but this should also be the subject of critical thinking (Yanai & Lercher,  2019 ).

The basis for scientific investigation accepts that, while the truth of the world exists in itself (‘relativism’ is foreign to scientific knowledge, as science keeps building up its progresses on previous knowledge, even when changing its paradigms), we can only access it through the mediation of a representation. This has been extensively debated at the time, 2500 years ago, when science and philosophy designed the common endeavour meant to generate knowledge (Frank,  1952 ). It was then apparent that we cannot escape this omnipresent limitation of human rationality, as Xenophanes of Colophon explicitly stated at the time [discussed in Popper,  1968 ]. This limitation comes from an inevitable constraint: contrary to what many keep saying, data do not speak . Reality must be interpreted within the frame of a particular representation that critical thinking aims at making visible. A sentence that we all forget to reject, such as ‘results show…’ is meaningless: results are interpreted as meaning this or that.

Accepting this limitation is a difficult attribute of scientific judgement. Yet the quality of thought progresses as the understanding of this constraint becomes more effective: to answer our questions we have to build models of the world, and be satisfied with this perspective. It is through our knowledge of the world's models that we are able to explore and act upon it. We can even become the creators of new behaviours of reality, including new artefacts such as a laser beam, a physics‐based device that is unlikely to exist in the universe except in places where agents with an ability similar to ours would exist. Indeed, to create models is to introduce a distance, a mediation through some kind of symbolic coding (via the construction of a model), between ourselves and the world. It is worth pointing out that this feature highlights how science builds its strength from its very radical weakness, which is to know that it is incapable, in principle, of attaining truth. Furthermore and fortunately, we do not have to begin with a tabula rasa . Science keeps progressing. The ideas and the models we have received from our fathers form the basis of our first representation of the world. The critical question we all face, then, is: how well these models match up with reality? how do they fare in answering our questions?

Many, over time, think they achieve ultimate understanding of reality (or force others to think so) and abide by the knowledge reached at the time, precluding any progress. A few persist in asking questions about what remains enigmatic in the way things behave. Until fairly recently (and this can still be seen in the fashion for ‘organic’ things, or the idea, similar to that of the animating ‘phlogiston’ of the Middle Ages, that things spontaneously organize themselves in certain elusive circumstances usually represented by fancy mathematical models), things were thought to combine four elements: fire, air, water, and earth, in a variety of proportions and combinations. In China, wood, a fifth element that had some link to life was added to the list. Later on, the world was assumed to result from the combination of 10 categories (Danchin,  2009 ). It took time to develop a physic of reality involving space, time, mass, and energy. What this means is still far from fully understood. How, in our times when the successes of the applications of science are so prominent, is it still possible to question the generally accepted knowledge, to progress in the construction of a new representation of reality?

This is where critical thinking comes in. The first step must be to try and simplify the problem, to abstract from the blurred set of inherited ideas a few foundational concepts that will not immediately be called into question, at least as a preliminary stage of investigation. We begin by isolating a phenomenon whose apparent clarity contrasts with its environment. A key point in the process is to be aware of the fact that the links between correlation and causation are not trivial (Altman & Krzywinski,  2015 ). The confusion between both properties results probably in the major anti‐science behaviour that prevents the development of knowledge. In our time, a better understanding of what causality is is essential to understand the present development of Artificial Intelligence (Schölkopf et al.,  2021 ) as this is directly linked to the process of rational decision (Simon,  1996 ).

Subsequently, a set of undisputed rules, phenomenological criteria and postulates is associated with the phenomenon. It constitutes temporarily the founding dogma of the theory, made up of the phenomenon of interest, the postulates, the model and the conditions and results of its application to reality. This epistemological attitude can legitimately be described as ‘dogmatic’ and it remains unchanged for a long time in the progression of scientific knowledge. This is well illustrated by the fact that the word ‘dogma’, a religious word par excellence, is often misused when referring to a scientific theory. Many still refer, for example, to the expression ‘the central dogma of molecular biology’ to describe the rules for rewriting the genetic program from DNA to RNA and then proteins (Crick,  1970 ). Of course, critical thinking understands that this is no dogma, and variations on the theme are omnipresent, as seen for instance in the role of the enzyme reverse transcriptase which allows RNA to be rewritten into a DNA sequence.

Yet, whereas isolating postulates is an important step, it does not permit one to give explanations or predictions. To go further, one must therefore initiate a constructive process. The essential step there will be the constitution of a model (or in weaker instances, a simulation) of the phenomenon (Figure  2 ).

The Critical Generative Method. Science is based on the premises that while we can look for the truth of reality, this is in principle impossible. The only way out is to build up models of reality (‘realistic models’) and find ways to compare their outcome to the behaviour of reality [see an explicit example for genome sequences in Hénaut et al.,  1996 ]. The ultimate model is mathematical model, but this is rarely possible to achieve. Other models are based on simulations, that is, models that mimic the behaviour of reality without trying to propose an explanation of that behaviour. A primitive attempt of this endeavour is illustrated when people use figurines that they manipulate hoping that this will anticipate the behaviour of their environment (e.g. ‘voodoo’). This is also frequent in borderline science (Friedman & Brown,  2018 ).

To this aim, the postulates will be interpreted in the form of entities (concrete or abstract) or of relationships between entities, which will be further manipulated by an independent set of processes. The perfect stage, generally considered as the ultimate one, associates the manipulation of abstract entities, interpreting postulates into axioms and definitions, manipulable according to the rules of logic. In the construction of a model, one assists therefore first to a process of abstraction , which allows one to go from the postulates to the axioms. Quite often, however, one will not be able to axiomatize the postulates. It will only be possible to represent them using analogies involving the founding elements of another phenomenon, better known and considered as analogous. One could also change the scales of a phenomenon (this is the case when one uses mock‐ups as models). In these families of approaches, the model is considered as a simulation. For example, it will be possible to simulate an electromagnetic phenomenon using a hydrodynamic phenomenon [for a general example in physics (Vives & Ricou,  1985 )]. In recent times the simulation is generally performed numerically, using (super)computers [e.g. the mesoscopic scale typical for cells (Huber & McCammon,  2019 )]. While all these approaches have important implications in terms of diagnostic, for example, they are generally purely phenomenological and descriptive. This is understood by critical thinking, despite the general tendency to mistake the mimic for what it represents. Recent artificial intelligence approaches that use ‘neuronal networks’ are not, at least for the time being, models of the brain.

However useful and effective, the simulation of a phenomenon is clearly an admission of failure. A simulation represents behaviour that conforms to reality, but does not explain it. Yet science aims to do more than simply represent a phenomenon; it aims to anticipate what will happen in the near and distant future. To get closer to the truth, we need to understand and explain, that is, reduce the representation to simpler elementary principles (and as few as possible) in order to escape the omnipresent anecdotes that parasitize our vision of the future. In the case of the study of genomes, for example, this will lead us to question their origin and evolution. It will also require us to understand the formal nature of the control processes (of which feedback, e.g. is one) that they encode. As soon as possible, therefore, we would like to translate the postulates that enabled the model's construction into well‐formed statements that will constitute the axioms and definitions of an explanatory model. At a later stage, the axioms and definitions will be linked together to create a demonstration leading to a theorem or, more often than not, a simple conjecture.

When based on mathematics, the model is made up of its axioms and definitions, and the demonstrations and theorems it conveys. It is an entirely autonomous entity, which can only be justified by its own rules. To be valid, it must necessarily be true according to the rules of mathematical logic. So here we have an essential truth criterion, but one that can say nothing about the truth of the phenomenon. A key feature of critical thinking is the understanding that the truth of the model is not the truth of the phenomenon. The amalgam of these two truths, common in magical thinking, often results in the model (identified as a portion of the world) being given a sacred value, and changes the role of the scientist to that of a priest.

Having started from the phenomenon of interest to build the model, we now need to return from the model to the real world. A process symmetrical to that which provided the basis for the model, an instantiation of the conclusions summarized in the theorem, is now required. This can take the form of predictions, observations or experiments, for which at least two types can be broadly identified. These predictions are either existential (the object, process, or relations predicted by the instantiation of the theorem must be discovered), or phenomenological, and therefore subject to verification and deniability. An experimental set‐up will have to be constructed to explore what has been predicted by the instantiations of the model theorems and to support or falsify the predictions. In the case of hypotheses based on genes, for example, this will lead to synthetic biology constructs experiments (Danchin & Huang,  2023 ), where genes are replaced by counterparts, even made of atoms that differ from the canonical ones.

The reaction of reality, either to simple (passive) observation or to the observation of phenomena triggered by the experiments, will validate the model and measure the degree of adequacy between the model and the reality. This follows a constructive path when the model's shortcomings are identified, and when are discovered the predicted new objects that must now be included in further models of reality. This process imposes the falsification of certain instantiated conclusions that have been falsified as a major driving force for the progression of the model in line with reality. This part of the thought process is essential to escape infinite regression in a series of confirmation experiments, one after the other, ad infinitum. Identifying this type of situation, based on the understanding that the behaviour of the model is not reality but an interpretation of reality, is essential to promote critical thinking.

It must also be stressed that, of course, the weight of the proof of the model's adequacy to reality belongs to the authors of the model. It would be both contrary to the simplest rules of logic (the proof of non‐existence is only possible for finite sets), and also totally inefficient, as well as sterile, to produce an unfalsifiable model. This is indeed a critical way to identify the many pretenders who plague science. They are easy to recognize since they identify themselves precisely by the fact that they ask the others: ‘repeat my experiments again and show me that they are wrong!’. Unfortunately, this old conjuring trick is still well spread, especially in a world dominated by mass media looking for scoops, not for truth.

When certain predictions of the model are not verified, critical thinking forces us to study its relationship with reality, and we must proceed in reverse, following the path that led to these inadequate predictions (Figure  2 ). In this reverse process, we go backwards until we reach the postulates on which the model was built, at which point we modify, refine and, if necessary, change them. The explanatory power of the model will increase each time we can reduce the number of postulates on which it is built. This is another way of developing critical thinking skills: the more factors there are underlying an explanation, the less reliable the model. As an example in molecular biology, the selective model used by Monod and coworkers to account for allostery (Monod et al.,  1965 ) used far fewer adjustable parameters than Koshland's induced‐fit model (Koshland,  1959 ).

In real‐life situations, this reverse path is long and difficult to build. The model's resistance to change is quickly organized, if only because, lacking critical thinking, its creators cannot help thinking that, in fact, the model manifests, rather than represents, the truth of the world. It is only natural, then, to think that the lack of predictive power is primarily due not to the model's inadequacy, but to the inappropriate way in which its broad conclusions have been instantiated. This corresponds, in effect, to a stage where formal terms have been interpreted in terms of real behaviour, which involves a great deal of fine‐tuning. Because it is inherently difficult to identify the inadequacy of the model or its links with the phenomenon of interest, it is often the case that a model persists, sometimes for a very long time, despite numerous signs of imperfection.

During this critical process, the very nature of the model is questioned, and its construction, the meaning it represents, is clarified and refined under the constraint of contradictions. The very terms of the instantiations of predictions, or of the abstraction of founding postulates, are made finer and finer. This is why this dogmatic stage plays such an essential role: a model that was too inadequate would have been quickly discarded, and would not have been able to generate and advance knowledge, whereas a succession of improvements leads to an ever finer understanding, and hence better representation of the phenomenon of interest. Then comes a time when the very axioms on which the model is based are called into question, and when the most recent abstractions made from the initial postulates lead to them being called into question. This is of course very rare and difficult, and is the source of those genuine scientific revolutions, those paradigm shifts (to use Thomas Kuhn's word), from which new models are born, develop and die, based on assumptions that differ profoundly from those of their predecessors. This manifests an ultimate, but extremely rare, success of critical thinking.

A final comment. Karl Popper in his Logik der Forschung ( The Logic of Scientific Discovery ) tried to show that there was a demarcation separating science from non‐science (Keuth and Popper,  1934 ). This resulted from the implementation of a refutation process that he named falsification that was sufficient to tell the observer that a model was failing. However, as displayed in Figure  2 , refutation does not work directly on the model of interest, but on the interpretation of its predictions . This means that while science is associated with a method, its implementation in practice is variable, and its borders fuzzy. In fact, trying to match models with reality allows us to progress by producing better adequacy with reality (Putnam,  1991 ). Nevertheless, because the separation between models and reality rests on interpretations (processes rooted in culture and language), establishing an explicit demarcation is impossible. This intrinsic difficulty, which is associated with a property that we could name ‘context associated with a research programme’ (Lakatos,  1976 , 1978 ), shows that the demarcation between science and non‐science is dominated by a particular currency of reality, which we have to consider under the name information , using the word with all its common (and accordingly fuzzy) connotations, and which operates in addition to the standard categories, mass, energy, space and time.

The first attempts to solve contradictions between model predictions and observed phenomena do not immediately discard the model, as Popper would have it. The common practice is for the authors of a model to re‐interpret the instantiation process that has coupled the theorem to reality. Typically: ‘exceptions make the rule’, or ‘this is not exactly what we meant, we need to focus more on this or that feature’, etc. This polishing step is essential, it allows the frontiers of the model and its associated phenomena to be defined as accurately as possible. It marks the moment when technically arid efforts such as defining a proper nomenclature, a database data schema, etc., have a central role. In contrast to the hopes of Popper, who sought for a principle telling us whether a particular creation of knowledge can be named Science, using refutation as principle, there is no ultimate demarcation between science and non‐science. Then comes a time when, despite all efforts to reconcile predictions and phenomena, the inadequacy between the model and reality becomes insoluble. Assuming no mistake in the demonstration (within the model), this contradiction implies that we need to reconsider the axioms and definitions upon which the model has been constructed. This is the time when critical thinking becomes imperative.

AUTHOR CONTRIBUTIONS

Antoine Danchin: Conceptualization (lead); writing – original draft (lead); writing – review and editing (lead).

CONFLICT OF INTEREST STATEMENT

This work belongs to efforts pertaining to epistemological thinking and does not imply any conflict of interest.

ACKNOWLEDGEMENTS

The general outline of the Critical Generative Method presented at Zhong Shan University in Guangzhou, China in 1991, and discussed over the years in the Stanislas Noria seminar ( https://www.normalesup.org/~adanchin/causeries/causeries‐en.html ) has previously been published in Danchin ( 2009 ) and in a variety of texts. Because scientific knowledge results from accumulation of knowledge painstakingly created by the generations that preceded us, the present text purposely makes reference to work which is seldom cited at a moment when scientists become amnesiac and tend to reinvent the wheel.

Danchin, A. (2023) Science, method and critical thinking . Microbial Biotechnology , 16 , 1888–1894. Available from: 10.1111/1751-7915.14315 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]

• Altman, N. & Krzywinski, M. (2015) Association, correlation and causation . Nature Methods , 12 , 899–900. [ PubMed ] [ Google Scholar ]
• Arrhenius, S. (1896) XXXI. On the influence of carbonic acid in the air upon the temperature of the ground . The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science , 41 , 237–276. [ Google Scholar ]
• Crick, F. (1970) Central dogma of molecular biology . Nature , 227 , 561–563. [ PubMed ] [ Google Scholar ]
• Danchin, A. (2002) The Delphic boat: what genomes tell us . Cambridge, MA: Harvard University Press. [ Google Scholar ]
• Danchin, A. (2009) Information of the chassis and information of the program in synthetic cells . Systems and Synthetic Biology , 3 , 125–134. [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Danchin, A. & Huang, J.D. (2023) synbio 2.0, a new era for synthetic life: neglected essential functions for resilience . Environmental Microbiology , 25 , 64–78. [ PubMed ] [ Google Scholar ]
• Fournier, Y. & Rakocevic, R. (2023) Objectifs éducation et formation 2030 de l'UE: où en est la France en 2023? Note d'Information , 23 , 20. [ Google Scholar ]
• Frank, P. (1952) The origin of the separation between science and philosophy . Proceedings of the American Academy of Arts and Sciences , 80 , 115–139. [ Google Scholar ]
• Friedman, H.L. & Brown, N.J.L. (2018) Implications of debunking the “critical positivity ratio” for humanistic psychology: introduction to special issue . Journal of Humanistic Psychology , 58 , 239–261. [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Hénaut, A. , Rouxel, T. , Gleizes, A. , Moszer, I. & Danchin, A. (1996) Uneven distribution of GATC motifs in the Escherichia coli chromosome, its plasmids and its phages . Journal of Molecular Biology , 257 , 574–585. [ PubMed ] [ Google Scholar ]
• Huber, G.A. & McCammon, J.A. (2019) Brownian dynamics simulations of biological molecules . Trends in Chemistry , 1 , 727–738. [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Iliopoulos, I. , Ananiadou, S. , Danchin, A. , Ioannidis, J.P. , Katsikis, P.D. , Ouzounis, C.A. et al. (2019) Hypothesis, analysis and synthesis, it's all Greek to me . eLife , 8 , e43514. [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Koshland, D.E. (1959) Enzyme flexibility and enzyme action . Journal of Cellular and Comparative Physiology , 54 , 245–258. [ PubMed ] [ Google Scholar ]
• Kuhn, T.S. (1962) The structure of scientific revolutions , 3rd edition. Chicago, IL: University of Chicago Press. [ Google Scholar ]
• Lakatos, I. (1976) Proofs and refutations: the logic of mathematical discovery . Cambridge: Cambridge University Press. [ Google Scholar ]
• Lakatos, I. (1978) The methodology of scientific research programmes . Cambridge: Cambridge University Press. [ Google Scholar ]
• Magyar, F. (1942) The compilation of an active vocabulary . The German Quarterly , 15 , 214–217. [ Google Scholar ]
• Monod, J. , Wyman, J. & Changeux, J.P. (1965) On the nature of allosteric transitions: a plausible model . Journal of Molecular Biology , 12 , 88–118. [ PubMed ] [ Google Scholar ]
• Popper, K.R. (1934) Logik der Forschung, 4., bearbeitete Auflage . Berlin: Akademie Verlag. Translation prepared by the author (1959): The logic of scientific discovery . London: Hutchinson & Co. [ Google Scholar ]
• Popper, K.R. (1968) Conjectures and refutations: the growth of scientific knowledge . London; New York, NY: Routledge. [ Google Scholar ]
• Putnam, H. (1991) Representation and reality . Cambridge, MA: MIT Press. [ Google Scholar ]
• Schölkopf, B. , Locatello, F. , Bauer, S. , Ke, N.R. , Kalchbrenner, N. , Goyal, A. et al. (2021) Towards causal representation learning . arXiv , 2021 , 11107. [ Google Scholar ]
• Simon, H.A. (1996) The sciences of the artificial , 3rd edition. Cambridge, MA: MIT Press. [ Google Scholar ]
• Vives, C. & Ricou, R. (1985) Experimental study of continuous electromagnetic casting of aluminum alloys . Metallurgical Transactions B , 16 , 377–384. [ Google Scholar ]
• Yanai, I. & Lercher, M. (2019) What is the question? Genome Biology , 20 , 1314–1315. [ PMC free article ] [ PubMed ] [ Google Scholar ]