First 50 of 200 questions. Each one lists the choices, the correct answer, and an explanation. The checker at the top of this page saves progress in this browser when it is available.
Continue in the practice tool above to load more questions, 50 at a time.
Question 1The Foundations of Scientific Thinking
Which statement best describes the role of a hypothesis in scientific inquiry?
- It is a personal opinion that requires no evidence.
- It is a testable proposed explanation that generates predictions. Correct answer.
- It is a final conclusion that cannot be revised.
- It is an observation recorded without interpretation.
Explanation
A hypothesis is a proposed explanation framed so that it can be tested against evidence, usually by deriving predictions from it. Because it is provisional, it can be supported, refined or rejected as new data appear. This testability is what separates it from opinion or fixed conclusion.
Question 2The Foundations of Scientific Thinking
A controlled experiment is designed mainly to do which of the following?
- Isolate the effect of one variable by holding others constant Correct answer.
- Increase the sample size until results are significant
- Replicate the study in a different laboratory
- Remove all measurement error from the data
Explanation
In a controlled experiment the independent variable is manipulated while other relevant factors are held constant, so any change in the dependent variable can be attributed to that manipulation. This isolation of a single variable is the defining purpose of control. It does not by itself guarantee larger samples or eliminate measurement error.
Question 3The Foundations of Scientific Thinking
In an experiment testing fertiliser effects on plant growth, which is the independent variable?
- The height each plant reaches
- The amount of fertiliser applied Correct answer.
- The temperature of the greenhouse
- The number of plants measured
Explanation
The independent variable is the factor deliberately manipulated by the researcher, here the amount of fertiliser applied. Plant height is the dependent variable because it is measured as the response. Temperature and plant number are controlled or sample variables, not the manipulated factor.
Question 4The Foundations of Scientific Thinking
Which practice most directly improves the reliability of a scientific measurement?
- Describing the method in greater detail
- Reporting results to more decimal places
- Choosing a more interesting research question
- Repeating the measurement several times Correct answer.
Explanation
Reliability concerns consistency, so repeating measurements and averaging them reduces the influence of random variation and gives a more dependable value. Extra decimal places do not improve the underlying precision of the instrument. Detailed methods aid reproducibility but do not themselves make repeated values consistent.
Question 5The Foundations of Scientific Thinking
A scientist reads a claim that a new supplement boosts memory. Which feature of the evidence would most strengthen the claim?
- The claim was tested in a controlled trial with a placebo group Correct answer.
- The claim is supported by a testimonial from an athlete
- The claim is repeated by several social media accounts
- The claim appears on a popular health website
Explanation
A controlled trial with a placebo group allows the effect of the supplement to be separated from expectation and other influences. This design provides evidence that can be evaluated independently of personal belief. Testimonials and repetition are anecdotes or popularity, not controlled evidence.
Question 6The Foundations of Scientific Thinking
What is the main purpose of peer review before publication?
- To guarantee that the results will be replicated
- To ensure the authors are paid for their research
- To assess the quality and validity of the work Correct answer.
- To make the findings easier for the public to read
Explanation
Peer review subjects a manuscript to scrutiny by independent experts who judge the soundness of methods, analysis and interpretation. It is a quality-control filter, not a guarantee of truth. It does not promise replication, public accessibility or payment.
Question 7The Foundations of Scientific Thinking
A result is described as statistically significant. What does this most accurately mean?
- The result is unlikely to have arisen by chance alone under the null hypothesis Correct answer.
- The experiment was performed without any errors
- The result has been confirmed by independent replication
- The result is large enough to be important in practice
Explanation
Statistical significance indicates that the observed result would be unlikely if the null hypothesis were true, given the chosen threshold. It is a statement about probability under a model, not about practical importance. Nor does it certify error-free work or independent confirmation.
Question 8The Foundations of Scientific Thinking
Which example best illustrates a pseudoscientific claim?
- A theory that is revised when new evidence emerges
- A hypothesis that is later rejected after careful testing
- A model that makes predictions later confirmed by new data
- A claim that cannot be tested and is defended by dismissing all contrary evidence Correct answer.
Explanation
Pseudoscientific claims typically present themselves as scientific while remaining untestable or immune to refutation, often by dismissing contrary evidence. Genuine science invites testing and revision. Rejected hypotheses, confirmed models and revised theories are normal features of scientific practice.
Question 9The Foundations of Scientific Thinking
A student measures the boiling point of a liquid five times and obtains values tightly clustered around 82 degrees Celsius, but the accepted value is 78 degrees Celsius. Which description fits these results?
- Reliable but not valid Correct answer.
- Valid but not reliable
- Both reliable and valid
- Neither reliable nor valid
Explanation
The readings are consistent with one another, so they are reliable, but they cluster away from the accepted value, so they lack validity. Reliability concerns consistency, whereas validity concerns closeness to the true value. Systematic error can produce this pattern of high precision with poor accuracy.
Question 10The Foundations of Scientific Thinking
A researcher finds that students who eat breakfast score higher on a test. Which is the most reasonable conclusion?
- There is an association between breakfast and test scores Correct answer.
- Test scores cause students to eat breakfast
- No relationship exists between the variables
- Eating breakfast causes higher test scores
Explanation
An observational association does not by itself establish causation, because other factors such as sleep, income or study habits may influence both variables. The cautious conclusion is that an association was observed. Establishing causation would require controlled or well-designed longitudinal evidence.
Question 11The Foundations of Scientific Thinking
Why is a control group included in a clinical trial of a new drug?
- To provide a baseline for comparison without the active treatment Correct answer.
- To increase the total number of participants
- To test whether the drug is safe at any dose
- To ensure the drug is given to everyone who needs it
Explanation
A control group provides a comparison baseline, often receiving a placebo or standard treatment, so the effect of the new drug can be distinguished from other influences. Without it, changes could be attributed to expectation, natural recovery or time. Controls do not increase participant numbers or establish safety on their own.
Question 12The Foundations of Scientific Thinking
A team reports a finding with a p-value of 0.04 using a threshold of 0.05. They then repeat the analysis on many subgroups until one shows p = 0.001. What is the main concern with the subgroup result?
- The sample size was too small in the original study
- Multiple comparisons increase the chance of a false positive Correct answer.
- Subgroup analysis is never scientifically useful
- The original p-value was calculated incorrectly
Explanation
Testing many subgroups raises the probability that at least one will appear significant by chance alone, a problem of multiple comparisons. The striking subgroup p-value may therefore be an artefact of repeated testing. Adjusting for multiplicity or pre-specifying subgroups addresses this concern.
Question 13The Foundations of Scientific Thinking
Which change would most improve the validity of an experiment measuring reaction time using a stopwatch?
- Testing all participants in the same room
- Asking each participant to perform the task once
- Using a digital timing device that removes human reaction lag Correct answer.
- Recording times to three decimal places
Explanation
Validity concerns whether the measurement actually reflects the intended quantity, here true reaction time. A stopwatch includes the experimenter's own reaction lag, a systematic error, so replacing it with an automated timer improves validity. More decimal places or a single trial do not correct that systematic bias.
Question 14The Foundations of Scientific Thinking
A scientific model is best understood as which of the following?
- A substitute for collecting data
- A permanent description of reality
- A guess made without any evidence
- A simplified representation used to explain and predict Correct answer.
Explanation
Models are deliberate simplifications that capture key features of a system so that it can be explained and predictions made. They are judged by their usefulness and predictive power rather than by being exact copies of reality. Models are revised as evidence accumulates and do not replace data collection.
Question 15The Foundations of Scientific Thinking
Two researchers disagree about a claim. Which response best reflects scientific thinking?
- Defer to whichever view is more popular
- Reject the claim because it is unfamiliar
- Examine the evidence and methods behind each position Correct answer.
- Accept the claim because the senior researcher supports it
Explanation
Scientific thinking evaluates claims on the strength of evidence and the soundness of methods rather than on authority, familiarity or popularity. Examining the evidence allows disagreements to be resolved on defensible grounds. Appeals to seniority or consensus alone are not sufficient justification.
Question 16The Foundations of Scientific Thinking
A study finds a strong negative correlation between hours of television watched and exam performance. Which explanation is most consistent with this finding?
- The correlation must be a calculation error
- Exam performance determines television habits
- Watching television directly reduces intelligence
- A third factor such as study time may influence both variables Correct answer.
Explanation
A negative correlation shows that the variables move in opposite directions, but it does not identify the cause. A confounding variable such as study time could independently affect both television watching and exam performance. Inferring direct causation or dismissing the data are both unjustified.
Question 17The Foundations of Scientific Thinking
Which statement about a scientific theory is most accurate?
- It is a proven fact that can never change
- It is a tentative guess awaiting confirmation
- It is less reliable than a single experiment
- It is a well-supported explanatory framework built from repeated evidence Correct answer.
Explanation
In science a theory is a broad explanatory framework supported by extensive evidence and able to generate predictions. It is stronger than a single experiment or hypothesis, yet remains open to revision. The everyday meaning of theory as a mere guess does not apply.
Question 18The Foundations of Scientific Thinking
An experiment tests whether a fertiliser increases yield, using one field with fertiliser and an adjacent field without. Which factor most threatens the validity of the conclusion?
- The two fields may differ in soil quality and sunlight Correct answer.
- The fertiliser was applied in spring
- The experiment was conducted outdoors
- The yield was measured in kilograms
Explanation
If the two fields differ systematically in soil, light or drainage, those differences are confounded with the fertiliser treatment. Any yield difference could then be caused by the field conditions rather than the fertiliser. Randomly assigning plots within a uniform area would reduce this threat.
Question 19The Foundations of Scientific Thinking
Why do scientists prefer to publish methods in enough detail for others to repeat the study?
- It allows findings to be tested and confirmed independently Correct answer.
- It guarantees the results will be correct
- It removes the need for statistical analysis
- It prevents other scientists from criticising the work
Explanation
Detailed methods allow other researchers to repeat the study, which is how findings are independently tested and either supported or challenged. Reproducibility is central to scientific self-correction. It does not guarantee correctness or shield work from criticism, and analysis remains necessary.
Question 20The Foundations of Scientific Thinking
A newspaper reports that a chemical 'causes cancer' based on a study of 20 mice. Which criticism is most appropriate?
- The study should have used no control group
- Mice are irrelevant to all biological research
- The sample is small and animal results may not transfer to humans Correct answer.
- Newspapers should never report scientific findings
Explanation
A small sample limits the strength of any conclusion, and findings in mice require caution before being extended to humans. Responsible reporting should convey this uncertainty rather than state causation outright. Animal models remain valuable, and controls are essential rather than optional.
Question 21The Foundations of Scientific Thinking
A researcher claims an effect is real because the result had p = 0.049, just under the 0.05 threshold. Which reasoning is most sound?
- Statistical significance proves the effect size is large
- The effect is certainly real because p is below 0.05
- The threshold should be lowered until the result is clearly significant
- A result near the threshold is weak evidence and should be interpreted cautiously Correct answer.
Explanation
A p-value close to the decision threshold provides only marginal evidence, since small changes in the data could move it across the line. Sound interpretation considers effect size, confidence intervals and replication rather than treating the threshold as a sharp boundary. Significance also says nothing directly about effect size.
Question 22The Foundations of Scientific Thinking
A hypothesis is described as falsifiable. Which situation best demonstrates this property?
- The hypothesis is supported by every observation made
- The hypothesis is accepted by most scientists
- The hypothesis cannot be tested with current technology
- The hypothesis specifies an observation that would show it to be false Correct answer.
Explanation
Falsifiability means the hypothesis rules out certain observations, so that specific evidence could show it to be wrong. This makes it genuinely testable. Universal support, majority acceptance or current technological limits do not establish falsifiability.
Question 23The Foundations of Scientific Thinking
Two studies investigate the same question. Study A uses a large random sample but measures the outcome indirectly; Study B uses a small convenience sample but measures the outcome directly and precisely. Which evaluation is most defensible?
- Both studies are worthless because neither is perfect
- Study B is superior because its measurement is direct
- Study A is superior because its sample is larger
- Each study has strengths and weaknesses that affect different aspects of validity Correct answer.
Explanation
Study A has stronger external validity through random sampling but weaker construct validity from indirect measurement, while Study B shows the reverse pattern. Judging overall quality requires weighing these trade-offs against the research aim. Neither study is simply superior or worthless.
Question 24The Foundations of Scientific Thinking
A phenomenon is observed that current theory cannot explain. What is the most scientifically appropriate response?
- Modify the observation until it fits the theory
- Treat the anomaly as a reason to investigate and possibly revise the theory Correct answer.
- Ignore the anomaly because the theory is well established
- Declare the theory false immediately
Explanation
Anomalies that resist explanation can motivate investigation and, if robust, drive revision of accepted theory. Science treats well-supported theory as provisional rather than absolute. Altering data to fit expectations is misconduct, while ignoring or instantly discarding theory are both extremes.
Question 25The Foundations of Scientific Thinking
A meta-analysis combines many studies and finds a small overall effect, but several included studies had publication bias. How should the result be interpreted?
- Publication bias improves the accuracy of a meta-analysis
- The overall effect is likely overstated and should be treated cautiously Correct answer.
- The small effect proves there is no real effect
- The meta-analysis is invalid and should be discarded entirely
Explanation
Publication bias means studies with significant or positive results are more likely to be published, so a meta-analysis drawing on the literature may overestimate the true effect. The finding should therefore be interpreted cautiously, ideally with bias-adjusted methods. Bias does not make the analysis worthless, nor does a small effect mean no effect.
Question 26The Foundations of Scientific Thinking
Which practice most directly allows other scientists to evaluate the reliability of a reported measurement?
- Presenting the result at a large international conference
- Reporting the measurement together with its estimated uncertainty Correct answer.
- Publishing the result in a journal with a high impact factor
- Repeating the experiment until the same number appears twice
Explanation
A measurement is only meaningful when accompanied by an estimate of its uncertainty, because every instrument and procedure introduces error. Reporting uncertainty lets readers judge how much confidence the value deserves and whether differences between results are meaningful.
Question 27The Foundations of Scientific Thinking
A scientist writes that a hypothesis must be testable against evidence. Which feature of the hypothesis does this requirement most directly support?
- Its capacity to generate predictions that could fail Correct answer.
- Its consistency with the researcher's earlier publications
- Its approval by a funding committee before the study
- Its ability to be expressed in mathematical notation
Explanation
Testability means the hypothesis yields predictions that observations could contradict, which is what allows evidence to discriminate between competing ideas. A claim that cannot fail under any conceivable observation cannot be tested scientifically.
Question 28The Foundations of Scientific Thinking
In scientific reasoning, what distinguishes an observation from an inference?
- Observations are always numerical, whereas inferences are always verbal
- Observations are provisional, whereas inferences are permanent conclusions
- Observations are direct records of evidence, whereas inferences are interpretations drawn from evidence Correct answer.
- Observations are made by instruments, whereas inferences are made by people
Explanation
Observations record what was detected through senses or instruments, while inferences are conclusions reasoned from those records. The same observation can support different inferences, which is why the distinction matters when evaluating claims.
Question 29The Foundations of Scientific Thinking
Which statement best describes the role of a hypothesis in an investigation?
- It is a proposed explanation that guides what data will be collected Correct answer.
- It guarantees the outcome the researcher expects to record
- It replaces the need for a control condition in the design
- It is a summary written after the data have been fully analysed
Explanation
A hypothesis is a tentative explanation or prediction that directs the design of an investigation and specifies what evidence is relevant. It is formulated before data collection and is later evaluated against the results.
Question 30The Foundations of Scientific Thinking
Why is random assignment of participants important in an experiment comparing two treatments?
- It increases the total number of participants available
- It removes the need to measure outcomes objectively
- It balances known and unknown confounding factors across the groups Correct answer.
- It ensures that every participant receives the more effective treatment
Explanation
Random assignment distributes characteristics, including ones the researchers have not measured, roughly evenly between groups. This reduces the chance that an observed difference reflects pre-existing differences rather than the treatment.
Question 31The Foundations of Scientific Thinking
A class debates whether a claim about a herbal remedy should be accepted. Which action best reflects the principle of scepticism in science?
- Accepting the claim because it has been repeated by many people
- Requesting evidence and considering whether it can be independently checked Correct answer.
- Adopting the claim provisionally because it seems harmless
- Rejecting the claim immediately because it is unfamiliar
Explanation
Scientific scepticism means withholding acceptance until claims are supported by evidence that others can examine and verify. It is neither automatic belief nor automatic rejection, but proportionate doubt tied to evidence.
Question 32The Foundations of Scientific Thinking
Which feature most clearly distinguishes science from other ways of understanding the world?
- Its use of specialised technical vocabulary
- Its interest in explaining natural events
- Its reliance on systematic evidence and methods open to scrutiny Correct answer.
- Its dependence on the authority of respected individuals
Explanation
Science is characterised by systematic observation and reasoning whose methods and evidence can be examined, criticised and repeated by others. Vocabulary, authority and interest in nature are shared with many other activities.
Question 33The Foundations of Scientific Thinking
A scientist reports a result and another team obtains a different value using the same method. What does this most directly illustrate?
- That at least one team has acted dishonestly
- That the method must be invalid
- That scientific knowledge is purely a matter of opinion
- That measurement in science can involve variability and requires replication Correct answer.
Explanation
Repeated measurement commonly yields slightly different values because of random and systematic sources of variation. Comparing independent results is how science estimates that variability and checks whether findings hold up.
Question 34The Foundations of Scientific Thinking
A student concludes that a plant grew taller because it was spoken to daily, without measuring light, water or temperature. Which improvement most strengthens the investigation?
- Photographing the plant each day for the school newsletter
- Speaking to the plant more frequently and for longer
- Choosing a plant species that grows faster
- Recording the growth of several plants kept under controlled, comparable conditions Correct answer.
Explanation
To support a causal claim, the investigation must control or account for other factors that could affect growth and compare conditions fairly. Using several plants under controlled, comparable conditions reduces the influence of chance and confounding variables.
Question 35The Foundations of Scientific Thinking
A researcher reports that a new study method produced results consistent with predictions made before data collection. Why does this consistency strengthen the claim?
- Because it shows the researcher is experienced
- Because the method was expensive to develop
- Because predictions made in advance cannot be influenced by the data Correct answer.
- Because consistent results prove the underlying theory is true
Explanation
Predictions specified before data collection cannot be shaped to fit the results, so confirming them provides stronger evidence than explanations devised afterwards. This protects against the bias of adjusting hypotheses to match whatever data appear.
Question 36The Foundations of Scientific Thinking
A researcher uses a thermometer calibrated to read 0.5 degrees Celsius too high at every temperature. What type of error does this introduce?
- No error, because the shift is constant
- Random error that averages out over repeated readings
- A systematic error that shifts all readings in one direction Correct answer.
- A sampling error caused by the choice of thermometer
Explanation
A consistent offset affects every measurement in the same direction, which is the defining feature of systematic error. Repeating readings will not remove it, although calibration against a known standard can correct it.
Question 37The Foundations of Scientific Thinking
Two explanations exist for a set of observations. Which principle should guide a scientist choosing between them?
- Prefer the explanation that requires fewer unverified additional assumptions Correct answer.
- Prefer the explanation that is more complicated because it covers more possibilities
- Prefer the explanation proposed by the more senior researcher
- Prefer the explanation that has been described in the most engaging way
Explanation
When competing explanations fit the same evidence, the one invoking fewer unsupported assumptions is generally preferred because it makes fewer claims that could turn out to be false. This is the practical value of parsimony in reasoning.
Question 38The Foundations of Scientific Thinking
A scientist describes a finding as preliminary. What does this most reasonably signal about the claim?
- The claim is known to be false
- The claim rests on limited evidence and may change with further work Correct answer.
- The claim cannot be investigated scientifically
- The claim has been fully verified by independent groups
Explanation
Calling a finding preliminary indicates that the evidence base is incomplete and that conclusions may be revised as more data accumulate. It communicates appropriate caution rather than final certainty or falsity.
Question 39The Foundations of Scientific Thinking
An investigator wants to know whether a tutoring program improves numeracy. Which design best supports a causal conclusion?
- Comparing numeracy scores of randomly allocated tutored and untutored groups Correct answer.
- Comparing numeracy scores of students who chose tutoring with those who declined
- Asking students whether they felt tutoring helped them
- Comparing the school's numeracy average before and after the program began
Explanation
Random allocation creates groups that should be comparable apart from the tutoring, so any difference in numeracy can be attributed more confidently to the program. Self-selection and simple before-after comparisons leave alternative explanations open.
Question 40The Foundations of Scientific Thinking
A model of ocean circulation simplifies many real processes. Why is such simplification acceptable in scientific practice?
- Because simplified models are always more accurate than reality
- Because the omitted processes are known to have no effect
- Because models are only used for teaching rather than research
- Because simplification can isolate the processes most relevant to the question being asked Correct answer.
Explanation
Models deliberately abstract from reality so that key mechanisms can be represented and investigated. A simplification is justified when the omitted details are unlikely to matter much for the specific question being addressed.
Question 41The Foundations of Scientific Thinking
A scientist finds that a result holds only when a particular data-processing choice is made. What is the most appropriate interpretation?
- The finding depends on an analytical choice and requires checking under alternatives Correct answer.
- The finding is robust because a choice was made deliberately
- The finding proves that all other choices are wrong
- The finding should be reported without mentioning the choice
Explanation
If a conclusion changes with reasonable variations in analysis, its robustness is in doubt and the dependence should be investigated and disclosed. Testing alternative choices shows whether the result reflects the data or the analyst's decisions.
Question 42The Foundations of Scientific Thinking
Why is an operational definition important when a study measures something like attention?
- It guarantees that the concept has been measured without error
- It removes the need for statistical analysis
- It specifies the concrete procedure or measure used to quantify the concept Correct answer.
- It shows that the concept is identical in every context
Explanation
Concepts such as attention are abstract, so researchers must state exactly how they are measured, for example by reaction time on a task. Operational definitions allow others to replicate the measurement and judge whether the results support the intended claim.
Question 43The Foundations of Scientific Thinking
A scientist reads a report claiming that a supplement improves memory and notices that the control group also took the supplement. What is the most significant problem with the study's design?
- The study should have used a different memory test
- There was no comparison group free of the supplement to isolate its effect Correct answer.
- The sample size was probably too small to matter
- The supplement was probably too expensive to be useful
Explanation
Without a group that does not receive the supplement, any change in memory cannot be attributed to the supplement rather than to other influences. A valid comparison requires groups differing in the treatment under test.
Question 44The Foundations of Scientific Thinking
A theory has survived many attempts to refute it. What is the most accurate description of its status?
- It is now a proven fact that can never be revised
- It is well supported by evidence but remains open to revision Correct answer.
- It should be replaced because it has been tested too often
- It is merely an opinion held by most scientists
Explanation
Surviving repeated testing gives a theory strong evidential support, yet scientific claims remain revisable if new evidence demands it. Support and certainty are therefore not the same thing.
Question 45The Foundations of Scientific Thinking
A researcher observes that two variables change together but suspects a third factor influences both. What does this suspicion concern?
- The wording of the research question
- The format used to display the data
- The possibility of a confounding variable Correct answer.
- The precision of the measuring instrument
Explanation
A confounding variable is associated with both the supposed cause and the outcome, creating an apparent relationship that may not be causal. Identifying plausible confounders is central to interpreting correlational evidence.
Question 46The Foundations of Scientific Thinking
A scientist uses a computer simulation to explore how a disease might spread. Which limitation is most fundamental to this approach?
- The simulation cannot be run more than once
- The simulation's conclusions depend on the assumptions built into it Correct answer.
- The simulation produces too much data to analyse
- The simulation is not a recognised scientific tool
Explanation
A simulation follows whatever rules and parameters its designers specify, so its outputs are only as trustworthy as those assumptions. Comparing simulations with observed data is one way to test whether the assumptions are adequate.
Question 47The Foundations of Scientific Thinking
A study reports an effect size with a confidence interval that includes zero. What is the most appropriate reading?
- The confidence interval should be ignored in favour of the point estimate
- The study has proven that no effect exists
- The effect is large and certain
- The data are compatible with no effect, so the finding is inconclusive Correct answer.
Explanation
A confidence interval spanning zero means that no effect remains among the plausible values consistent with the data. The estimate may still suggest a direction, but the evidence is not strong enough to rule out no effect.
Question 48The Foundations of Scientific Thinking
Two labs measure the same quantity. Lab A's mean is close to the accepted value but its readings vary widely; Lab B's readings cluster tightly but sit far from the accepted value. How should their results be described?
- Lab A is more precise; Lab B is more accurate
- Both labs are equally accurate and equally precise
- Lab A is neither accurate nor precise
- Lab A is more accurate; Lab B is more precise Correct answer.
Explanation
Accuracy concerns closeness to the true or accepted value, while precision concerns how closely repeated readings agree with one another. Lab A is nearer the accepted value but scattered, and Lab B is tightly clustered but offset.
Question 49The Foundations of Scientific Thinking
A research group reports only the analyses that produced statistically significant results, omitting the rest. Why does this practice threaten the validity of the published literature?
- It prevents the use of statistics in future research
- It distorts the evidence base by over-representing chance findings Correct answer.
- It reduces the number of authors who can be credited
- It makes the articles too short for readers to follow
Explanation
When only significant outcomes are reported, the literature overstates how often effects appear and can present chance results as reliable. The overall evidence base then misrepresents what the full set of analyses actually showed.
Question 50The Foundations of Scientific Thinking
A claim is framed so that any possible observation can be counted as supporting it. What is the most significant consequence for scientific evaluation?
- The claim requires no further communication to other scientists
- The claim cannot be tested, because no evidence could count against it Correct answer.
- The claim automatically becomes a scientific law
- The claim becomes more valuable because it explains everything
Explanation
If every conceivable observation is treated as confirmation, the claim makes no risky prediction and evidence cannot discriminate between it and its alternatives. Such a claim falls outside empirical testing, however appealing it may sound.