The Scientific Method — Question 10

Section 1-2 · Chemistry pages 45–46

Show solutionHide solution

Question 10

An explanation must risk being wrong

Claim A says: under a specified protocol, additive X reduces the mean time to a fixed endpoint by at least 10 s. Claim B says: X helps whenever the conditions are favorable, and any failure means conditions were unfavorable.

Diagram shown in the original SVG worksheet.

  1. Explain which claim is more testable and why.

  2. Propose a comparison that tests Claim A while limiting observer expectations.

  3. If the measured reduction is 3±23\pm2 s as a stated bound, evaluate Claim A.

Question 10 - Solution

An explanation must risk being wrong

Diagram shown in the original SVG worksheet.

(a) Require a possible contradiction

A specifies a procedure, outcome and minimum effect. B defines favorable conditions only after seeing results, so any observation can be reclassified as consistent with it.

(b) Reduce expectation bias

Randomize labeled samples with and without X, conceal labels from the person judging the endpoint, use a predefined endpoint, and perform repeated matched trials.

(c) Compare with the claimed threshold

The stated reduction interval is [1,5][1,5] s, entirely below 10 s. It does not support the claimed minimum benefit under this protocol, though it may be consistent with a smaller effect.

Check and interpretation

A negative result about a specified effect is useful information, not a failed scientific exercise.