STRATA
Skip to study
XLVII

V.10 / DISCOVERY

Contradiction diagnosis and model comparison

Do the competing models predict different readings under the same experimental conditions?

A source-led introduction2 source references1 related experiments

Start with the question.

An apparent contradiction can arise from different definitions, samples, instruments, scales, or model assumptions. Diagnosing it requires placing claims in comparable form before deciding whether one must be rejected. Measurement uncertainty and Bayesian model comparison provide complementary tools: one checks whether the reported quantities are commensurable, while the other examines which model better accounts for specified observations.

Compare two measurements with their uncertainty.

Suppose independent estimates of the same quantity are 10 ± 1 and 12 ± 1, with the uncertainties interpreted as standard uncertainties. The difference is two units, and its combined standard uncertainty is about 1.41 units. This is a different situation from comparing 10 ± 0.01 and 12 ± 0.01; the numerical disagreement alone is incomplete.

What would you inspect?

  • Definitions, units, populations, measurement procedures, and covariance.
  • Predictions that differ between the competing explanations.

Take the next step.

Build a discrepancy table for two real claims and choose the first check most likely to resolve whether they concern the same measurable quantity.

Put part of the question to work.

These models isolate a mechanism you can vary. Their assumptions define the part of this topic they can illuminate.

Try evidence and base rates.

Change one parameter, compare the numerical output, and export the result. The experiment loads when you open it.

Open its full page

Watch the quantities change.

12 seconds · Original model visualization · Silent

Evidence and base rates

Follow a screening result back through the population that produced it.

Read the explanation and method

A hypothetical batch contains 10,000 components. Detection is fixed at 99 percent and false flags at 5 percent.

The defect rate rises from 1 percent toward 20 percent. Orange shows actual defects that are flagged; cream shows sound items that are falsely flagged.

The posterior is true flags divided by all flags. Changing the starting population changes this fraction even when both screening rates stay fixed.

Method. Apply each conditional rate to its own population. True flags equal the defective population multiplied by the detection rate; false flags equal the sound population multiplied by the false-flag rate. Divide true flags by all flags to obtain the posterior probability.

Read the supporting material.

  1. Guide to the expression of uncertainty in measurement

    Joint Committee for Guides in Metrology / BIPM · Measurement models, uncertainty evaluation, and propagation.

  2. Bayesian interpolation

    David J. C. MacKay / Caltech · Bayesian model comparison and regularization in adaptive models.

Continue through the versioned study records.

Follow the comparisons.

Read the neighboring questions.