ICBB study materials
ICBB study resources

Shift B and the 30,000 Inspection Records

ICBB · Put your knowledge to work in context.

All case studies

Shift B and the 30,000 Inspection Records

At a medical-device assembly plant the final visual-inspection defect rate is 4.8% against a 2.0% target. The Black Belt pulled 30,000 inspection records from the last quarter and compared shift A (4.2%) with shift B (5.4%); a chi-square test gave p < 0.001. The team's draft report concludes 'shift B is the root cause; retrain shift B operators.' Additional facts: shift B runs the two high-mix product families (12 configurations) while shift A runs the three high-volume families (3 configurations); shift B has been running 6% overtime; a separate 2-sample t-test on inspection time (n = 8 for A, n = 9 for B) gave p = 0.04, but a Levene test gave p = 0.01 and one shift A observation was 3.5 standard deviations from its group mean. A regression of weekly defect rate on ambient humidity across 12 weeks gave R-squared = 0.71 with p = 0.004; humidity ranged only from 41% to 47%.

1. Critique the chi-square conclusion. What alternative explanations must be eliminated, and what analysis would you run instead?

Read the worked answer

What the test actually established With n = 30,000, chi-square answers 'is the difference distinguishable from zero?' - not 'is shift the cause?' The effect size is 1.2 percentage points (4.2% vs 5.4%) with a narrow confidence interval. Even if real, shift accounts for at most 1.2 of the 2.8-point gap, so calling it 'the root cause' overstates the evidence.

Confounders that must be excluded

  • Product mix. Shift B runs 12 configurations, shift A runs 3. High mix means more changeovers, more part variety, more look-alike parts, and harder inspection. Shift and mix are almost perfectly entangled, so this comparison cannot separate them.
  • Overtime and fatigue. 6% overtime may itself be a consequence of the high-mix schedule, so it is both a confounder and a mediator.
  • Inspector and measurement effects. Different people, possibly different strictness, and no attribute agreement study. A shift difference can be an inspection-standard difference.
  • Time-of-day and handoff effects (lighting, end-of-shift fatigue, shift-change communication).

Analysis to run instead

  • Two-way stratification: defect rate by product family x shift, with counts and confidence intervals. Test whether the shift effect survives within family.
  • Logistic regression with shift, product family, overtime indicator, and inspector as terms; look at the shift coefficient after adjustment.
  • A multi-vari chart (family x shift x inspector) to see where the variation actually lives.

Do not retrain shift B on this evidence. Training costs money, damages trust, and will not move the metric if mix and changeover are the real drivers. Target the dominant product family and the changeover process first.

2. What is wrong with the t-test on inspection time, and what would you conclude about the difference between shifts?

Read the worked answer

Problems with the test

  1. Unequal variances. Levene p = 0.01 rejects equal variances, so the pooled-variance two-sample t-test uses the wrong standard error. Its p = 0.04 is not trustworthy. Use Welch's t-test, or Mann-Whitney if normality is also doubtful.
  2. Influential outlier. One shift A observation is 3.5 standard deviations from its group mean. Verify it first: data-entry error, wrong product, trainee, or a genuinely long inspection. With n = 8 vs 9, a single point can move the p-value across 0.05 in either direction - the result is fragile, not robust.
  3. Low power. Groups of 8 and 9 can only detect large differences. A non-significant result would not have proven equivalence either.
  4. Practical significance ignored. A p-value says nothing about whether the time difference matters. If the difference is four seconds per unit, it is irrelevant to capacity; if it is 40 seconds, it matters regardless of the p-value.

What I would conclude No reliable evidence of a difference in inspection time. Report the Welch result, the mean difference with a confidence interval, and a sensitivity analysis excluding the outlier. If the decision genuinely depends on this difference, run a power analysis for the smallest operationally meaningful difference and collect more data with a documented sampling protocol.

Link back to the main question: if inspection time does not differ by shift but defect rate does, that points away from 'shift B inspectors are careless' and toward product mix and changeover, which is exactly where the team should look.

3. The humidity regression shows R-squared = 0.71 with p = 0.004. Should the plant install humidity control? Justify using the range of X, confounding, and practical significance.

Read the worked answer

Range of X The regression was fitted over 41-47% relative humidity - a 6-point window. R-squared = 0.71 says the line fits well inside that window; it says nothing about behavior at 30% or 65%. The slope is a local estimate, and the true relationship could be curved or could reverse outside the observed range. Extrapolating it to justify plant-wide humidification is unsupported.

Confounding and autocorrelation Twelve consecutive weekly points let humidity stand in for anything else that changed with the season: product mix, HVAC schedule, staffing, material lots, customer demand. With sequential weekly data the residuals are likely autocorrelated, which makes the reported p = 0.004 optimistic. A time-ordered residual plot is essential before believing the model.

Practical significance Compute the predicted defect-rate change across the observed 6-point humidity range. If the model implies, say, a 0.3-point swing while the gap to target is 2.8 points, humidity is a minor contributor at most. A statistically significant coefficient on a small effect is not an action item.

Decision Do not install humidity control on this evidence. Instead:

  • Run a multi-vari study with continuous humidity logging plus product family, shift, lot, and changeover recorded, so humidity can be separated from time.
  • If a real effect is still suspected, test it in a controlled experiment that deliberately spans a wider humidity range (chamber or seasonal replication), or include humidity as a blocking/noise factor in a follow-up DOE.
  • Revisit capex only after an effect is demonstrated over a range wide enough to matter operationally.