Residual Seasonality and a Pandemic Shock in Monthly Claim Counts
Monthly claim counts for a personal accident portfolio are available from January 2015 to December 2024, 120 observations. An ARIMA(1,1,1)(0,1,1)12 model selected by AIC gives a Ljung–Box p-value of 0.02 and a residual autocorrelation of 0.24 at lag 12. The fitted model also underpredicts the 2020 lockdown period, when counts fell 45%, and overpredicts the rebound in 2021. Rolling one-step forecasts are adequate in 2022–2024 but the 12-step forecast intervals are wider than the actuarial team expects. A colleague proposes switching to an ETS(A,A,A) model, while another suggests adding a pulse intervention for 2020 and a ramp for 2021. The reserving team needs a 12-month forecast and a defensible prediction interval for planning.
1. Diagnose the residual autocorrelation at lag 12 and the Ljung–Box result. Does this invalidate the ARIMA model? What alternatives would you consider?
Read the worked answer
The Ljung–Box p-value of 0.02 rejects the white-noise null at the 5% level, and the lag-12 residual autocorrelation of 0.24 is large enough to indicate remaining seasonal structure. The model is therefore not adequate for inference or forecasting as it stands, although it may still be a useful baseline. The remaining seasonality could mean that the seasonal MA(1) term is insufficient, that seasonal differencing has induced overdifferencing, or that the 2020–2021 shock is contaminating the residual diagnostics. I would examine residual ACF and PACF plots, test for seasonal unit roots, and compare a SARIMA with an additional seasonal AR term, a model with Fourier seasonal terms, and an ETS(A,A,A) alternative. The choice should not be based on AIC alone; rolling-origin forecast accuracy and interval coverage are more relevant. If the residual seasonality persists after adding a seasonal AR term, the model should be rejected rather than used for 12-step forecasting.
2. How should the 2020 lockdown and 2021 rebound be handled? Compare a pulse/ramp intervention with simply discarding 2020–2021.
Read the worked answer
Discarding 2020–2021 loses information, creates an artificial gap in the series, and can distort the estimated seasonal and trend components. It also makes the model unable to represent a future similar shock. A better approach is to include deterministic intervention terms: a pulse for the main lockdown months, and a ramp or level shift for the rebound, based on external event dates rather than data mining. The intervention coefficients should be tested for significance, and the model should be checked for remaining autocorrelation. A pulse/ramp intervention preserves the full time series and separates the shock from the regular seasonal dynamics. If the shock is expected to be non-repeating, the intervention is preferable for forecasting; if future shocks are plausible, scenario analysis should be added. The final model should be compared with the no-intervention ARIMA and ETS alternatives using out-of-sample rolling forecasts, not only in-sample fit.
3. The team needs a 12-month forecast and prediction interval. Outline a validation and interval construction plan that addresses model uncertainty.
Read the worked answer
Use rolling-origin cross-validation over the last 24–36 months, refitting each model at each origin and evaluating point forecast error and interval coverage. Compare the ARIMA baseline, a SARIMA with the additional seasonal term, the intervention model, and ETS(A,A,A). Choose the model on out-of-sample performance and on whether residuals pass white-noise checks. For the prediction interval, do not rely only on the innovation variance: simulate from the fitted model, including parameter uncertainty via bootstrap or Bayesian methods, and incorporate uncertainty about the intervention effects. Report the interval as a scenario-aware interval, and check its empirical coverage in the rolling validation. If the residuals are non-normal or the shock is not fully captured, use empirical quantiles from the rolling errors. The final recommendation should state the model, the intervention assumptions, the validation results, and the interval coverage, rather than presenting a single interval as if it were model-free.