BOCPD study materials
BOCPD study resources

BOCPD key terms

BOCPD · Get comfortable with the vocabulary.

Bayesian Online Changepoint Detection (BOCPD)

An online algorithm that maintains a probability distribution over how long the current run of data has lasted, updating it recursively as each new observation arrives so changepoints are flagged without reprocessing history.

Related: Run Length, Changepoint, Posterior Update
Changepoint

A time index where the statistical behavior of a data stream shifts, such as a change in mean, variance, or trend. Detection aims to locate such indices as quickly and reliably as possible.

Related: Run Length, False Alarm, Detection Delay
Run Length

The number of observations since the most recent changepoint. In BOCPD it is a latent variable, and the algorithm tracks a probability for each possible run length value.

Related: Run Length Posterior, Changepoint, Hazard Function
Run Length Posterior

A normalized distribution over all candidate run lengths after observing data up to the current time. It concentrates mass near zero when a changepoint is likely.

Related: Run Length, Posterior Update, Changepoint Probability
Posterior Update

The recursive step that combines the previous run length distribution, the hazard rate, and the predictive likelihood of the new datum to produce the current run length distribution.

Related: Predictive Likelihood, Hazard Function, Run Length Posterior
Predictive Likelihood

The probability assigned to the next observation given the data seen so far within a run. It is computed from the conjugate posterior of the underlying data model.

Related: Conjugate Prior, Posterior Update, Sufficient Statistics
Hazard Function

The prior probability that a changepoint occurs at each time step, independent of the data. A constant hazard yields a geometric prior over run lengths.

Related: Geometric Prior, Changepoint Probability, Run Length
Geometric Prior

A distribution over run lengths implied by a constant hazard rate, where the chance of continuing a run decays by the same factor at every step.

Related: Hazard Function, Run Length, Prior Specification
Changepoint Probability

The posterior mass placed on run length zero at a given time step, interpreted as the estimated probability that a change just occurred at that observation.

Related: Run Length Posterior, Hazard Function, Thresholding
Conjugate Prior

A prior distribution that, combined with a given likelihood, yields a posterior of the same family. This keeps BOCPD updates closed-form and cheap to compute.

Related: Predictive Likelihood, Sufficient Statistics, Normal-Inverse-Gamma Prior
Sufficient Statistics

Compact summaries of the data within a run, such as counts, sums, and sums of squares, that are all that is needed to update the predictive distribution.

Related: Conjugate Prior, Predictive Likelihood, Normal-Inverse-Gamma Prior
Normal-Inverse-Gamma Prior

A conjugate prior for a Gaussian model with unknown mean and variance, parameterized by prior mean, scale, and shape values that are updated with each observation.

Related: Conjugate Prior, Sufficient Statistics, Gaussian Model
Gaussian Model

An assumption that observations within a run follow a normal distribution. It underlies many BOCPD implementations and yields Student-t predictive distributions.

Related: Normal-Inverse-Gamma Prior, Predictive Likelihood, Model Selection
Model Selection

Choosing the data model, prior, and hazard settings that best match the application. Poor choices cause missed changes or excessive false alarms.

Related: Gaussian Model, Prior Specification, Hazard Function
Prior Specification

Setting initial hyperparameters, such as the expected run length or prior scale, before streaming data. These choices shape early behavior and sensitivity.

Related: Hazard Function, Geometric Prior, Model Selection
Expected Run Length

The mean number of observations between changepoints implied by the hazard setting. It is roughly the reciprocal of a constant hazard rate.

Related: Hazard Function, Geometric Prior, Prior Specification
Recursive Message Passing

The computational pattern in which the run length distribution at one step is computed solely from the previous step's distribution and the new datum, avoiding storage of full history.

Related: Posterior Update, Run Length Posterior, Computational Complexity
Computational Complexity

The cost of a BOCPD update. Naive updates grow linearly with the number of candidate run lengths, giving quadratic total cost over a stream unless pruning is applied.

Related: Pruning, Recursive Message Passing, Run Length
Pruning

Discarding candidate run lengths whose posterior probability falls below a small threshold, which bounds memory and computation while barely affecting accuracy.

Related: Computational Complexity, Run Length Posterior, Approximate Inference
Approximate Inference

Techniques that trade exactness for speed, such as capping the maximum run length, merging low-probability states, or subsampling, used when exact BOCPD is too costly.

Related: Pruning, Computational Complexity, Maximum Run Length
Maximum Run Length

A cap on the largest run length tracked, which limits memory growth. It slightly biases detection for very long stable periods but keeps updates bounded.

Related: Approximate Inference, Pruning, Computational Complexity
Thresholding

Declaring a changepoint when the changepoint probability or a related statistic crosses a chosen level. The threshold controls the trade-off between sensitivity and false alarms.

Related: Changepoint Probability, False Alarm, Detection Delay
False Alarm

A declared changepoint when none actually occurred. Frequent false alarms erode trust and trigger unnecessary downstream actions.

Related: Thresholding, Detection Delay, False Alarm Rate
Detection Delay

The number of observations between a true changepoint and its detection. Lower delay means faster response but usually more false alarms.

Related: False Alarm, Thresholding, Trade-off Analysis
False Alarm Rate

The expected frequency of spurious detections over a period, often expressed per observation or per unit time. It is tuned through hazard and threshold settings.

Related: False Alarm, Thresholding, Trade-off Analysis
Trade-off Analysis

Balancing detection delay against false alarm rate when tuning a detector. Curves plotting one against the other help compare configurations objectively.

Related: Detection Delay, False Alarm Rate, Thresholding
Offline Changepoint Detection

Analysis performed on a complete dataset, where the number and locations of changes are estimated jointly. It contrasts with online detection, which must decide in real time.

Related: Online Detection, Changepoint, Retrospective Analysis
Online Detection

Sequential analysis that processes each observation once, as it arrives, and must issue decisions without knowledge of future data.

Related: Offline Changepoint Detection, Recursive Message Passing, Detection Delay
Retrospective Analysis

Reviewing a stream after the fact to confirm, relabel, or explain detections. It is often used to validate an online detector's output.

Related: Offline Changepoint Detection, Online Detection, Ground Truth
Ground Truth

The known or annotated changepoint locations used to evaluate a detector, typically in simulation studies or labeled historical data.

Related: Retrospective Analysis, Precision and Recall, Detection Delay
Precision and Recall

Evaluation metrics for detection: precision is the share of declared changepoints that are real, and recall is the share of real changepoints that were found.

Related: Ground Truth, False Alarm, Retrospective Analysis
Concept Drift

Gradual or abrupt change in the data-generating process over time. BOCPD addresses abrupt drift but may need extensions for slow, incremental shifts.

Related: Changepoint, Model Selection, Online Detection
Anomaly Detection

Identifying unusual observations or periods. Changepoint methods complement anomaly detection by flagging shifts in normal behavior rather than single outliers.

Related: Concept Drift, Thresholding, False Alarm
Streaming Data

A potentially unbounded sequence of observations arriving over time, which motivates the incremental, memory-bounded design of online changepoint algorithms.

Related: Online Detection, Recursive Message Passing, Computational Complexity
Hyperparameter Tuning

Adjusting settings such as hazard rate, prior scale, and detection threshold using validation data or simulation to meet accuracy and latency goals.

Related: Prior Specification, Thresholding, Trade-off Analysis
Segment

A contiguous block of observations between two changepoints that is treated as sharing one statistical regime for modeling purposes.

Related: Changepoint, Run Length, Offline Changepoint Detection
Posterior Predictive Check

Comparing simulated data from the fitted model with observed data to judge whether the model and priors are reasonable for the stream.

Related: Model Selection, Ground Truth, Prior Specification