IFoA CS1 key terms
IFoA CS1 · Get comfortable with the vocabulary.
- Random variable
- Related: Probability mass function, Cumulative distribution function
A function that assigns a numerical value to each outcome in a sample space, so that probabilities can be attached to numbers rather than raw outcomes.
- Probability mass function
- Related: Random variable, Probability density function
For a discrete random variable, a function giving the probability that the variable equals each possible value; the values are non-negative and sum to one.
- Probability density function
- Related: Cumulative distribution function, Probability mass function
For a continuous random variable, a non-negative function whose integral over an interval gives the probability of falling in that interval; the total integral is one.
- Cumulative distribution function
- Related: Probability density function, Survival function
A function giving, for any value x, the probability that a random variable is less than or equal to x; it is non-decreasing and runs from zero to one.
- Survival function
- Related: Cumulative distribution function, Hazard rate
The probability that a random variable exceeds a given value, equal to one minus the cumulative distribution function; central to lifetime and mortality modelling.
- Hazard rate
- Related: Survival function, Force of mortality
The instantaneous rate of failure at a given age conditional on survival to that age, obtained as the density divided by the survival function.
- Force of mortality
- Related: Hazard rate, Survival function
In life-contingent work, the instantaneous death rate at exact age x conditional on survival to that age; the actuarial name for the hazard rate of a lifetime variable.
- Expectation
- Related: Variance, Moment generating function
The probability-weighted average of a random variable over its distribution; for a function of the variable, the average of that function's values weighted by probability or density.
- Variance
- Related: Expectation, Covariance
The expected squared deviation of a random variable from its mean, measuring spread; computed as the second moment minus the square of the first moment.
- Moment generating function
- Related: Expectation, Probability generating function
The expected value of the exponential of t times a random variable, viewed as a function of t; it generates moments by differentiation and can identify distributions uniquely.
- Probability generating function
- Related: Moment generating function, Compound distribution
For a non-negative integer-valued random variable, the expected value of z raised to the variable; its derivatives at one give factorial moments and it aids convolution of counts.
- Covariance
- Related: Correlation coefficient, Variance
A measure of joint linear association between two random variables, being the expected product of their deviations from their means; zero does not imply independence.
- Correlation coefficient
- Related: Covariance
Covariance standardised by the product of the two standard deviations, giving a value between minus one and one that is invariant to changes of scale.
- Independent random variables
- Related: Joint distribution, Conditional distribution
Variables whose joint distribution factorises into the product of their marginal distributions; equivalently, conditioning on one leaves the distribution of the other unchanged.
- Joint distribution
- Related: Marginal distribution, Independent random variables
The probability law describing two or more random variables simultaneously, from which marginal and conditional distributions can be derived by summing or integrating.
- Marginal distribution
- Related: Joint distribution, Conditional distribution
The distribution of one variable obtained from a joint distribution by summing or integrating out the other variables, ignoring them entirely.
- Conditional distribution
- Related: Joint distribution, Conditional expectation
The distribution of one variable given that another takes a specified value, formed from the joint distribution divided by the relevant marginal probability or density.
- Conditional expectation
- Related: Conditional distribution, Law of total variance
The expected value of one variable given information about another; it is itself a random variable when the conditioning variable is random, and obeys the tower property.
- Law of total variance
- Related: Conditional expectation, Variance
A decomposition stating that the variance of a variable equals the variance of its conditional expectation plus the expectation of its conditional variance.
- Central limit theorem
- Related: Normal distribution, Moment generating function
The result that the standardised sum or mean of many independent, identically distributed variables with finite variance tends to a standard normal distribution as the count grows.
- Normal distribution
- Related: Central limit theorem, Exponential family
A continuous symmetric bell-shaped distribution defined by a mean and variance, widely used as a large-sample approximation and closed under linear combinations of independent variables.
- Poisson distribution
- Related: Poisson process, Compound distribution
A discrete distribution for counts with a single rate parameter, where the mean and variance are equal; it arises as a limit of binomial counts and in Poisson processes.
- Exponential family
- Related: Sufficient statistic, Maximum likelihood estimator
A broad class of distributions whose densities can be written in a standard form with a natural parameter and sufficient statistic, giving convenient estimation and moment properties.
- Poisson process
- Related: Poisson distribution, Compound distribution
A model for events occurring randomly in time or space where counts in disjoint intervals are independent Poisson variables with rate proportional to interval length.
- Compound distribution
- Related: Poisson process, Probability generating function
A distribution for a random sum of independent identically distributed amounts, where the number of terms is itself random; used for aggregate claim models.
- Order statistics
- Related: Cumulative distribution function
The values of a sample arranged in increasing order; their distributions depend on the underlying distribution and are used for extremes and quantile estimation.
- Estimator
- Related: Bias, Mean squared error
A rule or statistic computed from sample data that produces a guess for an unknown parameter; it is a random variable before the data are observed.
- Bias
- Related: Mean squared error, Estimator
The difference between the expected value of an estimator and the true parameter value; an unbiased estimator has zero bias over repeated sampling.
- Mean squared error
- Related: Bias, Consistency
The expected squared difference between an estimator and the true parameter; it decomposes into the square of the bias plus the variance of the estimator.
- Consistency
- Related: Mean squared error, Maximum likelihood estimator
A property of an estimator meaning it converges in probability to the true parameter value as the sample size grows without limit.
- Maximum likelihood estimator
- Related: Likelihood function, Fisher information
The parameter value that maximises the likelihood, or equivalently the log-likelihood, of the observed sample; often found by solving score equations.
- Likelihood function
- Related: Maximum likelihood estimator, Log-likelihood
The joint probability or density of the observed data regarded as a function of the unknown parameters, with the data held fixed; it is not a probability distribution over parameters.
- Log-likelihood
- Related: Likelihood function, Score function
The natural logarithm of the likelihood function; maximised at the same point but usually easier to differentiate because products become sums.
- Score function
- Related: Log-likelihood, Fisher information
The derivative of the log-likelihood with respect to the parameter; its expectation is zero and setting it to zero gives likelihood equations for the estimator.
- Fisher information
- Related: Score function, Cramer-Rao lower bound
A measure of how much a sample carries about a parameter, equal to the variance of the score and to the negative expected second derivative of the log-likelihood.
- Cramer-Rao lower bound
- Related: Fisher information, Efficiency
A lower limit on the variance of any unbiased estimator, equal to the reciprocal of the Fisher information for a single parameter.
- Efficiency
- Related: Cramer-Rao lower bound, Mean squared error
A comparison of estimators by variance, where the efficient estimator attains the smallest variance among unbiased estimators, often the Cramer-Rao bound.
- Sufficient statistic
- Related: Exponential family, Estimator
A statistic that captures all information in the sample about the parameter, so the conditional distribution of the data given it does not depend on the parameter.
- Confidence interval
- Related: Pivot, Hypothesis test
A random interval constructed so that, over repeated samples, it contains the true parameter with a specified long-run probability called the confidence level.
- Hypothesis test
- Related: p-value, Power of a test
A decision procedure comparing data with a null hypothesis using a test statistic, a significance level, and a rejection region or p-value.
- p-value
- Related: Hypothesis test, Power of a test
The probability, assuming the null hypothesis is true, of obtaining a test statistic at least as extreme as that observed; small values suggest evidence against the null.
- Power of a test
- Related: Hypothesis test, p-value
The probability of correctly rejecting a false null hypothesis; it increases with effect size, sample size, and the chosen significance level.