ISTQB CT-PT study materials
ISTQB CT-PT study resources

ISTQB CT-PT key terms

ISTQB CT-PT · Get comfortable with the vocabulary.

Performance Testing

A testing type that measures and evaluates system behaviour such as response time, throughput and resource use under defined load conditions, to determine whether performance requirements are met and where bottlenecks exist.

Related: Load Testing, Performance Requirement, Bottleneck
Load Testing

Testing that exercises a system at expected or anticipated usage levels, including peaks, to confirm it meets requirements and to observe behaviour as load increases toward defined limits.

Related: Performance Testing, Stress Testing, Workload Model
Stress Testing

Testing conducted beyond normal or anticipated load, or with constrained resources, to find the point at which the system fails and to observe how it degrades and recovers.

Related: Load Testing, Bottleneck, Resource Utilization
Scalability Testing

Testing that determines how well a system sustains increasing load when capacity such as servers, threads or memory is added, revealing whether performance grows proportionally or levels off.

Related: Load Testing, Throughput, Resource Utilization
Soak Testing

Long-duration testing at a sustained, moderate load, used to expose problems that appear only over time such as memory leaks, connection exhaustion, log growth and gradual degradation.

Related: Load Testing, Memory Leak, Resource Utilization
Spike Testing

Testing where load is increased sharply and briefly, then removed, to evaluate how the system handles sudden surges and whether it recovers to normal behaviour afterwards.

Related: Stress Testing, Load Testing, Workload Model
Performance Requirement

A measurable statement describing expected performance, for example a maximum response time for a given transaction at a stated load, expressed precisely enough to be verified by testing.

Related: Response Time, Throughput, Service Level Agreement
Service Level Agreement

A formal agreement between a provider and a customer that states measurable service targets, such as availability and response times, which performance testing results are often compared against.

Related: Performance Requirement, Response Time, Percentile
Bottleneck

A component or resource whose limited capacity constrains overall system performance, so that relieving other parts yields little improvement until this constraint is addressed.

Related: Resource Utilization, Stress Testing, Profiling
Workload Model

A representation of the expected user population and their actions, including transaction mix, arrival pattern, think time and data volumes, used to drive realistic performance test execution.

Related: Virtual User, Think Time, Load Profile
Load Profile

The planned pattern of load over the duration of a performance test, specifying how many users or transactions are applied and how that level changes across phases.

Related: Workload Model, Ramp-Up, Steady State
Response Time

The elapsed time between a request being submitted and the corresponding response being received, often decomposed into network, queueing, application and data-access portions.

Related: Percentile, Throughput, Transaction
Throughput

The rate at which a system completes work, typically expressed as transactions, requests or data volume per unit of time, measured under a stated load and workload mix.

Related: Response Time, Transaction, Little's Law
Transaction

A named, logically meaningful unit of user work whose start and end are timed during a performance test, such as a login or a checkout, forming the basis for reported metrics.

Related: Response Time, Throughput, Virtual User
Percentile

A value below which a given proportion of measurements fall, such as the 90th percentile response time, used to describe the distribution of timings rather than only the average.

Related: Response Time, Service Level Agreement, Arithmetic Mean
Arithmetic Mean

The sum of a set of measurements divided by their count; useful for some resource metrics but misleading for response times, because a few very slow transactions can inflate it.

Related: Percentile, Response Time, Standard Deviation
Standard Deviation

A measure of how widely individual measurements spread around their mean; a large value for response times indicates inconsistent user experience even when the average looks acceptable.

Related: Arithmetic Mean, Percentile, Response Time
Resource Utilization

The proportion of a resource's capacity in use during a test, such as processor, memory, disk or network; sustained very high utilization suggests a likely constraint on performance.

Related: Bottleneck, Profiling, Memory Leak
Memory Leak

A defect where allocated memory is never released, so consumption grows steadily over time and eventually degrades performance or causes failure; typically revealed by long-duration testing.

Related: Soak Testing, Resource Utilization, Garbage Collection
Garbage Collection

Automatic reclamation of unused memory by a runtime environment; its pauses can cause periodic response-time spikes that are hard to see in averages but visible in percentile data.

Related: Memory Leak, Response Time, Profiling
Think Time

The simulated pause between a virtual user's consecutive actions, representing real user deliberation, which affects the load actually placed on the system under test.

Related: Virtual User, Workload Model, Pacing
Virtual User

A simulated user generated by a performance testing tool that executes a scripted sequence of interactions, each instance contributing to the applied load.

Related: Test Script, Think Time, Load Generator
Test Script

A recorded or coded sequence of interactions and validations that a virtual user executes, including data parameterisation and timing logic needed for realistic load generation.

Related: Virtual User, Correlation, Parameterisation
Correlation

The practice of capturing dynamic values returned by the system, such as session identifiers or tokens, and substituting them into later requests so scripted interactions remain valid.

Related: Test Script, Parameterisation, Virtual User
Parameterisation

Supplying varied input data to virtual users from a data source so that each iteration uses different values, avoiding unrealistic caching effects and data collisions during load tests.

Related: Test Script, Correlation, Virtual User
Ramp-Up

The phase in which applied load is gradually increased from a lower level to the target level, allowing observation of how performance changes as demand grows.

Related: Steady State, Load Profile, Ramp-Down
Steady State

The test phase during which load is held constant at the target level long enough for measurements to stabilise, so that collected metrics are representative and comparable.

Related: Ramp-Up, Ramp-Down, Load Profile
Ramp-Down

The phase in which load is gradually reduced after the steady state, used to observe recovery behaviour and to end the test without abrupt disruption to the system.

Related: Ramp-Up, Steady State, Spike Testing
Pacing

Control over how frequently a virtual user starts new iterations, independent of response time, so that the generated transaction rate matches the intended workload model.

Related: Think Time, Workload Model, Virtual User
Load Generator

A machine or process that runs virtual users and produces requests against the system under test; its own capacity must be monitored so it does not distort results.

Related: Virtual User, Performance Testing Tool, Resource Utilization
Performance Testing Tool

Software that records or scripts user interactions, generates load, and collects and reports metrics; selection considers protocol support, scripting effort, licensing cost and reporting depth.

Related: Load Generator, Test Script, Monitoring Tool
Monitoring Tool

Software that observes infrastructure and application behaviour during a test, collecting metrics such as processor load, memory, disk activity and request traces to support analysis.

Related: Profiling, Resource Utilization, Performance Testing Tool
Profiling

Detailed analysis of where execution time or resource consumption occurs inside application code or a runtime, used to locate the precise cause of an observed bottleneck.

Related: Bottleneck, Monitoring Tool, Resource Utilization
Test Environment

The hardware, software, network and data configuration in which performance tests run; it should resemble production closely enough for results to be credible and transferable.

Related: Production-Like Environment, Test Data, Load Generator
Production-Like Environment

A test environment dimensioned and configured comparably to production, including network characteristics and data volume, so that measured performance is representative of live behaviour.

Related: Test Environment, Test Data, Workload Model
Test Data

The data set used by performance tests, whose volume and distribution should reflect production; unrealistic data sizes can hide or create performance problems.

Related: Test Environment, Parameterisation, Production-Like Environment
Little's Law

A relationship stating that the average number of items in a system equals their arrival rate multiplied by average time spent, useful for checking load, throughput and response-time consistency.

Related: Throughput, Response Time, Workload Model
Baseline

A recorded set of performance measurements from a known configuration, used as a reference for comparing later test runs and detecting regressions after changes.

Related: Regression, Steady State, Load Profile
Regression

A deterioration in performance relative to a previous baseline or release, identified by comparing metrics from equivalent tests run under the same conditions.

Related: Baseline, Performance Requirement, Response Time