TASC Data Science and Digital Solutions key terms
TASC Data Science and Digital Solutions · Get comfortable with the vocabulary.
- Supervised learning
- Related: Label, Classification, Regression
A modeling approach where an algorithm learns from labeled examples, mapping inputs to known outputs so it can predict the target for new, unseen data.
- Unsupervised learning
- Related: Clustering, Feature
A modeling approach that finds structure in unlabeled data, such as groups or compressed representations, without any target variable to predict.
- Classification
- Related: Supervised learning, Confusion matrix
A supervised task that assigns each observation to one of a set of discrete categories, such as fraud or not fraud, based on its features.
- Regression
- Related: Supervised learning, Overfitting
A supervised task that predicts a continuous numeric value, such as a price or a temperature, from one or more input features.
- Clustering
- Related: Unsupervised learning
An unsupervised technique that groups observations so that items within a group are more similar to each other than to items in other groups.
- Feature
- Related: Label, Feature engineering
An individual measurable input variable used by a model, such as age, income, or a word count, that helps explain or predict the target.
- Label
- Related: Supervised learning, Feature
The known target value or correct answer attached to a training example, which a supervised model learns to predict from the features.
- Training set
- Related: Test set, Overfitting
The portion of data used to fit a model's parameters, kept separate from evaluation data so performance estimates remain honest.
- Test set
- Related: Training set, Cross-validation
A held-out portion of data never used during model fitting, reserved for estimating how well the final model generalizes to new cases.
- Cross-validation
- Related: Test set, Overfitting
A resampling method that splits data into several folds, training and validating repeatedly, to estimate performance more reliably than a single split.
- Overfitting
- Related: Training set, Regularization, Cross-validation
A failure mode where a model learns noise and quirks of the training data, performing very well there but poorly on new, unseen data.
- Regularization
- Related: Overfitting
A technique that penalizes model complexity, for example by shrinking large coefficients, to reduce overfitting and improve generalization to new data.
- Confusion matrix
- Related: Precision, Recall, Classification
A table comparing predicted versus actual classes, showing counts of true positives, true negatives, false positives, and false negatives for a classifier.
- Precision
- Related: Recall, Confusion matrix
A classification metric giving the share of predicted positives that are actually positive; high precision means few false alarms.
- Recall
- Related: Precision, Confusion matrix
A classification metric giving the share of actual positives that the model correctly identified; high recall means few missed cases.
- Feature engineering
- Related: Feature, Data cleaning
The practice of creating, transforming, or selecting input variables, such as ratios or date parts, so a model can learn patterns more effectively.
- Data cleaning
- Related: Missing data, Outlier, Feature engineering
The process of detecting and correcting errors in data, including duplicates, inconsistent formats, impossible values, and missing entries, before analysis.
- Missing data
- Related: Data cleaning, Imputation
Absent values in a dataset, which analysts handle by removing records, imputing estimates, or using models that tolerate gaps, depending on the cause.
- Imputation
- Related: Missing data
Replacing a missing value with an estimated substitute, such as a mean, median, or model-based prediction, so complete-case analysis becomes possible.
- Outlier
- Related: Data cleaning
An observation that lies unusually far from the rest of the data, which may signal a data error or a genuinely rare and important event.
- Exploratory data analysis
- Related: Outlier, Data cleaning
An initial, open-ended pass through a dataset using summaries and charts to reveal distributions, relationships, anomalies, and questions worth deeper investigation.
- Descriptive statistics
- Related: Exploratory data analysis, Distribution
Summary measures that characterize a dataset, such as mean, median, standard deviation, and range, used to describe central tendency and spread.
- Distribution
- Related: Descriptive statistics, Normal distribution
The pattern describing how often each value or range of values occurs in a variable, including its shape, center, and spread.
- Normal distribution
- Related: Distribution, Standard deviation
A symmetric, bell-shaped probability distribution defined by its mean and standard deviation, common in theory and often assumed by statistical tests.
- Standard deviation
- Related: Normal distribution, Descriptive statistics
A measure of how spread out values are around the mean, equal to the square root of the variance and expressed in the data's original units.
- Correlation
- Related: Causation, Regression
A statistic between minus one and one describing the strength and direction of a linear relationship between two variables; it does not prove causation.
- Causation
- Related: Correlation, A/B testing
A relationship where changing one factor actually produces a change in another, which requires stronger evidence than an observed association or correlation.
- Hypothesis test
- Related: p-value, Statistical significance
A formal procedure comparing observed data against a null hypothesis, producing a p-value that indicates how compatible the data are with that null.
- p-value
- Related: Hypothesis test, Statistical significance
The probability of observing results at least as extreme as the data, assuming the null hypothesis is true; it is not the probability the null is true.
- Statistical significance
- Related: p-value, Hypothesis test
A conclusion that an observed result is unlikely under the null hypothesis given a chosen threshold, indicating an effect probably exists but not how large it is.
- A/B testing
- Related: Causation, Statistical significance
A controlled experiment comparing two versions of something, randomly assigning users to variants and measuring a chosen outcome to judge which performs better.
- Data pipeline
- Related: ETL, Data warehouse
An automated sequence of steps that moves data from sources through transformation and validation into storage or a model, run reliably and repeatedly.
- ETL
- Related: Data pipeline, Data warehouse
Extract, transform, load: a pipeline pattern that pulls data from sources, cleans and reshapes it, then writes it into a target store such as a warehouse.
- Data warehouse
- Related: ETL, Data lake
A central repository that consolidates cleaned, structured data from many sources, optimized for querying and business reporting rather than transaction processing.
- Data lake
- Related: Data warehouse, Data pipeline
A storage system holding large volumes of raw data in native formats, structured or not, with structure applied at read time rather than write time.
- Data governance
- Related: Data quality, Data privacy
The policies, roles, and controls that define who may access data, how quality is maintained, and how privacy and regulatory obligations are met.
- Data quality
- Related: Data cleaning, Data governance
The degree to which data is accurate, complete, consistent, timely, and fit for its intended use in analysis or operations.
- Data privacy
- Related: Data governance, Anonymization
The protection of personal information through practices such as minimizing collection, restricting access, and honoring consent and legal requirements.
- Anonymization
- Related: Data privacy, Data governance
Removing or altering identifying details so individuals cannot reasonably be re-identified, while preserving the data's analytical usefulness.