OpenEDG PCAD key terms
OpenEDG PCAD · Get comfortable with the vocabulary.
- Database cursor
- Related: Connection object, Parameterized query
A database object that keeps track of a position in a result set and lets Python fetch rows one at a time or in batches after a query executes.
- Connection object
- Related: Database cursor, Transaction commit and rollback
The Python handle to a database session; it opens the channel used to run statements, manage transactions, and produce cursors.
- Parameterized query
- Related: SQL injection, Connection object
A SQL statement in which placeholders are filled with values supplied separately by the driver, preventing SQL injection and handling quoting automatically.
- SQL injection
- Related: Parameterized query
An attack in which untrusted input is concatenated into SQL so it alters the statement's logic; parameterized queries and input validation are the standard defenses.
- REST API pagination
- Related: Rate limiting, JSON response parsing
The practice of retrieving a large API result set in successive pages using limit, offset, or cursor tokens until no further records are returned.
- Rate limiting
- Related: REST API pagination, Retry with backoff
A server-side cap on how many requests a client may send in a time window; clients must back off and retry rather than hammering the endpoint.
- JSON response parsing
- Related: REST API pagination, Data type coercion
Converting an API's JSON text into Python objects with the json module, then navigating nested dictionaries and lists to extract the needed fields.
- Web scraping
- Related: HTML parsing, Robots.txt compliance
Programmatically downloading web pages and extracting structured data from their HTML, typically with a parser such as BeautifulSoup rather than fragile text splitting.
- Robots.txt compliance
- Related: Web scraping, Informed consent for data
Checking a site's robots.txt file before automated collection and honoring its disallow rules, along with terms of service and copyright constraints.
- Missing value
- Related: Imputation, Data type coercion
An absent or unrecorded observation, represented in pandas as NaN or None; it must be detected and handled explicitly because it silently breaks many computations.
- Imputation
- Related: Missing value, Outlier
Filling missing values with a substitute such as the mean, median, mode, or a model-based prediction, chosen so the substitution does not distort later analysis.
- Outlier
- Related: Interquartile range, Robust statistic
An observation far from the bulk of the data; it may be a genuine extreme case or a recording error, so it must be investigated rather than deleted automatically.
- Data type coercion
- Related: Missing value, Validation rule
Converting a column to the correct type, such as text digits to integers or strings to datetimes, so that arithmetic, sorting, and joins behave correctly.
- Validation rule
- Related: Data type coercion, Duplicate record
An explicit constraint a dataset must satisfy, such as a range check, uniqueness check, or referential check, used to detect bad records before analysis.
- Duplicate record
- Related: Validation rule
A row that repeats another row's identifying key, often introduced by merges or repeated loads; detection requires deciding which columns define identity.
- DataFrame
- Related: Series, Boolean mask indexing
A pandas two-dimensional table with labeled rows and columns, supporting vectorized operations, grouping, joins, and mixed column types.
- Series
- Related: DataFrame
A pandas one-dimensional labeled array; each column of a DataFrame is a Series, and most aggregation and vectorized operations return one.
- Boolean mask indexing
- Related: DataFrame, GroupBy aggregation
Selecting rows by a condition that yields True or False per row, then using that array to filter the DataFrame; multiple conditions combine with & and |.
- GroupBy aggregation
- Related: Boolean mask indexing, Pivot table
Splitting rows into groups by key values, applying a summary function such as mean or count to each group, and combining the results into a new table.
- Pivot table
- Related: GroupBy aggregation
A reshaped summary that places one variable on rows, another on columns, and aggregated values in cells, useful for comparing groups across two dimensions.
- NumPy broadcasting
- Related: Vectorization
Rules that let arrays of different but compatible shapes be combined in arithmetic without explicit copying, aligning dimensions from the right.
- Vectorization
- Related: NumPy broadcasting
Applying an operation to a whole array at once in compiled code instead of looping in Python, which is faster and usually clearer.
- SQL JOIN
- Related: Primary key, Foreign key
A clause combining rows from two tables on a matching condition; inner, left, right, and full joins differ in which unmatched rows are kept.
- Primary key
- Related: Foreign key, SQL JOIN
A column or column set that uniquely identifies each row in a table and cannot be null; it enforces entity integrity.
- Foreign key
- Related: Primary key, SQL JOIN
A column referencing another table's primary key, enforcing referential integrity so that child rows cannot point at nonexistent parents.
- GROUP BY with HAVING
- Related: SQL JOIN
GROUP BY collapses rows into groups for aggregation, while HAVING filters those groups after aggregation, unlike WHERE which filters individual rows first.
- Transaction commit and rollback
- Related: Connection object
A transaction groups statements so they all succeed or all fail; commit makes changes permanent and rollback undoes uncommitted work after an error.
- Mean versus median
- Related: Standard deviation, Outlier
The mean is the arithmetic average and is sensitive to extreme values; the median is the middle value and resists them, so they diverge in skewed data.
- Standard deviation
- Related: Mean versus median, Interquartile range
The typical distance of observations from the mean, in the original units; a large value indicates high spread around the center.
- Interquartile range
- Related: Outlier, Standard deviation
The range between the 25th and 75th percentiles, covering the middle half of the data; it is a spread measure unaffected by extreme values.
- Null hypothesis
- Related: p-value, Confidence interval
The default claim of no effect or no difference that a significance test tries to reject using observed sample evidence.
- p-value
- Related: Null hypothesis, Type I error
The probability of observing data at least as extreme as the sample if the null hypothesis were true; it is not the probability that the null is true.
- Confidence interval
- Related: Null hypothesis, Standard error
A range built from sample data that, under repeated sampling, would contain the true parameter in a stated percentage of cases.
- Type I error
- Related: p-value
Rejecting a true null hypothesis, a false positive whose rate equals the chosen significance level alpha.
- Standard error
- Related: Confidence interval
The standard deviation of a statistic's sampling distribution; it shrinks as sample size grows and underlies confidence intervals and tests.
- Correlation coefficient
- Related: Linear regression
A standardized number between minus one and one describing the strength and direction of a linear association; it does not by itself establish causation.
- Linear regression
- Related: Residual, R-squared, Overfitting
A model that predicts a numeric target as a weighted sum of input features plus an intercept, fitted by minimizing squared residuals.
- Train-test split
- Related: Overfitting, Cross-validation
Dividing labeled data into a fitting portion and a held-out portion so performance is measured on examples the model never saw.
- Overfitting
- Related: Train-test split, Cross-validation
Fitting training data so closely, including its noise, that the model generalizes poorly to new observations; detected by a large train-versus-test gap.
- Cross-validation
- Related: Train-test split, Overfitting
Repeatedly splitting data into folds, training on some and validating on the rest, then averaging scores for a more stable performance estimate.
- R-squared
- Related: Linear regression, Residual
The proportion of variance in the target explained by the model; it rises with added features, so adjusted R-squared is preferred when comparing models.
- Residual
- Related: Linear regression, R-squared
The difference between an observed value and the model's prediction; residual plots reveal non-linearity, unequal variance, and influential points.
- Figure and Axes
- Related: Chart type selection, Colorblind-safe palette
Matplotlib's two core objects: the Figure is the whole canvas, and each Axes is a plotting area with its own data coordinates, labels, and title.
- Chart type selection
- Related: Figure and Axes, Data-ink ratio
Matching a visual form to the question: bars for category comparison, lines for trends over time, scatter for relationships, histograms for distributions.
- Data-ink ratio
- Related: Chart type selection, Truncated axis
The share of a graphic's ink that encodes actual data; maximizing it means removing gridlines, 3D effects, and decoration that add no information.
- Truncated axis
- Related: Data-ink ratio
Starting a bar chart's value axis above zero, which exaggerates differences; bars must start at zero, though line charts may not need to.
- Colorblind-safe palette
- Related: Figure and Axes
A set of colors distinguishable under common color vision deficiencies, avoiding reliance on red versus green alone to encode categories.
- Context manager
- Related: Exception handling, Resource leak
An object used with the with statement that guarantees setup and cleanup, such as closing a file or database connection even when an exception occurs.
- Exception handling
- Related: Context manager, Custom exception
Catching errors with try, except, else, and finally so a program can recover, log the problem, or clean up instead of crashing abruptly.
- Custom exception
- Related: Exception handling
A user-defined exception class, usually subclassing Exception, that names a specific failure so callers can catch it precisely.
- Resource leak
- Related: Context manager
A file, socket, or connection left open because cleanup was skipped, exhausting handles over time; context managers are the usual prevention.
- Encapsulation
- Related: Inheritance and polymorphism
Bundling data and the methods that operate on it inside a class and exposing only a controlled interface, often via properties and underscore-prefixed attributes.
- Inheritance and polymorphism
- Related: Encapsulation
A subclass reuses and extends a parent class, and objects of different classes can be used through the same interface when they share method names.
- Informed consent for data
- Related: Anonymization, Robots.txt compliance
Collecting and using personal data only after telling people what is gathered, why, and with whom it is shared, and honoring their choice.
- Anonymization
- Related: Informed consent for data, Data minimization
Removing or transforming identifiers so individuals cannot reasonably be re-identified, being stricter than pseudonymization which keeps a reversible mapping.
- Data minimization
- Related: Anonymization
Collecting and retaining only the data actually needed for a stated purpose, reducing breach impact and storage obligations.
- Sampling bias
- Related: Informed consent for data
Systematic distortion from a sample that is not representative of the population, such as surveying only active users of a product.