ICML case studies
ICML · Put your knowledge to work in context.
The ICML (International Certified Machine Learning) credential is a vendor-neutral certification for practitioners who build, evaluate, and operate machine learning systems in production settings. It suits data scientists, ML engineers, and technical leads who want an independent signal that their knowledge spans the full lifecycle rather than a single library or cloud platform. The ICML case studies are 5 cases and about 2,739 words.
1Calibrating a Rare-Event Risk Model Under a Fixed Precision Budget
A fraud team deploys a gradient-boosted classifier on 1.2M monthly transactions with a 0.4% positive rate. The model outputs a probability, but the downstream rules engine only accepts a hard flag.
579 words, about 3 min2Feature Leakage in a Churn Pipeline
A subscription company builds a churn model. The pipeline computes, for each customer, 'days since last login', 'support tickets 30d', and 'avg session minutes 90d', then trains logistic regression with 5-fold cross-validation and reports AUC 0.93.
622 words, about 3 min3Choosing Between a Complex Model and a Simple One Under Distribution Shift
A hospital readmission model is being chosen between a regularized logistic regression (validation AUC 0.79) and a deep neural network (validation AUC 0.84) trained on three years of data from 12 hospitals. A new 13th hospital with a different patient mix and coding practices will go live next quarter.
506 words, about 3 min4Clustering Customer Segments When the 'Right' Number Is Contested
A retail analytics team runs k-means on 40 standardized behavioral features for 500k customers. The elbow plot is ambiguous, the silhouette score peaks at k=2 (0.31) and declines slowly to k=8 (0.24), and the business wants 5-7 actionable segments.
509 words, about 3 min5Deploying a Model Card When Subgroup Performance Is Uneven
A lending model predicts default probability to prioritize manual underwriting review. Overall validation AUC is 0.81, but disaggregated results show AUC 0.83 for the majority group and 0.74 for a smaller demographic subgroup that is 6% of applicants.
523 words, about 3 min