Dataiku ML Practitioner study materials
Dataiku ML Practitioner study resources

Dataiku ML Practitioner study plan

Dataiku ML Practitioner · Give each week a clear focus.

8 weeks · About 6 hours per week

Week 1

Visual machine learning

  • Map the visual machine learning workflow end to end: identify where dataset preparation, feature handling, model training, evaluation, and deployment sit in the tool's interface.

  • Configure a project with a train/test split and a target variable, then explain in writing why the chosen split strategy fits the data.

  • Train at least three baseline algorithms (for example a regularized linear model, a tree ensemble, and a gradient boosting model) on the same dataset and compare their default metrics.

  • Record which preprocessing steps (missing value handling, encoding, scaling) each algorithm applies automatically versus which require manual configuration.

Your checkpoint

A one-page comparison table of three trained baseline models on one dataset, listing the metric values and the preprocessing each model applied by default.

Week 2

Visual machine learning

  • Diagnose overfitting and underfitting by training the same model at several complexity settings and plotting training versus validation performance.

  • Configure cross-validation for a model and compare its score against a single holdout split, explaining the difference in variability.

  • Interpret per-feature importance and partial dependence outputs for a tree-based model, then write what each tells you and what it does not.

  • Tune at least two hyperparameters using a search strategy and justify the search space you chose.

Your checkpoint

A tuning log for one model showing at least six hyperparameter configurations, their validation scores, and a short paragraph justifying the final choice.

Week 3

Visual machine learning

  • Select evaluation metrics appropriate to the problem type and class balance, and compute them on the same model to show how the ranking of models can change.

  • Build a confusion matrix and threshold analysis for a binary classifier, then pick an operating threshold with a stated business rationale.

  • Handle class imbalance using at least two techniques and compare their effect on the chosen metric.

  • Detect and address data leakage by auditing the feature set for target-derived or time-violating columns.

Your checkpoint

A written evaluation report for one classifier covering metric choice, threshold selection, imbalance handling comparison, and a leakage audit checklist.

Week 4

Visual machine learning

  • Deploy a trained model to a scoring endpoint and score a fresh dataset through it.

  • Set up a retraining or evaluation workflow that recomputes model metrics on new labeled data.

  • Document the model's inputs, outputs, assumptions, and known limitations in a model card.

  • Review the full visual ML domain and list the three subtopics you understand least.

Your checkpoint

A deployed model plus a completed model card and a scored output dataset, submitted as a single project summary.

Week 5

Interactive statistics

  • Compute and interpret descriptive statistics for numeric and categorical variables, including distribution shape and outlier flags.

  • Build univariate visualizations for at least four variable types and state which question each chart answers.

  • Distinguish mean, median, and trimmed statistics on a skewed variable and explain when each is the right summary.

  • Identify missing data patterns and quantify the share of missingness per column.

Your checkpoint

A univariate profiling document covering at least eight variables with the chosen summary statistics and a one-sentence interpretation for each.

Week 6

Interactive statistics

  • Compute correlation coefficients across numeric variables and separate correlation from causation in written interpretation.

  • Run hypothesis tests for group differences and for association between categorical variables, then report effect size alongside p-values.

  • Check test assumptions and choose a nonparametric alternative when assumptions fail.

  • Interpret confidence intervals and explain what they do and do not say about a single sample.

Your checkpoint

A bivariate analysis write-up with at least three tests, each including the null hypothesis, test statistic, p-value, effect size, and a plain-language conclusion.

Week 7

Interactive statistics

  • Build a multivariate view combining at least three variables and describe interaction effects visible in the data.

  • Segment the dataset using grouping and aggregation, then compare segment-level statistics against the overall population.

  • Detect Simpson's paradox or a confounding pattern in your dataset or a constructed example, and explain the mechanism.

  • Create a chart that communicates a finding to a nontechnical audience and critique it for misleading scale or framing.

Your checkpoint

A segment comparison report with at least four groups, a population baseline, and one documented confounding or interaction finding.

Week 8

Visual machine learning & Interactive statistics

  • Re-run every weak-area exercise flagged in week 4 and in the statistics review, scoring each attempt against a written rubric.

  • Complete two timed mixed-domain practice sets covering both visual ML and interactive statistics under exam-like conditions.

  • Explain the connection between statistical testing and model evaluation metrics in a short written synthesis.

  • Consolidate a personal error log of recurring mistakes with the corrective rule for each.

Your checkpoint

Two completed timed practice sets with scores plus a final error log of at least ten entries, each paired with a corrective rule.

Milestones

Week 2: Can train, tune, and interpret a model without notes, and correctly explain the difference between a holdout score and a cross-validation score.

Week 4: Has a deployed model, a model card, and a written list of the three weakest visual ML subtopics to revisit in week 8.

Week 6: Can select an appropriate hypothesis test for a stated question, check its assumptions, and report both p-value and effect size unaided.

Week 8: Scores at or above the self-set target on both timed mixed-domain practice sets and has a complete error log with corrective rules.