watsonx GenAI Engineer study plan
watsonx GenAI Engineer · Give each week a clear focus.
8 weeks · About 7 hours per week
Foundation models and prompt engineering
Map the anatomy of a foundation model: tokenization, embeddings, attention, decoding, and context window limits, and state how each shapes prompt behavior
Compare model families available in watsonx (Granite and third-party options) on size, context length, licensing, and task fit, and justify a model choice for two sample use cases
Write and iterate zero-shot, few-shot, and chain-of-thought prompts for a classification task and a summarization task, recording how each change affected output quality
Identify and fix five common prompt failure modes: ambiguous instructions, conflicting constraints, missing output format, hallucinated facts, and prompt injection exposure
Your checkpoint
A 10-12 prompt engineering notebook with before/after outputs for two tasks, a model selection comparison table, and a short written rationale for each prompt revision
Retrieval-augmented generation and vector search
Explain the RAG pipeline end to end: ingestion, chunking, embedding, indexing, retrieval, reranking, and grounded generation
Configure a vector index in watsonx and compare dense, sparse, and hybrid retrieval on the same document set
Tune chunk size and overlap and measure the effect on retrieval precision for a fixed question set
Attach citations and guardrail instructions so generated answers stay grounded in retrieved passages and abstain when evidence is missing
Your checkpoint
A working RAG prototype over 50+ pages of your own documents with a 20-question evaluation sheet showing retrieved chunks, answer correctness, and citation accuracy
Generative AI application development and orchestration
Design a multi-step orchestration flow that chains prompt templates, retrieval, tool calls, and output validation
Implement at least two tool or function calls and handle failure, timeout, and retry paths
Add conversation memory and session state to a chat-style application and verify context does not leak across sessions
Apply input and output guardrails against prompt injection, unsafe content, and PII leakage
Your checkpoint
A deployed orchestration demo with a flow diagram, error-handling notes, and a test log of at least 15 scripted interactions including adversarial inputs
watsonx platform fundamentals and architecture
Describe the watsonx platform architecture: control plane versus runtime services, projects and spaces, model inference endpoints, and identity and access boundaries
Provision a project, assign roles, and connect a data source and a model endpoint using least-privilege access
Trace a single request from client to model inference and back, naming each component it passes through
Compare watsonx.ai, watsonx.data, and watsonx.governance responsibilities and state which service owns which artifact
Your checkpoint
A one-page architecture diagram of your own solution with labeled components plus a role and permission matrix for three personas
Model tuning and customization
Distinguish prompt engineering, RAG, fine-tuning, and parameter-efficient tuning by cost, data requirement, and when each is the right answer
Prepare a small instruction dataset in the required JSONL format with train and validation splits and document your labeling rules
Run a tuning job on a small model and compare tuned versus base output on a held-out prompt set
Evaluate tuning results with task-specific metrics and decide whether to keep, adjust, or abandon the tuned model
Your checkpoint
A tuning experiment report with dataset statistics, hyperparameters, base-versus-tuned comparison on 15 held-out prompts, and a keep-or-abandon recommendation
AI governance, risk, and compliance with watsonx.governance
Enumerate the governance lifecycle: use case intake, risk assessment, model factsheet, evaluation, approval, and ongoing monitoring
Configure fairness, drift, and quality monitors for a deployed model and interpret the resulting metrics
Draft a model factsheet and risk register entry for your week-3 application, naming owners and mitigation controls
Map your solution to a regulatory or internal policy framework and identify the evidence each control requires
Your checkpoint
A governance package for one use case containing a completed factsheet, risk register with at least eight risks and mitigations, and a monitoring configuration screenshot-free description
Deployment, monitoring, and lifecycle operations & Data preparation and integration for generative AI
Deploy a tuned or prompted model to a serving endpoint and configure autoscaling, rate limits, and versioning
Instrument the application with logging, latency and token-usage tracking, and quality sampling on live traffic
Build a data preparation pipeline that cleans, deduplicates, chunks, and embeds source documents and can be rerun idempotently
Define promotion, rollback, and deprecation criteria for a model version and document the runbook
Your checkpoint
An operations runbook plus a reproducible data pipeline script that rebuilds the vector index from raw sources in one command
watsonx platform fundamentals and architecture & Foundation models and prompt engineering & Retrieval-augmented generation and vector search & Model tuning and customization & AI governance, risk, and compliance with watsonx.governance & Generative AI application development and orchestration & Deployment, monitoring, and lifecycle operations & Data preparation and integration for generative AI
Re-derive the key decision points across all eight domains from memory and list every gap with a confidence rating
Retake a timed 60-question mixed practice set and review every wrong answer to its root concept
Rehearse explaining your capstone architecture, tuning decision, and governance controls aloud in under ten minutes
Close remaining weak spots with targeted review rather than full re-reading
Your checkpoint
A scored 60-question practice result with a written gap list, a corrected-answer log, and a final one-page cheat sheet covering all eight domains
Milestones
Week 2: You can explain why a RAG answer failed by pointing to a specific stage: chunking, retrieval, reranking, or generation
Week 3: Your orchestration demo survives at least five adversarial prompts without leaking system instructions or ungrounded claims
Week 4: You can sketch the watsonx request path and permission model on a whiteboard without notes
Week 5: You can state in one sentence when fine-tuning beats RAG for a given problem and defend the choice with cost and data arguments
Week 6: Your governance package would pass an internal review: every named risk has an owner, a control, and monitoring evidence
Week 8: Practice score is at or above your target pass margin and no domain remains rated low-confidence