Confluent Kafka Developer study plan
Confluent Kafka Developer · Give each week a clear focus.
8 weeks · About 7 hours per week
Kafka Fundamentals
Stand up a local single-broker cluster in KRaft mode and create a 3-partition topic with explicit partition and retention settings
Produce and consume records from the CLI and record how key-based partitioning changes which partition a record lands in
Trace a record from producer to consumer by mapping offset, log-end-offset, and consumer position for one consumer group
Explain leader/follower/ISR behavior and write down what acks=all with min.insync.replicas=2 protects against
Your checkpoint
A running local cluster plus a one-page fundamentals sheet containing captured CLI output for partition assignment and consumer-group lag
Kafka Fundamentals & Kafka Application Design
Trigger and observe a consumer-group rebalance by starting a second consumer and then killing a member, logging each state transition
Compare range, round-robin, and cooperative-sticky assignors on the same topic and justify a choice for a skewed-key workload
Derive effective delivery semantics by combining acks, enable.idempotence, and isolation.level in a matrix of at least six configurations
Write three producer configuration profiles (latency-first, throughput-first, durability-first) and defend every non-default setting
Choose a partition key strategy that preserves per-entity ordering without creating hot partitions
Your checkpoint
A rebalance experiment log plus a config-to-tradeoff decision table covering producer durability, consumer assignment, and delivery semantics
Kafka Application Design & Building Data Pipelines with Kafka
Implement an at-least-once consumer that commits offsets manually only after downstream writes succeed, and prove no message is lost when the consumer is killed mid-batch
Implement an idempotent write path and verify duplicate redelivery does not create duplicate rows
Size partition count and key selection for a pipeline with a stated ordering and throughput requirement, showing the arithmetic
Run a Kafka Connect source connector and sink connector end to end with explicit key/value converters
Your checkpoint
A pipeline repository that moves records from a source into a sink through Connect, with a README documenting partition math, offset-commit policy, and restart test results
Building Data Pipelines with Kafka
Build an end-to-end pipeline that survives poison-pill records by routing failures to a dead-letter topic with the exception details preserved
Configure Connect error tolerance and retry behavior and demonstrate both a tolerated and a failed task
Tune consumer fetch.min.bytes, fetch.max.wait.ms, and max.poll.records for a stated latency target and measure the effect
Handle a deserialization failure on the consumer side without stalling the partition
Your checkpoint
A pipeline demo with a dead-letter topic, a scripted failing-record test that shows the bad record in the DLQ and good records still flowing, plus before/after latency numbers for the tuned fetch settings
Confluent Platform and Cloud Components (Schema Registry, Connect, Stream Processing, Governance)
Register schemas for a subject and set compatibility to BACKWARD, then attempt at least four schema evolutions and classify each as accepted or rejected
Reproduce a compatibility failure and read the Schema Registry error response to identify the offending field change
Configure a Connect worker with Schema Registry-backed converters and a single-message transform, and confirm the transform output in the sink
Explain how subject naming strategies affect schema sharing across topics
Your checkpoint
A schema evolution log listing each attempted change, its compatibility verdict, and the registry error text for the rejected cases
Confluent Platform and Cloud Components (Schema Registry, Connect, Stream Processing, Governance)
Write a Kafka Streams topology that performs a stateful aggregation over a tumbling window and inspect the resulting state store
Enable exactly-once processing guarantees and demonstrate that a forced restart does not duplicate aggregate output
Apply access controls so one principal can write to a topic and another can only read it, then verify the denial
Map governance requirements to concrete controls: audit logging, data contracts enforced by schema compatibility, and lineage tracking across the pipeline
Your checkpoint
A running Streams application with a windowed aggregation, a restart test showing no duplicated output under exactly-once, and a governance control checklist mapping each requirement to a verified setting
Kafka Fundamentals & Kafka Application Design & Building Data Pipelines with Kafka & Confluent Platform and Cloud Components (Schema Registry, Connect, Stream Processing, Governance)
Re-run every weak-area item flagged in earlier self-checks and close each one with a written explanation
Work timed question sets per domain and log error causes by category rather than by topic
Re-derive delivery semantics, rebalance behavior, and schema compatibility rules from memory and correct against notes
Review Connect worker versus connector versus task responsibility boundaries until you can state them without notes
Your checkpoint
A remediation log with a row per missed item: cause category, corrected explanation, and a re-test result on that item
Kafka Fundamentals & Kafka Application Design & Building Data Pipelines with Kafka & Confluent Platform and Cloud Components (Schema Registry, Connect, Stream Processing, Governance)
Complete two full-length timed practice runs and record per-domain accuracy
Re-teach the two lowest-scoring domains from scratch using only official documentation
Verify every configuration value used in your projects against current documentation and fix any deprecated or misremembered setting
Write a one-page decision cheat sheet for the choices the exam repeats: partitioning, delivery semantics, connector topology, serialization format, and stream processing guarantees
Your checkpoint
Two scored practice runs with per-domain breakdowns, a list of resolved configuration corrections, and a final one-page decision cheat sheet
Milestones
Week 2: Can explain, without notes, what happens to ordering, duplicates, and offsets when a consumer dies mid-batch and again when acks=1 with a leader failure; rebalance log and config table reviewed and complete
Week 4: End-to-end pipeline with dead-letter routing runs clean on a fresh clone in under 10 minutes, bad records land in the DLQ instead of blocking the partition, and a 30-question mixed set on domains 1-3 scores at least 75%
Week 6: Schema compatibility predictions matched actual registry verdicts on at least 4 of 5 attempts across the plan, and the Streams restart test showed zero duplicated output with exactly-once enabled
Week 8: Both full-length practice runs show at least 80% overall with no domain below 70%, and every item in the remediation log is marked closed