Kafka Consumer Groups and Rebalancing Explained
How Kafka consumer groups share partitions, what triggers a rebalance, and how cooperative assignment and static membership cut downtime.
Focused explanations and longer guides, with worked scenarios, common mistakes and interview exercises across every chapter.
Showing 25–48 of 825 articles
How Kafka consumer groups share partitions, what triggers a rebalance, and how cooperative assignment and static membership cut downtime.
How Kafka transactions make consume-transform-produce exactly-once, how zombie fencing and read_committed work, and where the guarantee ends.
How the Kafka idempotent producer stops duplicates from retries, what it cannot dedupe, and how batch.size, linger.ms and compression work.
How Kafka consumers commit offsets, why commit order decides at-most-once or at-least-once, and how to get exactly-once effects.
How Kafka partitions and offsets work, why ordering is only per partition, and how keys keep each entity's events in sequence.
Why one bad Kafka record can block a whole partition, and how to handle it with error classification, bounded retries and a dead letter topic.
How Kafka replicates partitions, what the ISR and high watermark mean, and how acks=all with min.insync.replicas prevents data loss.
How Kafka deletes old segments by time or size, how log compaction keeps the latest value per key, and how tombstones delete keys.
What embeddings are, how cosine similarity and approximate nearest neighbour indexes work, and when to add keyword search and reranking.
Build an eval suite for an LLM app: golden datasets, code-based checks, LLM-as-judge calibration, retrieval metrics and regression gates in CI.
Fine-tuning changes how a model behaves; RAG changes what it knows at request time. A decision guide with data prep, costs and failure cases.
How LLM tool use works: schemas, the call-execute-return loop, validation, error results, step limits and when an agent beats a workflow.
Direct and indirect prompt injection, why prompts alone cannot stop it, and layered defenses: tool policy, confirmation and output filtering.
A step-by-step RAG design for interviews: ingestion, structure-aware chunking, hybrid retrieval, grounded prompts with citations and evaluation.
Why LLMs hallucinate and the layered fixes that work: grounding, permission to abstain, citations, structured output and automatic claim checks.
How LLMs turn text into tokens, why the context window is a shared budget, and what temperature, top-k and top-p actually do to the next token.
What bias and variance really measure, how to read validation and learning curves, and which fix to reach for when a model underfits or overfits.
How k-fold cross-validation works, which splitter suits grouped or time data, and how leakage turns pure noise into an 85% accurate model.
How gradient descent updates weights, how batch, stochastic and mini-batch differ, and why learning rate and feature scaling decide convergence.
How to train and evaluate a classifier with rare positives: PR-AUC over accuracy, class weights vs thresholds, and resampling without leakage.
How logistic regression turns a linear score into a probability, why it uses log loss, how to read odds ratios and what separation breaks.
How to spot overfitting, why L1 zeroes weights while L2 only shrinks them, and how scaling, early stopping and dropout fit into regularization.
Precision, recall and F1 from the confusion matrix, how the threshold trades one for the other, and how to pick one that meets a target.
Why a random forest averages away variance while gradient boosting chips away bias, with runnable code, early stopping and when to choose each.
No notes match that… try another filter.