A/B Test Sample Size and the Peeking Problem: Interview Guide
Size an A/B test from baseline, MDE, alpha and power, turn it into days, and see by simulation why stopping at the first p below 0.05 fails.
Focused explanations and longer guides, with worked scenarios, common mistakes and interview exercises across every chapter.
Showing 1–24 of 825 articles
Size an A/B test from baseline, MDE, alpha and power, turn it into days, and see by simulation why stopping at the first p below 0.05 fails.
Solve the classic 1% disease test question three ways, see why rare events wreck precision, and avoid the base rate traps interviewers set.
What the central limit theorem really promises, shown by simulation on skewed revenue data, and where it quietly breaks in A/B tests.
What 95% confidence really means, how to build t, Wilson and bootstrap intervals in Python, and why the textbook proportion interval fails.
The OLS assumptions interviewers expect, which violations bias coefficients and which only break standard errors, with Python checks for each.
What a p-value actually measures, how to run a two-proportion test by hand in Python, and the misreadings that sink data science candidates.
Why a variant can win in every segment yet lose overall, how to standardise for mix, and how to tell confounders from causes in product data.
Pick the right test from the data type and design: two-proportion z-tests, Welch and paired t-tests, and chi-square, each run in Python.
How SGD, momentum, Adam and AdamW update weights, why AdamW decouples weight decay, and how warmup and cosine decay keep training stable.
How backpropagation applies the chain rule layer by layer, worked by hand on a tiny network with softmax cross-entropy and a gradient check.
How batch norm and layer norm compute their statistics, why model.eval() matters, why small batches hurt, and why transformers use LayerNorm.
How a conv layer slides a kernel, the output size and parameter formulas, pooling, and how receptive field grows, with runnable Python.
How to spot overfitting in loss curves, why inverted dropout scales by 1/(1-p), and how weight decay, augmentation and early stopping help.
How RNNs, LSTMs and GRUs process sequences, why gradients vanish through time, how gates fix it, and how to count each model's parameters.
Compute softmax(QK^T/sqrt(d_k))V by hand, see why the scaling matters, then add causal masks, multiple heads and a KV cache memory budget.
Why gradients vanish or explode in deep networks, measured layer by layer, and how He and Xavier init, residuals and clipping fix it.
When a Go channel send blocks, what buffering changes, who closes a channel, and how select, nil channels and timeouts fit together.
How context cancellation propagates through a Go call tree, why cancel must always be called, and how to stop goroutines on a deadline.
How fmt.Errorf with %w builds an error chain in Go, when to use errors.Is versus errors.As, and how to design sentinel and typed errors.
How goroutines differ from OS threads, how the GMP scheduler maps them onto CPUs, and what GOMAXPROCS, preemption and syscalls change.
What counts as a data race in Go, how sync.Mutex and WaitGroup fix it, and how go test -race finds the race before production does.
Why a nil pointer returned as an error makes err != nil true in Go, how interface values store type and value, and how to avoid it.
How a Go slice header works, when append reallocates, why two slices can overwrite each other, and how to copy safely with Clone.
How to bound concurrency in Go with a worker pool or errgroup, why early returns leak goroutines, and how to find leaks with pprof.
No notes match that… try another filter.