Batch vs Online Inference: Choosing How to Serve a Model
When to score models in a nightly batch job and when behind a low-latency API, with tail-latency budgets, fallbacks and the hybrid pattern.
Focused explanations and longer guides, with worked scenarios, common mistakes and interview exercises across every chapter.
Showing 49–72 of 825 articles
When to score models in a nightly batch job and when behind a low-latency API, with tail-latency budgets, fallbacks and the hybrid pattern.
How CI, CD and continuous training fit together for ML, which tests gate a pipeline, retraining triggers, and Google's MLOps maturity levels.
How data drift, concept drift and prediction drift differ, how PSI and the KS test measure them, and why p-value alerts drown your team in noise.
Treat prompts as versioned releases: register and alias them in MLflow, trace every call, and block regressions with an evaluation gate in CI.
Log params, metrics and models with MLflow 3, compare runs with search_runs, and promote or roll back models by moving registry aliases.
What it takes to rebuild a model months later: code commit, data snapshot and hash, config, seeds, environment and the registered artifact.
How shadow mode, canary releases and A/B tests de-risk a new model, what each can measure, sticky user bucketing, and rolling back safely.
Why models that ace offline tests fail live: duplicated feature code, refitted scalers, future-leaking joins, and how feature stores stop them.
How the App Router differs from the Pages Router in Next.js 15, how data fetching maps across, and how to migrate one route at a time.
Request memoization, the Data Cache, the Full Route Cache and the Router Cache in Next.js 15, and how to debug a page that shows stale data.
Why React reports that server HTML did not match the client in Next.js 15, how to find the cause, and fixes for dates, browser APIs and nesting.
What Next.js 15 middleware can do, how matchers decide where it runs, and why real authorisation still belongs next to your data.
How Server Actions turn a function into a POST endpoint in Next.js 15, how to build forms with useActionState, and how to secure every action.
How Server and Client Components render in the Next.js 15 App Router, where to put use client, and how to keep secrets out of the bundle.
When Next.js 15 renders a page at build time, per request or with background regeneration, and how to prove which one a route uses.
How loading.tsx and Suspense stream a Next.js 15 page, where error.tsx catches failures, and why a slow layout or late notFound breaks the plan.
Cache-aside, write-through and write-behind with Redis, a safe invalidation order, and working code that stops a cache stampede.
Strings, hashes, lists, sets, sorted sets, streams, HyperLogLog and bitmaps: what each Redis type costs and which interview use case it fits.
Build a correct Redis lock with SET NX PX and a token-checked release, add fencing tokens, and explain the Redlock algorithm and its critique.
How Redis expires keys lazily and actively, what each maxmemory-policy evicts, and how approximated LRU and LFU choose a victim.
How RDB snapshots and the append-only file work, how much data each appendfsync setting can lose, and how to enable AOF without losing data.
Fixed window, sliding log and token bucket rate limiters in Redis, why they must be atomic, and tested Lua scripts for each one.
How Redis replicates asynchronously, how Sentinel fails over, and how Cluster shards keys into 16,384 hash slots with MOVED and ASK redirects.
Why one Redis thread handles huge request rates, what io-threads and background threads change, and which commands block every client.
No notes match that… try another filter.