Design a event-driven Data Pipeline System

Last updated: June 23, 2026

Quick Overview

Design a event-driven data pipeline system handling millions of requests. Discuss consistency, availability, and performance trade-offs.

Walmart
ML System Design
Machine Learning Engineer
Walmart
June 23, 2026
Machine Learning Engineer
Technical Screen
ML System Design
Medium

533

8

177 solved


Design a event-driven data pipeline system handling millions of requests. Discuss consistency, availability, and performance trade-offs.

How to Approach This
  1. Start by mapping the business objective to a concrete ML objective and metric.
  2. Cover the full pipeline: data collection, feature engineering, model selection, training, serving.
  3. Discuss online vs offline evaluation. Plan an A/B test to validate real-world impact.
  4. Address the serving latency budget and whether batch or real-time inference is needed.
  5. Think about the data flywheel: how user feedback improves the model over time.
Practice a Similar Problem on Codemia

Solve a related problem with our interactive workspace, get AI feedback, and view detailed solutions.

Solve on Codemia
Sample Answer
Problem Formulation

The primary business problem for Walmart is to efficiently process and analyze event-driven data from millions of customer interactions, inventory changes, and transactions in real-time. This can be f...

Data & Features

The data sources for this system would include:

  • Point of Sale (POS) transactions: Capturing real-time sales data, including product IDs, quantities sold, timestamps, and payment methods.
  • **Inv...

Submit Your Answer
Markdown supported

Related Questions