Design a event-driven Data Pipeline System
Last updated: June 23, 2026
Quick Overview
Design a event-driven data pipeline system handling millions of requests. Discuss consistency, availability, and performance trade-offs.
Walmart
ML System Design
Machine Learning Engineer
Walmart
June 23, 2026Machine Learning Engineer
Technical Screen
ML System Design
Medium
533
8
177 solved
Design a event-driven data pipeline system handling millions of requests. Discuss consistency, availability, and performance trade-offs.
How to Approach This
- Start by mapping the business objective to a concrete ML objective and metric.
- Cover the full pipeline: data collection, feature engineering, model selection, training, serving.
- Discuss online vs offline evaluation. Plan an A/B test to validate real-world impact.
- Address the serving latency budget and whether batch or real-time inference is needed.
- Think about the data flywheel: how user feedback improves the model over time.
Practice a Similar Problem on Codemia
Solve a related problem with our interactive workspace, get AI feedback, and view detailed solutions.
Solve on CodemiaSample Answer
Problem Formulation
The primary business problem for Walmart is to efficiently process and analyze event-driven data from millions of customer interactions, inventory changes, and transactions in real-time. This can be f...
Data & Features
The data sources for this system would include:
- Point of Sale (POS) transactions: Capturing real-time sales data, including product IDs, quantities sold, timestamps, and payment methods.
- **Inv...
Submit Your Answer
Markdown supported