Design Image Processing Infrastructure for real-time analytics

Last updated: May 11, 2026

Quick Overview

Design a multi-tenant image processing system that handles millions of requests. Discuss trade-offs in consistency, availability, and performance.

Shopify
System Design
Software Engineer
Shopify
May 11, 2026
Software Engineer
Technical Screen
System Design
Medium

9

12

328 solved


Design a multi-tenant image processing system that handles millions of requests. Discuss trade-offs in consistency, availability, and performance.

ML system design at Shopify goes beyond model selection. This Technical Screen question evaluates your ability to design end-to-end ML pipelines, from data collection to model serving, while considering production constraints like latency and reliability.

What the Interviewer Expects
  • Define clear ML objectives with appropriate loss functions and metrics
  • Design a comprehensive feature engineering pipeline
  • Discuss model selection with trade-offs (complexity vs interpretability vs latency)
  • Plan online and offline evaluation strategies including A/B testing
  • Address serving infrastructure: batch vs real-time, latency requirements
  • Consider data quality, labeling strategy, and feedback loops
Key Topics to Cover
Feature engineering and feature stores
Model selection and architecture
A/B testing and experimentation
Data collection and labeling strategy
Monitoring and model degradation detection
Online vs offline evaluation
How to Approach This
  1. Start by clarifying functional and non-functional requirements with the interviewer.
  2. Estimate the scale: QPS, storage, bandwidth. This drives your design decisions.
  3. Draw a high-level architecture first, then deep dive into 1-2 critical components.
  4. Discuss trade-offs explicitly (e.g., consistency vs availability, SQL vs NoSQL).
  5. Address failure scenarios, monitoring, and how the system handles 10x traffic spikes.
Possible Follow-up Questions
  • What would you do if model performance degrades over time?
  • How would you handle a 10x increase in prediction requests?
  • How would you ensure fairness and reduce bias in the model?
  • What is your model retraining strategy?
Practice a Similar Problem on Codemia

Solve a related problem with our interactive workspace, get AI feedback, and view detailed solutions.

Solve on Codemia
Sample Answer
Requirements

Functional Requirements

  1. Multi-Tenant Support: The system should support multiple Shopify merchants simultaneously, ensuring data isolation and security.
  2. Real-Time Image Processing: I...
Capacity Estimation

Assuming Shopify has around 1 million active merchants and each merchant uploads 10 images per day, we estimate:

  • Daily Requests: 1,000,000 merchants * 10 images = 10,000,000 images per day.
  • **...

Submit Your Answer
Markdown supported

Related Questions