System requirements

Functional:

content is dynamic, real time updates

user can customize, filter and sort

newsfeed(prioritize, hides, contents)

personal recommendations, ranking by algo

engagement metrics

user interaction notification

privacy control

Non-Functional:

reliability,TP?

performance, 1 sec for loading

scalability?

back up and recovery

final consistency

Capacity estimation

DAU, 1.9billion

1post per user per day = 1.9 B post

4 interactions per post = 5.7 B interactions

each post = 100K, 1.9T per day for User generated contents

API design

1. Create a Post

POST /posts

2. Get Newsfeed

GET /newsfeed/{userId}

3. Like & Comment

POST /posts/{postId}/like

POST /posts/{postId}/comment

Database design

1. Users Table

• user_id (Primary Key)
• name
• friends_list (Array of user_ids)
• following_pages (Array of page_ids)

2. Posts Table

• post_id (Primary Key)
• user_id (Foreign Key)
• content
• media_urls (Array)
• timestamp

3. Newsfeed Table (Precomputed Feeds)

• user_id (Primary Key)
• feed_items (List of post_ids)
• last_updated (Timestamp)

High-level design

Content Ingestion

Feed Generation

Ranking & Personalization

Storage & Caching

Real-Time Updates

Request flows

feed generation models:

push model(fanout on write)

Precompute and store a user’s newsfeed in a Newsfeed Table.

Posts from friends/pages are pushed to followers during creation.

Low latency but requires high storage.

pull model:

The feed is generated dynamically when a user opens the app.

Uses an index of latest posts from followed users.

More scalable, but higher query load.

Hybrid Model (Optimized for Scale)

• Active users → Use Push Model (precomputed feed for fast access).
• Less active users → Use Pull Model (fetch on demand).

Detailed component design

Ranking & Personalization

The ranking model evaluates:

• Engagement Signals – Likes, shares, comments.
• Content Type – Videos > Photos > Text.
• Recency – More recent posts rank higher.
• User Preferences – Past interactions.
• Diversity – Avoid content repetition.
• Ads & Sponsored Posts – Monetization.

💡 Tech Stack:

• Machine Learning (PyTorch, TensorFlow)
• Feature Storage (Redis, Cassandra)
• Ranking Pipeline (Apache Spark, Kafka)

Real-Time Updates

• WebSockets or Push Notifications send updates instantly.
• Kafka Streams process live interactions (likes, comments).
• Edge Caching ensures high-speed delivery.

Storage & Caching Strategy

• Posts & User Data → Cassandra (fast writes, scalable).
• Feed Cache → Redis / Memcached (low latency).
• Cold Storage → S3 / HDFS for archival.

Trade offs/Tech choices

Explain any trade offs you have made and why you made certain tech choices...

Failure scenarios/bottlenecks

High Read Load

Node Failure

Ranking Delays

High Storage Cost

Cache Penetration

Future improvements

Better Personalization – AI-driven interest prediction.

Efficient Storage – Auto-delete inactive feeds.

A/B Testing – Experiment with ranking models.