DesignElementary~20 min
Design Log Collection and Analysis System
system-designloggingmonitoringanalytics
Problem
Design a centralized log management system that can collect, store, and search large volumes of logs from multiple microservices.
Requirements
- Log collection from distributed systems
- Real-time log streaming
- Full-text search functionality
- Filtering by log level (ERROR, WARN, INFO, etc.)
- Time-series log display
- Long-term log storage and archiving
- Alert functionality (pattern detection)
- Dashboard visualization
- Process 10TB of logs per day
Constraints
- Log search response time within 3 seconds
- Log loss rate below 0.1%
- Searchable logs for 90 days
- Cost-effective storage strategy
Constraints
- Log search response time within 3 seconds
- Log loss rate below 0.1%
- Searchable logs for 90 days
- Cost-effective storage strategy
Your Answer
Minimum 100 characters (100 more characters)
Minimum 80 characters (80 more characters)
Minimum 80 characters (80 more characters)
Minimum 60 characters (60 more characters)
Minimum 60 characters (60 more characters)
Minimum 50 characters (50 more characters)
Minimum 50 characters (50 more characters)
Minimum 50 characters (50 more characters)
Answer Progress0 / 8 sections
Please fill all sections with the minimum character count
Model Answer
Submit your answer or click "Show" to view the model answer.