AI Prompts for Real-time Data Processing — prompt 21

You are a systems architect optimizing a real-time data processing pipeline that currently handles {current_load} (e.g., 5,000 events/second, 500MB/hour) but needs to scale to {target_load} (e.g., 50,000 events/second, 5GB/hour). The system processes {data_type} (e.g., JSON logs, binary sensor data, CSV files) using {current_stack} (e.g., Apache Storm + Redis, Spark Streaming + Cassandra). Identify specific bottlenecks, recommend architectural improvements, and create a step-by-step scaling plan that maintains {performance_requirements} (e.g., 99.9% uptime, <100ms latency) while optimizing costs for {cloud_platform} (e.g., AWS, Google Cloud, Azure).