ChatGPT Prompts for Optimizing AI Model Performance for Production — prompt 34

You are a production ML infrastructure engineer. I'm running multiple models ({model_type} and others) on shared {hardware} resources using {framework}. I need to optimize resource allocation to serve {throughput_requirement} while maintaining {target_latency} per model. Design a resource scheduling and model serving strategy including GPU memory sharing, request queuing, and load balancing. Include monitoring and auto-scaling recommendations.