A company is developing a new machine learning model solution in AWS. The models are developed as independent microservices that fetch about 1 GB of model data from Amazon S3 at startup and load the data into memory. Users access the models through an asynchronous API. Users can send a request or a batch of requests and specify where the results should be sent. The company provides models to hundreds of users. The usage patterns for the models are irregular Some models could be unused for days or weeks. Other models could receive batches of thousands of requests at a time. Which solution meets these requirements?

Question

Quizplus · Accepted Answer

This solution uses Amazon ECS to deploy the models, which is suitable for handling large model data and irregular usage patterns. The use of SQS queues allows for asynchronous processing, and AWS Auto Scaling ensures that the ECS cluster and services can scale based on demand, efficiently handling both idle periods and bursts of requests.

A Company Is Developing a New Machine Learning Model Solution