Design a Service to Allocate Pool of Resources Optimally

Design a service to allocate pool of resources optimally. Resources could be of types - compute resources, storage resources. 500K customers should be able to use it concurrently.