Cold start
The delay when a request arrives and no instance is warm: the container has to start, and for a model server the weights have to be loaded into GPU memory, which can take minutes.
A definition is not an understanding. This is taught properly in Serving open models yourself, part of Deployment & serving.
Learn this properlyTerms from the same topic