nip.language_model_server.types.VllmServerStatus

Contents

nip.language_model_server.types.VllmServerStatus#

nip.language_model_server.types.VllmServerStatus#

The status of the vLLM server. One of:

  • “online”: The server is running and accepting connections.

  • “not_started”: The server has not been started.

  • “crashed”: The server has exited unexpectedly.

  • “not_accepting_connections”: The server is running but not accepting connections. This can happen if the server is still starting up or if it has crashed.

  • “server_error”: A 5xx error occurred when trying to connect to the server.

  • “other_error”: Any other error occurred when trying to connect to the server.

alias of Literal[‘online’, ‘not_started’, ‘crashed’, ‘not_accepting_connections’, ‘server_error’, ‘other_error’]

Contents