nip.language_model_server.types.VllmStatusResponse

nip.language_model_server.types.VllmStatusResponse#

class nip.language_model_server.types.VllmStatusResponse(*, status: Literal['online', 'not_started', 'crashed', 'not_accepting_connections', 'server_error', 'other_error'], error: str | None)[source]#

A response obtained when checking the vLLM server status.

Attributes

__fields_set__

model_computed_fields

model_config

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

model_extra

Get extra fields set during validation.

model_fields

model_fields_set

Returns the set of fields that have been explicitly set on this model instance.

status

The status of the vLLM server, as defined in ServerStatus.

error

An error message if the server is not online, otherwise None.

Methods