nip.language_model_server.types.VllmStatusResponse#
- class nip.language_model_server.types.VllmStatusResponse(*, status: Literal['online', 'not_started', 'crashed', 'not_accepting_connections', 'server_error', 'other_error'], error: str | None)[source]#
A response obtained when checking the vLLM server status.
Attributes
__fields_set__
model_computed_fields
model_config
Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].
model_extra
Get extra fields set during validation.
model_fields
model_fields_set
Returns the set of fields that have been explicitly set on this model instance.
status
The status of the vLLM server, as defined in ServerStatus.
error
An error message if the server is not online, otherwise None.
Methods