nip.language_model_server.types.VllmStatusResponse#
- class nip.language_model_server.types.VllmStatusResponse(*, status: Literal['online', 'not_started', 'crashed', 'not_accepting_connections', 'timeout', 'server_error', 'other_error'], error: str | None)[source]#
A response obtained when checking the vLLM server status.
Attributes
__fields_set__model_computed_fieldsmodel_configConfiguration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].
model_extraGet extra fields set during validation.
model_fieldsmodel_fields_setReturns the set of fields that have been explicitly set on this model instance.
statusThe status of the vLLM server, as defined in ServerStatus.
errorAn error message if the server is not online, otherwise None.
Methods