nip.language_model_server.types.VllmStopRequest

class nip.language_model_server.types.VllmStopRequest(*, ignore_not_running: bool = False, terminate_timeout: float = 10.0)

A request to stop the vLLM server.

Attributes

__fields_set__
model_computed_fields
model_config	Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].
model_extra	Get extra fields set during validation.
model_fields
model_fields_set	Returns the set of fields that have been explicitly set on this model instance.
ignore_not_running	If True, the server will not raise an error if it is not running.
terminate_timeout	The timeout in seconds to wait for the server to terminate gracefully.

Methods