nip.language_model_server.types.VllmStopRequest

Contents

nip.language_model_server.types.VllmStopRequest#

class nip.language_model_server.types.VllmStopRequest(*, ignore_not_running: bool = False)[source]#

A request to stop the vLLM server.

Attributes

__fields_set__

model_computed_fields

model_config

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

model_extra

Get extra fields set during validation.

model_fields

model_fields_set

Returns the set of fields that have been explicitly set on this model instance.

ignore_not_running

If True, the server will not raise an error if it is not running.

Methods