nip.language_model_server.types.VllmStartResponse

class nip.language_model_server.types.VllmStartResponse(*, message: str, model_name: str, port: int)

A response obtained when starting the vLLM server.

Attributes

__fields_set__
model_computed_fields
model_config	Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].
model_extra	Get extra fields set during validation.
model_fields
model_fields_set	Returns the set of fields that have been explicitly set on this model instance.
message	A message indicating the result of the start operation.
model_name	The name of the model that the vLLM server is serving.
port	The port on which the vLLM server is running.

Methods