nip.language_model_server.types

Types for the language model server, including request and response structures.

Module Attributes

VllmServerStatus	The status of the vLLM server.
TrainingJobStatus	The status of a training job.
SubprocessOutputDestination	The destination for subprocess output.

Classes

CreateTrainingJobRequest(*, config, dataset)	A request to create a new training job.
LmDpoTrainingConfig(*, beta, learning_rate)	Configuration for Direct Preference Optimization (DPO) training.
LmLoraAdapterConfig(*, r, lora_alpha, ...)	Configuration for a LoRA adapter to be applied on top of a base model.
LmTrainingConfig(*, model_name, method, ...)	Configuration for training a language model with the language model server.
ServerVersionResponse(*, version)	A response containing the version of the language model server.
TrainingJobInfo(*, job_id, status, config, ...)	A data structure representing information about a training job.
VllmStartRequest(*, model_name)	A request to start the vLLM server with a specific model.
VllmStartResponse(*, message, model_name, port)	A response obtained when starting the vLLM server.
VllmStatusResponse(*, status, error)	A response obtained when checking the vLLM server status.
VllmStopRequest(*[, ignore_not_running])	A request to stop the vLLM server.