nip.language_model_server.server.stop_vllm_server

nip.language_model_server.server.stop_vllm_server#

async nip.language_model_server.server.stop_vllm_server(request: VllmStopRequest)[source]#

Stop the vLLM server.

Parameters:

request (VllmStopRequest) – A request containing the ignore_not_running flag.