nip.language_model_server.server.get_vllm_server_status#
- async nip.language_model_server.server.get_vllm_server_status() VllmStatusResponse[source]#
Get the status of the vLLM server.
- Returns:
response (VllmStatusResponse) – A data structure containing the status of the vLLM server and any error message if the server is not online.