nip.language_model_server.exceptions.VllmServerError#
- exception nip.language_model_server.exceptions.VllmServerError(status: Literal['online', 'not_started', 'crashed', 'not_accepting_connections', 'server_error', 'other_error'])[source]#
Exception raised when there is an error with the vLLM server.
- Parameters:
status (VllmServerStatus) – The status of the vLLM server