Unable to grpcurl to inference.GRPCInferenceService/ServerLive
Description
I am trying to establish a health check for a grpc triton application, but I am unable to run grpcurl on the inference.GRPCInferenceService/ServerLive rpc endpoint path. When I try this:
grpcurl -plaintext localhost:8001 inference.GRPCInferenceService/ServerLive
it returns this:
Error invoking method "inference.GRPCInferenceService.ServerLive": failed to query for service descriptor "inference.GRPCInferenceService": server does not support the reflection API
Even running
grpcurl -plaintext localhost:8001 list
results in
Failed to list services: server does not support the reflection API
Is the ServerLive health endpoint supposed to be exposed via grpc reflection? Or is there another way to reach the ServerLive endpoint? Or is there yet another way to get grpc service health?
Triton Information
What version of Triton are you using?
Triton version 2.8.0
docker image:
nvcr.io/nvidia/tritonserver:21.03-py3
Read more here: Source link
