If this is a feature request, please fill out the following form in full:
Describe the problem the feature is intended to solve
I cannot access the current servable configuration through gRPC, just update it using
HandleReloadConfigRequest. I would like to be able to see which models are being served, what their base paths are, etc, before deciding to update the configuration (and possibly use the current configuration as a starting point for the new one).
Describe the solution
HandleGetConfigRequest method in
model_service.proto, essentially returning the
ModelServerConfig currently being used by the server.
Describe alternatives you’ve considered
One can try to use the model metadata to figure out some of the information in the server configuration, but in particular I currently see no way of obtaining the servable base paths.
Read more here: Source link