Implement API to get current server configuration through gRPC (HandleGetConfigRequest method returning a ModelServerConfig)
Table of Contents
Feature Request
If this is a feature request, please fill out the following form in full:
Describe the problem the feature is intended to solve
I cannot access the current servable configuration through gRPC, just update it using HandleReloadConfigRequest
. I would like to be able to see which models are being served, what their base paths are, etc, before deciding to update the configuration (and possibly use the current configuration as a starting point for the new one).
Describe the solution
Define a HandleGetConfigRequest
method in model_service.proto
, essentially returning the ModelServerConfig
currently being used by the server.
Describe alternatives you’ve considered
One can try to use the model metadata to figure out some of the information in the server configuration, but in particular I currently see no way of obtaining the servable base paths.
Read more here: Source link