BentoML client fails to connect to gRPC server with HTTP BadStatusLine error

warning

configurationUpdated Mar 3, 2023(via Exa)

Sources

bug: Error using bentoml.client.Client.from_url to create client #3634github.com

Technologies:

BentoMLsubject

How to detect:

When using bentoml.client.Client.from_url to connect to a gRPC-enabled BentoService in version 1.0.15, the client fails with http.client.BadStatusLine error because the HTTP client attempts to parse gRPC protocol responses as HTTP

Recommended action:

Upgrade BentoML to version 1.0.16 or later which includes gRPC client support from PR #3280. Alternatively, configure the BentoService to use HTTP protocol instead of gRPC if client upgrade is not possible. Verify the protocol compatibility between client and server versions before deployment