Technologies/Ray/ray_grpc_server_requested_handling
RayRayMetric

ray_grpc_server_requested_handling

Request number are handling in grpc server
Dimensions:None
Available on:DatadogDatadog (1)
Interface Metrics (1)
DatadogDatadog
Request number are handling in grpc server
Dimensions:None
Sources
ray.grpc_server.req.handling.countgithub.com
Related Insights (1)
Ray Serve Backpressure Load Sheddingwarning

Ray Serve deployments reject requests with 503 errors when max_queued_requests limit is exceeded, indicating healthy load shedding but potential capacity issues.

▸