ray_serve_count_http_error_requested
The number of non-200 HTTP responses.Dimensions:None
Available on:
Datadog (1)
Interface Metrics (1)
Related Insights (1)
Ray Serve Backpressure Load Sheddingwarning
Ray Serve deployments reject requests with 503 errors when max_queued_requests limit is exceeded, indicating healthy load shedding but potential capacity issues.
▸