Introduction
Using Paddler API Streaming tokens
Inference service
Continue from conversation history Continue from raw prompt Generate embedding batch WebSocket endpoint
Management service
Get agents Get agents stream Get balancer desired state Get buffered requests Get buffered requests stream Get chat template override Get model metadata Put balancer desired state Get metrics
Compatibility Services
OpenAI

Get buffered requests

This endpoint gives you the number of requests currently being buffered.

Endpoint

Method: GET
Path: /api/v1/buffered_requests

Response

{
  "buffered_requests_current": 10
}
Get balancer desired state Get buffered requests stream