Paddler 🏓
Docs API
Introduction
Using Paddler API
Streaming tokens
Inference service
Continue from conversation history
Continue from raw prompt
Generate embedding batch
WebSocket endpoint
Management service
Get agents
Get agents stream
Get balancer desired state
Get buffered requests
Get buffered requests stream
Get chat template override
Get model metadata
Put balancer desired state
Compatibility services
OpenAI

Get buffered requests

This endpoint gives you the number of requests currently being buffered.

Endpoint

Method: GET
Path: /api/v1/buffered_requests

Response

{
  "buffered_requests_current": 10
}
Get balancer desired state Get buffered requests stream
Endpoint
Response

Made with ❤️ by Intentee and contributors.