Skip to content

vllm.entrypoints.serve.instrumentator.basic

Functions:

  • kv_event_sources –

    KV-event publisher config per DP rank; empty on render-only servers.

kv_event_sources(raw_request) async

KV-event publisher config per DP rank; empty on render-only servers.

Source code in vllm/entrypoints/serve/instrumentator/basic.py 
59
60
61
62
63
@router.get("/kv_event_sources")
async def kv_event_sources(raw_request: Request):
    """KV-event publisher config per DP rank; empty on render-only servers."""
    client: EngineClient | None = raw_request.app.state.engine_client
    return client.get_kv_event_sources() if client is not None else {}