Streaming SSE client with timeouts/retries; works with NIM/TRT-LLM, vLLM, Ollama, and other OpenAI-style servers.
Required Ruby Version
>= 3.2
Authors
Hal Fulton
Streaming SSE client with timeouts/retries; works with NIM/TRT-LLM, vLLM, Ollama, and other OpenAI-style servers.
>= 3.2
Hal Fulton