admin/ai-service
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Document vLLM audio URL payloads
All checks were successful
CI / test (push) Successful in 13s
Details
Build and Deploy / build-and-deploy (push) Successful in 16s
Details

Browse Source
This commit is contained in:
Grendgi
2026-06-09 13:49:27 +03:00
parent 1202ebcb7f
commit 88e7c86836
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@@ -59,8 +59,8 @@ Recommended comparison order:
3. `voxtral-small` (`mistralai/Voxtral-Small-24B-2507`) 3. `voxtral-small` (`mistralai/Voxtral-Small-24B-2507`)
Qwen2-Audio and Voxtral are called through an OpenAI-compatible Qwen2-Audio and Voxtral are called through an OpenAI-compatible
`/v1/chat/completions` endpoint with `input_audio`; set their endpoint URLs only `/v1/chat/completions` endpoint with vLLM-style `audio_url` data URLs; set
after the models are actually exposed on the AI server. their endpoint URLs only after the models are actually exposed on the AI server.
AI-server compose snippets for these temporary comparison endpoints live in AI-server compose snippets for these temporary comparison endpoints live in
`deploy/ai-server/docker-compose.audio.yml`. They are profile-gated because the `deploy/ai-server/docker-compose.audio.yml`. They are profile-gated because the