Add AI provider configuration
This commit is contained in:
14
README.md
14
README.md
@@ -41,9 +41,23 @@ service.
|
||||
- `HTTP_PORT`, default `8080`
|
||||
- `DATABASE_URL`, required
|
||||
- `MIGRATE_ON_START`, default `true`
|
||||
- `LLM_BASE_URL`, primary OpenAI-compatible LLM endpoint
|
||||
- `LLM_API_KEY`, primary LLM API key
|
||||
- `LLM_MODEL`, default `qwen2.5-14b`
|
||||
- `LLM_TIMEOUT`, default `5m`
|
||||
- `WHISPERX_URL`, WhisperX endpoint for transcription jobs
|
||||
- `OPENCLAW_URL`, optional OpenClaw gateway URL if we route through OpenClaw
|
||||
instead of direct vLLM
|
||||
|
||||
## Next integration step
|
||||
|
||||
`telephony` should first mirror low-risk analysis jobs into this service while
|
||||
continuing local processing. Remote execution can then be enabled by feature
|
||||
flag per task type.
|
||||
|
||||
## OpenClaw note
|
||||
|
||||
Current Portal services call the local AI server directly: vLLM for LLM tasks
|
||||
and WhisperX for transcription. OpenClaw is not required for the current
|
||||
`ai-service` queue deployment. It becomes useful if we want centralized model
|
||||
routing, provider fallback, request policy and cross-model gateway behavior.
|
||||
|
||||
Reference in New Issue
Block a user