Working config (gen_api_answer.py --openai-api-base /v1)
The consumer path is fastchat/llm_judge/gen_api_answer.py. --openai-api-base sets legacy openai.api_base to the /v1 root. That is the OpenAI-compatible join for answering against a remote Chat Completions host.
docs/openai_api.md is the server (fastchat.serve.openai_api_server). Do not start a controller or worker to talk to a hosted /v1. Override default gpt-3.5-turbo with a catalog id.
A Chat Completions host whose public catalog is GET https://api.pzero.studio/v1/models (no key) fits --openai-api-base if the value is https://api.pzero.studio/v1.
export OPENAI_API_KEY=<Bearer key for that host>
python gen_api_answer.py \
--model deepseek-v4-flash \
--openai-api-base https://api.pzero.studio/v1
Keep embeddings off this host.
Working config (
gen_api_answer.py --openai-api-base/v1)The consumer path is
fastchat/llm_judge/gen_api_answer.py.--openai-api-basesets legacyopenai.api_baseto the/v1root. That is the OpenAI-compatible join for answering against a remote Chat Completions host.docs/openai_api.mdis the server (fastchat.serve.openai_api_server). Do not start a controller or worker to talk to a hosted/v1. Override defaultgpt-3.5-turbowith a catalog id.A Chat Completions host whose public catalog is
GET https://api.pzero.studio/v1/models(no key) fits--openai-api-baseif the value ishttps://api.pzero.studio/v1.Keep embeddings off this host.