We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
嵌入模型和总结模型都是openai api,源码部署运行脚本时,说缺model_path,但是没有,咋填?文档没有提示,写None也没用
https://docs.dbgpt.site/docs/faq/install
The text was updated successfully, but these errors were encountered:
embedding model use openai
#EMBEDDING_MODEL=proxy_openai #proxy_openai_proxy_server_url=http://xxx/api/openai/v1 #proxy_openai_proxy_api_key=sk-xx #proxy_openai_proxy_backend=text-embedding-ada-002
llm service use openai
PROXY_API_KEY=sk-xxx PROXY_SERVER_URL=http://xxx/api/openai/v1
Sorry, something went wrong.
嵌入模型使用 openai #EMBEDDING_MODEL=proxy_openai #proxy_openai_proxy_server_url=http://xxx/api/openai/v1 #proxy_openai_proxy_api_key=sk-xx #proxy_openai_proxy_backend=text-embedding-ada-002 llm 服务使用 openai PROXY_API_KEY=sk-xxx PROXY_SERVER_URL=http://xxx/api/openai/v1
嵌入模型使用 openai
llm 服务使用 openai
我是使用swift微调了qwen2.5-14B-instruct,然后部署到本地, 我可以使用curl http://172.16.15.242:8000/v1/chat/completions -H "Content-Type: application/json" -d '{ "model": "qwen2_5-14b-instruct", "messages": [{"role": "user", "content": "你是谁?"}], "stream":true }' 进行访问我部署的微调模型,但是我该怎么使用DB- GPT去调起我本地部署的大模型服务? 我之前试过像调OpenAI的接口那样,但是会报错,报错信息如下: 我该怎么解决这个问题呢,这个问题已经困惑我很久,希望能得到解决。
LLM_MODEL=proxyllm PROXY_SERVER_URL=http://172.16.15.242:8000/v1/chat/completions PROXYLLM_BACKEND=qwen2_5-14b-instruct
谢谢你,已解决!
No branches or pull requests
Search before asking
Description
嵌入模型和总结模型都是openai api,源码部署运行脚本时,说缺model_path,但是没有,咋填?文档没有提示,写None也没用
Documentation Links
https://docs.dbgpt.site/docs/faq/install
Are you willing to submit PR?
The text was updated successfully, but these errors were encountered: