fix bug - Tongyiproxy embedding model error #2018
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
raw issues:
#1748
why cause this bug:batch size too longer may cause embedding error
qwen online embedding models must not be larger than 25
error detail:
{"status_code": 400, "request_id": "cabd7ddb-386c- 9a25-a488-94fb05b4f8b8", "code": "InvalidParameter", "message": "batch size is invalid, it should not be larger than 25.: payload.input.contents", "output": null, "usage": null}
how to solve this issue
data streaming processing
How Has This Been Tested?
Use tongyi embedding: text-embedding-v1
Start DB-GPT and pass in the pdf file for parsing