feat(core): More AWEL operators and new prompt manager API

[fangyinc]

• New prompt manager API (Use it in SDK or app)
• AWEL Support streaming response or no streaming with LLMBranchOperator
• New ConversationOperator to save or load conversation in storage
• New BufferedConversationMapperOperator to handle multiple rounds of conversation

[fangyinc]

Now we can run AWEL file in dev mode.

python examples/awel/simple_chat_history_example.py

Output:

INFO:     Started server process [9412]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:5555 (Press CTRL+C to quit)

Then send request to dev server,

DBGPT_SERVER="http://127.0.0.1:5555"

curl -X POST $DBGPT_SERVER/api/v1/awel/trigger/examples/simple_history/multi_round/chat/completions \
            -H "Content-Type: application/json" -d '{
                "model": "gpt-3.5-turbo",
                "context": {
                    "conv_uid": "uuid_conv_1234"
                },                
                "messages": "Who is elon musk?"
            }'

[csunny]

uk_prompt_name_sys_code UNIQUE KEY too long. Maybe it's better prompt_name set 256? and prompt_language set to 10?

sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (1071, 'Specified key was too long; max key length is 3072 bytes')
[SQL: ALTER TABLE prompt_manage ADD CONSTRAINT uk_prompt_name_sys_code UNIQUE (prompt_name, sys_code, prompt_language, model)]
(Background on this error at: https://sqlalche.me/e/20/e3q8)

[fangyinc]

uk_prompt_name_sys_code UNIQUE KEY too long. Maybe it's better prompt_name set 256? and prompt_language set to 10?

sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (1071, 'Specified key was too long; max key length is 3072 bytes')
[SQL: ALTER TABLE prompt_manage ADD CONSTRAINT uk_prompt_name_sys_code UNIQUE (prompt_name, sys_code, prompt_language, model)]
(Background on this error at: https://sqlalche.me/e/20/e3q8)

It has been fix in lastest code.

[csunny]

According to our idea, it is better not to have particularly long names for prompt_name and model_name.

• Recommended prompt_name to be less than 256 bytes
• Recommended model_name to be less than 128 bytes

uk_prompt_name_sys_code varchar length set to 256 + 128 + 32 + 128
@fangyinc How about this？

[fangyinc]

According to our idea, it is better not to have particularly long names for prompt_name and model_name.

• Recommended prompt_name to be less than 256 bytes
• Recommended model_name to be less than 128 bytes

uk_prompt_name_sys_code varchar length set to 256 + 128 + 32 + 128 @fangyinc How about this？

Good advice, done.

[csunny]

Awesome AWEL(Agentic Workflow Expression Language) is all you need. LGTM

[csunny]

How Can I fix this? use export command to set environment variables? can you give some commands?

{"text":"**LLMServer Generate Error, Please CheckErrorInfo.**: base_url is required, please set OPENAI_BASE_URL environment","error_code":1,"model_context":null,"finish_reason":null,"usage":null,"metrics":null}%

[fangyinc]

How Can I fix this? use export command to set environment variables? can you give some commands?

{"text":"**LLMServer Generate Error, Please CheckErrorInfo.**: base_url is required, please set OPENAI_BASE_URL environment","error_code":1,"model_context":null,"finish_reason":null,"usage":null,"metrics":null}%

Yes, if we run AWEL file in dev mode(default use chatgpt model), wo should set environment first.

export OPENAI_API_KEY=sxxxxxx
export OPENAI_API_BASE=https://api.openai.com/v1

[csunny]

@fangyinc Great for that, now i know who is elon musk? 😂

export OPENAI_API_KEY=xxx
export OPENAI_API_BASE=https://api.openai.com/v1

python examples/awel/simple_chat_history_example.py 

curl -X POST http://127.0.0.1:5555/api/v1/awel/trigger/examples/simple_history/multi_round/chat/completions \
            -H "Content-Type: application/json" -d '{
                "model": "gpt-3.5-turbo",
                "context": {
                    "conv_uid": "uuid_conv_1234"
                },
                "messages": "Who is elon musk?"
            }'

[Aries-ckt]

r+