Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support OpenAI o1 series models via OpenAI API #792

Open
PeterDaveHello opened this issue Sep 25, 2024 · 2 comments
Open

Support OpenAI o1 series models via OpenAI API #792

PeterDaveHello opened this issue Sep 25, 2024 · 2 comments

Comments

@PeterDaveHello
Copy link
Contributor

PeterDaveHello commented Sep 25, 2024

Is your feature request related to a problem? Please describe.

chatGPTBox currently can't use OpenAI's o1 series reasoning models due to some API spec differences. One key issue is that the max_tokens parameter has been deprecated and replaced by max_completion_tokens, which leads to incompatibility with the new models.

Describe the solution you'd like

To support the o1 series models, the following changes and considerations should be made based on the OpenAI API and beta limitations:

  • Replace max_tokens with max_completion_tokens.
  • Limitations during beta:
    • Only user and assistant message types are allowed (no system messages).
    • Streaming, tools, and function calling are not supported.
    • Parameters such as temperature, top_p, and n are fixed at 1.
    • presence_penalty and frequency_penalty are fixed at 0.
@Mohamed3nan
Copy link
Contributor

It's working if you just add the name of the model :D
image

@PeterDaveHello PeterDaveHello changed the title Support OpenAI o1 series models Support OpenAI o1 series models via OpenAI API Oct 1, 2024
@PeterDaveHello
Copy link
Contributor Author

Hey @Mohamed3nan,

Thanks for pointing that out! I should probably update the title to be more precise. This issue is specifically about accessing the o1 series models via the API. When using the web, these issues don't occur because the access method is different.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants