Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(ai): add pipelines optimization flags #3013

Merged
merged 3 commits into from
Apr 16, 2024
Merged

Commits on Apr 15, 2024

  1. feat(ai): add pipelines optimization flags

    This commit adds a new `OptimizationFlags` field to the `aiModels`
    config so that users can forward optimization environment variables to
    the [ai-worker]([email protected]:livepeer/ai-worker.git) for more
    information see livepeer/ai-worker#61.
    rickstaa committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    52dadff View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2024

  1. chore: update ai-worker to latest commit

    This commit ensures that the https://github.com/livepeer/ai-worker
    dependency is on the latest commit that includes the new optimization
    flags feature (see livepeer/ai-worker#61).
    rickstaa committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    bb50339 View commit details
    Browse the repository at this point in the history
  2. refactor: improve OptFlags logging

    This commit ensures that the `optimzation flag not supported` warning
    is shown for each model that is not loaded warm.
    rickstaa committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    fd3397a View commit details
    Browse the repository at this point in the history