Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature(ai): enable GAN upscalers with spandrel #176

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

ad-astra-video
Copy link
Collaborator

@ad-astra-video ad-astra-video commented Aug 27, 2024

New addition to stack is adding adding chaiNNer/spandrel to enable adding multiple models.

To ease the downloading of the different checkpoints I made a huggingface repo to bring them in and link to the source repo of the models: https://huggingface.co/ad-astra-video/upscalers. Adding the files to a Huggingface repo also adds some security precautions run on the files when they are uploaded to lessen chance a malicious file is downloaded.

  • Upscale multiple is set by the model and not modified so not change to API needed at this time.
  • Upscale multiple is limited based on size of input. With testing on a A6000, 1024x1024 4x upscale takes about 22GB vram and a 512x512 4x upscale takes 9-12GB vram. There is some variation between models but not significant.

Thoughts on limiting image inputs to 512x512 for upscaling to enable better coverage with 16gb gpu requirement?

*add selected upscalers with permissive licenses
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant