Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add StableDiffusion3 #1820

Merged
merged 62 commits into from
Sep 25, 2024
Merged

Commits on Sep 11, 2024

  1. Add VGG16 backbone (keras-team#1737)

    * Agg Vgg16 backbone
    
    * update names
    
    * update tests
    
    * update test
    
    * add image classifier
    
    * incorporate review comments
    
    * Update test case
    
    * update backbone test
    
    * add image classifier
    
    * classifier cleanup
    
    * code reformat
    
    * add vgg16 image classifier
    
    * make vgg generic
    
    * update doc string
    
    * update docstring
    
    * add classifier test
    
    * update tests
    
    * update docstring
    
    * address review comments
    
    * code reformat
    
    * update the configs
    
    * address review comments
    
    * fix task saved model test
    
    * update init
    
    * code reformatted
    divyashreepathihalli authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    b681ea3 View commit details
    Browse the repository at this point in the history
  2. Add ResNetBackbone and ResNetImageClassifier (keras-team#1765)

    * Add ResNetV1 and ResNetV2
    
    * Address comments
    james77777778 authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    33854c6 View commit details
    Browse the repository at this point in the history
  3. Add CSP DarkNet backbone and classifier (keras-team#1774)

    * Add CSP DarkNet
    
    * Add CSP DarkNet
    
    * snake_case function names
    
    * change use_depthwise to block_type
    sachinprasadhs authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    dd8df26 View commit details
    Browse the repository at this point in the history
  4. Add FeaturePyramidBackbone and port weights from timm for `ResNet…

    …Backbone` (keras-team#1769)
    
    * Add FeaturePyramidBackbone and update ResNetBackbone
    
    * Simplify the implementation
    
    * Fix CI
    
    * Make ResNetBackbone compatible with timm and add FeaturePyramidBackbone
    
    * Add conversion implementation
    
    * Update docstrings
    
    * Address comments
    james77777778 authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    7381b6d View commit details
    Browse the repository at this point in the history
  5. Add DenseNet (keras-team#1775)

    * Add DenseNet
    
    * fix testcase
    
    * address comments
    
    * nit
    
    * fix lint errors
    
    * move description
    sachinprasadhs authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    b76317e View commit details
    Browse the repository at this point in the history
  6. Add ViTDetBackbone (keras-team#1776)

    * add vit det vit_det_backbone
    
    * update docstring
    
    * code reformat
    
    * fix tests
    
    * address review comments
    
    * bump year on all files
    
    * address review comments
    
    * rename backbone
    
    * fix tests
    
    * change back to ViT
    
    * address review comments
    
    * update image shape
    divyashreepathihalli authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    c822f3a View commit details
    Browse the repository at this point in the history
  7. Add Mix transformer (keras-team#1780)

    * Add MixTransformer
    
    * fix testcase
    
    * test changes and comments
    
    * lint fix
    
    * update config list
    
    * modify testcase for 2 layers
    sachinprasadhs authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    bc69acd View commit details
    Browse the repository at this point in the history
  8. update input_image_shape -> image_shape (keras-team#1785)

    * update input_image_shape -> image_shape
    
    * update docstring example
    
    * code reformat
    
    * update tests
    divyashreepathihalli authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    7e180c2 View commit details
    Browse the repository at this point in the history
  9. Create __init__.py (keras-team#1788)

    add missing __init__ file to vit_det
    sachinprasadhs authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    12a4ccc View commit details
    Browse the repository at this point in the history
  10. Hack package build script to rename to keras-hub (keras-team#1793)

    This is a temporary way to test out the keras-hub branch.
    - Does a global rename of all symbols during package build.
    - Registers the "old" name on symbol export for saving compat.
    - Adds a github action to publish every commit to keras-hub as
      a new package.
    - Removes our descriptions on PyPI temporarily, until we want
      to message this more broadly.
    mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    3e9aaba View commit details
    Browse the repository at this point in the history
  11. Add CLIP and T5XXL for StableDiffusionV3 (keras-team#1790)

    * Add `CLIPTokenizer`, `T5XXLTokenizer`, `CLIPTextEncoder` and `T5XXLTextEncoder`.
    
    * Make CLIPTextEncoder as Backbone
    
    * Add `T5XXLPreprocessor` and remove `T5XXLTokenizer`
    
    Add `CLIPPreprocessor`
    
    * Use `tf = None` at the top
    
    * Replace manual implementation of `CLIPAttention` with `MultiHeadAttention`
    james77777778 authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    741f98d View commit details
    Browse the repository at this point in the history
  12. Add Bounding Box Utils (keras-team#1791)

    * Bounding box utils
    
    * - Correct test cases
    
    * - Remove hard tensorflow dtype
    
    * - fix api gen
    
    * - Fix import for test cases
    - Use setup for converters test case
    
    * - fix api_gen issue
    
    * - FIx api gen
    
    * - Fix api gen error
    
    * - Correct test cases as per new api changes
    sineeli authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    352e0b7 View commit details
    Browse the repository at this point in the history
  13. mobilenet_v3 added in keras-nlp (keras-team#1782)

    * mobilenet_v3 added in keras-nlp
    
    * minor bug fixed in mobilenet_v3_backbone
    
    * formatting corrected
    
    * refactoring backbone
    
    * correct_pad_downsample method added
    
    * refactoring backbone
    
    * parameters updated
    
    * Testcaseupdated, expected output shape corrected
    
    * code formatted with black
    
    * testcase updated
    
    * refactoring and description added
    
    * comments updated
    
    * added mobilenet v1 and v2
    
    * merge conflict resolved
    
    * version arg removed, and config options added
    
    * input_shape changed to image_shape in arg
    
    * config updated
    
    * input shape corrected
    
    * comments resolved
    
    * activation function format changed
    
    * minor bug fixed
    
    * minor bug fixed
    
    * added vision_backbone_test
    
    * channel_first bug resolved
    
    * channel_first cases working
    
    * comments  resolved
    
    * formatting fixed
    
    * refactoring
    
    ---------
    
    Co-authored-by: ushareng <[email protected]>
    2 people authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    1a81234 View commit details
    Browse the repository at this point in the history
  14. Pkgoogle/efficient net migration (keras-team#1778)

    * migrating efficientnet models to keras-hub
    
    * merging changes from other sources
    
    * autoformatting pass
    
    * initial consolidation of efficientnet_backbone
    
    * most updates and removing separate implementation
    
    * cleanup, autoformatting, keras generalization
    
    * removed layer examples outside of effiicient net
    
    * many, mainly documentation changes, small test fixes
    pkgoogle authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    894226d View commit details
    Browse the repository at this point in the history
  15. Add the ResNet_vd backbone (keras-team#1766)

    * Add ResNet_vd to ResNet backbone
    
    * Addressed requested parameter changes
    
    * Fixed tests and updated comments
    
    * Added new parameters to docstring
    gowthamkpr authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    6104520 View commit details
    Browse the repository at this point in the history
  16. Add VAEImageDecoder for StableDiffusionV3 (keras-team#1796)

    * Add `VAEImageDecoder` for StableDiffusionV3
    
    * Use `keras.Model` for `VAEImageDecoder` and follows the coding style in `VAEAttention`
    james77777778 authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    faffd86 View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    bdf0d7f View commit details
    Browse the repository at this point in the history
  18. Add pyramid output for densenet, cspDarknet (keras-team#1801)

    * add pyramid outputs
    
    * fix testcase
    
    * format fix
    
    * make common testcase for pyramid outputs
    
    * change default shape
    
    * simplify testcase
    
    * test case change and add channel axis
    sachinprasadhs authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    85daf81 View commit details
    Browse the repository at this point in the history
  19. Add MMDiT for StableDiffusionV3 (keras-team#1806)

    * Add `MMDiT`
    
    * Update
    
    * Update
    
    * Update implementation
    james77777778 authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    321b757 View commit details
    Browse the repository at this point in the history
  20. Add remaining bbox utils (keras-team#1804)

    * - Add formats, iou, utils for bounding box
    
    * - Add `AnchorGenerator`, `BoxMatcher` and `NonMaxSupression` layers
    
    * - Remove scope_name  not required.
    
    * use default keras name scope
    
    * - Correct format error
    
    * - Remove layers as of now and keep them at model level till keras core supports them
    
    * - Correct api_gen
    sineeli authored and mattdangerw committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    dfb7123 View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    753047d View commit details
    Browse the repository at this point in the history
  22. Add StableDiffusion3

    james77777778 committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    3c239ca View commit details
    Browse the repository at this point in the history
  23. Fix _normalize_inputs

    james77777778 committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    53e90f1 View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. Configuration menu
    Copy the full SHA
    6503f66 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    86f98bb View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Address comments

    james77777778 committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4ad8d47 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0d6d6a1 View commit details
    Browse the repository at this point in the history
  3. Add VGG16 backbone (keras-team#1737)

    * Agg Vgg16 backbone
    
    * update names
    
    * update tests
    
    * update test
    
    * add image classifier
    
    * incorporate review comments
    
    * Update test case
    
    * update backbone test
    
    * add image classifier
    
    * classifier cleanup
    
    * code reformat
    
    * add vgg16 image classifier
    
    * make vgg generic
    
    * update doc string
    
    * update docstring
    
    * add classifier test
    
    * update tests
    
    * update docstring
    
    * address review comments
    
    * code reformat
    
    * update the configs
    
    * address review comments
    
    * fix task saved model test
    
    * update init
    
    * code reformatted
    divyashreepathihalli authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    edc74fa View commit details
    Browse the repository at this point in the history
  4. Add ResNetBackbone and ResNetImageClassifier (keras-team#1765)

    * Add ResNetV1 and ResNetV2
    
    * Address comments
    james77777778 authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    f305f64 View commit details
    Browse the repository at this point in the history
  5. Add CSP DarkNet backbone and classifier (keras-team#1774)

    * Add CSP DarkNet
    
    * Add CSP DarkNet
    
    * snake_case function names
    
    * change use_depthwise to block_type
    sachinprasadhs authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d090b98 View commit details
    Browse the repository at this point in the history
  6. Add FeaturePyramidBackbone and port weights from timm for `ResNet…

    …Backbone` (keras-team#1769)
    
    * Add FeaturePyramidBackbone and update ResNetBackbone
    
    * Simplify the implementation
    
    * Fix CI
    
    * Make ResNetBackbone compatible with timm and add FeaturePyramidBackbone
    
    * Add conversion implementation
    
    * Update docstrings
    
    * Address comments
    james77777778 authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4b20620 View commit details
    Browse the repository at this point in the history
  7. Add DenseNet (keras-team#1775)

    * Add DenseNet
    
    * fix testcase
    
    * address comments
    
    * nit
    
    * fix lint errors
    
    * move description
    sachinprasadhs authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    689a8db View commit details
    Browse the repository at this point in the history
  8. Add ViTDetBackbone (keras-team#1776)

    * add vit det vit_det_backbone
    
    * update docstring
    
    * code reformat
    
    * fix tests
    
    * address review comments
    
    * bump year on all files
    
    * address review comments
    
    * rename backbone
    
    * fix tests
    
    * change back to ViT
    
    * address review comments
    
    * update image shape
    divyashreepathihalli authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    3f6c936 View commit details
    Browse the repository at this point in the history
  9. Add Mix transformer (keras-team#1780)

    * Add MixTransformer
    
    * fix testcase
    
    * test changes and comments
    
    * lint fix
    
    * update config list
    
    * modify testcase for 2 layers
    sachinprasadhs authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    76d704f View commit details
    Browse the repository at this point in the history
  10. update input_image_shape -> image_shape (keras-team#1785)

    * update input_image_shape -> image_shape
    
    * update docstring example
    
    * code reformat
    
    * update tests
    divyashreepathihalli authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d91b61a View commit details
    Browse the repository at this point in the history
  11. Create __init__.py (keras-team#1788)

    add missing __init__ file to vit_det
    sachinprasadhs authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    ab7efdd View commit details
    Browse the repository at this point in the history
  12. Hack package build script to rename to keras-hub (keras-team#1793)

    This is a temporary way to test out the keras-hub branch.
    - Does a global rename of all symbols during package build.
    - Registers the "old" name on symbol export for saving compat.
    - Adds a github action to publish every commit to keras-hub as
      a new package.
    - Removes our descriptions on PyPI temporarily, until we want
      to message this more broadly.
    mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    2a11cf1 View commit details
    Browse the repository at this point in the history
  13. Add CLIP and T5XXL for StableDiffusionV3 (keras-team#1790)

    * Add `CLIPTokenizer`, `T5XXLTokenizer`, `CLIPTextEncoder` and `T5XXLTextEncoder`.
    
    * Make CLIPTextEncoder as Backbone
    
    * Add `T5XXLPreprocessor` and remove `T5XXLTokenizer`
    
    Add `CLIPPreprocessor`
    
    * Use `tf = None` at the top
    
    * Replace manual implementation of `CLIPAttention` with `MultiHeadAttention`
    james77777778 authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    40b5153 View commit details
    Browse the repository at this point in the history
  14. Add Bounding Box Utils (keras-team#1791)

    * Bounding box utils
    
    * - Correct test cases
    
    * - Remove hard tensorflow dtype
    
    * - fix api gen
    
    * - Fix import for test cases
    - Use setup for converters test case
    
    * - fix api_gen issue
    
    * - FIx api gen
    
    * - Fix api gen error
    
    * - Correct test cases as per new api changes
    sineeli authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    f597523 View commit details
    Browse the repository at this point in the history
  15. mobilenet_v3 added in keras-nlp (keras-team#1782)

    * mobilenet_v3 added in keras-nlp
    
    * minor bug fixed in mobilenet_v3_backbone
    
    * formatting corrected
    
    * refactoring backbone
    
    * correct_pad_downsample method added
    
    * refactoring backbone
    
    * parameters updated
    
    * Testcaseupdated, expected output shape corrected
    
    * code formatted with black
    
    * testcase updated
    
    * refactoring and description added
    
    * comments updated
    
    * added mobilenet v1 and v2
    
    * merge conflict resolved
    
    * version arg removed, and config options added
    
    * input_shape changed to image_shape in arg
    
    * config updated
    
    * input shape corrected
    
    * comments resolved
    
    * activation function format changed
    
    * minor bug fixed
    
    * minor bug fixed
    
    * added vision_backbone_test
    
    * channel_first bug resolved
    
    * channel_first cases working
    
    * comments  resolved
    
    * formatting fixed
    
    * refactoring
    
    ---------
    
    Co-authored-by: ushareng <[email protected]>
    2 people authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    1e97bae View commit details
    Browse the repository at this point in the history
  16. Pkgoogle/efficient net migration (keras-team#1778)

    * migrating efficientnet models to keras-hub
    
    * merging changes from other sources
    
    * autoformatting pass
    
    * initial consolidation of efficientnet_backbone
    
    * most updates and removing separate implementation
    
    * cleanup, autoformatting, keras generalization
    
    * removed layer examples outside of effiicient net
    
    * many, mainly documentation changes, small test fixes
    pkgoogle authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    639d983 View commit details
    Browse the repository at this point in the history
  17. Add the ResNet_vd backbone (keras-team#1766)

    * Add ResNet_vd to ResNet backbone
    
    * Addressed requested parameter changes
    
    * Fixed tests and updated comments
    
    * Added new parameters to docstring
    gowthamkpr authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    b10c410 View commit details
    Browse the repository at this point in the history
  18. Add VAEImageDecoder for StableDiffusionV3 (keras-team#1796)

    * Add `VAEImageDecoder` for StableDiffusionV3
    
    * Use `keras.Model` for `VAEImageDecoder` and follows the coding style in `VAEAttention`
    james77777778 authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    9feb2d8 View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    30cc165 View commit details
    Browse the repository at this point in the history
  20. Add pyramid output for densenet, cspDarknet (keras-team#1801)

    * add pyramid outputs
    
    * fix testcase
    
    * format fix
    
    * make common testcase for pyramid outputs
    
    * change default shape
    
    * simplify testcase
    
    * test case change and add channel axis
    sachinprasadhs authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    ae3d558 View commit details
    Browse the repository at this point in the history
  21. Add MMDiT for StableDiffusionV3 (keras-team#1806)

    * Add `MMDiT`
    
    * Update
    
    * Update
    
    * Update implementation
    james77777778 authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    76e8fb6 View commit details
    Browse the repository at this point in the history
  22. Add remaining bbox utils (keras-team#1804)

    * - Add formats, iou, utils for bounding box
    
    * - Add `AnchorGenerator`, `BoxMatcher` and `NonMaxSupression` layers
    
    * - Remove scope_name  not required.
    
    * use default keras name scope
    
    * - Correct format error
    
    * - Remove layers as of now and keep them at model level till keras core supports them
    
    * - Correct api_gen
    sineeli authored and mattdangerw committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    759905e View commit details
    Browse the repository at this point in the history
  23. Configuration menu
    Copy the full SHA
    a5e5d8f View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2024

  1. Configuration menu
    Copy the full SHA
    f76b689 View commit details
    Browse the repository at this point in the history
  2. Fix

    james77777778 committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    ec7f53d View commit details
    Browse the repository at this point in the history
  3. Update

    james77777778 committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    ab10eaa View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    79f3a01 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Define functional model

    james77777778 committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    fb73693 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. Configuration menu
    Copy the full SHA
    aa42194 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    403e4b8 View commit details
    Browse the repository at this point in the history
  3. Delete old SD3

    james77777778 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    1363024 View commit details
    Browse the repository at this point in the history
  4. Fix copyright

    james77777778 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    51ca7ea View commit details
    Browse the repository at this point in the history
  5. Rename to keras_hub

    james77777778 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    0f72e58 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Address comments

    james77777778 committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    ef425d0 View commit details
    Browse the repository at this point in the history
  2. Update

    james77777778 committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    74a4b07 View commit details
    Browse the repository at this point in the history
  3. Fix CI

    james77777778 committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    2fb4953 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Configuration menu
    Copy the full SHA
    6e086cf View commit details
    Browse the repository at this point in the history