Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding NeMo 2.0 T5 finetuning (on Squad dataset) #10716

Open
wants to merge 27 commits into
base: main
Choose a base branch
from
Open

Adding NeMo 2.0 T5 finetuning (on Squad dataset) #10716

wants to merge 27 commits into from
+733 −247

Commits on Aug 16, 2024

  1. huvu/t5_nemo2.0 first commit from local

    Huy Vu2 committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    7ff1737 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2024

  1. runable training

    Huy Vu2 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    93a6661 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. commit to save

    Huy Vu2 committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    ce721ea View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into huvu/t5_nemo2.0

    Huy Vu2 committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    62e37c8 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. update nemo/collections/llm/t5/data/pre_training.py, adding cicd test

    Huy Vu2 committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    769e8c6 View commit details
    Browse the repository at this point in the history

  2. updating codes

    Huy Vu2 committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    8c086e8 View commit details
    Browse the repository at this point in the history

  3. reset nemo/collections/nlp/parts/megatron_trainer_builder.py

    Huy Vu2 committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    e6b01e8 View commit details
    Browse the repository at this point in the history

  4. reset megatron_lm_encoder_decoder_model.py, remove t5_release_test_co… 

    …nfig.sh
    Huy Vu2 committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    3bf5140 View commit details
    Browse the repository at this point in the history

  5. update init files

    Huy Vu2 committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    47b1174 View commit details
    Browse the repository at this point in the history

  6. keep changes of cicd

    Huy Vu2 committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    1f12e6c View commit details
    Browse the repository at this point in the history

  7. update Dockerfile.ci

    Huy Vu2 committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    fcaf5bf View commit details
    Browse the repository at this point in the history

  8. fix wandb for cicd test

    Huy Vu2 committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    575ab86 View commit details
    Browse the repository at this point in the history

  9. update training data path

    Huy Vu2 committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    4deacf4 View commit details
    Browse the repository at this point in the history

  10. remove uninstall TE

    Huy Vu2 committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    bfad4b1 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. update .github/workflows/cicd-main.yml, disable fused/flashAttn

    Huy Vu2 committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    726ca7c View commit details
    Browse the repository at this point in the history

  2. adjusting val_check_interval for action ci-cd tests

    Huy Vu2 committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    f151272 View commit details
    Browse the repository at this point in the history

  3. restore .github/workflows/cicd-main.yml

    Huy Vu2 committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    62db039 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. update

    Huy Vu2 committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    e880687 View commit details
    Browse the repository at this point in the history

  2. resolve conflict

    Huy Vu2 committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    4b6c431 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. update nemologger args

    Huy Vu2 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    910db2f View commit details
    Browse the repository at this point in the history

  2. Apply isort and black reformatting 

    Signed-off-by: huvunvidia <[email protected]>
    @huvunvidia
    huvunvidia committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    d49e0fe View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into huvu/t5_nemo2.0 

    Signed-off-by: Huy Vu <[email protected]>
    @huvunvidia
    huvunvidia authored Sep 18, 2024
    Configuration menu
    Copy the full SHA
    e1620b7 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. a checkpoint for NeMo 2.0 T5 finetune

    Huy Vu2 committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    7d0800f View commit details
    Browse the repository at this point in the history

  2. solving conflicts

    Huy Vu2 committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    011bcea View commit details
    Browse the repository at this point in the history

  3. moving NeMo 2.0 examples to tests

    Huy Vu2 committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    ff11a07 View commit details
    Browse the repository at this point in the history

  4. reorganizing files, putting examples files into tests

    Huy Vu2 committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    b9de083 View commit details
    Browse the repository at this point in the history

  5. Apply isort and black reformatting 

    Signed-off-by: huvunvidia <[email protected]>
    @huvunvidia
    huvunvidia committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    9880efe View commit details
    Browse the repository at this point in the history