Skip to content

DeTrain primarily focuses on MP training, with two types: Tensor parallelism (TP) and Pipeline parallelism (PP).

Notifications You must be signed in to change notification settings

a2nfinance/detrain-python-lib

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Introduction

This package focuses on model parallelism training jobs with two types: tensor and pipeline. Source code is published on PyPI as DeTrain package

Commands

  • For local development: pip install -e .
  • To publish to pypi:
    • python3 -m build
    • python3 -m twine upload dist/*

About

DeTrain primarily focuses on MP training, with two types: Tensor parallelism (TP) and Pipeline parallelism (PP).

Resources

Stars

Watchers

Forks

Languages