Starrick Liu
421db17d53
This release introduces significant performance optimizations, memory efficiency improvements, and enhanced system robustness: 🚀 Performance Optimizations: - Add three new fused CUDA kernels (rope_index, rot_pos_emb, get_window_index) for accelerated multimodal preprocessing - Implement FSDP2 support for distributed training with improved memory efficiency - Add Torch.compile integration for additional performance gains - Optimize memory usage: reduce peak allocation from 48GB to 24GB on 8-GPU setup 🔧 System Robustness: - Fix missing token position inputs in prediction pipeline - Add type-robust negation operations in RoPE CUDA kernels (half/bfloat16 support) - Fix dataset root parameter initialization in LeRobot data loader - Enhanced error handling and input validation across fusion operators 📚 Documentation & Usability: - Add comprehensive memory usage benchmarks and hardware recommendations - Update citation format with proper arXiv reference - Improve training configuration documentation with quick start guide - Add detailed API documentation for new fusion operators 🛠️ Technical Details: - Version bump to 1.0.1 - New CUDA kernels: rope_index.cu, rot_pos.cu, window_index.cu - FSDP2 state dict loading with distribute_tensor support - Enhanced multimodal RoPE with 3D position encoding - Window attention optimization for Vision Transformers Breaking Changes: None - all changes are backward compatible
270 lines
4.2 KiB
Plaintext
270 lines
4.2 KiB
Plaintext
# =============================================================================
|
|
# OPERATING SYSTEM FILES
|
|
# =============================================================================
|
|
|
|
# macOS
|
|
.DS_Store
|
|
.DS_Store?
|
|
._*
|
|
.Spotlight-V100
|
|
.Trashes
|
|
ehthumbs.db
|
|
Thumbs.db
|
|
|
|
# Windows
|
|
Thumbs.db
|
|
ehthumbs.db
|
|
Desktop.ini
|
|
$RECYCLE.BIN/
|
|
*.cab
|
|
*.msi
|
|
*.msix
|
|
*.msm
|
|
*.msp
|
|
|
|
# Linux
|
|
*~
|
|
|
|
# =============================================================================
|
|
# PYTHON
|
|
# =============================================================================
|
|
|
|
# Byte-compiled / optimized / DLL files
|
|
__pycache__/
|
|
*.py[cod]
|
|
*$py.class
|
|
|
|
# C extensions
|
|
*.so
|
|
|
|
# Distribution / packaging
|
|
.Python
|
|
build/
|
|
develop-eggs/
|
|
dist/
|
|
downloads/
|
|
eggs/
|
|
.eggs/
|
|
lib/
|
|
lib64/
|
|
parts/
|
|
sdist/
|
|
var/
|
|
wheels/
|
|
pip-wheel-metadata/
|
|
share/python-wheels/
|
|
*.egg-info/
|
|
.installed.cfg
|
|
*.egg
|
|
MANIFEST
|
|
|
|
# PyInstaller
|
|
# Usually these files are written by a python script from a template
|
|
# before PyInstaller builds the exe, so as to inject date/other infos into it.
|
|
*.manifest
|
|
*.spec
|
|
|
|
# Installer logs
|
|
pip-log.txt
|
|
pip-delete-this-directory.txt
|
|
|
|
# Unit test / coverage reports
|
|
htmlcov/
|
|
.tox/
|
|
.nox/
|
|
.coverage
|
|
.coverage.*
|
|
.cache
|
|
nosetests.xml
|
|
coverage.xml
|
|
*.cover
|
|
*.py,cover
|
|
.hypothesis/
|
|
.pytest_cache/
|
|
|
|
# Translations
|
|
*.mo
|
|
*.pot
|
|
|
|
# Django stuff:
|
|
local_settings.py
|
|
db.sqlite3
|
|
db.sqlite3-journal
|
|
|
|
# Flask stuff:
|
|
instance/
|
|
.webassets-cache
|
|
|
|
# Scrapy stuff:
|
|
.scrapy
|
|
|
|
# Sphinx documentation
|
|
docs/_build/
|
|
|
|
# PyBuilder
|
|
target/
|
|
|
|
# Jupyter Notebook
|
|
.ipynb_checkpoints
|
|
*.ipynb
|
|
|
|
# IPython
|
|
profile_default/
|
|
ipython_config.py
|
|
|
|
# pyenv
|
|
.python-version
|
|
|
|
# pipenv
|
|
# According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
|
|
# However, in case of collaboration, if having platform-specific dependencies or dependencies
|
|
# having no cross-platform support, pipenv may install dependencies that don't work, or not
|
|
# install all needed dependencies.
|
|
#Pipfile.lock
|
|
|
|
# PEP 582; used by e.g. github.com/David-OConnor/pyflow
|
|
__pypackages__/
|
|
|
|
# Celery stuff
|
|
celerybeat-schedule
|
|
celerybeat.pid
|
|
|
|
# SageMath parsed files
|
|
*.sage.py
|
|
|
|
# Spyder project settings
|
|
.spyderproject
|
|
.spyproject
|
|
|
|
# Rope project settings
|
|
.ropeproject
|
|
|
|
# mkdocs documentation
|
|
/site
|
|
|
|
# mypy
|
|
.mypy_cache/
|
|
.dmypy.json
|
|
dmypy.json
|
|
|
|
# Pyre type checker
|
|
.pyre/
|
|
|
|
# =============================================================================
|
|
# DEVELOPMENT ENVIRONMENT
|
|
# =============================================================================
|
|
|
|
# VS Code
|
|
.vscode/
|
|
*.code-workspace
|
|
|
|
# PyCharm
|
|
.idea/
|
|
|
|
# Vim
|
|
*.swp
|
|
*.swo
|
|
*~
|
|
|
|
# Emacs
|
|
*~
|
|
\#*\#
|
|
/.emacs.desktop
|
|
/.emacs.desktop.lock
|
|
*.elc
|
|
auto-save-list
|
|
tramp
|
|
.\#*
|
|
|
|
# =============================================================================
|
|
# PROJECT SPECIFIC
|
|
# =============================================================================
|
|
|
|
# Model checkpoints and weights
|
|
*.pth
|
|
*.pt
|
|
*.ckpt
|
|
ckpt/
|
|
checkpoints/
|
|
|
|
# Output directories
|
|
outputs/
|
|
results/
|
|
logs/
|
|
bin/
|
|
|
|
# Media files
|
|
*.jpg
|
|
*.jpeg
|
|
*.gif
|
|
*.mp4
|
|
*.avi
|
|
*.mov
|
|
*.wav
|
|
*.mp3
|
|
|
|
# Configuration files with sensitive data
|
|
fuse.cfg
|
|
ray/auth.json
|
|
|
|
# AI/ML related
|
|
*.ai
|
|
|
|
# =============================================================================
|
|
# LOGGING AND MONITORING
|
|
# =============================================================================
|
|
|
|
# General logs
|
|
*.log
|
|
*.err
|
|
*.out
|
|
|
|
# Weights & Biases
|
|
wandb/
|
|
_wandb/
|
|
|
|
# TensorBoard
|
|
runs/
|
|
tensorboard/
|
|
|
|
# MLflow
|
|
mlruns/
|
|
|
|
# =============================================================================
|
|
# TEMPORARY AND CACHE FILES
|
|
# =============================================================================
|
|
|
|
# Temporary files
|
|
*.tmp
|
|
*.temp
|
|
*.bak
|
|
*.backup
|
|
|
|
# Cache directories
|
|
.cache/
|
|
cache/
|
|
.ruff_cache/
|
|
|
|
# =============================================================================
|
|
# FONTS AND ASSETS (if not part of the project)
|
|
# =============================================================================
|
|
|
|
# Font files (uncomment if fonts should not be tracked)
|
|
# *.ttf
|
|
# *.otf
|
|
# *.woff
|
|
# *.woff2
|
|
|
|
# =============================================================================
|
|
# PERSONAL/LOCAL FILES
|
|
# =============================================================================
|
|
|
|
# Personal notes and documentation
|
|
code_update_info.md
|
|
TODO.md
|
|
NOTES.md
|
|
|
|
# Local configuration
|
|
.env
|
|
.env.local
|
|
.env.*.local |