Update Wall-X dependency and runtime setup (#105)

* Update Wall-X dependency and runtime setup * Simplify FlashAttention installation notes
2026-06-17 20:07:03 +08:00
parent 72834e7de5
commit dce38a7556
4 changed files with 34 additions and 9 deletions
@@ -65,7 +65,8 @@ Install requirements:

 ```bash
 pip install -r requirements.txt
-MAX_JOBS=4 pip install flash-attn==2.7.4.post1 --no-build-isolation
+export FLASH_ATTN_CUDA_ARCHS=$(python -c 'import torch; print(f"{torch.cuda.get_device_capability()[0]}{torch.cuda.get_device_capability()[1]}")')
+MAX_JOBS=4 pip install flash-attn==2.8.3 --no-build-isolation
 ```

 Install DMuon, which is used by the default training configs: