Update Wall-X dependency and runtime setup (#105)
* Update Wall-X dependency and runtime setup * Simplify FlashAttention installation notes
This commit is contained in:
+2
-1
@@ -29,7 +29,8 @@ conda activate wallx
|
||||
|
||||
```bash
|
||||
pip install -r requirements.txt
|
||||
MAX_JOBS=4 pip install flash-attn==2.7.4.post1 --no-build-isolation
|
||||
export FLASH_ATTN_CUDA_ARCHS=$(python -c 'import torch; print(f"{torch.cuda.get_device_capability()[0]}{torch.cuda.get_device_capability()[1]}")')
|
||||
MAX_JOBS=4 pip install flash-attn==2.8.3 --no-build-isolation
|
||||
```
|
||||
|
||||
安装默认训练配置使用的 DMuon:
|
||||
|
||||
Reference in New Issue
Block a user