[lint] Update lint (#16)
* update lint * update readme * update ruff lint
This commit is contained in:
+2
-2
@@ -10,7 +10,7 @@ High-performance CUDA kernels for accelerating model training.
|
||||
|
||||
### Token Permutation
|
||||
- `permute`: Token permutation for MoE routing
|
||||
- `unpermute`: Token recovery after expert computation
|
||||
- `unpermute`: Token recovery after expert computation
|
||||
- `unpermute_bwd`: Backward pass for token recovery
|
||||
|
||||
### Multimodal RoPE
|
||||
@@ -20,4 +20,4 @@ High-performance CUDA kernels for accelerating model training.
|
||||
|
||||
## Acknowledgments
|
||||
|
||||
The `permute` and `unpermute` operators are adapted from [fanshiqing/grouped_gemm](https://github.com/fanshiqing/grouped_gemm). Thanks for their open-source contributions.
|
||||
The `permute` and `unpermute` operators are adapted from [fanshiqing/grouped_gemm](https://github.com/fanshiqing/grouped_gemm). Thanks for their open-source contributions.
|
||||
|
||||
@@ -13,4 +13,3 @@ PYBIND11_MODULE(TORCH_EXTENSION_NAME, m) {
|
||||
m.def("rope", &launch_multimodal_rope_forward, "Multimodal RoPE forward kernel");
|
||||
m.def("rope_bwd", &launch_multimodal_rope_backward, "Multimodal RoPE backward kernel");
|
||||
}
|
||||
|
||||
|
||||
@@ -549,4 +549,3 @@ void launch_multimodal_rope_backward(
|
||||
break;
|
||||
}
|
||||
}
|
||||
|
||||
|
||||
Reference in New Issue
Block a user