AlloyMoE: GPU Kernels for Mixture of Experts
In Progress
This project is looking at developing performant and memory efficient GPU kernels for MoE modules.
This project is looking at developing performant and memory efficient GPU kernels for MoE modules.