AlloyMoE: GPU Kernels for Mixture of Experts
In Progress
This project is looking at developing performant and memory efficient GPU kernels for MoE modules.
This project is looking at developing performant and memory efficient GPU kernels for MoE modules.

This paper explores methods to perform efficient bounds-propagation on neural networks.