* WIP: support pre-merged up/gate experts Haha, mainline has elected to arrange the merged tensors the other way around compared to what I had done in the on-the-fly merge. * Change the order of on-the-fly packed up/gate * OpenAI * CUDA TG * CPU * Split mode graph for models with pre-merged ffn_up/ffn_gate experts |
||
|---|---|---|
| .. | ||
| cmake | ||
| include | ||
| src | ||
| .gitignore | ||
| CMakeLists.txt | ||