ExpertRouter.hpp File Reference

Computes expert weights for the Residual MoE architecture based on position features. More...

#include "FactorizedFeatureExtractor.hpp"
#include "FeatureExtractor.hpp"
#include <algorithm>
#include <array>
#include <cmath>
#include <cstdint>

Include dependency graph for ExpertRouter.hpp:

This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes
class	ExpertRouter
struct	ExpertRouter::ExpertWeights

Detailed Description

Computes expert weights for the Residual MoE architecture based on position features.