EvalContextMoECacheSharedModel Struct Reference

Contains the shared neural network weights. More...

#include <EvalContextMoECache.h>

Collaboration diagram for EvalContextMoECacheSharedModel:

Public Attributes
BenchConfig	cfg
	Configuration of the MoE architecture.
SharedMoEWeights	weights
	Thread-safe shared weights container.

Detailed Description

Contains the shared neural network weights.

Member Data Documentation

cfg

BenchConfig EvalContextMoECacheSharedModel::cfg

Configuration of the MoE architecture.

weights

SharedMoEWeights EvalContextMoECacheSharedModel::weights

Thread-safe shared weights container.

---

The documentation for this struct was generated from the following file:

• engine/src/eval/EvalContextMoECache.h