EvalContextMoECache.h File Reference

Thread-local evaluator for the Factorized Mixture of Experts (MoE) network. More...

#include "IEvaluator.h"
#include "WDLConverter.hpp"
#include "MoECacheModel.hpp"
#include <algorithm>
#include <array>
#include <atomic>
#include <fstream>
#include <memory>
#include <stdexcept>
#include <string>

Include dependency graph for EvalContextMoECache.h:

This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes
struct	EvalContextMoECacheSharedModel
	Contains the shared neural network weights. More...
class	EvalContextMoECache
	Thread-local evaluator context utilizing the MoE network. More...

Detailed Description

Thread-local evaluator for the Factorized Mixture of Experts (MoE) network.

Implements an incremental network evaluation context that safely updates its hidden state during the search tree traversal.