Evaluator.h File Reference

Runtime evaluator manager. More...

#include "IEvaluator.h"
#include <memory>
#include <string>

Include dependency graph for Evaluator.h:

This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes
class	Evaluator
	Model manager that shares native weights across threads. More...

Detailed Description

Runtime evaluator manager.

Supports native incremental MoE cache bundles for engine runtime, managing the shared models and creating thread-local contexts.