Struct FTryllKvCachePrefillResult¶

ClassList > FTryllKvCachePrefillResult

#include <TryllKvCache.h>

Public Attributes¶

Type	Name
int64	AgentId = `0`
int32	ContextsCreated = `0`
FString	DebugInfo
int32	EligibleNodeCount = `0`
ETryllKvCachePrefixStatus	PrefixStatus = `ETryllKvCachePrefixStatus::NotCurrent`
ETryllKvCacheResidency	Residency = `ETryllKvCacheResidency::Evicted`
int32	TokensDecoded = `0`
int32	TokensReused = `0`
bool	bApplicable = `false`

Detailed Description¶

Aggregate result of PrefillKvCache.

Public Attributes Documentation¶

variable AgentId¶

int64 FTryllKvCachePrefillResult::AgentId;

variable ContextsCreated¶

int32 FTryllKvCachePrefillResult::ContextsCreated;

variable DebugInfo¶

FString FTryllKvCachePrefillResult::DebugInfo;

variable EligibleNodeCount¶

int32 FTryllKvCachePrefillResult::EligibleNodeCount;

variable PrefixStatus¶

ETryllKvCachePrefixStatus FTryllKvCachePrefillResult::PrefixStatus;

variable Residency¶

ETryllKvCacheResidency FTryllKvCachePrefillResult::Residency;

variable TokensDecoded¶

int32 FTryllKvCachePrefillResult::TokensDecoded;

variable TokensReused¶

int32 FTryllKvCachePrefillResult::TokensReused;

variable bApplicable¶

bool FTryllKvCachePrefillResult::bApplicable;

The documentation for this class was generated from the following file C:/_tryll/_monorepo3/tryll/clients/unreal/Source/TryllClient/Public/TryllKvCache.h