Struct Tryll::Client::AgentKvCachePrefillResult

ClassList > Tryll > Client > AgentKvCachePrefillResult

Inherits the following classes: Tryll::Client::AgentKvCacheStatus

Public Attributes

Type	Name
std::uint32_t	contextsCreated = 0
std::uint32_t	tokensDecoded = 0
std::uint32_t	tokensReused = 0

Public Attributes inherited from Tryll::Client::AgentKvCacheStatus

See Tryll::Client::AgentKvCacheStatus

Type	Name
std::uint64_t	agentId = 0
bool	applicable = false
std::string	debugInfo
std::uint32_t	eligibleNodeCount = 0
AgentKvCachePrefixStatus	prefixStatus = AgentKvCachePrefixStatus::NotCurrent
AgentKvCacheResidency	residency = AgentKvCacheResidency::Evicted

Public Attributes Documentation

variable contextsCreated

std::uint32_t Tryll::Client::AgentKvCachePrefillResult::contextsCreated;

---

variable tokensDecoded

std::uint32_t Tryll::Client::AgentKvCachePrefillResult::tokensDecoded;

---

variable tokensReused

std::uint32_t Tryll::Client::AgentKvCachePrefillResult::tokensReused;

---

---

The documentation for this class was generated from the following file C:/_tryll/_monorepo3/tryll/clients/cpp/include/tryll/AgentKvCache.h