Struct FTryllModelInfo¶

#include <TryllModelInfo.h>

Public Attributes¶

Type	Name
FString	Audience
int32	ContextSize = `0`
FTryllSamplingParams	DefaultSampling
FString	Engine
TArray< FString >	Files
FString	HuggingFaceRepo
FString	LocalPath
FString	ModelType
FString	Name
int64	SizeBytes = `0`
ETryllModelStatus	Status = `ETryllModelStatus::Absent`
FString	ToolCallFormat
FString	ToolCallSupport
bool	bHasDefaultSampling = `false`

Detailed Description¶

Summary information for one model returned by ListModels.

Public Attributes Documentation¶

variable Audience¶

FString FTryllModelInfo::Audience;

Intended audience tier: "public" | "experimental" | "internal" | "".

variable ContextSize¶

int32 FTryllModelInfo::ContextSize;

Variant context window in tokens; 0 means the engine default.

variable DefaultSampling¶

FTryllSamplingParams FTryllModelInfo::DefaultSampling;

Recommended sampling parameters; valid only when bHasDefaultSampling.

variable Engine¶

FString FTryllModelInfo::Engine;

Resolved inference engine, e.g. "llama-cpp" | "sherpa-onnx".

variable Files¶

TArray<FString> FTryllModelInfo::Files;

Files downloaded/resolved for the configured engine's variant.

variable HuggingFaceRepo¶

FString FTryllModelInfo::HuggingFaceRepo;

HuggingFace repo id (e.g. "Qwen/Qwen2.5-0.5B-Instruct-GGUF") or empty for local-only models.

variable LocalPath¶

FString FTryllModelInfo::LocalPath;

Resolved on-disk directory for the model; empty when not on disk.

variable ModelType¶

FString FTryllModelInfo::ModelType;

Model type: "language" | "embedding" | "stt" | "tts" | "vad".

variable Name¶

FString FTryllModelInfo::Name;

Catalog name of the model (matches the name in models.json).

variable SizeBytes¶

int64 FTryllModelInfo::SizeBytes;

On-disk size in bytes when the model has been downloaded. Zero if Status == Absent.

variable Status¶

ETryllModelStatus FTryllModelInfo::Status;

Current status on the server (absent / local / downloading / downloaded / loaded).

variable ToolCallFormat¶

FString FTryllModelInfo::ToolCallFormat;

Tool-call prompt/parse format: "chatml" | "llama3" | "mistral" | "generic" | "".

variable ToolCallSupport¶

FString FTryllModelInfo::ToolCallSupport;

Advisory catalog-declared tool-calling capability for language models: "supported" | "unsupported". Empty for non-language models (and when talking to older servers). The authoritative check happens server-side at agent creation from the model's own chat template.

variable bHasDefaultSampling¶

bool FTryllModelInfo::bHasDefaultSampling;

True when the catalog supplies explicit default sampling parameters.

The documentation for this class was generated from the following file C:/_tryll/_monorepo3/tryll/clients/unreal/Source/TryllClient/Public/TryllModelInfo.h