Skip to main content

Crate llama_herd

Crate llama_herd 

Source
Expand description

LlamaHerd library containing configuration, model discovery, server launching, and TUI components.

Modulesยง

config
Configuration structures and helpers for parsing GGUF/TOML config files. Configuration structures and helpers for parsing GGUF/TOML config files.
discovery
Heuristics and utilities for scanning directories and discovering model presets.
launcher
Orchestrates running llama-server subprocesses and command line construction.
setup
CLI wizard for setting up initial paths and settings.
tui
Text User Interface components and event loop.