#local-llm


  1. commandok

    Spotlight-like command generator for your terminal, powered by LLMs

    v0.1.7 #terminal-command #generator #llm #provider #powered #apple-intelligence #pops #local-llm

  2. alex

    Alexandria: local LLM credential vault, multi-provider routing proxy, and trace capture daemon

    v0.1.21 #vault #daemon #proxy #turn #trace #claude #gemini #alexandria #llm #local-llm

  3. api_ollama

    Ollama local LLM runtime API client for HTTP communication

    v0.5.1 #artificial-intelligence #ollama #local-llm #llm #ollama-api #local-api

  4. forge-agent

    Forge — the model-agnostic AI coding agent. One harness, every provider.

    v2.0.0 #forge #ai-agent #coding-agent-harness #model-provider #chat #ollama #mcp #local-llm #status-line #ai-coding-harness

  5. deepsearch

    A CLI for AI-powered research assistance, using local LLMs to decompose questions, search the web, and synthesize answers

    v0.1.25 1.5K #local-llm #ollama #summarize #research #search #search-cli #deep-research #wikipedia #duckduckgo #synthesize

  6. blazen-local-llm

    Shared option + request types for Blazen local LLM backends (candle, mistralrs, llama.cpp) and the controlplane local-model factory seam

    v0.6.75 270 #llama #local-llm #blazen #llama-cpp #back-ends #llm-provider #event-driven #prometheus #candle #control-plane

  7. llama-mcp-server

    Local LLM inference MCP server powered by llama.cpp

    v0.1.1 #llm-inference #gguf #mcp #llama #mcp-server #json-rpc #local-llm #web-server #llama-cpp #mcp-model

  8. open-agent-sdk

    Production-ready Rust SDK for building AI agents with local OpenAI-compatible servers (LMStudio, Ollama, llama.cpp, vLLM). Features streaming, tools, hooks, retry logic, and comprehensive examples.

    v0.6.4 #ai-agent #openai #local-llm #llm

  9. claudette

    Privacy-first, air-gapped AI coding agent and personal assistant that drives one local model (LM Studio or Ollama). Single-binary Rust CLI + TUI.

    v0.15.0 #coding-agent #local-llm #offline-first #air-gapped #privacy #privacy-first

  10. gobby-local

    Auto-detect local LLM backends and launch AI CLI tools

    v0.1.4 #lm-studio #ollama #llm #local-ai #local-llm

  11. claudectl

    Orchestrate a swarm of Claude Code agents with a local-LLM brain that learns from you

    v0.63.0 #local-llm #claude-code #hive-mind #agent-orchestration #tui

  12. whet

    An open-source local-LLM terminal coding agent (Ollama / llama.cpp / LM Studio / vLLM)

    v0.2.0 #coding-agent #ai-agent #local-llm #llm

  13. octoroute

    Intelligent multi-model router for self-hosted LLMs

    v1.0.0 #prometheus #artificial-intelligence #http-router #model-tier #load-balancing #self-hosted #model-routing #llama #local-llm #model-selection

  14. vibe-cluster

    Multi-provider LLM cluster library for Rust

    v0.0.5 #artificial-intelligence #multi-provider #cluster #llm #model #cloud-api #gpu #ollama #local-llm #vibe

  15. candle-pipelines

    intuitive pipelines for local LLM inference in Rust, powered by Candle. Inspired by Python's Transformers library.

    v0.0.7 110 #llm-inference #llama #pipeline #candle #hugging-face #tool-calling #local-llm #classification #qwen3 #text-output

  16. mecha10-ai-llm

    Large Language Model integration for Mecha10 - Claude, GPT-4, Gemini, and local models

    v0.1.25 #large-language-model #local-llm #claude #model-integration #artificial-intelligence #mecha10 #gpt-4 #system-prompt #ollama #gemini

  17. hematite-cli

    Senior SysAdmin, Network Admin, Data Analyst, and Software Engineer living in your terminal. A high-precision local AI agent harness for LM Studio, Ollama, and other local OpenAI-compatible…

    v0.14.1 #local-llm #lm-studio #sysadmin

  18. oddonkey

    A dead-simple Ollama wrapper – auto-installs Ollama & models, then lets you prompt in two lines of code

    v0.2.0 #ollama #local-llm #embedding #llm

  19. arct-ai

    AI integration for Arc Academy Terminal - OpenAI, Anthropic, and local LLM support

    v0.2.2 #artificial-intelligence #arc #interactive-shell #ai-provider #local-llm #openai #anthropic #assistance

  20. infernum

    CLI - From the depths, intelligence rises

    v0.2.0-rc.2 #inference #chat #cache #chat-history #hugging-face #cuda #metal #gpu #local-llm #cli-for-running

  21. blazen-llm-candle

    Local LLM backend for Blazen using candle inference engine

    v0.6.75 #blazen #inference-engine #local-llm #llm-provider #llm-inference #event-driven #candle #llm-model #prometheus #cuda

  22. vtkxoptm

    Local-LLM token-saving router for Claude Code (vinitokx)

    v0.1.0 #local-llm #ollama #llm #claude #llm-token

  23. reviva

    Local-first review terminal for deterministic, inspectable, constrained repository analysis

    v0.1.0 #repository-analysis #local-first #deterministic #back-ends #llama-server #llm #inspectable #local-llm #coding-agent

  24. tt-provider-local

    Local-LLM provider adapter — Ollama, vLLM, LM Studio (all OpenAI-compatible)

    v0.1.0 #open-ai-compatible #provider-adapter #local-llm #lm-studio #ollama #vllm #openai #pricing #base-url #anthropic

  25. dkdc-lm-cli

    CLI for dkdc-lm: local LLM inference management

    v0.2.1 #llm-inference #cli #dkdc #local-llm #service

  26. unrager-model

    Shared data types for the unrager workspace (server, TUI, web/mobile clients)

    v0.21.1 #unrager #client-server #twitter #shared-data #filter #local-llm #notifications #rage #ollama #timeline

  27. wax-core

    Core inference engine for wax, a small Candle-based local LLM runner

    v0.1.0 #gguf #safetensors #llama #inference-engine #llm #local-llm #llm-inference #mlx #top-p #candle

  28. laminae-shadow

    Adversarial red-teaming engine for AI output — static analysis, LLM review, sandbox execution

    v0.4.2 #artificial-intelligence #laminae #adversarial #sandbox #red-teaming #llm #vulnerabilities #local-llm #ollama #security

  29. swink-agent-local-llm

    Local on-device LLM inference for swink-agent using llama.cpp

    v0.9.0 #gguf #llm-inference #local-llm #llm #embedding #local-inference

  30. dkdc-lm

    Local LLM inference management via llama-server

    v0.2.1 #llama-server #llm-inference #dkdc #service #local-llm

  31. blazen-llm-mistralrs

    Local LLM backend for Blazen using mistral.rs inference engine

    v0.6.76 #inference-engine #blazen #llm-inference #mistralrs #local-llm #mistral #gpu #llm-model #metal #accelerate

  32. blazen-llm-llamacpp

    Local LLM backend for Blazen using llama.cpp inference engine

    v0.6.76 #llama-cpp #inference-engine #blazen #local-llm #llm-inference #gpu #cuda #vulkan #llm-model #metal

  33. sonr-daemon

    Background daemon for sonr, providing semantic search capabilities using local LLMs

    v0.1.7 #semantic-search #local-llm #daemon #llama #semantic-search-tool #llama-server #model-context-protocol #gpu #hugging-face #embedding

  34. laminae-ollama

    Ollama client for local LLM inference — used by Laminae Psyche and Shadow

    v0.4.2 #llm-inference #laminae #ollama-client #local-llm #sdk #egress #local-client #shadow #psyche

  35. neuron-provider-ollama

    Ollama local model provider for neuron-turn

    v0.4.0 #ai-agent #local-llm #neuron #ollama #artificial-intelligence

  36. llm_prompt

    Low Level Prompt System for API LLMs and local LLMs

    v0.0.3 330 #gguf #local-llm #chat-template #llm-client #prompt-tokens #llm-interface #llm-model #token-count

  37. aitna

    A local LLM inference platform with model pulling, quantization optimization, and high-performance serving

    v0.1.0-alpha #llm-inference #local-llm #llm

  38. tllama

    Lightweight Local LLM Inference Engine

    v0.1.1 #local-llm #inference-engine #llm-inference #openai #server-api #api-model

  39. alith-models

    Load and Download LLM Models, Metadata, and Tokenizers

    v0.4.3 #gguf #llm-model #metadata #hugging-face #local-llm #tokenizer #embedding

  40. coze

    An egui app for playing with a local open source LLM

    v0.1.7 550 #local-llm #egui #model #mistral #zephyr #candle #cache #instruct #model-weights #hugging-face

  41. dkdc-ai

    Local LLM inference management via llama-server

    v0.1.0 #llm-inference #local-llm #llama-server #management #tmux-session
  42. Try searching with DuckDuckGo.


  43. alith-prompt

    LLM Prompting

    v0.4.3 #chat-template #openai #llm-prompt #prompt-tokens #local-llm #hash-map #model-context

  44. skg-provider-ollama

    Ollama local model provider for skg-turn

    v0.4.1 #ai-agent #local-llm #skelegent #ollama #artificial-intelligence

  45. deck-llm

    LLM backend trait + Ollama HTTP implementation for ono-sendai

    v0.1.1 #ollama #back-end #llm #local-llm #ono-sendai #back-end-traits

  46. llmterm

    Your friendly local LLM terminal companion

    v0.2.3 #local-llm #inference #terminal #shell #kalosm