Ellama is a tool for interacting with large language models from Emacs. It allows you to ask questions and receive responses from the LLMs. Ellama can perform various tasks such as translation, code review, summarization, enhancing grammar/spelling or wording and more through the Emacs interface. Ellama natively supports streaming output, making it effortless to use with your preferred text editor.

Just M-x package-install Enter ellama Enter. By default it uses ollama provider and zephyr model. If you ok with it, you need to install ollama and pull zephyr like this:

ollama pull zephyr

You can use ellama with other model or other llm provider. In that case you should customize ellama configuration like this:

;; YOU DON'T NEED NONE OF THIS CODE FOR SIMPLE INSTALL
;; IT IS AN EXAMPLE OF CUSTOMIZATION.
(use-package ellama
  :init
  ;; language you want ellama to translate to
  (setopt ellama-language "German")
  ;; could be llm-openai for example
  (require 'llm-ollama)
  (setopt ellama-provider
                  (make-llm-ollama
                   ;; this model should be pulled to use it
                   ;; value should be the same as you print in terminal during pull
                   :chat-model "mistral:7b-instruct-v0.2-q6_K"
                   :embedding-model "mistral:7b-instruct-v0.2-q6_K"))
  ;; Predefined llm providers for interactive switching.
  ;; You shouldn't add ollama providers here - it can be selected interactively
  ;; without it. It is just example.
  (setopt ellama-providers
                  '(("zephyr" . (make-llm-ollama
                                 :chat-model "zephyr:7b-beta-q6_K"
                                 :embedding-model "zephyr:7b-beta-q6_K"))
                    ("mistral" . (make-llm-ollama
                                  :chat-model "mistral:7b-instruct-v0.2-q6_K"
                                  :embedding-model "mistral:7b-instruct-v0.2-q6_K"))
                    ("mixtral" . (make-llm-ollama
                                  :chat-model "mixtral:8x7b-instruct-v0.1-q3_K_M-4k"
                                  :embedding-model "mixtral:8x7b-instruct-v0.1-q3_K_M-4k")))))

Ask Ellama about something by entering a prompt in an interactive buffer and continue conversation.

Ask Ellama about a selected region or the current buffer.

Send selected region or current buffer to ellama chat.

Send current line to ellama chat.

Complete text in current buffer with ellama.

Ask Ellama to translate a selected region or word at the point.

Find the definition of the current word using Ellama.

Summarize a selected region or the current buffer using Ellama.

Review code in a selected region or the current buffer using Ellama.

Change text in a selected region or the current buffer according to a provided change.

Create a markdown list from the active region or the current buffer using Ellama.

Create a markdown table from the active region or the current buffer using Ellama.

Summarize a webpage fetched from a URL using Ellama.

Select ellama provider.

Complete selected code or code in the current buffer according to a provided change using Ellama.

Add new code according to a description, generating it with a provided context from the selected region or the current buffer using Ellama.

Change selected code or code in the current buffer according to a provided change using Ellama.

Change selected code or code in the current buffer according to a provided change using Ellama.

Enhance the wording in the currently selected region or buffer using Ellama.

Enhance the grammar and spelling in the currently selected region or buffer using Ellama.

Make the text of the currently selected region or buffer concise and simple using Ellama.

Render the currently selected text or the text in the current buffer as a specified format using Ellama.

Load ellama session from file.

Remove ellama session.

Change current active session.

Rename current ellama session.

Here is a table of keybindings and their associated functions in Ellama, using the C-c e prefix:

The following variables can be customized for the Ellama client:

• ellama-enable-keymap: Enable the Ellama keymap.
• ellama-keymap-prefix: The keymap prefix for Ellama.
• ellama-user-nick: The user nick in logs.
• ellama-assistant-nick: The assistant nick in logs.
• ellama-language: The language for Ollama translation. Default

language is english.

• ellama-provider: llm provider for ellama. Default provider is

ollama with zephyr model. There are many supported providers: ollama, open ai, vertex, GPT4All. For more information see llm documentation.

• ellama-providers: association list of model llm providers with name as key.
• ellama-spinner-type: Spinner type for ellama. Default type is

progress-bar.

• ellama-ollama-binary: Path to ollama binary.
• ellama-auto-scroll: If enabled ellama buffer will scroll automatically during generation. Disabled by default.
• ellama-fill-paragraphs: Option to customize ellama paragraphs filling behaviour.
• ellama-name-prompt-words-count: Count of words in prompt to generate name.
• Prompt templates for every command.
• ellama-chat-done-callback: Callback that will be called on ellama

chat response generation done. It should be a function with single argument generated text string.

• ellama-nick-prefix: User and assistant nick prefix in logs.
• ellama-session-file-extension: File extension for saving ellama session. Default value “org”.
• ellama-sessions-directory: Directory for saved ellama sessions.
• ellama-instant-mode: Major mode for ellama instant commands. Org mode by default.
• ellama-long-lines-length: Long lines length for fill paragraph call. Too low value can break generated code by splitting long comment lines. Default value 100.

Thanks Jeffrey Morgan for excellent project ollama. This project cannot exist without it.

Thanks zweifisch - I got some ideas from ollama.el what ollama client in Emacs can do.

Thanks Dr. David A. Kunz - I got more ideas from gen.nvim.

Thanks Andrew Hyatt for llm library. Without it only ollama would be supported.

To contribute, submit a pull request or report a bug. This library is part of GNU ELPA; major contributions must be from someone with FSF papers. Alternatively, you can write a module and share it on a different archive like MELPA.