LLaMA Vim 插件

Installation

Plugin setup

• vim-plug

    Plug 'ggml-org/llama.vim'
    

• Vundle

    cd ~/.vim/bundle
    git clone https://github.com/ggml-org/llama.vim
    

Then add Plugin 'llama.vim' to your .vimrc in the vundle#begin() section.

• lazy.nvim

    {
        'ggml-org/llama.vim',
    }
    

llama.cpp setup

The plugin requires a llama.cpp server instance to be running at g:llama_config.endpoint_fim and/or g:llama_config.endpoint_inst.

Mac OS

brew install llama.cpp

Windows

winget install llama.cpp

Any other OS

Either build from source or use the latest binaries: https://github.com/ggml-org/llama.cpp/releases

Examples

<img width="1758" alt="image" src="https://github.com/user-attachments/assets/8f5748b3-183a-4b7f-90e1-9148f0a58883">

Another example on a small Swift code

Plugin configuration

You can customize llama.vim by setting the g:llama_config variable.

Examples:

1. Disable the inline info:

    " put before llama.vim loads
    let g:llama_config = { 'show_info': 0 }
    

1. Same thing but setting directly

    let g:llama_config.show_info = v:false
    

1. Disable auto FIM (Fill-In-the-Middle) completion with lazy.nvim

    {
        'ggml-org/llama.vim',
        init = function()
            vim.g.llama_config = {
                auto_fim = false,
            }
        end,
    }
    

1. Configure FIM keymaps:

    let g:llama_config.keymap_fim_trigger     = "<leader>llf"
    let g:llama_config.keymap_fim_accept_full = "<Tab>"
    let g:llama_config.keymap_fim_accept_line = "<S-Tab>"
    let g:llama_config.keymap_fim_accept_word = "<leader>ll]"
    

1. Configure instruction-based editing keymaps

    let g:llama_config.keymap_inst_trigger  = "<leader>lli"
    let g:llama_config.keymap_inst_rerun    = "<leader>llr"
    let g:llama_config.keymap_inst_continue = "<leader>llc"
    let g:llama_config.keymap_inst_accept   = "<Tab>"
    let g:llama_config.keymap_inst_cancel   = "<Esc>"
    

1. Configure named llama.cpp servers:

    let g:llama_config.profiles = {
        \ 'spark':   'http://192.168.0.66:8080',
        \ 'gmktec':  'http://192.168.0.65:8080',
        \ }
    let g:llama_config.profile = 'spark'
    

Use :LlamaProfile to show the available profiles and :LlamaProfile spark to switch both FIM and instruction requests to another server. Profile names support command-line completion. The selected profile is persisted and :LlamaProfileReset can be used to restore the profile (or custom endpoints) configured in .vimrc.

This only allows the host servers to be specified, not the models used which are configured using model_fim and model_inst. But using consistent naming accross servers, or using server aliases, one can make this independant of the actual selected profile. For example, using something like:

    \ 'model_fim':              'fim_model',
    \ 'model_inst':             'inst_model',

[qwen3.8-27B]
alias                = inst_model,pi

Please refer to :help llama_config or the source for the full list of options.

llama.cpp settings

Here are recommended settings, depending on the amount of VRAM that you have:

• More than 64GB VRAM:

  llama-server --fim-qwen-30b-default
  

• More than 16GB VRAM:

  llama-server --fim-qwen-7b-default
  

• Less than 16GB VRAM:

  llama-server --fim-qwen-3b-default
  

• Less than 8GB VRAM:

  llama-server --fim-qwen-1.5b-default
  

Use :help llama for more details.