LLaMA Vim 插件

Installation

Plugin setup

• vim-plug

    Plug 'ggml-org/llama.vim'
    

• Vundle

    cd ~/.vim/bundle
    git clone https://github.com/ggml-org/llama.vim
    

Then add Plugin 'llama.vim' to your .vimrc in the vundle#begin() section.

• lazy.nvim

    {
        'ggml-org/llama.vim',
    }
    

llama.cpp setup

The plugin requires a llama.cpp server instance to be running at g:llama_config.endpoint_fim and/or g:llama_config.endpoint_inst.

Mac OS

brew install llama.cpp

Windows

winget install llama.cpp

Any other OS

Either build from source or use the latest binaries: https://github.com/ggml-org/llama.cpp/releases

Examples

<img width="1758" alt="image" src="https://github.com/user-attachments/assets/8f5748b3-183a-4b7f-90e1-9148f0a58883">

Another example on a small Swift code

Plugin configuration

You can customize llama.vim by setting the g:llama_config variable.

Examples:

1. Disable the inline info:

    " put before llama.vim loads
    let g:llama_config = { 'show_info': 0 }
    

1. Same thing but setting directly

    let g:llama_config.show_info = v:false
    

1. Disable auto FIM (Fill-In-the-Middle) completion with lazy.nvim

    {
        'ggml-org/llama.vim',
        init = function()
            vim.g.llama_config = {
                auto_fim = false,
            }
        end,
    }
    

1. Configure FIM keymaps:

    let g:llama_config.keymap_fim_trigger     = "<leader>llf"
    let g:llama_config.keymap_fim_accept_full = "<Tab>"
    let g:llama_config.keymap_fim_accept_line = "<S-Tab>"
    let g:llama_config.keymap_fim_accept_word = "<leader>ll]"
    

1. Configure instruction-based editing keymaps

    let g:llama_config.keymap_inst_trigger  = "<leader>lli"
    let g:llama_config.keymap_inst_retry    = "<leader>llr"
    let g:llama_config.keymap_inst_continue = "<leader>llc"
    let g:llama_config.keymap_inst_accept   = "<Tab>"
    let g:llama_config.keymap_inst_cancel   = "<Esc>"
    

Please refer to :help llama_config or the source for the full list of options.

llama.cpp settings

Here are recommended settings, depending on the amount of VRAM that you have:

• More than 64GB VRAM:

  llama-server --fim-qwen-30b-default
  

• More than 16GB VRAM:

  llama-server --fim-qwen-7b-default
  

• Less than 16GB VRAM:

  llama-server --fim-qwen-3b-default
  

• Less than 8GB VRAM:

  llama-server --fim-qwen-1.5b-default
  

Use :help llama for more details.