Documentation / Connect

Connect → llm

Use AxForge with llm

llm runs prompts from the command line and keeps a log of them. One entry in its extra-openai-models.yaml adds an AxForge model.

Before you start
  • An AxForge API key. Get one (a minute).
  • Python 3.9 or newer. This guide was tried with llm 0.36 on 2026-10-17.

Set it up

  1. Install llm

    pip install llm
  2. Add the AxForge model

    Create extra-openai-models.yaml in llm's folder, the one llm logs path shows (on Linux ~/.config/io.datasette.llm/):

    - model_id: axforge
      model_name: qwen3.8-27b
      api_base: https://api.axforge.ai/v1
      api_key_name: axforge

    model_id is the name you type after -m; model_name is ours. Add more entries the same way, for example axforge-glm for glm-5.3-flash.

  3. Store your key

    llm keys set axforge

    Paste the key when it asks. llm keeps it in its own key file under the name axforge, the api_key_name above.

  4. Ask

    llm -m axforge "Say hello in five words"
    The model file written, the key stored with llm keys set, and llm -m axforge answering with a five-word hello

The settings

KeyValue
model_idaxforge (your choice)
model_nameqwen3.8-27b, glm-5.3-flash or mimo-v2.6-flash
api_basehttps://api.axforge.ai/v1
api_key_nameaxforge (the name used in llm keys set)

Which model for what: qwen3.8-27b is the everyday default and reads images, glm-5.3-flash thinks before it answers, mimo-v2.6-flash is the fastest. To make it the default: llm models default axforge.

Check that it works

llm -m axforge answers, and llm logs -n 1 shows the prompt and reply. The call shows in the console under API Keys → Recent calls within a minute.

When it does not work

Not sure which it is? The connection doctor makes seven small checks on your key and names the fix: irm https://dev.axforge.ai/assets/axforge-doctor.ps1 | iex in PowerShell, curl -fsSL https://dev.axforge.ai/assets/axforge-doctor.sh | bash on macOS and Linux.

What you seeWhat it meansFix
"Unknown model: axforge"llm did not find the YAML fileput it in the folder of llm logs path, named exactly extra-openai-models.yaml
"Invalid API key. Create one at https://console.axforge.ai/keys."no key under the name axforge, or it was refusedrun llm keys set axforge again and paste the key whole

Test a call says in one click whether a problem is your key, your balance or us.

Ask on the forum Markdown For AI Updated 2026-11-06

Anything unclear on this page?

Ask on the forum. The answer helps the next person too.

Ask about this page