Connect → LlamaIndex

Use AxForge with LlamaIndex

LlamaIndex connects models to your data: indexes, retrieval, agents. Its OpenAILike class is made for OpenAI-compatible services such as AxForge.

Set it up

1. Install the OpenAILike package

   pip install llama-index-llms-openai-like

2. Point OpenAILike at AxForge

   import os
   from llama_index.llms.openai_like import OpenAILike
   
   llm = OpenAILike(
       api_base="https://api.axforge.ai/v1",
       api_key=os.environ["AXFORGE_API_KEY"],
       model="qwen3.8-27b-nvfp4",
       is_chat_model=True,
       is_function_calling_model=True,
       context_window=262144,
   )
   print(llm.complete("Say hello in five words"))

   OpenAILike cannot ask our models what they can do, so you tell it: they are chat models, they call tools, and they read 262,144 tokens at once.

3. Run it

   python hello.py

   

To use it everywhere in LlamaIndex: from llama_index.core import Settings, then Settings.llm = llm.

The settings

Which model for what: qwen3.8-27b-nvfp4 is the everyday default and reads images, glm-5.3-flash thinks before it answers, mimo-v2.6-flash is the fastest.

Check that it works

The script prints an answer. The call shows in the console under API Keys → Recent calls within a minute.

When it does not work

Test a call says in one click whether a problem is your key, your balance or us.