A0 LocalAI plugin thumbnail

A0 LocalAI

Adds LocalAI as an OpenAI-compatible LLM provider for Agent Zero chat and embedding models.

Author neurocis 0 stars Version 0.1.0 Updated
LlmIntegrationApi
GitHub Repository Discussion How to install

README

A0 LocalAI

A0 LocalAI adds LocalAI as an OpenAI-compatible LLM provider in Agent Zero.

It is a lightweight provider-definition plugin. It does not run LocalAI itself and does not add background services. Instead, it exposes a dedicated LocalAI provider option that can be configured with your own LocalAI/OpenAI-compatible endpoint.

What it adds

The plugin contributes provider definitions through:

conf/model_providers.yaml

Provider details

  • Runtime plugin name: a0_localai
  • Provider id: localai
  • Display name: LocalAI
  • LiteLLM provider: openai
  • Model listing endpoint: /models
  • Chat models: supported
  • Embedding models: supported

Both chat and embedding provider sections mirror Agent Zero's generic Other OpenAI compatible provider shape, but are labeled specifically for LocalAI.

Endpoint configuration

No API base is hardcoded in conf/model_providers.yaml.

Configure the LocalAI endpoint per model in Agent Zero's Model Configuration UI, the same way you would configure another OpenAI-compatible endpoint.

Common examples:

http://localhost:8080/v1
http://host.docker.internal:8080/v1
http://your-localai-host:8080/v1

Use the API base that matches your LocalAI deployment.

Installation

Install through the Agent Zero Plugin Hub when available, or copy this plugin folder into Agent Zero's user plugins directory:

/a0/usr/plugins/a0_localai

Then enable A0 LocalAI from the Plugins UI if it is not already enabled.

Notes

  • This plugin is intentionally small: it only contributes model provider metadata.
  • It uses LiteLLM's openai provider compatibility mode via custom_llm_provider: openai so non-registry LocalAI model ids can be used.
  • You must run and secure your LocalAI server separately.