Ragfish Logo
Get In Touch
Ragfish Logo

Book a Demo

Ollama

           Coming Soon

Ragfish is designed with a modular AI provider architecture, allowing applications to work with different AI model providers through the same Core Framework.

Ollama support is planned for a future release.

Planned Integration

The planned Ollama integration will allow Ragfish applications to work with locally hosted AI models.

The integration is expected to follow the same provider architecture used by the existing OpenAI integration.

@ragfish/core
     │
     ▼
  Settings
     │
     ▼
Ollama Provider
     │
     ├── Language Model
     └── Embeddings



Local AI Architecture

Ollama is intended to support local model deployments.

A future Ragfish application could follow this architecture:

Ragfish Application
       │
       ▼
  @ragfish/core
       │
       ▼
    Settings
       │
       ▼
     Ollama
       │
       ▼
Local AI Model


This can provide an alternative to cloud-based AI providers for applications that require locally hosted model infrastructure.

Provider Independence

The Ragfish provider architecture keeps AI-provider-specific implementation separate from the Core Framework.

Application
   │
   ▼
@ragfish/core
   │
   ▼
Provider Interface
   │
   ▼
Ollama

This allows the rest of the Ragfish RAG pipeline to remain independent of the underlying model provider.

Status

     Status : Coming Soon

Ollama support is not currently available in the documented Ragfish release.

Installation instructions, supported models, configuration options, and API examples will be added when the integration is released.

For currently available AI provider functionality, see OpenAI