---
id: T-377
name: "LLM Provider abstraction layer with Ollama + OpenRouter"
description: >
  Create web/llm/ package with LLMProvider ABC, OllamaProvider, OpenRouterProvider,
  ProviderManager. Strategy pattern for hot-switching. Refactor ask.py to use provider
  interface. Add openai dependency. Parent: T-375.

status: work-completed
workflow_type: build
owner: agent
horizon:
tags: [llm, openrouter]
components: []
related_tasks: []
created: 2026-03-09T09:41:38Z
last_update: '2026-06-11T22:24:20Z'
date_finished: 2026-03-09T09:51:06Z
bvp_scores_proposed:
  - ts: '2026-06-11T22:24:20Z'
    estimator: bvp-estimator-v1-heuristic
    scores:
      D1: 0
      D2: 0
      D3: 0
      D4: 0
      F-RECALL: 0
      F-ORCH: 0
      F3: 0
      F1: 0
      F2: 0
    rationale: D1=0 (no-signal); D2=0 (no-signal); D3=0 (no-signal); D4=0 
      (no-signal); F-RECALL=0 (no-signal); F-ORCH=0 (no-signal); F3=0 
      (no-signal); F1=0 (no-signal); F2=0 (no-signal)
    rubric_sha: e4a00f38e801
---

# T-377: LLM Provider abstraction layer with Ollama + OpenRouter

## Context

<!-- One sentence for small tasks. Link to design docs for substantial ones. -->

## Acceptance Criteria

### Agent
- [x] web/llm/ package created with provider.py, ollama_provider.py, openrouter_provider.py, manager.py
- [x] LLMProvider ABC with chat_stream, list_models, is_available
- [x] ask.py refactored to use provider abstraction (no direct ollama import)
- [x] ProviderManager supports hot-switching and lazy OpenRouter registration
- [x] All search/ask tests pass (36/36)

## Verification

python3 -c "from web.llm import get_manager; m = get_manager(); print(m.active_name, len(m.list_providers()))"
python3 -c "from web.ask import stream_answer, get_model; print('OK')"

## Decisions

<!-- Record decisions ONLY when choosing between alternatives.
     Skip for tasks with no meaningful choices.
     Format:
     ### [date] — [topic]
     - **Chose:** [what was decided]
     - **Why:** [rationale]
     - **Rejected:** [alternatives and why not]
-->

## Updates

### 2026-03-09T09:41:38Z — task-created [task-create-agent]
- **Action:** Created task via task-create agent
- **Output:** /opt/999-Agentic-Engineering-Framework/.tasks/active/T-377-llm-provider-abstraction-layer-with-olla.md
- **Context:** Initial task creation

### 2026-03-09T09:47:37Z — status-update [task-update-agent]
- **Change:** status: captured → started-work

### 2026-03-09T09:51:06Z — status-update [task-update-agent]
- **Change:** status: started-work → work-completed

## Reviewer Verdict (v1.5)

- **Scan ID:** R-09b00823
- **Timestamp:** 2026-06-02T15:02:28Z
- **Catalogue:** v1.3-seed
- **Overall:** PASS
- **Needs Human:** no
- **Findings:** none
