documentation updated for model inference settings
This commit is contained in:
@@ -14,6 +14,7 @@ inference services. Served as static files by Caddy on Mini PC 2.
|
||||
## Dependencies
|
||||
|
||||
- `react` + `react-dom` — UI framework
|
||||
- `react-markdown` — Markdown rendering in message bubbles and memory viewer
|
||||
- `uuid` — session ID generation
|
||||
- `vite` + `@vitejs/plugin-react` — build tooling
|
||||
|
||||
@@ -63,13 +64,16 @@ export default defineConfig({
|
||||
'/sessions': 'http://192.168.0.205:4000',
|
||||
'/chat': 'http://192.168.0.205:4000',
|
||||
'/projects': 'http://192.168.0.205:4000',
|
||||
'/episodes': 'http://192.168.0.205:4000',
|
||||
'/settings': 'http://192.168.0.205:4000',
|
||||
'/health': 'http://192.168.0.205:4000',
|
||||
}
|
||||
}
|
||||
});
|
||||
```
|
||||
|
||||
When adding new top-level routes to the orchestration service, add a matching
|
||||
entry here too.
|
||||
entry here and in the Caddy config.
|
||||
|
||||
## Internal Structure
|
||||
|
||||
@@ -84,19 +88,22 @@ src/
|
||||
│ ├── useChat.js # Message sending, SSE streaming, message state
|
||||
│ ├── useModels.js # Dynamic model list fetched from /models endpoint
|
||||
│ ├── useProjects.js # Project list fetched from /projects endpoint
|
||||
│ ├── useSettings.js # Settings fetch + saveSetting helper
|
||||
│ └── useContextMenu.js # Right-click context menu position and visibility
|
||||
├── components/
|
||||
│ ├── App.jsx # Root component — layout, shared state, view routing
|
||||
│ ├── Sidebar.jsx # Left sidebar — projects, recent chats, navigation
|
||||
│ ├── ChatWindow.jsx # Centre panel — message thread and input bar
|
||||
│ ├── MessageBubble.jsx # Individual message bubble (user or assistant)
|
||||
│ ├── MessageBubble.jsx # Individual message bubble — renders markdown via react-markdown
|
||||
│ ├── InfoPanel.jsx # Right panel — model selector and session metadata (slide-in)
|
||||
│ ├── SessionModal.jsx # Modal for session rename, project assignment, delete
|
||||
│ ├── ProjectModal.jsx # Modal for project create, edit, delete
|
||||
│ ├── AllChatsView.jsx # Full paginated session list with multi-select bulk delete
|
||||
│ ├── AllProjectsView.jsx # Project tile grid with create/edit/delete
|
||||
│ ├── ProjectView.jsx # Individual project — session list, new chat button
|
||||
│ └── SettingsView.jsx # Settings placeholder (Appearance, Memory, Models, About)
|
||||
│ ├── MemoryView.jsx # Paginated, searchable, expandable, deletable episode viewer
|
||||
│ └── SettingsView.jsx # Settings — Memory limits, Models (inference params, active
|
||||
│ # model, context window), Service Health, Appearance placeholder
|
||||
├── index.css # Global reset, CSS variables, utility classes
|
||||
└── main.jsx # React entry point
|
||||
```
|
||||
@@ -118,7 +125,7 @@ panel are persistent across all views.
|
||||
│ ⊞ View Projects │ all-projects → AllProjectsView│
|
||||
│ │ project → ProjectView │
|
||||
│ PROJECTS ▾ │ settings → SettingsView │
|
||||
│ [tile] [tile] │ │
|
||||
│ [tile] [tile] │ memory → MemoryView │
|
||||
│ All Projects → │ │
|
||||
│ │ │
|
||||
│ RECENT CHATS ▾ │ │
|
||||
@@ -143,6 +150,7 @@ via the `⊹` button in the `ChatWindow` header.
|
||||
| `'all-projects'` | `AllProjectsView` | "View Projects" button or ⊞ icon |
|
||||
| `'project'` | `ProjectView` | Clicking a project tile in the sidebar |
|
||||
| `'settings'` | `SettingsView` | Settings button or ⚙ icon |
|
||||
| `'memory'` | `MemoryView` | "Open →" button in Settings → Memory section |
|
||||
|
||||
`activeProject` state in `App.jsx` tracks which project `ProjectView` is
|
||||
displaying. Set via `onSelectProject` before navigating to `'project'`.
|
||||
@@ -261,4 +269,19 @@ exposes `refreshProjects` for keeping the sidebar in sync after mutations.
|
||||
and a filtered session list. The "+ New Chat" button creates a new session,
|
||||
navigates to `'chat'`, and writes the project assignment after the first message.
|
||||
|
||||
For memory isolation behaviour, see `memory-isolation.md`.
|
||||
For memory isolation behaviour, see `memory-isolation.md`.
|
||||
|
||||
## Settings
|
||||
|
||||
`useSettings` fetches from `GET /settings` on mount and exposes a `saveSetting(key, value)`
|
||||
helper that issues a `PATCH /settings` with a single key-value pair. The `saving`
|
||||
boolean is exposed for disabling save buttons during in-flight requests.
|
||||
|
||||
`SettingsView` is organised into sections:
|
||||
|
||||
- **Memory** — recent episode limit, semantic limit, score threshold, link to MemoryView
|
||||
- **Models** — models folder path, temperature, repeat penalty, Top-P, Top-K,
|
||||
active model dropdown, read-only model info panel (file, size, context window,
|
||||
loaded model from llama-server)
|
||||
- **About** — service health check panel, version
|
||||
- **Appearance** — theme (coming soon)
|
||||
Reference in New Issue
Block a user