OpenWiki Bot
42 lines
3.7 KiB
Markdown
42 lines
3.7 KiB
Markdown
---
|
|
type: "Reference"
|
|
title: "Sources"
|
|
description: "Per-connector evidence indexes and ingestion coverage for the local knowledge wiki; durable synthesis lives on canonical pages."
|
|
tags: [sources, connectors, evidence, ingestion]
|
|
---
|
|
|
|
# Sources
|
|
|
|
Per-connector evidence indexes. Each connector gets its own page (for example `gmail.md`, `slack.md`) that records ingestion coverage, freshness, and a compact evidence trail. Durable synthesis lives on the canonical pages (`/themes.md`, `/commitments.md`, `/personal-logistics.md`, `/open-questions.md`); these source pages are the evidence layer underneath.
|
|
|
|
## Active connectors
|
|
|
|
| Connector | Page | Status |
|
|
| --- | --- | --- |
|
|
| Hacker News (`hackernews-1`, LLM-agent topics) | [/sources/hackernews.md](/sources/hackernews.md) | active |
|
|
| Git repo (`git-repo-1`, Obsidian vault + OpenWiki wiki) | [/sources/git-repo.md](/sources/git-repo.md) | active (last 2026-08-15 18:07 UTC) |
|
|
| Web Search (`web-search-1`, Tavily) | [/sources/web-search.md](/sources/web-search.md) | active (latest pull 2026-08-03; 2026-08-08, 2026-08-10, 2026-08-12, and 2026-08-15 update attempts skipped — connector not enabled, `TAVILY_API_KEY` missing) |
|
|
|
|
Additional connectors appear here automatically once they are authenticated and ingested at least once.
|
|
|
|
## Connector roll
|
|
|
|
| Connector | Status | Auth / env var | Notes |
|
|
| --- | --- | --- | --- |
|
|
| Gmail (`google`) | not configured | `OPENWIKI_GOOGLE_*` via `openwiki auth google` | Direct API; defaults to `newer_than:1d`. |
|
|
| Slack | not configured | `openwiki auth slack` | Needs `search:read` for definitive self-message search; otherwise falls back to recent conversations. |
|
|
| Notion | not configured | Notion MCP credentials | Discovery via `openwiki_list_mcp_tools`; do not guess tool names. |
|
|
| X / Twitter | not configured | `OPENWIKI_X_ACCESS_TOKEN` via `openwiki auth x` | Streams: `home_timeline`, `user_posts`, `mentions`, `bookmarks`, `list_posts`. |
|
|
| Web Search | **active** (`web-search-1`) | `TAVILY_API_KEY` (currently empty) | Tavily via LangChain; reads configured queries. Latest successful pull 2026-08-03 18:08 UTC; the 2026-08-08, 2026-08-10, 2026-08-12, and 2026-08-15 update attempts were skipped because the connector was not enabled in the runtime registry. Evidence at [/sources/web-search.md](/sources/web-search.md). |
|
|
| Hacker News | **active** (`hackernews-1`) | _(public, no auth)_ | Public feeds (`top`, `new`, `best`) + Algolia HN search queries. Source-specific query set: `organoid`, `CelVivo`, `3Brain`, `Cellink`, `openwiki`, `deepagents` (LLM-agent topics per the source-specific instruction "Track organoid / CelVivo / 3Brain / Cellink / openwiki / AI agent stories"). Last successful pull 2026-08-16 18:00 UTC — fifth consecutive "no promotable hits" pull under the 6-query set (empty-pulls-on-vendor-queries is normal cadence, not an outage). Evidence at [/sources/hackernews.md](/sources/hackernews.md). |
|
|
| Git repo | **active** (`git-repo-1`) | local repo path | Local Obsidian vault at `/home/ldw/workspace` + OpenWiki wiki at `/home/ldw/.openwiki/wiki` (two configured repos per `~/.openwiki/connectors/git-repo/config.json`). Writes compact manifest; repo itself is source of truth. Evidence at [/sources/git-repo.md](/sources/git-repo.md). Last updated 2026-08-15 18:07 UTC. |
|
|
|
|
## How new source pages get created
|
|
|
|
When a connector ingests for the first time, an update run will:
|
|
|
|
1. Write the raw dump to `~/.openwiki/connectors/<connector>/raw/`.
|
|
2. Create `/sources/<connector>.md` with the ingestion manifest, freshness, and compact evidence notes.
|
|
3. Route durable items into the canonical pages and add a row in `/themes.md` if a recurring signal emerges.
|
|
|
|
Until then, the new connector only has a row in the active connectors table above and no evidence page of its own.. |