Files
openwiki-wiki/sources/README.md
T
2026-08-23 02:33:39 +08:00

43 lines
12 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
---
type: "Reference"
title: "Sources"
description: "Per-connector evidence indexes and ingestion coverage for the local knowledge wiki; durable synthesis lives on canonical pages."
tags: [sources, connectors, evidence, ingestion, 2026-08-22]
timestamp: 2026-08-22T18:00:32Z
---
# Sources
Per-connector evidence indexes. Each connector gets its own page (for example `gmail.md`, `slack.md`) that records ingestion coverage, freshness, and a compact evidence trail. Durable synthesis lives on the canonical pages (`/themes.md`, `/commitments.md`, `/personal-logistics.md`, `/open-questions.md`); these source pages are the evidence layer underneath.
## Active connectors
| Connector | Page | Status |
| --- | --- | --- |
| Hacker News (`hackernews-1`, LLM-agent topics) | [/sources/hackernews.md](/sources/hackernews.md) | active (last 2026-08-22 18:00 UTC — twelfth pull since 2026-08-07 with an empty / noise-only Algolia lane on vendor queries; the 2026-08-22 pull reverts to the noise-only shape (organoid 5 hits + CelVivo 0 + 3Brain 6 hits + Cellink 3 hits + openwiki 0 + deepagents 0) after the 2026-08-21 fully-zero pull — NOT a third fully-zero Algolia lane in a row; the noise-only Algolia substring hits include **1 thematic organoid duplicate** (`49400587` Nautilus "The Remarkable Lives of 5-Year-Old Brain Organoids" 1 pt top, the 3rd neural-organoid HN signal in 11 pulls after the 2026-07-27 Nature biocomputing `49071596` + 2026-08-12 Wired `49266068` + 2026-08-20 Nature `49366519` + Science Alert `49373812`) + **2 agent-memory-architecture adjacents** (`49394827` OzBrain 72 pts top, submitter text explicitly cites "Obsidian vaults with 7k files synced through a VPS, markdown repos behind their own MCP servers" — exact architectural parallel to Robin's OpenWiki + Obsidian vault stack; `49399942` Knowl 1 pt top, open-source MCP-backed agent memory with memory-pruning pattern — same pattern the `agent-memory-architecture` row anchors on); the strongest named-stack-adjacent items are `49398152` "Munder Difflin Agent harness to run an office of your clones" 192 pts top (agent harness cross-walks to the same agent-as-primary-compute-substrate narrative Robin's `hermes-agent-v0-19-quicksilver` row documents; **5th entry in the now 5-day self-hosted-agentic-substrate cluster** — DeepSeek Harness 2026-08-13 + machine0 2026-08-18 + OneCLI 2026-08-19 + self-hosted agentic software factory 2026-08-21 + **Munder Difflin 2026-08-22** — 5 independent submissions across 5 consecutive working days, with Munder Difflin's 192-pt engagement being the second-highest of the cluster after the 422-pt DeepSeek Harness; cluster is now an emerging-pattern watchlist candidate) + `49399591` "New MCP Roadmap" 120 pts top (official MCP roadmap from the canonical MCP blog at blog.modelcontextprotocol.io — **first MCP-protocol roadmap entry since the 2026-07-28 MCP revision finalization** documented on the `hermes-agent-v0-19-quicksilver` row; **MCP substrate is its own substrate-cluster watchlist candidate** — MCP Memory 2026-08-13 + machine0 MCP support 2026-08-18 + OneCLI MCP connectors 2026-08-19 + **New MCP Roadmap 2026-08-22** — 4 distinct substrate-protocol signals across 4 pulls in 10 days; MCP is the protocol-layer substrate of every named-stack item on Robin's workflow — Hermes Agent / Codex CLI / OpenWiki / RAGFlow / machine0 / OneCLI all depend on MCP), with five additional adjacents flagged for traceability: `49394827` OzBrain 72 pts top (3Brain substring-noise duplicate; direct Obsidian-vault + MCP architectural parallel to Robin's OpenWiki stack; adjacent-not-promoted per scope), `49399942` Knowl 1 pt top (Cellink substring-noise duplicate; open-source MCP-backed agent memory with memory-pruning pattern; adjacent-not-promoted per scope), `49400587` Nautilus 5-Year-Old Brain Organoids 1 pt top (organoid/3Brain substring-noise duplicate; 3rd neural-organoid HN signal in 11 pulls; flagged-for-traceability rather than promoted because 1-pt engagement is below the 5-pt 2026-08-12 Wired + 18-pt 2026-08-20 Nature engagement thresholds that drove prior `class-organoid-3d-bioprinting` Last-seen refreshes), `49401549` Anthropic Claude Code A/B testing reduced effort levels 29 pts top (4th Claude Code traceability entry in 14 days; adjacent-not-promoted per scope — Claude Code is not on Robin's named stack), `49394496` "Three important steps in my maturation process" 199 pts best (Thomas Dullien personal-blog essay; adjacent-not-promoted per scope — off-scope per scope discipline), `49397947` "Embedded AI" 29 pts top (No Starch Press book publication; adjacent-not-promoted per scope — book publication, not a vendor stack change)) |
| Git repo (`git-repo-1`, Obsidian vault + OpenWiki wiki) | [/sources/git-repo.md](/sources/git-repo.md) | active (last 2026-08-22 18:13 UTC — 0 new vault commits since 2026-08-21T18:09Z fetch (vault silent for the 6th consecutive fetch, **6 calendar days stale** since the 2026-08-16 Quintard + Guo cluster); 2 new automated wiki commits since 2026-08-21T18:09Z fetch (`d8e2277` daily update 2026-08-22 + `43d4548` sources-sync 2026-08-22, the eighth consecutive sources-sync re-applying the 2026-08-15 count-data wipe pattern)) |
| Web Search (`web-search-1`, Tavily) | [/sources/web-search.md](/sources/web-search.md) | active (latest pull 2026-08-03; 2026-08-08, 2026-08-10, 2026-08-12, 2026-08-15, 2026-08-17, 2026-08-18, 2026-08-19, 2026-08-20, 2026-08-21, and 2026-08-22 update attempts skipped — connector not enabled, `TAVILY_API_KEY` missing) |
Additional connectors appear here automatically once they are authenticated and ingested at least once.
## Connector roll
| Connector | Status | Auth / env var | Notes |
| --- | --- | --- | --- |
| Gmail (`google`) | not configured | `OPENWIKI_GOOGLE_*` via `openwiki auth google` | Direct API; defaults to `newer_than:1d`. |
| Slack | not configured | `openwiki auth slack` | Needs `search:read` for definitive self-message search; otherwise falls back to recent conversations. |
| Notion | not configured | Notion MCP credentials | Discovery via `openwiki_list_mcp_tools`; do not guess tool names. |
| X / Twitter | not configured | `OPENWIKI_X_ACCESS_TOKEN` via `openwiki auth x` | Streams: `home_timeline`, `user_posts`, `mentions`, `bookmarks`, `list_posts`. |
| Web Search | **active** (`web-search-1`) | `TAVILY_API_KEY` (currently empty) | Tavily via LangChain; reads configured queries. Latest successful pull 2026-08-03 18:08 UTC; the 2026-08-08, 2026-08-10, 2026-08-12, 2026-08-15, 2026-08-17, 2026-08-18, 2026-08-19, 2026-08-20, 2026-08-21, and 2026-08-22 update attempts were skipped because the connector was not enabled in the runtime registry (tenth consecutive skip on the same code path; nightly searxng-fallback slot for 2026-08-21 is also empty on disk). Evidence at [/sources/web-search.md](/sources/web-search.md). |
| Hacker News | **active** (`hackernews-1`) | _(public, no auth)_ | Public feeds (`top`, `new`, `best`) + Algolia HN search queries. Source-specific query set: `organoid`, `CelVivo`, `3Brain`, `Cellink`, `openwiki`, `deepagents` (LLM-agent topics per the source-specific instruction "Track organoid / CelVivo / 3Brain / Cellink / openwiki / AI agent stories"). Last successful pull 2026-08-22 18:00 UTC — **twelfth pull since 2026-08-07 with an empty / noise-only Algolia lane on vendor queries** (after the 2026-08-08 03:15 + 2026-08-08 18:00 + 2026-08-15 + 2026-08-16 + 2026-08-18 + 2026-08-19 + 2026-08-21 fully-zero pulls + the 2026-08-10 + 2026-08-12 + 2026-08-17 + 2026-08-20 + 2026-08-22 noise-only pulls where vendor queries returned substring-fragment noise; the **2026-08-22 pull reverts to the noise-only shape after the 2026-08-21 fully-zero pull** — substring-noise on organoid/3Brain/Cellink (5+6+3=14 hits) + clean zero on CelVivo/openwiki/deepagents — and is **NOT** the third fully-zero Algolia lane in a row; empty-pulls-on-vendor-queries is normal cadence, not an outage). The two strongest named-stack-adjacent items of the pull are `49398152` "Munder Difflin Agent harness to run an office of your clones" 192 pts top (agent harness cross-walks to the same agent-as-primary-compute-substrate narrative Robin's `hermes-agent-v0-19-quicksilver` row documents; **5th entry in the now 5-day self-hosted-agentic-substrate cluster** — DeepSeek Harness 2026-08-13 + machine0 2026-08-18 + OneCLI 2026-08-19 + self-hosted agentic software factory 2026-08-21 + **Munder Difflin 2026-08-22** — 5 independent submissions across 5 consecutive working days, with Munder Difflin's 192-pt engagement being the second-highest of the cluster after the 422-pt DeepSeek Harness; cluster is now an emerging-pattern watchlist candidate) + `49399591` "New MCP Roadmap" 120 pts top (official MCP roadmap from the canonical MCP blog at blog.modelcontextprotocol.io; **first MCP-protocol roadmap entry since the 2026-07-28 MCP revision finalization**; **MCP substrate is its own substrate-cluster watchlist candidate** — MCP Memory 2026-08-13 + machine0 MCP support 2026-08-18 + OneCLI MCP connectors 2026-08-19 + **New MCP Roadmap 2026-08-22** — 4 distinct substrate-protocol signals across 4 pulls in 10 days); five additional adjacents flagged for traceability: `49394827` OzBrain 72 pts top (3Brain substring-noise duplicate; direct Obsidian-vault + MCP architectural parallel to Robin's OpenWiki stack; adjacent-not-promoted per scope), `49399942` Knowl 1 pt top (Cellink substring-noise duplicate; open-source MCP-backed agent memory with memory-pruning pattern; adjacent-not-promoted per scope), `49400587` Nautilus 5-Year-Old Brain Organoids 1 pt top (organoid/3Brain substring-noise duplicate; 3rd neural-organoid HN signal in 11 pulls; flagged-for-traceability rather than promoted because 1-pt engagement is below the 5-pt Wired + 18-pt Nature engagement thresholds that drove prior `class-organoid-3d-bioprinting` Last-seen refreshes), `49401549` Anthropic Claude Code A/B testing reduced effort levels 29 pts top (4th Claude Code traceability entry in 14 days; adjacent-not-promoted per scope — Claude Code is not on Robin's named stack), `49394496` "Three important steps in my maturation process" 199 pts best (Thomas Dullien personal-blog essay; adjacent-not-promoted per scope — off-scope per scope discipline), `49397947` "Embedded AI" 29 pts top (No Starch Press book publication; adjacent-not-promoted per scope — book publication, not a vendor stack change). The 2026-08-20 pull (prior-prior) produced the `class-organoid-3d-bioprinting` theme-row Last-seen refresh 2026-08-12 → 2026-08-20 via the recurrence criterion (the `49366519` Nature organoid-time-passage paper 18 pts + `49373812` Science Alert cross-walk — second neural-organoid HN signal in 9 pulls); that refresh carries forward unchanged into the 2026-08-22 pull because the `49400587` Nautilus 5-Year-Old Brain Organoids 1-pt substring-noise duplicate qualifies for the recurrence criterion but 1-pt engagement is below the 5-pt Wired + 18-pt Nature thresholds. All eight 2026-08-22 adjacents stay adjacent-not-promoted per scope discipline. Evidence at [/sources/hackernews.md](/sources/hackernews.md). |
| Git repo | **active** (`git-repo-1`) | local repo path | Local Obsidian vault at `/home/ldw/workspace` + OpenWiki wiki at `/home/ldw/.openwiki/wiki` (two configured repos per `~/.openwiki/connectors/git-repo/config.json`). Writes compact manifest; repo itself is source of truth. Evidence at [/sources/git-repo.md](/sources/git-repo.md). Last updated 2026-08-22 18:13 UTC — **0 new vault commits in the 24-hour window** (vault silent for the 6th consecutive fetch; the 2026-08-16 Quintard 2024 + Guo 2026 cluster remains the most recent vault activity, **6 calendar days stale**); 2 new automated wiki commits since the 2026-08-21 fetch (`d8e2277` daily update 2026-08-22 + `43d4548` sources-sync 2026-08-22, the **eighth** consecutive sources-sync re-applying the 2026-08-15 count-data wipe pattern after `997b648` 2026-08-16 + `be49285` 2026-08-17 + `1fc73ae` 2026-08-18 + `dcb53a2` 2026-08-19 + `bd30339` 2026-08-20 + `f6c2576` 2026-08-21 + now `43d4548` 2026-08-22). |
## How new source pages get created
When a connector ingests for the first time, an update run will:
1. Write the raw dump to `~/.openwiki/connectors/<connector>/raw/`.
2. Create `/sources/<connector>.md` with the ingestion manifest, freshness, and compact evidence notes.
3. Route durable items into the canonical pages and add a row in `/themes.md` if a recurring signal emerges.
Until then, the new connector only has a row in the active connectors table above and no evidence page of its own..its own...