Commit graph

649 commits

Author SHA1 Message Date
Aaron Bockelie
d4c005f1a6 docs(adr): accept ADR-203 (reviewed & approved) 2026-05-19 00:16:11 -05:00
Aaron Bockelie
2be1998e12 docs(adr): ADR-203 — faithful-by-default content reads; concise tool results (#133)
Synthesizes #133's intent (machine-usable default for a machine protocol)
with the project instinct (concise formatted tool results, but unaltered
content for editing). Empirically grounded: default vault.read is lossy
(fragments + flattens newlines → broken read→edit round-trip), the raw
envelope double-encodes the body (~2x), and returnFullFile-without-raw
crashes the formatter.

Decision (two-bucket contract): content reads faithful/verbatim by default
(fragmentation = explicit opt-in via existing strategy/maxFragments);
action/result tools stay concise-formatted by default; stop double-encoding
the body; verbatim path must not route through the broken formatter.
#133's global-raw-flip remedy explicitly declined; its intent satisfied by
bucket 1. Status: Proposed (design of record; implementation tracked
separately, not in this ADR).
2026-05-19 00:14:29 -05:00
Aaron Bockelie
2decbc4f08
Merge pull request #203 from aaronsb/refactor/199-split-router-monolith
refactor(router): extract vault operation into operations/ module (ADR-202, #199 stage 1)
2026-05-19 00:00:09 -05:00
Aaron Bockelie
767bbd7a49 refactor(router): drop unused ctx param from pure helpers (PR #203 review nit)
splitContent/sortFiles don't touch RouterContext — the uniform ctx-first
param was a mechanical-extraction artifact. Removed from both defs and
their two call sites. Indentation nit deliberately NOT addressed: the
retained class-method indentation is what makes the extraction a
byte-verifiable behaviour-preserving move (per the review's normalized
diff); reflowing would destroy that property for zero functional gain.

tsc clean, lint baseline, 235/235.
2026-05-18 23:14:12 -05:00
Aaron Bockelie
c2d6f8b325 refactor(router): extract vault operation into operations/ module (ADR-202, #199 stage 1)
router.ts was a 2,228-line monolith (~2.8x the 800-line threshold). Extract
the largest unit — executeVaultOperation + its helpers — into
src/semantic/operations/vault.ts behind a RouterContext interface.

- operations/router-context.ts: RouterContext (api/app/fragmentRetriever/
  validator); SemanticRouter implements it and passes itself, so shared
  state propagates with no indirection
- operations/shared.ts: Params, SearchResultItem, paramStr/Num/Bool
  (router-private → shared by all handlers)
- operations/vault.ts: executeVaultOperation + splitContent/sortFiles/
  copyFile/copyDirectoryRecursive; mechanical this.→ctx. (tsc is the
  safety net — a missed rewrite fails compile)
- router fields api/app/fragmentRetriever/validator → public readonly
- removed a fully unreachable pre-existing dead subtree (combineSearchResults,
  isDirectory, performFileBasedSearch, indexVaultFiles, getSearchWorkflowHints,
  extractContext, getFileType — zero call sites anywhere; eslint doesn't flag
  unused class methods, which hid them). ~290 dead lines gone.

router.ts 2228→988; vault.ts 948. Behaviour-preserving: tsc clean, lint at
the exact pre-existing baseline (0 errors, 5 unrelated warnings), 235/235
tests unchanged.

Staged per the issue's "extract vault first in isolation" guidance: #199
stays open for the remaining handlers (edit/view/graph/system/bases →
router thin dispatcher <300 lines). ADR-202.
2026-05-18 23:07:40 -05:00
Aaron Bockelie
759ad09a9d chore: Bump version to 0.11.29 2026-05-18 22:50:53 -05:00
Aaron Bockelie
b38b7ff4e5
Merge pull request #201 from aaronsb/fix/190-client-driven-reinit-signal
fix(mcp): client-driven session re-init via spec 404 (ADR-106, closes #190)
2026-05-18 22:50:09 -05:00
Aaron Bockelie
ba6bbf966f
Merge pull request #202 from aaronsb/fix/139-serialize-per-file-edits
fix(edit): serialize concurrent edits to the same file (closes #139)
2026-05-18 22:49:29 -05:00
Aaron Bockelie
9b348015d0 Merge main into fix/190; harden sessionManager type (PR #201 review)
- INDEX.md regenerated authoritatively (ADR-105 from #197 + ADR-106 here)
- mcp-server.ts auto-merged cleanly (#197 worker removal + #190 session
  re-init touched disjoint regions)
- sessionManager: drop optional '?' — assigned unconditionally in ctor;
  makes the ADR-106 'initialize never short-circuited' invariant
  type-guaranteed (PR #201 review nit)

make check green (229/229).
2026-05-18 22:48:26 -05:00
Aaron Bockelie
f57e8bc851
Merge pull request #200 from aaronsb/chore/197-remove-dead-worker-path
chore(worker): remove dormant worker-offload path (ADR-105, closes #197)
2026-05-18 22:45:45 -05:00
Aaron Bockelie
92e71e0cd3 fix(edit): serialize concurrent edits to the same file (closes #139)
Parallel edit.window/append/patch/at_line/from_buffer calls against the
same file (the recommended batched-tool pattern for MCP clients) ran
overlapping read-modify-write cycles: every call returned "Edit
successful" but only one edit survived, with no error surfaced — silent
data loss.

A new SemanticRouter is constructed per request, so a per-instance lock
cannot serialize concurrent requests. Add a process-wide FileLockManager
singleton (same pattern as ContentBufferManager) that serializes
operations on the *same* file path in arrival order while leaving
different paths fully concurrent. executeEditOperation runs its whole
action switch inside withLock(params.path, …).

- src/utils/file-lock.ts: promise-chain-per-path lock; chains drain so
  the map stays bounded; a rejected holder doesn't break later waiters.
- router.ts: wrap executeEditOperation in the per-file lock; also move
  the window-edit dynamic import into the two cases that use it (window,
  from_buffer) instead of eagerly on every edit action — append/patch/
  at_line no longer load it, and the path is unit-testable.
- tests/file-lock-edit-serialization.test.ts: FileLockManager unit
  behaviour + a router-level #139 repro (3 concurrent appends; without
  the lock the read-modify-write MockAPI loses 2 of 3 — with it all
  land) + a different-files-stay-concurrent assertion.

Scope: edit.* actions (the #139 report). No router extraction (that is
#199's own PR). make check green (build + lint 0 errors + 231/231).
2026-05-18 22:43:16 -05:00
Aaron Bockelie
ddb13508a1 fix(mcp): client-driven session re-init via spec 404 (ADR-106, closes #190)
Stale/evicted MCP sessions were unrecoverable without a client restart
(#128): a non-initialize request bearing an evicted Mcp-Session-Id hit a
server-side synthetic `initialize` that cannot drive SDK 1.29's
web-standard transport to an initialized state (proven in #190 — non-stream
compatReq, hono RequestError→400, post-hoc accept header lost→406), "failed
open", and returned a non-spec 400 -32000 "Server not initialized" that no
client treats as session-expiry → infinite 400 loop.

Emit the Streamable HTTP spec's session-lifecycle signal and let the client
re-initialize itself:

- evicted session + non-initialize  → HTTP 404 + Mcp-Session-Id (spec §3);
  compliant client/bridge re-inits per §4, next request opens a fresh
  session — no restart (fixes #128)
- no session id + non-initialize    → HTTP 400 (spec §2)
- initialize (fresh or recreate)    → unchanged, never short-circuited

Delete the synthetic compat-initialize block, requireInitializeNotice
machinery, and the createNullRes/NullResponse shim. New
sendSessionTerminated() helper centralises the spec response.

ADR-106 records the decision, the restated acceptance (404-signal +
2xx-reinit pair), and the known client caveat (spec §4 is the client's
obligation; mcp-remote reaches it via connectToRemoteServer recursion).
Regression harness tests/mcp-session-reinit.test.ts drives the request
pair through handleMCPRequest deterministically (paths return before any
SDK transport — the thing #190 showed cannot be driven synthetically).

ADR numbered 106 (not 105) to avoid collision with the #197 branch's
ADR-105; contiguous once both merge. make check green (build + lint 0
errors + 229/229 tests).
2026-05-18 22:37:23 -05:00
Aaron Bockelie
cce503edbf chore(worker): address PR #200 review — drop dead eslint ignore, tighten ADR-105 scope note
- eslint.config.mts: remove now-deleted build-worker.js from ignores (review nit)
- ADR-105: correct overreaching claim — the ConnectionPool pipeline itself
  was also dormant (submitRequest never called; live path is MCPServerPool →
  SDK setRequestHandler → tool.handler). Scope explicitly limited to the
  worker-offload path; unused pool scaffolding left to a separate decision.
2026-05-18 22:31:47 -05:00
Aaron Bockelie
bf1aa6319a chore(worker): remove dormant worker-offload path (ADR-105, closes #197)
The worker-thread pool ratified/extended by ADR-104 has never executed a
single request since introduction (v0.5.8b, 22742bd): ConnectionPool's
action-level workerOps gate (tool.vault.search, …) never matched the
operation-level method strings the pool emits (tool.vault, tool.edit, …),
so processWithWorker was unreachable. Independently, the worker built to
dist/workers/workers/semantic-worker.js while WorkerManager loaded
dist/workers/semantic-worker.js — load would have failed anyway.

Verified dead against current main; no CPU-starvation field reports.
Fixing forward was rejected: it would ship an untested concurrency path
that widens the #139 parallel-edit race via a new TOCTOU window for an
unproven perf need (see #197 analysis).

- delete src/workers/semantic-worker.ts, src/utils/worker-manager.ts,
  build-worker.js; drop build:worker + the build-worker.js build step
- strip worker wiring from ConnectionPool (retained as a main-thread
  bounded queue — the only behaviour that ever ran) and the dead
  prepareWorkerContext/workerScript from mcp-server.ts
- ADR-105 records the removal as a partial reversal of ADR-104; ADR-104
  stays Accepted (SSE-route deconfliction half, shipped #196, still
  governs) with a banner pointing to ADR-105

Behaviour-preserving by construction: the deleted path never ran.
make check green (build + lint 0 errors + 225/225 tests).
2026-05-18 22:26:14 -05:00
Aaron Bockelie
7f41399752 chore: Bump version to 0.11.28 2026-05-18 21:55:41 -05:00
Aaron Bockelie
6714001961
Merge pull request #198 from aaronsb/fix/restore-claude-code-cli-onboarding
fix(onboarding): restore one-command Claude Code setup (corrects #192 regression)
2026-05-18 21:55:20 -05:00
Aaron Bockelie
69be0a007e fix(onboarding): restore one-command Claude Code setup; drop misinformed CLI warning
#192 replaced the Claude Code copy/paste command with a hand-edit-this-JSON
blob plus a warning against `claude mcp add --header`. That was a real UX
regression, and the security premise was wrong for THIS transport:

- The argv / macOS-unified-log exposure applies to **stdio** transports
  (a spawned `npx mcp-remote --header ...` child), NOT native **HTTP**
  transport — there is no spawned child carrying the header in argv. #143's
  threat model was conflated with the mcp-remote setup it was also removing.
- Cleartext-at-rest in ~/.claude.json / .mcp.json is identical whether the
  entry is added via the CLI or hand-edited, so "edit the file instead"
  bought no at-rest improvement either.

(Confirmed against current Claude Code docs via claude-code-guide.)

Restores the single `claude mcp add --transport http ...` command as the
Claude Code path in the Settings UI, README, and the issue-32 template.
Removes the inaccurate warning and its now-dead `.mcp-security-warning` CSS
and the eslint-disable it required.

Kept from #192 (those parts were legit): native HTTP transport over the
deprecated mcp-remote, and the self-signed-cert / NODE_EXTRA_CA_CERTS
trust docs.

ADR-104's context has a passing line calling the `--header` form
deprecated; left as-is (accepted ADRs are immutable records of what we
believed then) — this commit is the corrective record.
2026-05-18 21:43:28 -05:00
Aaron Bockelie
3598294749 chore: Bump version to 0.11.27 2026-05-18 21:25:06 -05:00
Aaron Bockelie
f750f86dd0
Merge pull request #196 from aaronsb/feat/edit-worker-offload-sse-deconflict
fix(mcp): debug route no longer shadows GET /mcp SSE stream + two-row Levenshtein (from #126)
2026-05-18 21:07:00 -05:00
Aaron Bockelie
535dfd1c53 fix(mcp): stop debug route shadowing the GET /mcp SSE stream + two-row Levenshtein
Reimplemented from PR #126 (djsplice, who also reported #125), reduced to
the parts that are verified-clean. The worker-offload half of #126 is split
out to a tracking issue (inert as wired + correctness divergences — see PR
discussion / the follow-up issue).

SSE route deconfliction
  In @modelcontextprotocol/sdk@1.29.0 (the pinned version), `GET /mcp` is
  the standalone server->client SSE stream for server-initiated messages —
  verified in webStandardStreamableHttp.js:handleGetRequest (opens
  `_GET_stream`, Content-Type text/event-stream, gated on
  Accept: text/event-stream + session + protocol version). A debug route
  returning application/json on `GET /mcp` shadowed it, so any client that
  opens the standalone stream (mcp-remote-class bridges — #128's logs show
  one in use here) received JSON instead of an SSE stream and treated it as
  failed. Moved debug to `GET /mcp-info`; `GET /mcp` and `POST /mcp` both
  reach handleMCPRequest. Unlike #126's `app.all('/mcp')`, GET/POST are
  registered individually so the existing explicit `app.delete('/mcp')`
  session-close handler is preserved.

  Scope note: this restores the server-initiated-notification channel (a
  real latent defect on its own). It is NOT claimed to fix #128 — per the
  #190 investigation that is a separate SDK-1.29 compat-init problem — and
  #125's "SSE reconnection loop" is the reporter's un-reproduced diagnosis.

Two-row Levenshtein
  fuzzy-match.ts rewritten from a full (m+1)x(n+1) matrix to a two-row
  formulation (O(n) memory, no per-line array-of-arrays allocation) plus
  length heuristics and a 0.95 early-exit. Pure CPU/memory win on the
  main-thread edit.window path; behaviour-preserving. Adds the first
  fuzzy-match tests (classic Levenshtein distances, symmetry,
  heuristic-preservation).

build.yml: PR-status-comment step set continue-on-error so it cannot red an
otherwise-green build on fork/limited-token PRs.

Co-authored-by: djsplice <barrows.jeff@gmail.com>
2026-05-18 21:05:22 -05:00
Aaron Bockelie
0db6b0e7b9
Merge pull request #193 from aaronsb/feat/combine-inline-return
feat(vault): combine returns inline when destination omitted (reimplements #146)
2026-05-18 16:28:22 -05:00
Aaron Bockelie
75b29be6e1
Merge pull request #192 from aaronsb/security/safe-mcp-config-docs
security(docs): safe MCP config approach (reimplements #143)
2026-05-18 16:27:51 -05:00
Aaron Bockelie
6d8b24d3e5
Merge pull request #191 from aaronsb/docs/adr-104-worker-offload-sse
docs(adr): ADR-104 — worker offload + SSE deconfliction (gate for #126)
2026-05-18 16:27:47 -05:00
Aaron Bockelie
e92173fa10 docs(adr): accept ADR-104 (decider review — gate for #126 cleared) 2026-05-18 16:27:38 -05:00
Aaron Bockelie
f55f469cd2 fix(vault): inline combine sourceFiles must match combined order
Code review (PR #193) caught that the inline branch returned
`sourceFiles: paths` (caller input order) while `content` is built from
the local sourceFiles array *after* sortFiles() mutates it in place. With
sortBy set — exactly the sorted multi-file retrieval case this feature
targets — a consumer mapping content sections back to files got the wrong
order. Return the post-sort order instead.

Adds a router-level regression test (the gap the reviewer flagged: the
formatter-only tests could not have caught this).

Co-authored-by: Earl Plak <5597016+laplaque@users.noreply.github.com>
2026-05-18 12:20:48 -05:00
dependabot[bot]
a7702c3b9e
ci: Bump actions/attest-build-provenance from 2 to 4
Bumps [actions/attest-build-provenance](https://github.com/actions/attest-build-provenance) from 2 to 4.
- [Release notes](https://github.com/actions/attest-build-provenance/releases)
- [Changelog](https://github.com/actions/attest-build-provenance/blob/main/RELEASE.md)
- [Commits](https://github.com/actions/attest-build-provenance/compare/v2...v4)

---
updated-dependencies:
- dependency-name: actions/attest-build-provenance
  dependency-version: '4'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-05-18 16:29:12 +00:00
Aaron Bockelie
f10aea7d54 feat(vault): return combined content inline when destination is omitted
`vault combine` without a `destination` now returns the combined content
inline in the response instead of erroring. Read-only consumers can use
combine for multi-file retrieval with no side effects.

- router.ts: no-destination path returns { inline, content, ... }; the
  destination-exists guard is skipped when there is no destination.
- formatters/vault.ts: FileCombineResponse gains optional destination +
  inline/content; formatFileCombine renders an inline block.
- semantic-tools.ts: combine counts as a write-op (blocked in read-only
  mode) only when a destination is given; param description updated.
- tests: formatter inline/destination/fallback coverage.

Reimplemented from PR #146 against current `main` (code only); supersedes
and closes out #146. Dropped the original PR's
`path: destination || '_inline_'` validator workaround — the batch.combine
validators (BatchLimitValidator, PathArrayValidator) never inspect `path`,
so the hack was unnecessary. The README/troubleshooting cert-trust docs
that #146 also carried are covered by the #143 reimplementation instead, to
avoid duplicate divergent copies.

Co-authored-by: Earl Plak <5597016+laplaque@users.noreply.github.com>
2026-05-18 08:10:12 -05:00
Aaron Bockelie
0bd8020804 security(docs): replace claude mcp add --header with safe config-file approach
`claude mcp add --header "Authorization: Bearer <token>"` defeats
secret-at-rest protection: the CLI resolves and echoes the header value to
stdout (captured by any parent process, incl. AI agents) and on macOS the
spawned MCP child argv is written to the unified log. Editing the MCP config
file directly avoids both vectors.

- Settings UI: new shared `renderClaudeCodeConnection()` renders a
  ready-to-paste JSON config + a security warning for the authenticated
  path, and the safe plain CLI command only when auth is disabled. Used by
  both the initial render and the live-refresh handler so they cannot drift
  (the previous two copies had already diverged).
- README / SECURITY.md / troubleshooting.md / issue-32 response template:
  drop `mcp-remote` + `NODE_TLS_REJECT_UNAUTHORIZED=0`, document native HTTP
  transport and proper self-signed-cert trust (macOS Keychain +
  NODE_EXTRA_CA_CERTS for Bun-based runtimes), add the `--header` warning.
- styles.css: `.mcp-security-warning`.

Reimplemented from PR #143 against current `main` (the settings UI had been
restructured since the PR was opened); supersedes and closes out #143.
ADR-100 left untouched — accepted ADRs are immutable records; the `--header`
deprecation is recorded in ADR-104's context instead.

Co-authored-by: Earl Plak <5597016+laplaque@users.noreply.github.com>
2026-05-18 08:10:00 -05:00
Aaron Bockelie
8f882e6bfe docs(adr): ADR-104 — worker-thread offload for CPU-bound ops + SSE route deconfliction
Ratifies the existing (undocumented, v0.5.8b) worker-thread pool as the
sanctioned execution model for CPU-bound semantic operations, and records
the decision to extend it to edit.window fuzzy matching plus deconflict the
GET /mcp SSE route. This ADR is the architectural gate for PR #126 (#125).

Status: Draft — pending decider review.

Refs: #125, #126
2026-05-18 07:59:24 -05:00
Aaron Bockelie
c46d5e13b2 chore: Bump version to 0.11.26 2026-05-16 23:51:53 -05:00
Aaron Bockelie
e6ea9cc1a6
Merge pull request #189 from aaronsb/feat/scorecard-ci-gate
feat(scorecard): scheduled regression gate vs committed baseline (#165)
2026-05-16 23:44:38 -05:00
Aaron Bockelie
024e9cb1b5 harden(scorecard): baseline refuses STALE portal; gate notes it (#165)
Advisor follow-up. Asymmetry by design:
- scorecard-gate.mjs TOLERATES a STALE portal (comparing an old scan
  is harmless) but now prints a non-gating note so a pass/fail is read
  in context.
- scorecard-baseline.mjs REFUSES on STALE (exit 4) the way it refuses
  on drift — anchoring the baseline to an outdated scan would freeze a
  stale truth and mis-calibrate every future gate run.

Validated: gate exit 0 + STALE note when manifest>portal; baseline
exit 4 (refused). Refs #165
2026-05-16 23:43:32 -05:00
Aaron Bockelie
f1cc9d63ba feat(scorecard): scheduled regression gate vs committed baseline (#165)
Standalone weekly watch (+ workflow_dispatch) that FAILS only on a real
portal regression vs scripts/scorecard-baseline.json:
- Health/Review score-ratio downgrade
- automated issue count increase
- a new behaviour/permission ("**Title**:") finding

Never inspects advisory wording — structured deltas only. Scraper drift
→ exit 3, reported distinctly (fix scorecard.mjs, not a regression).
Portal unreachable → exit 0 (inconclusive, never a false fail). Gates
nothing in the release path; no PR/release triggers; no dependency
install (Node builtins only).

`make scorecard-gate` runs it; `make scorecard-baseline` re-snapshots
deliberately (refuses on drift) — a named act, since an accidental
re-baseline silently disarms the gate. Baseline captured for 0.11.25
(Health Excellent 4/4, Review Satisfactory 3/4, 5 issues, 12 findings)
— still shows Dynamic Code Execution; it clears (an improvement, not a
fail) when a post-ADR-201 release is scanned.

Validated: happy path exit 0, simulated regression exit 1 (all 3
classes), drift refusal, idempotent re-baseline.

Closes #165
2026-05-16 23:42:05 -05:00
Aaron Bockelie
0bf6098b9e
Merge pull request #188 from aaronsb/docs/adr-tls-cert-storage
docs(adr): ADR-103 — TLS cert/key storage strategy for localhost HTTPS (#7)
2026-05-16 23:36:38 -05:00
Aaron Bockelie
905a4d26f6
Merge pull request #187 from aaronsb/fix/scorecard-portal-redesign
fix(scorecard): re-anchor parser to redesigned Obsidian portal (#183)
2026-05-16 23:36:35 -05:00
Aaron Bockelie
92bd69013f docs(adr): ADR-103 — TLS cert/key storage strategy for localhost HTTPS (#7)
Records the decision to keep the per-instance, non-synced, auto-generated
self-signed cert/key and NOT move the private key into the synced vault,
and to dissolve the recurring "store the key in the vault?" question by
documenting the HTTPS scope (opt-in, loopback-only, asserts no identity;
zero-config already delivered by the HTTP-on-localhost default).

Rationale: localhost self-signed cert is low-sensitivity; the API key
(#135) is the real secret and already syncs; vault-shared key is a
defense-in-depth regression for shared/team vaults for marginal gain.

ADR only — no code change; certificate-manager.ts behaviour unchanged.
Independent of the accepted "Direct Filesystem Access" finding.

Refs #7
2026-05-16 23:34:39 -05:00
Aaron Bockelie
c59314d591 fix(scorecard): re-anchor parser to redesigned Obsidian portal (#183)
The 2026 portal redesign replaced the old DOM/RSC structure with a card
UI: Health/Review render as a coloured grade word + a segmented bar
meter, and findings are RSC JSX tuples. The old parser drifted (SCRAPER
DRIFT, null anchors).

- decodeDoc/toText split: keep tags for the structural bar meter, strip
  for prose fields.
- gradeAndScore(): grade = coloured span after the label; numeric score =
  filled/total bar-meter segments (#183 — the portal's visible trust
  signal), window bounded to the next label so Health can't bleed into
  Review.
- Grade vocab no longer enum-pinned (the hard-coded Excellent|Good|… list
  is exactly what drifted) — capture whatever word renders; drift guard
  catches a null.
- Findings re-extracted from ["$","div|details","<text>",{...}] tuples in
  the scorecard region; SIGNATURE re-anchored to the redesign wording
  (**Title**: + neutral scan/attestation sentences).
- Drift guard: numeric scores are now first-class anchors; findingsDrift
  = non-zero issue count with zero findings. Exit 2 on drift preserved.

Validated live: Health Excellent (4/4), Review Satisfactory (3/4), 5
issues, 12 findings, freshness current, integrity ok. Correctly surfaces
the residual "Dynamic Code Execution" finding on 0.11.25 (clears when a
post-ADR-201 release is scanned — the CLAUDE.md caveat).

Refs #183
2026-05-16 23:29:53 -05:00
Aaron Bockelie
b1a8ffe150
Merge pull request #186 from aaronsb/feat/sandboxed-bases-evaluator
feat(bases): sandboxed expression evaluator — replace new Function (ADR-201, PR 2/2)
2026-05-16 23:24:08 -05:00
Aaron Bockelie
73b3276453 harden(bases): runtime-computed-member escape test + scope scanner claim
Advisor review follow-up on #186:
- Add SECURITY cases note[("cons"+"tructor")] / file[("__pro"+"to__")]:
  runtime-computed member names our static pre-walk intentionally does NOT
  catch (property is BinaryExpression, not Identifier/Literal) — they must
  fail closed via expression-eval's own access guard. Test-grounds the
  defense-in-depth claim instead of asserting it. 60/60 green.
- CLAUDE.md 'Known accepted review findings': the Bases new Function is
  REMOVED (ADR-201, #180/#185/#186), not pending #175. Documents the
  honest caveat — grep 'new Function' main.js != 0 by design: residual is
  transitive ajv@6.14.0 validator codegen + a deprecation shim, a
  pre-existing library-internal class not reachable from vault content,
  present on the reviewed 0.11.25, non-gating. Scanner finding was
  attributed to the Bases path; this closes that path.

Refs #180, ADR-201
2026-05-16 23:03:43 -05:00
Aaron Bockelie
b9d99edfd7 feat(bases): replace new Function with expression-eval (ADR-201)
PR2 of 2 for #180 (ADR-201). Closes the arbitrary-code-execution vector
reachable through a synced/shared `.base` file.

- Drop `new Function('context', 'with(context){return ${expr}}')` (and its
  no-implied-eval eslint-disable) from expression-evaluator.ts.
- Parse with expression-eval@5.0.1 (jsep grammar: no eval/Function/new, no
  global scope; member denylist built in). Pinned exact; jsep 0.3.5 is its
  audited transitive parser. Both >7d old; npm audit 0 vulns.
- Defense-in-depth AST pre-walk (assertNoForbiddenAccess): rejects
  constructor/__proto__/prototype member access (Identifier AND computed
  ["constructor"] forms) and ThisExpression, independent of the library's
  internal list — ADR-201's explicit, tested no-globals property lives in
  our code, not a transitive dep.
- createEvalContext and all helpers untouched → behavioural parity.

Differential corpus (tests/bases-expression-evaluator.test.ts, from PR1):
57 EVAL_CASES still green = expression-eval == old new Function for every
realistic Bases construct; the formerly-executing escapes (2/42/99 under
new Function) now fail closed; SECURITY set never reaches a function, the
real global, or a value.

No behavioural change for legitimate `.base` expressions. Breaking only by
design: the RCE vectors, `this`, and prototype-chain access are now
refused. Clears the Obsidian "Dynamic Code Execution" finding.

209/209 tests; build + lint clean. Refs #180, ADR-201
2026-05-16 22:57:43 -05:00
Aaron Bockelie
0043e9acc9
Merge pull request #185 from aaronsb/test/bases-expr-corpus
test(bases): differential corpus + new Function baseline (ADR-201, PR 1/2)
2026-05-16 17:32:57 -05:00
Aaron Bockelie
5cdd131c41 test(bases): differential corpus + new Function baseline for ADR-201
PR1 of 2 for #180 (ADR-201). Lands the regression net independently of
library choice, against the *current* `new Function` evaluator as the
behavioural oracle.

- Expand tests/fixtures/base-corpus.ts: EVAL_CASES (~57 expr/expected
  pairs spanning every operator class + every fn/property the evaluator
  exposes), makeNoteContext() canonical fixed context, SECURITY_EXPRESSIONS
  (sandbox-escape set). FILTER_EXPRESSIONS kept as a derived export.
- tests/bases-expression-evaluator.test.ts: locks current behaviour over
  the corpus AND proves the live RCE — constructor.constructor reaches the
  Function constructor through the `with` scope chain (returns 2/42/99
  today). PR2 inverts the SECURITY block.

Time-dependent primitives (now/today) appear only inside relations stable
for all wall-clock times, so expectations never rot.

209/209 tests pass; build + lint clean.

Refs #180, ADR-201
2026-05-16 17:05:26 -05:00
Aaron Bockelie
aa346d4c9a chore: Bump version to 0.11.25 2026-05-16 14:23:03 -05:00
Aaron Bockelie
5b87d4d3f6
Merge pull request #182 from aaronsb/fix/yaml-migration
refactor(bases): migrate js-yaml → yaml (maintained), differential-tested
2026-05-16 14:22:32 -05:00
Aaron Bockelie
ed0ceac56d
Merge pull request #184 from aaronsb/fix/statusbar-orphan
fix(ui): stop orphaning status-bar elements on async startup
2026-05-16 14:21:32 -05:00
Aaron Bockelie
9309a618cb
Merge pull request #179 from aaronsb/chore/code-of-conduct
docs: add Contributor Covenant 2.1 code of conduct
2026-05-16 14:21:29 -05:00
Aaron Bockelie
cf3b4a6a04
Merge pull request #181 from aaronsb/adr-201-bases-expression-evaluator
docs(adr): ADR-201 — sandboxed expression evaluator for Bases
2026-05-16 14:21:26 -05:00
Aaron Bockelie
d9c7452c01 test(bases): address #182 review — accurate date-safety rationale + explicit divergences
Code review found the date-safety doc cited the wrong line (date() global,
not the real reconciliation). Correct it: (1) Obsidian metadata cache is the
primary frontmatter source, this parser is only a fallback; (2) when the
fallback runs, expression-evaluator auto-coerces date-like keys via
new Date(); (3) .base docs have no date scalars.

Surface the masked divergences instead of hiding them behind toBeFalsy:
- empty doc: yaml→null vs js-yaml→undefined — asserted concretely, proven
  neutralized by parseFrontmatter's typeof/!==null guard.
- merge keys: js-yaml resolves <<:*anchor, yaml keeps literal — asserted as
  a known, accepted boundary (.base/frontmatter never use merge keys).
- input anchors/aliases: confirmed both resolve structurally.
Documented all in yaml-bridge.ts. 149/149 green.
2026-05-16 14:20:23 -05:00
Aaron Bockelie
20679473b0 fix(ui): stop orphaning status-bar elements on async startup
Closes #178. updateStatusBar() previously remove()'d and re-addStatusBarItem()'d
on every call. It fires multiple times during async startup (port-conflict
paths, server-start callbacks, settings); concurrent calls could each add an
element while only the last was tracked, orphaning a transient 'Mcp: error'
element that persisted until the next Obsidian reload.

Create the element exactly once and mutate it thereafter (setText + class
swap). showConnectionStatus=false now hides the single element via the
existing mcp-hidden utility instead of leaving/removing DOM. Structurally
eliminates duplicate/orphaned indicators regardless of call ordering.
2026-05-16 14:14:57 -05:00
Aaron Bockelie
366d329140 refactor(bases): migrate js-yaml → maintained yaml package
Closes #174. Obsidian source-code review flagged js-yaml (unmaintained) for
replacement. Rewire bases-api.ts's 5 call sites onto yaml-bridge; drop
js-yaml + @types/js-yaml. yaml pinned to 2.8.4 (published 2026-05-02, clears
the project's 7-day supply-chain hold; 2.9.0 was 5 days old). Existing
overrides.yaml reconciled to $yaml so the direct dep governs transitive
resolution. Behaviour-equivalence proven by the differential corpus.
2026-05-16 14:08:46 -05:00