3 commits

Author	SHA1	Message	Date
mpstaton	f946973894	feat(release): 0.3.0 — three analyst-grade templates for VC/PE/equities + four infrastructure fixes for deep-research reliability ... 0.3.0 turns Perplexed into a serious analyst tooling layer for Venture Capital, Private Equity, and equities-trading workflows. Three new directory templates produce 6-9K-word cited analyst drafts in a single Perplexity Deep Research run. Underneath them, four infrastructure fixes turn deep-research from a brittle "might work" workflow into something you can put real analyst time behind. The three new templates: market-map-profile (analyst memo for Known Category or Thesis-Driven maps), standards-and-specs-profile (open-spec profiles with five-way authority typing and three-tier adoption framing), market-category-profile (concept-folder reference card with three financial-stage tiers — Incumbents / Challengers / Innovators). The four infrastructure fixes: per-template request-timeout-ms wall-clock override (yesterday, pressure-relief valve), structural port of per-chunk idle-timeout discipline from the legacy modal flow into the directory-template flow (yesterday, structural fix), per-template max-tokens Perplexity output-budget override (today, fixes silent clean-truncation when finish_reason=length fires mid-template), and a strengthened mermaid-discipline partial plus new latex-discipline partial (today, fixes the 4-of-5 broken-Mermaid rate via paired BAD/GOOD examples and a six-item pre-emit self-check). New templates (src/docs/templates/): - market-map-profile.md — sonar-deep-research, request-timeout-ms 2400000 (40-min ceiling), max-tokens 24000. Anti-incumbent editorial stance. - standards-and-specs-profile.md — sonar-deep-research, request-timeout-ms 0 (idle-only safety), max-tokens 24000. Five-way authority typing, named editors, stewardship transitions, named critics. - market-category-profile.md — sonar-deep-research, request-timeout-ms 0, max-tokens 24000. Three-tier financial-stage framing, separate Why Now and What's Happening sections, Industry Coverage sub-grouped into Market Reports / Industry Articles / Financial News. Rendering-discipline partials (src/docs/partials/): - mermaid-discipline.md rewritten — paired BAD/GOOD examples throughout, the &amp; escape rule, explicit \n vs <br/> ban, six-item self-check before emit, simplify-rather-than-break ethos. Original ~250 tokens expanded to ~440. - latex-discipline.md new — Obsidian MathJax delimiters and \$ escaping in prose to avoid accidental inline-math spans. - concept-profile.md wired in {{include: latex-discipline}} alongside the existing {{include: mermaid-discipline}}, placed immediately after the "render a mermaid codefence here" instruction so the rules are in scope at the moment of generation. Streaming, timeout, and output-budget infrastructure (src/services/ directoryTemplateService.ts): - streamPerplexityToFile now races each reader.read() against a fresh per-chunk idle timer (270s deep-research, 90s normal — matches the legacy modal flow at perplexityService.ts:659). Closes the "Wall-clock-timeout cuts off long deep-research streams" issue. - request-timeout-ms cft override is now the optional absolute wall-clock ceiling (belt-and-suspenders backstop on top of the idle timer); explicit 0 disables. - max-tokens cft override added to buildPayload — passes through to Perplexity's max_tokens parameter; lifts the silent ~8K-token default ceiling that was clean-truncating thorough drafts via finish_reason: length. Documentation (README.md, docs/directory-templates.md): - README — new top-level section "For Venture Capital, Private Equity, and Equities-Trading Workflows" with a five-row table mapping each analyst workflow to the template that produces it. Directory Templates section updated to seven shipped templates plus the new per-template cft-block knobs. - docs/directory-templates.md — new "Per-template max-tokens override" section with the diagnostic table for distinguishing wall-clock-timeout truncation (mid-sentence cutoff, no sources footer) from max_tokens truncation (clean section-end, full sources footer). The diagnostic vocabulary that did not exist before this release. Seeding (src/services/templateSeederService.ts): - Registered all three new templates plus the new latex-discipline partial so they auto-seed into vaults on first plugin load and appear in Re-seed runs. Version bump (manifest.json, package.json, versions.json): - 0.2.1 to 0.3.0. minAppVersion unchanged at 1.8.10. Engineering changelog entries (changelog/): - 2026-05-26_02.md — the structural idle-timeout port. - 2026-05-27_01.md — the two new templates, max-tokens override, and rendering-discipline partial work. Includes the diagnostic-led narrative on the vault-drift bug that caused the 4-of-5 broken-Mermaid rate. Release narratives: - changelog/releases/0.3.0.md — full marketing-quality release narrative with frontmatter, four-audience cascade, three diagnostic-led stories (streaming-timeout, max_tokens, rendering-discipline), explicit upgrade notes including the vault-drift warning, three deferred items for 0.4.x. - release-notes/0.3.0.md — prose-only release-page body picked up by the release.yml workflow when the 0.3.0 tag is pushed. Tighter cut of the same narrative, suited for the GitHub release page. Context-v stamp: - context-v/issues/Wall-Clock-Timeout-Cuts-Off-Long-Deep-Research-Streams.md marked status: resolved, date_resolved 2026-05-26, with the four open items reorganized into "what landed" (3 of 4) and "deferred follow-ups" (cross-service audit, settings-pane exposure, deep-research detection robustness). Files changed: - manifest.json, package.json, versions.json - README.md, docs/directory-templates.md - src/services/directoryTemplateService.ts - src/services/templateSeederService.ts - src/docs/templates/README.md - src/docs/templates/concept-profile.md - src/docs/templates/market-map-profile.md - src/docs/templates/market-category-profile.md (new) - src/docs/templates/standards-and-specs-profile.md (new) - src/docs/partials/mermaid-discipline.md - src/docs/partials/latex-discipline.md (new) - changelog/2026-05-26_02.md (new) - changelog/2026-05-27_01.md (new) - changelog/releases/0.3.0.md (new) - release-notes/0.3.0.md (new) - context-v/issues/Wall-Clock-Timeout-Cuts-Off-Long-Deep-Research-Streams.md Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>	2026-05-27 17:41:13 -05:00
mpstaton	96df70595f	feat(directory-templates): market-map analyst profile + per-template request-timeout-ms cft override ... A new shipped template aimed at analyst-grade market maps (Known Category and Thesis-Driven flavors), and the timeout refactor that came out of running it against a real 7-8K-word draft and watching the wall-clock AbortController truncate the tail mid-sentence. The two ship together because the template surfaced the bug — running market-map-profile on lost-in-public/market-maps/Humanoid Robots and their Input Industries.md was the first observable instance of the wall-clock pathology — and they're both groundwork for the multi-stage Claude+Perplexity+RAG pipeline the exploration doc now sketches. Impact: a fifth shipped template auto-seeded into Content-Dev/Templates/ on first plugin load (and re-seedable from settings), running on sonar-deep-research with return-images off by design; templates can override the plugin-level wall-clock timeout per-template via a new cft-block key; the plugin-level default jumped from 10 min to 30 min because the old default was tuned for short concept-profile runs and was cutting off any deep-research template that took its time. Existing four templates are unchanged in behavior — they don't declare the override and inherit the new 30-min default, which they all finish comfortably under. Market-map template (src/docs/templates/market-map-profile.md): - Heading skeleton: Market Snapshot, The Question this Map Answers, Why Now, Map of the Market, Lighthouse Examples, Innovator Profiles (Link/Offering/Funding/Why/Coverage cards + per-sub-segment summary table), Media-Voices-Coverage, Market Dynamics (Sizing, Adoption, Capital Flow), Frontier and Open Questions, Adjacent Concepts. - Dual-flavor: the system prompt has the model pick between Known Category (Humanoid Robots, Quantum Computing) and Thesis-Driven (e.g. Neural Network Hardware as Brains for Robotics) based on title and tags. - Anti-incumbent editorial stance copied from the concept template family — cap big tech at 1 of 5-10 in every sub-bucket, attribute innovation to startups/labs/founders. - Declares request-timeout-ms: 2400000 (40 min) with an inline comment explaining the budget — the only shipped template that overrides the plugin default today. - Registered in templateSeederService.ts so first-load seeding and the Re-seed button both pick it up; surfaced in src/docs/templates/README.md and docs/directory-templates.md. Timeout refactor (src/services/directoryTemplateService.ts, main.ts): - Per-template cft-block key request-timeout-ms: accepts number or numeric string, silently falls back on non-positive / non-numeric values, otherwise wins over the plugin-level setting for that template's runs. Resolution code sits just before the streamPerplexityToFile call so the rest of the streaming primitive is untouched. - Plugin default directoryTemplatesRequestTimeoutMs bumped 600000 → 1800000 (10 min → 30 min). Settings-pane description rewritten to call out the override and the cost framing ("$10-$50 of analyst time per good output is worth waiting for"). - Structural fix (idle-timeout discipline ported from perplexityService.ts:659-668, where the legacy modal flow already does it correctly) is filed as its own open issue, not in scope for this commit. Context-v writing: - context-v/explorations/Multi-Stage-Cooperative-Claude-and-Perplexity-with-RAG.md — three architectures weighed (zoned single-file appends, multi-doc folder per market map, per-section cft-section blocks), an include-sources YAML schema proposed covering vault paths/globs and Chroma queries, and the "Perplexity and Claude do not overwrite each other until editing" heuristic translated into three implementation strictness levels. Recommends Option A (zoned appends) for v1. - context-v/issues/Wall-Clock-Timeout-Cuts-Off-Long-Deep-Research-Streams.md — the Humanoid Robots truncation as motivating symptom, side-by-side diagnosis of the two timeout disciplines in the codebase (wall-clock here, per-chunk idle in the legacy modal), the partial fix shipped today, why it's only partial, the structural-fix proposal, and four pre-spec open items. Cross-linked both ways to the exploration so the issue is reachable from either entry point. Files changed: - src/docs/templates/market-map-profile.md (new) - src/services/templateSeederService.ts - src/services/directoryTemplateService.ts - main.ts - src/docs/templates/README.md - docs/directory-templates.md - context-v/explorations/Multi-Stage-Cooperative-Claude-and-Perplexity-with-RAG.md (new) - context-v/issues/Wall-Clock-Timeout-Cuts-Off-Long-Deep-Research-Streams.md (new) Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>	2026-05-26 17:08:43 -05:00
mpstaton	0d7078c688	doc(directory-templates): README section + canonical reference in docs/ ... Backfills the documentation gap for the directory-templates feature shipped in changelog/2026-05-10_01.md. Until now, a GitHub reader landing on README.md had no idea the feature existed — the README jumped straight from Command Reference into Developer Onboarding. README.md — new "## Directory Templates" section between Command Reference and Developer Onboarding (and a matching TOC entry). ~60 lines covering: why this exists, the three primitives (template / commands / cleanup pipeline), the four shipped templates and their target globs, auto-seed behavior including the two-tier policy (README always, templates only when fresh), how to write your own template, and a link to the canonical reference. docs/directory-templates.md — new canonical reference for repo readers. Adapted and expanded from src/docs/templates/README.md (which stays as the user-vault-seeded variant). Adds: why this paradigm exists (the 1,600-empty-files problem), full anatomy of the three template zones with grammar example, interpolation token table, fill-vs-append run modes, streaming + cleanup pipeline mechanics (think wrap, image marker swap, fallback images section, sources footer aligned to cite-wide's REFDEF_NUM_RE), frontmatter stamps (cf_last_run / cf_last_run_model / google_books_url), the anti-incumbent editorial stance rationale, first-run + re-seed semantics with the two-tier policy, instructions for writing your own template, plugin settings reference, and the open-items list mirrored from the changelog. Links back to the changelog as the canonical engineering record. src/docs/templates/README.md left untouched — it's the user-vault-seeded doc and remains correctly scoped for the "you have these files in your vault, here's how to use them" audience. Naming note: the feature was originally specced as "prompt outlines" (see context-v/specs/Using-Files-as-Prompt-Outlines.md). The shipped naming is "directory templates" — matches the code, the changelog, and the command-palette entries. The new doc mentions the original name once, for orientation. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>	2026-05-10 23:40:05 -05:00