chore: reduce memory footprint

[avivkeller]

Reduces the memory used by doc-kit by evicting cache after it is no longer needed, and avoiding cloning objects

Ref: #815

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated (UTC)
api-docs-tooling	Ready	Preview	May 30, 2026 8:14pm

[cursor]

PR Summary

Medium Risk
Pipeline caching and eviction change when intermediate AST/metadata is retained, and downstream generators now mutate shared content trees instead of clones—risk of subtle cross-generator side effects if ordering or concurrency assumptions differ from before.

Overview
Lowers doc-kit memory use by replacing the separate generator/stream caches with a single createCache in caching.mjs that dedupes async-generator collection and evicts each generator result after the last expected consumer reads it (consumer counts computed up front from the dependency closure).

The orchestrator in generators.mjs now routes dependency reads and final target collection through cache.consume, and streaming.mjs is removed; async detection moves to isAsyncIterable in utils/misc.mjs.

Several output generators stop deep-cloning metadata content (structuredClone / JSON.parse(JSON.stringify(...))) and instead mutate entry.content in place in json-simple, jsx-ast, legacy-html, and legacy-json.

Tests add caching.test.mjs and generators.test.mjs (mocked pipeline: shared deps run once, targets that are also dependencies are not re-run); streaming.test.mjs is deleted and isAsyncIterable coverage moves to misc.test.mjs.

^{Reviewed by Cursor Bugbot for commit 0005913. Bugbot is set up for automated code reviews on this repo. Configure here.}

[codecov]

Codecov Report

❌ Patch coverage is 97.23757% with 15 lines in your changes missing coverage. Please review.
✅ Project coverage is 84.01%. Comparing base (a793466) to head (0005913).
⚠️ Report is 3 commits behind head on main.

Files with missing lines	Patch %	Lines
src/generators/json-simple/generate.mjs	0.00%	5 Missing ⚠️
src/generators/legacy-html/utils/buildContent.mjs	0.00%	4 Missing ⚠️
src/utils/__tests__/misc.test.mjs	93.75%	3 Missing ⚠️
src/__tests__/generators.test.mjs	99.28%	1 Missing ⚠️
src/generators.mjs	97.36%	1 Missing ⚠️
src/generators/legacy-json/utils/buildSection.mjs	0.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #816      +/-   ##
==========================================
+ Coverage   82.85%   84.01%   +1.16%     
==========================================
  Files         170      172       +2     
  Lines       14732    15180     +448     
  Branches     1266     1345      +79     
==========================================
+ Hits        12206    12754     +548     
+ Misses       2520     2417     -103     
- Partials        6        9       +3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[cursor]

Cursor Bugbot has reviewed your changes using default effort and found 2 potential issues.

^{❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}

^{Reviewed by Cursor Bugbot for commit a082cae. Configure here.}

[github-actions]

orama-db Generator

File	Base	Head	Diff
orama-db.json	8.83 MB	8.83 MB	-1018.00 B (-0.01%)

[avivkeller]

cc @nodejs/web-infra