Skip to content

diagnostics: LPG residency accounting + compact/lazy experiments - #4

Open
jarmen423 wants to merge 1 commit into
agent/txn-session-batch-20260726from
diagnostics/lpg-memory-accounting
Open

diagnostics: LPG residency accounting + compact/lazy experiments#4
jarmen423 wants to merge 1 commit into
agent/txn-session-batch-20260726from
diagnostics/lpg-memory-accounting

Conversation

@jarmen423

Copy link
Copy Markdown

Summary

Expand Grafeo LPG memory accounting (property columns, strings, capacity waste, adjacency) and measure compact/lazy representations.

Separate from close-forensics PR #2.

Head: 195678c36b335022c9a2add4f755bb675955feb2

Measured (synthetic 200k strings / 256 unique)

  • Dictionary compress: estimated −20.6 MiB; RssAnon −5.5 MiB; point-get faster; correctness pass
  • shrink_capacities: no waste/RSS change on this fill

See docs/TRACK_E_LPG_RESIDENCY.md.

Test plan

  • cargo test -p grafeo-core --test lpg_residency_experiments
  • Review accounting API surface for production stats export

Made with Cursor

Attribute property map slots, string payloads, capacity waste, and
adjacency; add shrink + dictionary-compress experiments with RSS and
correctness checks for the Track E residual investigation.
jarmen423 added a commit that referenced this pull request Aug 2, 2026
Charge max_schema_bytes for all schema-bounded structures:
- node_schema (labels + label_to_table_id + table_row_counts)
- rel_keys + rel_id_map (edge type schema)
- schema_strings (global dictionary schema strings)
- column geometries (per-column metadata)

N-vs-4N test now shows schema_peak=476 B (non-zero, constant across
scales as expected for schema-bounded data).

anon_peak and temp_peak remain 0 — those require charging at the
pass/run-store level (future work).

GATES:
- grafeo-core: 2130 passed
- n_vs_4n_peak_memory: PASSED (delta ratio 0.75x)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant