Skip to content

Add audit_log and binlog system tables#268

Open
suxiaogang223 wants to merge 11 commits intoalibaba:mainfrom
suxiaogang223:codex/system-table-pr2
Open

Add audit_log and binlog system tables#268
suxiaogang223 wants to merge 11 commits intoalibaba:mainfrom
suxiaogang223:codex/system-table-pr2

Conversation

@suxiaogang223
Copy link
Copy Markdown
Contributor

@suxiaogang223 suxiaogang223 commented May 9, 2026

Summary

  • Add table$audit_log and table$binlog on top of the system table framework.
  • Route catalog, scan, and read paths through context-aware SystemTable interfaces.
  • Output rowkind, optional _SEQUENCE_NUMBER, and batch-mode binlog singleton-list columns.
  • Reuse the primary-key table read path with delete records preserved; non-primary-key tables return a clear unsupported status.
  • Remove the legacy SystemTableRead fallback so system tables use the same scan/read context path.

Part of #141.

Scope

  • This PR focuses on batch read correctness for audit_log and binlog.
  • Streaming before/after pairing and full predicate pushdown are intentionally left for follow-up work.

Validation

  • Fedora: cmake --build build-codex-pr2 --target paimon-core-test paimon-read-inte-test -j4
  • Fedora: ./build-codex-pr2/release/paimon-core-test --gtest_filter="FileSystemCatalogTest.TestAuditLogAndBinlogSystemTableCatalog:CoreOptionsTest.*"
  • Fedora: ./build-codex-pr2/release/paimon-read-inte-test --gtest_filter="SystemTableReadInteTest.*"

@suxiaogang223 suxiaogang223 changed the title Implement audit log and binlog system tables Add audit_log and binlog system tables May 9, 2026
@suxiaogang223 suxiaogang223 marked this pull request as ready for review May 9, 2026 11:08
@suxiaogang223
Copy link
Copy Markdown
Contributor Author

suxiaogang223 commented May 9, 2026

Hi @lxy-9602 , could you please help review this PR when you have time?

This PR adds the next batch of system table support on top of the merged system table framework: table$audit_log and table$binlog. It includes catalog routing/schema exposure, scan/read integration, rowkind output, optional _SEQUENCE_NUMBER, and related tests for catalog and read paths.

The next PR will continue this work by adding the remaining metadata system tables. :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant