Skip to content

👷 add running-tests and writing-commits-and-prs skills - #5120

Open
mormubis wants to merge 3 commits into
mainfrom
adlrb/agent-skills
Open

mormubis wants to merge 3 commits into
mainfrom
adlrb/agent-skills

Conversation

@mormubis

@mormubis mormubis commented Oct 8, 2026 •

Copy link
Copy Markdown
Contributor

Motivation

Test commands and commit/PR rules are spread across AGENTS.md, docs/TESTING.md, test/e2e/AGENTS.md, docs/DEVELOPMENT.md, CONTRIBUTING.md and some CI scripts. Without these skills, an agent needed up to 11 files to answer basic questions, and it picked 🔥 instead of 💥 for removing a public API. That hides a breaking change under Internal Changes. The iOS SDK already has repo skills for this kind of thing, so I did the same here.

Changes

running-tests is one table with every test command. It also explains when you actually need yarn build:apps: locally, E2E only runs the bundle setup straight from source, but npmSetup, app-based tests and the performance tests use built apps.

writing-commits-and-prs covers signing, the PR template and how the gitmoji ends up in the changelog. It uses the list in docs/DEVELOPMENT.md instead of keeping its own copy, since the changelog legend is built from that file. I also clarified 🔥 there. It said "deprecated items", and #4329 and #4677 both went in as 🔥 but ended up as 💥 and ✨ in the changelog. What do you think?

AGENTS.md keeps the commands and drops the commit/PR rules that the skill now covers. It still says titles start with a gitmoji, because a skill only loads when the agent thinks it applies, and it points to both skills with their path so agents that don't load skills automatically can still find them.

I also tried a skill for the generated schema types, but agents already did the right thing without it, so I dropped it.

Both skills were written with an agent. Every command was checked against package.json, the Karma and Playwright configs, and the CI scripts.

Test instructions

I asked an agent the same questions with and without the skills. With them, it got all of them right from the skill file alone.

To try it, check out this branch and ask your agent:

  • "Which gitmoji should a PR removing a deprecated public API use?"
  • It should load writing-commits-and-prs and answer 💥
  • "CI fails on send unhandled rejections > npm but it passes locally. How do I reproduce it?"
  • It should load running-tests and say yarn build:apps, then CI=1 yarn test:e2e -g "send unhandled rejections"

Checklist

  • Tested locally
  • Tested on staging
  • Added unit tests for this change.
  • Added e2e/integration tests for this change.
  • Updated documentation and/or relevant AGENTS.md file

@cit-pr-commenter-54b7da

Copy link
Copy Markdown

Bundles Sizes Evolution

📦 Bundle Name Base Size Local Size 𝚫 𝚫% Status
Rum Salesforce N/A 185.67 KiB N/A N/A N/A
Rum 185.65 KiB 185.65 KiB 0 B 0.00% ✅
Rum-salesforce Profiler N/A 8.38 KiB N/A N/A N/A
Rum Profiler 8.38 KiB 8.38 KiB 0 B 0.00% ✅
Rum-salesforce Recorder N/A 31.94 KiB N/A N/A N/A
Rum Recorder 31.94 KiB 31.94 KiB 0 B 0.00% ✅
Logs 59.57 KiB 59.57 KiB 0 B 0.00% ✅
Rum Slim 143.65 KiB 143.65 KiB 0 B 0.00% ✅
Worker 22.96 KiB 22.96 KiB 0 B 0.00% ✅
Rum Shopify N/A 216.06 KiB N/A N/A N/A
Rum-shopify Profiler N/A 8.38 KiB N/A N/A N/A
Rum-shopify Recorder N/A 4.77 KiB N/A N/A N/A

@datadog-official

datadog-official Bot commented Oct 8, 2026 •

Copy link
Copy Markdown

Tests

✅ All CI checks and tests passed.

🎉 All green!

🧪 All tests passed
❄️ No new flaky tests detected

🎯 Code Coverage (details)
• Patch Coverage: 100.00%
• Overall Coverage: 77.17% (+0.00%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 8aa6825 | Docs | View more details | Give us feedback!

@mormubis
mormubis marked this pull request as ready for review October 13, 2026 19:48
@mormubis
mormubis requested a review from a team as a code owner October 13, 2026 19:48
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 13, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-13T19:55:06.249810Z 8aa6825 Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@datadog-official datadog-official Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bits Code Review: PASS

More details

The test guidance matches the repository’s build prerequisites and setup selection. The gitmoji guidance correctly classifies removal of a deprecated public API as a breaking change.

Was this helpful? React 👍 or 👎

Open Bits AI session

🤖 Bits Code Review · Commit 8aa6825

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 8aa68253aa

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

| Mistake | Fix |
| ----------------------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------- |
| Running `npmSetup`/app-based E2E or perf tests right after editing SDK source | `yarn build:apps` first, otherwise they use stale packages |
| E2E passes locally, fails in CI on `<test> > npm` | Locally only `bundle` runs. `yarn build:apps`, then `CI=1 yarn test:e2e -g "<test>"` runs `async`, `npm` and `bundle` like CI |

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Include the failing browser in the CI reproduction command

issue: For failures from any Firefox, WebKit, or pinned-browser CI job, this command silently runs Chromium because test/e2e/playwright.config.ts registers only the Chromium project when no --project argument is provided, while the e2e matrix in .gitlab-ci.yml explicitly invokes --project=$BROWSER for six browsers. Instruct users to copy the failing job's browser into --project=<browser>; otherwise the prescribed command can fail to reproduce the CI-only behavior this entry is meant to diagnose.

AGENTS.md reference: AGENTS.md:L49-L49

Useful? React with 👍 / 👎.


## Signing

Every commit must be signed. `main` has a `required_signatures` ruleset, so a single unsigned commit blocks the merge. Check with `git log --show-signature -1`. If `git config commit.gpgsign` isn't `true`, commit with `git commit -S`.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Verify every commit in the PR

issue: In a multi-commit PR where HEAD is signed but an earlier commit is unsigned, this check reports only the signed HEAD because -1 limits the log to one commit (git rev-list -h lists --max-count=<n> under “limiting output”). That contradicts the preceding requirement that one unsigned commit blocks the merge; inspect the full PR range, such as origin/main..HEAD, so contributors do not discover an older unsigned commit only at merge time.

AGENTS.md reference: AGENTS.md:L142-L142

Useful? React with 👍 / 👎.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant