Repository navigation
Add workload through leveraging OCI images to run on CI - #438
Open
henrybear327 wants to merge 2 commits into
Open
henrybear327 wants to merge 2 commits into
henrybear327 wants to merge 2 commits into
Conversation
henrybear327
assigned
Max042004,
henrybear327,
jserv and
sunxiaoguang and unassigned
henrybear327
![cubic-dev-ai[bot]](https://avatars.githubusercontent.com/in/1082092?s=60&v=4){kind=small}
This comment was marked as resolved.
This comment was marked as resolved.
Sorry, something went wrong.
henrybear327
force-pushed
the
oci/runtime-lanes
branch
from
October 13, 2026 12:55
0ad18e6 to
e3e97d3
Compare
jserv
reviewed
Oct 13, 2026
| set -e | ||
|
|
||
| # Async preemption can deliver a signal while the vCPU is in the EL1 MRS path. | ||
| export GOCACHE=/tmp/elfuse-go-cache GOTOOLCHAIN=local GODEBUG=asyncpreemptoff=1 |
Contributor
There was a problem hiding this comment.
GODEBUG=asyncpreemptoff=1 hides an elfuse bug instead of exercising it: the comment admits that a signal delivered while the vCPU is in the EL1 MRS path breaks the guest, and nothing else tracks that. Every Go guest runs with async preemption on by default, so this lane stays green while that failure ships. As a follow-up, please file an issue with a repro and link it here, so the override can be dropped once it is fixed.
jserv
reviewed
Oct 13, 2026
jserv
reviewed
Oct 13, 2026
jserv
reviewed
Oct 13, 2026
| # Redis treats port 0 as disabled. | ||
| local port="" try=0 | ||
| while [ "$try" -lt 10 ]; do | ||
| port=$((20000 + RANDOM % 20000)) |
Contributor
There was a problem hiding this comment.
There is a race between the nc -z probe and redis binding the port. Runners on this host share loopback, so another lane can take the port in between, and that shows up as "server guest exited before readiness" with nothing pointing at the real cause. As a follow-up, retry start_server with a fresh port when the guest exits before it is ready.
jserv
reviewed
Oct 13, 2026
jserv
reviewed
Oct 13, 2026
jserv
reviewed
Oct 13, 2026
scripts/ci/oci-runtime.sh runs elfuse on a real runtime per key: python, node, go, jvm, c, and redis, each driving a workload from scripts/ci/workloads and requiring its sentinel. The node and redis lanes serve from one guest to the host or to a second guest, and redis moves to a new port when another process bound its pick first. The go lane keeps async preemption on and requires a goroutine spinning on one P to be preempted. The oci-runtime job builds crane and umoci from source as oci-smoke does, then runs each key on the self-hosted macOS runner. Runners on one host share $HOME, so each key and runner gets a store, kept between runs and named for the hash of elfuse-oci.py and oci-runtime.sh; a change to either starts a fresh store and removes the old one. Like oci-smoke, it pulls the library images through mirror.gcr.io, pinned by digest here, so a run pulls an image only when its store lacks it. The helpers oci-smoke.sh defined move to scripts/ci/oci-lib.sh, which both lanes source. wait_for there probes once more than the oci-smoke.sh copy did, so it fails after the full timeout instead of half a second short of it.
docs/oci-images.md lists what each oci-runtime key covers, and docs/usage.md gives the local command and notes that a runtime lane keeps its images in the store.
henrybear327
force-pushed
the
oci/runtime-lanes
branch
from
October 17, 2026 07:39
e3e97d3 to
f62bd3f
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Based on the workload used in #224 and the newly merged OCI image capability, python, node, go, jvm, c, and redis images are pulled and run on CI for all PR, making sure that elfuse is able to execute common workload normally after changes.
Summary by cubic
Adds
oci-runtimeCI lanes that run elfuse against real runtimes (python, node, go, jvm, c, redis) on OCI images, so common workloads are exercised on every PR and push. The smoke helper functions move to a sharedoci-lib.sh, and each lane is documented indocs/oci-images.mdanddocs/usage.md.The python lane covers threaded SQLite writers, filesystem walks, subprocesses, and Unix sockets longer than the host's
sun_path. The node and redis lanes expose server guests to the host or a second guest, and the go lane formats generated files withGOMAXPROCS=2and requires async preemption to interrupt a spinning goroutine.Written for commit f62bd3f. Summary will update on new commits.