Rewrite of scheduler as event driven instead of constant polling of task queue

[smuzaffar]

Rewrite of scheduler using event driven model instead of constant polling of job queue.

[cmsbuild]

A new Pull Request was created by @smuzaffar for branch V00-34-XX.

@akritkbehera, @cmsbuild, @iarspider, @raoatifshad, @smuzaffar can you please review it and eventually sign? Thanks.
@ftenchini, @mandrenguyen, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

[cmsbuild]

cms-bot internal usage

[smuzaffar]

test parameters:

• set_env = NO_PACKAGE_STORE

[smuzaffar]

please test with #210 for CMSSW_17_0_ROCM_X

[smuzaffar]

please test with #210 for CMSSW_17_0_X

[cmsbuild]

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-794a9c/53703/summary.html
COMMIT: 44f56ed
CMSSW: CMSSW_17_0_X_2026-06-05-1100/el8_amd64_gcc13
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/pkgtools/239/53703/install.sh to create a dev area with all the needed externals and cmssw changes.

Failed External Build

I found compilation warning when building: See details on the summary page.

[cmsbuild]

Pull request #239 was updated.

[smuzaffar]

please test with #210 for CMSSW_20_0_CLANG_X

[cmsbuild]

Pull request #239 was updated.

[cmsbuild]

Pull request #239 was updated.

[cmsbuild]

Pull request #239 was updated.

[smuzaffar]

+externals

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next V00-34-XX IBs after it passes the integration tests. This pull request will now be reviewed by the release team before it's merged. @mandrenguyen, @sextonkennedy, @ftenchini (and backports should be raised in the release meeting by the corresponding L2)