Skip to content

feat: Add TE+CP support for gemma4 26b MoE#2155

Draft
athitten wants to merge 1 commit intomainfrom
athitten/gemma4_moe_cp
Draft

feat: Add TE+CP support for gemma4 26b MoE#2155
athitten wants to merge 1 commit intomainfrom
athitten/gemma4_moe_cp

Conversation

@athitten
Copy link
Copy Markdown
Contributor

@athitten athitten commented May 6, 2026

What does this PR do ?

Add a one line overview of what this PR aims to accomplish.

Changelog

  • Add specific line by line info of high level changes in this PR.

Before your PR is "Ready for review"

Pre checks:

  • Make sure you read and followed Contributor guidelines
  • Did you write any new necessary tests?
  • Did you add or update any necessary documentation?

If you haven't finished some of the above items you can still open "Draft" PR.

Additional Information

  • Related to # (issue)

Signed-off-by: Abhishree Thittenamane <athittenaman@cw-dfw-cs-001-login-02.cm.cluster>
@copy-pr-bot
Copy link
Copy Markdown

copy-pr-bot Bot commented May 6, 2026

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@athitten athitten linked an issue May 6, 2026 that may be closed by this pull request
@athitten athitten changed the title Add TE+CP support for gemma4 26b MoE feat: Add TE+CP support for gemma4 26b MoE May 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Support for CP with TE for Gemma4 MoE

1 participant