Issues

• Comparative analysis of MLA vs MLA-o model behavior

  chrisjmccormick/shared-subspaces#12 · Filter by author chrisjmccormick opened on Sep 3, 2025

• MoE router health analysis

  chrisjmccormick/shared-subspaces#11 · Filter by author chrisjmccormick opened on Sep 3, 2025

• Query vs Output subspace impact comparison

  ablationarchitecturebenchmarkingthroughput
  chrisjmccormick/shared-subspaces#10 · Filter by author chrisjmccormick opened on Sep 3, 2025

• Investigate high gradient norms in MLA-o training

  chrisjmccormick/shared-subspaces#9 · Filter by author chrisjmccormick opened on Sep 3, 2025

• Systematic throughput benchmarking to identify MLA-o advantages

  benchmarkingdecoderthroughput
  chrisjmccormick/shared-subspaces#8 · Filter by author chrisjmccormick opened on Sep 3, 2025

• Fix RoPE dimension split issue for balanced head configurations

  chrisjmccormick/shared-subspaces#7 · Filter by author chrisjmccormick opened on Sep 3, 2025

• Add a subspace_encoder config that runs quickly as a demo

  chrisjmccormick/shared-subspaces#2 · Filter by author chrisjmccormick opened on Aug 14, 2025

• Set up an on-ramp for new community members

  chrisjmccormick/shared-subspaces#1 · Filter by author chrisjmccormick opened on Aug 14, 2025