Back to papers
July 21, 2026cs.LGcs.AI

Where Should Optimizer State Live? Tiered State Allocation for Memory-Efficient Mixture-of-Experts Training

HF Upvotes

6

Categories

cs.LG, cs.AI