← Back to the feed
Mobility & logisticsResearch findings

Mozart Framework for Modular MoE Training on 3.5D Chiplet Architectures

Original published 2026.03.07 11:57 KSTAdded to Blackdeck 2026.11.18 11:14 KST

What has changed?

A joint algorithm-hardware co-design framework that improves communication efficiency and computation overlap in modular MoE training on 3.5D wafer-scale chipl

Key points

  1. Mozart proposes a joint algorithm-hardware co-design framework for efficient MoE-based LLM training on 3.5D wafer-scale chiplet architecture
  2. Improves communication efficiency and computation overlap through on-package all-to-all communication and fine-grained token streaming
  3. Demonstrates significant efficiency gains across three popular MoE models

Connect it to your work

Enables more effective parallelization and resource utilization in large-scale modular MoE LLMs

What remains unproven

This research note is based on an abstract; check the original for test conditions and application scope.

Originals used for this note

Links open the original publisher in a new tab.

  1. arxivMozart: Modularized and Efficient MoE Training on 3.5D Wafer-Scale Chiplet Architectures