Albert MoE-13

𒀭 albert.

ARCH —

TNS —

EP —

BATCH — / —

ATL —

GATE

Surgery Gate — 17L → 18L

myc_stable — / >= 5

Plateau

— delta / win

WAITING FOR TRAINING DATA
fire albert-train to begin

EVENTS

WAITING FOR ANOMALY DATA

■ Layer Architecture

WAITING FOR TELE DATA

■ Expert Activity (12 MoE Experts)

WAITING FOR TELE DATA

■ Expert Routing — Last 60 Steps

WAITING FOR ROUTE DATA

■ Traffic Light Routing (TTL)

WAITING FOR TLIGHT DATA

■ Per-Layer Gradient Norm

WAITING FOR GRAD DATA