Everett Stenberg / LabTry LMSteinshark ↗

PRETRAINING / RUN MONITOR

Learning, one token at a time.

Loading checkpoint…

ConnectingWaiting for metrics

Training progress

Throughput

tokens / second

Training loss

cross-entropy

Validation loss

cross-entropy

Estimated remaining

at latest throughput

Learning curves

TrainingValidation
View loss samples
TokensTrainValidation

Latest checkpoint

Elapsed training time

Context curriculum

1,024 through 28B tokens
2,048 for the final 2B