05

Research workshop

Experiments meant to become working systems.

These are long-running engineering projects, documented while the questions are still alive—not rewritten afterward to make progress look inevitable.

01
SMALL LANGUAGE MODELSACTIVE RESEARCH

Train fluency. Retrieve knowledge.

A retrieval-native language model architecture designed around the idea that a compact model should learn reasoning, language, and tool use—not spend its limited capacity memorizing a brittle encyclopedia.

  • Consumer-GPU pretraining
  • Query head from initialization
  • Efficient context injection
02
SELF-LEARNING CHESSACTIVE BUILD

Learning chess from the board itself.

An AlphaZero-style system with a residual policy-value network, parallel Monte Carlo tree search, and a self-play pipeline built to make serious experimentation possible on available hardware.

  • 1.6M-game source corpus
  • ResNet policy-value model
  • Batched parallel search