Learning State-Tracking from Code: REPL Traces and Probabilistic Automata
Published in Workshop on Latent & Implicit Thinking – Going Beyond CoT Reasoning, 2026
We convert state-tracking benchmarks into code via REPL traces and study which sequence models can learn long-horizon state tracking.