Information-Theoretic Progress Measures reveal Grokking is an Emergent Phase Transition.

Mon, 01 Jan 2024 00:00:00 +0100

Kenzo Clauw, Sebastiano Stramaglia, Daniele Marinazzo:
Information-Theoretic Progress Measures reveal Grokking is an Emergent Phase Transition. CoRR abs/2408.08944 (2024)