Extrapolation across Phase Transitions: Error Bounds and Power-Law Scaling
Jeffrey Wei, Manolis Zampetakis, John Sous
TLDR Fixed-feature regression learns from one phase to locate the transition where neural networks fail, and a sample-free bound limits its error to power-law growth.