Generalization in LLM Problem Solving: The Case of the Shortest Path

ID: 2604.15306

Authors: Yao Tong, Jiayuan Ye, Anastasia Borovykh, Reza Shokri

Focus: Systematic generalization in sequential optimization problems.

Key Insight: Models exhibit strong spatial transfer (unseen maps) but fail under length scaling due to recursive instability. This highlights a fundamental bottleneck in multi-step reasoning evolution.

RSI Relevance: Identifies "recursive instability" as a primary failure mode that must be solved for long-horizon autonomous agents.

View on ArXiv