A Theoretical Study on Bridging Internal Probability and Self-Consistency for LLM Reasoning(在新窗口打开)
建立采样式 test-time scaling 的置信估计理论框架,提出 RPC 融合 self-consistency 与 perplexity。
- 理论分析 self-consistency 估计误差高、perplexity 建模误差大等问题
- RPC 含 Perplexity Consistency 与 Reasoning Pruning 两组件
- 七个 benchmark 上 RPC 推理可比 self-consistency 且采样成本约减半