实验 75:A69 Lambda Router Stress Audit

leave-one-out 支持 adaptive 方向,但阈值 exact route 仍不稳

实验定位 方向稳定 / 阈值未稳

A69 专门审计 A68 的过拟合风险:A68 在 3-case 上同时提升 Chamfer/F@5,但可能只是把三个 case 的答案编码进规则。A69 使用两种压力测试:leave-one-out 阈值学习,以及 285 组 conflict/unobserved 阈值扰动。

结果:LOO router 的 mean joint score=-0.0006242,仍优于固定 A66 的 -0.0005395,但弱于完整 A68 的 -0.0007329。阈值扰动中 100.0% 的设置优于 A66 joint,但只有 50.5% 完全复现 A68 的 exact routing。

实验设计(Image-2 风格)

实验设计图:A69 lambda router stress audit
实验设计图:A69 lambda router stress audit
模块设计图:router robustness checks
模块设计图:router robustness checks

模块设计(Image-2 风格)

Leave-one-out

  • 每次留出 1 个 case。
  • 在剩余 2 个 case 上搜索简单阈值。
  • 用学到的阈值预测 held-out case 的 policy。
  • 比较 LOO、A68 full、A66 fixed 的 joint score。

Threshold Stress

  • 扫描 moderate conflict / unobserved 阈值。
  • 扫描 saturated conflict / unobserved 阈值。
  • 统计 exact routing 是否复现 A68。
  • 统计是否仍优于 A66 fixed joint score。

实验结果(表格)

method 汇总

methodmean ΔChamfermean ΔF@5joint scoreselected policies
a66_uncertainty_damped_budget-0.00039090.001858-0.0005395{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a66_uncertainty_damped_budget', 'gso_008_input4': 'a66_uncertainty_damped_budget'}
a67_visible_preserving_damping-0.00033610.002504-0.0005365{'gso_000_input4': 'a67_visible_preserving_damping', 'gso_002_input4': 'a67_visible_preserving_damping', 'gso_008_input4': 'a67_visible_preserving_damping'}
a67_coverage_friendly_damping-0.00028130.001956-0.0004378{'gso_000_input4': 'a67_coverage_friendly_damping', 'gso_002_input4': 'a67_coverage_friendly_damping', 'gso_008_input4': 'a67_coverage_friendly_damping'}
a68_adaptive_lambda_router-0.00051580.002714-0.0007329{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a67_visible_preserving_damping', 'gso_008_input4': 'a67_coverage_friendly_damping'}
a69_leave_one_out_router-0.00043300.002389-0.0006242{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a66_uncertainty_damped_budget', 'gso_008_input4': 'a67_coverage_friendly_damping'}

leave-one-out 明细

held-outselected policyΔChamferΔF@5jointtrain selectedlearned params
gso_000_input4a66_uncertainty_damped_budget-0.0003827-0.000773-0.0003208{'gso_002_input4': 'a67_visible_preserving_damping', 'gso_008_input4': 'a67_coverage_friendly_damping'}{'moderate_conflict': 0.12, 'moderate_unobserved': 0.04, 'sat_conflict': 0.45, 'sat_unobserved': 0.01}
gso_002_input4a66_uncertainty_damped_budget-0.00083940.006863-0.0013885{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_008_input4': 'a67_coverage_friendly_damping'}{'moderate_conflict': 0.12, 'moderate_unobserved': 0.01, 'sat_conflict': 0.45, 'sat_unobserved': 0.01}
gso_008_input4a67_coverage_friendly_damping-0.00007700.001078-0.0001633{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a67_visible_preserving_damping'}{'moderate_conflict': 0.12, 'moderate_unobserved': 0.04, 'sat_conflict': 0.45, 'sat_unobserved': 0.01}

threshold stress top rows

mean ΔChamfermean ΔF@5jointselected policiesmatches A68beats A66params
-0.00051580.002714-0.0007329{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a67_visible_preserving_damping', 'gso_008_input4': 'a67_coverage_friendly_damping'}TrueTrue{'moderate_conflict': 0.12, 'moderate_unobserved': 0.04, 'sat_conflict': 0.45, 'sat_unobserved': 0.01}
-0.00051580.002714-0.0007329{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a67_visible_preserving_damping', 'gso_008_input4': 'a67_coverage_friendly_damping'}TrueTrue{'moderate_conflict': 0.12, 'moderate_unobserved': 0.04, 'sat_conflict': 0.45, 'sat_unobserved': 0.02}
-0.00051580.002714-0.0007329{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a67_visible_preserving_damping', 'gso_008_input4': 'a67_coverage_friendly_damping'}TrueTrue{'moderate_conflict': 0.12, 'moderate_unobserved': 0.04, 'sat_conflict': 0.45, 'sat_unobserved': 0.04}
-0.00051580.002714-0.0007329{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a67_visible_preserving_damping', 'gso_008_input4': 'a67_coverage_friendly_damping'}TrueTrue{'moderate_conflict': 0.12, 'moderate_unobserved': 0.04, 'sat_conflict': 0.55, 'sat_unobserved': 0.01}
-0.00051580.002714-0.0007329{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a67_visible_preserving_damping', 'gso_008_input4': 'a67_coverage_friendly_damping'}TrueTrue{'moderate_conflict': 0.12, 'moderate_unobserved': 0.04, 'sat_conflict': 0.55, 'sat_unobserved': 0.02}
-0.00051580.002714-0.0007329{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a67_visible_preserving_damping', 'gso_008_input4': 'a67_coverage_friendly_damping'}TrueTrue{'moderate_conflict': 0.12, 'moderate_unobserved': 0.04, 'sat_conflict': 0.55, 'sat_unobserved': 0.04}
-0.00051580.002714-0.0007329{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a67_visible_preserving_damping', 'gso_008_input4': 'a67_coverage_friendly_damping'}TrueTrue{'moderate_conflict': 0.12, 'moderate_unobserved': 0.04, 'sat_conflict': 0.65, 'sat_unobserved': 0.01}
-0.00051580.002714-0.0007329{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a67_visible_preserving_damping', 'gso_008_input4': 'a67_coverage_friendly_damping'}TrueTrue{'moderate_conflict': 0.12, 'moderate_unobserved': 0.04, 'sat_conflict': 0.65, 'sat_unobserved': 0.02}
-0.00051580.002714-0.0007329{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a67_visible_preserving_damping', 'gso_008_input4': 'a67_coverage_friendly_damping'}TrueTrue{'moderate_conflict': 0.12, 'moderate_unobserved': 0.04, 'sat_conflict': 0.65, 'sat_unobserved': 0.04}
-0.00051580.002714-0.0007329{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a67_visible_preserving_damping', 'gso_008_input4': 'a67_coverage_friendly_damping'}TrueTrue{'moderate_conflict': 0.12, 'moderate_unobserved': 0.06, 'sat_conflict': 0.45, 'sat_unobserved': 0.01}
-0.00051580.002714-0.0007329{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a67_visible_preserving_damping', 'gso_008_input4': 'a67_coverage_friendly_damping'}TrueTrue{'moderate_conflict': 0.12, 'moderate_unobserved': 0.06, 'sat_conflict': 0.45, 'sat_unobserved': 0.02}
-0.00051580.002714-0.0007329{'gso_000_input4': 'a66_uncertainty_damped_budget', 'gso_002_input4': 'a67_visible_preserving_damping', 'gso_008_input4': 'a67_coverage_friendly_damping'}TrueTrue{'moderate_conflict': 0.12, 'moderate_unobserved': 0.06, 'sat_conflict': 0.45, 'sat_unobserved': 0.04}

可视化结果

A69 joint score comparison
A69 joint score comparison
A69 F@5 comparison
A69 F@5 comparison
A69 threshold stability
A69 threshold stability

实验结论

下一步想法