实验 71:A65 Per-region Signed Residual

区域级 signed residual 改善 A64,但 naive risk 公式仍会选错

实验定位 区域信号正向 / risk 公式待修正

A65 针对 A64 的核心反例:gso008 iter1 在所有输入视角 depth residual 都改善的情况下,GT Chamfer 反而变差。这里不再只按视角聚合,而是把 A58 candidate mesh 的可见表面采样点投影回输入相机,并按 A51/A35 继承的 face label 统计 surface_improvedsurface_conflictsurface_neutralunobserved_closable 四类区域的 signed depth residual。

结果:最佳 no-GT selector 是 a65_min_region_spread,active-case mean ΔChamfer=-0.0001943、ΔF@5=0.005121,比 A64 best 的 ΔChamfer=-0.0001264 更好;但手写的 a65_per_region_signed_risk 过度偏向早停,mean ΔChamfer=0.0002961,因此不能作为最终公式。

实验设计(Image-2 风格)

实验设计图:A65 per-region signed residual
实验设计图:A65 per-region signed residual
模块设计图:regional signed residual budget
模块设计图:regional signed residual budget

模块设计(Image-2 风格)

Residual Decomposition

  • 对每个 candidate mesh 采样 70k 个带 face label 的表面点。
  • 投影到 4 个输入相机,并用 z-buffer 过滤被遮挡点。
  • 与 VGGT depth 做 scale-aligned signed residual:candidate depth - VGGT depth。
  • 按 inherited surface region 统计 mean abs、mean signed、positive/negative ratio 和 delta vs carrier。

Selector Audit

  • min_conflict_abs:只奖励 conflict 区 residual 变小。
  • min_visible_damage:优先保护可信可见区。
  • min_region_spread:压低区域间 residual 变化分歧。
  • signed_risk:线性组合 conflict gain、visible damage、spread 与 signed drift。
  • safe:只有 conflict 改善且 visible 不恶化才接受,否则回 carrier。

实验结果(表格)

selector 汇总

selectormean ΔChamfermean ΔF@5mean conflict abs Δmean visible abs Δmean region spreadselected iters
a65_min_conflict_abs0.00026720.000399-0.00069440.00044250.0012124{'1': 2, '2': 1}
a65_min_visible_damage-0.00017140.0049880.0005034-0.00027070.0016574{'1': 1, '2': 1, '6': 1}
a65_min_region_spread-0.00019430.005121-0.00035490.00083990.0005894{'1': 1, '3': 1, '8': 1}
a65_per_region_signed_risk0.00029610.000594-0.00055250.00023240.0011832{'1': 3}
a65_conflict_gain_visible_safe-0.0000707-0.000080-0.0000854-0.00004890.0001189{'0': 2, '1': 1}
gt_chamfer_oracle-0.00055810.0114630.0024179-0.00164320.0023407{'3': 1, '8': 2}
gt_fscore_oracle-0.00051670.0116280.0025958-0.00164270.0024107{'4': 1, '8': 2}

case-level 定位

caseGT Chamfer iterrisk itersafe iterlocal-damage iters
gso_000_input4311[5, 7]
gso_002_input4810[]
gso_008_input4810[1, 2, 3, 4, 5, 6, 7, 8]

关键选择明细

caseselectoriterΔChamferΔF@5conflict abs Δvisible abs Δregion spreadrisk
gso_000_input4a65_min_region_spread3-0.00041590.000512-0.00017240.00042290.00023090.0053993
gso_000_input4a65_per_region_signed_risk1-0.0002122-0.000240-0.0002562-0.00014660.00035660.0016828
gso_000_input4a65_conflict_gain_visible_safe1-0.0002122-0.000240-0.0002562-0.00014660.00035660.0016828
gso_000_input4gt_chamfer_oracle3-0.00041590.000512-0.00017240.00042290.00023090.0053993
gso_002_input4a65_min_region_spread8-0.00160530.015600-0.00084410.00194450.00115490.0163967
gso_002_input4a65_per_region_signed_risk1-0.00033760.002772-0.00135300.00069160.00281060.0050377
gso_002_input4a65_conflict_gain_visible_safe00.00000000.0000000.00000000.00000000.00000000.0000000
gso_002_input4gt_chamfer_oracle8-0.00160530.015600-0.00084410.00194450.00115490.0163967
gso_008_input4a65_min_region_spread10.0014382-0.000748-0.00004830.00015230.00038230.0040817
gso_008_input4a65_per_region_signed_risk10.0014382-0.000748-0.00004830.00015230.00038230.0040817
gso_008_input4a65_conflict_gain_visible_safe00.00000000.0000000.00000000.00000000.00000000.0000000
gso_008_input4gt_chamfer_oracle80.00034680.0182770.0082700-0.00729700.00563630.0286227

gso008 iter1 区域残差

regionsamplesmean absabs Δmean signedsigned Δpositive ratio
surface_improved189380.03829490.00015230.00072830.000403454.6%
surface_conflict995070.0289694-0.00004830.01284150.001286971.9%
surface_neutral177970.01182700.00048650.00621210.000249883.8%
unobserved_closable990.0498781-0.0005681-0.0355004-0.010847747.5%

区域信号与 GT Chamfer 相关性

casesignalSpearman rhop-value
gso_000_input4conflict_abs_delta0.66670.0499
gso_000_input4visible_abs_delta-0.48330.1875
gso_000_input4region_abs_delta_spread0.28330.4600
gso_000_input4per_region_signed_risk0.21670.5755
gso_000_input4local_damage_flag0.09130.8153
gso_002_input4conflict_abs_delta-0.13330.7324
gso_002_input4visible_abs_delta-0.63330.0671
gso_002_input4region_abs_delta_spread-0.21670.5755
gso_002_input4per_region_signed_risk-0.96670.0000
gso_002_input4local_damage_flag-0.27390.4758
gso_008_input4conflict_abs_delta0.41670.2646
gso_008_input4visible_abs_delta-0.21670.5755
gso_008_input4region_abs_delta_spread0.43330.2440
gso_008_input4per_region_signed_risk0.30000.4328
gso_008_input4local_damage_flag0.54770.1269

可视化结果

A65 Chamfer comparison
A65 Chamfer comparison
A65 F@5 comparison
A65 F@5 comparison
A65 gso008 local damage decomposition
A65 gso008 local damage decomposition

实验结论

下一步想法