实验 33:A27 Per-view Depth Lock Taxonomy

把 per-view VGGT depth 与 visible evidence 对齐,解释 gso_002 与 gso_008 的局部可观测性差异

实验定位 诊断正结果 / 路由混合

A27 回答 A26 的核心问题:为什么 case-level risk 分不开某些 under-coverage?本轮把 A20 的 per-view visible evidence 和 A23 的 per-view VGGT depth/normal evidence 对齐,给每个输入视角打标签:depth_good、depth_bad、visible_conflict、silhouette_good、under_coverage。

焦点结论很清楚:gso_002 虽然有 under-coverage,但有 depth_good views=[0, 1] 和 silhouette_good views=[3],所以 repair 可接受;gso_008 同时有 case/per-view depth reject、visible_conflict views=[2] 和 silhouette_bad,因此必须拒绝。

实验设计(Image-2 风格)

实验设计图:A27 per-view depth lock taxonomy
实验设计图:A27 per-view depth lock taxonomy
模块设计图:从标量门控到 view-level lock
模块设计图:从标量门控到 view-level lock

模块设计(Image-2 风格)

Hypothesis

问题:A26 case-level risk cannot distinguish local depth-supported under-coverage from true visible support deletion.

Per-view lock:Align per-view VGGT depth deltas with per-view visible loss and silhouette deltas to classify each view as depth_good/depth_bad/visible_conflict/etc.

论文角度:This is the first step toward a pixel/region-level lock map that separates visible-locked, unobserved-closable and conflict regions.

Taxonomy Tags

  • depth_good/depth_bad:repair 相对 baseline 是否更接近 VGGT depth。
  • visible_conflict:repair 删除可见支持且 silhouette 变差。
  • silhouette_good:repair 在该视角改善轮廓,可抵消轻微 coverage 风险。
  • under_coverage:区域缩小,只能作为风险提示,不能单独拒绝。

实验结果(表格)

策略选择 repair 数false rejectfalse acceptselected Chamfer Δselected F@5 Δ选择的 repair case
A24 calibrated340-0.000540.0067gso_000_input4, gso_002_input4, gso_009_input4
A27 per-view depth lock531-0.000300.0051gso_000_input4, gso_002_input4, gso_003_input4, gso_004_input4, gso_007_input4

A27 逐 case 汇总

caseA27 gatemean view scoredepth good viewsdepth bad viewsvisible conflict viewssilhouette good viewsunder-coverage viewsGT Chamfer ΔGT F@5 Δ原因
gso_000_input4pass0.1363[0, 1, 2, 3][][][0, 1, 2, 3][]-0.001600.0202[]
gso_001_input4reject-0.0019[][][][][0, 1, 2, 3]-0.001050.0082['broad under-coverage without depth/silhouette compensation']
gso_002_input4pass0.0152[0, 1][2][][3][1, 2, 3]-0.003770.0502[]
gso_003_input4pass-0.0027[][][][][]-0.00005-0.0041[]
gso_004_input4pass-0.0003[][][][][]-0.000410.0032[]
gso_005_input4reject-0.0000[][][][][0, 1, 2, 3]0.00119-0.0079['broad under-coverage without depth/silhouette compensation']
gso_006_input4reject-0.0255[][0, 1, 2, 3][][][]0.001440.0204['case and per-view depth both reject', 'multi-view depth_bad']
gso_007_input4pass-0.0001[][3][][][]0.00281-0.0188[]
gso_008_input4reject-0.0382[2][0][2][][0, 1, 2, 3]0.00474-0.0168['case and per-view depth both reject', 'visible conflict without compensating silhouette']
gso_009_input4reject-0.0084[][][0][1][2]-0.00006-0.0029[]

gso_002 vs gso_008 逐视角解释

caseviewscoredepth Δnormal Δvisible lossIoU Δarea ratiotags
gso_002_input400.0645-0.05570-0.06580.01780.01520.979['depth_good']
gso_002_input410.0300-0.02306-0.06930.01800.01890.727['depth_good', 'under_coverage']
gso_002_input42-0.05630.05237-0.07840.03860.00790.618['depth_bad', 'under_coverage']
gso_002_input430.02240.00016-0.07410.01600.04920.732['silhouette_good', 'under_coverage']
gso_008_input40-0.08780.073550.08390.0308-0.01310.685['depth_bad', 'under_coverage']
gso_008_input41-0.00780.003550.00130.0066-0.00470.207['under_coverage']
gso_008_input42-0.0437-0.01672-0.00950.0893-0.06130.635['depth_good', 'visible_conflict', 'silhouette_bad', 'under_coverage']
gso_008_input43-0.01360.00040-0.00610.0186-0.01560.202['under_coverage']

可视化结果

A27 与 A24 的错误类型对比
A27 与 A24 的错误类型对比
A27 接受 repair 数和 F@5 收益对比
A27 接受 repair 数和 F@5 收益对比

实验结论

下一步想法