实验 28:A22 Depth/Normal Oracle Probe

用 GT oracle 验证 depth/normal 几何一致性能否补上 silhouette-support 的盲区

实验定位 Oracle 正结果 / 不可直接部署

A22 回答 A21 留下的问题:如果 3D silhouette-support 分不出 gso_008 的 baseline 与 repair,depth/normal 几何信号能不能分出来?这里使用 GSO GT mesh 作为 诊断 oracle,只验证信号价值,不把它当作无 GT 部署方法。

结论:可以。repair_hybrid 的 mask IoU 平均略高,但 depth_abs 平均比 baseline 变差 0.00510,normal_cos 平均下降 -0.0042。对 gso_008,repair depth error 增加 0.08539,normal_cos 降低 -0.0375,正好解释 A21 漏检的几何错误。

实验设计(Image-2 风格)

实验设计图:GT-oracle depth/normal probe
实验设计图:GT-oracle depth/normal probe
模块设计图:从 GT oracle 到 VGGT gate
模块设计图:从 GT oracle 到 VGGT gate

模块设计(Image-2 风格)

Oracle Purpose

test whether depth/normal reprojection explains failures missed by silhouette-only support

GT 使用范围:diagnostic oracle only; not deployable routing

部署替代:VGGT-predicted depth/normal or multi-view estimated geometry should replace GT in a real method

Gate Rules

  • reject repair if GT-oracle depth error worsens by > 0.005
  • reject repair if GT-oracle normal cosine worsens by > 0.01
  • keep A20 2D visible-safe rejection as a hard reject

实验结果(表格)

方法casemask IoUdepth abs ↓normal cos ↑normal angle ↓
baseline100.51670.228460.640842.61
repair_hybrid100.53700.233560.636643.12

逐 case oracle gate

caseA22 gatebaseline depthrepair depthdepth Δbaseline normalrepair normalnormal ΔGT Chamfer ΔGT F@5 ΔA20 gateA21 gate原因
gso_000_input4reject0.168240.175630.007390.65780.6439-0.0138-0.001600.0202TrueTrue['repair worsens GT-oracle depth', 'repair worsens GT-oracle normal']
gso_001_input4reject0.303260.30168-0.001590.42800.4272-0.0009-0.001050.0082FalseFalse['A20 2D visible-safe gate rejects repair']
gso_002_input4pass0.284140.19594-0.088200.65430.74630.0920-0.003770.0502TrueTrue[]
gso_003_input4reject0.150210.153620.003410.86610.8659-0.0002-0.00005-0.0041FalseFalse['A20 2D visible-safe gate rejects repair']
gso_004_input4reject0.205570.205590.000020.59830.60030.0020-0.000410.0032FalseFalse['A20 2D visible-safe gate rejects repair']
gso_005_input4reject0.210770.21074-0.000030.64200.6394-0.00250.00119-0.0079FalseFalse['A20 2D visible-safe gate rejects repair']
gso_006_input4reject0.208370.246910.038540.56040.5020-0.05840.001440.0204FalseFalse['repair worsens GT-oracle depth', 'repair worsens GT-oracle normal', 'A20 2D visible-safe gate rejects repair']
gso_007_input4reject0.325300.330610.005320.52980.5138-0.01610.00281-0.0188FalseFalse['repair worsens GT-oracle depth', 'repair worsens GT-oracle normal', 'A20 2D visible-safe gate rejects repair']
gso_008_input4reject0.364450.449840.085390.60090.5635-0.03750.00474-0.0168FalseFalse['repair worsens GT-oracle depth', 'repair worsens GT-oracle normal', 'A20 2D visible-safe gate rejects repair']
gso_009_input4pass0.064330.065080.000750.87030.8634-0.0069-0.00006-0.0029TrueTrue[]

可视化结果

A22 oracle depth/normal aggregate metrics
A22 oracle depth/normal aggregate metrics
A22 repair vs baseline oracle deltas
A22 repair vs baseline oracle deltas

gso_008 depth / normal oracle panels

gso_008 baseline depth panel: GT vs baseline
gso_008 baseline depth panel: GT vs baseline
gso_008 repair depth panel: GT vs repair
gso_008 repair depth panel: GT vs repair
gso_008 baseline normal panel: GT vs baseline
gso_008 baseline normal panel: GT vs baseline
gso_008 repair normal panel: GT vs repair
gso_008 repair normal panel: GT vs repair

实验结论

下一步想法