实验 40:A34 Persistent Surface Labels

保存逐点 surface evidence 并聚类成 editable patches,为真实局部 mesh edit 铺路

实验定位 正向 artifact step / 尚未编辑 mesh

A34 补上 A33 明确指出的关键缺口:A30/A31 之前只保存了 summary 和 PNG,没有保存逐点 surface evidence。本轮重跑 gso_002/gso_008 的 surface projection,并把每个 repair surface sample 的 3D 坐标、标签、patch id、per-view depth residual delta 都持久化到磁盘。

结果:persisted npz=2/2,ply=2/2,patch json=2/2;mean patch count=45,mean observed sample ratio=0.9925。这使 A35 可以真正做 patch-level mesh edit,而不再停留在 case-level 路由。

实验设计(Image-2 风格)

实验设计图:A34 persistent surface labels
实验设计图:A34 persistent surface labels
模块设计图:sample evidence 到 editable patches
模块设计图:sample evidence 到 editable patches

模块设计(Image-2 风格)

Label Semantics

  • surface_improved:repair surface is closer to VGGT visible depth than baseline
  • surface_conflict:repair surface is farther from VGGT visible depth than baseline
  • surface_neutral:visible but residual change is small or mixed
  • unobserved_closable:not supported by input views; candidate area for weak completion

Persisted Artifacts

  • surface_samples_labels.npz:points、label_ids、patch_ids、per_view_depth_delta、mean_depth_delta。
  • surface_samples_labeled.ply:带颜色和 patch id 的 3D 点云,可直接查看。
  • patches.json:每个 patch 的 label、sample_count、ratio、centroid、mean_radius。
  • PNG panels:标签投影和 patch 聚类可视化。

实验结果(表格)

casesamplespatchessmall patches <1%largest patch ratioimprovedconflictneutralunobservedobservedNPZPLY
gso_002_input42000070630.66370.66060.16510.15950.01490.9851/home/jiachen/TRELLIS/experiments/nonorthogonal_gpt_orthoview/outputs/data_survey/vggt_spatial_adapter/support_guidance_a34_persistent_surface_labels/gso_002_input4/surface_samples_labels.npz/home/jiachen/TRELLIS/experiments/nonorthogonal_gpt_orthoview/outputs/data_survey/vggt_spatial_adapter/support_guidance_a34_persistent_surface_labels/gso_002_input4/surface_samples_labeled.ply
gso_008_input42000020160.70270.16320.70160.13490.00030.9998/home/jiachen/TRELLIS/experiments/nonorthogonal_gpt_orthoview/outputs/data_survey/vggt_spatial_adapter/support_guidance_a34_persistent_surface_labels/gso_008_input4/surface_samples_labels.npz/home/jiachen/TRELLIS/experiments/nonorthogonal_gpt_orthoview/outputs/data_survey/vggt_spatial_adapter/support_guidance_a34_persistent_surface_labels/gso_008_input4/surface_samples_labeled.ply

可视化结果

A34 逐点标签比例
A34 逐点标签比例
A34 patch cluster 数量
A34 patch cluster 数量
gso_002_input4 surface sample labels
gso_002_input4 surface sample labels
gso_002_input4 patch clusters
gso_002_input4 patch clusters
gso_008_input4 surface sample labels
gso_008_input4 surface sample labels
gso_008_input4 patch clusters
gso_008_input4 patch clusters

实验结论

下一步想法