TRELLIS / TRELLIS.2 / ReconViaGen 多视角非正交输入评估

数据:ProObjaverse 5 个对象,每个对象输入 2/3/4/6/8 个非正交视角,测试 20 个 held-out 视角。GT mesh 来自本地 lh-slat latent 经 TRELLIS mesh decoder 解码。

总体结论

本页同时报告 raw mesh 和 raw faces 约 1/3 的 simplified mesh,并加入 ReconViaGen 论文风格的 CD/F-score 与 normal-view novel-view 指标。绿色、蓝色、黄色分别表示该指标的第一、第二、第三名。

MetricTRELLISTRELLIS 1/3TRELLIS.2TRELLIS.2 1/3ReconViaGenReconViaGen 1/3
Chamfer-L2 meanlower is better0.01560.01560.00960.00960.01700.0169
F-score @2% bbox diaghigher is better0.83280.83250.93530.93570.76770.7675
F-score @5% bbox diaghigher is better0.94860.94860.98410.98400.92910.9294
Paper CD-100klower is better0.04950.04950.02930.02930.05290.0529
Paper F-score r=0.1higher is better0.90410.90400.95500.95480.84650.8468
Raw bbox IoUhigher is better0.89290.89270.92910.92910.80950.8095
20-view silhouette IoUhigher is better0.76560.76560.87730.87730.72640.7264
20-view mask F1higher is better0.85710.85710.93410.93410.83080.8308
Boundary Chamferlower is better0.00980.00980.00590.00590.01190.0119
Normal-view PSNRhigher is better20.676520.683314.402514.405120.363820.3698
Normal-view SSIMhigher is better0.83300.83280.77800.77790.82940.8292
Normal-view LPIPSlower is better0.15880.15920.24230.24230.18830.1887

实验设置

几何指标:每个 mesh 采样 20,000 个点,做 bbox diagonal 归一化后计算 Chamfer 和 F-score。

论文风格几何:每个 mesh 额外采样 100,000 个点,归一化到 [-1,1]^3,用半径 0.1 计算 F-score。

2D 指标:用数据集 20 个测试相机渲染 mask,计算 silhouette IoU、mask F1、boundary Chamfer。GT decoded-vs-alpha sanity check 用于验证相机对齐。

Novel-view 指标:当前导出的 OBJ 缺少统一纹理,因此新增的 PSNR/SSIM/LPIPS 基于预测 normal render 与 GT decoded normal render,不直接和 GT RGB 纹理图比较。

ReconViaGen:使用官方多视角 checkpoint Stable-X/trellis-vggt-v0-2,输入与 TRELLIS/TRELLIS.2 相同的非正交视角,输出 mesh 后进入同一套 ProObjaverse GT 指标评估。

Simplified mesh:对每个 raw OBJ 使用 quadric decimation,把 faces 降到 floor(raw_faces / 3),不覆盖 raw 输出。

相机修正:ProObjaverse JSON extrinsic 为 camera-to-world,需要取逆并乘 diag(1,-1,-1,1) 转到 TRELLIS renderer 坐标。

指标说明

3D 几何指标

Chamfer-L2 mean:预测 mesh 和 GT mesh 各采样固定数量点,双向最近邻距离取均值。数值越低,整体几何越接近。

F-score @2% / @5%:以 GT bbox diagonal 的 2% 或 5% 作为距离阈值,同时考察 precision 和 recall。数值越高,说明预测表面更完整且更贴近 GT。

Paper CD-100k / F-score r=0.1:按 ReconViaGen 论文风格,每个 3D 输出采样 100k surface points,点云归一化到 [-1,1]^3,F-score 半径为 0.1。

Raw bbox IoU:预测 mesh 与 GT mesh 的轴对齐包围盒重叠程度。它主要反映尺度、朝向和整体占位是否接近。

20 视角投影指标

Silhouette IoU:把预测 mesh 渲染到 20 个 held-out 相机视角,与数据集 alpha mask 比较轮廓重叠。数值越高,说明新视角外形越一致。

Mask F1:轮廓 mask 的 precision/recall 调和平均,更能区分“预测太大”和“预测缺失”的情况。

Boundary Chamfer:预测轮廓边界和 GT 轮廓边界的平均距离。数值越低,轮廓边缘越贴合。

Novel View 与法线图

GT camera sanity IoU:先把 GT decoded mesh 渲染回数据集相机,与原始 alpha 对齐。如果该值很低,说明相机坐标不可信。本报告已修正 ProObjaverse camera-to-world 到 renderer world-to-camera 的转换。

Normal view:网页里的彩色法线图不是 RGB/材质图,而是表面法线方向编码,通常可理解为 R/G/B 分别对应 x/y/z 朝向。颜色变化表示表面朝向、面片 winding 或坐标约定变化,不表示物体真实颜色变化。

Normal-view PSNR / SSIM / LPIPS:由于当前 OBJ 主要是几何而非完整 PBR 贴图,这里把预测 normal render 与 GT decoded normal render 比较,是 novel-view 几何渲染一致性指标,不等同于 ReconViaGen 论文的真实 RGB 纹理指标。

生成 mesh 规模

CaseInputsTRELLIS vertices / facesTRELLIS 1/3 vertices / facesTRELLIS.2 vertices / facesTRELLIS.2 1/3 vertices / facesReconViaGen vertices / facesReconViaGen 1/3 vertices / faces
proobj_012313,284 / 626,656104,398 / 208,884738,351 / 1,481,830244,793 / 493,942274,392 / 548,78491,464 / 182,928
proobj_023172,610 / 345,22457,535 / 115,074579,068 / 1,169,852190,073 / 389,949173,020 / 346,01057,681 / 115,336
proobj_034323,166 / 646,300107,732 / 215,4321,909,251 / 3,849,698629,277 / 1,283,231342,236 / 684,332114,125 / 228,110
proobj_046330,442 / 660,872110,151 / 220,290783,941 / 1,573,216260,074 / 524,405333,898 / 667,792111,298 / 222,596
proobj_058517,606 / 1,035,256172,512 / 345,0841,688,373 / 3,419,552554,487 / 1,139,849453,572 / 907,136151,193 / 302,378

proobj_01 · 小车

输入视角 2 个:[0, 20];测试视角 20 个。GT camera sanity IoU = 0.986

TRELLIS better
输入视角
20 个测试视角
GT decoded
Loading OBJ...
39,970 vertices / 80,000 faces preview
TRELLIS
Loading OBJ...
39,956 vertices / 80,000 faces preview
TRELLIS 1/3
Loading OBJ...
39,957 vertices / 80,000 faces preview
TRELLIS.2
Loading OBJ...
38,807 vertices / 79,999 faces preview
TRELLIS.2 1/3
Loading OBJ...
38,825 vertices / 79,999 faces preview
ReconViaGen
Loading OBJ...
40,003 vertices / 80,000 faces preview
ReconViaGen 1/3
Loading OBJ...
40,000 vertices / 80,000 faces preview
held-out 视角可视化:GT alpha、GT decoded normal、TRELLIS normal, TRELLIS 1/3 normal, TRELLIS.2 normal, TRELLIS.2 1/3 normal, ReconViaGen normal, ReconViaGen 1/3 normal
MetricTRELLISTRELLIS 1/3TRELLIS.2TRELLIS.2 1/3ReconViaGenReconViaGen 1/3
Chamfer-L2 meanlower is better0.00850.00850.00980.00980.03530.0353
F-score @2%higher is better0.97050.96880.90960.90940.45000.4494
F-score @5%higher is better1.00001.00000.99390.99330.74330.7437
Paper CD-100klower is better0.03080.03060.03470.03480.10520.1051
Paper F-score r=0.1higher is better0.99500.99510.93910.93780.57560.5765
Silhouette IoUhigher is better0.88890.88890.87920.87920.56890.5689
Mask F1higher is better0.94090.94090.93550.93550.72260.7225
Boundary Chamferlower is better0.00520.00520.00520.00520.02410.0241
Normal-view PSNRhigher is better21.660721.670413.448513.449217.111217.1144
Normal-view SSIMhigher is better0.86430.86410.79120.79120.79330.7932
Normal-view LPIPSlower is better0.09730.09750.23450.23450.28760.2878

proobj_02 · 机器人

输入视角 3 个:[0, 13, 27];测试视角 20 个。GT camera sanity IoU = 0.864

TRELLIS.2 better
输入视角
20 个测试视角
GT decoded
Loading OBJ...
40,025 vertices / 80,000 faces preview
TRELLIS
Loading OBJ...
39,998 vertices / 80,000 faces preview
TRELLIS 1/3
Loading OBJ...
39,998 vertices / 80,000 faces preview
TRELLIS.2
Loading OBJ...
37,024 vertices / 79,999 faces preview
TRELLIS.2 1/3
Loading OBJ...
37,114 vertices / 80,000 faces preview
ReconViaGen
Loading OBJ...
40,012 vertices / 80,000 faces preview
ReconViaGen 1/3
Loading OBJ...
40,012 vertices / 79,999 faces preview
held-out 视角可视化:GT alpha、GT decoded normal、TRELLIS normal, TRELLIS 1/3 normal, TRELLIS.2 normal, TRELLIS.2 1/3 normal, ReconViaGen normal, ReconViaGen 1/3 normal
MetricTRELLISTRELLIS 1/3TRELLIS.2TRELLIS.2 1/3ReconViaGenReconViaGen 1/3
Chamfer-L2 meanlower is better0.03720.03720.00950.00950.01960.0195
F-score @2%higher is better0.55530.55460.93160.93190.64700.6469
F-score @5%higher is better0.74410.74390.99010.99010.91200.9120
Paper CD-100klower is better0.13200.13190.03110.03110.07550.0755
Paper F-score r=0.1higher is better0.61530.61530.94970.94970.74300.7439
Silhouette IoUhigher is better0.49920.49910.81080.81080.59130.5914
Mask F1higher is better0.66420.66420.89520.89520.74220.7423
Boundary Chamferlower is better0.01430.01430.00680.00680.01180.0118
Normal-view PSNRhigher is better18.679018.687817.184017.185319.235819.2437
Normal-view SSIMhigher is better0.83920.83960.87360.87360.85240.8527
Normal-view LPIPSlower is better0.21140.21150.12940.12950.17220.1722

proobj_03 · 折叠椅

输入视角 4 个:[0, 10, 20, 30];测试视角 20 个。GT camera sanity IoU = 0.984

TRELLIS.2 better
输入视角
20 个测试视角
GT decoded
Loading OBJ...
40,020 vertices / 80,000 faces preview
TRELLIS
Loading OBJ...
40,016 vertices / 80,000 faces preview
TRELLIS 1/3
Loading OBJ...
40,016 vertices / 80,000 faces preview
TRELLIS.2
Loading OBJ...
36,072 vertices / 80,000 faces preview
TRELLIS.2 1/3
Loading OBJ...
36,216 vertices / 79,999 faces preview
ReconViaGen
Loading OBJ...
40,072 vertices / 80,000 faces preview
ReconViaGen 1/3
Loading OBJ...
40,070 vertices / 80,000 faces preview
held-out 视角可视化:GT alpha、GT decoded normal、TRELLIS normal, TRELLIS 1/3 normal, TRELLIS.2 normal, TRELLIS.2 1/3 normal, ReconViaGen normal, ReconViaGen 1/3 normal
MetricTRELLISTRELLIS 1/3TRELLIS.2TRELLIS.2 1/3ReconViaGenReconViaGen 1/3
Chamfer-L2 meanlower is better0.01420.01420.00720.00710.01160.0115
F-score @2%higher is better0.74440.74420.99220.99170.84300.8444
F-score @5%higher is better0.99940.99951.00001.00000.99410.9951
Paper CD-100klower is better0.04120.04120.01820.01820.03310.0331
Paper F-score r=0.1higher is better0.92500.92421.00001.00000.94440.9444
Silhouette IoUhigher is better0.68200.68190.88550.88540.64690.6469
Mask F1higher is better0.81010.81010.93910.93910.78140.7813
Boundary Chamferlower is better0.01130.01130.00380.00390.01180.0118
Normal-view PSNRhigher is better17.086517.092611.644311.651117.203317.2091
Normal-view SSIMhigher is better0.71300.71230.66120.66090.72120.7207
Normal-view LPIPSlower is better0.25750.25870.37130.37100.28690.2880

proobj_04 · 玩具狗

输入视角 6 个:[0, 6, 13, 20, 27, 34];测试视角 20 个。GT camera sanity IoU = 0.990

TRELLIS better
输入视角
20 个测试视角
GT decoded
Loading OBJ...
39,999 vertices / 80,000 faces preview
TRELLIS
Loading OBJ...
40,006 vertices / 80,000 faces preview
TRELLIS 1/3
Loading OBJ...
40,006 vertices / 80,000 faces preview
TRELLIS.2
Loading OBJ...
38,871 vertices / 79,999 faces preview
TRELLIS.2 1/3
Loading OBJ...
38,903 vertices / 79,999 faces preview
ReconViaGen
Loading OBJ...
40,000 vertices / 80,000 faces preview
ReconViaGen 1/3
Loading OBJ...
40,000 vertices / 80,000 faces preview
held-out 视角可视化:GT alpha、GT decoded normal、TRELLIS normal, TRELLIS 1/3 normal, TRELLIS.2 normal, TRELLIS.2 1/3 normal, ReconViaGen normal, ReconViaGen 1/3 normal
MetricTRELLISTRELLIS 1/3TRELLIS.2TRELLIS.2 1/3ReconViaGenReconViaGen 1/3
Chamfer-L2 meanlower is better0.00780.00790.00870.00860.00910.0091
F-score @2%higher is better0.97590.97580.96330.96400.92700.9256
F-score @5%higher is better1.00001.00000.99900.99891.00001.0000
Paper CD-100klower is better0.02150.02170.02520.02480.02740.0274
Paper F-score r=0.1higher is better0.99520.99520.98870.98880.98170.9818
Silhouette IoUhigher is better0.88570.88570.92130.92130.89580.8958
Mask F1higher is better0.93930.93930.95900.95900.94490.9449
Boundary Chamferlower is better0.00700.00710.00470.00470.00660.0066
Normal-view PSNRhigher is better23.640423.646215.864515.867023.739123.7413
Normal-view SSIMhigher is better0.87370.87350.80530.80520.87940.8790
Normal-view LPIPSlower is better0.09720.09730.18480.18480.10060.1014

proobj_05 · 沙发

输入视角 8 个:[0, 5, 10, 15, 20, 25, 30, 35];测试视角 20 个。GT camera sanity IoU = 0.995

ReconViaGen 1/3 better
输入视角
20 个测试视角
GT decoded
Loading OBJ...
39,994 vertices / 80,000 faces preview
TRELLIS
Loading OBJ...
39,972 vertices / 80,000 faces preview
TRELLIS 1/3
Loading OBJ...
39,971 vertices / 80,000 faces preview
TRELLIS.2
Loading OBJ...
32,189 vertices / 80,000 faces preview
TRELLIS.2 1/3
Loading OBJ...
33,020 vertices / 79,999 faces preview
ReconViaGen
Loading OBJ...
40,004 vertices / 80,000 faces preview
ReconViaGen 1/3
Loading OBJ...
40,004 vertices / 80,000 faces preview
held-out 视角可视化:GT alpha、GT decoded normal、TRELLIS normal, TRELLIS 1/3 normal, TRELLIS.2 normal, TRELLIS.2 1/3 normal, ReconViaGen normal, ReconViaGen 1/3 normal
MetricTRELLISTRELLIS 1/3TRELLIS.2TRELLIS.2 1/3ReconViaGenReconViaGen 1/3
Chamfer-L2 meanlower is better0.01030.01030.01290.01290.00930.0092
F-score @2%higher is better0.91800.91910.87990.88140.97120.9713
F-score @5%higher is better0.99940.99960.93760.93750.99600.9961
Paper CD-100klower is better0.02200.02210.03760.03740.02330.0233
Paper F-score r=0.1higher is better0.99010.99020.89730.89800.98770.9875
Silhouette IoUhigher is better0.87210.87210.88970.88970.92900.9290
Mask F1higher is better0.93130.93130.94150.94150.96300.9631
Boundary Chamferlower is better0.01130.01130.00910.00910.00540.0054
Normal-view PSNRhigher is better22.315922.319413.871013.872824.529824.5404
Normal-view SSIMhigher is better0.87490.87450.75850.75840.90060.9003
Normal-view LPIPSlower is better0.13090.13120.29150.29170.09400.0941