City

Benchmarks

Task Name	Dataset Name	SOTA Result
Semantic Segmentation	City	mIoU61.6	61
Promptable Image Segmentation	CITY (val)	mIoU63.2	24
Driver Acceptance Prediction	City C	AUC Improvement0.84	18
Driver Acceptance Prediction	City B	AUC Improvement (%)2.6	18
Desnowing	City Snow	PSNR24.19	10
Passenger-side Cancellation Prediction	City B	AUC Improvement6	9
Driver-side Cancellation Prediction	City B	AUC Improvement4.98	9
Passenger-side Cancellation Prediction	City C	AUC Improvement5.65	8
Semantic SLAM	City 10000 Simulation	ATE (Absolute Trajectory Error)2.9864	7
Summarization	City E	ROUGE-1 Score59.324	7
Summarization	City D	R1 Score59.68	7
Summarization	City C	R157.401	7
Summarization	City B	R1 Score53.871	7
Trajectory Prediction	City D	Average DTW31.94	5
Trajectory Prediction	City C	Average DTW20.57	5
View Synthesis	City-1M (test)	PSNR21.67	4
Human mobility prediction	City D (test)	GEO-BLEU0.3	4
Human mobility prediction	City B (test)	GEO-BLEU0.297	4
Per-patient decision agreement evaluation	City 2 diabetic nephropathy guidance policy	Agreement98.9	3
Pose Graph Optimization	City	Objective Value6.386	2
Hallucination Detection	City*	AUC ROC0.898	2

Showing 21 of 21 rows