Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ACS

Benchmarks

Task NameDataset NameSOTA ResultTrend
ClassificationACS dataset I=[20%, 40%] (test)
pSP Fairness0.9669
20
ClassificationACS-I (synthetic)
Acc78.19
15
Analog Circuit SizingACS In-domain 8 trained tasks (train)
ACCIA Score0.94
12
Synthetic Tabular Data GenerationACS California (TravelTime) Folktables 2018
KSComp0.61
10
Synthetic Tabular Data GenerationACS California (Income) Folktables 2018
KSComp0.08
10
Optical Chemical Structure RecognitionACS 331
Exact Match Accuracy88.2
9
Molecular Structure RecognitionACS Realistic
Exact Matching Accuracy71.9
9
Behavioral Axis DetectionACS In-distribution 10 axes (test)
Refusal MC Recall97
7
Synthetic Tabular Data GenerationACS California Employment Folktables 2018
KSComp0.96
5
Synthetic Tabular Data GenerationACS California Coverage Folktables 2018
KSComp0.74
5
Strategic Label Improvement EvaluationACS Income (test)
Number of Manipulated Agents52,666
4
Population SynthesisACS South Carolina
Rejection Rate13.3
4
Counterfactual GenerationACS Public Coverage
Latency (minutes)0.91
3
Single-attribute counterfactual generationACS Public Coverage
VCR97.4
3
Counterfactual GenerationACS Public Coverage
Retained99.9
3
ClassificationACS Income
Accuracy80.9
2
Showing 16 of 16 rows