Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Database

Benchmarks

Task NameDataset NameSOTA ResultTrend
Multi-Agent System PerformanceDatabase
Task Success Rate (TS)71.72
16
Private Information Retrievaldatabase 1 GB
Offline Communication Size1
15
Knowledge TracingDatabase
AUC84.22
12
Private Information Retrieval64 GiB Database
Communication Overhead per Query2.14
11
Private Information Retrieval4 GiB Database
Execution Time4.4
11
Private Information RetrievalDatabase 16GiB
Execution Time9.3
11
Multi-turn conversation performanceDatabase
Avg Performance96.3
9
Information-Theoretic Error-Detecting Private Information RetrievalDatabase of size n
Communication Complexity1
7
Private Information RetrievalDatabase with n=2^20 items (288 B size)
Online Server Latency (ms)0.087
6
Private Information RetrievalDatabase (64GiB)
Throughput (QPS)144
4
List-Decodable Byzantine Robust PIRDatabase (n=2^16, k=6, b=3, t=1, log|Fp|=10)
Worst List Size2
4
List-Decodable Byzantine Robust PIRDatabase (n=2^16, k=6, b=3, t=1, log|Fp|=7)
Worst List Size2
4
Private Membership QueryDatabase size M
Communication Complexity1
4
Private Information RetrievalDatabase n=2^18 items (288 B size)
Client Storage Overhead (KB)12
4
Private Information RetrievalDatabase with n=2^16 items (288 B size)
Client Storage (KB)6
4
Performance overhead evaluationDatabase SQLite
Performance Overhead1
4
Hint searchDatabase N=2^28 entries
Latency (ms)1.045
2
Hint searchDatabase N=2^24 entries
Latency (ms)0.268
2
Showing 18 of 18 rows