Share your thoughts, 1 month free Claude Pro on usSee more

Distribution Shift Detection on BROAD (test)

97.38Novel Classes AUC

MDSl

Updated 1mo ago

Evaluation Results

Method
MDSl 2023.08	97.38	74.75	68.98	83.29	63.41	77.56
VIM 2023.08	95.76	56.85	61.01	79.79	68.45	72.37
EBO 2023.08	95.52	59.72	65.91	83.83	71.27	75.25
ASH 2023.08	95.52	59.72	65.91	83.83	71.27	75.25
REACT 2023.08	95.47	60.71	66.03	83.67	71.79	75.53
MAX LOGITS 2023.08	95.25	59.73	66.08	83.6	71.63	75.26
ENS-F 2023.08	95.08	79.05	75.02	91.57	72.55	82.65
ENS-R 2023.08	95	80.79	76.56	92.17	74.79	83.86
ENS-V 2023.08	94.97	82.67	78.45	92.76	73.27	84.42
RELATION 2023.08	93.61	68.77	65.67	79.95	64.79	74.56
ODIN 2023.08	91.73	52.29	62.74	79.68	70.75	71.44
Da 2023.08	91.27	58.62	64.95	81.57	72.49	73.78
SHE 2023.08	90.98	72.15	67.19	82.38	60.92	74.72
GRADNORM 2023.08	90.85	65.17	72.19	85	69.59	76.56
MSP 2023.08	90.56	58.45	64.78	78.62	71.93	72.87
MDSall 2023.08	89.17	85.64	72.45	95.55	26.06	73.77
VIM 2023.08	81.55	62.91	53.26	87	49.01	66.75
ENS-R 2023.08	80.42	75.21	62.38	90.56	60.79	73.87
REACT 2023.08	79.7	61.46	54.24	89.82	63.91	69.83
ENS-V 2023.08	79.42	74.85	60.55	91.08	53.78	71.93
ENS-F 2023.08	79.16	69.32	59.89	91.59	61.41	72.27
SHE 2023.08	76.71	68.37	63.87	89.79	60.91	71.93
RELATION 2023.08	76.06	67.55	57.58	87.8	59.49	69.7
GRADNORM 2023.08	75.53	56.52	65.57	89.39	54.45	68.29
DICE 2023.08	74.45	58.76	59.43	91.38	59.97	68.8
ASH 2023.08	73.89	69.61	57.94	91.13	61.65	70.84
EBO 2023.08	73.8	59.59	57.72	91.14	61.55	68.76
MAX LOGITS 2023.08	73.67	59.62	57.65	90.87	62.79	68.92
ODIN 2023.08	73.58	54.44	61.49	88.52	64.46	68.5
MDSall 2023.08	72.66	71.49	60.89	89.42	30.01	64.89
MDSl 2023.08	72.32	68.91	55.41	75.24	38.92	62.16
Da 2023.08	67.95	61.44	55.65	87.43	67.12	67.92
MSP 2023.08	67.25	61.17	55.59	86.71	67.52	67.65
CADET Min 2023.08	66.79	62.4	55.65	87.15	56.88	65.77
MDSf 2023.08	63.52	55.04	56.18	76.52	36.81	57.61
DICE 2023.08	55.7	78.29	77.84	86.67	61.23	71.95
MDSf 2023.08	53.35	67.73	54.92	31.47	63.43	54.18
LOGITS NORM 2023.08	52.62	51.82	59.47	82.81	48.05	58.95
LOGITS NORM 2023.08	51.93	37.39	38.25	39.99	36.32	40.78
CADET Min 2023.08	20.91	67.12	59.82	79.67	54.24	56.35