Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Interpretable Classification via a Rule Network with Selective Logical Operators

About

We introduce the Rule Network with Selective Logical Operators (RNS), a novel neural architecture that employs \textbf{selective logical operators} to adaptively choose between AND and OR operations at each neuron during training. Unlike existing approaches that rely on fixed architectural designs with predetermined logical operations, our selective logical operators treat weight parameters as hard selectors, enabling the network to automatically discover optimal logical structures while learning rules. The core innovation lies in our \textbf{selective logical operators} implemented through specialized Logic Selection Layers (LSLs) with adaptable AND/OR neurons, a Negation Layer for input negations, and a Heterogeneous Connection Constraint (HCC) to streamline neuron connections. We demonstrate that this selective logical operator framework can be effectively optimized using adaptive gradient updates with the Straight-Through Estimator to overcome gradient vanishing challenges. Through extensive experiments on 13 datasets, RNS demonstrates superior classification performance, rule quality, and efficiency compared to 25 state-of-the-art alternatives, showcasing the power of RNS in rule learning. Code and data are available at https://anonymous.4open.science/r/RNS_-3DDD.

Bowen Wei, Ziwei Zhu• 2024

Related benchmarks

TaskDatasetResultRank
ClassificationBank
F1 Score77.62
48
ClassificationAdult
F1 Score81.24
26
Classificationchess
F1 Score81.19
26
Classificationc-4
F1 Score72.93
26
ClassificationWine
F1 Score98.8
26
Classificationdota2
F1 Score60.17
26
ClassificationFashion
F1 Score90.04
26
ClassificationOverall 13 datasets aggregate
N-Mean85.7
26
Classificationmagic
F1 Score86.68
26
ClassificationFB
F1 Score90.93
26
Showing 10 of 13 rows

Other info

Follow for update