Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Forward-Only Convolutional Neural Networks with Learnable Channel-Class Assignment

About

The Forward-Forward (FF) algorithm offers a biologically inspired alternative to backpropagation by replacing gradient-based credit assignment with local, forward-only objectives. While recent extensions have adapted FF to convolutional neural networks (CNNs), existing formulations rely on static channel-class partitions and struggle to perform effectively in complex tasks. In this work, we introduce a learnable channel-class assignment mechanism that enables adaptive, data-driven specialization of convolutional channels, supported by entropy and orthogonality regularization to promote learning performance. We further propose a loss-aware layer contribution strategy that adaptively weights intermediate-layer predictions based on their validation performance, enhancing the effectiveness of forward-only inference. Integrated into residual CNNs, the proposed method achieves consistently superior performance across CIFAR-10, CIFAR-100, and Tiny-ImageNet compared to existing similar forward-only methods. Notably, it establishes new state-of-the-art performance among FF-based models, substantially narrowing the gap with backpropagation. These findings demonstrate that introducing learnable channel specialization and layer contribution weighting significantly enhances the representational capacity of forward-only learning in deep CNNs.

Mohammadnavid Ghader, Saeed Reza Kheradpisheh, Bahar Farahani, Mahmood Fazlali• 2026

Related benchmarks

TaskDatasetResultRank
Image ClassificationMNIST (test)
Accuracy99.74
654
Image ClassificationFashionMNIST (test)
Accuracy94.55
461
Image ClassificationTiny-ImageNet
Accuracy (%)49.87
134
Showing 3 of 3 rows

Other info

Follow for update