Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matrices

About

We introduce algebraic machine reasoning, a new reasoning framework that is well-suited for abstract reasoning. Effectively, algebraic machine reasoning reduces the difficult process of novel problem-solving to routine algebraic computation. The fundamental algebraic objects of interest are the ideals of some suitably initialized polynomial ring. We shall explain how solving Raven's Progressive Matrices (RPMs) can be realized as computational problems in algebra, which combine various well-known algebraic subroutines that include: Computing the Gr\"obner basis of an ideal, checking for ideal containment, etc. Crucially, the additional algebraic structure satisfied by ideals allows for more operations on ideals beyond set-theoretic operations. Our algebraic machine reasoning framework is not only able to select the correct answer from a given answer set, but also able to generate the correct answer with only the question matrix given. Experiments on the I-RAVEN dataset yield an overall $93.2\%$ accuracy, which significantly outperforms the current state-of-the-art accuracy of $77.0\%$ and exceeds human performance at $84.4\%$ accuracy.

Jingyi Xu, Tushar Vaidya, Yufei Wu, Saket Chandra, Zhangsheng Lai, Kai Fong Ernest Chong• 2023

Related benchmarks

TaskDatasetResultRank
Abstract Visual ReasoningRAVEN v1 (test)
Average Accuracy92.9
22
Abstract Visual ReasoningI-RAVEN v1 (test)
Avg Accuracy93.2
11
Showing 2 of 2 rows

Other info

Code

Follow for update