Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Tab-CoT: Zero-shot Tabular Chain of Thought

About

The chain-of-though (CoT) prompting methods were successful in various natural language processing (NLP) tasks thanks to their ability to unveil the underlying complex reasoning processes. Such reasoning processes typically exhibit implicitly structured steps. Recent efforts also started investigating methods to encourage more explicitly structured reasoning procedures to be captured. In this work, we propose Tab-CoT, a novel tabular-format CoT prompting method, which allows the complex reasoning process to be explicitly modelled in a highly structured manner. Despite its simplicity, we show that our approach is capable of performing reasoning across multiple dimensions (i.e., both rows and columns). We demonstrate our approach's strong zero-shot and few-shot capabilities through extensive experiments on a range of reasoning tasks.

Ziqi Jin, Wei Lu• 2023

Related benchmarks

TaskDatasetResultRank
Table Fact VerificationTabFact (test)
Accuracy79.05
136
Table Question AnsweringWikiTQ (test)
Accuracy60.43
130
Table Fact VerificationTabFact
Accuracy0.798
104
Financial Question AnsweringFinQA (test)
Accuracy27.81
57
Table Question AnsweringWikiTQ
Accuracy60.6
29
Table Mathematical ReasoningTabMWP (test)
Accuracy92.21
15
Hierarchical Table Question AnsweringHiTab (test)
Accuracy (%)60.64
15
Showing 7 of 7 rows

Other info

Follow for update