From Atomic Evidence to Logical Composition: Structured Compositional Reasoning over Compound Answer Options
Abstract
A framework decomposes compound logical options into atomic judgments and uses constrained optimization to improve reasoning over AND, OR, and NEITHER/NOR operators.
Large language models often fail when answer options require combining atomic judgments under explicit logical operators, even when they judge the individual atoms correctly. We study compound options connected by AND, OR, and NEITHER/NOR, introducing a framework that decomposes each option into atomic answers and scores contrastive hypotheses about each one, so the model never sees a compound option. An operator-constrained integer linear program then composes the calibrated scores into a single prediction. We evaluate on LOGICAL-COMMONSENSEQA and introduce LOGICAL-SATA, a reading-comprehension benchmark derived from SATA-Bench. Our framework improves Macro-F1 from 48.3 to 77.0 on the human-validated LOGICAL-COMMONSENSEQA split and from 47.0 to 75.6 on LOGICAL-SATA, with the largest gains on NEITHER/NOR.
Community
This paper decomposes compound answer options connected by AND, OR, and NEITHER/NOR into atomic judgments, score each atom contrastively, and combine the calibrated evidence with an operator-constrained ILP. The framework substantially improves Macro-F1 on LOGICAL-COMMONSENSEQA and the newly introduced LOGICAL-SATA benchmark, with the largest gains on NEITHER/NOR.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Reason Popper-ly: Patching In-Context Reasoning with Inductive Logic Programming (2026)
- Implicit Reasoning Steering via Concept Chaining (2026)
- Coherence Under Commitment: Probing Generalization and Vacuous Memorization in LLM Logical Reasoning (2026)
- Benchmarking LLM Competence on Logical Inference over Probability Operators (2026)
- Gold-Guided Programmatic Distillation for Financial Reasoning over Hybrid Tables and Text (2026)
- Concretized Proposition Prompting Resolves Composition-Knowledge Dichotomy in Large Language Models (2026)
- Reference-Free Evaluation of Reasoning in Open-Ended Question Answering (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2608.12836 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper