arXiv:2611.03641v1 Announce Type: new
Abstract: Chain-of-Thought (CoT) generation has substantially improved the performance of Large Language Models (LLMs) on complex reasoning tasks, including code generation, data analysis, and exam-style question answering. Despite these advances, purely neural LLMs continue to struggle with elementary logical reasoning problems and lack the determinism, soundness, and reliability characteristic of symbolic reasoning systems. Conversely, classical symbolic methods such as SAT solving and exact cover guarantee correctness and completeness, but require problems to be expressed in highly specialized formal encodings, limiting their applicability to natural language inputs. In this work, we present a synergistic neuro-symbolic framework that bridges this gap by combining neural semantic parsing with deterministic exact cover reasoning. Given a Zebra-style logic puzzle in natural language, an LLM translates entities and constraints into structured tool calls that construct an exact cover instance. A symbolic solver then computes the solution and provides feedback to iteratively refine invalid, under- or overconstrained encodings, exploiting the uniqueness property of Zebra puzzles. We conduct a comprehensive empirical evaluation across multiple parameter scales, post-training paradigms, and LLM families. The results demonstrate that our hybrid approach consistently outperforms strong plain neural baselines, including CoT prompting, as well as recent neuro-symbolic methods.
arxiv
Neuro-Symbolic Framework Solves Zebra Puzzles via LLM Parsing and Exact Cover
This paper introduces a neuro-symbolic framework that combines LLM-based semantic parsing with deterministic exact cover solving for Zebra-style logic puzzles. The LLM converts natural language constraints into structured tool calls, and a symbolic solver provides feedback to refine encodings. Experiments across multiple model scales and families show consistent improvements over plain CoT and other neuro-symbolic baselines.
Offers a concrete hybrid approach with empirical results, addressing a known LLM weakness in logical reasoning.
Comments & Questions (0)
No comments yet
Be the first to comment!