Awesome-Neuro-Symbolic-Learning-with-LLM

✨✨Latest Advances on Neuro-Symbolic Learning in the Era of Foundation Models.

Table of Contents

• Awesome-Neuro-Symbolic-Learning-with-LLM
• Awesome Tutorials & Workshops & Talks
• Awesome Survey
• Awesome Papers
  • Basic Neuro-Symbolic Frameworks
  • LLM for Neural-Symbolic Learning
  • Nesy for LLM Reasoning
  • Nesy for Planning
  • Nesy for the Explainable & Trustworthy
  • Application
    • Nesy for Visual Reasoning
    • Nesy for Math
    • Nesy for Agent
    • Nesy for RL
    • Nesy for Embodied AI
    • Nesy for AIGC
  • Misc
• Awesome Datasets

Awesome Tutorials & Workshops & Talks

• Summer School on Neurosymbolic Programming
• Advances in Neuro Symbolic Reasoning and Learning AAAI 2023
• Neuro-Symbolic Approaches: Large Language Models + Tool Use ACL 2023
• Neuro-Symbolic Visual Reasoning and Program Synthesis CVPR 2020
• Neuro-Symbolic Learning and Reasoning in the Era of Large Language Models Workshop in AAAI 2024
• MIT 6.S191: Neuro-Symbolic AI Talk given by David Cox [Video]
• Neuro-Symbolic Concepts for Robotic Manipulation Talk given by Jiayuan Mao [Video]
• Building General-Purpose Robots with Compositional Action Abstractions Talk given by Jiayuan Mao

Awesome Survey

• Neuro-Symbolic AI: The 3rd Wave
• Neuro-Symbolic AI and its Taxonomy: A Survey
• Neurosymbolic AI - Why, What, and How
• From Statistical Relational to Neuro-Symbolic Artificial Intelligence: a Survey
• Neuro-Symbolic Artificial Intelligence: Current Trends
• A Review on Neuro-symbolic AI Improvements to Natural Language Processing
• Neurosymbolic Programming [Slides]

Awesome Papers

Basic Neuro-Symbolic Frameworks

Title	Venue	Date	Code
DeepProbLog: Neural Probabilistic Logic Programming	NeurIPS	2018	Github
Learning Explanatory Rules from Noisy Data	Journal of Artificial Intelligence Research	2018	Github
Neural Logic Machines	ICLR	2019	Github
Bridging Machine Learning and Logical Reasoning by Abductive Learning	NeurIPS	2019	Github
SATNet: Bridging deep learning and logical reasoning using a differentiable satisfiability solver	ICML	2019	Github
The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision	ICLR	2019	Github
NeurASP: Embracing Neural Networks into Answer Set Programming	IJCAI	2020	Github
Logical Neural Networks	Arxiv	2020	Github
Ontology Reasoning with Deep Neural Networks	Artificial Intelligence	2020	-
Logic Tensor Networks	Artificial Intelligence	2022	Github
Neuro-symbolic Learning Yielding Logical Constraints	NeurIPS	2023	Github

LLM for Neural-Symbolic Learning

Title	Venue	Date	Code
Evaluating Large Language Models Trained on Code	Arxiv	2021	Github
Autoformalization with Large Language Models	NeurIPS	2022	-
MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning	Arxiv	2022	-
Symbol-LLM: Leverage Language Models for Symbolic System in Visual Human Activity Reasoning	NeurIPS	2023	Github
Large Language Models Are Neurosymbolic Reasoners	AAAI	2024	Github
AutoSAT: Automatically Optimize SAT Solvers via Large Language Models	Arxiv	2024	-
Leveraging Environment Interaction for Automated PDDL Translation and Planning with Large Language Models	NeurIPS	2024	Github
A Foundation Model for Zero-shot Logical Query Reasoning	NeurIPS	2024	-

Nesy for LLM Reasoning

Title	Venue	Date	Code
PTR: Prompt Tuning with Rules for Text Classification	Arxiv	2021	Github
A Generative-Symbolic Model for Logical Reasoning in NLU	IJCAI Workshop	2021	-
Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text	ACL	2022	Github
PAL: Program-aided Language Models	ICML	2023	Github
LLM Sandwich: NeuroSymbolic Approach to Solving Complex Reasoning Problem	ACL	2023	Github
Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning	EMNLP	2023	Github
LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Provers	EMNLP	2023	Github
Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks	TMLR	2023	Github
Faithful Logical Reasoning via Symbolic Chain-of-Thought	ACL	2023	Github
Binding Language Models in Symbolic Languages	ICLR	2023	Github
SATLM: Satisfiability-Aided Language Models Using Declarative Prompting	NeurIPS	2023	Github
StackSight: Unveiling WebAssembly through Large Language Models and Neurosymbolic Chain-of-Thought Decompilation	ICML	2024	-
Leveraging LLMs for Hypothetical Deduction in Logical Inference: A Neuro-Symbolic Approach	Arxiv	2024	-
Natural Language Embedded Programs for Hybrid Language Symbolic Reasoning	ACL	2024	Github
Prototype-then-Refine: A Neuro-Symbolic Approach for Improved Logical Reasoning with LLMs	Arxiv	2024	-
Premise Order Matters in Reasoning with Large Language Models	ICML	2024	-
LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models	EMNLP	2024	Github
Language Models can be Logical Solvers	ACL	2024	-
Abstract Meaning Representation-Based Logic-Driven Data Augmentation for Logical Reasoning	ACL	2024	Github
Learning to Reason via Program Generation, Emulation, and Search	NeurIPS	2024	Github
Learning to Reason Iteratively and Parallelly for Complex Visual Reasoning Scenarios	NeurIPS	2024	Github
Enhancing Reasoning Capabilities of LLMs via Principled Synthetic Logic Corpus	NeurIPS	2024	-
Adaptable Logical Control for Large Language Models	NeurIPS	2024	-
Rule Based Rewards for Language Model Safety	NeurIPS	2024	-
Rule Extrapolation in Language Models: A Study of Compositional Generalization on OOD Prompts	NeurIPS	2024	-
KnowGPT: Knowledge Graph based PrompTing for Large Language Models	NeurIPS	2024	-

Nesy for Planning

Title	Venue	Date	Code
Learning Rational Subgoals from Demonstrations and Instructions	AAAI	2023	Github
Neuro-Symbolic Procedural Planning with Commonsense Prompting	ICLR	2023	Github
Why Not Use Your Textbook? Knowledge-Enhanced Procedure Planning of Instructional Videos	CVPR	2024	Github
Learning Planning Abstractions from Language	ICLR	2024	-

Nesy for the Explainable & Trustworthy

Title	Venue	Date	Code
An Interpretable Neuro-Symbolic Reasoning Framework for Task-Oriented Dialogue Generation	ACL	2022	Github
Bridging the Gap: Providing Post-Hoc Symbolic Explanations for Sequential Decision-Making Problems with Inscrutable Representations	NeurIPS	2022	-
Interpretable Neural-Symbolic Concept Reasoning	ICML	2023	-

Application

Nesy for Visual Reasoning

Title	Venue	Date	Code
Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understanding	NeurIPS	2018	Github
Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering	ICML	2019	-
Visual Concept-MetaConcept Learning	NeurIPS	2019	Github
The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision	ICLR	2019	Github
Learning to Describe Scenes with Programs	ICLR	2019	-
Learning to Infer and Execute 3D Shape Programs	ICLR	2019	Github
Program-Guided Image Manipulators	ICCV	2019	-
Neuro-Symbolic Visual Reasoning: Disentangling “Visual” from “Reasoning”	ICML	2020	Github
FALCON: Fast Visual Concept Learning by Integrating Images, Linguistic descriptions, and Conceptual Relations	ICLR	2022	-
What's Left? Concept Grounding with Logic-Enhanced Foundation Models	NeurIPS	2023	Github
Visual Programming: Compositional visual reasoning without training	CVPR (Best Paper)	2023	Github
NS3D: Neuro-Symbolic Grounding of 3D Objects and Relations	CVPR	2023	Github
ViperGPT: Visual Inference via Python Execution for Reasoning	CVPR	2023	Github
Rapid Image Labeling via Neuro-Symbolic Learning	KDD	2023	Github
GENOME: Generative Neuro-Symbolic Visual Reasoning by Growing and Reusing Modules	ICLR	2024	-
Interpret Your Decision: Logical Reasoning Regularization for Generalization in Visual Classification	NeurIPS	2024	-

Nesy for Math

Title	Venue	Date	Code
A Symbolic Framework for Evaluating Mathematical Reasoning and Generalization with Transformers	ACL	2024	Github
AlphaIntegrator: Transformer Action Search for Symbolic Integration Proofs	Arxiv	2024	-
Proving Olympiad Algebraic Inequalities without Human Demonstrations	Arxiv	2024	-
Frugal LMs Trained to Invoke Symbolic Solvers Achieve Parameter-Efficient Arithmetic Reasoning	AAAI	2024	-
Neuro-Symbolic Data Generation for Math Reasoning	NeurIPS	2024	-
Autoformalize Mathematical Statements by Symbolic Equivalence and Semantic Consistency	NeurIPS	2024	Github
ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving	ICLR	2024	Github
Don't Trust: Verify -- Grounding LLM Quantitative Reasoning with Autoformalization	ICLR	2024	Github
MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning	ICLR	2024	Github

Nesy for Agent

Title	Venue	Date	Code
Symbolic Learning Enables Self-Evolving Agents	Arxiv	2024	Github

Nesy for RL

Title	Venue	Date	Code
Modular multitask reinforcement learning with policy sketches	ICML	2017	-
Programmatically interpretable reinforcement learning	ICML	2018	-
SDRL: Interpretable and Data-efficient Deep Reinforcement Learning Leveraging Symbolic Planning	AAAI	2019	-
Language as an Abstraction for Hierarchical Deep Reinforcement Learning	NeurIPS	2019
Regression Planning Networks	NeurIPS	2019	-
Synthesizing Programmatic Policies that Inductively Generalize	ICLR	2020
Neurosymbolic Reinforcement Learning with Formally Verified Exploration	NeurIPS	2020	-
Deepsynth: Program synthesis for automatic task segmentation in deep reinforcement learning	AAAI	2021	-
Neuro-Symbolic Reinforcement Learning with First-Order Logic	EMNLP	2021	-
Discovering symbolic policies with deep reinforcement learning	ICML	2021	-
Compositional Reinforcement Learning from Logical Specifications	NeurIPS	2021	-
Program Synthesis Guided Reinforcement Learning for Partially Observed Environments	NeurIPS	2021
Neurosymbolic Reinforcement Learning and Planning: A Survey	IEEE TAI	2023	-
Hierarchical Programmatic Reinforcement Learning via Learning to Compose Programs	ICML	2023	-
Robust Subtask Learning for Compositional Generalization	ICML	2023	-
Cosmos: Neurosymbolic Grounding for Compositional World Models	ICLR	2024	Github
Learning Concept-Based Causal Transition and Symbolic Reasoning for Visual Planning	ICLR	2024	Github
Skill Machines: Temporal Logic Skill Composition in Reinforcement Learning	ICLR	2024	Github

|Enhancing Human-AI Collaboration Through Logic-Guided Reasoning|ICLR|2024|-| |Neurosymbolic Grounding for Compositional World Models|ICLR|2024|Github| |End-to-End Neuro-Symbolic Reinforcement Learning with Textual Explanations
| ICML | 2024 |Github| |Interpretable end-to-end Neurosymbolic Reinforcement Learning agents|Arxiv|2024|-| |Temporal Logic Specification-Conditioned Decision Transformer for Offline Safe Reinforcement Learning|Arxiv|2024|-|

Nesy for Embodied AI

Title	Venue	Date	Code
Neural Task Programming: Learning to Generalize Across Hierarchical Tasks	ICRA	2018
Learning symbolic operators for task and motion planning	IROS	2021
PDSketch: Integrated Domain Programming, Learning, and Planning	NeurIPS	2022	Github
JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agents	Arxiv	2022	-
Learning Neuro-Symbolic Skills for Bilevel Planning	COIL	2022	Github
ProgPrompt: Generating Situated Robot Task Plans using Large Language Models	ICRA	2023	Github
Learning Neuro-symbolic Programs for Language Guided Robot Manipulation	ICRA	2023
What's Left? Concept Grounding with Logic-Enhanced Foundation Models	NeurIPS	2023	Github
Programmatically Grounded, Compositionally Generalizable Robotic Manipulation	ICLR	2023	Github
Knowledge-based Embodied Question Answering	TPAMI	2023	-
Learning Adaptive Planning Representations with Natural Language Guidance	ICLR	2024	-
Learning Reusable Manipulation Strategies	CORL	2023	-
Compositional Diffusion-Based Continuous Constraint Solvers	CORL	2023	Github
Sequential Dexterity: Chaining Dexterous Policies for Long-Horizon Manipulation	CORL	2023
RoboCook: Long-Horizon Elasto-Plastic Object Manipulation with Diverse Tools	CORL	2023
Hierarchical Planning and Learning for Robots in Stochastic Settings Using Zero-Shot Option Invention	AAAI	2024	-
Learning Neuro-Symbolic Abstractions for Robot Planning and Learning	AAAI	2024	-
Grounding Language Plans in Demonstrations through Counter-factual Perturbations	ICLR	2024	Github
VisualPredicator: Learning Abstract World Models with Neuro-Symbolic Predicates for Robot Planning	Arxiv	2024	-
A Framework for Neurosymbolic Robot Action Planning using Large Language Models	Frontiers in Neurorobotics	2024	-
Fast and Accurate Task Planning using Neuro-Symbolic Language Models and Multi-level Goal Decomposition	Arxiv	2024	-
ClevrSkills: Compositional Language and Visual Reasoning in Robotics	NeurIPS Benchmark	2024	Github

Nesy for AIGC

Misc

Title	Venue	Date	Code
Harnessing Deep Neural Networks with Logic Rules	ACL	2016	-
Neural-Symbolic Reasoning Under Open-World and Closed-World Assumptions	AAAI-MAKE	2022	-
Neuro-Symbolic Entropy Regularization	UAI	2022	Github
RuleMatch: Matching Abstract Rules for Semi-supervised Learning of Human Standard Intelligence Tests	IJCAI	2023	Github
Learning with Logical Constraints but without Shortcut Satisfaction	ICLR	2023	Github
The KANDY Benchmark: Incremental Neuro-Symbolic Learning and Reasoning with Kandinsky Patterns	Arxiv	2024	-
On the Hardness of Probabilistic Neurosymbolic Learning	ICML	2024	-
On the Independence Assumption in Neurosymbolic Learning	ICML	2024	-
Analysis for Abductive Learning and Neural-Symbolic Reasoning Shortcuts	ICML	2024	-
Convex and Bilevel Optimization for Neural-Symbolic Inference and Learning	ICML	2024	-
Bridging Neural and Symbolic Representations with Transitional Dictionary Learning	ICLR	2024	-
LogicMP: A Neuro-symbolic Approach for Encoding First-order Logic Constraints	ICLR	2024	-
Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcuts	NeurIPS	2023	-
Localized Symbolic Knowledge Distillation for Visual Commonsense Models	NeurIPS	2023	-
A-NeSI: A Scalable Approximate Method for Probabilistic Neurosymbolic Inference	NeurIPS	2023	-
Neuro-Symbolic Continual Learning:Knowledge, Reasoning Shortcuts and Concept Rehearsal	ICML	2023	Github
Out-of-Distribution Generalization by Neural-Symbolic Joint Training	AAAI	2023	Github

Awesome Datasets

• CLEVR Dataset for VQA
• GQA Dataset for VQA
• LogiCity for Abstract Urban Simulation
• LogicGame Benchmarking Rule-Based Reasoning Abilities of Large Language Models
• BabyAI
• Minecraft
• Mini-Behavior for Embodied Tasks
• CLIPort Dataset for Embodied Tasks
• ALFworld for Embodied Tasks
• VirtualHome for Embodied Tasks