The Importance Of Logical Reasoning In AI

This can be the case too when requesting to see a problem solved via inductive or deductive reasoning. The generative AI might proceed to solve the problem using something else entirely, but since you requested inductive or deductive reasoning, the displayed answer will be crafted to look as if that’s how things occurred. Some argue that we don’t need to physically reverse engineer the brain to proceed ahead with devising AI reasoning strategies and approaches. The viewpoint is that it would certainly be a nice insight to know what the human mind really does, that’s for sure. Nonetheless, we can strive forward to develop AI that has the appearance of human reasoning even if the means of the AI implementation is potentially utterly afield of how the mind works.

They implemented a perceptual system for the Sony humanoid robots (Spranger et al., 2012). This study was extended by Vogt et al. from the perspective of semantical and grammatical complexity (Vogt, 2002; 2005; De Beule et al., 2006; Bleys, 2015; Matuszek, 2018). Furthermore, a model for the evolution and induction of compositional structures in a simulation environment was reported (Vogt, 2005).

PC posits that the brain predicts sensory information and updates its mental models to enhance predictability. Notably, CPC is shown to be closely related to the free-energy principle (FEP), which has gradually gained recognition as a general principle of the human brain and cognition (Friston, 2019; 2010; Clark, 2013), theoretically. The FEP, a broader concept, posits that the brain learns to predict sensory inputs and makes behavioral decisions based on these predictions, aligning with the Bayesian brain idea (Parr et al., 2022). Additionally, the CPC provides a new explanation for why large language models (LLMs) appear to possess knowledge about the world based on experience, even though they have neither sensory organs nor bodies. The total system dynamics is theorized from the perspective of predictive coding. The hypothesis draws inspiration from computational studies grounded in probabilistic generative models and language games, including the Metropolis–Hastings naming game.

Artificial Intelligence Versus the Data Engineer

At Stability AI, meanwhile, Mason managed the development of major foundational models across various fields and helped the AI company raise more than $170 million. Now he’s CTO of Unlikely AI, where he will oversee its “symbolic/algorithmic” approach. Still, the overall variance shown for the GSM-Symbolic tests was often relatively small in the grand scheme of things. OpenAI’s ChatGPT-4o, for instance, dropped from 95.2 percent accuracy on GSM8K to a still-impressive 94.9 percent on GSM-Symbolic. AlphaProof is an AI system designed to prove mathematical statements using the formal language Lean. It integrates Gemini, a pre-trained language model, with AlphaZero, a reinforcement learning algorithm renowned for mastering chess, shogi, and Go.

In neuroscience, the subject of a PC is a single agent (i.e., the brain of a person). With the emergence of symbolic communication, society has become the subject of PC via symbol emergence. A mental model in the brain corresponds to language (a symbol system) that emerges in society (Figure 1). Decentralized physical interactions and semiotic communications comprise CPC. The sensory–motor information observed by every agent participating in the system is encoded into an emergent symbol system, such as language, which is shared among the agents. Each agent physically interacts with its environment using its sensorimotor system (vertical arrows).

From a statistical perspective, prediction errors are naturally interpreted as negative log-likelihoods. For example, least-squares errors are regarded as the negative log-likelihood of normal distributions, ignoring the effects of variance parameters. Hence, minimizing the prediction errors corresponds to maximizing the marginal likelihood, which is a general criterion for training PGMs using the Bayesian approach. In PGMs, latent variables are usually inferred by model joint distributions over observations (i.e., sensory information). Considering variational inference, the inference of latent variables z corresponds to the minimization of the free energy DKL[q(z)‖p(z,o)], where o denotes observations.

An object labeled as “X” by one agent may not be recognized as “X” by another agent. The crux of symbols (including language) in the human society is that symbolic systems does not pre-exist, but they are developed and transformed over time; thereby forming the premise of the discussion on symbol emergence. Through coordination between agents, the act of labeling an object as “X” becomes shared across the group, gradually permeating the entire society. An object identified as the sign “X” by one agent may not be recognized as “X” by another. The essence of symbols, including language, in human society lies in the fact that symbolic systems are not pre-existing; rather, they evolve and transform over time, forming the basis for discussions on the emergence of symbols.

By integrating multi-modal sensorimotor information to better predict future sensations, people can form internal representations5. Even without supervision or linguistic input, humans can learn the physical properties of objects by their autonomous interaction via multi-modal sensorimotor system. For example, without any linguistic input, children can find similarities between different apples because of the similarities in color, shape, weight, hardness, and sounds made when dropped. Such information is obtained through the visual, haptic, and auditory senses. The internal representation learning process or categorization begins before learning linguistic signs, such as words (Quinn et al., 2001; Bornstein and Arterberry, 2010; Junge et al., 2018). Therefore, an internal representation system forms the basis of semiotic communication, and the argument does not exclude the effects of semiotic information provided by another agent during representation learning.

For instance, to interpret the meaning of the sign “apple,” an agent must share this sign within its society through social interactions, like semiotic communication, which includes naming the object with others. Concurrently, the agent develops a perceptual category through multi-modal interactions with the object itself. In Peircean semiotics, a symbol is a kind of sign emerging from a triadic relationship between the sign, object, and interpretant (Chandler, 2002). An SES provides a descriptive model for the complete dynamics of symbol emergence (Taniguchi et al., 2016a; Taniguchi et al., 2018 T.) and a systematic of the fundamental dynamics of symbolic communication, regardless of artificial or natural agents. The agent symbolic learning framework demonstrates superior performance across LLM benchmarks, software development, and creative writing tasks. It consistently outperforms other methods, showing significant improvements on complex benchmarks like MATH.

Perhaps you’ve used a generative AI app, such as the popular ones of ChatGPT, GPT-4o, Gemini, Bard, Claude, etc. The crux is that generative AI can take input from your text-entered prompts and produce or generate a response that seems quite fluent. This is a vast overturning of the old-time natural language processing (NLP) that used to be stilted and awkward to use, which has been shifted into a new version of NLP fluency of an at times startling or amazing caliber. With inductive reasoning, you observe particular facts or facets and then from that bottoms-up viewpoint try to arrive at a reasoned and reasonable generalization. My point is that inductive reasoning, and also deductive reasoning, are not surefire guaranteed to be right.

1 PC, FEP, and world models

The AI hype back then was all about the symbolic representation of knowledge and rules-based systems—what some nostalgically call „good old-fashioned AI“ (GOFAI) or symbolic AI. It’s hard to believe now, but billions of dollars were poured into symbolic AI with a fervor that reminds me of the generative AI hype today. The learning procedure involves a forward pass, language loss computation, back-propagation of language gradients, and gradient-based updates using symbolic optimizers. These optimizers include PromptOptimizer, ToolOptimizer, and PipelineOptimizer, each designed to update specific components of the agent system. CEO Ohad Elhelo argues that most AI models, like OpenAI’s ChatGPT, struggle when they need to take actions or rely on external tools. In contrast, Apollo integrates seamlessly with a company’s systems and APIs, eliminating the need for extensive setup.

In the case of images, this could include identifying features such as edges, shapes and objects. Psychologist Daniel Kahneman suggested that neural networks and symbolic approaches correspond to System 1 and System 2 modes of thinking and reasoning. System 1 thinking, as exemplified in neural AI, is better suited for making quick judgments, such as identifying a cat in an image. System 2 analysis, exemplified in symbolic AI, involves slower reasoning processes, such as reasoning about what a cat might be doing and how it relates to other things in the scene. I want to now bring up the topic of generative AI and large language models.

Through the interactions, the agent forms internal models and infers states. 1, variational inference is obtained by minimizing the free energy DKL[q(z)‖p(z,o,w)], suggesting a close theoretical relationship between multi-modal concept formation ChatGPT App and FEP. RAR offers comprehensive accuracy and guardrails against the hallucinations that LLMs are so prone to, grounded by the knowledge graph. He is persuing B.Tech in mechanical engineering at the Indian Institute of Technology, Kharagpur.

Integrating these AI types gives us the rapid adaptability of generative AI with the reliability of symbolic AI. To be sure, AI companies and developers are employing various strategies to reduce hallucinations in large language models. But such confabulations remain a real weakness in both how humans and large language models deal with information. Hinton points out that just as humans often reconstruct memories rather than retrieve exact details, AI models generate responses based on patterns rather than recalling specific facts.

Fast-forward to today, and we find ourselves reflecting on what was a huge swing from symbolic AI to two decades of AI being completely data-centric—an era where machine learning (particularly deep learning) became dominant. The success of deep learning can be attributed to the availability of vast amounts of data and computing power, but this led to models trained on this data being black boxes, lacking transparency and explainability. The buzz is understandable given generative AI’s impressive capabilities and potential for disruption. However, the promise of artificial general intelligence (AGI) is a distraction when it comes to the enterprise.

The notable point about this is that we need to be cautious in painting with a broad brush all generative AI apps and LLMs in terms of how well they might do on inductive reasoning. Subtleties in the algorithms, data structures, ANN, and data training could impact the inductive reasoning proclivities. Something else that they did was try to keep inductive reasoning and deductive reasoning from relying on each other. This does not somehow preclude generative AI from also or instead performing deductive reasoning.

While humans can easily recognize the images, LLMs found it extremely challenging to interpret the symbolic programs. Even the advanced GPT-4o model performed only slightly better than random guessing. This stark contrast between human and LLM performance highlights a significant gap in how machines process and understand symbolic representations of visual information compared to humans. Neuro-symbolic AI is a synergistic integration of knowledge representation (KR) and machine learning (ML) leading to improvements in scalability, efficiency, and explainability.

The startup uses structured mathematics that defines the relationship between symbols according to a concept known as “categorical deep learning.” It explained in a paper that it recently co-authored with Google DeepMind. Structured models categorize and encode and encode the underlying structure of data, which means that they can run on less computational power and rely on less overall data than large, complex unstructured models such as GPT. Traditional symbolic AI solves tasks by defining symbol-manipulating rule sets dedicated to particular jobs, such as editing lines of text in word processor software. That’s as opposed to neural networks, which try to solve tasks through statistical approximation and learning from examples. Traditional AI systems, especially those reliant on neural networks, frequently face criticism for their opaque nature—even their developers often cannot explain how the systems make decisions. Neuro-symbolic AI mitigates this black box phenomenon by combining symbolic AI’s transparent, rule-based decision-making with the pattern recognition abilities of neural networks.

The hypothesis establishes a theoretical connection between PC, FEP, and symbol emergence. You can foun additiona information about ai customer service and artificial intelligence and NLP. RAG is powerful because it can point at the areas of the document sources that it referenced, signposting the human ChatGPT so they can check the accuracy of the output. AI agents extend the functionality of LLMs by enhancing them with external tools and integrating them into systems that perform multi-step workflows.

“Formation of hierarchical object concept using hierarchical latent dirichlet allocation,” in IEEE/RSJ international conference on intelligent robots and systems (IROS), 2272–2279. 1In this paper, we consider both “symbolic communication” and “semiotic communication” depending on the context and their relationship with relevant discussions and research. This section presents an overview of previous studies on the emergence of symbol systems and language, and examines their relationship with the CPC hypothesis. The FEP explains animal perception and behavior from the perspective of minimizing free energy.

Understanding Neuro-Symbolic AI: Integrating Symbolic and Neural Approaches

Therefore, the CPC hypothesis suggests that LLMs potentially possess the capability to encode more structural information about the world and make inferences based on it than any single human can. Considering Figure 7 a deep generative model, CPC was regarded as representation learning involving multi-agent multi-modal observations. Nevertheless, the agents conducted representation learning, in which representations were not only organized inside the brain but also formed as a symbol system at the societal level.

• This can be achieved by implementing robust data governance practices, continuously auditing AI decision-making processes for bias and incorporating diverse perspectives in AI development teams to mitigate inherent biases.
• The CPC hypothesis posits that self-organization of external representations, i.e., symbol systems, can be conducted in a decentralized manner based on representation learning and semiotic communication ability of individual agents.
• On the other hand, we have AI based on neural networks, like OpenAI’s ChatGPT or Google’s Gemini.
• Okay, we’ve covered the basics of inductive and deductive reasoning in a nutshell.

If you accept the notion that inductive reasoning is more akin to sub-symbolic, and deductive reasoning is more akin to symbolic, one quietly rising belief is that we need to marry together the sub-symbolic and the symbolic. Doing so might be the juice that gets us past the presumed upcoming threshold or barrier. To break the sound barrier, as it were, we might need to focus on neuro-symbolic AI. First, they reaffirmed what we would have anticipated, namely that the generative AI apps used in this experiment were generally better at employing inductive reasoning rather than deductive reasoning.

The agent symbolic learning framework

DeepMind says it tested AlphaGeometry on 30 geometry problems at the same level of difficulty found at the International Mathematical Olympiad, a competition for top high school mathematics students. The previous state-of-the-art system, developed by the Chinese mathematician Wen-Tsün Wu in 1978, completed only 10. The following resources provide a more in-depth understanding of neuro-symbolic AI and its application for use cases of interest to Bosch. Cory is a lead research scientist at Bosch Research and Technology Center with a focus on applying knowledge representation and semantic technology to enable autonomous driving.

Similarly, spatial concept formation models have been proposed by extending the concept of multi-modal object categorization9. Recently, owing to the enormous progress in deep generative models, PGMs that exploited the flexibility of deep neural networks achieved multi-modal object category formation from raw sensory information (Suzuki et al., 2016). Thus, high and low-level internal representations (i.e., object and spatial categories and features, respectively) were formed in a bottom-up manner. This research, which was published today in the scientific journal Nature, represents a significant advance over previous AI systems, which have generally struggled with the kinds of mathematical reasoning needed to solve geometry problems. One component of the software, which DeepMind calls AlphaGeometry, is a neural network.

Generative AI has taken the tech world by storm, creating content that ranges from convincing textual narratives to stunning visual artworks. New applications such as summarizing legal contracts and emulating human voices are providing new opportunities in the market. In fact, Bloomberg Intelligence estimates that „demand for generative AI products could add about $280 billion of new software revenue, driven by specialized assistants, new infrastructure products, and copilots that accelerate coding.“ In the realm of legal precedent analysis, it could grasp underlying legal principles, make nuanced interpretations and more accurately predict outcomes.

Nakamura et al. developed an unsupervised multi-modal latent Dirichlet allocation (MLDA) learning method that enabled a robot to perform perceptual categorization in a bottom-up manner (Nakamura et al., 2009). MLDA is an extension of the latent Dirichlet allocation (LDA), which is a probabilistic generative model widely used in NLP for topic modeling (D.M. Blei and Jordan, 2003), and is a constructive model of the perceptual symbol system. The MLDA system integrates visual, auditory, and haptic information from a robot to form a variety of object categories without human intervention8. Nakamura et al. (2011b) proposed a multi-modal hierarchical Dirichlet process (MHDP) that allowed a robot to determine the number of categories. Ando et al. (2013) proposed a hierarchical model that enabled a robot to form object categories with hierarchical structures.

It relies on predetermined rules to process information and make decisions, a method exemplified by IBM’s Deep Blue 1997 chess victory over Garry Kasparov. But GOFAI falters in ambiguous scenarios or those needing contextual insight, common in legal tasks. Symbolic techniques were at the heart of the IBM Watson DeepQA system, which beat the best human at answering trivia questions in the game Jeopardy! However, this also required much human effort to organize and link all symbolic ai the facts into a symbolic reasoning system, which did not scale well to new use cases in medicine and other domains. Neuro-symbolic AI integrates several technologies to let enterprises efficiently solve complex problems and queries demanding reasoning skills despite having limited data. Dr. Jans Aasman, CEO of Franz, Inc., explains the benefits, downsides, and use cases of neuro-symbolic AI as well as how to know it’s time to consider the technology for your enterprise.

This study aims to provide a new hypothesis to explain human cognitive and social dynamics pertaining to the creation and upgrade of their shared symbol systems including language. Despite the existence of numerous philosophical, psychological, and computational theories, no general computational theory has explained the dynamics of symbol emergence systems. From the evolutionary perspective, explanations must include how the emergence of symbolic communication contributes to the environmental adaptation of humans.

The relevance of Piaget’s work, which provides an insightful analysis of cognitive development in human children, has been recognized for example in Bonsignorio (2007). Large language models (LLMs) have revolutionized the field of artificial intelligence, enabling the creation of language agents capable of autonomously solving complex tasks. The current approach involves manually decomposing tasks into LLM pipelines, with prompts and tools stacked together. This process is labor-intensive and engineering-centric, limiting the adaptability and robustness of language agents. The complexity of this manual customization makes it nearly impossible to optimize language agents on diverse datasets in a data-centric manner, hindering their versatility and applicability to new tasks or data distributions.

• For example, in computer vision, AlphaGeometry can elevate the understanding of images, enhancing object detection and spatial comprehension for more accurate machine vision.
• Getting to the “next level” of AI, as it were, Hassabis said, will instead require fundamental research breakthroughs that yield viable alternatives to today’s entrenched approaches.
• Generative AI apps similarly start with a symbolic text prompt and then process it with neural nets to deliver text or code.
• Something else that they did was try to keep inductive reasoning and deductive reasoning from relying on each other.
• Model development is the current arms race—advancements are fast and furious.

He was humble enough to honor the Denny’s Diner, where the whole thing started twenty years ago amongst a group of friends. The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. CPC provides a new explanation for why LLMs appear to possess knowledge about the world based on experience, even though they have neither sensory organs nor bodies. They compared their method against popular baselines, including prompt-engineered GPTs, plain agent frameworks, the DSpy LLM pipeline optimization framework, and an agentic framework that automatically optimizes its prompts.

AlphaGeometry’s success underscores the broader potential of neuro-symbolic AI, extending its reach beyond the realm of mathematics into domains demanding intricate logic and reasoning, such as law. Just as lawyers meticulously uncovered the truth at Hillsborough, neuro-symbolic AI can bring both rapid intuition and careful deliberation to legal tasks. IBM’s Watson exemplifies this, famously defeating chess grandmasters Garry Kasparov and Vladimir Kramnik. Chess, with its intricate rules and vast possible moves, necessitates a strategic, logic-driven approach — precisely the strength of symbolic AI. Artificial intelligence startup Symbolica AI launched today with an original approach to building generative AI models.