Parroting Patterns: The Stochastic Nature of AI

This post delves into the statistical heart beating within LLMs and contrasts it with deterministic systems in AI.

Mind the Gap: The Intelligence Dilemma in AI

This post seeks to explore various definitions of intelligence, assess how LLMs fare against these definitions, and highlight a notable limitation in logical inference exhibited by these models.

Navigating the Maze: Unpacking the Operations of LLMs

This post delves into the mechanics of how LLMs navigate this maze to process and generate text, with a spotlight on the attention mechanism that plays a pivotal role in handling context.