Posts

Granite 4.2 for Financial Reasoning: When Does Thinking Actually Help? I am working to this project right now, first content will come soon. Interesting facts to describe: 4.2 family of modles goes from MoE architecture exisitng in 4.0 back to dense architecture where generating one token uses whole model Hidden size dimentions is 2560 with 40 attention heads. So head dimension = 2560 / 40 = 64 Granite has 40 attention heads but only 8 KV heads. ...

Visualize Kafka Some of my clients work with Kafka without ever developing an intuitive feel for its dynamics. Terms such as producers, consumers, partitions, offsets, lag, and consumer groups remain abstract until something breaks. To make these mechanics easier to understand, I built a small, intentionally playful simulation around a mission-control journey to the Moon. Kafka becomes the communication system coordinating the mission, while ASCII-based graphics show messages moving through the platform in real time. The humorous theme lowers the entry barrier, but the underlying goal is practical: to help people see how Kafka behaves, not merely memorize its terminology. ...

Visualise Kafka Some of my clients work with Kafka without ever developing an intuitive feel for its dynamics. Terms such as producers, consumers, partitions, offsets, lag, and consumer groups remain abstract until something breaks. To make these mechanics easier to understand, I built a small, intentionally playful simulation around a mission-control journey to the Moon. Kafka becomes the communication system coordinating the mission, while ASCII-based graphics show messages moving through the platform in real time. The humorous theme lowers the entry barrier, but the underlying goal is practical: to help people see how Kafka behaves, not merely memorize its terminology. ...

Introduction Before jumping into retrieval, I wanted a memory layer that behaved less like a vector database and more like the way humans connect ideas. So there is this idea to rather construct a semi-graph memory layer instead of storing isolated chunks, this layer combines semantic search with explicit relationships between concepts, people, facts, etc. The result is better, richer casuality that is visible in each answer of RAG system. In this post, I’ll walk through the architecture, the design decisions, and the lessons learned while building it. ...

Introduction 2024 was a year where time series zero/few shot forecasting functioality made its way into LLM architectures: Moment, TimesFM, Chonos, Moirai, and many more showed up. Those were novel models but, computationally, heavy to use. So soon the second wave of lighter models appeared incluging Tiny Time-Mixer (TTM) architecture from IBM Research. TTM can work with just 1M parameters, it supports channel correlations and exogenous signals, and handles multivariate forecasting. Let’s dive in. ...

Introduction Many VLMs perform great on benchmarks like viusal question-answering or multi-image reasoning. Models in 2024 were predominantly trained on natural images, thus often limiting performance in other domains like visual document undestanding. Granite Vision is a 3 billion parameters model focused on entreprise use cases with visual document understanding document content extraction and working with documents. Get the Granite Vision research paper here. Architecture Granite Vision was trained on 12 trillion tokens. Dataset for it’s training is constanlty curated by Granite Team but not open sourced. It contained 13 million images and 80 milllion instructions such as: document question-answering, scene understanding key-value extraction, text grounding, layout parsing, captioning, UI understanding, code comprehension. ...

Introduction OCR on documents remains a challenging task. While printed text can often be recognized with 95% or higher accuracy, real-world documents — containing handwriting, non-standard layouts, and other irregularities — are still much harder to read accurately. There are high quality systems solving documents reading in sub-tasks: OCR, layout analysis, structure recognition, classification. Recent trend is using large vision-language models to solve whole convertion task in one shot, and giving the user opportunity to define additional specific tasks to do in the prompt. This post is about SmalDocling, a very tiny and compute-effient vision-language model doing the convertion task and the instruction task written into a prompt. The post is based on SmolDocling research paper. ...