Skip to content 
Informatica vs dbt: The Ultimate Comparison
After more than two decades of honourable service, Informatica PowerCenter is approaching end-of-support. During these years, on-premise, visual, point-and-click tools have also lost the battle to code-driven, cloud-native alternatives, especially in the enterprise arena. Now, enterprise AI ambitions are giving data leaders the ultimate mandate to overcome the traditional enterprise inertia, and do the jump […]
How to Scale Postgres to Kafka: Snapshotting 1.5 bn Rows Without Crashing Production
Replicating data from a critical operational PostgreSQL database into Kafka at scale is not a trivial challenge. When datasets reach billions of rows, performing a naive full snapshot can overwhelm and degrade the performance of production databases. At Infinite Lambda, we faced this challenge when replicating close to 300 tables from a Postgres database into […]
Modern Data Platform Adoption: The Human Side of Migrations
Cutting-edge data platforms open new doors to businesses, as they enable enterprise AI and inform strategic decisions. However, successful transformation takes a holistic approach to the modern data platform adoption that goes far beyond the technology itself. While many enterprises invest heavily in modern data platforms on the cloud, they often struggle to see tangible […]
Manage Fivetran Connectors with Terraform: Step-by-Step Guide
In recent years, Fivetran’s plug-and-play connectors have made data ingestion incredibly easy, helping you sync data from databases, SaaS apps, and files into your warehouse. For data teams that need speed, reliability, and minimal setup at the beginning, Fivetran is often the first choice. Engineers and analysts love it alike because it works like a […]
Infinite Lambda Wins Snowflake Rising Star Partner of the Year Award for the ASEAN Region
Having successfully delivered over 250 data and AI projects and more than 100 migrations to the Snowflake AI Data Cloud, Infinite Lambda is named Snowflake Rising Star Partner of the Year for ASEAN for 2025 The award recognises Infinite Lambda’s expertise in building advanced data and AI capabilities on the Snowflake AI Data Cloud. An […]
Data platform migration beyond the tech stack: Patties Food Group
Data teams often find themselves balancing business needs against budget constraints and limited headcount, not to mention the increasing pressures to catch up with ever-changing technologies. If you have a three-person data team that maintains hundreds of tables & serves thousands of reports for internal and external stakeholders, the challenge multiplies with a tech stack […]
Implementing Model Context Protocol Server with the mcp-fivetran Package
Model Context Protocol (MCP) is an open protocol that standardises how applications provide context to Large Language Models (LLMs). This is particularly useful for LLM Reasoning & Acting (ReAct) use cases and in building agentic workflows. Fivetran, the industry leader in data movement, powers real-time analytics, database replication, AI workflows, and cloud migrations for thousands […]
Meet the dbt Fusion Engine: a game-changer in data transformation
In January 2025, dbt Labs announced the acquisition of SDF Labs, a company known for its deep expertise in advanced SQL parsing and execution. This was a major leap forward for the analytics engineering community. This technology now powers the new dbt Fusion engine, which represents the most substantial upgrade to dbt Core’s internals since […]
DSPy Prompt Automation, Evaluation, and Optimisation: Building a Financial Adviser
DSPy stands for Declarative Self-improving Python. Moving away from brittle prompts, you can now write compositional Python code and use DSPy to teach your Large Language Model (LLM) to deliver high-quality output. Approaches like Chain of Thought (CoT) and Reasoning and Acting (ReAct) are powerful, but they still rely on carefully constructed examples and prompts. […]
MCP vs Workflow Automation vs LLM-specific function calling for Enterprise
Model Context Protocol (MCP) is an open protocol that standardises how applications provide context to LLMs. You can think of MCP like a USB-C port for AI applications. With the success of GenAI in the consumer space, there is no shortage of tools and adapters to connect to AI applications. Generally, there are three types […]
From R Scripts to Azure Magic: How to Hack Azure Data Factory to Run R
Picture this: You have got a stack of R scripts — perfect little data-crunching, web-scraping gems — and a client who is adamant they need to run inside Azure Data Factory. One problem: ADF does not speak R. What do you do? In this article, I will let you in on how to run R […]
Performance Impact of PostgreSQL Triggers
First things first, what are PostgreSQL triggers? PostgreSQL triggers are special functions that automatically execute in response to specific database events, such as inserts, updates, or deletes, on a table (or on materialised views with some limitations). Think of them as built-in listeners: when something changes in your data, a trigger can step in and […]