...

Reliable GenAI for Enterprise: Scalable, Interoperable & Programmable

Generative AI has made tremendous strides in consumer-facing applications — we have all witnessed the rapid adoption of ChatGPT, Claude, and others. At enterprise level however, productionising GenAI remains a major challenge. Simple chatbot solutions quickly become outdated compared to cutting-edge features, such as voice mode in ChatGPT, and deeply integrated use cases often prove […]

Real-Time Dashboard with Tinybird

Real-time dashboard with Tinybird

Tinybird has achieved substantial increase in analytical power over ksqlDB and comparable products, due to its introduction of ClickHouse database. At Infinite Lambda, we evaluated Tinybird over some complex joins operation over 200 million of rows, and found the latency to be well within 30 seconds. Tinybird offers data lineage similar to Snowflake Dynamic Tables/ […]

Reduce Latency with Snowflake Dynamic Tables and Minimal Rewrite of Existing dbt Models

how to recuce latency with Snowflake dynamic tables and minimal changes to existing dbt models

For enterprises which already have Snowflake as the cloud data warehouse, the Snowflake dynamic tables, coupled with Native Snowflake Connector for PostgreSQL, could substantially reduce latency with minimal rewrite of existing models. In particular, dbt 1.9 has broadened the support for Snowflake dynamic tables, enabling refresh mode selection. We find the end-to-end latency of a […]

Real-Time Analytics: The New Approach You Need

Real-Time Analytics: The Latest Developments

Being able to analyse information in real-time is no longer a luxury but a necessity for enterprises that seek to maintain a competitive edge. From monitoring live dashboards to enabling rapid AI model retraining, demand for up-to-the-minute insights has surged. Meeting the technological expectations that enable real-time analytics requires a delicate balance between latency and […]

A/B testing an ML-powered learning-to-rank algorithm

A/B testing an ML-powered learn-to-rank algorithm [part 2]

Personalisation is one of the most impactful applications of machine learning. In this article, we will explore the development and A/B testing of the ML-powered learn-to-rank (LTR) algorithm we helped one of our clients to build. The solution was created for Secret Escapes, a leading members-only online travel deals company with millions of users worldwide. […]

Building an ML-powered Learning-to-Rank Algorithm

Building an ML-powered learn-to-rank algorithm [part 1]

One of the most powerful uses of machine learning technology is personalisation. In this article, we will go into detail about building an ML-powered Learning-to-Rank (LTR) algorithm for a client in the travel industry. Secret Escapes is one of the world’s leading members-only online travel brands, offering hand-picked offers to millions of users worldwide. They […]

Stop Rearranging Deck Chairs: How to Solve Legacy Debt

legacy debt

This article is about legacy debt, a type of technical debt that organisations incur naturally over time, even if they make smart decisions about their tech stack. This content is also available in audio format.   Yes, you read that correctly — this article is about legacy debt specifically, and not just technical debt in […]

If Talend Feels Sticky, Here Is Some Rubbing Alcohol

If Talend feels sticky, migrate

You have just received your Talend renewal bill, and I believe the technical term for it is frightful. It is the kind of number that has you sweating at the thought of the conversation you are going to have with stakeholders. You are no stranger to Talend’s costs — licensing fees, infrastructure maintenance, the ever-growing […]

Captain Obvious: The Cloud Is Cheaper to Run than On-Premises

Cloud is cheaper than on-premises

This article is going to show you how to make your cloud warehouse move cheaper and better with Data & AI: Fast and Slow (DAFS). This content is also available in audio format. Your browser does not support the audio element. Cloud technology has become synonymous with cost savings and efficiency. Everyone says it is, […]

Future-Proof Your SAP Data: The Power of Open Data Platforms

Future-proof your SAP data: The power of open data platforms

The data management landscape has evolved rapidly, leaving enterprise organisations with critical decisions to make about leveraging their data efficiently. For businesses using SAP, this decision is inevitable. At the end of 2027, mainstream maintenance for SAP’s Business Suite 7 will be discontinued, with many SAP products, such as SAP ECC and SAP Business Warehouse, […]

Symmetric and Asymmetric Encryption in Snowflake for Files in Internal Stages

symmetric and asymmetric encryption in Snowflake

External connectors like Fivetran and Matillion have become the go-to choice of a growing number of organisations when it comes to transferring data into cloud data platforms, such as Snowflake. These connectors facilitate seamless data ingestion and, if required, transformation. However, when handling sensitive information, they require deep expertise in security to eliminate risks and […]

Cloud Sustainability

Cloud sustainability

This article on cloud sustainability is a part of a series on carbon analytics published on the Infinite Lambda Blog. Appreciating the cloud is becoming more and more like appreciating electricity. Don’t get me wrong — the cloud still has a lot of catching up to do before it can be considered equally essential. However, […]