...

Stop Rearranging Deck Chairs: How to Solve Legacy Debt

legacy debt

This article is about legacy debt, a type of technical debt that organisations incur naturally over time, even if they make smart decisions about their tech stack. This content is also available in audio format.   Yes, you read that correctly — this article is about legacy debt specifically, and not just technical debt in […]

If Talend Feels Sticky, Here Is Some Rubbing Alcohol

If Talend feels sticky, migrate

You have just received your Talend renewal bill, and I believe the technical term for it is frightful. It is the kind of number that has you sweating at the thought of the conversation you are going to have with stakeholders. You are no stranger to Talend’s costs — licensing fees, infrastructure maintenance, the ever-growing […]

Future-Proof Your SAP Data: The Power of Open Data Platforms

Future-proof your SAP data: The power of open data platforms

The data management landscape has evolved rapidly, leaving enterprise organisations with critical decisions to make about leveraging their data efficiently. For businesses using SAP, this decision is inevitable. At the end of 2027, mainstream maintenance for SAP’s Business Suite 7 will be discontinued, with many SAP products, such as SAP ECC and SAP Business Warehouse, […]

Symmetric and Asymmetric Encryption in Snowflake for Files in Internal Stages

symmetric and asymmetric encryption in Snowflake

External connectors like Fivetran and Matillion have become the go-to choice of a growing number of organisations when it comes to transferring data into cloud data platforms, such as Snowflake. These connectors facilitate seamless data ingestion and, if required, transformation. However, when handling sensitive information, they require deep expertise in security to eliminate risks and […]

Tag-Based Masking in Snowflake: Practical Guide with Scalable Implementation

Tag-Based Masking in Snowflake

As data continues to be a critical asset for organisations across industries, safeguarding sensitive information while enabling data access for authorised users is a constant balancing act. One effective approach to protect sensitive data is through tag-based masking in Snowflake, a method that allows organisations to control access to data based on predefined tags or […]

Cloud Sustainability

Cloud sustainability

This article on cloud sustainability is a part of a series on carbon analytics published on the Infinite Lambda Blog. Appreciating the cloud is becoming more and more like appreciating electricity. Don’t get me wrong — the cloud still has a lot of catching up to do before it can be considered equally essential. However, […]

Why Sustainability Analytics

why sustainability analytics

We all like a sunny day. Kicking back in the garden with the shades on, cool drink in hand and hopefully a liberal amount of SPF on the hottest English Summer day on record. So why, then, is reaching 1.5° global warming a problem that scientists keep harping on about? I am going to spare […]

Data Diff Validation in Blue-Green Deployments

Data diff validation in a blue green deployment: how to guide

During a blue-green deployment, there are discrepancies between environments that we need to address to ensure data integrity. This calls for an effective data diff solution that complements existing frameworks and improves the data validation process. If we can do that with zero budget, that is even better. In this article, we are going to […]

GDPR & Data Governance in Tech

GDPR & Data Governance in Tech

The increasing focus on data protection and privacy in the digital age is a response to the rapid advancements in technology and the widespread collection, processing and sharing of personal information. The General Data Protection Regulation (GDPR) is a comprehensive privacy regulation implemented by the European Union to protect the rights and privacy of individuals […]

Automated Data Masking on Snowflake Using Data Contracts

Data masking on Snowflake using data contracts

As digital data is growing exponentially, safeguarding sensitive information is more important than ever. Compliance with strict regulatory frameworks, such as the European Union’s General Data Protection Regulation (GDPR), is paramount, and data masking is a crucial technique to protect users’ personally identifiable information (PII) against data breaches and unauthorised access. Data masking is a […]

Demystifying LLMs: What AI Is Not

What AI is not: demystifying LLMs

Just a year ago, hardly anyone had heard of large language models (LLMs), the technology behind ChatGPT. Now, these models are everywhere, revolutionising the way we work and interact with machines. But with such great hype come the misconceptions: AI is not (yet?) the Swiss Army knife it tends to be depicted as. So let’s […]

Enhancing dbt Observability with Row-Level Metadata

row-level metadata for enhanced data observability on dbt Cloud

Data observability is vital in every dbt project, especially in large and complex ones with multiple concurrent executions. It enables data teams to swiftly detect issues, analyse their root causes and optimise pipelines efficiently. The most common approach to implementing monitoring in dbt is by utilising dbt artifacts. These files store essential metadata from dbt […]