Incremental population of fact tables in a dbt model
september 29, 2025 Incremental population of fact tables in a dbt model Data Build Tool (dbt) enables the consistency and freshness of analytical data in the warehouse. However, as projects scale, a key challenge emerges — implementing incremental updates for fact tables containing large volumes of event-based data spanning extended time periods. This article explores how […]
Using dbt (data build tool) in traditional data warehouse development
september 21, 2025 Using dbt (data build tool) in traditional data warehouse development Data Build Tool (dbt) – has become an essential tool for analysts and data engineers, streamlining data transformation and management processes in modern data warehouses. By defining acyclic dependencies and automating model builds, dbt helps ensure the consistency and freshness of analytical […]
Data-driven approach: case studies from small businesses to international corporations
august 26, 2025 Data-driven approach: case studies from small businesses to international corporations Introduction: data-driven decision-making A data-driven approach means making decisions based on objective data analysis rather than relying solely on intuition. Research shows that companies that actively leverage data are three times more likely to improve the quality of their decision-making compared to […]
ODS and Data Marts in BI
august 11, 2025 ODS and Data Marts in BI What is an ODS (Operational Data Store) An Operational Data Store (ODS) is a centralised database that consolidates up-to-date data from various operational systems within a company. Data is loaded into an ODS almost in real time and is stored either without historical changes or with […]
6 common misconceptions when choosing a BI system
july 28, 2025 6 common misconceptions when choosing a BI system Selecting and implementing a BI system is not just a technical task — it’s a strategic one. Many companies approach it superficially, ultimately wasting money and ending up with a platform that no one actually uses. Here are some common misconceptions businesses rely on […]
Why a business needs a DWH and how to justify the project
july 23, 2025 Why a business needs a DWH and how to justify the project Can you measure the ROI of a data warehouse? In most companies, data is stored in a fragmented manner across different systems. Access to these systems is typically restricted by department and role. For example, financial and tax data may […]
Prompt engineering: experience in optimising LLM behaviour
june 26, 2025 Prompt engineering: experience in optimising LLM behaviour During the development of a tool for automatic database documentation generation, we encountered several challenges when working with LLMs: Excessive, irrelevant information. Presence of technical details not relevant to the user. Inconsistency with the desired structure and style. These issues negatively impacted the usefulness of […]
Using LLM to automatically generate documentation for a database
june 21, 2025 Using LLM to automatically generate documentation for a database High-quality database documentation is an essential part of a successful project. It offers a number of key benefits: Simplifies and speeds up onboarding for new developers. Facilitates faster development and reduces the risk of errors. Minimises risks related to team turnover. Increases transparency […]
Apache Superset — Frequently Asked Questions (FAQs)
may 27, 2025 Apache Superset: Frequently Asked Questions (FAQs) Frequently Asked Questions Is it possible to join/query multiple tables at once? Not in the Explore or visualisation UI. A Superset SQLAlchemy datasource can only be a single table or view. When working with multiple tables, a common solution is to materialise a table that contains […]
Big Data is no longer an experiment: businesses are expecting quick results
may 12, 2025 Big Data is no longer an experiment: businesses are expecting quick results How popular were Big Data projects last year? Demand for big data solutions continues to grow at an average rate of 30% per year. In 2024, the number of Big Data and BI projects remained consistently high. The majority of requests […]