Database maintenance
october 28, 2024 Database maintenance Database maintenance is a comprehensive task that covers the entire lifecycle of a data repository. It is a crucial process that helps prevent database degradation. This article will discuss the aspects of database maintenance that require special attention: table maintenance, index maintenance, statistics management, and fragmentation control. Indexes, fragmentation and […]
Key nuances of building a Kylin cube
october 14, 2024 Key nuances of building a Kylin cube Not long ago, our company started working with a new Apache technology stack. After several successful projects, we would like to share our development experience and some of our insights. Apache Kylin is a distributed storage system for pre-calculated and aggregated data designed for complex […]
Installing Apache SuperSet in a Kubernetes cluster on Windows OS
september 27, 2024 Installing Apache SuperSet in a Kubernetes cluster on Windows OS Kubernetes is a container orchestration platform designed for deploying and managing application containers. A Kubernetes cluster (or K8s) addresses scaling, running containers across multiple hosts, and load balancing. In our example, we will use a local single-node Kubernetes cluster based on Minikube. […]
Using SQL CLR technology to enhance the performance of MS SQL functionality
september 13, 2024 Using SQL CLR technology to enhance the performance of MS SQL functionality It is crucial to ensure the high performance of a large analytical system at all stages of operation. However, the built-in functionality of MS SQL does not always process data efficiently. For instance, when working with large data sets, it […]
Disk performance
august 25, 2024 Disk performance Disk performance is a critical factor for most modern applications and systems. It determines the speed at which data can be read from or written to the disk, which directly impacts the overall system performance. In this article, we will explore the key aspects of disk performance, testing methods, and […]
Optimising RAM usage in SQL Server
august 14, 2024 Optimising RAM usage in SQL Server Optimising the use of RAM in SQL Server is a key aspect of ensuring high database performance. Incorrect memory configuration can lead to serious performance issues that negatively impact the end-user experience. Here’s how it can manifest: Slower query response times Increased wait times Reduced overall […]
Enhancing DWH resilience through backup optimisation in SQL Server
july 27, 2024 Enhancing DWH resilience through backup optimisation in SQL Server Backup is the process of creating a duplicate copy of data on a separate medium (local or remote) to prevent the loss of original data and ensure the possibility of quickly restoring it in case of unforeseen situations, such as damage or loss […]
Automatic statistics update
july 13, 2024 Automatic statistics update SQL Server uses a query optimizer that analyses statistics to determine the most efficient execution plan for a query. Therefore, the relevance of statistics directly affects query speed. This article discusses statistics and the MS SQL Server options that allow for their automatic updating. Statistics are information about the […]
Recommendations for optimising TempDB performance
june 29, 2024 Recommendations for optimising TempDB performance When working with high-load systems, it is essential to address the optimisation of all server processes. One potential cause of performance degradation can be the suboptimal configuration of TempDB, a system database in Microsoft SQL Server. In this article, we will discuss our experience with TempDB and […]
Index Fragmentation Removal
june 27, 2024 Index fragmentation removal Index fragmentation occurs when data that is logically stored sequentially on a disk is actually stored in a random order. Any changes to the data increase fragmentation. In our practice, we encountered a case where the average index fragmentation in a client’s database exceeded 50%, which is significantly higher […]