Apache Kylin distributed analytics data store
july 09, 2023 Apache Kylin distributed analytics data store Analysts have to group and merge data frequently. These operations in relational databases are resource-intensive. Operational analytical processing (OLAP) is a technology that organizes large commercial databases and supports complex analysis. It can be used to perform complex analytic queries without negatively impacting transactional systems. OLAP […]
Loading data from external file sources with gpfdist
june 30, 2023 Loading data from external file sources with gpfdist Greenplum provides extensive functionality for working with data in external sources, and the source, volume and purpose of use must be taken into account when choosing how to access the data. To download large amounts of data from files located on remote hosts, the […]
Apache Sqoop — installation and configuration
june 23, 2023 Apache Sqoop — installation and configuration Analysts often have to group and merge data. These operations in relational databases are resource-intensive. Operational analytical processing (OLAP) is a technology that organizes large commercial databases and supports complex analysis. It can be used to perform complex analytical queries without negatively impacting transaction systems. OLAP […]
Greenplum’s best practices
june 16, 2023 Best practices for schema design, query debugging and database support in Greenplum Best practices are a collection of methods and approaches that have been shown to be superior to alternatives as a result of their use. It is an amalgamation of knowledge and experience that allows the product to be used correctly […]
Uploading XML files to Greenplum
june 08, 2023 Uploading XML files to Greenplum This article will describe the approach to loading xml-files into Greenplum. The task was to develop a data warehouse in Greenplum and to load fact and reference data directly from xml-files, since the data were provided in xml-files. Many people store data in xml files, so the […]
Creating users with limited privileges in Apache Superset
june 01, 2023 Creating users with limited privileges in Apache Superset. Developing analytical systems with regard to end users implies the absence of unnecessary information unrelated to the final product. In Apache Superset, this is achieved through the creation of role-based models. The platform comes with a standard set of roles: — Admin: administrators who […]
Configuring Kylin (Spark) Components
may 25, 2023 Configuring Kylin (Spark) Components Not so long ago our company started to master the new Apache technology stack. After several successful projects we want to share our development experience and some features. After deploying the Apache Kylin docker image from the developers (apachekylin/apache-kylin-standalone:4.0.0), working with analytics solutions, encountered the problem of resource […]
Deploying Kylin cubes from the script
may 18, 2023 Deploying Kylin cubes from the script Recently, open-source software has been gaining in popularity and active use. Our company has followed the main trend and started to master the new Apache technology stack. After several successful projects we want to share our development experience and some features. The metadata of analytics solutions […]
Kylin cube segment processing automation via NiFi
may 11, 2023 Kylin cube segment processing automation via NiFi Recently, open-source software has been gaining in popularity and active use. Our company has followed the main trend and started to master the new Apache technology stack. After several successful projects we want to share our development experience and some features. Developing an analytics solution […]
Configuring the local Kylin cache to optimize query execution time
may 5, 2023 Configuring the local Kylin cache to optimize query execution time Open source technologies have become more and more popular and widely used lately. Our company is not an exception and began to master the new Apache technology stack. After several successful projects we would like to share our development experience and some […]