In this guide, we will take a look at the features that Mage.ai offers for data analysis. While this tool is primarily used for ETL pipelines, it also includes features for exploratory analysis, data statistics, and charts. With these features, you can perform initial data analysis within the tool. Mage offers a wide range of… Read More »
In this guide, we will take a look at how to configure the io_config.yaml file in Mage.ai. We will also explore how to hide and encrypt access passwords so that they are not readily available in this configuration file. Mage.ai io_config.yaml Configuration and Location The io_config.yaml file is the main configuration file for setting up… Read More »
This article will be related to troubleshooting. Today, I managed somehow to write a comment that caused the entire Mage.ai instance to crash due to a UnicodeDecodeError. How did I manage to do that? Mage.ai UnicodeDecodeError: ‘charmap’ codec can’t decode byte Mage.ai failed to decode a specific character “ň,” which is specific to the Czech… Read More »
In the previous article – ETL | Mage.ai – Solid Alternative to Airflow – Intro and Installation we introduced the ETL tool Mage.ai as a lighter alternative to Apache Airflow. We demonstrated how to get the framework up and running through the terminal and learned that after installation, it runs on localhost:6790/. I promised in… Read More »
In a recent article dedicated to introducing Mage.ai – a tool for creating and managing ETL processes, I promised at the end that we would try to create a Mage.ai pipeline in the next article. If you are not familiar with this ETL framework, I recommend going through the introductory article. Source and Destination Databases… Read More »
BCP is a utility that is installed by default with SQL Server editions and is used for bulk import or export of a large volume of data in user-defined formats. This utility is optimized for large data transfers either between SQL Server instances or between a SQL instance and a text file. The utility is… Read More »
Table and index compression is a functionality that has been available in various SQL Server editions for a while. It has been available in all editions, including SQL Server Express (for free), since version SQL Server 2016. Data compression allows you to save storage space significantly. This, of course, saves enterprise resources, such as hardware… Read More »
In previous articles, I have published several tutorials on Reporting Services (you can find them in the reporting services – SSRS category). These tutorials provide detailed guidance on creating a basic report using SSRS, applying parameters and filters to limit report output, and similar topics. Designing more advanced and visually appealing reports requires additional experience… Read More »
Data masking is a feature that allows you to completely or partially mask selected data in a database. Access to unmask the data can also be granted or revoked for individual users. Data masking and anonymization have become increasingly important topics, especially with the introduction of GDPR regulations by the European Commission, which require greater… Read More »
Lately, I’ve been dedicating a lot of time to financial mathematics in Excel. I’ll try to leverage that and shift the focus from Excel to SQL Server. Perhaps someone is considering creating an application for amortization calculator schedule where you can input parameters, and it will generate results for you in a table. The result… Read More »