The previous article focused on installing dbt in the Mage.ai environment or independently, followed by the initialization of a project named mage_dbt – Dbt Installation (pip/conda) and project initialization. So, we have the mage-ai environment installed, into which we have installed dbt-sqlserver. We then tested that we can see the established file structure of the… Read More »
As a business intelligence developer experimenting with ChatGPT, I explore various scenarios that could assist me in my work. These scenarios certainly include assistance in writing code (such as in Python), reverse engineering code, detailed planning of the breakdown of an epic/story/project into JIRA, or perhaps financial analysis of a company? Yes, for these scenarios,… Read More »
I mainly use SSIS (SQL Server Integration Services) as the tool for creating ETL pipelines. But in the data warehouse world, we’re shifting more from on-prem solutions to the cloud and from conservative (and expensive) platforms to alternatives. This is especially true for ETL platforms. One promising alternative is Mage.ai. Mage.ai as a ETL framework “The… Read More »
Are you preparing for an essay or presentation and want to have it quickly at your fingertips? In this article, we’ll explore how you can utilize ChatGPT to create seminar papers or presentations. We’ll also emphasize the importance of verifying the information provided by artificial intelligence. Time is moving forward, and it’s essential to use… Read More »
Automation and artificial intelligence (AI) are bringing impacts into many areas of our lives, including work. Some professions are potentially lowly affected (craftsmanship), while others, typically office work, such as accounting, are more affected. It’s a mistake to see AI as a competitor and to fear it. Those who learn to work efficiently with AI… Read More »
I have been using the KingswaySoft tool for automating ETL data flows for many years and decided to write an article about this tool. KingswaySoft brings a low-code revolution to data integration through SQL Server Integration Services (SSIS). Don’t worry, it’s not a startup, it’s a vendor that has been in the market for many… Read More »
In this short article I will introduce the possibility to run a sql script outside of SQL management studio using SQL server command line utility (sqlcmd for short). This utility allows you to work with SQL server using the command line. The use are obvious and include working with SQL from different applications. How to… Read More »
I recently purchased a new Macbook Air with Apple Silicon M1 CPU architecture (ARM). From the first time everything was fine – super experience when unboxing, everything tuned to the smallest detail, huge performance, battery lasts 8 hours on a single charge without losing performance when unplugged. But… As a Business intelligence developer and financial… Read More »
The ALTER TABLE statement, along with commands like CREATE TABLE, belongs to the category of Data Definition Language (DDL) commands. It allows us to modify the definition of a table. Changes to an SQL Server table can include: Adding a new column Deleting a column Changing the data type or definition of a column Changing… Read More »
Table Indexes are a fundamental pillar of optimizing SQL queries in a database. They significantly speed up read operations. Unfortunately, over time, indexes get fragmented, and the order of indexes deteriorates. Index fragmentation occurs because records are gradually inserted or deleted from a table, and indexes are not optimized afterward. This means that individual index… Read More »