Snowflake is a cloud platform for data storage and analysis, offering a wide range of services for working with data – data warehouse, data lake, data science, and data sharing. It was founded in 2012 and has since spread very quickly thanks to its ability to efficiently process large volumes of data, unique architecture, and… Read More »
In Dbt (data build tools), files are organized in a logical structure based on files/folder organization and configuration (dbt_project.yml). To navigate the project effectively as the codebase grows, it’s perhaps a good idea to create a system within the files. File Structure of a Dbt Project After initializing an empty Dbt project, the directory structure… Read More »
Is Dbt compatible with Snowflake? Definitely! And if you combine it with some ETL/orchestration tool like Keboola (cloud) or Mage.ai (on-premises), you’ve got yourself a decent data solution. Nowadays, most ETL frameworks (at least the better ones) integrate with dbt. Local Configuration of Dbt and Snowflake In this tutorial, we assume that dbt is installed… Read More »
Last time, we did a deeper dive into how Keboola Storage works, how applications process it, and how it stores data during a flow. Today, I’ll show you how transformations work in Keboola. We’ll create a much more complex Flow that calculates data from a source, utilizes Keboola transformation and then updates a Power BI… Read More »
In previous articles, I showed how easy it is to set up your first data flow in Keboola, and we took a closer look at the fundamental elements of Flow, which are Keboola components and their settings. If the fundamental elements of each flow are components, then one of the key components in the entire… Read More »
In Keboola, components are blocks that make up the Data Flow (pipeline). They are elements in the ETL/ELT process used to connect to data sources (source) or data destinations (destination). Components enable us to transfer data. Thanks to democratization tools like Keboola, there is no need to know how to program because Keboola components are… Read More »
In the previous part titled ETL | Keboola Free – Creating a Project, Basics, we did a basic introduction to the application. We went through the process of creating a project and also briefly explored the Keboola structure and menu. Today, I’d like to show you how easy it is to create a Keboola flow.… Read More »
In the previous article, we introduced ourselves briefly – ETL | Keboola – Introduction, Pricing, Products – An Alternative to Fivetran. We know that Keboola offers a Freemium model, so we can try this tool for free. We just have to tolerate some limitations when it comes to usage (the limit of minutes is 120).… Read More »
As part of data democratization and the transformation towards data-driven management, more and more companies are adopting solutions that support and strengthen this culture. Data is made accessible to a wide range of users for analysis and reporting in tools like Power BI. At the ETL level, through which we perform data integrations into a… Read More »
Before, it was a common practice that the management and access to corporate data for internal customers (employees from different departments) were exclusively under control of the IT department. If you wanted to request any report or data set, you had to contact IT. Then you waited for a few days until your turn came,… Read More »