Alkmaar     +31659380335

Data Engineering and Analytics

Tag: mysql

Home » mysql
Jan 12 2025

Dynamically Calculating Yesterday’s Date

By Farnam Iranpour

Streamlining ETL Pipelines: Dynamically Calculating Yesterday’s Date As a data engineer, one of the most common tasks is building ETL pipelines that process data from the previous day. While it may seem simple to manually enter a date before running the pipeline, this approach is both inefficient and error-prone. A small mistake, such as entering…

Apr 28 2024

Ingest Data from MySQL into Databricks

By Farnam Iranpour

Introduction In the world of data engineering, the ability to efficiently extract and analyze data from various sources is paramount. MySQL, a popular relational database management system, stands as a cornerstone in many data ecosystems. As a data engineer, mastering the art of extracting data from MySQL databases is not just beneficial but often essential.…