Alkmaar     +31659380335

Data Engineering and Analytics

Tag: spark

Ingest Netherlands GDP Data to Databricks for Free

By Farnam Iranpour

If you’re working with data on Databricks and need access to Netherlands GDP information, you’re in luck! The CBS (Statistics Netherlands) offers free and easy access to this data via its Python library, cbsodata. In this blog post, we’ll walk you through the process of ingesting Netherlands GDP data into your Databricks environment effortlessly. Step-by-Step…

Load Data from Live Delta Sharing Using Python

By Farnam Iranpour

Introduction Databricks Live Delta Sharing empowers Databricks users to seamlessly share data with individuals beyond the Databricks environment. Users can generate a URL to share with recipients, granting them access to download a credential file. This streamlined process enables effortless data access across platforms like pandas, Spark, PowerBI, and more. Access Data Using Pyhton Upon…

Query Databricks Using API

By Farnam Iranpour

Introduction Are you looking to programmatically access and query data stored in Databricks? Whether you’re aiming to construct an application utilizing this data or simply share it with your colleagues, the Databricks SQL Statement Execution API offers a solution. It allows you to execute SQL statements on a SQL warehouse and retrieve the results efficiently.…

Ingest Data from MySQL into Databricks

By Farnam Iranpour

Introduction In the world of data engineering, the ability to efficiently extract and analyze data from various sources is paramount. MySQL, a popular relational database management system, stands as a cornerstone in many data ecosystems. As a data engineer, mastering the art of extracting data from MySQL databases is not just beneficial but often essential.…