Alkmaar     +31659380335

Data Engineering and Analytics

Month: May 2024

Handling Pagination in API Requests Using Python’s requests Library

By Farnam Iranpour

APIs are a powerful tool for accessing data and performing various operations over the web. However, when working with large datasets, it’s common to encounter pagination, where the data is split into chunks or pages. Handling pagination properly is crucial to ensure you retrieve all the data you need. In this blog post, we’ll walk…

Looking for Free and Reliable Weather Data in the Netherlands? 🤔

By Farnam Iranpour

The unpredictable weather in the Netherlands is a critical factor for many businesses. By comparing historical weather data with your sales data, you can gain valuable insights into which weather conditions favor the sale of specific products. Whether you’re managing inventory, planning marketing campaigns, or optimizing logistics, weather data can be a game-changer. But first,…

Load Data from Live Delta Sharing Using Python

By Farnam Iranpour

Introduction Databricks Live Delta Sharing empowers Databricks users to seamlessly share data with individuals beyond the Databricks environment. Users can generate a URL to share with recipients, granting them access to download a credential file. This streamlined process enables effortless data access across platforms like pandas, Spark, PowerBI, and more. Access Data Using Pyhton Upon…

Query Databricks Using API

By Farnam Iranpour

Introduction Are you looking to programmatically access and query data stored in Databricks? Whether you’re aiming to construct an application utilizing this data or simply share it with your colleagues, the Databricks SQL Statement Execution API offers a solution. It allows you to execute SQL statements on a SQL warehouse and retrieve the results efficiently.…