Home

Inner Join using Pyspark Databricks

Creating an inner join in PySpark within a Databricks environment is a straightforward process. Below is a step-by-step guide to creating an inner join using PySpark, including the setup of the Databricks notebook and the script itself. Step 1: Set…

Mastering the WHERE Clause in SQL (or Spark SQL)

Recap In our last blog, we explored data analysis in Databricks. Today, we’re diving deep into one of the fundamental aspects of SQL (or Spark SQL) queries – the WHERE clause. Let’s explore its power and versatility! Understanding the WHERE…

How to register for Databricks Community Edition

In this post we will see how we can register for Databricks community Edition. To register for Databricks community Edition open link for Databricks registration page. In registration page fill all required details and click continue. You will be…

Read Excel files in DataBricks Spark Sql

We can use read different types of data files in the DataBricks. Thanks to it’s capability and available libraries which makes easier to read different types of data files. In this tutorial we will see how we can read excel…