Data Bricks

3 students enrolled

Introduction to DataBricks

1
Creating Azure Databricks Workload
2 min.
2
Introduction to Azure Databricks and Creating First Cluster
5 min.
3
Creating Cluster in Databricks community Edition
4 min.
4
Creating First Notebook
4 min.
5
DBFS
5 min.
6
DBFS UI
1 min.
7
Creating Documentation Cell
3 min.
8
Uploading file in DBFS
4 min.
9
Reading File from DBFS
1 min.
10
Reading File _ Creating First Data Frame
7 min.
11
End of Module 1
1 min.

Data Manipulation

1
Spark Documentation
3 min.
2
Creating PySpark DataFrame using list of Rows
3 min.
3
Creating PySpark DataFrame using explicit schema
4 min.
4
Creating PySpark DataFrame using pandas DataFrame
3 min.
5
Creating DataFrame Ex 1
9 min.
6
Creating DataFrame Ex2
3 min.
7
Creating DataFrame using PySpark Datatypes
4 min.
8
Creating DataFrame Ex3
5 min.
9
Creating DataFrame Ex4
3 min.

Transformations

1
Select
8 min.
2
withColumnRenamed
4 min.
3
withColumn
4 min.
4
Col, Lit and Concat Functions
5 min.
5
Renaming Column Names
4 min.
6
Select & withcolumn
2 min.
7
Filter
3 min.
8
Select & concat
4 min.
9
Sort
4 min.

Delta Lake

1
Introduction to Delta Lake
11 min.
2
Internals of Delta Lake
14 min.
3
Optimize in Delta Lake
3 min.
4
Time Travel in delta lake
1 min.
5
UpSert in Delta Lake
4 min.
6
Z ordering in Delta Lake
5 min.

End to End Capstone

1
E2E Capstone
16 min.
2
Azure Databricks intro
7 min.
3
Azure Intro and ADLS
8 min.
4
Big Data File Formats
4 min.
5
CSV to Delta Table
11 min.
6
Jobs in Databricks
7 min.
7
Method Using Secret Key and Service Principal
16 min.
8
Unmount
1 min.

Reader and Writer

1
Reading Json(Constructor)and Writing into Parquet
8 min.
2
Reading Json(driver)and Writing into Parquet
5 min.
3
Reading CSV with user Schema
7 min.
4
Complex Json
9 min.
5
Reading Excel
8 min.
6
Reading CSV and transforming
17 min.
7
Creating User Defined Schema
5 min.
8
Date and Time Stamp Functions
17 min.
9
Handling Null Values
11 min.
10
Views
9 min.
11
Why Create User Defined Schema
6 min.

Be the first to add a review.

Please, login to leave a review