Master Azure Databricks[

0

1

2

3

4

5

Posted on 21 Oct 02:53 | by huayting | 29 views

Learn Databricks concepts, PySpark, Spark Structure Streaming, Delta lake, Databricks SQL Analytics, REST API & CLI

What you'll learn
Azure Databricks Fundamentals
RDD & PySpark DataFrame
Spark Structure Streaming
Databricks Advance concept (Delta lake,SQL Warehouse,Security,Devops,Administration)

Description
Module 1

What is Data Pipeline

What is Azure databricks

Azure Databricks Architecture

Azure Account Setup

WorkSpace Setup

Module 2

Navigate the Workspace

Runtimes

Clusters

Notebooks

Libraries

Repos

Databricks File System (DBFS)

DBUTILS

Widgets

Workflows

Metastore - Setup external Metastore

Module 3

What is RDD

Creating RDD

RDD transformations

RDD Actions

RDD Joins

Pair RDD

Broadcast Variables

Accumulators

Convert RDD to DataFrame

Import & Read data

Create a table using the UI

Create a table in a Notebook

Module 4

Create DataFrames

Define Schema

Functions

Casting Operations

Filter Transformation

Update, Update ALL & UpdateByName

OrderBy & SortBY

GroupBy

Remove Duplicates

Window Functions

Date and Timestamp Functions

UDF (User Defined Function)

JOIN

Handle corrupt records using the badRecordsPath

File metadata column

Module 5

Read Parquet File

Read CSV Files

Read JSON Files

Read XML Files

Read Excel file

SQL databases using JDBC

Azure blob storage

Module 6

What is Spark Structure Streaming

Data Source & Sink

Rate & File Source

Kafka Source

Sink : Console, Memory, File & Custom

Build Streaming ETL

Stream ETL 1 : Setup Event Hub

Streaming ETL 2 : Event Hub Producer

Streaming ETL 3 : Integrate Event Hubs with Data Bricks

Streaming ETL 4 : Transformation

Streaming ETL 5 : Ingest into Azure Data storage

Twitter Sentiment Analysis - Introduction

Setup Twitter Developer Account

Twitter Sentiment Analysis - II

Twitter Sentiment Analysis - III

Module 7

Components in Databricks SQL

Configuring a SQL Endpoint

Creating a Table from a CSV File

Create Queries

Parameterized Query

Query Profile

Building Visualization (Table, BAR & PIE )

Building Line Chart & Counter Chart

Adding Charts to Dashboards

Defining a Query Alert

Access Control on Databricks SQL Objects

Lab: Data Object Access Control

Transfer Ownership

Access SQL Endpoint from Python

Databricks SQL CLI

Databricks SQL CLI

Who this course is for
Data Engineering Students & Developers
Bigdata Developer
Python & SQL Developer

Requirements
Basic Python Skills
Basic SQL Skills
Azure Account

https://www.udemy.com/course/master-azure-databricks/

PLEASE SUPPORT ME BY CLICK ONE OF MY LINKS IF YOU WANT BUYING OR EXTENDING YOUR ACCOUNT


https://nitroflare.com/view/668A71569DD3056/Master_Azure_Databricks.part1.rar
https://nitroflare.com/view/6A2134282AA3E7D/Master_Azure_Databricks.part2.rar
https://nitroflare.com/view/F6D5C6501943DF6/Master_Azure_Databricks.part3.rar
https://nitroflare.com/view/417BDD3C46E05E5/Master_Azure_Databricks.part4.rar
https://nitroflare.com/view/01696324BC2F1E1/Master_Azure_Databricks.part5.rar


https://rapidgator.net/file/51eaf75b217057f1f7a0fdf7d8dc7356/Master_Azure_Databricks.part1.rar.html
https://rapidgator.net/file/5ee80499e89ac848725dfee7af11ad32/Master_Azure_Databricks.part2.rar.html
https://rapidgator.net/file/fe21f7a1acfd0d8d6a359e4a738a8fa7/Master_Azure_Databricks.part3.rar.html
https://rapidgator.net/file/7b50861d5d2c8f3a20cb24b8c2b8af09/Master_Azure_Databricks.part4.rar.html
https://rapidgator.net/file/5bcb1a513f3fe2464c00ed03c711c491/Master_Azure_Databricks.part5.rar.html