Azure Data Factory July 2024
-
01 Azure Data Engineering Part 01 July 26th 2024 (65:04)
-
02 Azure Data Engineering Demo Part 02 - July 27 2024 (81:39)
-
03 Azure Data Engineering Demo - Aug 05th 2024 (63:02)
-
04 ADF - Create Azure Free Subscription (54:46)
-
05 ADF - Region, Resource Group, Create Data Factory, Data Lake and BLOB (58:20)
-
06 ADF - Create Stoareg Accounts BLOB and Data Lake (53:27)
-
07 ADF - Access Keys, SAS Token and Access Control IAM (50:57)
-
08 ADF - Data Storage, File Shares, Queues and Tables (71:05)
-
09 ADF - Create First Pipeline (61:39)
-
10 ADF - Dynamic Pipelines using Parameters (1) (60:17)
-
11 ADF - Adding Time Stamp and Pipeline Level Parameter (58:29)
-
12 ADF - Key Vaults and Secrets (55:05)
-
13 ADF - Demo on Dynamic Linked Service.mp4 (52:04)
-
14 ADF - Activities and Intro to Big Data, Spark and Cluster (80:42)
-
15 ADF - Data Warehouse, Big Data, Apache Spark and Cluster (71:35)
-
16 ADF - What is Spark and Load the Data If File Exists (63:40)
-
17 ADF - Load Last 24Hrs Modified Files using For Each Loop (55:31)
-
18 ADF - Rest API (26:41)
-
19 ADF - Azure SQL. (54:00)
-
20 ADF - Load Data From Azure SQL to Data Lake Dynamically (55:34)
-
21 ADF - Load Data From Azure SQL to Data Lake Dynamically Assignment (26:02)
-
22 ADF - Load Data From Multiple Excel Files and Sheets to Azure SQL. (60:40)
-
23 ADF - Load Data Lake to Azure SQL using ForEachLoop. (53:26)
-
24 ADF - Self Hosted Integration Runtime. (49:39)
-
25 ADF - On Prem SQL To Azure SQL Demo and Assignment. (17:32)
-
26 ADF - CICD Part1. (41:09)
-
27 ADF - CICD Part2. (43:29)
-
28 ADF - Triggers Part1. (39:47)
-
29 ADF - Triggers Part2 Tumbling Windows Triggers. (37:00)
-
30 ADF - Triggers Part3 Tumbling Windows Triggers. (52:07)
-
31 ADF - Incr Data Loading (37:13)
-
32.ADF- INCR loading using SCD. (43:31)
-
33 ADF - Incr Data Loading Using Merge SQL. (48:30)
-
34 ADF - Incr Loading using CDD and Copy Data Upsert Demo. (44:00)
-
34 ADF - Incr Loading using CDD and Copy Data Upsert Demo. (44:00)
-
35 ADF - Incr Loading Demo using Watermark or Timestamp. (82:29)
-
36 ADF - Data Flow Transformations. (35:25)
-
37 ADF - Fail, Script Task, Logging. (62:37)
-
38 ADF - Assignment Incr Loading. (36:40)
-
ADF Project PDF.
-
Interview Questions
-
Resume 1
-
Resume-2
DWH
-
01 DWH - Intro. (49:52)
-
02 DWH - Top Down vs Bottm Up Approach. (44:53)
-
03 DWH - ODS Vs DWH. (43:28)
-
04 DWH - Convert OLTP Data to OLAP Data. (43:15)
-
05 DWH - Intro to Dim Modeling. (56:13)
-
06 DWH - Designing DWH (57:03)
-
07 DWH - Normalization Vs De-Normalization and Designing DWH (57:03)
-
08 DWH - Schemas. (52:28)
-
09 DWH - Load Data to DWH (72:37)
-
10 DWH - Dims and Facts (17:18)
-
11 DWH - Types of Dimensions. (61:25)
-
12 DWH - Types of Dimensions SCD and Inferred Dim. (54:04)
-
13 DWH - Types of Facts. (51:03)
-
Amazon Project Scripts
