Search This Blog

Data-Engineer

SQL With Python

Get link
Facebook
X
Pinterest
Email
Other Apps

November 21, 2023

https://www.youtube.com/watch?v=zrNHkRgWzTI

Sql queries using Pandas Data frames : https://www.youtube.com/watch?v=oPuVYSC_kpo

Get link
Facebook
X
Pinterest
Email
Other Apps

Comments

Azure Synapse : Working with External Tables

January 18, 2024

-- Working with external Tables External Table can be used to read and write data in Hadoop , Azure Blob Storage, Azure Data Lake. 59: Loading Data using Polybase : 62 : To be continued : Designing a Data Warehouse

Azure Synapse

November 20, 2023

Not a SQL Server or a Azure Synapse , you can make use of the Azure Synapse service. Earlier they only had the service for hosting a sql data warehouse and then they brought the service of Azure synapse. Initially while using the Azure synapse was that you can host a sql data warehouse. Over the time they have introduced many services to Azure synapse itself . Now you can host a sql database using the sql option as part of the entire Eco-system as part of the Azure synapse . But at the same time you can also make use of Apache Spark when it comes to Analyzing your data . You can bring your data much more closer for your Analytical needs by bring your "Azure Data Lake" attaching it basically to your Azure synapse workspace . You can use the tools on the right hand side which can be used for visualization. You can actually ingest your data using data injection tools on the left. -- Creating an Azure Synapse workspace : The first thing about working with Azure Synapse is creati...