We have seen the implementation of the Lake Database in our previous blog, and we will see that the object created using the SPARK in the Lake Database can be easily queried using the Serverless SQL Pool. This gives a benefit that the tables can be queried on the Ad-hoc basis without turning the SPARK…
The Lake Database can be expressed as Database on top of a Storage which got added to the Synapse workspace Studio in 2022 as a new feature by Microsoft. At first glance, if you read about it then it seems a database which you can create from a template that is prebuilt and exposed to the user from the variety of industries. Well, that’s true that you can just start to design your own data model on top of the Data Lake and it gives you a GUI to map the relationship between the tables you want to create on top of your Azure Storage using Database Designer.
Here I am going to demonstrate on how to take the filename using the ADF/Synapse Pipeline from the storage and store the file properties in SQL Table.
Logic app is one of the most usable Paas Service offering by MS and it can be leveraged for many day to day activities and to achieve some tricky tasks as well. Sending a customized email is one of the most asked question by business to get notified on any event which generates a trigger….
What is Polybase in Synapse Analytics?
If you have data stored in some external source and you want to read and propagate that chunk of data to your warehouse post transformation or you just want to load it using an INSERT query in any staging table after some simple joins with other tables to form a meaningful data then Polybase would be a good option.
