In this blog, we will discuss the movement of the Delta tables from one environment to another environment within a same subscription. There may be a scenario where you need to transfer Delta Table or the Lake Database from the upper environment to the lower environment and vice versa. Currently, there is no comprehensive documentation…
In our earlier blogs, we discussed the optimization of Delta tables through the use of OPTIMIZE and ZORDER commands. We have learned about their functionality and their impact on the performance of the tables. However, it is also important to consider the number of files that are invalidated when we run OPTIMIZE. As an example,…
In our last blog, we saw the workings of the Delta Table. Today, we have a topic that will help optimize our delta table. In the real time scenarios, the number of data files increases at a very high rate due to the multiple transactions performed on the table during day-to-day work. The size of…
We have seen the solution architecture of the delta lake in our Blog and how we can register a delta table in the Delta Lake. However, this blog will go around the working of the Delta table from the time you register and perform the DML operation on it. We will see internal architecture of…
