This episode of Data Exposed welcomes back Saveen Reddy, a Principal PM on the Azure Data Lake team. Scott and Saveen follow up the Azure Data Lake Explained episode with a show about, as Saveen puts it, “how we’re making big data easy”. Saveen and his group focus on how to make developers productive with big data, specifically around the tooling and language aspects. On today’s show, Saveen introduces us to U-SQL optimization with Data Lake Tools for Visual Studio which is installed with the Azure SDK. U-SQL jobs provide the ability to do analytics at scale and Saveen shows how easy it is to debug and optimize for performance at scale. Saveen shows us the U-SQL job graph/execution plan that is generated from a Data Lake U-SQL script and the analysis tools that help developers understand key performance hotspots and opportunities for optimization.
For more information on Azure Data Lake visit: https://azure.microsoft.com/en-us/solutions/data-lake/