iLearn

Although I have been aware of GitHub for quite a while but got a chance to use it as a repository in the project for storing artifacts only over the past few months.  We use GitHub as the sole cloud repo for storing SQL, Databricks, and Azure Data Factory artifacts.  Got an opportunity to set up GitHub with ADF right from scratch and all the excitement to learn more about GitHub took a back seat when I stumbled upon the following issue Problem Statement - You are an admin on a repo in GitHub and even then get a permission error while linking the ADF to GitHub Solution - After scratching my hairs and going on a searching spree on google for some days, I was able to figure out what needed to be done, however was not aware of how to implement it. Finally thanks to Microsoft for getting on a call and helping me resolve this issue. What needed to be done - Need to authorize AzureDataFactory service so that Github can communicate with it.  How it should be done -  Basically, you need to auth

  Identity Insert Without Identity Column Problem Statement -  There is a source table and a target table. The structure is almost similar. The ask is to insert data from the source table to the target table. The target table has an additional column of int type which could be used as a row identifier, however, it's not configured to have auto identity insert and you cannot redefine/recreate the target table. Solution - Used Row_Number window function by partitioning it with a constant value. Please see below Let me know if you guys can think of some other way! Fetch the schema details of a view Got a rarer requirement to list out the columns returned from a view along with its data type.  Here is the query