Skip to main content

Intro of the Azure DevOps setup

Microsoft FabricAn all-in-one data and analytics platform from Microsoft. Think of it as a "digital warehouse" for all your company's information. has options to integrate with GIT via Azure DevOps. You can do a couple of things with that, which works quite well, especially when you are used to do things by manual labour, by creating Data pipelines, dataflow or such items for every task that is coming onto your desk. EasyFabric is for the ones that want to generate stuff, based on input via config files.

note

Forget the Fabric Release pipelines or GIT integration that is coming with Microsoft Fabric if you want to use EasyFabric.

The deploymentThe process of "pushing a button" to make your configuration actual, working software in the cloud. pipelineAn automated "conveyor belt" that moves data from one place to another or performs a task automatically. in Azure DevOps will do the following:

Build

  • Check the yamlA simple way to write configurations. It's basically a list that computers can read easily. files for common errors before deploying
  • Generate the scripts for the objects to use for deployment

Deployment

  • Copy yaml files to the Meta LakehouseA place where you store both "raw" data (like files) and "organized" data (like tables). It combines the best of a File Cabinet and a Database.
  • Deploy notebooks to the Meta, Bronze, Silver and Gold lakehouse
  • Run a notebook that will create* the objects in the different lakehouses