Microsoft AZURE Data Factory

It is a cloud-based data integration service that allows you to create data-driven workflows to orchestrate and automate data movement and data transformation.
With Data Factory, you can use the Azure portal to visually design and monitor your data pipelines.
It also provides the following benefits:

• It offers a code-free UI or you can use familiar SSIS tools to construct ETL/ELT pipelines.
• It allows you to hybrid data integration at global scale with built-in IR triggers and CNAPS support.
• You can lift and shift SSIS packages to Azure and run them on Azure Data Factory without changing any code.
• You can monitor all your pipelines from the central monitoring dashboard and set up alerts.

Microsoft SQL AZURE Data Factory provides a flexible platform that helps you composition tasks into distinct activity workflows within pipelines. An activity workflow defines Apache Hadoop, Hive, Pig, Spark, Machine Learning, Stored Procedure, Custom, or Copy activities that perform the actual work in the respective big data engines. All these activities are chained together by linking input and output datasets to form a directed graph (called a pipeline). The created pipelines can be scheduled or triggered by an event. After the pipeline is executed, you can monitor its progress and performance in the central monitoring dashboard. When needed, you can also set up alerts so that you will be notified immediately if any issues occur during pipeline execution. Microsoft SQL AZURE Data Factory makes it easy for you to compose ETL/ELT workflows by offering visual tools in addition to code editor for authoring pipelines.”

Data Factory, you can easily move data from on-premises to cloud, or cloud to cloud, without having to worry about the underlying infrastructure. In addition, Data Factory provides a rich set of built-in connectors and activities that can be used to construct complex pipelines. For example, you can use Data Factory to copy data from an on-premises SQL Server database to Azure Blob Storage, or process incoming messages from an Azure Service Bus queue and write the results to an Azure SQL Database. Data Factory makes it easy to get started with cloud-based data integration by providing a simple drag-and-drop interface that doesn’t require any coding. You can also use Data Factory to pipeline data from multiple sources, including both on-premises and cloud-based data stores. For example, you could use Data Factory to copy data from an on-premises SQL Server database into Azure SQL Database, and then transform and load the data into an Azure Storage account for analysis. Thanks to its flexibility and scalability, Data Factory is well suited for handling big data workloads. In addition, Data Factory enables you to monitor your pipelines and enable auditing for compliance purposes.