Sync Datamill Pipelines

Overview

The Sync Datamill Pipelines Azure DevOps Build/Release Task is a versatile task designed to synchronize various configurations and pipelines between different Dynamics 365 environments. It offers a range of features to help streamline your data migration and configuration management processes related to Kerv Digital's Datamill Pipeline records, making it a valuable addition to your DevOps pipeline.

Features

1. Configuration Group Sync: This task allows you to synchronize configuration groups between Dynamics 365 environments, ensuring consistency in your configurations.

2. Pipeline and Related Records Sync: You can easily synchronize pipelines and their related records, including tasks and stages, to maintain data integrity across different environments.

3. Customizable Pipeline Selection: You have the flexibility to choose which pipelines to sync by providing a CSV of pipeline IDs as a release variable, making it adaptable for various scenarios.

4. Cross-Platform Compatibility: The task is designed to work seamlessly on various build agents, including Windows and Linux, ensuring that it fits into your existing DevOps setup.

Code

The task is implemented in JavaScript and uses several libraries, including Azure DevOps' task libraries and the Dynamics Web API for interacting with Dynamics 365 instances. It also leverages Axios for making HTTP requests and uses agent pooling for improved performance.

The script is organized into functions for acquiring tokens for authentication, creating or updating configuration groups, and synchronizing pipelines, tasks, stages, and other related records. It provides detailed logs to help you track the synchronization process and identify any errors.

Usage

To use the Sync Datamill Pipelines task in your Azure DevOps pipeline:

1. Add the task to your pipeline by specifying it in your YAML or through the Azure DevOps visual editor.

2. Configure the required task inputs and, if needed, set the pipeline IDs CSV as a release variable.

3. Ensure that the necessary connection details for both source and destination Dynamics 365 environments are correctly provided.

4. Run your pipeline, and the task will take care of syncing the specified configurations and pipelines.

Error Handling

The script includes error handling to ensure that your pipeline can gracefully recover from any issues encountered during the synchronization process. It sets the pipeline result to "Failed" in case of any errors, allowing you to take appropriate actions.

License

This task is provided as-is under an open-source license. You are free to modify and distribute it as needed for your projects.

Support

For any questions, issues, or feature requests related to this task, you can reach out to the community or the task author.

Author: Manjunath P R

Contribution

Contributions to this task are welcome.

Version History

• Version 0.1.x: Initial private release for testing and demo. Uses service principal details.
• Version 1.0.x: Changed to use Service connection configured on ADO.