Brief introduction: When users migrate to the cloud, they need to migrate the Azkaban task under the cloud to the cloud. Before, the corresponding business process is created step by step by users in DataRoks. The transformation difficulty and transformation time are both cost and time. However, how to achieve a time-saving and labor-saving migration method, this paper provides the use of migration assistant to solve the problem of cloud migration on business processes, this paper simulates the Azkaban business process to enter the operation process of DataWorks, for your reference.

1. Install Azkaban and package the simple process tasks to run

1.1 Build corresponding running tasks

bar.job

bar.job

type=command

dependencies=foo

command=echo bar

foo.job

foo.job

Type =command command=echo foo package the two files as foobar.zip file

1.2. To create a project

1.3. Upload corresponding scheduling tasks

1.4. Run the corresponding scheduling task

2. Open the migration assistant in DataWorks and import the business process

2.1 Open the development interface of DataWorks, select all products, and click Operation and Maintenance Assistant

2.2 Enter Migration Assistant and click New Import Task

2.3 Select the corresponding Azkaban task and click the upload file to upload foobar.zip

2.4 After uploading, you can see the corresponding task list and view the corresponding import report

You can view the corresponding task import as the result display and the business process name that it translates to

2.5 Finally, go back to the development interface of DataWorks to view the transformed scheduling task

Summary and Note: 1. Only the master account and workspace administrator can import and export, other role members only support to view the import and export task list, no operation authority. 2. Currently supports Hive, SQOOP, Shell transformation, etc. 3. Migrate DataWorks business processes. The tasks that need to be transformed need to be changed manually, but the overall logic will not change. Compared with the reconstruction of the corresponding complex dependence relationship, both efficiency and cost are a perfect scheme. This article is the original content of Aliyun, shall not be reproduced without permission.