Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
May 10, 2022 8:11:13 AM
Mar 17, 2022 8:35:50 AM
This is part 2 of 4 in a series of articles with information about migrating Databricks projects from Compose for Data Lakes 6.6 (C4DL 6.6) to Qlik Compose 2021.8 (Gen2)
Different Migration Modules for customers
Module 2: Migrate Databricks projects from C4DL 6.6 to Gen2
In C4DL 6.6, we have only option to create ODS project and Gen2 we can also create HDS, you can decide now to change the project type in Gen2. Please reach out to support if you have any questions.
There are two paths for data bricks ODS project, you can choose one of the paths to finish migration:
Path 1: You can clean up storage database and replicate landing database (including underlaying files for attrep_cdc_partition). Reload replicate task and start the compose tasks as it is new project. It was covered in first demo.
Path 2: You can follow migration path, and I explained all the required steps in this document.
Here are the migration steps (Path 2) if you don’t want to reload the replicate task. You are going to completely migrate your project definition and data to Gen2.
ComposeCli.exe adjust_cfdl_project --project Suresh_Databricks_ODS --infile “C:\Program Files\Qlik\C4DL66\Suresh_Databricks_ODS_deployment_<datetime>.zip”
à C:\Program Files\Qlik\Compose\data\projects\Suresh_Databricks_ODS\deployment_package \Suresh_Databricks_ODS__<datetime>__QlikComposeDLMigration.zip
ComposeCli.exe create_cfdl_data_migration_script --project Suresh_Databricks_ODS --infile “C:\Program Files\Qlik\C4DL66\Suresh_Databricks_ODS_deployment_<datetime>.zip”
NOTE:
After migration you can check\run
also set
You can watch demo video How to Migrate Databricks ODS projects.
The information in this article is provided as-is and to be used at own discretion. Depending on tool(s) used, customization(s), and/or other factors ongoing support on the solution below may not be provided by Qlik Support.