Talend Administration Center MetaServlet database X to Y migration examples

TalendSolutionExpert — Fri, 09 Feb 2024 18:22:49 GMT

You can use MetaServet to migrate a Talend Administration Center database from one database to another. The examples in this article use the following conventions:

Talend Administration Center URL

http://tac721.test.fr:8080/org.talend.administrator/
DB config password: admin

MySQL

user : mysql8
password : mysqlpass
database : mysql_721
database server : mysql8.test.fr
jdbc:mysql://mysql8.test.fr:3306/mysql_721_source?useSSL=false&allowPublicKeyRetrieval=true

MSSQL2017

user : SA
password : MSSQLpass2017
database : MSSQL_721
database server : mssql2017.test.fr
jdbc:sqlserver://mssql2017.test.fr:1433;databaseName=MSSQL_721_DEST

Tomcat endorsed folder

Store all of the JDBC drivers you're using in the following folder: <Tac install>/apache-tomcat/endorsed

NOTE: Depending on the Tomcat, version you may need to store the drivers in: <Tac install>/apache-tomcat/lib. You need to restart Tomcat if you add a driver.

JDBC string and control characters

In the JDBC string (between ' (simple quote)), if there are special characters in the JDBC connection string, they must be escaped.

For example, on Linux:

'jdbc:mysql://mysql8.test.fr:3306/mysql_721?useSSL=false&allowPublicKeyRetrieval=true'

needs to be written as:

'jdbc:mysql://mysql8.test.fr:3306/mysql_721?useSSL=false\&allowPublicKeyRetrieval=true'

The behavior is similar when using a semicolon ( ; ) or other special characters.

Migration limitation

If you're migrating to MSSQL/SQLServer, the source database and destination database name must be dbo. The dbo source database needs to be the active Talend Administration Center database.

MYSQL to MYSQL

mysql> drop database mysql_721_dest;
Query OK, 12 rows affected (0.10 sec)

mysql> create database mysql_721_dest;
Query OK, 1 row affected (0.00 sec)

mysql> grant ALL PRIVILEGES on *.* to 'mysql8'@'%';
Query OK, 0 rows affected (0.01 sec)

# /opt/Talend-7.2.1/tac/apache-tomcat/webapps/org.talend.administrator/WEB-INF/classes/MetaServletCaller.sh --tac-url http://tac721.test.fr:8080/org.talend.administrator/ -v --json-params='{"actionName":"migrateDatabase","skipBackup":"true","dbConfigPassword":"admin","mode":"synchronous","sourcePasswd":"mysqlpass","sourceUrl":"'jdbc:mysql://mysql8.test.fr:3306/mysql_721?useSSL=false\&allowPublicKeyRetrieval=true'","sourceUser":"mysql8","targetPasswd":"mysqlpass","targetUrl":"'jdbc:mysql://mysql8.test.fr:3306/mysql_721_dest?useSSL=false\&allowPublicKeyRetrieval=true'","targetUser":"mysql8"}'


-> URL: http://tac721.test.fr:8080/org.talend.administrator/
-> Json parameters:

{
"actionName": "migrateDatabase",
"dbConfigPassword": "admin",
"mode": "synchronous",
"skipBackup": "true",
"sourcePasswd": "mysqlpass",
"sourceUrl": "jdbc:mysql://mysql8.test.fr:3306/mysql_721?useSSL=false&allowPublicKeyRetrieval=true",
"sourceUser": "mysql8",
"targetPasswd": "mysqlpass",
"targetUrl": "jdbc:mysql://mysql8.test.fr:3306/mysql_721_dest?useSSL=false&allowPublicKeyRetrieval=true",
"targetUser": "mysql8"
}
-> Complete request: http://tac721.test.fr:8080/org.talend.administrator//metaServlet?eyJhY3Rpb25OYW1lIjoibWlncmF0ZURhdGFiYXNlIiwic2tpcEJhY2t1cCI6InRydWUiLCJkYkNvbmZpZ1Bhc3N3b3JkIjoiYWRtaW4iLCJtb2RlIjoic3luY2hyb25vdXMiLCJzb3VyY2VQYXNzd2QiOiJteXNxbHBhc3MiLCJzb3VyY2VVcmwiOiJqZGJjOm15c3FsOi8vbXlzcWw4LnRlc3QuZnI6MzMwNi9teXNxbF83MjFfc291cmNlP3VzZVNTTD1mYWxzZSZhbGxvd1B1YmxpY0tleVJldHJpZXZhbD10cnVlIiwic291cmNlVXNlciI6Im15c3FsOCIsInRhcmdldFBhc3N3ZCI6Im15c3FscGFzcyIsInRhcmdldFVybCI6ImpkYmM6bXlzcWw6Ly9teXNxbDgudGVzdC5mcjozMzA2L215c3FsXzcyMV9kZXN0P3VzZVNTTD1mYWxzZSZhbGxvd1B1YmxpY0tleVJldHJpZXZhbD10cnVlIiwidGFyZ2V0VXNlciI6Im15c3FsOCJ9
{"executionTime":{"millis":20052,"seconds":20},"returnCode":0}

MYSQL to MSSQL

In this case, the migration limitations apply. That is, both databases are named dbo.

To create a destination db and schema:

[dbuser@mssql2017 ~]$ /opt/mssql-tools/bin/sqlcmd -S localhost -U SA -P MSSQLpass2017
1> CREATE DATABASE dbo;
2> go

# /opt/Talend-7.2.1/tac/apache-tomcat/webapps/org.talend.administrator/WEB-INF/classes/MetaServletCaller.sh --tac-url http://tac721.test.fr:8080/org.talend.administrator/ -v --json-params='{"actionName":"migrateDatabase","skipBackup":"true","dbConfigPassword":"admin","mode":"synchronous","sourcePasswd":"mysqlpass","sourceUrl":"'jdbc:mysql://mysql8.test.fr:3306/dbo?useSSL=false\&allowPublicKeyRetrieval=true'","sourceUser":"mysql8","targetPasswd":"MSSQLpass2017","targetUrl":"'jdbc:sqlserver://mssql2017.test.fr:1433;databaseName=dbo'","targetUser":"SA"}'


-> URL: http://tac721.test.fr:8080/org.talend.administrator/
-> Json parameters:
{
"actionName": "migrateDatabase",
"dbConfigPassword": "admin",
"mode": "synchronous",
"skipBackup": "true",
"sourcePasswd": "mysqlpass",
"sourceUrl": "jdbc:mysql://mysql8.test.fr:3306/dbo?useSSL=false&allowPublicKeyRetrieval=true",
"sourceUser": "mysql8",
"targetPasswd": "MSSQLpass2017",
"targetUrl": "jdbc:sqlserver://mssql2017.test.fr:1433;databaseName=dbo",
"targetUser": "SA"
}
-> Complete request: http://tac721.test.fr:8080/org.talend.administrator//metaServlet?eyJhY3Rpb25OYW1lIjoibWlncmF0ZURhdGFiYXNlIiwic2tpcEJhY2t1cCI6InRydWUiLCJkYkNvbmZpZ1Bhc3N3b3JkIjoiYWRtaW4iLCJtb2RlIjoic3luY2hyb25vdXMiLCJzb3VyY2VQYXNzd2QiOiJteXNxbHBhc3MiLCJzb3VyY2VVcmwiOiJqZGJjOm15c3FsOi8vbXlzcWw4LnRlc3QuZnI6MzMwNi9teXNxbF90ZXN0P3VzZVNTTD1mYWxzZSZhbGxvd1B1YmxpY0tleVJldHJpZXZhbD10cnVlIiwic291cmNlVXNlciI6Im15c3FsOCIsInRhcmdldFBhc3N3ZCI6Ik1TU1FMcGFzczIwMTciLCJ0YXJnZXRVcmwiOiJqZGJjOmp0ZHM6c3Fsc2VydmVyOi8vbXNzcWwyMDE3LnRlc3QuZnI6MTQzMy9teXNxbF90ZXN0IiwidGFyZ2V0VXNlciI6IlNBIn0=
{"executionTime":{"millis":20062,"seconds":20},"returnCode":0}

MSSQL to MYSQL