topic Re: Encryption issues in Talend Data Catalog

Encryption issues

RLagrange — Fri, 15 Nov 2024 23:56:30 GMT

Hello everyone,

I am facing issues with the export of my jobs on one of my servers, and I think this is due to the encryption system that must have changed since I have upgraded Talend Open Studio from version 7.1 to 7.3.

Indeed, if I am launching my job on my local computer, or its exported version, my output PostGreSQL database has inserted rows, but if I copy and paste the exported job on my server, I have the following error in the cmd :

C:\Windows\system32>C:

C:\Windows\system32>cd C:\Users\adminetl\Desktop\TEST_0.1\TEST\

C:\Users\adminetl\Desktop\TEST_0.1\TEST>java -Dtalend.component.manager.m2.repos

itory="C:\Users\adminetl\Desktop\TEST_0.1\TEST/../lib" -Xms256M -Xmx1024M -cp .;

../lib/routines.jar;../lib/log4j-slf4j-impl-2.12.1.jar;../lib/log4j-api-2.12.1.j

ar;../lib/log4j-core-2.12.1.jar;../lib/ojdbc7.jar;../lib/talend-oracle-timestamp

tz.jar;../lib/postgresql-42.2.9.jar;../lib/crypto-utils.jar;../lib/slf4j-api-1.7

.25.jar;../lib/dom4j-2.1.1.jar;test_0_1.jar; jobs.test_0_1.TEST --context=Defau

[FATAL] 15:52:43 jobs.test_0_1.TEST- tDBInput_1 ORA-01017: nom utilisateur/mot d

e passe non valide ; connexion refusÚe

java.sql.SQLException: ORA-01017: nom utilisateur/mot de passe non valide ; conn

exion refusÚe

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:450) ~[ojdbc

7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:392) ~[ojdbc

7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:385) ~[ojdbc

7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CTTIfun.processError(T4CTTIfun.java:938) ~[ojdbc

7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CTTIoauthenticate.processError(T4CTTIoauthentica

te.java:480) ~[ojdbc7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:655) ~[ojdbc7.jar

:12.1.0.1.0]

at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:249) ~[ojdbc7.jar:1

2.1.0.1.0]

at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.ja

va:416) ~[ojdbc7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.ja

va:825) ~[ojdbc7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:596) ~[ojdb

c7.jar:12.1.0.1.0]

at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:

715) ~[ojdbc7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:385) ~[ojd

bc7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtensio

n.java:30) ~[ojdbc7.jar:12.1.0.1.0]

at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:564) ~[ojdb

c7.jar:12.1.0.1.0]

at java.sql.DriverManager.getConnection(Unknown Source) ~[?:1.8.0_131]

at jobs.test_0_1.TEST.tDBInput_1Process(TEST.java:1169) [test_0_1.jar:?]

at jobs.test_0_1.TEST.runJobInTOS(TEST.java:2049) [test_0_1.jar:?]

at jobs.test_0_1.TEST.main(TEST.java:1863) [test_0_1.jar:?]

Exception in component tDBInput_1 (TEST)

java.sql.SQLException: ORA-01017: nom utilisateur/mot de passe non valide ; conn

exion refusée

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:450)

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:392)

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:385)

at oracle.jdbc.driver.T4CTTIfun.processError(T4CTTIfun.java:938)

at oracle.jdbc.driver.T4CTTIoauthenticate.processError(T4CTTIoauthentica

te.java:480)

at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:655)

at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:249)

at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.ja

va:416)

at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.ja

va:825)

at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:596)

at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:

715)

at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:385)

at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtensio

n.java:30)

at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:564)

at java.sql.DriverManager.getConnection(Unknown Source)

at jobs.test_0_1.TEST.tDBInput_1Process(TEST.java:1169)

at jobs.test_0_1.TEST.runJobInTOS(TEST.java:2049)

at jobs.test_0_1.TEST.main(TEST.java:1863)

The input Oracle connection is refused, but I am sure that the rights are correctly defined (it worked before). It must be the translation of the password which doesn't work.

Here is the content of my studio.keys file :

# studio encryption keys

# Tue Jul 06 14:04:22 CEST 2021

system.encryption.key.v1=ObIr3Je6QcJuxJEwErWaFWIxBzEjxIlBrtCPilSByJI\=

routine.encryption.key.v1=YBoRMn8gwD1Kt3CcowOiGeoxRbC2eNNVm7Id6vA3hrk\=

Is there a way to generate these keys in the exported job in order to give the "good" credentials as I am exporting the job on my server or any other way to "translate" the password in the exported job ?

Thank you very much for your answers.

Re: Encryption issues

Anonymous — Tue, 20 Jul 2021 06:44:30 GMT

Hello,

How are you passing your connection details? Context variables? Literals?

Best regards

Sabrina

Re: Encryption issues

RLagrange — Tue, 20 Jul 2021 07:12:46 GMT

Hello,

Thank you for your answer.

I am using a tDBConnection component for my PostGreS database, and a tDBInput for my Oracle input :

Best regards

Re: Encryption issues

Anonymous — Tue, 20 Jul 2021 08:09:19 GMT

Hello,

Set the password filed with a context variable (password type), the default value will be stored as an encrypted data. eg:

password=enc\:routine.encryption.key.v1\:5cBz7N96rJ180ZT6tHREHAPg6d1/FU75sW69/+/1NmZdRg\=\=

When you export the job bat file, uncheck the 'Item' box, it will not contain the job items. Without the the item files, others can only run the job and cannot import the job.

Re: Encryption issues

RLagrange — Tue, 20 Jul 2021 11:13:49 GMT

I still got the same error, I think I don't use the context properly :

Btw, how do I display the "items" checkbox on the building menu ? I don't have this option.

Re: Encryption issues

Anonymous — Wed, 21 Jul 2021 03:19:14 GMT

Hello,

Please have a look at this online documentation about: TalendHelpCenter: Building Jobs and select the build type as standalone job.

Best regards

Sabrina

Re: Encryption issues

RLagrange — Wed, 21 Jul 2021 08:11:37 GMT

Hello,

I checked the documentation (thank you for the link), I added the classpath jar in the build, but still I do not have the option "Items" in the building menu, and by default the job was exported as Standalone.

It it still not working with the same error.

I think the "Items" checkbox might be the solution, but I don't find online the option to enable its display on the building menu...

Best regards, and thank you for all your advices.

Rémy

Re: Encryption issues

Anonymous — Wed, 21 Jul 2021 09:32:28 GMT

Hello,

Are you able to create a new job in V 7.3.1 and export it as a standalone one to see if it works?

We are suspecting that there might be something wrong with you migration task from V 7.1 to V 7.3.

Best regards

Sabrina

Re: Encryption issues

RLagrange — Wed, 21 Jul 2021 12:02:47 GMT

Hello,

I am able to create it, and it's perfectly working if I am lauching the .bat file on my local computer.

Best regards,

Rémy

Re: Encryption issues

RLagrange — Thu, 22 Jul 2021 07:26:08 GMT

*But still not on the server dedicated to schedule the builded jobs.

Re: Encryption issues

Anonymous — Thu, 22 Jul 2021 09:12:00 GMT

Hello,

Talend Studio requires a JDK installation on your machine to execute job script. Did you install required Java environment on the server?

Best regards

Sabrina

Re: Encryption issues

RLagrange — Thu, 22 Jul 2021 11:00:05 GMT

Hello,

Absolutely, and I think this is why I have this error message :

[FATAL] 15:52:43 jobs.test_0_1.TEST- tDBInput_1 ORA-01017: nom utilisateur/mot d

e passe non valide ; connexion refusÚe

(In English, username/password incorrect ; connection refused).

Btw, all my previous jobs that has been deployed with the version 7.1 are perfectly working, so I don't think that the JDK is the issue.

Thanks again for all your suggestions.

Best regards,

Rémy

Re: Encryption issues

Anonymous — Fri, 23 Jul 2021 03:02:33 GMT

Hello,

Could you please open a jira issue under Talend DI components (TDI) project on our bugtracker? Provide an example job for R&D team to investigate it if possible? Thanks!

Best regards

Sabrina

Re: Encryption issues

RLagrange — Mon, 26 Jul 2021 07:31:42 GMT

Hello Sabrina,

Thank you for your answer. Just before I create a ticket on the bugtracker, I have a new error message when I execute the bat file on the server, as following :

C:\Users\adminetl\Desktop\FORMASOFT_1.0\FORMASOFT_1.0\FORMASOFT>java -Dtalend.co

mponent.manager.m2.repository="C:\Users\adminetl\Desktop\FORMASOFT_1.0\FORMASOFT

_1.0\FORMASOFT/../lib" -Xms1024M -Xmx8192M -cp classpath.jar; jobs.formasoft_1_0

.FORMASOFT --context=Default

java.security.InvalidKeyException: Illegal key size

at javax.crypto.Cipher.checkCryptoPerm(Cipher.java:1039)

at javax.crypto.Cipher.implInit(Cipher.java:805)

at javax.crypto.Cipher.chooseProvider(Cipher.java:864)

at javax.crypto.Cipher.init(Cipher.java:1396)

at javax.crypto.Cipher.init(Cipher.java:1327)

at org.talend.daikon.crypto.CipherSources$2.get(CipherSources.java:94)

at org.talend.daikon.crypto.CipherSources$SymmetricKeyCipherSource.encry

pt(CipherSources.java:141)

at org.talend.daikon.crypto.Encryption.encrypt(Encryption.java:52)

at routines.system.PasswordEncryptUtil.encryptPassword(PasswordEncryptUt

il.java:53)

at routines.system.ResumeUtil.convertToJsonText(ResumeUtil.java:350)

at jobs.formasoft_1_0.FORMASOFT.runJobInTOS(FORMASOFT.java:8065)

at jobs.formasoft_1_0.FORMASOFT.main(FORMASOFT.java:7878)

[FATAL] 09:24:47 jobs.formasoft_1_0.FORMASOFT- tDBInput_1 ORA-01017: nom utilisa

teur/mot de passe non valide ; connexion refusÚe

java.sql.SQLException: ORA-01017: nom utilisateur/mot de passe non valide ; conn

exion refusÚe

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:450) ~[ojdbc

7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:392) ~[ojdbc

7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:385) ~[ojdbc

7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CTTIfun.processError(T4CTTIfun.java:938) ~[ojdbc

7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CTTIoauthenticate.processError(T4CTTIoauthentica

te.java:480) ~[ojdbc7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:655) ~[ojdbc7.jar

:12.1.0.1.0]

at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:249) ~[ojdbc7.jar:1

2.1.0.1.0]

at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.ja

va:416) ~[ojdbc7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.ja

va:825) ~[ojdbc7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:596) ~[ojdb

c7.jar:12.1.0.1.0]

at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:

715) ~[ojdbc7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:385) ~[ojd

bc7.jar:12.1.0.1.0]

at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtensio

n.java:30) ~[ojdbc7.jar:12.1.0.1.0]

at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:564) ~[ojdb

c7.jar:12.1.0.1.0]

at java.sql.DriverManager.getConnection(Unknown Source) ~[?:1.8.0_131]

at jobs.formasoft_1_0.FORMASOFT.tDBInput_1Process(FORMASOFT.java:6775) [

formasoft_1_0.jar:?]

at jobs.formasoft_1_0.FORMASOFT.tDBInput_3Process(FORMASOFT.java:3551) [

formasoft_1_0.jar:?]

at jobs.formasoft_1_0.FORMASOFT.runJobInTOS(FORMASOFT.java:8120) [formas

oft_1_0.jar:?]

at jobs.formasoft_1_0.FORMASOFT.main(FORMASOFT.java:7878) [formasoft_1_0

.jar:?]

Exception in component tDBInput_1 (FORMASOFT)

java.sql.SQLException: ORA-01017: nom utilisateur/mot de passe non valide ; conn

exion refusée

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:450)

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:392)

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:385)

at oracle.jdbc.driver.T4CTTIfun.processError(T4CTTIfun.java:938)

at oracle.jdbc.driver.T4CTTIoauthenticate.processError(T4CTTIoauthentica

te.java:480)

at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:655)

at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:249)

at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.ja

va:416)

at oracle.jdbc.driver.T4CTTIoauthenticate.doOAUTH(T4CTTIoauthenticate.ja

va:825)

at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:596)

at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:

715)

at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:385)

at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtensio

n.java:30)

at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:564)

at java.sql.DriverManager.getConnection(Unknown Source)

at jobs.formasoft_1_0.FORMASOFT.tDBInput_1Process(FORMASOFT.java:6775)

at jobs.formasoft_1_0.FORMASOFT.tDBInput_3Process(FORMASOFT.java:3551)

at jobs.formasoft_1_0.FORMASOFT.runJobInTOS(FORMASOFT.java:8120)

at jobs.formasoft_1_0.FORMASOFT.main(FORMASOFT.java:7878)

It looks kinda different, the error database connexction seems explicitly due to the cipher system of the key, what do you think ?

Thanks again for your researches.

Best regards,

Rémy

Re: Encryption issues

RLagrange — Fri, 27 Aug 2021 06:44:30 GMT

Hello,

For the record, TalendForge found the solution to the issue : my jre/jdk version on the server was below the 1.8.0_161. After an update, it's now working !

Best regards.

Re: Encryption issues

Anonymous — Fri, 27 Aug 2021 07:53:50 GMT

Hello,

Great it works. Thanks for sharing the solution with us on community.

Best regards

Sabrina