DataPrep 6.4.1 start fails in docker

[cimt_mk]

Hi all,

we are currently setting up a complete Talend environment in docker and we are almost done. However, at the moment I'm struggeling with the DataPrep installation. We are using 6.4.1. In the config file application.properties, I changed the value security.provider to 'tac'. This is the value our current running data prep 6.3.1 instance has. However, when I start dataprep I get the following error:

 Please find the error as text here: https://pastebin.com/d5EKrjrL

This is my application.properties file: https://pastebin.com/3RXL6dKT

The default value of security.provider was oauth, I guess it is for the use of Talend Identity and Access Management. However, I would like to use the normal TAC authentification.

Thanks!

Best regards!

[Anonymous]

Hi,

As of 6.4.1, Talend IAM is a mandatory piece of the architecture, Data Preparation cannot communicate directly to TAC anymore. So you cannot change the security provider to point to TAC directly. Note that Data Prep users are still managed in TAC's UI. See the following doc page for more details: https://help.talend.com/reader/svfONkQzuB1~g6TYZbfc3Q/ij5BHTinTeKT7wkmiwlrRw & https://help.talend.com/reader/R2jkkk~taTa9YFFcADNN6Q/7GobU5QLUzsZZGXT0q8pDg

Regards,

Gwendal

[cimt_mk]

Hi Gwendal,

thank you for your response. Well, then we need to install IAM. I have already set up a container for IAM and it's running (I can access it) but I have a very hard time configuring it correctly. The Talend installation guide for IAM is very poor and give no instructions on how to properly configure IAM. 

Can you help us with that? Our TAC is connected to LDAP for user authentification. But what are the next steps for configuring IAM? I have entered the IAM URL in TAC but I don't know how to proceed.

Thank you very much!

[Anonymous]

Hi,

Have you checked the manual installation procedure? See https://help.talend.com/reader/vuI_X~V6unFjTgNxRMPcLw/wC1xyZN9kSCRCfruACWGCw for IAM and https://help.talend.com/reader/lGdL5d6BacS8BER99BzxIg/_3gzw9IaDWvohZ2KeG62bQ for Prep.

If you still see gaps, please point them out so that we can improve the documentation.

Thank you,

Gwendal

[cimt_mk]

Hi,

yes, I have checked this documentation. However, the bigger picture is missing for me as I don't exactly know what IAM is doing within the Talend environment. 

As I said, IAM is actually already running. But I don't know what I need to configure in IAM, does it need to be connected to TAC? Do I need to configure something within IAM? 

I know that the connection between DataPrep and IAM is described in this documentation. But I'm missing the step how to connect IAM to TAC / configure IAM itself.

Edit:

Hm, for some reason my post wasn't saved. Well, here we go again 🙂 :

To see the whole post, download it here
OriginalPost.pdf

[cimt_mk]

Hi all,

I made some progress. Quick recap:

All components (DataPrep, TAC, IAM etc.) running in individual containers but on the same docker host. I have two issues now:

1. After opening the website of DataPrep, I get redirected to IAM to log in. However, it tries to redirect to a page on "localhost"like "http://localhost:9080/idp/federation?....". When I manually change the localhost to the hostname of my docker server, the redirect works and I can see the Talend IAM login page. When I enter the login credentials, I'll get the following error:

To see the whole post, download it here
OriginalPost.pdf

[Anonymous]

Adding @Donn's reply sent by private message:

To see the whole post, download it here
OriginalPost.pdf

[cimt_mk]

@gvaznunes Funny, now all posts appeared . Feel free to delete the duplicate ones . Btw. I will reach out to you next week with some feedback to the documentation. Now that I know that the feedback actually is getting heard, I'm more than glad to help improving the docs! 

I really appreciate the direct communication with the team here, this is a big pro of Talend!

[Anonymous]

Wow, that is awkward. Let's keep all the duplicated posts, it could help the Community team understand what happened.

And yes, we truly do listen - there is nothing more valuable than direct user feedback! So thanks again for your help

[cimt_mk]

I just finished the Data-Stewardship docker container and experience the exact same issue as mentioned above:

1. The redirect for login goes to "localhost" instead of the IAM URL (docker-dev-52.cgn.company.de)

2. When I fix the redirect manually I get to the login page, try to login and get the error in IAM: 

 The endpointAddress value of http://docker-dev-52.cgn.company.de:9080/oidc/idp/authorize does not match any of the passive requestor values

Now I'm really stuck, can't proceed with our installation without DataPrep and DataStewardship . Appreciate any help!