Compose May 2021: New data source - Associate with Replicate task

[Abrie_M]

Good day

We're trying to test Compose 2021.5, but can't get the list of replicate tasks when setting up the Source database connection. I can do a test connection successfully and the account that is used to connect to the Replicate server has full admin permissions.

Any suggestions?

Thanx

Abrie

[TimGarrod]

The Compose request to Replicate filters out tasks based on target endpoint.
I'm assuming this is for a data lake project -
What's the compute cluster you are using with the Compose DL project?
What is the endpoint you have configured in the Replicate task ?
What version of Replicate are you running ?

[Abrie_M]

Hi Tim

Thanx for the guidance. I'll check and give feedback!

[Abrie_M]

Yes, It is a data lake project and we are running on Cloudera CDP 7.1

Running Replicate 7.0.0.652.

The replicate endpoint is Hadoop ... wondering if that is the reason. We could not get the CDP endpoint working in our environment, because HttpFS that was not supported.

[TimGarrod · Accepted solution]

I expect that is it. Compose filters the tasks based on target endpoint. So if you are using CDP in Compose - it will filter CDP only tasks when providing the list of Replicate tasks.

[Abrie_M]

OK, thanx. I will see if I can get a Replicate task going with a CDP endpoint, and work from that.

Appreciate your help and feedback!

Regards

am