Build a job with maven and talend P2 to deploy it on TMC

[idir]

Hello

I try to build and deploy un talend job dowloanded from a git repository for deploy on TMC

For that i used the next commande

mvn -s setting.xml -f TEST_TALEND_CI_DEV/poms/pom.xml \
clean deploy -fn -e -pl jobs/process/test_job_dev_ci_0.1 -am \
-Dlicense.path=license \
-Dupdatesite.path=Talend_Full_Studio_p2 \
-Dservice.url=https://iam.eu.cloud.talend.com/ \
-Dcloud.publisher.screenshot=true -Dcloud.publisher.environment=default \
-Dcloud.publisher.workspace=Personal -Pcloud-publisher

Note

We use our own nexus is configured in setting.xml file

and command is execute in test-ci folder which contente the licence the talend p2 the talend job and the setting.xml for maven

~/Desktop/test_ci
$ ls
ci-setting.properties  license  setting.xml  Talend_Full_Studio_p2/  TEST_TALEND_CI_DEV/

The error i get is this :

To see the whole post, download it here

[Anonymous]

Light commandline didn't install correctly from p2 repository(updatesite.path), please make sure Talend_Full_Studio_p2/ is the parent folder of features, plugins, content.jar, artifact.jar, then run the command again to see if it works:

mvn -s setting.xml -f TEST_TALEND_CI_DEV/poms/pom.xml \
clean deploy -pl jobs/process/test_job_dev_ci_0.1 -am \
-Dlicense.path=license \
-Dupdatesite.path=Talend_Full_Studio_p2 \
-Dservice.url=https://iam.eu.cloud.talend.com/ \
-Dcloud.publisher.screenshot=true -Dcloud.publisher.environment=default \
-Dcloud.publisher.workspace=Personal -DforceUpdate -Pcloud-publisher -X

if it still failed, please send back the maven log to check.

[idir]

Hello zwxue, 

Thank you for your feedback, I tried to execute your maven command, Unfortunately it's still the same(I add in attachment the logs).  

About my P2 directory it's seem correct (we download it from TMC)

/# tree -L 2 test_ci/
test_ci/
|-- TEST_TALEND_CI_DEV
|   |-- Databases
|   |-- Maps
|   |-- Namespace\ Containers
|   |-- Reports
|   |-- Sample\ Data
|   |-- Structures
|   |-- TDQ_Data\ Profiling
|   |-- TDQ_Libraries
|   |-- businessProcess
|   |-- businessProcessSVG
|   |-- code
|   |-- components
|   |-- context
|   |-- documentations
|   |-- images
|   |-- joblets
|   |-- joblets_spark
|   |-- joblets_spark_streaming
|   |-- metadata
|   |-- poms
|   |-- process
|   |-- process_mr
|   |-- process_storm
|   |-- resources
|   |-- route_resources
|   |-- routelets
|   |-- routes
|   |-- services
|   |-- sqlPatterns
|   |-- talend.project
|   `-- tests
|-- Talend_Full_Studio_p2
|   |-- artifacts.jar
|   |-- content.jar
|   |-- features
|   `-- plugins
|-- ci-setting.properties
|-- license
`-- setting.xml

1580129443982.log
maven_log.txt

[Anonymous · Accepted solution]

From log found that problem should be this:

-Dupdatesite.path=Talend_Full_Studio_p2

it should be an absolute path here, please modify the command then try again.

Sorry we didn't clarify it in the description of ci-builder, we'll update it later.

[idir]

Hello zwxue,

it's seem it can build now but cannot publish. 

To see the whole post, download it here
OriginalPost.pdf

[Anonymous]

OK, at least it can run now.

for now problem is here:

org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.talend.ci:cloudpublisher-maven-plugin:7.2.1:publish (default) on project test_job_dev_ci: Use at least service token or service username and password!

you need to provide service.username and service.password/token to it, but I'm not sure if it's the only problem since it's maintained by another team, I don't know if you have the help doc of ci-builder, normally it's with the plugin jar inside the zip, you can find all available properties in it. if no, please ask support team for wiki/documentation to see what else properties are needed here.