Talend Context default.properties file need custom directory to read variables

Anonymous — Sat, 16 Nov 2024 06:37:53 GMT

Hi,

Can we use the custom directory for reading the context variables in the exported build job instead of using tcontextLoad component?

The reason is big data batch spark configuration of yarn cluster job is not passing the variables to worker node even enabled the broadcast factory in the tuning properties. The context variables are passing from the standard job, using trunjob (independent process and transport whole context option enabled) component assigned to the big data batch job.

If its possible custom directory for context(default.properties file), I can stamp all the variables to the file and big data batch job has to consume from this file.

Sample build script:

By default, the build Job.sh script is :
java -Xms256M -Xmx1024M -cp .:$ROOT_PATH:$ROOT_PATH/../lib/routines.jar:: bq.tcontextparam_0_1.tcontextparam --context=Default "$@"

we need custom directory for big data batch job context:

java -Xms256M -Xmx1024M -cp .:$ROOT_PATH:$ROOT_PATH/../lib/routines.jar:: bq.tcontextparam_0_1.tcontextparam --context=<Custom Directory>Default.properties "$@"

Thanks,

Regards,

Srini,

Re: Talend Context default.properties file need custom directory to read variables

Anonymous — Mon, 11 Feb 2019 03:03:09 GMT

Hi,

Any suggestion please.

Thanks,

topic Re: Talend Context default.properties file need custom directory to read variables in Talend Studio

Talend Context default.properties file need custom directory to read variables

Re: Talend Context default.properties file need custom directory to read variables