Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
See why IDC MarketScape names Qlik a 2025 Leader! Read more
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Talend Context default.properties file need custom directory to read variables

 

Hi,

Can we use the custom directory for reading the context variables in the exported build job instead of using tcontextLoad component?

The reason is big data batch spark configuration of yarn cluster job is not passing the variables to worker node even enabled the broadcast factory in the tuning properties. The context variables are passing from the standard job, using trunjob (independent process and transport whole context option enabled) component assigned to the big data batch job.

 

If its possible custom directory for context(default.properties file), I can stamp all the variables to the file and big data batch job has to consume from this file.

 

Sample build script:

By default, the build Job.sh script is :
java -Xms256M -Xmx1024M -cp .:$ROOT_PATH:$ROOT_PATH/../lib/routines.jar:: bq.tcontextparam_0_1.tcontextparam --context=Default "$@"

 

we need custom directory for big data batch job context:

java -Xms256M -Xmx1024M -cp .:$ROOT_PATH:$ROOT_PATH/../lib/routines.jar:: bq.tcontextparam_0_1.tcontextparam --context=<Custom Directory>Default.properties "$@"

 

Thanks,

 

Regards,

Srini,

Labels (4)
1 Reply
Anonymous
Not applicable
Author

 

Hi,

 

Any suggestion please.

 

Thanks,