Have you tried to enable parallelization to optimize Job performance? tHashInput and tHashOutput components shoud be OK with the parallelization of data flow.
No parallelization should be used in DI webservices according to Talend Support.
Eric
You cannot use tPartitioner, tCollector, tRecollector and tDepartitioner or Parallel iterations for reading data( Enable parallel execution option) in your current DI webservice? All types of parallel execution cannot be used?
I confirm no parralel component should be used in a DI webservices according to Talend Support.
But it is not the problem. Using these components would meet my requirement. My requirement is to be able to buffer data. That's why we used tHashInput and tHashOutput. But these component doesn't support parralelisation (When you deploy a DI webservices in Karaf it can be called in parallel).
I know this thread has been dead for a long time, but I was wondering if you came up with any solution because I'm having the same issue. I have a job deployed as a REST service that uses tHashOutput and tHashInput components. It works just fine unless requests are very close in time (like in the same second) which happens every now and then.
Are you flushing the data immediately after reading from tHashOutput?
I have used them in the past but have not seen this issue.
Warm Regards, Nikhil Thampi
Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂
Yes, I think I am flushing the data. I have "Append" unchecked in tHashOutput component and "Clear cache after reading" checked in tHashInput component, but still I get a NullPointer Exception in tHashInput component when two requests are made in the same second. Both components are linked with a "onSubjobOk" link.
Thank you for answering, if you have any tips I would really appreciate it because I have no clues at the moment.
If you are using same Hash as part of Web services, often there is chance of pumping data at same second. But I am not sure whether there is any limitation in Hash components for simultaneous transactions like web services.
Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂
