Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hi all, I was testing the ETL from my sql production to bigdata (hive).
And I found that my records are reduced from 1200 to 28.
What went wrong? Are there any tools to settings the connection timeout in talend?
Any help or ideas will be appreciated.
Hello,
There is an option and it is only used by talend studio.
Window / Preferences ... / Talend / Performance --> Activate the Timeout for the Database Connection.
You can set a timeout in components using JDBC additional parameters.
What does your job design look like?
Best regards
Sabrina
is there, at any chance, that the reduction of the row is not caused by talend timeout? What are those things that I have to check?
Hello,
Is the whole work flow? From above screenshot, the row rate is decreasing obviously after tMap component. What's transformation are you achieving?
Best regards
Sabrina
from lower case into upper case. The columns is about 20 columns..
is it any issue about how the tdbinput sql works? e.g : I want to ingest xx_xx an the source column is xx_"xx" is there any treatment (I was using String Handling but produce error)