Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration
We are using Talend 4.2.2r63143 enterprice edition, stuck up with the below Exception.
Exception in component tVerticaOutputBulkExec_1_tVBE
com.vertica.util.PSQLException: Something unusual has occured to cause the driver to fail. Please report this exception.
at com.vertica.Driver.connect(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at dev_sam.j_mysql_2_vertica_error_0_1.j_MySQL_2_Vertica_Error.tMysqlInput_1Process(j_MySQL_2_Vertica_Error.java:988)
at dev_sam.j_mysql_2_vertica_error_0_1.j_MySQL_2_Vertica_Error.runJobInTOS(j_MySQL_2_Vertica_Error.java:1268)
at dev_sam.j_mysql_2_vertica_error_0_1.j_MySQL_2_Vertica_Error.main(j_MySQL_2_Vertica_Error.java:1142)
Caused by: java.lang.NullPointerException
at com.vertica.core.v3.QueryExecutorImpl.receiveRFQ(Unknown Source)
at com.vertica.core.v3.QueryExecutorImpl.processResults(Unknown Source)
at com.vertica.core.v3.QueryExecutorImpl.execute(Unknown Source)
at com.vertica.core.v3.ConnectionFactoryImpl.runSetupQuery(Unknown Source)
at com.vertica.core.v3.ConnectionFactoryImpl.runInitialQueries(Unknown Source)
disconnected
at com.vertica.core.v3.ConnectionFactoryImpl.openConnectionImpl(Unknown Source)
at com.vertica.core.ConnectionFactory.openConnection(Unknown Source)
at com.vertica.jdbc2.AbstractJdbc2Connection.<init>(Unknown Source)
at com.vertica.jdbc3.AbstractJdbc3Connection.<init>(Unknown Source)
at com.vertica.jdbc3g.Jdbc3gConnection.<init>(Unknown Source)
at com.vertica.Driver.makeConnection(Unknown Source)
... 6 more
Job j_MySQL_2_Vertica_Error ended at 04:15 10/05/2013.
For data with row size 1000 i could load it using tverticaoutputbulkexec component ,but when data size is more i am getting such an error. Do you think it is the reason ,is it not possible to load huge data through bulk component
Hi,
Is it same result with tVerticaOutputBulk and tVerticaBulkExec components? I suspect your DB Vertica don't support for Bulk Mode.
Could you please check it?
Best regards
Sabrina
row1.START_TSTAMP.equals("")?null:TalendDate.parseDate("MM-dd-yy,HH:mm:ss", row1.START_TSTAMP) using the above getting no record was loaded into the vertica bulk loader component. vertica database does not allow null value to be inserted to timestamp field,how to handle this ,what default value should be filled in null part.
vertica database does not allow null value to be inserted to timestamp field,how to handle this ,what default value should be filled in null part.
You can give a default value, such as row1.START_TSTAMP==null || row1.START_TSTAMP.isEmpty())?"TalendDate.parseDate("MM-dd-yy,HH:mm:ss", "default value"):TalendDate.parseDate("MM-dd-yy,HH:mm:ss", row1.START_TSTAMP). Best regards Sabrina
Hi
Thx for date handling solution. And what i have observed while loading through tverticaoutputbulkexec component ,if there is any null values for numeric data type the component gives "no record was loaded" error but the same data and file generated through this can be loaded through copy command and tverticaoutput component is able to load same data even though it has null values. why is it so ?
hi, The tverticaoutputbulkexec component is failing to handle null values if any in the column i am getting "no record was loaded into the component". The tverticaoutput has no such issues with null its inserting successfully . why is it a problem in bulk component?
Hi banu,
Sorry for delay.
What talend product build version are you using? We had such similar issue before, however, it had been fixed.
https://jira.talendforge.org/browse/TDI-4750 Best regards
Sabrina
