topic Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration in Talend Studio

Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

Anonymous — Mon, 13 May 2013 15:52:55 GMT

We are using Talend 4.2.2r63143 enterprice edition, stuck up with the below Exception.
Exception in component tVerticaOutputBulkExec_1_tVBE
com.vertica.util.PSQLException: Something unusual has occured to cause the driver to fail. Please report this exception.
at com.vertica.Driver.connect(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at dev_sam.j_mysql_2_vertica_error_0_1.j_MySQL_2_Vertica_Error.tMysqlInput_1Process(j_MySQL_2_Vertica_Error.java:988)
at dev_sam.j_mysql_2_vertica_error_0_1.j_MySQL_2_Vertica_Error.runJobInTOS(j_MySQL_2_Vertica_Error.java:1268)
at dev_sam.j_mysql_2_vertica_error_0_1.j_MySQL_2_Vertica_Error.main(j_MySQL_2_Vertica_Error.java:1142)
Caused by: java.lang.NullPointerException
at com.vertica.core.v3.QueryExecutorImpl.receiveRFQ(Unknown Source)
at com.vertica.core.v3.QueryExecutorImpl.processResults(Unknown Source)
at com.vertica.core.v3.QueryExecutorImpl.execute(Unknown Source)
at com.vertica.core.v3.ConnectionFactoryImpl.runSetupQuery(Unknown Source)
at com.vertica.core.v3.ConnectionFactoryImpl.runInitialQueries(Unknown Source)
disconnected
at com.vertica.core.v3.ConnectionFactoryImpl.openConnectionImpl(Unknown Source)
at com.vertica.core.ConnectionFactory.openConnection(Unknown Source)
at com.vertica.jdbc2.AbstractJdbc2Connection.<init>(Unknown Source)
at com.vertica.jdbc3.AbstractJdbc3Connection.<init>(Unknown Source)
at com.vertica.jdbc3g.Jdbc3gConnection.<init>(Unknown Source)
at com.vertica.Driver.makeConnection(Unknown Source)
... 6 more
Job j_MySQL_2_Vertica_Error ended at 04:15 10/05/2013.

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

Anonymous — Tue, 14 May 2013 03:26:05 GMT

Hi,
There is a Null Pointer Exception. Could you please give us your work flow and component setting screenshots so that we can address your issue quickly.
Please see the online component reference: tVerticaOutputBulkExec

Best regards
Sabrina

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

Anonymous — Tue, 14 May 2013 08:26:40 GMT

I am trying to connect to Vertica 6, but in the component i am able to see only Version till 4.1. I have attached the Job Screen shot.
The flow is like below
tMySQL=>tMap=>tVerticaOutputBulkExec.
MySQL and vertica DBs are in different Network

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

Anonymous — Tue, 14 May 2013 09:15:54 GMT

Hi,

We are using Talend 4.2.2r63143 enterprice edition

The version 4.2.2 you are using is very old. Vertica 6 is supported since version 5.0, please download the latest version 5.3.0 and test if it works, if you want to upgrade product, please report a ticket in support portal, our colleagues will help you and show you the detailed instructions.
Best regards
Sabrina

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

_AnonymousUser — Thu, 08 Aug 2013 08:18:10 GMT

hi

Im getting below exception when using vertica component ,the job flow is
tfileinputdelimited--->tmap--->tsort---->tuniqrow---->tvericaoutputbulkexec

Exception in component tVerticaOutputBulkExec_2_tVBE
java.lang.RuntimeException: No record was loaded into component tVerticaOutputBulkExec_2_tVBE
at master_project.ip_bill_cdr_6a_0_1.IP_BILL_CDR_6a.tFileList_1Process(IP_BILL_CDR_6a.java:10707)
at master_project.ip_bill_cdr_6a_0_1.IP_BILL_CDR_6a.runJobInTOS(IP_BILL_CDR_6a.java:11625)
at master_project.ip_bill_cdr_6a_0_1.IP_BILL_CDR_6a.main(IP_BILL_CDR_6a.java:11493)

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

Anonymous — Thu, 08 Aug 2013 08:34:57 GMT

Hi,
From the error "No record was loaded into component tVerticaOutputBulkExec", it seems there is no processed row in the work flow.
Did you use tlogrow to take a testing in order to see if the data is normal?
Best regards
Sabrina

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

_AnonymousUser — Thu, 08 Aug 2013 09:38:13 GMT

hi sabrina,

Yes, i checked it with tlogrow the dataflow is normal.

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

Anonymous — Thu, 08 Aug 2013 10:13:05 GMT

Hi,
That means something wrong with the setting of tVerticaOutputBulkExec. Is it OK for tVerticaOutput?
A trouble screenshot will be helpful.
In addition, while using tVerticaOutputBulkExec, be sure to set the right field delimitor(default is ";") according to the source data file.

Best regards
Sabrina

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

_AnonymousUser — Thu, 08 Aug 2013 11:00:58 GMT

hi,
I tried with tverticaoutput the data is getting inserted properly ,i dont know why bulk loading is not working im not able to upload images

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

Anonymous — Thu, 08 Aug 2013 11:03:33 GMT

Hi,
You should register and log in as a Community member first, then you'll get a Image upload box that allows to upload screen captures and images up to 200KB.
For registered users, please click on "post reply" (not through the quick post").
Best regards
Sabrina

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

_AnonymousUser — Thu, 08 Aug 2013 11:51:18 GMT

hi ,

For data with row size 1000 i could load it using tverticaoutputbulkexec component ,but when data size is more i am getting such an error. Do you think it is the reason ,is it not possible to load huge data through bulk component

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

Anonymous — Fri, 09 Aug 2013 04:36:36 GMT

Hi,
Is it same result with tVerticaOutputBulk and tVerticaBulkExec components? I suspect your DB Vertica don't support for Bulk Mode.
Could you please check it?
Best regards
Sabrina

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

_AnonymousUser — Wed, 14 Aug 2013 11:10:30 GMT

hi

row1.START_TSTAMP.equals("")?null:TalendDate.parseDate("MM-dd-yy,HH:mm:ss", row1.START_TSTAMP)
using the above getting no record was loaded into the vertica bulk loader component.
vertica database does not allow null value to be inserted to timestamp field,how to handle this ,what default value should be filled in null part.

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

Anonymous — Thu, 15 Aug 2013 06:31:43 GMT

Hi,

vertica database does not allow null value to be inserted to timestamp field,how to handle this ,what default value should be filled in null part.

You can give a default value, such as
row1.START_TSTAMP==null || row1.START_TSTAMP.isEmpty())?"TalendDate.parseDate("MM-dd-yy,HH:mm:ss", "default value"):TalendDate.parseDate("MM-dd-yy,HH:mm:ss", row1.START_TSTAMP).
Best regards
Sabrina

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

_AnonymousUser — Mon, 19 Aug 2013 06:24:16 GMT

Hi
Thx for date handling solution. And what i have observed while loading through tverticaoutputbulkexec component ,if there is any null values for numeric data type the component gives "no record was loaded" error but the same data and file generated through this can be loaded through copy command and tverticaoutput component is able to load same data even though it has null values. why is it so ?

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

_AnonymousUser — Tue, 20 Aug 2013 10:05:03 GMT

hi,
The tverticaoutputbulkexec component is failing to handle null values if any in the column i am getting "no record was loaded into the component". The tverticaoutput has no such issues with null its inserting successfully . why is it a problem in bulk component?

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

Anonymous — Tue, 20 Aug 2013 10:18:49 GMT

Hi banu,
Sorry for delay.
What talend product build version are you using? We had such similar issue before, however, it had been fixed.
https://jira.talendforge.org/browse/TDI-4750
Best regards
Sabrina

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

_AnonymousUser — Tue, 20 Aug 2013 10:55:26 GMT

hi

Im using version 5 (TOS_DI-r99271-V5.2.2)..

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

Anonymous — Tue, 20 Aug 2013 11:00:29 GMT

Hi banu,
I'm going to make a testing and investigation on it. Will come back to you asap.
Best regards
Sabrina

Re: Error - tVerticaOutputBulkExec component - MySQL 2 Vertica migration

_AnonymousUser — Tue, 20 Aug 2013 11:02:18 GMT

hi sabrina,
Thank u will be waiting for answer.