topic Re: In tRedshiftOutput, Action on table --> Create table is not working in Talend Studio

In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Sat, 16 Nov 2024 11:31:41 GMT

Hi,
Below is my job flow in which i am exracting a data from mysql, transforming it twice using tmap and creating a csv file. Now i want this csv file to be inserted in my Redshift. I do not have that table in Redshift. So i selected Action on table --> Create table in tRedshiftOutput component. But it keeps on failing stating
Exception in component tRedshiftOutput_2
org.postgresql.util.PSQLException: ERROR: relation "my_csv_table" does not exist

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Wed, 27 Aug 2014 09:38:31 GMT

Hi,
Is there any sensitive problem of your table name in your DB component?
Best regards
Sabrina

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Wed, 27 Aug 2014 09:41:50 GMT

Dont think so. Check attached screenshot

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Wed, 27 Aug 2014 09:55:18 GMT

Hi,
Have you tried option "Drop table if exists and create"?
Best regards
Sabrina

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Wed, 27 Aug 2014 10:00:05 GMT

Yes. I have tried create table, create table if does not exist, drop table if exists and create,. But still get same error.
This is really driving me crazy. Not sure what is wrong.

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Wed, 27 Aug 2014 10:08:23 GMT

Hi,
Is your Host "redshift.amazonaws.com" Hostname or IP address of the database server?
Best regards
Sabrina

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Wed, 27 Aug 2014 10:17:20 GMT

I have shortened it here. Its rather a long name.
That should not be a problem because if the table is exsiting in Redshift, I am able to insert data successfully. Problem only occurs when table is not represent and Talend needs to create it.

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Wed, 27 Aug 2014 10:32:02 GMT

Hi,
Due to PostgreSQL is case sensitive for table and column names, have you tried to use double quotes for your table name?
Have you tried another Data Base (tMySqlOutPut) to see if this issue repro? What's the build version you are using?
Best regards
Sabrina

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Wed, 27 Aug 2014 10:34:46 GMT

I haven't tried tmysqloutput.
I am using talend open studio for data integration
Version: 5.5.1
Build id: r118616-20140617-1110

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Wed, 27 Aug 2014 10:35:55 GMT

Hi,
Due to PostgreSQL is case sensitive for table and column names, have you tried to use double quotes for your table name?
Best regards
Sabrina

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Wed, 27 Aug 2014 10:38:54 GMT

Thanks for helping me.
I am sorry i did not get you. We always need to specify table name inside double quotes, which i have done. Check screenshot in my above post where i gave basic settings details.

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Wed, 27 Aug 2014 10:51:03 GMT

Hi,
Could you please have a try to use "ELOQUA.SG_COUNT" as your table name to see if it is working?
Best regards
Sabrina

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Wed, 27 Aug 2014 10:57:35 GMT

Does not work. Still same error.
Eloqua is the name of schema. I also tried removing that from the table name. But that also didn't work.

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Thu, 28 Aug 2014 02:58:56 GMT

Its strange. But when I changed tRedshiftOutput component to use public schema, it worked and created table in public schema. But, when I use any other schema, it doesn't work.
Do not think there would be permission issue as I am able to create table in Redshift manually in any other schema.

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Thu, 28 Aug 2014 08:01:33 GMT

Hi,
Could you use your schema (not the public one) to make Redshift DB connection successfully in DB metadata?
Best regards
Sabrina

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Thu, 28 Aug 2014 08:03:34 GMT

Yes. I can.

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Sun, 17 May 2015 21:04:34 GMT

Has this been solved? I am experiencing the same problem.
What I think the problem is here, is that the schema name is missing from the table when checking.
SELECT = exists in a different schema!
INSERT . = going wrong
I think this needs a (quick) fix in the tRedshift components.

Re: In tRedshiftOutput, Action on table --> Create table is not working

_AnonymousUser — Fri, 07 Aug 2015 19:01:22 GMT

Hi,
Even i face a similar problem. The tredshiftoutput works fine in update configuration when the job has its own redshift connection. But throws error with "tablename" relation does not exist when using a shared connection of parent job. Although the tredshiftoutput component which are configured for inserts work fine in both scenarios, so i am certain that the Connection is not a problem and Also the "schema.table" relation actually exists in the database.
Is there a resolution to this or has this been resolved in any on the release. I am trying to establish a SCD2 process with redhshift being the target.
I am using Version - 5.5.1 Buid - r118616

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Wed, 28 Oct 2015 11:09:49 GMT

Hi, we were having the same problem in the tRedshiftOutput component, and found that when we unticked the 'extend insert' option under its advanced setting, and added a row -> main after the tRedshiftOutput to a tRedshiftCommit (untick the auto close connection), then the job ran without any issues.

Re: In tRedshiftOutput, Action on table --> Create table is not working

Anonymous — Tue, 03 Nov 2015 07:31:40 GMT

the same problem happened with me, thanks Lourens for the solution, that works

Hi, we were having the same problem in the tRedshiftOutput component, and found that when we unticked the 'extend insert' option under its advanced setting, and added a row -> main after the tRedshiftOutput to a tRedshiftCommit (untick the auto close connection), then the job ran without any issues.