Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Discover how organizations are unlocking new revenue streams: Watch here
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

How to load Data from Oracle DB Tables into AMazon S3 using Talend?

HI Experts,
Basically i am new to Talend ETL Tool.
I have a requirement that i need to load the data from Oracle DB Tables into Amazon S3 using Talend D.I Tool.
I have seen the things we can load the files into Amazon S3 but how about the data loading data from Oracle DB Tables into Amazon S3 in talend etl tool.
Can anyone suggest me for the above query.
Appreciate for your help!!!!

Thansk & Regards,
Sudheer Reddy
Labels (3)
20 Replies
Anonymous
Not applicable
Author

hi sabrina

But insert or update is too slow and we dont have tverticalastinsertid since i cant use tmysqllastinsertid
Anonymous
Not applicable
Author

hi

How to make job read only new data for example
table1
id val
1 a
2 b
3 c
First time job reads this from mysql db and inserts into vertica db
Next time
table1
id val
1 a
2 b
3 c
4 d
5 e
The job should read oly last two values from mysql and put it in vertica how to achieve this ?
Anonymous
Not applicable
Author

hi

How to use inner join or outer join so that i can get
4 d
5 e
values in the output.
Anonymous
Not applicable
Author

Hi,
But insert or update is too slow and we dont have tverticalastinsertid since i cant use tmysqllastinsertid

What's the row rate? Could you share your workflow screenshot with us?
Best regards
Sabrina
Anonymous
Not applicable
Author

Hi,
How to use inner join or outer join so that i can get
4 d
5 e
values in the output.

You can inner join source table and target table in tMap.
The workflow should be: t<DB>input(target)-->main-->tMap-->output
t<DB>input(source)-->lookup-->
Set "Catch lookup inner join reject" as true. The processed output data should be the updated data.
Best regards
Sabrina
Anonymous
Not applicable
Author

hi
I have configured the job on same lines as said above .
But inner join reject is not working for me the output i'm getting is data common in both tables.

t<DB>input(target)-->main-->tMap-->output
t<DB>input(source)-->lookup-->
columns are id and value i'm putting source table columns to output
Anonymous
Not applicable
Author

Hi,
Could you please show us your tMap editor screenshot? Did you set inner join?
Best regards
Sabrina
Anonymous
Not applicable
Author

in tmap i have set inner join.
Even then its not coming only the data which is same in both tables is coming as output.
Anonymous
Not applicable
Author

Hi,
Could you please show us your tMap editor screenshot so that we can address your issue quickly.
Best regards
Sabrina
_AnonymousUser
Specialist III
Specialist III

  Hi Sabrina,Is there a way to spool the file directly from an RDBMS table to S3 without a need to store the file in intermediate location (D:/Talend-Studio-r104014-V5.3.1/workspace/out.csv)) ? i.e., OracleInput --> S3 bucket?