error when inserting bulk data into RDS PostgreSQL DB using tDBOutputBulkExec component

[rudder_db]

Hi, we wnat to load large amount of data into the RDS postgresql table. We have used tDBOutput component to do this but it is taking lot of time to load the data as the component tDBOutput uses row by row insertion.

We tried using tDBOutputBulkExec component but we are getting the following error:

"Exception in component tDBOutputBulkExec_6_tPBE org.postgresql.util.PSQLException: ERROR: must be superuser or a member of the pg_read_server_files role to COPY from a file"

In RDS we can't assign the superuser role to any user.

Is there any other way to load the Bulk of data in the RDS postgresql table?

[Anonymous]

Hello,

You could  increase the batch size in the advanced setting of tPostgresOutput component.

Please have a look at this related topic and let us know if it helps

https://community.talend.com/s/question/0D53p00007vCsTbCAK/inserting-1000000-rows-into-postgresql-ta...

Best regards

Sabrina