Inserting data to redshift using tredshiftoutputbulkexec -->'stl_load_errors'

[Anonymous]

Initially I tried tmongodbinput ==> tredshiftoutput  the data loaded succesfully, but it took me about 460 rows/second it takes too long time. To improve the performance tried tredshiftoutputbulkexec component.

Now trying to load my mongodb data into the redshift. Going from (tmongodbinput) directly to (tredshiftoutputbulkexec)  got me about same time approx 450 rows/second.BUT DATA NOT LOADED INTO TABLE.

Error Message : Invalid operation: Load into table 'fact_table' failed. Check 'stl_load_errors' system table for details.

Reading the data is faster in tredshiftoutputbulkexec but commits takes same as tredshiftoutput.

I attached the screen shot below.

-----------------------------------------------

Can anyone please help me with the solution.

Please do let me know if you need any more details.

[vapukov]

Hi,

errors with BulkExec components could be as an example by collisions with used delimiter character and escaping (check Advanced Settings tab in component)

And in any case, first what you need to do it is check the real error

https://docs.aws.amazon.com/redshift/latest/dg/r_STL_LOAD_ERRORS.html 

https://aws.amazon.com/premiumsupport/knowledge-center/redshift-stl-load-errors/ 

regards, Vlad