topic Re: How to insert into DynamoDB with DynamoDBoutput? in Talend Studio

How to insert into DynamoDB with DynamoDBoutput?

Anonymous — Sat, 16 Nov 2024 08:32:36 GMT

Hi, All

I'm using Talend Open Studio Big Data 6.3, and I wanna use DynamoDB in my job.

My job is pretty simple.

Read file, and extract it, then insert to DynamoDB.

My AWS DynamoDB upload capacity is 2000.

So I think this job can insert 2000 rows /s. But It's actually 31 rows / s.

Is there anyway past way to inset into Dynamo?

Thank you in advance..

Re: How to insert into DynamoDB with DynamoDBoutput?

Anonymous — Wed, 21 Mar 2018 08:37:01 GMT

Hello,

In advanced setting of tDynamoDBoutput component, there are " Read Capacity Unite" and " Write Capacity Unite", which specify the number of read/write capacity units. For more information, please refer to

https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/HowItWorks.ProvisionedThroughput.html#HowItWorks.ProvisionedThroughput.Reads

Best regards

Sabrina

Re: How to insert into DynamoDB with DynamoDBoutput?

Anonymous — Wed, 21 Mar 2018 08:47:26 GMT

Hello

I set it up 2,000 for each DynamoDB and tDynamoDBOutput component... and it's same...

Thank You for Reply.

Re: How to insert into DynamoDB with DynamoDBoutput?

Anonymous — Tue, 02 Oct 2018 13:24:47 GMT

Hi,

I'm not sure this issue is resolved or not. I have similar issue and I believe it is a problem with Talend tDynamoDBOutout component. It gives a strange error with "Action on Data" is set as "Insert".

Try to use the "Action on Data" value as "Update". It works for me and I'm able to use this setting to Update as well as Insert new records in my DynamoDB table.

Thanks,

Siva

Re: How to insert into DynamoDB with DynamoDBoutput?

ashif2 — Sun, 28 Apr 2019 13:54:58 GMT

When "Action on Data" is set as "Insert",

Starting job BD_Job at 13:53 28/04/2019.

java.lang.VerifyError: Inconsistent stackmap frames at branch target 1601
Exception Details:
Location:
local_project/bd_job_0_1/BD_Job.tRowGenerator_1Process(Ljava/util/MapV @1601: ldc_w
Reason:
Type top (current frame, locals[17]) is not assignable to 'com/amazonaws/services/dynamodbv2/document/spec/PutItemSpec' (stack map, locals[17])
Current Frame:
bci: @788flags: { }locals: { 'local_project/bd_job_0_1/BD_Job', 'java/util/Map', integer, 'java/lang/String', 'java/lang/String', 'java/util/Map', integer, 'local_project/bd_job_0_1/BD_Job$row1Struct', 'local_project/bd

To see the whole post, download it here
OriginalPost.pdf