Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us to spark ideas for how to put the latest capabilities into action. Register here!
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

How to get data from AWS Kinesis in Talend data streams

Hi,

 

I am currently trying out Talend Data Streams on AWS and Kinesis.

I have lambda operation that puts data into kinesis stream and I also created a connector to Kinesis srteam.

My Kinesis stream monitoring shows successful getRecords from Talend Data Stream yet I keep having this error

'

Cannot fetch sample from dataset 29409e8b-f3d6-4161-9ec6-62ee23917236

'

 

NB:

I have added an IAM role my EC2 instance that has full Kinesis rights.

my dataset type is CSV even though I am passing a string to Kinesis as data

 

I wish to know what I am missing out. Please help 

 

Thanks

Labels (2)
4 Replies
Anonymous
Not applicable
Author

Sorry about the delay in getting back to you. Have you tried this use case in Pipeline Designer (the new evolution of the Data Streams idea)? You may find that this is better handled in Pipeline Designer.

Pressley1647
Contributor
Contributor

Amazon Kinesis Data Streams is a massively scalable, highly durable data ingestion and processing service optimized for streaming data. You can configure hundreds of thousands of data producers to continuously put data into a Kinesis data stream. Data will be available within milliseconds to your Amazon Kinesis applications, and those applications will receive data records in the order they were generated.

 

 

MCDVOICE

IronSloth
Contributor
Contributor

Awesome and interesting article. Great things you’ve always shared with us. Thanks. Just continue composing this kind of post.

 

 

 

 

MyMileStoneCard Login

milestone
Contributor
Contributor

To resolve the error you're encountering in Talend Data Streams with AWS Kinesis, ensure that your dataset schema matches the data format being sent to Kinesis. Since you're passing a string but have set the dataset type to CSV, this mismatch could be causing the issue. Additionally, verify that the IAM role attached to your EC2 instance has the necessary permissions for both reading from and writing to the Kinesis stream. Lastly, check the connector configuration for any discrepancies. For more information and discussion please contact us at Mymilestonecard.