Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Write Table now available in Qlik Cloud Analytics: Read Blog
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable
‎2016-11-14 11:38 PM

Unable to run steps on EMR using talend studio for data integration

I'm trying to use Talend data integration for pulling data set and pig script from Amazon S3 and run it on EMR. When I try to launch an EMR Cluster using talend, only core hadoop is installed so I wrote separate steps to install PIG and HIVE which are failing. The following are the parameters I gave for the steps in talend open studio
JAR: https://s3-us-west-2.amazonaws.com/us-west-2.elasticmapreduce/libs/script-runner/script-runner.jar
Arguments: https://s3-us-west-2.amazonaws.com/us-west-2.elasticmapreduce/libs/pig/pig-script,--base-path,https:...
Labels (4)
Labels
235 Views
0 Likes
2 Replies
Anonymous
Not applicable
‎2016-11-15 04:38 AM
Author

Which version of Talend are you using? And how are you starting the cluster: with the Talend components or the AWS Console?
Thomas
235 Views
0 Likes
Anonymous
Not applicable
‎2016-11-15 04:45 AM
Author

I'm using Talend Open Studio 6.3.0 and I'm launching EMR using talend tAmazonEMRManage component.
235 Views
0 Likes