Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Scenario: I have a few files in S3 bucket, now I want to get only a single file at a time and process the file and then get another file again and process it again, this should continue for all the files present in the S3.
please find the job design.
Thanks in advance.
@vvengala ,you use on component ok.
HI @shong ,
I have tried it but getting the below error after processing first file:
Connection pool shut down
Exception in component tFileList_1 (S3_Multiple_Files_Connection)
java.lang.RuntimeException: No file found in directory C:/Users/Vivek/Desktop/AWS/JSON/S3Connection/IPfiles
at aws.s3_multiple_files_connection_0_1.S3_Multiple_Files_Connection.tFileList_1Process(S3_Multiple_Files_Connection.java:3139)
at aws.s3_multiple_files_connection_0_1.S3_Multiple_Files_Connection.tS3List_1Process(S3_Multiple_Files_Connection.java:3636)
at aws.s3_multiple_files_connection_0_1.S3_Multiple_Files_Connection.tS3BucketExist_1Process(S3_Multiple_Files_Connection.java:3362)
at aws.s3_multiple_files_connection_0_1.S3_Multiple_Files_Connection.tS3Connection_1Process(S3_Multiple_Files_Connection.java:3846)
at aws.s3_multiple_files_connection_0_1.S3_Multiple_Files_Connection.runJobInTOS(S3_Multiple_Files_Connection.java:4076)
at aws.s3_multiple_files_connection_0_1.S3_Multiple_Files_Connection.main(S3_Multiple_Files_Connection.java:3925)
[statistics] disconnected
@shong , I want to get one file and process it, then get the other file and process it. It should repeat for all the files.
I have removed the ts3close connection, which runs on tfilelist subjob ok. it is working fine now.