<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic downloading all files from S3 in Talend Studio</title>
    <link>https://community.qlik.com/t5/Talend-Studio/downloading-all-files-from-S3/m-p/2362294#M126459</link>
    <description>&lt;P&gt;I tried using tS3List--&amp;gt;tS3Get components&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;in tS3list I gave the bucket name and the key prefix. Under this folder, there are multiple files&amp;nbsp;&lt;/P&gt;&lt;P&gt;Key prefix as below&amp;nbsp;&lt;/P&gt;&lt;PRE&gt;/folder/export=2019/&lt;/PRE&gt;&lt;P&gt;&amp;nbsp;in tS3Get component for Key i gave as below&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;PRE&gt;((String)globalMap.get("tS3List_1_CURRENT_KEY"))&lt;/PRE&gt;&lt;P&gt;&amp;nbsp;File: as below&amp;nbsp;&lt;/P&gt;&lt;PRE&gt;/folder/work/&lt;/PRE&gt;&lt;P&gt;The problem here is if I include as File as below, it creates the folder inside from the current_key&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;PRE&gt;"/folder/work/" + ((String)globalMap.get("tS3List_1_CURRENT_KEY"))&lt;/PRE&gt;&lt;P&gt;it creates as below&lt;/P&gt;&lt;PRE&gt;/folder/work/folder/export=2019/a.json&lt;/PRE&gt;&lt;P&gt;my expectation is as below&amp;nbsp;&lt;/P&gt;&lt;PRE&gt;/folder/work/a.json&lt;/PRE&gt;</description>
    <pubDate>Mon, 10 Jun 2019 22:27:32 GMT</pubDate>
    <dc:creator>Karuetl</dc:creator>
    <dc:date>2019-06-10T22:27:32Z</dc:date>
    <item>
      <title>downloading all files from S3</title>
      <link>https://community.qlik.com/t5/Talend-Studio/downloading-all-files-from-S3/m-p/2362294#M126459</link>
      <description>&lt;P&gt;I tried using tS3List--&amp;gt;tS3Get components&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;in tS3list I gave the bucket name and the key prefix. Under this folder, there are multiple files&amp;nbsp;&lt;/P&gt;&lt;P&gt;Key prefix as below&amp;nbsp;&lt;/P&gt;&lt;PRE&gt;/folder/export=2019/&lt;/PRE&gt;&lt;P&gt;&amp;nbsp;in tS3Get component for Key i gave as below&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;PRE&gt;((String)globalMap.get("tS3List_1_CURRENT_KEY"))&lt;/PRE&gt;&lt;P&gt;&amp;nbsp;File: as below&amp;nbsp;&lt;/P&gt;&lt;PRE&gt;/folder/work/&lt;/PRE&gt;&lt;P&gt;The problem here is if I include as File as below, it creates the folder inside from the current_key&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;PRE&gt;"/folder/work/" + ((String)globalMap.get("tS3List_1_CURRENT_KEY"))&lt;/PRE&gt;&lt;P&gt;it creates as below&lt;/P&gt;&lt;PRE&gt;/folder/work/folder/export=2019/a.json&lt;/PRE&gt;&lt;P&gt;my expectation is as below&amp;nbsp;&lt;/P&gt;&lt;PRE&gt;/folder/work/a.json&lt;/PRE&gt;</description>
      <pubDate>Mon, 10 Jun 2019 22:27:32 GMT</pubDate>
      <guid>https://community.qlik.com/t5/Talend-Studio/downloading-all-files-from-S3/m-p/2362294#M126459</guid>
      <dc:creator>Karuetl</dc:creator>
      <dc:date>2019-06-10T22:27:32Z</dc:date>
    </item>
    <item>
      <title>Re: downloading all files from S3</title>
      <link>https://community.qlik.com/t5/Talend-Studio/downloading-all-files-from-S3/m-p/2362295#M126460</link>
      <description>&lt;P&gt;You could do a string replace to remove the key prefix text:&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;PRE&gt;String keyPrefix = "/folder/export=2019/";&lt;BR /&gt;"/folder/work/" + ((String)globalMap.get("tS3List_1_CURRENT_KEY")).replaceAll(keyPrefix,"");&lt;/PRE&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Tue, 11 Jun 2019 01:24:34 GMT</pubDate>
      <guid>https://community.qlik.com/t5/Talend-Studio/downloading-all-files-from-S3/m-p/2362295#M126460</guid>
      <dc:creator>nfz11</dc:creator>
      <dc:date>2019-06-11T01:24:34Z</dc:date>
    </item>
  </channel>
</rss>

