topic Re: text file hanling in Archived Discussions

text file hanling

nara1 — Thu, 08 May 2025 17:40:29 GMT

how to read csv file in pipeline designer? pls help

Re: text file hanling

Anonymous — Tue, 02 Jul 2019 13:30:06 GMT

Hi Nara,

The answer depends on where your file is located. If it is stored on a Amazon S3 bucket for instance, you can create a connection to Amazon S3 and then define a dataset that refers to this file.

Kind regards,

Cyril

Re: text file hanling

nara1 — Tue, 02 Jul 2019 13:40:03 GMT

If the file is in my local how can we do process?

Re: text file hanling

Anonymous — Wed, 03 Jul 2019 14:04:24 GMT

A the moment, the only ways for you to process this file are if it is in an S3 Bucket on AWS or if you use the little trick I demonstrate in this blog (https://www.talend.com/blog/2019/06/19/creating-avro-schemas-for-pipeline-designer-with-pipeline-designer/). There is a "Test Connection" Connection Type which will allow you to create a manual Dataset. You can copy and paste your file contents into that Dataset and try out processing the data in your file from there.

I know this is not ideal, but Pipeline Designer is very new and is growing.

Re: text file hanling

nara1 — Wed, 03 Jul 2019 14:14:03 GMT

Thanks got it.

Can we do touch file?

Re: text file hanling

Anonymous — Wed, 03 Jul 2019 14:22:36 GMT

I'm not sure I understand the question. Do you want to process an empty file?