topic Re: [resolved] How to copy files with keeping folder structure ? in Talend Studio

[resolved] How to copy files with keeping folder structure ?

Fernandez — Fri, 05 Jun 2015 14:17:05 GMT

Hi,
I have a folder structure with files scattered across the folders and I want to copy all files to another destination keeping the folder structure.
How can I do that ?
Regards,
Antoine

Re: [resolved] How to copy files with keeping folder structure ?

Anonymous — Sat, 06 Jun 2015 17:34:49 GMT

This is an interesting question and one that I had very recently. However, it appears to be harder than it actually is. The following will sort this for you as long as every folder of the structure you want to recreate has a file in it. The job will look like below..

The tFileList is set up like below.....

The tFixedFlowInput outputs one column which uses one of the variables from the tFileList....

((String)globalMap.get("tFileList_1_CURRENT_FILEPATH"))

The tJavaRow has the following code....

//Get file path
String fileToCopy = input_row.fileToCopy;
//Replace back slashes to forward slashes - Windows
fileToCopy = fileToCopy.replace('\\', '/');
//Set fileToCopy value
output_row.fileToCopy = fileToCopy;
//Replace the start of the path to change it to the new start or root
String outputPath = fileToCopy.toUpperCase().replaceFirst("C:/TEST", "E:/TEST/NEW_LOCATION");
//Remove the file name from the path so that only the path is left
outputPath = outputPath.substring(0, outputPath.lastIndexOf("/"));
//Output the new file path
output_row.outputFilePath = outputPath;

In the tFileCopy you need to set the "File Name" as the "fileToCopy" column and the "Desitination directory" as the "outputFilePath" column.
This should do it for you.

Re: [resolved] How to copy files with keeping folder structure ?

Fernandez — Tue, 09 Jun 2015 10:43:52 GMT

It's running fine.
Many thanks.
Antoine

Re: [resolved] How to copy files with keeping folder structure ?

Anonymous — Wed, 21 Aug 2019 08:36:24 GMT

Hi I used the above method to copy files from source to target. however files does not copied to destination folder. in tFileCopy i put destination directory as "outputFilePath" and filename as fileToCopy

please find my source and destination path

source D:/Documents/SourceDir/Important tables.docx

destination: D:/DESTDIR

I used same tjava code as given.

also I tried using context variable for destination directory in context file.

and kept context.tgtfilepath as destination directory

context file contains tgtfilepath=D:/DestDir

It copies the all files into destination folder. however it does not create subfolder at destination as per my source folder. Please help

in my source i have files like...

source files:

D:/Documents/SourceDir/Important tables.docx

D:/Documents/SourceDir/Other Files/File1.docx

D:/Documents/SourceDir/VPN Connection/File2.docx

aslo i need to check no. of source files and no of target files are same or not? how can i achieve this. please help

Randepp

Re: [resolved] How to copy files with keeping folder structure ?

Anonymous — Wed, 21 Aug 2019 17:38:38 GMT

It sounds like you may have been confused by my description. Can you give a screenshot of your job and of your tFileCopy configuration. I believe that maybe you have got the wrong values there.

Re: [resolved] How to copy files with keeping folder structure ?

Anonymous — Thu, 22 Aug 2019 08:42:18 GMT

Please find my tfilecopy settings.

Job executes but does not copy files/ folders from source directory to destination. also i need to copy all subfolders and files inside it to destination folder as it has structured in source (folders / subfolders / files)

If I used copy a directory option from tfilecopy(above), it works as I required however it copies source directory into destination directory. I need all files/subfolders(files) from source to destination directory with files/subfolders(files) in it.

Randeep

Re: [resolved] How to copy files with keeping folder structure ?

Anonymous — Tue, 27 Aug 2019 09:30:18 GMT

You've not set the columns correctly.

"File Name" should be.....

row2.fileToCopy

"Destination directory" should be....

row2.outputFilePath

This is assuming that you have configured the column in the tJavaFlex and used the same code as me

Re: [resolved] How to copy files with keeping folder structure ?

sgoardou1611911472 — Thu, 20 Oct 2022 11:45:06 GMT

Hi,

7 years later, I am dealing with the same issue.

However, I have tried to implement the solution, but I do have the following issues:

fileToCopy cannot be resolved or is not a field
outputFilePath cannot be resolved or is not a field

I am using TALEND STUDIO V8.

Re: [resolved] How to copy files with keeping folder structure ?

Anonymous — Thu, 27 Oct 2022 13:52:02 GMT

fileToCopy and outputFilePath need to be configured in the schema of your tJavaRow component. If you have done this, then they will be available in the next component by using the row name before the column names. So, if your row is "row2" (as in the example above), they will be....

row2.fileToCopy

...and....

row2.outputFilePath

Re: [resolved] How to copy files with keeping folder structure ?

Anonymous — Thu, 27 Oct 2022 14:19:31 GMT

added the job demo which works for your reference