List File names that are NOT present in HDFS Directory

[rohitpatil1993]

Hello

I am trying to get the names of Files that are NOT present in the specified HDFS directory.

(Note: I have multiple files using date mask for this check)

Here is what I thought will work but It's not

If condition --> !((Boolean)globalMap.get("tHDFSExist_1_EXISTS"))

tJava --> System.out.println(((String)globalMap.get("tHDFSExist_1_FILENAME")));

Can anyone help with the solution ?

[Anonymous]

How do you set the file name parameter of tHDFSExist? use the global variable of tHDFSList? If so, all files do exist in the specified HDFS directory, and the condition you set is always false.

[rohitpatil1993]

I think the condition is right since I want the names of Files that are not present.

Here is what you asked for.

[Anonymous]

You are iterating all files in the same directory as tHDFSList did, I don't understand why there will exist files are not present.

[rohitpatil1993]

Maybe I set the wrong logic...

What is the way to list the files not present in the specified directory?

[rohitpatil1993]

@Xiaodi Shi​  @Manohar B​  @Fred Trebuchet​ 

Do you guys have any idea on how to achieve the desired result?

[manodwhb]

@Rohit Patil​ ,what the location of the folder to check the List and exist components?

Thanks,

Manohar

[rohitpatil1993]

The location is set in tHDFSList.

[Anonymous]

tHDFSList is used to iterate all files in the specified folder, the files must exist if you use tHDFSExist to check it. It's a logical error.

[rohitpatil1993]

Yes. I understood that it was a logical error but what's the way out?

@Shicong Hong​