Set hadoop configuration?

Anonymous — Sat, 16 Nov 2024 11:42:53 GMT

Hello!
I would like to integrate this code in a tJavaMR. (It reads a file from hdfs)
However i don't know how to integrate some Hadoop parameters as for example:
"Configuration conf = context.getConfiguration();"
or
"FileSystem fs = FileSystem.get(conf);"

Do you know where i can set these parameters please?

Best regards

Here is the code:

Configuration conf = context.getConfiguration();
            String file = conf.get("my.own.file", "hdfs://file.xml");
            Path path = new Path(file);
            FileSystem fs = FileSystem.get(conf);
            
            BufferedReader bread = new BufferedReader(new InputStreamReader(fs.open(path)));
            StringBuilder sb = new StringBuilder();
            String line = bread.readLine();
           
            while (line != null) {
                sb.append(line).append("\n");
                line = bread.readLine();
            }
            String xml = sb.toString();

Re: Set hadoop configuration?

Anonymous — Thu, 20 Mar 2014 09:55:48 GMT

Hi djidji,
Of course ,you can do it.
Please to my attachment.

jjzhou

topic Re: Set hadoop configuration? in Talend Studio

Set hadoop configuration?

Re: Set hadoop configuration?