topic Re: Getting an specific tag from HTML file in Talend Studio

Getting an specific tag from HTML file

Anonymous — Fri, 16 Nov 2018 15:10:02 GMT

Hi everyone,

I'm trying to get an href link from an HTML file obtained from a HTTP GET request, but seems that I cannot iterate in the correct xml tags to get the data.

the xpath wich I'm trying to dive into is: "//*[@id="node-24615"]/div/div/div/div/center/div[3]/div/table/tbody/tr[2]/td[2]/div/a"

and the link that I have to get is: "http://obieebr.banrep.gov.co/analytics/saw.dll?Download&Format=excel2007&Extension=.xlsx&BypassCache=true&path=%2Fshared%2fSeries%20Estad%C3%ADsticas_T%2F1.%20IBR%2F%201.1.IBR_Plazo%20overnight%20nominal%20para%20un%20rango%20de%20fechas%20dado%20IQY&lang=es&NQUser=publico&NQPassword=publico&SyncOperation=1"

thanks for your help!!

Re: Getting an specific tag from HTML file

Anonymous — Fri, 16 Nov 2018 16:44:37 GMT

HTML is not XML so this will only work in rare cases. A better solution to this is use something like jsoup https://jsoup.org/

It will require a bit of java, but is entirely possible.

Re: Getting an specific tag from HTML file

Anonymous — Fri, 16 Nov 2018 23:48:16 GMT

Thanks for your help, finally I could import jsoup library and write a short java code to extract the link.

try {
Document doc = Jsoup.connect(context.webURI).timeout(20000).get();
Elements tds = doc.select(context.elementSelector);
context.webURIExcel = tds.first().attr(context.hrefLabel);
} catch (IOException e) {
e.printStackTrace();
}

talend solution.PNG

Re: Getting an specific tag from HTML file

Anonymous — Sat, 17 Nov 2018 13:58:03 GMT

Nice work!