topic Re: tHTMLinput in Talend Studio

tHTMLinput

Anonymous — Mon, 13 Jul 2015 08:05:26 GMT

I would like to parse the table on the following page:
http://english.mnb.hu/arfolyamok
So the HTML is something like:

<td class="firstcell noborder">AUD</td>
<td>Australian Dollar</td>
<td>1</td>
<td>209.43</td>
<td></td>
<td class="firstcell">KRW</td>
<td>South Korean Won</td>
<td>100</td>
<td>24.87</td>
</tr>

So I am trying to use the tHTMLinput component and currently I get the following message:
Exécution en erreur :Échec de la génération du code.

Could you help me ?
Thanks
Didier

Re: tHTMLinput

Anonymous — Wed, 15 Jul 2015 09:37:40 GMT

Hi,
Have you already checked this custom component overview from TalendExchange:tHTMLInput?

Best regards
Sabrina

Re: tHTMLinput

Anonymous — Wed, 15 Jul 2015 09:43:33 GMT

I have written a tutorial that covers this. It is reasonably complicated and meant to show what you can do with Talend when you use it with other third party tools/libraries. It comes with an example job that I think you can probably tailor to your requirements. You will require Java knowledge to tailor this to your requirements.
http://www.rilhia.com/node/39

Re: tHTMLinput

Anonymous — Wed, 15 Jul 2015 15:58:45 GMT

Yes to Sabrina
and Yes, I have read the tutorial but it is not yet clear

Re: tHTMLinput

Anonymous — Thu, 16 Jul 2015 08:46:36 GMT

hi Dihonore,
follow following steps to get expected result, it does not required Java knowledge. and hope you have seen the original post from author of tHTMLInput component here.

Parent Element="table.MNBDailyRatesUI_Table.mnbtable"
add columns and configure as follows.

first column= " td:eq(0)"
second column =" td:eq(1)"
third column = " td:eq(2)"

this way you can get the expected result. if you want to try then refer this URL.

http://try.jsoup.org/~Tmx2BFhR_XBIJE0WJMFj86MpMEM

Hope this solve your problem.

Re: tHTMLinput

Anonymous — Thu, 16 Jul 2015 09:34:51 GMT

Another example to understand how tHTMLInput works
on the same site: http://english.mnb.hu/
I want to extract the official euro rate
so I have the HTML source code:

<div class="MNBStatsValue roundedBox">
<span>
<span id="ctl00_WebPartManager1_MNBEuroExchangeRate1880065841_ctl00_euroValueLabel">EUR</span></span> 
<span id="ctl00_WebPartManager1_MNBEuroExchangeRate1880065841_ctl00_euroPriceLabel" class="BaseRateData">310.83</span>
</div>
so the parent element is "div.MNBStatsValue roundedBox" or "span.BaseRateData" ??
and how I get the rate (310.83) ??
Thanks
Didier

Re: tHTMLinput

Anonymous — Thu, 16 Jul 2015 10:18:19 GMT

your parent element is =div.MNBStatsValue.roundedBox
or if you just need a Euro value then keep the parent as above and give the column value as follows.

Euro Rate="span#ctl00_WebPartManager1_MNBEuroExchangeRate1880065841_ctl00_euroPriceLabel"

this will solve your problem.

Re: tHTMLinput

Anonymous — Thu, 16 Jul 2015 10:25:48 GMT

Currently I get:
Démarrage du job GetCurrency_BNH_HTML a 11:24 16/07/2015.
connecting to socket on port 3598
connected
310.83|
3 %|
0.6 %|
1.50 %|
disconnected
Job GetCurrency_BNH_HTML terminé à 11:24 16/07/2015.
Is there a way to specify the class BaseRateData to get only the rate?
Thanks
Didier

Re: tHTMLinput

Anonymous — Thu, 16 Jul 2015 10:32:58 GMT

put the parent element as "*" and keep the column setting as is. it will give only euro rate.

EuroRate="span#ctl00_WebPartManager1_MNBEuroExchangeRate1880065841_ctl00_euroPriceLabel"

tHTMLInput component will give expected result. other wise you can filter result using tmap to get only one result.

Re: tHTMLinput

Anonymous — Thu, 16 Jul 2015 11:53:10 GMT

Démarrage du job GetCurrency_BNH_HTML a 12:50 16/07/2015.
connecting to socket on port 3413
connected
Exception in component tHTMLInput_1
java.lang.NullPointerException
    at pmi.getcurrency_bnh_html_0_1.GetCurrency_BNH_HTML.tHTMLInput_1Process(GetCurrency_BNH_HTML.java:692)
    at pmi.getcurrency_bnh_html_0_1.GetCurrency_BNH_HTML.runJobInTOS(GetCurrency_BNH_HTML.java:1099)
    at pmi.getcurrency_bnh_html_0_1.GetCurrency_BNH_HTML.main(GetCurrency_BNH_HTML.java:920)
disconnected
Job GetCurrency_BNH_HTML terminé à 12:50 16/07/2015.

another recommandation???

Re: tHTMLinput

Anonymous — Fri, 17 Jul 2015 07:39:43 GMT

Today I will upload new version of tHTMLInput please download it, It will give you option to choose how many times you want to try to connect certain webpage. this will avoid errors at some extent.

Re: tHTMLinput

Anonymous — Fri, 17 Jul 2015 08:49:55 GMT

Hi Umesh,
I have looked on the Talend Exchange site and I see tHTMLinput Release date : 22-Apr and tHTMLInput_extended with a release date of 2-July
There is another version??
Thanks
Didier

Re: tHTMLinput

Anonymous — Mon, 20 Jul 2015 15:54:37 GMT

I have install the V2
Now it works:
connecting to socket on port 3628
connected
.------+--------------.
|      tLogRow_2      |
|=-----+-------------=|
|euro |parseErrorText|
|=-----+-------------=|
|309.33|null          |
'------+--------------'
disconnected
but the component does not seem very stable:
connected
Exception in component tHTMLInput_2
java.lang.NullPointerException
    at pmi.getcurrency_bnh_html_0_1.GetCurrency_BNH_HTML.tHTMLInput_2Process(GetCurrency_BNH_HTML.java:806)
    at pmi.getcurrency_bnh_html_0_1.GetCurrency_BNH_HTML.runJobInTOS(GetCurrency_BNH_HTML.java:1209)
    at pmi.getcurrency_bnh_html_0_1.GetCurrency_BNH_HTML.main(GetCurrency_BNH_HTML.java:1030)
disconnected

when you try to execute several times the same job!

Re: tHTMLinput

Anonymous — Wed, 22 Jul 2015 14:40:26 GMT

You need to add tSleep component to slow down process, and avoid frequent requesting to web server, it may block your IP address. Other wise there are options but need to add like proxy. It will be added in next version, right now I am too busy.

Re: tHTMLinput

Anonymous — Mon, 27 Jul 2015 14:48:05 GMT

With a tSleep:
Démarrage du job GetCurrency_BNH_HTML a 15:45 27/07/2015.
connecting to socket on port 3510
connected
Exception in component tHTMLInput_2
java.lang.NullPointerException
    at pmi.getcurrency_bnh_html_0_1.GetCurrency_BNH_HTML.tHTMLInput_2Process(GetCurrency_BNH_HTML.java:1478)
    at pmi.getcurrency_bnh_html_0_1.GetCurrency_BNH_HTML.tSleep_1Process(GetCurrency_BNH_HTML.java:2076)
    at pmi.getcurrency_bnh_html_0_1.GetCurrency_BNH_HTML.runJobInTOS(GetCurrency_BNH_HTML.java:2338)
    at pmi.getcurrency_bnh_html_0_1.GetCurrency_BNH_HTML.main(GetCurrency_BNH_HTML.java:2159)
disconnected
Job GetCurrency_BNH_HTML terminé à 15:46 27/07/2015.