Hi, i´ve got two websites. One Website wich supports SOAP, imports and so on. Another Website wich keeps about 7000 html documents with an identical format with information in tables on it. Now, with the relaunch, I have to transport content from the 7000 files to a database / CMS / SOAP. I saw, that talend is able to connect to http. Can I also extract data from html tables? Thank you. Bye, Chris
Hello Chris,
as Olivier wrote, there is no special component. I had the same problem and it ends up in a tJavaRow with many regex. But that depends on your html structure. I've experimented a little bit with html2xml converter. If you search in google you should find different tools (including open source). At the end I could'nt use them because my input was very "unwell formed".
If you found a solution please give a us a feedback.
Bye
Volker
I have written an OpenSource function for converting bad HTML to well-formed XML (http://sourceforge.net/projects/light-html2xml) and I would appreciate to test it with your input. It is a single-pass automat and it does not need specific objects. It is not yet written in Java but in C# and in PHP5 (I will soon rewrite it in Java, especially if you're interested in...).
Hi,
We use for internal stats some Talend jobs using
http://cpan.uwinnipeg.ca/module/HTML::TokeParser in tPerl/tPerlRow. We may push on the stack a new component if you need it.
Hope this helps
The Java version of the html2xml function I have written is now downloadable at http://sourceforge.net/projects/light-html2xml Please send me your comments and remarks about it so I will fix bugs.
I found another helpful thing for this:
http://www.iopus.com/imacros/firefox/?ref=fxmoz Amazing tool to automate the web, even data extraction works fine.
One could combine the output which is e.g. Excel with Talend to get it into another database.
