I am trying to extract a Twitter feed using tRSSInput in TOS 3.0 in Java. I have used tRSSIput successfully before for RSS feeds. Twitter is an Atom feed. When I use following link (or any link for that matter).
http://search.twitter.com/search.atom?lang=en&q=obama&rpp=10&page=2&show_user=true This is the sample output I get in tLogRow (TITLE, DESCRIPTION, NULL DATE, LINK)
geek3point0: I say let barack obama redistribute wealth until I sit above the 100k mark then kick him out....|geek3point0: I say let barack obama redistribute wealth until I sit above the 100k mark then kick him out....||
http://twitter.com/geek3point0/statuses/980112990 luv2shoppe: Ret: @larrymwalkerjr Reading: JUST WORDS? Obama's Four Tax Plans In Four Days
http://tinyurl.com/6hhhx4 |luv2shoppe: Ret: @larrymwalkerjr Reading: JUST WORDS? Obama's Four Tax Plans In Four Days
http://tinyurl.com/6hhhx4 ||
http://twitter.com/luv2shoppe/statuses/980112976 I do get the Title, Description as well as the Link elements. But my date element is always NULL (with other real RSS feeds, I have gotten date). Date is very important for my analysis. Is there anyway I can do this with tRSSInput or using any other component in Talend? I know I can write some Curl/PHP or something to get this information but I want to keep all my work in Talend if possible. Please let me know if any of you have attempted something similar.
Regards,
Sean
A follow up to my above question.
Twitter also gives a JSON feed. JSON is getting to be quite standard. I was examining this field and it gives more in-depth information. Is there anyway I can read that feed and more importantly parse it in Talend?
A sample JSON will be:
http://search.twitter.com/search.json?lang=en&q=obama&rpp=10&page=2&show_user=true Thanks
Sean
I hope someone can answer my questions above. I really do not want to use PHP etc. for this and keep everything nicely in TOS. I'm going to try to use Web Service component and see if I can achieve the same results as tRSSInput. Sean
