topic Re: QlikView app to analyse Uber Data in QlikView

QlikView app to analyse Uber Data

anguila — Sun, 13 Mar 2016 21:47:55 GMT

Have you ever wondered how much you spent so far in Uber? What would it look like to overlap all your trips? The impact of the fare surges in your final charged price? With whom did you split more trips? Your trend usage or hourly usage pattern? I'm sure you did. And I did too That's why I created this App.

Well, to be honest, all started in a pub. As many good stories.. I was chatting around with some friends, complaining about me always going to their area instead of finding a middle point. They said that's not true.. I was unable to prove it back at those days, not anymore..

GitHub - anguila/qvUberDashboard: QlikView App to analyse your own Uber data to detect trends, patterns and usage in you…

Note: This app is for reference and personal purposes only.

I hope you enjoy!

Screenshots:

David,

Re: QlikView app to analyse Uber Data

jvitantonio — Sun, 13 Mar 2016 21:56:39 GMT

HI David. This app is excellent! I'll be using it often! Keep up the good work.

Juan

Re: QlikView app to analyse Uber Data

jagan — Mon, 14 Mar 2016 01:57:12 GMT

Simply Superb.

Regards,

jagan.

Re: QlikView app to analyse Uber Data

avinashelite — Mon, 14 Mar 2016 06:15:47 GMT

Good work David

Re: QlikView app to analyse Uber Data

cclayford — Mon, 14 Mar 2016 14:18:07 GMT

I keep getting this error...

Re: QlikView app to analyse Uber Data

anguila — Mon, 14 Mar 2016 17:06:14 GMT

Did you follow the installation process in https://github.com/anguila/qvUberDashboard ?

You need to install nodejs to run the Uber extractor in the background.

David,

Re: QlikView app to analyse Uber Data

cclayford — Tue, 15 Mar 2016 06:39:30 GMT

Yes, i followed all the instructions. Could it be that i am a South African user?

Re: QlikView app to analyse Uber Data

anguila — Tue, 15 Mar 2016 11:28:00 GMT

You might have some issues with the fares, as I only tested it in UK, FR and USA. But still the extractor should work.

Did you run npm install in the extractor folder too, to install missing nodejs libraries?

You can run the extractor (which is your main issue here), separately to be able to see the full log:

So open a terminal (cmd.exe):

Go to the folder where you stored qvUberDashboard, and run the follow commands:

cd extractor/

node app.js your@email.com your-password out/UberData.txt

You should have this following output:

Requesting login page...

Logging in as your@email.com...

Cool, logged in

Finding out how many pages we've to read...

Fetching https://riders.uber.com/trips?page=100

Fetching https://riders.uber.com/trips?page=50

Fetching https://riders.uber.com/trips?page=25

Fetching https://riders.uber.com/trips?page=12

Fetching https://riders.uber.com/trips?page=6

Fetching https://riders.uber.com/trips?page=3

Fetching https://riders.uber.com/trips?page=1

Reading trips up to page num. 12

Getting pages 1,2,3,4,5,6,7,8,9,10,11,12

Fetching https://riders.uber.com/trips?page=1

Fetching https://riders.uber.com/trips?page=2

Fetching https://riders.uber.com/trips?page=3

Fetching https://riders.uber.com/trips?page=4

....

Downloading trip **********************************12

Downloading trip **********************************c4

Downloading trip **********************************46

Downloading trip **********************************76

Downloading trip **********************************ed

....

Finished downloading all trips

Writing trips into file out/uberData.txt...

Done

If there's something wrong with your installation, you should be able to see it in the console.

Let me know your output and I'll try to help you as much as I can.

Kind regards,

Re: QlikView app to analyse Uber Data

cclayford — Tue, 15 Mar 2016 13:34:03 GMT

This is the error i get:

Re: QlikView app to analyse Uber Data

anguila — Tue, 15 Mar 2016 14:07:07 GMT

Looks like I'm having troubles identifying the page number. Is the uber website different there?

As far I can see from that log, there's any issue with the login and initial page retrieve, but in identifying the current page number, to know how many pages do we need to read.

I'm reading the value at the down of the page. Can I have an alike screenshot? You can use either google chrome or i.e, dev tools for that. You can send it to me at david.alcobero@gmail.com.

I'll try to fix it soon and let you know.

Thanks for your feedback!

Re: QlikView app to analyse Uber Data

cclayford — Tue, 15 Mar 2016 14:18:25 GMT

I only have one page of information, so the arrow at the bottom is grayed out:

Re: QlikView app to analyse Uber Data

anguila — Wed, 16 Mar 2016 12:02:46 GMT

Hi,

I just uploaded a bug fix that should solve that issue in https://github.com/anguila/qvUberDashboard

You have to download the .qvw file, and the extractor extractor/app.js to fix this issue.

Also, I added a log system in the extractor, which is read by the app too. So if there's any error in the extraction, an icon is shown in the main Login page (Qlikview app_, and once you click on it, you can see all the details.

That will help, if there's something unexpected..

Let me know if if works now, or if you have any other issue.

Thanks for the feedback!

Re: QlikView app to analyse Uber Data

cclayford — Wed, 16 Mar 2016 12:42:00 GMT

Thanks for the great update! It works now

Re: QlikView app to analyse Uber Data

cclayford — Wed, 16 Mar 2016 13:03:17 GMT

I Think the next update should be to make it work via Access Point on the server

Re: QlikView app to analyse Uber Data

Thu, 28 Apr 2016 15:39:38 GMT

Hi, I'm trying to get this app to work but am getting an error when trying to log-in and load the data from Uber.

I think I've installed everything successfully, I've tried just running the Node.JS from the command line, and am getting a Cannot read 'Parent' property, any suggestions please???

Re: QlikView app to analyse Uber Data

anguila — Thu, 28 Apr 2016 15:55:41 GMT

Did you try to run 'npm install' in the \extractor folder?

Looks like is something wrong with your cheerio version.

Also, I'd recommend you to download the latest version of the app in: GitHub - anguila/qvUberDashboard: QlikView App to analyse your own Uber data to detect trends, patterns and usage in you…

As I added a logging system which might help you to identify some issues.

Kind regards,

Re: QlikView app to analyse Uber Data

Thu, 28 Apr 2016 16:07:36 GMT

Hi, yes I did run the 'npn install' in extractor folder and I only downloaded the files from GitHub today so I assume it should be up to date.

I should mention that I don't have any trips in Uber as yet so was just testing the log-in but I believe in the latest version it should cope with this unless I've misunderstood???

Many thanks!

Re: QlikView app to analyse Uber Data

anguila — Fri, 06 May 2016 01:55:40 GMT

Is still the issue going on? I realized it was an issue with the Uber servers at end of may, now should work fine.

Actually, if you doesn't have any data, an error should prompt saying so.. (Not a nodejs exception.

Kind regards,

Re: QlikView app to analyse Uber Data

mohsinqlik — Mon, 06 Feb 2017 14:16:50 GMT

Hi David,

I have checked my user d id and password by logging in to uber website and it is working.

But when in i am using the same credential in dashboard i am getting authentication error.

Re: QlikView app to analyse Uber Data

jptneumann — Sun, 27 May 2018 21:05:52 GMT

Hi David/Mohsin,

I receive the same Mohsin error. Probably the Uber login page was changes since 2016 and the code need to be adjusted....