Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hello guys!
I've got a request from a new client, and have these problems:
My client consists of several different companies. None of these companies are within the same network or AD. They all have different business systems that are installed inside each companies fire wall.
Now, someone at the top management wants to follow up revenue and costs for each company in one QlikView-application.
As far as I can see, I'm facing these main problems:
1) How to generate data for each company
2) How to transfer all the data to the top management guy, to feed his QlikView-application?
As for question 1, I'm thinking of installing Personal Edition at each of these sites to generate neccesary QVD's from each business system.
As for question 2, I have no idea. Maybe set up som kind of ftp server, write some scripts to automatically upload/ download the QVD's on schedule. Maybe a better solution exists. What would be the best?
Have some of you guys had this problem? How did you solve it? Did it work well?I don't want to mess with firewalls or anything that would jepoardize my clients security.
Thanks!
Lars
Hi Lars,
By the very nature of the situation you are going to have to either fetch the data or get the data sent to you. Fetching the data meaning allowing remote access to whatever business system(s) hold the data. Sending the data is like the idea you have about generating QVDs at each site.
Regardless of the method you will have to ensure that you are transporting the data in a secure way. It is important that access to either a database or some sort of file staging area is first secured by allowing your IP address (or some other identifier such as a hostname or MAC), then enforcing some form of user/password and finally ensuring that data cannot be read between the two endpoints - it must be encrypted.
You say that you dont want to mess with firewalls so this would typically mean using existing openings (such as email or a VPN for example) - it does rather limit your choice!
A possible setup would be to have a process at each site that generates the data that you need. This could be a QVD, or maybe just a simple CSV export file. You then send this data to staging area - typically SFTP (not FTP!). Your master QVW then reads all of that data. The only downside of this approach is that it involves the most work- firewalls, staging area, SFTP configuration, data exports etc.- there is a lot to go wrong. If you end up going this way have a look at WinSCP - it has a feature to syncronise remote areas with one another, meaning that you dont have to worry about the scripting behind syncing files and sending them.
The easiest method is to have secure access directly to the datasources. There is less to go wrong and it easy to implement. The biggest problem is the idea of having critical systems exposed - people get scared. This way would involve firewall config and detailed auditing.
I would go to your top man with 2 options-
1-Exporting data on site and sending it somewhere
2-allowing remote access to key systems
He/she can then choose - I expect them to choose number 1 😉
Good luck!
-Adam
Thanks for the tips Adam!
Another way is simply to involve someone with a better infrastructure knowledge than I have, to put the desicion off my shoulders. I don't want to set up anything that doesn't work, or does work with a lot of maintenance. Also, if I use SFTP I'll guess I'll have to open up some ports etc. in the firewall, and that is to scary for me to do if I haven't got an OK from someone who actually know about the risks involved.
Cheers!
Lars
no problem - always glad to help!
Just to confirm - SFTP typically uses port 22, so yes you would have to open this.
Just to say we are now working on an SFTP Connector which should be in QVSource soon. Let me know if you would like advanced access to try it out:
SFTP File Transfer Connector For QlikView - QVSource - The QlikView API Connector (Docs)