Q: We have upgraded Qlik Sense from June 2020 Patch 4 to May 2021 Patch 5 , we have installed bundled version, PostgreSQL version 9.6. How to create separate DB node from bundled version and how to upgrade postgreSQL from 9.6 to 12.x version?
As always, my recommendation is to test this in a test environment before applying the process in Prod.
Q: Can we have more than one windows version in the Qlik Sense cluster nodes?
A: It should be technically possible but not recommended and perhaps not even supported. It is important to keep your cluster as identical as possible as there could be feature/settings difference between Operating System version causing inconsistent behavior.
Q: I tried an Update, but it hangs durring removal of older patch.
A: It is possible to manually remove the patch and then update to the newer patch. Sometimes is happens that for some reason the installer is not able to perfom this operation successfully.
Q: Do the streams and applications carry over to the new version?
A: Yes, they do along with all your settings.
Q: Hello, is there anything specific when upgrading a multi-node environment (in terms of installation and troubleshooting)?
A: In a multi node environment it is recommended to stop all nodes and start by upgrading the central node. If you are using the Qlik Sense failover feature, make sure which node is having the role of central node before stopping the services. Also, when you stop your nodes, always stop the rim nodes first and then the central node at the end.
Q: We are multi-node and multi-environment. Whenever upgrading, each node takes a fair amount of time, is this normal?
A: Yes, and this is most probably because of the dispatcher service which covers multiple subservices. In addition to that it is possible that a 3rd party software such as an antivirus is scanning each and every upgrade operation like copy files which as a result slows down the whole process.
Q: I get the error qlik notification service already exist. Support says its under investagation. Would upgrade to the a newer version fix this?
A: I wouldn’t recommend upgrading a non-working environment except if advised otherwise by the support team. This is a risk to make things worst.
Q: Is this the same process for QlikView Server?
A: While there are some similarities especially when it comes to the steps prior to the upgrade such as testing, system requirements and backup. However the actual process is different. There are articles and help documentations covering this such as: Upgrading and Migrating Best Practices for QlikView Services
Hello everyone and welcome to the September edition of Support Techspert Thursdays. I’m Troy Raney and I’ll be your host for today's session. Today's presentation is Troubleshooting Qlik Sense Upgrades with Bastien Laugiero. Bastien, why don't you tell us a little bit about yourself?
Hi everybody. So, my name is Bastien Laugiero. I’ve been working at Qlik for almost six years now focusing primarily on Qlik Sense on-promise; and I recently moved to a new role as a program delivery manager focusing on our SaaS platform.
Okay, and what are we going to be talking about today?
So, today we're going to talk about Qlik Sense upgrade and troubleshooting approach. The first thing I would like to talk about is the requirement and preparation for a successful upgrade. Then we're going to go through a couple of demos: one that shows an upgrade failure and another one that shows a platform down after upgrade. So, basically a successful upgrade, but a platform that won't come up. And there's gonna be some takeaway at the end of the sessions, some articles being shared and so on.
Okay. So, when it comes upgrading Qlik Sense, what constitutes a successful upgrade?
There is never any guarantee that an upgrade is going to be successful, right? We are talking about software here. So, there are however key factors. It’s the amount of preparation we put prior to the upgrade. That's basically going to guarantee at least a recovery in a working state.
And what kind of preparation would you consider required for an upgrade?
A very simple step and often missed is to read the documentation, right? So, you can look at upgrading Qlik Sense and you will end up here. So, here the whole process is being described. Something that you really not want to miss is to look at the system requirements, the precautions, backup and so on. But everything is detailed on this page here.
Okay. Help is a great place to start. Where else can admins look for guidance?
Take a look at our Knowledge Base and Release Notes. So, this can be found in our Community. If you go under Community.com, you've got Support and Release Notes here. You can also search in our Knowledge Base. For instance: “Upgrade to Qlik Sense August 2021” and see if there is any results.
How do customers really know what version of Qlik Sense they should be upgrading to?
That's a good question. So, if you go to Qlik.com, if you go under Support and Download; you're going to end up in our Download site. Select your product “Qlik Sense” and you will have all the versions available.
So, the latest should be on top there?
Exactly. And that's what we see here on the screen, right? August 2021, and we've got the initial reason the patch one available.
And where can you find what's in the release, like features or fixes you might want?
For that, you can go to Help.Qlik.com, under “Qlik Sense on Windows” you're going to find this “What's New in Qlik Sense,” and you can select the version that you are targeting to upgrade, right? We're gonna talk about August 2021, and you've got a list of different features and so on.
Yeah, a lot of new features there.
The last thing I always recommend to do is: to look once again at the Release Notes, because the reason it contains the defect fixes that are available as well as new features, settings that needs to be enabled to enable potential features. So this one is very very rich in terms of information.
Okay, and if someone like with this version that's the latest, it already has a patch. Should we upgrade automatically to the latest patch? Is that possible?
So, no. We're going to take a quick example here. Let's say that: you want to upgrade from Qlik Sense May to Qlik Sense August patch 1. You cannot upgrade directly to August patch 1. You will need to first upgrade to the initial release, and then to the patch.
So, once you are on the initial release, so let's say August 2021, you don't need to upgrade to patch 1, patch 2, patch 3, patch 4. You can go directly to the latest patch.
But you need to start with the initial release first?
Now, I know that in IT in general, but especially when upgrading Qlik Sense, the most important step is backing up. What specifically should be backed up so that Qlik Sense can be restored if anything unexpected happens?
The first one will be the product backup, so Qlik Sense backup. You can go into our Help site. And here you've got the process to actually backup your Repository Database, important files. That's the first thing you need to do. We also provide some Qlik Fix video on how to do that step-by-step as well to follow here. The second thing that you can do is to take a server backup or virtual machine snapshots. This is often easier and faster to restore from this type of backup.
What kind of failures can occur when upgrading?
There are two type of failures in my opinion. The first one will be: so you get a pop-up that shows that your upgrade failed, and we're going to see that in the next demo. The second one is the installer says that you've upgraded successfully to target release; however, when you start up your services, you can't access the Hub, you can't access the QMC. So, the platform seems to be down even though the Windows services are up and running.
Okay, well, let's jump to the demo. What did you want to show us first?
So, here we have this virtual machine running Qlik Sense November 2020, and we're gonna basically upgrade it to Qlik Sense May 2021. As you can see here, I’m not going to jump to February in between. I’m going to go directly to May. I’ve been taking all the precautions that I was talking about before. I’ve checked my system requirement. I took my backup. Now I’m just gonna run the upgrade. Always run your installer as an Administrator.
And you've downloaded it locally and now you're just running it?
Exactly. Alright so, here we're gonna click on Yes, because we want to run the installer. Click on Upgrade.
I like that the installer recognizes the pre-installed version, that's cool.
Accept the terms. Service account information. And here, enter the Repository Database password for this demo. I’m going to just put the wrong password. Just a quick note on that: I’m able to make this upgrade fail, because I have stopped all the services. Normally, if the services are up when I’m actually running the upgrade, there will be a check of the super user password. And if it's wrong, the installer will tell you that. We want to install the latest bundles. We accept the terms for the bundles. And we're going to start the upgrade process. So, it's going to fail at the Qlik Sense Repository Database. Here, we've got our upgrade failure. So, in most cases, you're going to see actually a meaningful error message here that you can actually search then into our Knowledge Base. And we can just search for “Password Validation Failure.” We can just filter on “article only.” And here, you will end up with different articles related to that error message.
What if the error message wasn't so helpful or clear is that one? Was that a link to the log files from the upgrade?
Exactly. So, this is a link to the installation or upgrade log file. So, this is important, because if you have to reach out to a Support to help you troubleshooting this issue, they will often ask you for the installation or upgrade logs. So, these are the logs that we are expecting to receive. So, if you click on that link, you're gonna end up on this folder here. So, this was the logs that were created during my initial installation on November 2020. As you can see, it just gives us the release name here. So, there are a lot of different logs, and the reason is because Qlik Sense has multiple services to upgrade. And each service will be represented by a specific log file. So, this is the order it went through. So, the first one as you can see it's PostgreSQL, so Qlik Sense Repository Database, and then it will continue here. If it fails at any time, let's say it fails at the Scheduler; so, it's not going to go through the other services. However, you will see a rollback log file on top of each of the ones that were already upgraded. So, you're going to see this these five here, plus an additional five with a dash roll back at the end. So, what you - the log that you want to open is actually the latest one that don't that, don't have this rollback…
Exactly. If we go back to PostgreSQL. So, there was no rollback here, because it just failed at the password validation. So, it fails right at the start, so there was no rollback to perform. But this is basically the latest log that we've got from the installer. So, this is the one we're going to look at, right?
So, when you're looking at a log file what do you usually search for to zero in on what is important?
Yeah so, you can search for “Value 3.” So, “Value 3” it's an error code that will trigger a rollback basically. The other thing that you can search that is always associated with that return Value 3 is “Error Code 1603” here. If you start to read a little bit above that error, you can find back our Password Validation Failed error message. However, you may have other error messages here that you can search in our Knowledge Base.
Okay so, if it fails, you're not sure what the message means, you could theoretically copy that message that you find here in the log file, search in a Community, and hopefully find more information? But this is definitely a log file that Support would need if they if you require some additional assistance?
My advice here is that: when you send logs to Support, don't just select the latest log. Take all the logs that are associated to your upgrade basically.
And it's pretty easy to see which ones they are, because in this in this case, we're upgrading to a different version and it's designated there in the first part of the log which version wrapped it into.
Now quick question: since this upgrade failed, is the November 2020 still active and functioning on this system?
Yes. In fact, we can take a look at the services here.
So, it didn't really affect the current installation.
No, it didn't. The installer is built in a way that if there is any failure, it will roll back to the previous state. However, it may happen that this rollback is not happening correctly, and therefore this precaution of taking a backup becomes critical.
Yeah, I totally understand working in IT that everything starts with a backup. Okay, you had a second scenario you wanted to run us through. Tell us about that?
All right. So, we're gonna look at scenario where the upgrade is actually successful, but you are not able to start your platform. My services are started; however, when I try to launch the QMC, I’m just getting a 404 error. So, well, the first thing I want to do since I am on the Qlik Sense Server here; the first thing I want to test of course is if I’m facing any DNS or network issues, I’m going to try localhost. And I’m going to basically end up with the same problem, which means that my Qlik Sense platform is down here. The troubleshooting approach is a little bit different, right? Because we we're not going to look at the upgrade or installation logs, because those who are successful. What we want to look at is the Qlik Sense service logs.
Okay, taking a look at the services, would you help explain what all the services do exactly?
So, we've got the Qlik Sense Repository Database, which contains basically the entire configuration of your platform. So, this one is the first one that needs to function basically for the other services to pick up the configuration. The next ones are the Repository Service and Service Dispatcher. And then you've got the remaining ones which are the Engine, Printing, Proxy Scheduler that all depend on the Repository Service to be started to function properly. When you start the services here in Windows, there is an entire startup phase that's happening in the background we're going to look at through the logs.
So, since the Repository Database starts first, is that where you would begin looking in the logs?
Exactly. So, there is a much easier way for this one at least to to see if this one works fine than looking at logs.
We want to connect to the database, right? This is a Postgres database running in the background. One thing that we can do is to actually try to access the database. We usually do that with pgAdmin. There is an article actually explaining how to install it and configure it. It's called “Installing and Configuring pgAdmin4.” So, you can find that in our Community Knowledge Base.
And that is a free utility, right? That people can download?
Exactly. So, what we want to do is to basically try to connect to this Repository Database. So, I’ve already have a pre… connection that is already created, but the setup is very simple, right? So, the host is “localhost” because my service is installed on this machine. Got Postgres, and I will put my super user password during the setup. If we try to connect here, I’m gonna do “Connect Server,” it's gonna ask me for my super user password. And here, I can see that I can access my databases. I can open them, the connection here is working fine. So, I can assume that this service is actually functioning properly.
Since the database is running fine, what's the next step?
Will be to look at the Qlik Sense Repository Service, right? For that, we need to look at the Qlik Sense logs.
And where do we find those?
So, the Qlik Sense logs are - you can find them under C: > ProgramData > Qlik > Sense > Log. Here you've got all the logs for each services.
So, each service has its own log folder?
Exactly. Got the Repository folder, and we're going to look at Trace and System. So, if we look at this log, just scroll to the bottom here. We can see an error. .
Ah, right there.
What we are seeing here, if we look at the couple of lines above is: it's trying to connect to the QSR Database. It's waiting 300 second for a response, which is five minutes. So, we can assume that this service is not able to actually connect to the QSR Database; and that's most likely the root cause of my issue. So, once again, this is just a troubleshooting approach. You may have different error messages in there. The idea is just to take this error message, search for it in our Knowledge Base and find some potential root causes and solution.
In this particular case, so, I just modified manually the connection string the Qlik Sense Repository Service so that it will fail to connect to my database. I can quickly show that. So, if you go under C: > ProgramFiles > Qlik > Sense, you've got something called Repository > Util > QlikSenseUtil.
Okay, so what is this utility?
So, this utility it's basically providing several information: such as your connection string, your service cluster setup, and more. We usually use it for service clustering connection string editor. So, if you start to read your connection string. So, this is my QSR connection string here. What I’ve done is simply modify this port so that it won't be able to reach my QSR Database, because the default port is 4432 and not 5432. If I start to save this, and exit; I should now be able to actually start my services.
Now you're restarting because you actually changed that connection string, right?
Exactly. So, I need to re-trigger a connection attempt.
Okay, and once that's finished, you should be able to connect to the QMC?
Then yes, I should be able to access my QMC if I’m not facing any other error of course. There should be a line in this log that says “Startup Phase Completed.” So, you can just search for that, and there I can find it. So, that means my Repository started correctly.
If that started up fine, but we still weren't able to access the QMC or Hub, what would be next?
The next service that I would look at is my Proxy Service, because my Proxy Service is the one that delivers the web interface.
Okay, so, that actually hosts the QMC?
Exactly. I can take a Qlik look at my Proxy logs. So, same thing: Proxy > Trace, and then we've got System Proxy.
And I noticed before there are a couple warnings there.
Yes. So, that's because of the startup phase, right? it tries to connect to my Repository, but since my Repository was not up and running; so, it failed, but it's retrying, right, until it can. Then you can see the last line on this log is “Proxy is Running.” So, that means this service started up fine.
It's always important to look at the entire context, and not just stop at the first error or warning, because it might be actually a false alarm, right? So, if we now try to access our QMC, and our services are working, and I can connect to my environment.
Great. And would you say those are two of the most common issues that people face when they're upgrading: the upgrade fails or the upgrade succeeds, but the services don't work correctly?
Yes. Exactly. Now, the root cause can vary from case to case.
From version to version as well, because our R&D team is working very hard on trying to fix those potential use cases, but there might be new ones coming in other release, right?
Just as a reminder, we will be sharing the links to everything that's been discussed today along with the recording. Bastien, are there any other resources you'd like to highlight?
So, I just wanted to highlight a couple of things. Here are a few links around our System Requirements for Qlik Sense, how to back-up your Qlik Sense site, a link to the Release Notes and the upgrade process. And finally, I’m highlighting here a couple of articles that will help you troubleshooting your Qlik Sense installation or upgrade if any failure occurs. So, it's kind of a summary of what we just discussed today.
Okay, great! Thanks. Okay, now it's time for Q&A. Everyone, go ahead and enter your questions in the Q&A panel on the left side of your On24 console. Bastien, which question would you like to address first?
All right. So, the first question is: how to prevent Qlik Sense Enterprise on Windows from rewriting config files such as C: > ProgramFiles > QlikSenseproxyproxy.exe.config, which as for example: the keeper live timing parameter.
So, unfortunately this is not possible. So, when we do a major version upgrade, these files are being replaced or overwritten with the new ones corresponding to the updated version. My best advice here is to actually keep track of these changes you are making in these config files, to then update them post upgrade. Do not replace these configuration files from a previous version to a newer one, because they could be different, like new settings for example or deprecated settings. So, it's very important to keep the original file and just change the setting that you had configured before the upgrade.
That's good to know. Next question?
Do all nodes in a separated environment needs to be disconnected from the Repository before proceeding with the upgrade?
So, in a multi-environment, it's recommended to stop all nodes and start by upgrading the central node. So, if you are using a Qlik Sense failover feature, that's a Qlik tip here: make sure which node is having the role of central node before stopping the sources. It's very possible that actually a rim node became a central. And this one you will either need to move back the central node role to the original central. You will need to consider this stream. Know that the central node and basically be the first one to upgrade. Also, when you stop your nodes, always stop the rim node first, and then the central node at the end. When it comes to the rim node, there is not really any - it's not really important in which order you are going to stop your rims. But the central should be the last in any case.
That makes sense. Next question?
Please include any tips or suggestions you may have regarding certificate changes that occur during a Sense upgrade.
So, there are normally no changes to the certificate during an upgrade. They're not being touched. It has happened in the past for some specific releases that the certificate needed to be renewed as a post upgrade activity, but this is always documented in the Release Notes; so, with step-by-step instructions as well. So, finally the certificate is also part of the backup that you take before upgrading, so if sometimes it happens that something can go wrong; and in this case, you will have this backup to cover you. But in general, there is no change on the certificate that's happening in Qlik Sense.
Okay, next question?
So, we had a lot of problem in the past with broken certificate that then needed to be recreated reinstalled, so that's why we postpone upgrade unfortunately.
So, this issue - it's often environmental, and can be caused due to many different reasons such as: a security policy applied on the server, or third-party software such as antivirus blocking or blocking the files basically or corrupting them. So, as mentioned before, my best advice here is to make sure that you are backing up the certificate before upgrading. Which means that if they get corrupted post upgrade or at any time, you can safely restore them without any problem.
That's interesting that it's not, that happens people, but it's not actually Qlik Sense that's affecting it. It's just being affected by the environment.
Correct, and that's the thing with Qlik Sense. It runs on Windows and is very dependent on the overall environment that it's installed on.
Okay, next question.
Upgrading multi-node Qlik Sense from November 2019 to February 2020 was unsuccessful. Some users can log on, some cannot. How to check the root cause in the log file?
So, it's very difficult to say to say right now without any clear symptoms and clear message. So, what I will do is: based on your question, it sounds like the upgrade was successful from the installer (which was what we discussed previously in the demo), but now you are you are facing some post upgrading issue, right? In that case, I would just suggest to focus first on the symptoms that the users are experiencing. For instance: is there any specific error message or specific behavior that they experience when it faced with the problem and start from here. Alright. You can search this behavior or error messages in our Knowledge Base. That should give you a good point to start, here.
And if it has to do with logon issues, what log files or what service log file would you recommend looking at?
So, if that's pure logon, I will first check the Windows event log. So, that depends also which authentication method you are using, right? Let's say that you are using Windows authentication in this case. The first thing to know is that Qlik Sense does not take care of the authentication. So, if you use for instance Windows, you will need to check the Windows event log security at the time the user had the failure to see if there is an error messages there. If you are using single sign-on, you probably need to check your in the single second side as well.
Very good, thanks. Next question?
All right so please cover upgrades related to Postgres Repository sitting on node outside of Qlik.
So, the process is no different, right? Qlik Sense will automatically detect where the database is and will proceed with the upgrade. However, note that Qlik Sense will not upgrade your Postgres. You are responsible to upgrade it if you wish, making always sure that the version you choose is actually listed under the Qlik Sense system requirements for the version that you are running of course.
If moving from one version to another and you are currently several release out of date, do you need to install each releases in turn?
The answer is no. You do not need to upgrade to each release in between. However, if you want to install a patch, you need to first install the initial release associated to that patch. So, let's just take a quick example: you are running Qlik Sense February 2018 which is a very old version, and you want to upgrade to Qlik Sense May 2021. You can do that. You don't need to upgrade to each major version in between. However, if you want to upgrade to Qlik Sense May 2021 patch 4, you will first need to upgrade to Qlik Sense May 2021 initial release; and then apply the patch. And here the for the patch, same applies. You don't need to patch to apply the patch one by one. You can go directly to patch 4.
Thanks for clarifying that. So, next question.
Where can we find the latest patch?
So, this is something we quickly saw in the presentation before. You can find it in our download page which is accessible from Qlik.com in the Support area of that website, right?
Do I need to apply all patches or just the latest?
This is kind of related to the question we just answered before. So, no you don't need to apply all patches one by one. A patch is cumulative. So, which means that you can simply install the latest one and all fixes from the previous patch will also be included.
The next question is: we got error 1068 “The dependency service or group failed to start” with the Repository Service. What does that mean?
In my experience, so, this error message happens when you try to start one of the Qlik Sense Services in the service console, the Windows service console; and this basically it's very possible that the service account does not have the right privileges to start the services. I know that there are some articles that use about this error here. So, we'll just search directly for the error message in our Knowledge Base, and you should find information on what caused this and what is the potential solution.
What right does the QS service account require? Does it also need a license?
So in terms of Windows privileges, it's recommended that the Qlik Sense service account is part of the local administrator group on the Qlik Sense server. However, if for security reason this is not an option; so, it's very often that your IT department will not allow you that sort of privileges. There is a way documented on Help.Qlik.com to run the Qlik Sense services without admin privileges. When it comes to the license, the Qlik Sense service account does not need the license. The license is really about accessing the Hub, opening and creating application, so you don't need to have a license to access the QMC and do administrative tasks there.
That's good to know. Okay, we're getting near the end. Next question?
So, the next question is: usually I test future new releases of Qlik Sense server with the desktop version. Since there is no desktop version anymore, how do you guys test new versions before upgrading your whole cluster?
That's an interesting question. So, and here we are really talking about how deeply you should test your environment before upgrading. So, my recommendation here is to always have a Qlik Sense server test environment, because Qlik Sense desktop is very good to test your application and how they will behave with the updated version. However, something that you also need to consider testing is the server part of the software. Potentially the overall upgrade process as well, so that you are familiar with all the steps that needs to be taken when it's time to upgrade your production. So, testing application it's of course needed, right? But you also have the server side, the server parts of your upgrade that also need to be tested, in my opinion.
Is that like a license they could get from their account manager to have a test license?
Yeah, this is - you can reach out to your company to see what your options are, but yeah definitely having a test license is possible for a given period of time here.
Okay, we have time for one last question.
So, is the upgrade similar for QlikView?
Interesting question. So, while there are some similarities, especially when it comes to the steps prior to the upgrade such as the testing the system requirements, the backup and so on. The actual process is actually different. We are talking about two different products that work different way, right? So, there are there are definitely articles and help documentation covering this. So, you can search in Help.Qlik.com for the upgrade process, and you can also look at our Knowledge Base for upgrading and migrating best practices for QlikView.
I hope this was useful. Thank you all for attending and have fun with your upgrade!
Thank you everyone! We hope you enjoyed this session. And thank you to Bastien for presenting. We appreciate getting experts like Bastien to share with us. Here's our legal disclaimer. And thank you once again. Have a great rest of your day.
Q: When getting permission for our Sharepoint tenant site - you mention you allready got it approved. Was this done inside of Sharepoint itself or your Office 365 Azure AD portal ?, it seems other connector seem to suggest needing to do this to approve and allow third party apps to send requests. Is this correct?
A: There is nothing to be done from the Azure portal. If it's the first time using the connector, it's mandatory to use the Azure tenant admin when authenticating. This will prompt and authorization approval for Qlik's sharepoint app (the reason why appears as a third party app it's because is not developed by microsoft).
Q: What is the purpose of the "Access Token"?
A: The access token will grant access to connector
Q: Is there a connector to Azure?
A: Yes, both in SaaS and on-premise (december 2020)
Q: When you say 'Azure Tenant,' is that the same as Auzre AD admin portal to approve the app?
Q: We are using a proxy to connect to outside enterprise connections (Sharepoint Online).But it's possible to activate proxy only for some connections types ?
Hello everyone and welcome to the March edition of Support Techspert Thursdays. I’m Troy Raney and I’ll be your host for today's session. Today's presentation is Best Practices for Using Qlik Web Connectors with Francisco Fernandez. Francisco, why don't you tell us a little bit about yourself?
Hello, my name is Francisco and I’m a Technical Support Engineer here at Qlik. I’ve been working at Qlik since 2019 and my main focus are Qlik Web Connectors and Qlik Sense integrations, such as APIs and mashups.
Okay, and what are we going to be going through today?
We are going to go through installation tips; how to use SharePoint Connector; difference between SaaS and on-premise connectors; and a little bit of troubleshooting.
Okay, and for those of us who are kind of new to Qlik Web Connectors, what are Qlik Web Connectors and how do they work?
The Qlik Web Connectors package is a lightweight web service that helps you fetch data from many web-based data sources, and also social media. It contains 42 different connectors with tons of functionalities. Also, it can be used in a separate server, so it's a completely isolated package that doesn't depend on Qlik Sense or QlikView; and that's the main reason it can be used with both.
So Qlik Web Connectors works with both Qlik Sense and QlikView?
Yes. Here in the example architecture. You can see that the Qlik Web Connectors is being run in a different server. That's why it doesn't have a dependency.
Okay, that's cool. Now why should someone start using these connectors? How are they useful?
So, first of all, because it's free of charge with a Qlik Sense license.
That’s always nice.
It's free. It's simple to install and configure. Auto-generate the scripts. It can be used as a Windows service or run as an application. As I previously mentioned, it can be used both with Qlik Sense and QlikView.
Okay, I think the initial question for a lot of people is: how to install it and how to get started?
Yep, you can download the Web Connector from our Support page. As a demo, I already downloaded the package. This is what you get from the download page. I already uncompressed it, so we are ready to go.
Okay, and what version of Web Connectors is this? Is this the latest version?
Yeah, this is the latest version. This is December 2020.
Francisco, what are we looking at here?
We are looking at the connector. It's basically a library of DLLs, as you can see here. Each DLL is a connector. And we also have some folders that contains the connector configuration. Scroll down. We can see the deploy.config file, which contains all the connector configuration. Scroll further, we can see here: application executable and the application service executable.
Yeah, you mentioned there's two different ways of running connectors: one as a service or as an executable application.
Yeah, if we want to use it as an application; we only need to double Qlik this window will pop up and we are ready to go. The connector is already working.
If we want to run it as a service, we have to go here to batch files. And we have two batch files here. The first one contains the installer service, and the second one contains the uninstall service.
Can I ask you, what are the advantages of running it as a service versus just clicking on the application?
Running the Web Connectors as a service is especially useful for server admins. It allows them to automate tasks, such as restart all the services at once using a script.
Okay, can you show us the details of running the service installer?
Yeah, if we open it using the Notepad++, we can see here that it contains a path. This path should be where our Web Connector is located. In our case, it is in the desktop. So, we should change the path here. Save it and install after that. And it will be available in the services tab. If we want to start using the connector, we have to check the configuration in the deploy.config file. Notepad++ and edit it. Here we have an XML configuration file which contains lots of tags, as you can see.
Yes, these are kind of difficult to read with the human eye sometimes if you're not used to editing XML files. What settings here are important that we should take a look at?
First of all, the port where we want to run the connector. This is by default: 5555. You can change it to whatever port you want to use. Secondly, one of the most important tags is: the Allow Remote Access, which basically allows access to the Web Connector from remote machines.
Okay, so if like I have Qlik Sense running on a totally different machine, this is the major setting that allows that connection?
Yeah. Otherwise, you will see an error message saying that you have to enable it.
We have to change it to True. After that, we should look at the File System Allow Path. This tag is quite important, especially for those connectors who download files, because the connector needs access to the file system. You can either allow full access to any path by using the wildcard (*) or you can specify which paths you want to use for the downloads. You have to use the semi-colon (;) to enumerate more than one path.
I see that's a little confusing having the examples right above the setting which is initially by default: blank.
Yeah, usually people tend to mistake this with actual configuration parameters, but the parameter starts after the arrow (->). This is basically not being used by the connector.
Lastly, we have Default Allow IP Addresses. This is also very important if you are using the Web Connector in a multi-node environment because it will allow all the nodes access to the Web Connector. You have two options: use any to allow all the nodes including the new ones if you want to add more nodes. Or you have the other option is to specify the IP Addresses of those nodes. Usually, I tend to prefer to use any. We have some other advanced features.
Yeah, so I see a lot of settings there about security and SSL. And if someone wanted to take advantage of all those security settings, would they go to the Help page to find all that information?
Yeah, they can find it in the Help page in the section called Advanced Qlik Web Connectors Configuration.
How do we access the console here? Could you show us that again?
Now, we are going to run the Web Connector as an application for demonstration purposes. The land page is this one. In case that you are running it as a service, it's the same page. This is the main page. Here you can find all the connectors available.
That's a long list. Would you mind walking us through the steps to set up a connection?
Yeah, we can start by using SharePoint which is here. First of all, what we have to do is authenticate to our SharePoint site using the Can Authenticate table and pressing Parameters.
We can see that we have here the base URL. In this case, we are using Qlik’s SharePoint site. In your case, you will have to use your company SharePoint site. We also have Prompt and Consent level. If you were already using the SharePoint connector, you will have to use None. But if this is the first time that you're using the connector, you should use Consent and using an Azure tenant admin, consent the application. Since we are already allowed access to the application, we are going to use None and continue with the authentication process, which generates this authentication code. Copy to clipboard. Go back to Authentication Code here and paste it and then save. We can run to see if we are authenticated. The Web Connector is allowed to retrieve data.
Okay so we've authenticated ourselves from the connector to our company SharePoint site?
Okay, what's next?
Now we can start by trying to retrieve a list. I already set up a list for the demonstration. It's in here.
Okay, so this is our SharePoint site, and you've got a list there I see?
Yeah. Here in the URL, we can see that we have all this. So, the first part is the site Sub Path.
So here is our site and site Sub Path. So, it usually is always Sites followed by the name of the group that we want to use. After that, we usually find what's the table that we need to use. In our case, since we want to retrieve a list as you can see, we should use the table ‘List.’ But if we want to retrieve document let's say, you we will have to go to the Documents as you can see here. I already put the Site and the Subsite path. And using list. We can run the table, and we can see all the lists that are available.
Okay so, this is a preview of everything it reads from that Subsite?
Yeah, it's reading metadata. So, it's not only reading our list, but everything that gets pulled by the connector.
We already know the name of the list that we want to retrieve. And this is the identifier that we have to use.
Okay, do you need to copy that?
Yeah, we are going to copy this. If you want to retrieve data from a list, it's very important to use one of these tables, because lists are not files; are actually metadata. If you want to use the Get File table, it will fail. So, for example, as you can see: everything is correctly set up and we are going to paste. Bear in mind that this might contain spaces, so you have to delete them, and run the table. And as you can see, we have a Not Found. This might be also a 403 - Not Authorized.
That didn't work because the command was Get File, but you actually pasted the ID of a List, so it doesn't match?
Instead, we are going to use the correct table, which is: List Items from ID. So, the Connector stores what was your last search, so basically that's why we didn't have to paste it again. If we run the table again, we can see that we are able to retrieve the list.
Okay, so it previews the actual list right there.
And if we go to the list, we can see that the information matches.
Okay, how do we get this data in Qlik Sense?
Here, we can see that we have all the instructions to create a connection in Qlik Sense.
Francisco, would you demonstrate for us creating this connection now that you've prepared everything in Web Connectors?
Just following the instructions, we have to copy the URL, and we have to create a web file connection in Qlik Sense. So, we go to the Data Load Editor. Create New Connection. Scroll down until we see Web File. And we have to paste the URL that we copied, and username.
Any name, right?
Any name and create the connection. Also, here in instructions it's mentioned that you have to create a variable with a connection string that you are using. I already done that before, so everything is correctly set up now.
And we only have to copy the script to the clipboard and paste it and make a reload. As you can see, the reload was successful and we are able to retrieve the list.
Francisco, that all seemed to go very smoothly. Just following the instructions, copying, and pasting from Qlik Connectors to Qlik Sense; what should you do when things go wrong?
I prepared an example actually.
We're going to do the same; but in this case, I purposely made an empty list with no data in it. As you can see here, we are going to make the same procedure as we did before.
We are going to look for Empty List. We are going to copy the ID and follow the same procedure as we did before. Delete this, paste. As we mentioned before, we have some spaces. We have to delete them and run the table. The connector is basically saying that there is no data to pull. So usually when this happens, we have to verify in SharePoint that there is actually data in what we are trying to retrieve. There is no data in here, so the connector cannot achieve anything.
How would it be different, Francisco if you're trying to load a file from SharePoint instead of a list?
So, we have here this folder that contains this file. We have to go to List Files. And since we already know the folder: Save Inputs and run the table. We can see here that we have our Excel file and we just need to copy the unique ID. Go back. We have two options: either the Get File or Download File.
We're going to use Get File. Paste the unique ID. Run the table. As you can see, we are able to generate a string.
In case that we want to use it in Qlik Sense, we just need a new connection using this URL.
Would that be a web file connection?
Yeah, it's a web file connection in this case.
What happens if admins encounter an error while trying to set up that connection?
One of the common problems that we are seeing from Support is that sometimes Qlik Sense is failing to reload the data with a 500 error.
In order to troubleshoot that problem, we usually go to the localhost. In this case, we already are here. Try to open the URL. So, as you can see, we are able to download the data. If we open this, we will see the Excel file and all the data that contains. So just copying this URL and going to the node that is failing, pasting in the browser should be the same result as the in the localhost.
That data file that you downloaded, is that the actual XLS file?
Yeah, it doesn't have an extension because it's ready to be used with Qlik Sense.
Okay, that's a great step to test the access to the data. What troubleshooting steps would you take if it doesn't have access?
What we need to do is: go to the home page. Go to Settings. Double check if the allowed IP addresses matches with the deploy.config file. In here, we have ‘Any,’ and also, we have ‘Any’ here. It's not likely that we are going to face this problem, but in case that you have ‘Any’ here and ‘localhost’ here, you will have to change it and then press Save. If you change any parameter here and press Save, there is no need to restart services.
Okay, but it's very important that the settings in the main page here need to match what's in the deploy.config file?
Yeah. Also, if you're using more than one administrator, all the administrators have to have the same allowed IP addresses.
Okay, so that's a very important setting there.
And where would you find the log files if you needed to investigate further?
Go into the home page. Here in the Log Files tab, you can see all the logs. If we open one, for example this one. We can see that it's an XML file. So, for example, when we tried to retrieve the Empty List, we receive ‘No Rows Return’ error message. We can look for the exact same error here in the logs. We can see the error message.
What’s the difference between Qlik Web Connectors for Qlik Sense on Windows versus Web Connectors for Qlik Sense Enterprise SaaS?
The Qlik Web Connectors is standalone. It’s a package that you have to install in the server. As a kindly reminder: always use the latest version. It contains 42 connectors. On the other hand, the Qlik Web Connectors for SaaS it's integrated in Qlik Sense. It's always using the latest version. It contains 33 connectors. It's still growing. Soon it will be available the SharePoint File Connector, so I’m sure that many customers will be happy knowing this.
Yeah definitely. So just to clarify, that whole installation process, configuration that we saw; that's not really necessary in SaaS because it's already built in?
Yeah. Qlik is taking care of that.
To review, what are some basic troubleshooting steps when things go wrong?
First of all, always double check in if you are using the latest version. Then you can check the logs for any error messages.
And lastly, you can check the API limitations of the connector. You can check that in the About button under the Useful Links page.
Okay, because basically the Web Connectors are using the APIs of each individual web source and like Google or Facebook their APIs; and they may change?
Yeah, that's correct.
Where are some resources where admins can find more information?
They can find more information in the help page, and also in the community articles that Support creates.
And again, where can we find the Web Connector download that we started with?
You can go to Qlik Support download site. Look for Qlik Connectors and under the Qlik Connector site, just go to the latest version available.
Okay, now it's time for Q and A. Please submit your questions through the Q&A panel on the left side of your on24 console. Francisco, which question would you like to address first?
So, first we have: do we need to upgrade to the latest version of Qlik Sense to use them?
No, but we strongly suggest to upgrade to the latest version of Qlik Web Connectors.
Moving on to the second one, are all the connectors free along with the Qlik Sense license? Some of the connectors on our site show as premium.
Ah yeah, if you are using a previous version, let say from March 2020 or maybe May 2019 it will appear that they are still premium, but if you upgrade to December 2020 you will see that all appear as free. Also, it’s not only Qlik Sense. If you have a QlikView license and you use the December 2020 version, you will see that the connectors are also free.
Uh, we’ve had trouble connecting to the SharePoint site. What administrative privileges need to be granted to what user?
Probably this question might be related to the when you first start using the SharePoint connector, you have to use an Azure tenant admin to authenticate to the connector; so an application will be created in the tenant site. This might solve the problem that you’re facing.
And we have another question. Does the account running Qlik Sense need to be an administrator on the SharePoint site?
Uh, no, there is no need.
Uh, are all the 42 connectors free to use including SharePoint 365 connector?
Well, I think I already answered this one, yeah. All of them are free to use.
I see some questions that we already answered regarding the license. If you are still seeing the connector is not free to use, you basically need to upgrade to the latest version of the connector.
Does the version of Sense or QlikView matter?
Uh, no. They are not related. As we mentioned during the presentation, the connector is a separate package. It is isolated.
For example, this one is a good one. In a multi-node setup, do I need to install of each node or only on the central node?
You can install the Web Connector only on one node. There is no need to install the Web Connector on each node. This is not like the ODBC package. And you can even install the Web Connector on a different server, as long as it has connectivity to the – to the Qlik Sense Server.
What is the difference between QS Standard and Legacy mode when obtaining the load script?
This is a change regarding to Qlik Sense actually. It’s not related to the Web Connector. The Legacy Mode has some differences when loading the connection strings. You can go to the QMC, after you go to Engines and you can enable or disable the Legacy mode.
We are using a Proxy to connect to object enterprise connections, uh like SharePoint, but it’s possible to activate the Proxy only for some connection types. Example: ActivateProxy for SharePoint online.
Unfortunately, this is a limitation that the connector has. You can only setup one proxy and you cannot select which connectors are using that proxy.
Uh, can Web Connectors be used with Qlik Sense Desktop?
Yeah, they can used in Qlik Sense Desktop. And you can also try them in your Desktop if you want to.
Uh, how can we fetch multiple files from a folder in a SharePoint site?
So unfortunately, this is a current limitation that the connector has. I strongly suggest creating a feature request in the community to raise awareness within the product management.
I saw there’s a couple questions asking about the difference between the REST connector and Web Connectors. You want to address that?
Yeah. Basically, the REST Connector has the same capabilities as the SharePoint connector for example when retrieving data. But the thing is that using the SharePoint Connector is much easier than using the REST connector because all the authentication part is handled by the – by the SharePoint Connector, so it is much easier to use.
A question just came in. Are Web Connectors free for QlikView users as well?
Yes, as long as you are using the latest version.
Is there a connector to Azure?
Yes, we have once connector to Azure Block Storage.
Okay Francisco, we’ve got time for one last question.
Those web connectors have limitation on large volume of data?
Not specifically, since each connector uses a different API. There might exist API limitations, but not the connector itself.
Well thank you very much Francisco.
You're welcome and thanks for everyone for listening. I hope this has helped many people and good luck with your web connections. Feel free to post any questions you might have in the Qlik community. I’m there quite often, and I have written several of the articles on Web Connectors.
Okay great! Thank you everyone! We hope you enjoyed this session. Thank you to Francisco for presenting. We appreciate getting experts like Francisco to share with us. Here is our legal disclaimer. Thank you once again and have a great rest of your day.
A:We are working on fixing the label for the initial release to be Qlik_Sense_setup.exe. We apologize for the inconvenience.
Q: How do I check what version of Qlik Sense I currently have installed?
A:Go to Control Panel > Programs and Features and check the version of Qlik Sense June 2020
Q: How do I check the version of theinstallation I have downloaded?
A: Right click the installation file > Properties > Details
Q: I have GA release 13.82.3 installed. Which patch do I apply?
A:Please install this version of Qlik Sense June 2020 Patch 1. This is the only patch that is compatible with version 13.82.3 and can ONLY be downloaded from this link. This version of the patch is not on the Download site.
Q: I have GA release 13.82.4 installed. Which patch do I apply?
A:Please use the Qlik Sense June 2020 Patch 1 that is listed on the Qlik download site. This is the only patch that is compatible with version 13.82.4 and can ONLY be found on the Qlik Download site.
I used to have access to the Qlik extended download page where I could find and download installation files for all products. Today my access is no lo...
I used to have access to the Qlik extended download page where I could find and download installation files for all products. Today my access is no longer working and I can only see free Qlik products available for download such as QlikView Personal Edition and/or Qlik Sense Desktop.
Note: Before closing the Qlik.Nprinting.Manager.exe command prompt window: Ensure that the backup message "completed successfully" appears. The resulting back up file will be found in"C:\NPrintingBackups"
Part 3: Upgrade the NPrinting server using the steps in the links below and in the order as follows
Part 4: Check that all NPrinting services are running
Open the Windows Services panel and review all Qlik Nprinting services to ensure they are started
Log into NPrinting as usual and begin working
Note that once the upgrade is complete, you will find two automated NPrinting backup files created by the upgrade process that can be found here: C:\ProgramData\NPrinting. The upgrade process creates pre and post upgrade backup files that may be used for disaster recovery purposes. Product Version IDs and Upgrade dates are appended to these files. See examples below:
!For disaster recovery purposes, as a standard industry best practice, it is recommended to perform regular manual backups including the NPrinting repository database. See the following article for NP database backup and restore procedure
Consulting team needs to be contacted when either one of the following is true:
There is a need for step-by-step deployment walk-through assistance.
Consulting team needs to be contacted when either one of the following is true:
There is a need for step-by-step deployment walk-through assistance.
There is interest in Consulting Services and someone would like to get in touch with them.
There are questions about Consulting Services
The assistance needed is of "how-to", "development task", "performance baseline / benchmark", and/or of "health-check" nature and could not be satisfied by Posting to the Qlik Community.
The assistance needed is not of break/fix nature, Feature Request, report of known or potential new product defect, nor an inquiry in reference to information that can be found under published resources such as Knowledge Base, Release Notes, and Qlik Help.
1. Contact the Consulting team at Qlik Consulting Services 2. Download the Qlik Consulting Catalog found in that page. 3. Scroll all the way down and Click CONTACT US
4. If Consulting Contacts cannot be found in the list, contact your Account Manager and/or contact owner if available.
This article explains how users can locate the executable download links for versions Qlik Sense 3.2 or earlier. As always, the full download site is ...
This article explains how users can locate the executable download links for versions Qlik Sense 3.2 or earlier. As always, the full download site is only accessible to licensed Customers, Partners and Internal Employees.
Log into Qlik.com (using a Qlik ID and password credentials)
Once logged in, navigate to Support, then Downloads
Click on the "Get Started" button to enter the full download site
Select Qlik Sensein the Data Analytics menu and filter for Qlik Sense 3.2 and earlier.
If you are still unable to see the download links, please find the links for Qlik Sense 3.2.4. For even earlier releases, please contact Customer Support.