Hello and Welcome to the Cloudera integration site in Community! Please browse around the content, try the demos and  ask any questions you have around Qlik and Cloudera integration.

Go to http://cloudera.qlik.com to learn more!

Below is a  list of the current "15 Points of Integration"  that we are showcasing with Cloudera.

Google Cloud Platform

The Google Cloud Platform (GCP) contains many components and capabilities that are directly relevant to a deployment of Qlik software. This non-exhaustive list catalogs some of the commonly used services. More detail can be found at https://cloud.google.com/products/

Relational Datasources

These may be accessed using the corresponding ODBC driver that may be downloaded from Google, or often using one of the drivers in the Qlik ODBC Connector package that is embedded in Qlik Sense.

https://help.qlik.com/en-US/connectors/Subsystems/ODBC_connector_help/Content/Connectors_ODBC/Introduction/ODBC-connector.htm

• BigQuery (GBQ) – a fully managed, highly scalable data warehouse with built-in Machine Learning.
  https://cloud.google.com/bigquery/
  https://cloud.google.com/bigquery/partners/simba-drivers/
• Cloud SQL – a fully managed database service that makes it easy to setup, manage and administer PostgreSQL and MySQL databases in the cloud
  • Cloud SQL for PostgreSQL
    https://cloud.google.com/sql/docs/postgres/
    https://www.postgresql.org/download/windows/
  • Cloud SQL for MySQL
    https://cloud.google.com/sql/docs/mysql/
    https://dev.mysql.com/downloads/connector/odbc/

Infrastructure

• Storage
  • Persistent Disk – durable and high performance block storage (SSD & HDD) that may be attached to instances of Google Compute Engine (Virtual Machines) or Google Kubernetes Engine (Containers)
    https://cloud.google.com/persistent-disk/
  • Cloud Filestore – a managed Network Attached Storage (NAS) solution that supports NFS client connectivity (basically Linux only)
    https://cloud.google.com/filestore/
  • Cloud Storage (GCS) – Object storage with global edge-caching. May be used for CLOB artifacts such as extractions from BigQuery but not suitable as a fileserver.
    https://cloud.google.com/storage/
• Compute
  • Compute Engine (GCE) – Virtual Machines running in Google data centers. This is the simplest step towards Cloud whereby you no longer manage Hardware, but you do still have to maintain (patch) the Operating System and manage all applications on the host. QlikView and Qlik Sense Enterprise for Windows require Compute Engines.
    https://cloud.google.com/compute/
  • Kubernetes Engine (GKE) – Containerized Application Management. Containers are a step beyond Compute Engines, in which you no longer maintain the [typically Linux] Operating System, but only configure how many Containers your Application runs in. Qlik Sense Enterprise for Elastic runs in Kubernetes-managed Containers.
    https://cloud.google.com/kubernetes-engine
• Network
  • Virtual Private Cloud (VPC) – a private space within Google Cloud Platform.
    https://cloud.google.com/vpc/
  • Load Balancer – put your resources behind a single anycast IP and scale your resources up or down with intelligent Autoscaling.
    https://cloud.google.com/load-balancing/
    
    The Google HTTP(S) Load Balancer has a session timeout that is satisfactory for QlikView but not suitable for use with Qlik Sense which requires long duration websocket connections. Use the TCP Load Balancer with Qlik Sense.
    https://cloud.google.com/load-balancing/docs/https/
    https://cloud.google.com/load-balancing/docs/tcp/
  • Cloud VPN – extend your on-premises network to Google’s network through an IPsec VPN tunnel. Useful for making your on-premise Active Directory available in your VPC or providing access to on-premise database from Qlik Sense.
    https://cloud.google.com/vpn/

Additional Products

Many additional Google Cloud capabilities may also be used in relation to Qlik but are not directly discussed in this document. Much more can be seen at https://cloud.google.com/products/

• Data Transfer – pull data from Google Ad Manager, Youtube, Google Play and some other services directly into Google BigQuery
  https://cloud.google.com/bigquery/docs/enable-transfer-service
  https://cloud.google.com/dataflow/
• Data Preparation – use Trifacta as a managed service within Google Cloud Platform to explore your data (CSV, JSON, or relational table formats) and prepare it for consumption.
  https://cloud.google.com/dataprep/
• NoSQL Datasources
  • Google BigTable – a PetaByte-scale, fully managed NoSQL database service for large analytical and operational workloads
    https://cloud.google.com/bigtable/
  • Cloud DataStore - highly scalable NoSQL database.
    https://cloud.google.com/datastore/
  • Firebase (Beta) Realtime Database – a JSON datastore that lets you store and sync data amongst your users in realtime.
    https://firebase.google.com/products/realtime-database/
  • FireStore – NoSQL database built for global apps
    https://cloud.google.com/firestore/

GCP-Qlik Dependency Matrix

Further detail can be found in additional Qlik Community documents:

• QlikView Server & Publisher
• Qlik Sense Enterprise for Windows
• Qlik Sense Multi-Cloud
• Qlik Sense Enterprise for Elastic

Several core and underlying infrastructure decisions need to be made and deployed before beginning the Qlik implementation, particularly the Network Tier where the Virtual Private Cloud is organized (address ranges chosen, connectivity with any on-premise datacenter established).

Connectivity between Qlik components, to Datasources and interaction with the Persistence Tier is highly dependent on how the customer has configured their Cloud Network (use of Public or only VPC-internal addresses, requirement for Proxy components, Firewall rules).

Is the Presentation or Web Tier going to be made publicly accessible via the Load Balancers using Public IP Addresses, or is access to the solution available only from the on-premise network and via additional end-user VPN Connectivity?

The customer must also give serious consideration to Identity and Access Management. How will users authenticate when accessing the Qlik solution? Does this require replication of Active Directory into a cloud component, or is there already a SAML Identity Provider that can be integrated with Qlik? Many other possibilities are also viable.

Readers are strongly advised to seek guidance from both Qlik Consulting and their account-specific GCP team to research options that are applicable within their specific IT & Security constraints.  Some customers are commencing their transition to Cloud and making decisions that could have long-lasting implications or are negatively disruptive to adjust later.

The Design that is chosen may vary from the guidance in this document and should be clearly documented and agreed by all parties BEFORE commencing implementation.