Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Q&A with Qlik - Qlik Cloud Migration: Questions about migrating to Qlik Cloud? Catch the latest replay!
Ben_Hough_Qlik
Employee
Employee

How flexible routing turned chaotic device streams into real-time analytics gold.

At Qlik Connect 2026, the Qlik Games turned a conference into a live data playground. Every golf swing, bike sprint, and hockey goal fed real-time leaderboards and AI trading cards on big screens across the venue. At the heart of the solution was a deceptively simple but powerful toolkit: Qlik Talend Routes.

bhough_2-1779902894511.png

Routing excels in a variety of rolls like API orchestration and microservices messaging, — but one of its major transformative roles is bridging “tricky” sources that analytics platforms simply can’t reach on their own. That’s exactly what we needed here. Two very different technical headaches, one flexible routing layer, and clean, real-time data flowing into Qlik Open Lakehouse so the rest of the platform could work its magic.

 

The Bike Challenge: High-Velocity Telemetry Trapped in a Time-Series Database

bhough_3-1779902894511.png

 

Bike sensor data from ANT+ devices streamed straight into InfluxDB — a time-series store that no analytics application speaks natively in real time. The Talend Route listened for new events, enriched each one with rider and device context on the fly, and pushed the results forward. In milliseconds, clean, analytics-ready records were landing in Qlik Open Lakehouse via Kinesis, continually populating live leaderboards. What started as raw, high-velocity telemetry became contextualized, queryable data the moment it hit the lakehouse.

 

 

bhough_4-1779902894512.png

 

The Golf Challenge: The JSON File That Refused to Behave

The GSPro golf simulator wrote every stroke into a single .dat file — a JSON array that was completely overwritten after each swing. It was a moving target, not a clean event stream. The Talend Route watched the file for changes, intelligently split the array into individual strokes, filtered out duplicates with idempotency, and enriched each new record with golfer context. Clean JSON records then landed in dated, timestamped S3 folders for Qlik OLH to ingest. What began as a messy, stateful file became a reliable stream of enriched events the platform could trust.

 

Two completely different technical problems — one a high-velocity database listener, the other a file-watching, array-splitting challenge. The same routing layer handled both with ease, delivering the exact same outcome: clean, real-time, context-rich data that Qlik Open Lakehouse could immediately turn into live leaderboards, recent-attempt visuals, and AI trading cards. 

 

The Power of Routing

By absorbing most of the source complexity, Talend Routes let the rest of the architecture shine. No custom one-off scripts. No forcing the analytics layer to become an ETL engine. Just flexible integration that made “impossible” sources behave like well-behaved, contextualized events on standard channels.

This matters more than it first appears. In a modern open lakehouse architecture — Apache Iceberg on S3, decoupled storage and compute, spot-instance economics — the routing layer becomes the quiet enabler that lets every other component do what it does best. The bike route turned a time-series database into a streaming source. The golf route turned a constantly-rewritten file into partitioned, idempotent events. Both fed the same downstream system without any special handling on the analytics side. That’s the real leverage: routing doesn’t just move data; it normalizes chaos so the platform can deliver speed, scale, and cost efficiency at the same time.

 

 

Conclusion

Key Takeaways

  • When real-time sources are inaccessible or awkwardly formatted, routing is often the cleanest bridge.
  • Different sources deserve different patterns — the right tool lets you choose without compromising the destination.
  • Enrichment at the routing layer keeps downstream systems simple and fast.
  • Small capabilities (idempotency, file streaming, dated partitioning) deliver outsized reliability and value.

 

The Bottom Line

Talend Routes turned sensor data that no analytics application could have consumed directly into the rhythm of Qlik Connect 2026. The same flexible approach scales far beyond conferences — it’s how modern data teams turn messy, real-world sources into governed, analytics-ready pipelines at production scale. Whether you’re dealing with device streams, legacy files, or anything else that feels just out of reach, routing could be the answer.

 

More about the Qlik Games:

https://www.qlik.com/blog/inside-the-qlik-games-how-we-turned-qlik-connect-2026-into-a-live-data-pla...

1 Comment
PabloLabbeImaps
Partner Ambassador
Partner Ambassador

Awesome work and a great showcase about how Qlik can leverage real time ingestion in Qlik Open Lakehouse.

146 Views