Hello,
I am writing a plugin for Qlik using Python 3.6.4. It takes a large amount of data passed to it from Qlik Sense Desktop through an open port. Once the data has been taken through the port, the Python program then converts the data handed to it from the Qlik Sense into a Python data format by essentially looping through the data. The problem is that this process takes about 2 minutes which is a rather long time compared to the rest of the program. Does anyone have any tips on how to speed up the data conversion process?
If it helps, I am already using maps to speed up part of the looping process and I have provided a snippet of the relevant part of my code below.
Here is a snippet of the relevant part of my code:
Note: request is the data sent to it by Qlik Sense, the data is 4 columns of data storing these items in this order: date, serial number, item name and item value. The date, serial, item_name and item_val variables are lists that correspond to the items passed to it by Qlik Sense.
for rows in request:
'''
This section still needs work to improve its efficiency.
'''
date += list(map(lambda c: dt.strptime(c.duals[0].strData,'%d/%m/%Y %H:%M:%S'),rows.rows))
serial += list(map(lambda c: c.duals[1].numData,rows.rows))
item_name += list(map(lambda c: c.duals[2].strData,rows.rows))
item_val += list(map(lambda c: c.duals[1].numData,rows.rows))
Thanks,
Matt
