Is there a limit on String Field character size?

[Mary-Joicelin]

Dear Team, 

We are using Qlik SaaS (BYOK). When I was loading the data in a qvd file, from S3 data lake, using Athena Connector. 

I have noticed that a string field is broken in the qvd file. i.e. If the string is longer, it has loaded only up to 254 characters.

Is there a limit on number of characters in a field's value? If yes, is there a workaround to load the whole value of the filed?

[Albert_Candelario · Accepted solution]

Hello @Mary-Joicelin ,

This reminds me of this:

https://community.qlik.com/t5/Official-Support-Articles/MongoDB-connector-limits-text-field-to-255-c...

Also for reference:

https://exasol.my.site.com/s/article/String-length-exceeds-limit-of-255-characters-in-AWS-ATHENA?lan...

I hope this give a hint.

Cheers,

Albert

[Mary-Joicelin · Accepted solution]

Thanks Albert! Indeed, the parameter set to 255. I will change the stringColumnLegnth.

Thanks a lot! Much appreciated! 

Warm regards

Mary Joicelin J

[Albert_Candelario]

Excellent @Mary-Joicelin 

Cheers,

Albert

[oli_hardy]

Hi @Albert_Candelario 

Are you aware of any restriction or setting options regarding field length by fetching data over the data gateway? 
In the connector setting (postgressql) the max field length is the default value of 4096. But only a max 255 characters comes through.

[Albert_Candelario]

Hello @oli_hardy,

Is this still an issue for you? If yes, let's open a new thread and we will have a look and see this with the rest of the Community.

Cheers,

Albert

[oli_hardy · Accepted solution]

Hi Albert.

Thanks for your response and your offering for help.

Fortunately my issue could be resolved. This article helped me to find a way to fetch more characters ( https://community.qlik.com/t5/App-Development/Does-column-length-in-SQL-SF-table-matter-when-reading...) 

I had to adjust some settings in the connector: disable "enable bulk reader" and setting advanced parameter: useBulkReader to false

[Albert_Candelario]

Great @oli_hardy !