Finding the highest word count. To identify trends.

[bnelson111]

As I'm sure most people will have a problem with unstructed text fields, for example some people may write two sentences in a comment field while others 3 words or one. I'm looking a way to interrogate a field which may contain 1 word to 5 sentences or more to try and find the most commonly used words, so that we can attempt to discover failure trends.

For example.

Operator Comments	Machine	Job Number
Station 3 problems	Press 1	12345
Failure on Station issues	Press 2	23233
Spill on Station	Press 1	3232323
Working hard all day and Station issues.

I want to display counts:-

Station = 4

issues = 2

on = 2

All others count1?

There are 1000's of comments so may be best not to have any fix in the script. Also the keys words will change based on date ranges. Any ideas? Thanks.

[maxgro]

maybe some help in a similar discussion here

word clouds

[bnelson111]

Was hoping to have just a count within qlikview if at all possible.

[swuehl]

Well, John's example in that referenced thread does the word count within QV only, right?

[MarcoWedel · Accepted solution]

Hi,

one solution at script level:

LOAD SubField(PurgeChar([Operator Comments],'.'), ' ') as Word
FROM [http://community.qlik.com/thread/123629]
(html, codepage is 1252, embedded labels, table is @1);

hope this helps

regards

Marco

[bnelson111]

Brilliant!!! Thanks