I'm trying to build a view that will show me all the unique words used a field in my product description and am having some challenges. I'm starting by removing all the special characters found in my data (of which I can get most out but not all) and second I'm trying to remove a few "known words" from my list because I don't want to report on common words.
Here's an example:
MAPPING LOAD * INLINE [
This is for a desktop deployment
This is for a new switch to replace ABC-123
"Need to install a new mouse"
Running cable for John & Mike
LOAD * INLINE [
LOAD lower(SubField(MapSubString('SpecialChars',[Summary]),' ')) as Word RESIDENT [Summaries];
LOAD Word AS NewWord
AND NOT Exists(BadWords,Word);
I can't find a way to remove some special characters, especially the Microsoft "long dash" and their fancy quote symbols, as well as the ']' (because it breaks the inline table load)
The remove of the "bad words" isn't working at all - they still show up in my resultant list
Any help would be much appreciated! Thank you in advance!