Fine tuning the output of KWE

Lothar Lemnitzer — Wed, 27 Jun 2007 13:14:08 -0000

I checked the KWE output for all languages wrt to patterns of unwanted keywords.
Here are some suggestions. Please, remove
0. All words which appear more than once
1. all strings of lower case character and or punctuation signs up to a length of three. Remark: I doubt that a good keyword has only three (lower case) characters or less. Upper case should be excluded here, cf. XP, XML etc. Any other counterexamples???
2. all strings which contain digits. Stricter version: strings which do include digits but do not end in one (in case we would like to include Win2000, Win98 etc.)
3. Strings which contain one of the following punctuation characters --> ., &, ,, /,(,),[,],%,*,<,>,%,+,:,", _ Remark: the following punctuation signs can be part of words and words containing them should be kept: §, ' (singlequote), - (dash)

These three rules should do a decent job

Recent changes to 32: Fine tuning the output of KWE

Fine tuning the output of KWE