Tokenize 001234 as 1234. Include a testing function in NoiseFilter to figure out...
commitd21e4f67014d5efdcaef38319e80052994f18fcc
authordbera <dbera>
Sat, 25 Nov 2006 02:45:46 +0000 (25 02:45 +0000)
committerdbera <dbera>
Sat, 25 Nov 2006 02:45:46 +0000 (25 02:45 +0000)
treed4ec3fe084d67e36c420850cab66e0c304d83d3e
parente613dd8e66eea69c506bb9f3094a66d647b0caff
Tokenize 001234 as 1234. Include a testing function in NoiseFilter to figure out what/how words are tokenized.
beagled/LuceneCommon.cs
beagled/NoiseFilter.cs