Updated: (LUCENE-1024) MarkovChainTokenFilter

     [ https://issues.apache.org/jira/browse/LUCENE-1024?page=co
m.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Karl Wettin updated LUCENE-1024:
--------------------------------

    Attachment:     (was: LUCENE-1024.txt)

> MarkovChainTokenFilter
> ----------------------
>
>                 Key: LUCENE-1024
>                 URL: htt
ps://issues.apache.org/jira/browse/LUCENE-1024
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Analysis, Term Vectors
>            Reporter: Karl Wettin
>            Priority: Minor
>
> Merges chains of tokens to a single token, ngrams on a
phrase word level rathar than on a word character level.
> Quite useful for text mining purposes of the vector
space.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue
online.


------------------------------------------------------------
---------
To unsubscribe, e-mail: java-dev-unsubscribelucene.apache.org
For additional commands, e-mail: java-dev-helplucene.apache.org