TokenCollectionExtension extension

Extension methods on a collection of Token.

on

• Iterable<Token>

Properties

allTerms → List<String>

Available on Iterable<Token>, provided by the TokenCollectionExtension extension

Returns a list of all the terms from the collection of Tokens, in the same order as they occur in the SourceText.

no setter

terms → Set<String>

Available on Iterable<Token>, provided by the TokenCollectionExtension extension

Returns the set of unique terms from the collection of Tokens.

no setter

Methods

byTerm(Term term) → Iterable<Token>

Available on Iterable<Token>, provided by the TokenCollectionExtension extension

Filters the collection for tokens with Token.term == term.

firstPosition(Term term) → int

Available on Iterable<Token>, provided by the TokenCollectionExtension extension

Returns the lowest Token.termPosition where Token.term == term.

kGrams([int k = 2]) → Map<KGram, Set<Term>>

Available on Iterable<Token>, provided by the TokenCollectionExtension extension

Returns a hashmap of k-grams to terms from the collection of tokens.

lastPosition(Term term) → int

Available on Iterable<Token>, provided by the TokenCollectionExtension extension

Returns the highest Token.termPosition where Token.term == term.

termCount(Term term) → int

Available on Iterable<Token>, provided by the TokenCollectionExtension extension

Returns the count where Token.term == term.