org.dllearner.algorithms.isle.index

Class Token

java.lang.Object

org.dllearner.algorithms.isle.index.Token

All Implemented Interfaces:

Serializable, Comparable<Token>

public class Token
extends Object
implements Comparable<Token>, Serializable

Author:

Lorenz Buehmann

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
Token(String rawForm)
Token(String rawForm, String stemmedForm, String posTag, boolean isPunctuation, boolean isStopWord)

Method Summary

Modifier and Type	Method and Description
void	addAlternativeForm(String alternativeForm, Double score) Adds a new surface form to the alternative forms of this token.
int	compareTo(Token other)
boolean	equals(Object o)
boolean	equalsWithAlternativeForms(Token other) Compares the given token to this one including alternative forms.
Set<String>	getAlternativeForms() Returns the unmodifiable list of alternative surface forms for this token.
String	getPOSTag()
String	getRawForm()
Map<String,Double>	getScoredAlternativeForms() Returns the map storing the scored alternative forms of this token.
String	getStemmedForm()
int	hashCode()
boolean	isHead()
boolean	isPunctuation()
boolean	isStopWord()
void	setIsHead(boolean isHead)
void	setIsPunctuation(boolean isPunctuation)
void	setIsStopWord(boolean isStopWord)
void	setPOSTag(String posTag)
void	setStemmedForm(String stemmedForm)
String	toString()

Methods inherited from class java.lang.Object

getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

Token

public Token(String rawForm)

Token

public Token(String rawForm,
             String stemmedForm,
             String posTag,
             boolean isPunctuation,
             boolean isStopWord)

Method Detail

getRawForm

public String getRawForm()

Returns:

the rawForm

getStemmedForm

public String getStemmedForm()

Returns:

the stemmedForm

getPOSTag

public String getPOSTag()

Returns:

the posTag

getAlternativeForms

public Set<String> getAlternativeForms()

Returns the unmodifiable list of alternative surface forms for this token. These alternative forms might be generated by, e.g., WordNet synonym expansion.

Returns:

unmodifiable set of alternative surface forms for this token

getScoredAlternativeForms

public Map<String,Double> getScoredAlternativeForms()

Returns the map storing the scored alternative forms of this token.

addAlternativeForm

public void addAlternativeForm(String alternativeForm,
                               Double score)

Adds a new surface form to the alternative forms of this token. Alternative forms are included in comparison of two tokens when using the equalsWithAlternativeForms(org.dllearner.algorithms.isle.index.Token).

isPunctuation

public boolean isPunctuation()

Returns:

the isPunctuation

isStopWord

public boolean isStopWord()

Returns:

the isStopWord

setStemmedForm

public void setStemmedForm(String stemmedForm)

Parameters:

stemmedForm - the stemmedForm to set

setPOSTag

public void setPOSTag(String posTag)

Parameters:

posTag - the posTag to set

setIsPunctuation

public void setIsPunctuation(boolean isPunctuation)

Parameters:

isPunctuation - the isPunctuation to set

setIsStopWord

public void setIsStopWord(boolean isStopWord)

Parameters:

isStopWord - the isStopWord to set

setIsHead

public void setIsHead(boolean isHead)

Parameters:

isHead - the token is the head of the containg sequence of tokens

isHead

public boolean isHead()

Returns:

the isHead

toString

public String toString()

Overrides:

toString in class Object

equalsWithAlternativeForms

public boolean equalsWithAlternativeForms(Token other)

Compares the given token to this one including alternative forms. This means that tokens are considered to be equal iff the POS tags is the same and if the intersection of all surface forms (stemmed forms + alternative forms) is not empty.

Parameters:

other - token to compare this token to

Returns:

true if tokens are equal considering alternative forms, otherwise false

equals

public boolean equals(Object o)

Overrides:

equals in class Object

hashCode

public int hashCode()

Overrides:

hashCode in class Object

compareTo

public int compareTo(Token other)

Specified by:

compareTo in interface Comparable<Token>