org.dllearner.algorithms.isle

Class VSMCosineDocumentSimilarity

java.lang.Object

org.dllearner.algorithms.isle.VSMCosineDocumentSimilarity

public class VSMCosineDocumentSimilarity
extends Object

Imagine an N-dimensional space where N is the number of unique words in a pair of texts. Each of the two texts can be treated like a vector in this N-dimensional space. The distance between the two vectors is an indication of the similarity of the two texts. The cosine of the angle between the two vectors is the most common distance measure.

Author:

Lorenz Buehmann

Field Summary

Fields

Modifier and Type	Field and Description
static String	CONTENT
static org.apache.lucene.document.FieldType	TYPE_STORED

Constructor Summary

Constructors

Constructor and Description
VSMCosineDocumentSimilarity(String s1, String s2)
VSMCosineDocumentSimilarity(String s1, String s2, org.dllearner.algorithms.isle.VSMCosineDocumentSimilarity.TermWeighting termWeighting)

Method Summary

Modifier and Type	Method and Description
static double	getCosineSimilarity(String doc1, String doc2) Returns the cosine document similarity between document doc1 and doc2 using TF-IDF as weighting for each term.
static double	getCosineSimilarity(String doc1, String doc2, org.dllearner.algorithms.isle.VSMCosineDocumentSimilarity.TermWeighting termWeighting) Returns the cosine document similarity between document doc1 and doc2 based on termWeighting to compute the weight for each term in the documents.
static void	main(String[] args)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CONTENT

public static final String CONTENT

See Also:

Constant Field Values

TYPE_STORED

public static final org.apache.lucene.document.FieldType TYPE_STORED

Constructor Detail

VSMCosineDocumentSimilarity

public VSMCosineDocumentSimilarity(String s1,
                                   String s2,
                                   org.dllearner.algorithms.isle.VSMCosineDocumentSimilarity.TermWeighting termWeighting)
                            throws IOException

Throws:

IOException

VSMCosineDocumentSimilarity

public VSMCosineDocumentSimilarity(String s1,
                                   String s2)
                            throws IOException

Throws:

IOException

Method Detail

getCosineSimilarity

public static double getCosineSimilarity(String doc1,
                                         String doc2)
                                  throws IOException

Returns the cosine document similarity between document doc1 and doc2 using TF-IDF as weighting for each term. The resulting similarity ranges from -1 meaning exactly opposite, to 1 meaning exactly the same, with 0 usually indicating independence, and in-between values indicating intermediate similarity or dissimilarity.

Parameters:

doc1 -

doc2 -

Returns:

Throws:

IOException

getCosineSimilarity

public static double getCosineSimilarity(String doc1,
                                         String doc2,
                                         org.dllearner.algorithms.isle.VSMCosineDocumentSimilarity.TermWeighting termWeighting)
                                  throws IOException

Returns the cosine document similarity between document doc1 and doc2 based on termWeighting to compute the weight for each term in the documents. The resulting similarity ranges from -1 meaning exactly opposite, to 1 meaning exactly the same, with 0 usually indicating independence, and in-between values indicating intermediate similarity or dissimilarity.

Parameters:

doc1 -

doc2 -

Returns:

Throws:

IOException

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception