org.licas_text.filter

Class DocCounts

java.lang.Object

org.licas_text.filter.DocCounts

public class DocCounts
extends java.lang.Object

Comparisons based on document frequency not frequency of occurrences in each document.

Author:

Kieran Greer

Field Summary

Fields

Modifier and Type	Field and Description
protected java.util.ArrayList<java.lang.String>	analysedSequenceDocs List of analysed sequence document pairs
protected java.util.ArrayList<java.lang.String>	analysedWordDocs List of analysed word document pairs
protected java.util.HashMap<java.lang.String,java.lang.Float>	docSequences Popular sequences list.
protected java.util.HashMap<java.lang.String,java.lang.Float>	docWords List of most popular words only.

Constructor Summary

Constructors

Constructor and Description
DocCounts() Create a new instance of DocCounts.

Method Summary

Modifier and Type	Method and Description
void	comparePopularWords(java.lang.String docName, java.util.ArrayList<java.lang.String[]> wordList) Update the counts based on the new word list.
void	comparePopularWordSequences(java.lang.String docName, java.util.ArrayList<java.util.ArrayList<java.lang.String[]>> sequenceList) Update the counts based on the new word sequences list.
java.util.ArrayList<java.lang.String[]>	reSortPopularWords(int popularWordsNumber) Re-sort the popular words list so that only the specified top number remain.
java.util.ArrayList<java.lang.String[]>	reSortWordSequences(int popularSequencesNumber) Re-sort the word sequences list so that only the specified top number remain.
java.lang.String	sequencesToString(java.util.ArrayList<java.util.ArrayList<java.lang.String[]>> popularSequences) Convert the stored analysis into a textual format for displaying.
java.lang.String	wordsToString(java.util.ArrayList<java.lang.String[]> popularWords) Convert the stored analysis into a textual format for displaying.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

analysedWordDocs

protected java.util.ArrayList<java.lang.String> analysedWordDocs

List of analysed word document pairs

analysedSequenceDocs

protected java.util.ArrayList<java.lang.String> analysedSequenceDocs

List of analysed sequence document pairs

docWords

protected java.util.HashMap<java.lang.String,java.lang.Float> docWords

List of most popular words only. List of arrays storing word name and count

docSequences

protected java.util.HashMap<java.lang.String,java.lang.Float> docSequences

Popular sequences list. List of list of arrays storing word sequence and count

Constructor Detail

DocCounts

public DocCounts()

Create a new instance of DocCounts.

Method Detail

comparePopularWords

public void comparePopularWords(java.lang.String docName,
                                java.util.ArrayList<java.lang.String[]> wordList)

Update the counts based on the new word list. Only one comparison for each document.

Parameters:

docName - the document name.

wordList - new list of popular words.

comparePopularWordSequences

public void comparePopularWordSequences(java.lang.String docName,
                                        java.util.ArrayList<java.util.ArrayList<java.lang.String[]>> sequenceList)

Update the counts based on the new word sequences list. Only one comparison for each document.

Parameters:

docName - the first document name.

sequenceList - the new list of word sequences.

reSortPopularWords

public java.util.ArrayList<java.lang.String[]> reSortPopularWords(int popularWordsNumber)

Re-sort the popular words list so that only the specified top number remain. Only include if a count > 1.

Parameters:

popularWordsNumber - maximum number to store, but ties carry on.

Returns:

the re-sorted list of words.

reSortWordSequences

public java.util.ArrayList<java.lang.String[]> reSortWordSequences(int popularSequencesNumber)

Re-sort the word sequences list so that only the specified top number remain. Only include if a count > 1.

Parameters:

popularSequencesNumber - maximum number to store, but ties carry on.

Returns:

the re-sorted list of word sequences.

wordsToString

public java.lang.String wordsToString(java.util.ArrayList<java.lang.String[]> popularWords)

Convert the stored analysis into a textual format for displaying.

Parameters:

popularWords - the popular words list.

Returns:

the analysis in a textual format.

sequencesToString

public java.lang.String sequencesToString(java.util.ArrayList<java.util.ArrayList<java.lang.String[]>> popularSequences)

Convert the stored analysis into a textual format for displaying.

Parameters:

popularSequences - the popular word sequences list.

Returns:

the analysis in a textual format.