org.licas_text.search

Class SearchEngine

java.lang.Object

org.licas_text.search.SearchEngine

public class SearchEngine
extends java.lang.Object

This class acts as a search engine over the Web. This can be used to perform a vendor search or to analyse content from a specific number of pages. Usable as is, but may get updated.

Author:

Kieran Greer

Constructor Summary

Constructors

Constructor and Description
SearchEngine() Create a new instance of SearchEngine

Method Summary

Modifier and Type	Method and Description
java.util.ArrayList<SearchResult>	analyse(SearchInfo searchInfo) Perform a search based on the configuration and return the resulting analysis.
java.util.ArrayList<SearchResult>	search(SearchInfo searchInfo) Perform a search based on the configuration and return the resulting parsed content.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SearchEngine

public SearchEngine()

Create a new instance of SearchEngine

Method Detail

search

public java.util.ArrayList<SearchResult> search(SearchInfo searchInfo)
                                         throws java.lang.Exception

Perform a search based on the configuration and return the resulting parsed content. This uses a vendor search engine to analyse search results for a specified number of pages. Each search page is added as a separate document, when it can be parsed later to extract hyperlinks, for example.

Parameters:

searchInfo - the search configuration info.

Returns:

the search results as a list of parsed web pages. Each element of the list is a SearchResult object that contains the web page url, page html content and a list of parsed hyperlinks.

Throws:

java.lang.Exception - any error.

analyse

public java.util.ArrayList<SearchResult> analyse(SearchInfo searchInfo)
                                          throws java.lang.Exception

Perform a search based on the configuration and return the resulting analysis. This starts at the page indicated, reads it and retrieves all URLs embedded in that page. It then reads those pages and retrieves all URLs embedded in them as well, up to a maximum number of pages. So x extra levels deep.

Parameters:

searchInfo - the search configuration info.

Returns:

the search results as a list of SearchResult objects.

Throws:

java.lang.Exception - any error.