Free searches software for linux

Search::Glimpse is a Perl extension to communicate with Glimpse server.

SYNOPSIS

use Search::Glimpse;

my $glimpse = Search::Glimpse->new;

my @results = $glimpse->search("search this string");

ABSTRACT

This module is an extension to use glimpse server from Perl.

Quick hack to connect to glimpse server.

new

Creates a new glimpse object.

search

Search on a glimpse object

hits

Returns the number of hits...

files

Returns the number of files...

WWW::Search is a collection of Perl modules which provide an API to WWW search engines like WebCrawler, AltaVista, Hotbot, Lycos and so on. Currently WWW::Search includes back-ends for variations of AltaVista, Lycos, and HotBot.

We include two applications built from this library: AutoSearch (an program to automate tracking of search results over time), and a small demonstration program to drive the library. Back-ends for other search engines and more sophisticated clients are currently under development.

WWW::Search includes AutoSearch, an program to automate web-based searches.

Search::FreeText is a free text indexing module for medium-to-large text corpuses.

SYNOPSIS

my $test = new Search::FreeText(-db => [DB_File, "stories.db"]);

$text->open_index();
$text->clear_index();
$text->index_document(1, "Hello world");
$text->index_document(2, "World in motion");
$text->index_document(3, "Cruel crazy beautiful world");
$text->index_document(4, "Hey crazy");
$text->close_index();

$text->open_index();
foreach ($text->search("Crazy", 10)) {
print "$_->[0], $_->[1]n";
};
$text->close_index();

This module provides free text searching in a relatively open manner. It allows a persistent inverted file index to be constructed and managed (within limits), and then to be searched fairly efficiently. The module depends on a DBM module of some kind to manage the inverted file (DB_File is usually the best choice, as it is quite fast, quite scaleable, and accepts the long values that are needed for performance.

The free text searching algorithm used is the BM25 weighting scheme described in Robertson, S. E., Walker, S., Beaulieu, M. M., Gatford, M., and Payne, A. (1995). Okapi at TREC-4, in NIST Special Publication 500-236, the Fourth Text Retrieval Conference (TREC-4), pages 73-96.

Much of the module depends on an open lexical analysis system, which is implemented by Search::FreeText::LexicalAnalysis. This is where all the word splitting and stemming is handled (Lingua::Stem is used for the stemming).

Using the module is quite simple: you can open an index and close it, and while it is open you add documents as strings, each with a key of your own choosing. You can search the corpus using a string, and you get back a list of matches, each an array of your own document key and a relevance measure. So, for example, the keys might be database table keys, URLs, file names, anything like that will do. This makes Search::FreeText a very useful package to implement fairly efficient and high quality search systems.

WWW::Search::YahooNews is a Perl backend for searching Yahoo News.

SYNOPSIS

use WWW::Search; $query = "Bob Hope"; $search = new WWW::Search(YahooNews); $search->native_query(WWW::Search::escape_query($query)); $search->maximum_to_retrieve(100); while (my $result = $search->next_result()) {
$url = $result->url; $title = $result->title; $desc = $result->description;
print
$desc

n"; }

This class is a Yahoo specialization of WWW::Search. It handles making and interpreting Yahoo News Searches. Yahoo allows searching a wide variety of news sources like SEC and PRWire to name a few. http://www.search.news.yahoo.com.

HOW DOES IT WORK?

native_setup_search is called (from WWW::Search::setup_search) before we do anything. It initializes our private variables (which all begin with underscore) and sets up a URL to the first results page in {_next_url}.

native_retrieve_some is called (from WWW::Search::retrieve_some) whenever more hits are needed. It calls WWW::Search::http_request to fetch the page specified by {_next_url}. It then parses this page, appending any search hits it finds to {cache}. If it finds a ``next button in the text, it sets {_next_url} to point to the page for the next set of results, otherwise it sets it to undef to indicate were done.

Search::Dict is a Perl module to search for key in dictionary file.

SYNOPSIS

use Search::Dict;
look *FILEHANDLE, $key, $dict, $fold;

use Search::Dict;
look *FILEHANDLE, $params;

Sets file position in FILEHANDLE to be first line greater than or equal (stringwise) to $key. Returns the new file position, or -1 if an error occurs.

The flags specify dictionary order and case folding:

If $dict is true, search by dictionary order (ignore anything but word characters and whitespace). The default is honour all characters.

If $fold is true, ignore case. The default is to honour case.

If there are only three arguments and the third argument is a hash reference, the keys of that hash can have values dict, fold, and comp or xfrm (see below), and their correponding values will be used as the parameters.

If a comparison subroutine (comp) is defined, it must return less than zero, zero, or greater than zero, if the first comparand is less than, equal, or greater than the second comparand.

If a transformation subroutine (xfrm) is defined, its value is used to transform the lines read from the filehandle before their comparison.