Free search http software for linux

DGS Search was created to provide an easy to install search utility capable of handling filesystem and database searches on UNIX and Windows based platforms.

DGS Search is aimed at supporting the small to medium sized web site.

Search::ContextGraph is a Perl module for spreading activation search engine.

SYNOPSIS

use Search::ContextGraph;

my $cg = Search::ContextGraph->new();

# first you add some documents, perhaps all at once...

my %docs = (
first => [ elephant, snake ],
second => [ camel, pony ],
third => { snake => 2, constrictor => 1 },
);

$cg->bulk_add( %docs );

# or in a loop...

foreach my $title ( keys %docs ) {
$cg->add( $title, $docs{$title} );
}

# or from a file...

my $cg = Search::ContextGraph->load_from_dir( "./myfiles" );

# you can store a graph object for later use

$cg->store( "stored.cng" );

# and retrieve it later...

my $cg = ContextGraph->retrieve( "stored.cng" );


# SEARCHING

# the easiest way

my @ranked_docs = $cg->simple_search( peanuts );


# get back both related terms and docs for more power

my ( $docs, $words ) = $cg->search(snake);


# you can use a document as your query

my ( $docs, $words ) = $cg->find_similar(First Document);


# Or you can query on a combination of things

my ( $docs, $words ) =
$cg->mixed_search( { docs => [ First Document ],
terms => [ snake, pony ]
);


# Print out result set of returned documents
foreach my $k ( sort { $docs->{$b} $docs->{$a} }
keys %{ $docs } ) {
print "Document $k had relevance ", $docs->{$k}, "n";
}

# Reload it
my $new = Search::ContextGraph->retrieve( "filename" );

Spreading activation is a neat technique for building search engines that return accurate results for a query even when there is no exact keyword match. The engine works by building a data structure called a context graph, which is a giant network of document and term nodes. All document nodes are connected to the terms that occur in that document; similarly, every term node is connected to all of the document nodes that term occurs in. We search the graph by starting at a query node and distributing a set amount of energy to its neighbor nodes. Then we recurse, diminishing the energy at each stage, until this spreading energy falls below a given threshold. Each node keeps track of accumulated energy, and this serves as our measure of relevance.

This means that documents that have many words in common will appear similar to the search engine. Likewise, words that occur together in many documents will be perceived as semantically related. Especially with larger, coherent document collections, the search engine can be quite effective at recognizing synonyms and finding useful relationships between documents. You can read a full description of the algorithm at http://www.nitle.org/papers/Contextual_Network_Graphs.pdf.

The search engine gives expanded recall (relevant results even when there is no keyword match) without incurring the kind of computational and patent issues posed by latent semantic indexing (LSI). The technique used here was originally described in a 1981 dissertation by Scott Preece.

Socks via HTTP provides a socks tunnel via HTTP.

Socks via HTTP is a program converting SOCKS requests into HTTP requests and tunnelling them through HTTP proxies if needed.

The SOCKS protocol allows programs to traverse firewalls on any port number and is used by many popular programs, like Napster, MSN Messenger, CRT(telnet client) and many others.

Many companies restrict firewall traversals only to HTTP requests, disabling SOCKS proxy.

Socks via HTTP provides a miniature SOCKS server for the SOCKS client, performing its connection through an HTTP proxy to a remote server, which establishes the real connection.

Socks via HTTP is 100% Java, and can run on any OS. It is entirely written in Java.

Yahoo::Search is a Perl interface to the Yahoo! Search public API.

The following search spaces are supported:

Doc
Common web search for documents (html, pdf, doc, ...), including Y!Q contextual search.

Image
Image search (jpeg, png, gif, ...)

Video
Video file search (avi, mpeg, realmedia, ...)

News
News article search

Local
Yahoo! Local area (ZIP-code-based Yellow-Page like search)

Terms
A pseudo-search to report the important search terms from the provided content or content+query.

Spell
A pseudo-search to fetch a "did you mean?" spelling suggestion for a search term.

Related
A pseudo-search to fetch "also try" related-searches for a search term.

(Note: what this Perl API calls "Doc" Search is what Yahoo! calls "Web" Search. But gee, arent all web searches "Web" search, including Image/News/Video/etc?)

Yahoo!s raw API, which this package uses, is described at:

http://developer.yahoo.net/

WWW::Search::HotJobs is a Perl class for searching HotJobs.

SYNOPSIS

require WWW::Search;
$search = new WWW::Search(HotJobs);

This class is an HotJobs specialization of WWW::Search. It handles making and interpreting HotJobs searches http://www.HotJobs.com.

This class exports no public interface; all interaction should be done through WWW::Search objects.

OPTIONS

None at this time (2001.04.25)

search_url=URL

Specifies who to query with the HotJobs protocol. The default is at http://www.HotJobs.com/cgi-bin/job-search.

search_debug, search_parse_debug, search_ref Specified at WWW::Search.

HOW DOES IT WORK?

native_setup_search is called before we do anything. It initializes our private variables (which all begin with underscores) and sets up a URL to the first results page in {_next_url}.

native_retrieve_some is called (from WWW::Search::retrieve_some) whenever more hits are needed. It calls the LWP library to fetch the page specified by {_next_url}. It parses this page, appending any search hits it finds to {cache}. If it finds a ``next button in the text, it sets {_next_url} to point to the page for the next set of results, otherwise it sets it to undef to indicate were done.

Answers.com Search is a Superkaramba theme that searches Answers.com.

If you tried this theme before and it doesnt works for you, please try this new version since it fixes a major problem that used to prevent the theme from working.

WWW::Search::Dice is a class for searching Dice.

SYNOPSIS

use WWW::Search;
my $oSearch = new WWW::Search(Dice);
my $sQuery = WWW::Search::escape_query("unix and (c++ or java)");
$oSearch->native_query($sQuery,
{method => bool,
state => CA,
daysback => 14});
while (my $res = $oSearch->next_result()) {
if(isHitGood($res->url)) {
my ($company,$title,$date,$location) =
$oSearch->getMoreInfo($res->url);
print "$company $title $date $location " . $res->url . "n";
}
}

sub isHitGood {return 1;}

This class is a Dice specialization of WWW::Search. It handles making and interpreting Dice searches at http://www.dice.com.

By default, returned WWW::SearchResult objects contain only url, title and description which is a mixture of location and skills wanted. Function getMoreInfo( $url ) provides more specific info - it has to be used as

my ($company,$title,$date,$location) =
$oSearch->getMoreInfo($res->url);