Free search engine software for linux

iSearch engine project is an internal web site search engine.
Built to run as a CGI module, iSearch performs a searching for one or more character sequences ( terms ) within documents in a web site, without the needing of external indexing and filtering tools, like, for example, a database engine.
iSearch performs a real time elaboration of HTML documents in a web site, every time it is invoked. Documents are found, filtered from unnecessary parts, like HTML tag, and then inspected searching for the input terms.
iSearch acts under the directives set in its configuration file. You can set one or more starting search path, exclude file or directories from scanning, set your own output templates, and so on.
So if you want to add an internal search engine in your web site, iSearch is one of your possible solutions.
iSearch is written in C and the source code is based on Yed technology.
Main features:
- iSearch is a CGI module written in C, available for both GNU/Linux and Windows environment.
- iSearch latest release has been developed and tested within an Apache HTTP server. OS involved are Slackware GNU/Linux and Windows XP SP2, both on a i686 architecture.
- When invoked, iSearch scans recursively directories in a web site extracting files so-called documents. In every document extracted, iSearch performs a filtering to delete unnecessary information, like HTML tags. Then, the pure resulting text is inspected searching for the characters sequences received in input, so-called terms.
- A term can be a single word, but also a sequence of words enclosed with character "; in this latter case, the sequence will be treated as a single term ( i.e. "sowing the seeds of love" ).
- All documents containing all the terms will be output according to user templates and related environment.
- All terms are matched in boolean AND mode: only a document containing all terms is considered as a matched document.
- All terms are matched in case-insensitive mode.
Enhancements:
- The ID Input parameter is now optional.
- If omitted, it defaults to the first < root > element of the configuration.
- Handling of eventual error explanation string was added in displaying error templates, through the new token "%det".
- Its now possible to search for strings enclosed with quotation marks (").
- The source code has been totally reorganized.
- The < replace > element was added in the configuration file.
- This element contains a list of strings to replace or cut from documents to inspect.

ALTSE is an alternative search engine technology.

It can index up to a couple million Web sites.

A search engine is a program designed to help find information stored on a computer system such as the World Wide Web, or a personal computer.

The search engine allows one to ask for content meeting specific criteria (typically those containing a given word or phrase) and retrieves a list of references that match those criteria.

Search engines use regularly updated indexes to operate quickly and efficiently. Without further qualification, search engine usually refers to a Web search engine, which searches for information on the public Web.

Other kinds of search engine are enterprise search engines, which search on intranets and personal search engines, which search individual personal computers.

Some search engines also mine data available in newsgroups, large databases, or open directories like DMOZ.org. Unlike Web directories, which are maintained by human editors, search engines operate algorithmically.

Most web sites which call themselves search engines, are actually front ends to other search engines owned by other companies. The typical user will often not know which underlying search engine they are using.

Kat is an application for KDE designed to index files. Meta information, fulltext and thumbnails are extracted from documents, images, mp3 and other media allowing quick and accurate information retrieval.
Similar to the Windows application WhereIsIt, but also similar to Google Desktop Search, Kat is completely written in C++, using Qt3, KDE and KIO libraries.
The application is based on the extensible kfile plugin architecture of KDE in order to facilitate the creation of new media managers for emerging file formats.
Kat is the first KDE application using the new fulltext kfile plugins.
Information retrieval relies on the powerful SQLite3 embedded database engine.
Supported document formats for full text search:
Documents:
- Adobe PDF Portable Document Format (1.5)
- DOC Microsoft Word Document (2, 6, 7, 97, 2000, 2002 and 2003)
- HTML HyperText Markup Language
- SXW OpenOffice 1.3 Writer Text Document
- SXI OpenOffice 1.3 Impress Presentation
- SXC OpenOffice 1.3 Calc Spreadsheet
- SXM OpenOffice 1.3 Math Formula
- ODT OpenOffice 2.0 Writer Text Document
- ODP OpenOffice 2.0 Impress Presentation
- ODC OpenOffice 2.0 Calc Chart
- ODF OpenOffice 2.0 Math Formula
- Plain Text
Images:
- BMP
- CGM
- DCX
- DIB
- FAX
- GIF
- ICO
- JPEG
- PBM
- PCD
- PCX
- PDB
- PGM
- PICT
- PIX
- PNG
- RGB
- RLE
- TGA
- TIF
- ...and other

MKSearch provides a Web metadata spider and search engine.

MKSearch is a metadata search engine that indexes structured metadata in Web documents instead of free text in the document body.

The data acquisition system conforms to the Dublin Core metadata in HTML recommendations, and supports other application profiles, such as the UK e-Government Metadata Standard.

It also indexes native RDF formats, including RSS 1.0. The system has five major components: a Web crawler, an HTML document validator and formatter, a set of custom indexers, an RDF storage and query system, and a public query interface, provided through a standard servlet container.

System composition

The MKSearch system is composed of several other free software components. Further details are provided in the MKSearch development plans.

JSpider
JSpider is a Java Web crawler engine that has pluggable interfaces that can be used to add custom processing and content handling. MKSearch uses custom SAX-based content handlers for extracting metadata from Web documents.

Sesame
Sesame is a set of RDF processing and storage APIs and applications that includes RDF data query facilities. MKSearch uses Sesame to store indexed metadata in RDF format and to search the repository via the public query interface.

JTidy
JTidy is a utility for correcting common HTML markup errors and is used to convert HTML documents to XHTML so they can be processed using SAX.

phpSearch provides a single-table search engine with a customizable query form.

phpSearch is a PHP3 application that allows you to easily insert a search engine into your Web site. The search engine that phpSearch provides is based on a MySQL database.

phpSearch supports single-table searches.

It will generate a search-form dynamically, and will return the resulting list of matching records with selected fields.

crapsearch project enhances privacy by polling targeted Web search engines with random search terms. It does not flood search engines, but can help disguise your real search habits and prevent the creation of meaningful search logs and user tracking.

It uses local dictionaries, personal favorite lists, and Web news as sources for random search terms. crapsearch also takes a little care to make differentiation from your real browser (and therefore real searches) difficult.

pro-search is a crawler for FTP servers, SMB shares, HTTP servers, and DC++ networks.