Free external site catalog software for linux

External Site Catalog allows you to index and search external sites in a Plone site.

ExternalSiteCatalog is a web crawler that can index external sites and make them searchable in Plone.

You can specify the sites to index in a Plone Configlet, and directly index them from Plone, or let a scheduler do the job.

Searching the external sites is done in a special portlet that is installed with ExternalSiteCatalog.

External sites are not searchable in the normal Plone catalog, but are only available in a separate catalog in the portal_externalcatalog tool.

external IP shows your current external IP in the browsers statusbar.

External IP is set to check your IP address once every hour.

Bundle::Catalog is a bundle to install all Catalog related modules.

SYNOPSIS

perl -MCPAN -e install Bundle::Catalog

This bundle includes all the modules used by the Perl Catalog module.

A Bundle is a module that simply defines a collection of other modules. It is used by the CPAN module to automate the fetching, building and installing of modules from the CPAN ftp archive sites.

Contentment::Catalog is a Perl module to provides categorization and indexing features.

SYNOPSIS

# Get a list of the available indexes
my @indexes = $context->catalog->indexes;

for my $index (@indexes) {

# Get a list of avilable terms
my @terms = $index->terms;

for my $term (@terms) {

# Get a list of generators
my @generators = $index->generators;

}

}

One frequently controversial component of a CMS is the categorization system. Contentment attempts to avoid this problem by providing a framework for building categorization systems so that any controversy just leads to the replacement of whatever system someone doesnt like.
That is, rather than create some all encompassing categorization system or some dead-simple one that your grandma who thinks the boogey-man is going to jump out of the her CD-ROM drive can use, you can have either or both or neither depending upon your need. Thus, instead of providing a category or taxonomy system, Contentment provides the indexing system, which allows you to implement whatever category system you prefer.

Sort::External is a Perl module that can sort huge lists.

SYNOPSIS

my $sortex = Sort::External->new( -mem_threshold => 2**24 );
while ( ) {
$sortex->feed($_);
}
$sortex->finish;
while ( defined( $_ = $sortex->fetch ) ) {
&do_stuff_with($_);
}

Problem: You have a list which is too big to sort in-memory.
Solution: "feed, finish, and fetch" with Sort::External, the closest thing to a drop-in replacement for Perls sort() function when dealing with unmanageably large lists.

How it works:

Cache sortable items in memory. Periodically sort the cache and empty it into a temporary sortfile. As sortfiles accumulate, interleave them into larger sortfiles. Complete the sort by sorting the input cache and any existing sortfiles into an output stream.

Note that if Sort::External hasnt yet flushed the cache to disk when finish() is called, the whole operation completes in-memory.

In the CompSci world, "internal sorting" refers to sorting data in RAM, while "external sorting" refers to sorting data which is stored on disk, tape, punchcards, or any storage medium except RAM -- hence, this modules name.

Stringification

Items fed to Sort::External will be returned in stringified form (assuming that the cache gets flushed at least once): $foo = "$foo". Since this is unlikely to be desirable when objects or deep data structures are involved, Sort::External throws an error if you feed it anything other than simple scalars.

Taint and UTF-8 flags

Expert: Sort::External does a little extra bookkeeping to sustain each items taint and UTF-8 flags through the journey to disk and back.

METHODS

new()
my $sortscheme = sub { $Sort::External::b $Sort::External::a };
my $sortex = Sort::External->new(
-mem_threshold => 2**24, # default: 2**20 (1Mb)
-cache_size => 100_000, # default: undef (disabled)
-sortsub => $sortscheme, # default sort: standard lexical
-working_dir => $temp_directory, # default: see below
);

Construct a Sort::External object.

-mem_threshold -- Allow the input cache to consume approximately -mem_threshold bytes before sorting it and flushing to disk. Experience suggests that the optimum setting is somewhere between 2**20 and 2**24: 1-16Mb.
-cache_size -- Specify a hard limit for the input cache in terms of sortable items. If set, overrides -mem_threshold.
-sortsub -- A sorting subroutine. Be advised that you MUST use $Sort::External::a and $Sort::External::b instead of $a and $b in your sub. Before deploying a sortsub, consider using a GRT instead, as described in the Sort::External::Cookbook. Its probably a lot faster.
-working_dir -- The directory where the temporary sortfiles will reside. By default, this directory is created using File::Temps tempdir() command.
feed()

$sortex->feed( @items );

Feed one or more sortable items to your Sort::External object. It is normal for occasional pauses to occur during feeding as caches are flushed and sortfiles are merged.

finish()
# if you intend to call fetch...
$sortex->finish;

# otherwise....
use Fcntl;
$sortex->finish(
-outfile => sorted.txt,
-flags => (O_CREAT | O_WRONLY),
);

Prepare to output items in sorted order.

If you specify the parameter -outfile, Sort::External will attempt to write your sorted list to that location. By default, Sort::External will refuse to overwrite an existing file; if you want to override that behavior, you can pass Fcntl flags to finish() using the optional -flags parameter.

Note that you can either finish() to an -outfile, or finish() then fetch()... but not both.

fetch()
while ( defined( $_ = $sortex->fetch ) ) {
&do_stuff_with($_);
}

Fetch the next sorted item.

Extended Path Index provides an extended index type based on the Zope index type that has additional query methods that are especially suited to generating navigation trees, site maps - and also supports querying a single folder, something the standard PathIndex cant do.
Note: You normally dont need to install this separately, as it ships as a standard part of Plone 2.1 and up. This download is for people wanting to use it outside of Plone or in earlier releases of Plone.
This index supports depth limiting, and the ability to build a structure usable for navtrees and sitemaps. The actual navtree implementations are not (and should not) be in this Product, this is the index implementation only.
Main features:
- Can construct a site map with a single catalog query
- Can construct a navigation tree with a single catalog query
- Doesnt wake up any objects
- Much lower RAM consumption
- Massively improved performance
- Catalog based instead of traversal based
Works with:
- Plone 2.5.1
- Plone 2.5
- Plone 2.1.4
- Plone 2.1.3
- Plone 2.1.2
- Plone 2.1.1
- Plone 2.1
Enhancements:
- A minor release for Plone 2.5.1

Open Site Builder Tools is a project that provides you with free software intended to facilitate your life as a professional web site developer.

Currently available tools include:

open site builder

site pages assembler. Merges content pages into a predefined template and produces target site by only replacing changed documents. Now includes sitemap generator

osb log analyzer

scans osb logs and displays list of modified files day by day, version by version. Each day activity is divided by project version and each version displays modified files sorted in descending order by the number of times the file was modified. So you can simply review development activity in each project version and know which files were most active

osb ftp uploader

uploads site pages from your development machine to the production server. Only the newer documents are uploaded. It also shows you the files on your target server that are missing in your development environment. This facilitates you the task of tracking moved / deleted files

Wizard Site Framework project has been used in production sites for three years, serving countless thousands of page views.
It is modular , coming out of the factory with a basic structure, allowing the webmaster to spend more time on design and less on the plumbing.
Included is a user authentication system, scripts for registering, changing passwords, contact forms, confirmation emails, listing users, editing their profiles, privacy statements (etc.etc.), fully integrated into the site skeleton and under the rule of common CSS stylesheets.
Very cool is the menu and sitemap systems which are generated from the database automatically when a page is added or altered during authoring. The menu systems use the famed Suckerfish CSS-driven Javascript code harnessed to a MySQL database with PHP scripting.
You can, for example, have either horizontal or vertical menus, and they can be set at whatever depth you think is reasonable. You can hide pages from the menu or sitemap or restrict their view to only site members with the appropriate credentials.
Other features include such utilities as visitors statistics tied to the user management system so that you can see what specific pages on your site your registered members are viewing.
This is the third generation of the Wizard framework. While the structure of the site continues to be managed through an admin panel, and stored in a MySQL database, what is rather unique about the latest iteration is that the page content, indeed the entire page, is stored on the server as an HTML - PHP file.
While previous versions stored HTML content in the database, the Version 3.0 makes the page completely accessible to such online programs as Macromedia Contribute or other authoring tools.
Unlike previous versions, or content management systems (CMS) that store the HTML content in a database table, you have the ability to include whatever server-side or client-side code in site pages, removing a major disadvantage of most content management systems.
This makes Wizard Site Framework totally customizable and flexible. And because it is lightweight and very efficient it is easily scalable to large sites.
Enhancements:
- Many major and minor bugs were fixed.
- The front and back ends are now W3C compliant.
- A Poll and Blog script was added.
- Preliminary support for the PostgreSQL database was added.