Free perl text processing software for linux

Emdros is an Open-Source text database engine for storage and retrieval of analyzed or annotated text.
Emdros has a powerful query-language for asking relevant questions of the data.
Emdros has wide applicability in fields that deal with analyzed or annotated text. Application domains include linguistics, publishing, text processing, and any other fields that deal with annotated text.
Main features:
- Linguistic analyses are the primary target domain. This includes all levels of analysis, such as morphology, syntax, and discourse analysis, and even phonology to some extent.
- Publishing is also a field where Emdros can be useful. Emdros supports breaking a text down into pages, chapters, paragraphs, etc.
- Text processing may benefit from Emdros if the problem involves annotating the text.
Emdros provides a conceptual model of text which can be quite liberating to use once it has been grasped.
Meta-data may also be stored, so long as there is some textual element with which it can be associated.
Emdros is good both for corpus linguistics (large amounts of text) and for field-linguistics (smaller amounts of data).
Fixed corpora, such as Biblical texts, are good candidates for making Emdros useful. Emdros is currently being used for large databases of the Hebrew Bible.
Dictionaries are also a target possibility. Emdros supports structuring of text documents down to minute details, while not losing the big picture.
Emdros embodies a particular model of text called the EMdF model. The primary advantage over XMLs data model is that object types (such as pages and chapters) need not be hierarchically structured or embedded, but may overlap. In addition, objects (such as a clause or a phrase) need not be contiguous, but may have gaps.
Emdros can output its results in XML. The XML carries its own standalone DTD and validates with a validating parser.
Emdros architecture
Emdros fits into a software architecture as follows:
+---------------+
| Client | User-written
+---------------+
|
+---------------+
| MQL | Emdros
+---------------+
|
+---------------+
| EMdF | Emdros
+---------------+
|
+---------------+
| DB | PostgreSQL or MySQL
+---------------+
At the top, there is a client which you, the user, must write. This client will take advantage of Emdross services to provide for the needs of your particlar database domain.
Then come the two Emdros-layers: The MQL layer and the EMdF layer. The MQL layer provides an interface to the MQL language. The MQL layer automatically takes advantage of the EMdF layer, which translates the MQL queries into SQL calls to the underlying database.
The underlying database takes care of storing the data, and retrieving it as directed by the EMdF layer.
The data domain which Emdros handles is that of text. Emdros provides a certain abstraction of text that makes it ideally suited to storing and retrieving annotated text, such as linguistic analyses of a text.
These analyses can be, e.g., syntactic analyses, morphological analyses, or discourse analyses, or all of these. Phonological analyses are also supported to some extent.
Emdros is particularly useful in domains where research questions need to be asked of databases of annotated text. This would include dictionary-making, Biblical language-research (Greek or Hebrew), other linguistic research, and research on annotated text in general.
Emdros has a particular model of text called the EMdF model. Users have attested, and our experience shows, that the EMdF model can be quite liberating when dealing with text as a programmer or program designer. Thus any application that deals with annotated text will likely benefit from the Emdros and the EMdF model.
Enhancements:
- The topographic part of the language was expanded.
- A TIGER XML importer was added.
- Beta quality C# bindings were added.
- Bugfixes were made, and the regression test suite was enhanced.

Text::Quote contains quotes strings as required for perl to eval them back correctly.

SYNOPSIS

use Text::Quote;

my @quotes=map{$quoter->quote($_,indent=>6,col_width=>60)}(
"The time has come"
the walrus said,
"to speak of many things..."
," 123456abtn13fr16172021222324252627303132e34353637",
("6abtn13fr32e34" x 5),2/3,10,00);
for my $i (1..@quotes) {
print "$var$i=".$quotes[$i-1].";n";
}
Would produce:
$var1=qq"The time has come"ntthetwalrus said,nt"to speak of man.
qqy things...";
$var2=" 123456abtn13fr16172021222324252627".
"303132e34353637";
$var3=("6abtn13fr32e34" x 5);
$var4=0.666666666666667;
$var5=10;
$var6=00;

Text::Macro Perl module is a template facility whos focus is on generating code such as c, java or sql. While generating perl code is also possible, there is a potential conflict between the control-symbol and the perl comment symbol.
Perl is excelent at manipulating text, and it begs the question why one would need such a tool.
The answer is that good code design should be such that applications should not have to be modified so as to make configuration changes. Thus external configuration files/data is used. However, if these files are read in as perl-code, then simple errors could crash the whole application (or provide subtle security risks). Further, it is often desired to invert the control flow and text-data (namely, make the embedded strings primary, and control-flow secondary). This is the ASP model, and for 90% HTML, 10% code, this works great.
This module supports many control facilities which directly translate into perl-control facilities (e.g. inverting the ASP-style code back into perl-style behind the scenes). The inversion process is cached in a simple user object.
The module was initially inspired by Text::FastTemplate by Robert Lehr, whos module didnt completely fullfill my needs.
Main features:
- fast, simple, robust
- code-generating-centric feature-set
- substitutions stand-out from template
- macro-code embedded in text
- OOP
- external and internal includes (for clearifying complex control-flow)
- scoped variable-substitutions
- line-based processing (like cpp)
- usable error messages