mysql storage engine aws s3 0.06
Sponsored Links
Sponsored Links
Secleted [ 0 ] software to compare
Results 1 - 15 of about 2961
A MySQL Storage Engine for AWS S3 0.06
A MySQL Storage Engine for AWS S3 is a plugin storage engine that allows MySQL to access Amazon Web Services. more>>
A MySQL Storage Engine for AWS S3 project is a plugin storage engine that allows MySQL to access Amazon Web Services Simple Storage Service (AWS S3) buckets and items.
You need a MySQL source tree, and you need to have it built.
Figure out where the source tree is.
In my case its /home/mark/mysql/mysql-5.1-arch
Figure out where the target install tree is.
In my case its /home/mark/mysql/builds/example
Figure out where the MySQL build puts storage engine plugins.
Its probably in lib/mysql under the install tree
Or its /usr/lib/mysql
Or its /usr/local/lib/mysql
For me its /home/mark/mysql/builds/example/lib/mysql
Then run:
./config/bootstrap
./configure --with-mysql=/path/to/mysql-source --libdir=/path/to/mysql-plugins
make && make install
You can optionally copy the "src" directory here into storage/ in the
MySQL server source, rebuild MySQL, and things should compile.
Next, you should probably install the S3 command line tools.
They depend on you having Python.
Get them at http://www.hanzoarchives.com/development-projects/s3-tools/
If you dont have one yet, you need an Amazon AWS account, and then
request that they enable S3. Go to http://amazonaws.com/ to do that.
You will need to get your "AWS Access Key Identifiers".
Assume they are
FV8CY5793BC7CY32YOSN
W9oQxQNJizGgjxNc82giE9/ipefQW19tuO2xpC9G
(I just made those up with a random number generator.)
Put this in your .bashrc file
AWS_ACCESS_KEY_ID=FV8CY5793BC7CY32YOSN
AWS_ACCESS_KEY_SECRET=W9oQxQNJizGgjxNc82giE9/ipefQW19tuO2xpC9G
export AWS_ACCESS_KEY_ID AWS_ACCESS_KEY_SECRET
This isnt used by the storage engine, but it makes using the s3 command
line tools easier.
Use s3mkbucket to create a bucket. Remember that buckets are in a
global namespace, and there are advantages to having them look lik a
domain name. I suggest you snap up "s3.example.com", where
"example.com" is your own domain name.
s3mkbucket s3.example.com
s3put -k solfege/Do -s "a deer, a female deer" s3.example.com
s3put -k solfege/Re -s "a drop of golden sun" s3.example.com
s3put -k solfege/Mi -s "a name I call myself" s3.example.com
s3put -k solfege/Fa -s "a long long way to run" s3.example.com
s3put -k solfege/So -s "a needle pulling thread" s3.example.com
s3put -k solfege/La -s "a note to follow So" s3.example.com
s3put -k solfege/Ti -s "a drink with jam and bread" s3.example.com
Then at the mysql> prompt
create table s3notes (s3id varchar(255) not null primary key, s3val blob)
engine=AWSS3
connection=awss3 s3.example.com FV8CY5793BC7CY32YOSN W9oQxQNJizGgjxNc82giE9/ipefQW19tuO2xpC9G;
select * from s3notes where s3id=solfege/Re;
insert into s3notes (s3id, s3val) values (color/Red, ff 00 00);
select * from s3notes where s3id=color/Red;
delete from s3notes where s3id=color/Red;
You can name the table anything you want, but the fields must be named s3id and s3val, and s3id must be the primary key.
Enhancements:
- More flexible schema, CREATE SERVER, and SELECT without WHERE are supported.
<<lessYou need a MySQL source tree, and you need to have it built.
Figure out where the source tree is.
In my case its /home/mark/mysql/mysql-5.1-arch
Figure out where the target install tree is.
In my case its /home/mark/mysql/builds/example
Figure out where the MySQL build puts storage engine plugins.
Its probably in lib/mysql under the install tree
Or its /usr/lib/mysql
Or its /usr/local/lib/mysql
For me its /home/mark/mysql/builds/example/lib/mysql
Then run:
./config/bootstrap
./configure --with-mysql=/path/to/mysql-source --libdir=/path/to/mysql-plugins
make && make install
You can optionally copy the "src" directory here into storage/ in the
MySQL server source, rebuild MySQL, and things should compile.
Next, you should probably install the S3 command line tools.
They depend on you having Python.
Get them at http://www.hanzoarchives.com/development-projects/s3-tools/
If you dont have one yet, you need an Amazon AWS account, and then
request that they enable S3. Go to http://amazonaws.com/ to do that.
You will need to get your "AWS Access Key Identifiers".
Assume they are
FV8CY5793BC7CY32YOSN
W9oQxQNJizGgjxNc82giE9/ipefQW19tuO2xpC9G
(I just made those up with a random number generator.)
Put this in your .bashrc file
AWS_ACCESS_KEY_ID=FV8CY5793BC7CY32YOSN
AWS_ACCESS_KEY_SECRET=W9oQxQNJizGgjxNc82giE9/ipefQW19tuO2xpC9G
export AWS_ACCESS_KEY_ID AWS_ACCESS_KEY_SECRET
This isnt used by the storage engine, but it makes using the s3 command
line tools easier.
Use s3mkbucket to create a bucket. Remember that buckets are in a
global namespace, and there are advantages to having them look lik a
domain name. I suggest you snap up "s3.example.com", where
"example.com" is your own domain name.
s3mkbucket s3.example.com
s3put -k solfege/Do -s "a deer, a female deer" s3.example.com
s3put -k solfege/Re -s "a drop of golden sun" s3.example.com
s3put -k solfege/Mi -s "a name I call myself" s3.example.com
s3put -k solfege/Fa -s "a long long way to run" s3.example.com
s3put -k solfege/So -s "a needle pulling thread" s3.example.com
s3put -k solfege/La -s "a note to follow So" s3.example.com
s3put -k solfege/Ti -s "a drink with jam and bread" s3.example.com
Then at the mysql> prompt
create table s3notes (s3id varchar(255) not null primary key, s3val blob)
engine=AWSS3
connection=awss3 s3.example.com FV8CY5793BC7CY32YOSN W9oQxQNJizGgjxNc82giE9/ipefQW19tuO2xpC9G;
select * from s3notes where s3id=solfege/Re;
insert into s3notes (s3id, s3val) values (color/Red, ff 00 00);
select * from s3notes where s3id=color/Red;
delete from s3notes where s3id=color/Red;
You can name the table anything you want, but the fields must be named s3id and s3val, and s3id must be the primary key.
Enhancements:
- More flexible schema, CREATE SERVER, and SELECT without WHERE are supported.
Download (0.32MB)
Added: 2007-04-20 License: GPL (GNU General Public License) Price:
548 downloads
Memcache Engine for MySQL 0.6
Memcache Engine for MySQL project allows memcache to work as a storage engine to MySQL. more>>
Memcache Engine for MySQL project allows memcache to work as a storage engine to MySQL.
This means that you can SELECT/UPDATE/ INSERTE/DELETE from it as though it is a table in MySQL. This is very experimental.
This is still very experimental.
Memcached is a high-performance, distributed memory object caching system, generic in nature, but intended for use in speeding up dynamic web applications by alleviating database load.
Enhancements:
- Support for discovery of tables was added.
- Row level locks were implemented.
- A major bug in duplicate keys was fixed, along with phantom rows for updates.
- The server status has been updated.
<<lessThis means that you can SELECT/UPDATE/ INSERTE/DELETE from it as though it is a table in MySQL. This is very experimental.
This is still very experimental.
Memcached is a high-performance, distributed memory object caching system, generic in nature, but intended for use in speeding up dynamic web applications by alleviating database load.
Enhancements:
- Support for discovery of tables was added.
- Row level locks were implemented.
- A major bug in duplicate keys was fixed, along with phantom rows for updates.
- The server status has been updated.
Download (0.29MB)
Added: 2007-04-10 License: GPL (GNU General Public License) Price:
932 downloads
Skeleton Engine for MySQL 0.4
Skeleton Engine for MySQL is a full framework to plug in a new storage engine. more>>
Skeleton Engine for MySQL is a full framework to plug in a new storage engine. Comes with prebuild autoconf files, and a full framework to plug in your own design.
The AWS, HTTP, Memcache, Nitro, PBXT, and many other engines were put together from the skeleton engine.
To install, grab a copy of the mysql source code and run this:
./configure --with-mysql=/home/brian/mysql-5.1/ --libdir=/usr/local/lib/mysql/
make install
And then inside of MySQL:
mysql> INSTALL PLUGIN skeleton SONAME libskeleton_engine.so;
mysql> CREATE TABLE `d` (`a` varchar(125), b text, primary key(a)) ENGINE=skeleton DEFAULT
CHARSET=latin1;
Query OK, 0 rows affected (0.01 sec)
You will probably need to edit the Makefile.am in the src/ tree if you want to build on anything other then Linux (and the Makefile assumes that the server was not compiled for debug).
<<lessThe AWS, HTTP, Memcache, Nitro, PBXT, and many other engines were put together from the skeleton engine.
To install, grab a copy of the mysql source code and run this:
./configure --with-mysql=/home/brian/mysql-5.1/ --libdir=/usr/local/lib/mysql/
make install
And then inside of MySQL:
mysql> INSTALL PLUGIN skeleton SONAME libskeleton_engine.so;
mysql> CREATE TABLE `d` (`a` varchar(125), b text, primary key(a)) ENGINE=skeleton DEFAULT
CHARSET=latin1;
Query OK, 0 rows affected (0.01 sec)
You will probably need to edit the Makefile.am in the src/ tree if you want to build on anything other then Linux (and the Makefile assumes that the server was not compiled for debug).
Download (0.29MB)
Added: 2007-07-17 License: BSD License Price:
831 downloads
Web Service Engine for MySQL 0.4
Web Service Engine for MySQL is a storage engine for the MySQL database. more>>
Web Service Engine for MySQL is a storage engine for the MySQL database. The project takes basic SQL and translates this through the engine interface into HTTP request methods.
This gives you the ability to create, read, and delete pages on Web servers. Wikipedia becomes a table you can select on from your database.
Enhancements:
- Multiple attributes per table are now supported.
- The engine now handles tables with more than two columns by generating XML that is stored on the remote server.
- Tables with only two columns are stored as before, with the non-keyed attribute being directly provided to the remote provider.
<<lessThis gives you the ability to create, read, and delete pages on Web servers. Wikipedia becomes a table you can select on from your database.
Enhancements:
- Multiple attributes per table are now supported.
- The engine now handles tables with more than two columns by generating XML that is stored on the remote server.
- Tables with only two columns are stored as before, with the non-keyed attribute being directly provided to the remote provider.
Download (0.29MB)
Added: 2007-06-29 License: GPL (GNU General Public License) Price:
849 downloads
Storage Inspector 0.5
Storage Inspector is a Firefox extension that makes it easy to view any sqlite database files in the current profile. more>>
Storage Inspector is a Firefox extension that makes it easy to view any sqlite database files in the current profile. This includes the anti-phishing and search engine...
Developer Comments:
There are quite a few polish issues that need to be addressed before this version is ready for the masses. If you notice problems, please view the readme.txt file first and tell me if there are other issues.
You can set the storageinspector.openmode pref to 2 if you want the extension to open in a new tab instead of its own window.
I have primarily tested the extension in Firefox 2b1 but would still like feedback on how it runs in 3a1.
If you dont like something, please post here with a constructive statement telling me what you would like.
<<lessDeveloper Comments:
There are quite a few polish issues that need to be addressed before this version is ready for the masses. If you notice problems, please view the readme.txt file first and tell me if there are other issues.
You can set the storageinspector.openmode pref to 2 if you want the extension to open in a new tab instead of its own window.
I have primarily tested the extension in Firefox 2b1 but would still like feedback on how it runs in 3a1.
If you dont like something, please post here with a constructive statement telling me what you would like.
Download (0.040MB)
Added: 2007-07-26 License: GPL (GNU General Public License) Price:
824 downloads
Multi-Agent Grid Engine library 0.1.3
Multi-Agent Grid Engine library is an experiment aimed to make a programming tool for creation of autonomic systems. more>>
Multi-Agent Grid Engine library is an experiment aimed to make a programming tool for creation of autonomic systems.
<<less Download (0.68MB)
Added: 2005-09-27 License: LGPL (GNU Lesser General Public License) Price:
1488 downloads
BerkeleyDB Backend Storage Engine for DURUS 20070503
BerkeleyDB Backend Storage Engine for DURUS provides a storage engine for DURUS, a persistence system for the Python language. more>>
BerkeleyDB Backend Storage Engine for DURUS project provides a storage engine for DURUS, a persistence system for the Python programming language.
Some advantages compared to Durus standard FileStorage:
- Startup time is negligible.
- You dont need an in-memory index, so your repository size is only limited by storage space, not RAM.
- If you change existing objects, your storage size doesnt increase.
- If you delete objects, those objects are garbage collected in background, slowly, without performance degradation.
- You can still do a full fast collection, if you need it. While this collection is in progress, Durus still serves objects. From time to time, nevertheless, it can be unresponsible for 2 or 3 seconds, while is doing a checkpointing to be able to free database logging diskspace.
- Garbage collection doesnt increase storage size. Neither RAM usage.
- Garbage collection deletes objects using nondurable transactions, very efficiently. If the collection is aborted abruptly (program or machine crashes), the collection will start again from the beginning. If the GC finishes without problems, that state is durable.
- Any object store in the storage will commit a durable transaction, including all objects released in the background garbage collector, along the way.
- Garbage collection time is proportional to garbage, not repository size.
There are some disadvantages, nevertheless:
- IMPORTANT: This backend uses reference counting to decide when an object is garbage and can be collected. So, if you have cycles in your data structures, you **MUST*BREAK** them before releasing the objects.
- Failing to do that will leak diskspace. It is possible that in a future release we can collect cycles, but try to avoid that pattern.
- Leaking objects will grow the diskspace, but **NO** corruption or malfunction will happen. No other secondary effect.
- Although this code could work on Windows, I havent checked it. Absolutely no garantee!.
- Sometimes this backend can become irresponsible for a couple of seconds. It is busy doing a checkpoint to recycle database logging space. The pause should be sort, nevertheless.
- Dont use this storage backend over NFS, at least you know what is going on.
- Since we are using BerkeleyDB as the backend:
- You should be experienced with BerkeleyDB deployments.
- Beware when updating Python or BerkeleyDB. In particular, BerkeleyDB is known by breaking (but they DOCUMENT!) binary compatibility between versions. In this case, they ALWAYS document the procedure to do a controlled upgrade, so dont worry. But take note of the risk.
- To do a trustable backup, you should follow instructions in BerkeleyDB documentation:
- http://www.sleepycat.com/docs/ref/transapp/reclimit.html
- http://www.sleepycat.com/docs/ref/transapp/archival.html
- http://www.sleepycat.com/docs/utility/db_hotbackup.html
- In Python you can use the standard "bsddb" or the up-to-date "bsddb3" bindings (which will be included in new python versions). This product will try to use always the more recent BerkeleyDB bindings. Be careful about BerkeleyDB version changes when you update the bindings.
- Since BerkeleyDB files are binary structures, a corrupt database can be unrecoverable. Be diligent and careful with your backups.
You can use this product both as a normal (local) filestorage, or a server (remote) storage system, just like the usual Durus FileStorage.
Enhancements:
- Compatibility with Durus 3.7 was added.
<<lessSome advantages compared to Durus standard FileStorage:
- Startup time is negligible.
- You dont need an in-memory index, so your repository size is only limited by storage space, not RAM.
- If you change existing objects, your storage size doesnt increase.
- If you delete objects, those objects are garbage collected in background, slowly, without performance degradation.
- You can still do a full fast collection, if you need it. While this collection is in progress, Durus still serves objects. From time to time, nevertheless, it can be unresponsible for 2 or 3 seconds, while is doing a checkpointing to be able to free database logging diskspace.
- Garbage collection doesnt increase storage size. Neither RAM usage.
- Garbage collection deletes objects using nondurable transactions, very efficiently. If the collection is aborted abruptly (program or machine crashes), the collection will start again from the beginning. If the GC finishes without problems, that state is durable.
- Any object store in the storage will commit a durable transaction, including all objects released in the background garbage collector, along the way.
- Garbage collection time is proportional to garbage, not repository size.
There are some disadvantages, nevertheless:
- IMPORTANT: This backend uses reference counting to decide when an object is garbage and can be collected. So, if you have cycles in your data structures, you **MUST*BREAK** them before releasing the objects.
- Failing to do that will leak diskspace. It is possible that in a future release we can collect cycles, but try to avoid that pattern.
- Leaking objects will grow the diskspace, but **NO** corruption or malfunction will happen. No other secondary effect.
- Although this code could work on Windows, I havent checked it. Absolutely no garantee!.
- Sometimes this backend can become irresponsible for a couple of seconds. It is busy doing a checkpoint to recycle database logging space. The pause should be sort, nevertheless.
- Dont use this storage backend over NFS, at least you know what is going on.
- Since we are using BerkeleyDB as the backend:
- You should be experienced with BerkeleyDB deployments.
- Beware when updating Python or BerkeleyDB. In particular, BerkeleyDB is known by breaking (but they DOCUMENT!) binary compatibility between versions. In this case, they ALWAYS document the procedure to do a controlled upgrade, so dont worry. But take note of the risk.
- To do a trustable backup, you should follow instructions in BerkeleyDB documentation:
- http://www.sleepycat.com/docs/ref/transapp/reclimit.html
- http://www.sleepycat.com/docs/ref/transapp/archival.html
- http://www.sleepycat.com/docs/utility/db_hotbackup.html
- In Python you can use the standard "bsddb" or the up-to-date "bsddb3" bindings (which will be included in new python versions). This product will try to use always the more recent BerkeleyDB bindings. Be careful about BerkeleyDB version changes when you update the bindings.
- Since BerkeleyDB files are binary structures, a corrupt database can be unrecoverable. Be diligent and careful with your backups.
You can use this product both as a normal (local) filestorage, or a server (remote) storage system, just like the usual Durus FileStorage.
Enhancements:
- Compatibility with Durus 3.7 was added.
Download (0.033MB)
Added: 2007-05-03 License: GPL (GNU General Public License) Price:
907 downloads
MySQL table patcher 1.6.2
MySQL table patcher is a patch that reads table creation file (tables.sql) and compares it to what mysqldump gives. more>>
MySQL table patcher is a patch that reads table creation file (tables.sql) and compares it to what mysqldump gives. It creates SQL clauses to update the database to match the creation file.
<<less Download (1.9MB)
Added: 2006-08-02 License: GPL (GNU General Public License) Price:
1179 downloads
Smooth Engine 0.6.0.1
Smooth Engine is a simple, smooth, yet versatile theme engine, capable of mimicing many theme engines. more>>
Smooth Engine is a simple, smooth, yet versatile theme engine, capable of mimicing many theme engines; it is designed to be highly flexible yet retain a relatively small footprint to provide a fair balance between speed, memory, and overall design.
<<less Download (0.20MB)
Added: 2005-08-05 License: LGPL (GNU Lesser General Public License) Price:
1544 downloads
Linux MSN Messenger Engine 1.0
Linux MSN Messenger Engine is a fully asynchronous, and fully multithreaded MSN messenger engine. more>>
Linux MSN Messenger Engine is a fully asynchronous, and fully multithreaded MSN messenger engine.
Preliminary releases will be statically combined with an ncurses console-based EPIC4-like interface for instant messaging functionality.
Enhancements:
- Code cleanup
<<lessPreliminary releases will be statically combined with an ncurses console-based EPIC4-like interface for instant messaging functionality.
Enhancements:
- Code cleanup
Download (0.056MB)
Added: 2006-05-30 License: GPL (GNU General Public License) Price:
827 downloads
madlibs engine 1.0
madlibs engine project is a MadLibs clone. more>>
madlibs engine project is a MadLibs clone.
The madlibs engine is a tiny engine for MadLibs-like interactive stories. Basically, you enter different words of a certain part of speech.
The program pastes them into a story text, creating weird, funny, or stupid results.
It runs on anything from a line printer to an xterm.
<<lessThe madlibs engine is a tiny engine for MadLibs-like interactive stories. Basically, you enter different words of a certain part of speech.
The program pastes them into a story text, creating weird, funny, or stupid results.
It runs on anything from a line printer to an xterm.
Download (4.62MB)
Added: 2006-11-22 License: GPL (GNU General Public License) Price:
1069 downloads
Drome Engine 0.3.3
Drome Engine is a 3D game engine thats written in C++ and uses OpenGL for graphics rendering. more>>
Drome Engine is a 3D game engine thats written in C++ and uses OpenGL for graphics rendering. Its currently under constant development; the main focus at this time is to improve and stabilize the application programming interface (API).
<<less Download (0.43MB)
Added: 2005-09-22 License: GPL (GNU General Public License) Price:
1497 downloads

Mimer SQL Engine for liunx 9.3.8
This article describes some of the highlights introduced in Mimer SQL Engine 9. As always, we have a mission to constantly improve performance and to keep up with the latest in database more>> This article describes some of the highlights introduced in Mimer SQL Engine 9. As always, we have a mission to constantly improve performance and to keep up with the latest in database standardization.
Binary and Character Large Objects (BLOBs/CLOBs/NCLOBs)
Mimer SQL Engine 9 has an efficient implementation of the SQL-99 data types BINARY LARGE OBJECT (BLOB) and CHARACTER LARGE OBJECT (CLOB). The data type NATIONAL CHARACTER LARGE OBJECT (NCLOB) was introduced in Mimer SQL 9.2. NCLOB is a data type where Unicode character data can be stored in standardized format, thus enabling a true portability between different platforms (e.g. in a client/server application with a heterogeneous client environment, for example, both Linux and Windows clients). All BLOBs, CLOBs and NCLOBs are stored in the Mimer SQL Engine database and are included in the same transaction control, access control and backup/restore system as more traditional business data.
The maximum size of a BLOB/CLOB/NCLOB is in practice unlimited (the only limitation is the maximum table size in Mimer SQL Engine; 8 TBytes!).
Mimer SQL Engine implements several functions for optimising the performance for insert, select, update, and delete of BLOBs/CLOBs/NCLOBs. When retrieving a BLOB/CLOB/NCLOB over a network, the large object is transferred directly from Mimer SQL Engines communication buffers to the application requesting the BLOB/CLOB/NCLOB without any intermediate temporary storage.
When large objects are accessed from Mimer SQL Engine, the objects are split into packages optimised for best possible performance e.g. over a network. The objects are also accessed asynchronously; the application can read the first packages of the BLOB/CLOB/NCLOB while Mimer SQL Engine delivers the rest of the object.<<less
Download (36.60MB)
Added: 2009-04-20 License: Freeware Price: Free
186 downloads
The Wurld 3D Engine 0.4
The Wurld 3D Engine is yet another 3D gaming engine. more>>
The Wurld 3D Engine is yet another 3D gaming engine. It is light, fast, has minimal external requirements, and is still very immature. The project is Python scriptable, including support for generating models using 3D turtle graphics.
<<less Download (0.88MB)
Added: 2007-06-11 License: BSD License Price:
871 downloads
Nelit2 Engine 0.1.2
Nelit2 Engine project is a game engine. more>>
Nelit2 Engine project is a game engine.
Nelit2 Engine is a game engine that uses a Model-View-Controller concept. All View-s classes was developed by me, and you can dont worrie about this.
Model-s classes also was developed by me, but you can modify it for your game or write new class and use Model class how abstract.
The engine uses some popular libraries such OpenGL and SDL.
It works on Unix systems and on Windows.
Enhancements:
- Decoding png, bmp, jpg texture-file.
- 3D mesh.
- Cubemap texturing.
<<lessNelit2 Engine is a game engine that uses a Model-View-Controller concept. All View-s classes was developed by me, and you can dont worrie about this.
Model-s classes also was developed by me, but you can modify it for your game or write new class and use Model class how abstract.
The engine uses some popular libraries such OpenGL and SDL.
It works on Unix systems and on Windows.
Enhancements:
- Decoding png, bmp, jpg texture-file.
- 3D mesh.
- Cubemap texturing.
Download (MB)
Added: 2006-12-05 License: GPL (GNU General Public License) Price:
1054 downloads
Secleted [ 0 ] software to compare
Copyright Notice:
Software piracy is theft, Using crack, password, serial numbers, registration codes, key generators is illegal and prevent future software development. The above mysql storage engine aws s3 0.06 search only lists software in full, demo and trial versions for free download. Download links are directly from our mirror sites or publisher sites, torrent files or links from rapidshare.com, yousendit.com or megaupload.com are not allowed