ex crawler

We have hosted the application ex crawler in order to run this application in our online workstations with Wine or directly.

Quick description about ex crawler:

Ex-Crawler is divided into 3 subprojects (Crawler Daemon, distributed gui Client, (web) search engine) which together provide a flexible and powerful search engine supporting distributed computing. More informations: http: //ex-crawler.sourceforge.net

Features:

• Fast web and image crawler written in Java which follows new links automaticly on a priority algorithm and can run 24h a day.
• Uses MySQL, MSSQL, PostgreSQL or even SQLlite Database to store informations
• Comes with a web frontend search engine, direct website analysis and more (in development - SVN)
• Support for distributed crawling with a graphical frontend for non-advanced users (de.excrawler.distributed.client in svn)
• Comes with it's own server where you can add new sites and much more including UserManagement and more.
• Comes with an plugin interface, with it you can easily add your own features in no time
• And much more

Audience: Advanced End Users, Developers, Education, End Users/Desktop, Science/Research, System Administrators.

Programming Language: Java, PHP.
Database Environment: JDBC, Microsoft SQL Server, MySQL, PostgreSQL (pgsql), SQLite.
.