Tagged: Release

OpenWebSpider(js) v0.3.0 with support to PostgreSQL

Released OpenWebSpider(js) v0.3.0 Support for PostgreSQL Update Mode Support for HTTP Headers: Last-Modified and ETag Indexer Web Service Example tools using Indexer Web Service (github page)     Getting started Download Screenshots Changelog GitHub...

OpenWebSpider# v0.1.3

Released OpenWebSpider v0.1.3 CHANGELOG: New feature: CRAWLER NAME and CRAWLER VERSION used in the User-Agent string in HTTP Requests New feature: New configuration file field: sql_hostlist_where New feature: new command-line argument: –keep-dup BUG: fixed...

OpenWebSpider# v0.1.2

Released OpenWebSpider v0.1.2 CHANGELOG: BUG: fixed the regex used to extract URLs from (I)FRAME New feature: OpenWebSpider# can index images (new table: images) New feature: new command-line argument: −−images Improved Stress-test facility: now OpenWebSpider#...

OpenWebSpider# v0.1.1

Released OpenWebSpider v0.1.1 CHANGELOG: New feature: new command-line argument: −−req−timeout New feature: new command-line argument: −−stress−test BUG: fixed a bug in http.cs::getURL() [New features here: OpenWebSpider# v0.1 Command Line Arguments/Usage] [ Read more about:...

OpenWebSpider# v0.1

Released the first public version of OpenWebSpider entirely written in C# [ Read more about: Why C#? Why .NET Framework? ] Source code and binary are available in the package: Download Documentation of OpenWebSpider#...