PHP-Crawler

PHP-Crawler
Developer(s)	Vlad Fedorkov ^[1]
Initial release	9 January 2006 (2006-01-09)

Stable release	0.8 / 25 July 2007 (2007-07-25)
Written in	PHP
Operating system	Cross-platform
Available in	English
License	BSD License
Website	astellar.com/php-crawler/

PHP-Crawler is an open source crawling script based on PHP and MySQL. Created to implement simple as possible local website search it became popular for small websites on shared hosting. Script set is distributed under the terms of BSD License.

Features

Full text search support via MySQL FT indexes
As a general PHP script it allows running crawler manually from browser, requires no SSH access to the hosting.
Crawling is limited by depth setting or amount
Following "href=" links on web page, in HTML or JavaScripts

Requirements

PHP 4.3.10+
MySQL 3.23.56+

External links

References

↑ "Vlad Fedorkov". Retrieved 18 August 2013.

Web crawlers

Internet bots designed for Web crawling and Web indexing

Active	80legs bingbot Fetcher Googlebot Heritrix HTTrack Pandemonium_(Webcrawler) PHP-Crawler PowerMapper Wget

Discontinued	FAST Crawler msnbot RBSE TkWWW robot Twiceler Yahoo! Slurp

Types	Distributed web crawler Focused crawler ICDL crawler

This article is issued from Wikipedia - version of the 9/28/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.