PHP Classes
elePHPant
Icontem

PHP Link Crawler Script: Crawl Web pages and extract links to other pages

Recommend this page to a friend!
     
  Info   View files Example   View files View files (5)   DownloadInstall with Composer Download .zip   Reputation   Support forum   Blog    
Last Updated Ratings Unique User Downloads Download Rankings
2019-01-31 (1 month ago) RSS 2.0 feedNot yet rated by the usersTotal: 139 All time: 8,785 This week: 504Up
Version License PHP version Categories
link-crawler 1.0.0The PHP License5HTML, PHP 5, Databases, Searching, Pa...
Description Author

This package can crawl Web pages and extract links to other pages.

The crawler class takes the URL of a given page and retrieves the page contents to be parsed.

The class returns a list of links that it contains and can be stored in a database using a another class in this package.

The pages in the database can be used as queue to crawl whole sites.
  Performance   Level  
Name: Kemal GENIS <contact>
Classes: 5 packages by
Country: Turkey Turkey

Level 1 Star

  Files folder image Files  
File Role Description
Accessible without login Plain text file betik.php Example Example script
Plain text file crawler.class.php Class Class source
Accessible without login Plain text file crawler.sql Data Auxiliary data
Accessible without login Plain text file curl.php Aux. Auxiliary script
Plain text file mysql.class.php Class Class source

Downloadlink-crawler-2019-01-31.zip 7KB
Downloadlink-crawler-2019-01-31.tar.gz 6KB
Install with ComposerInstall with Composer
 Version Control Unique User Downloads Download Rankings  
 100%
Total:139
This week:0
All time:8,785
This week:504Up

  Applications that use this package  
No pages of applications that use this class were specified.

Add link image If you know an application of this package, send a message to the author to add a link here.