PHP Classes
elePHPant
Icontem

MegaSpider: Crawl a Web site and retrieve all links addresses

Recommend this page to a friend!
  Info   Screenshots Screenshots   View files View files (16)   DownloadInstall with Composer Download .zip   Reputation   Support forum (1)   Blog    
Last Updated Ratings Unique User Downloads Download Rankings
2005-05-10 (11 years ago) RSS 2.0 feedStarStarStar 46%Total: 2,990 All time: 1,186 This week: 901Up
Version License Categories
megaspider 1.0GNU Lesser Genera...Searching
Description Author

This class can crawl the pages of Web site recursively to retrieve the URLs of links and e-mail addresses that are found in the pages.

It uses regular expressions to retrieve the links found in each page and follows the links URLs and until all linked pages are visited.

Picture of Marcin Sznyra
Name: Marcin Sznyra <contact>
Classes: 2 packages by
Country: Poland Poland

Screenshots  
  • screen
  Files folder image Files  
File Role Description
Files folder imagedocs (6 files, 3 directories)
Plain text file example.php Example Example of usage
Plain text file spider.class.php Class MegaSpider Class

  Files folder image Files  /  docs  
File Role Description
Files folder imagemedia (3 files)
Files folder imageMegaSpider (3 files)
Files folder image__filesource (2 files)
  HTML file classtrees_MegaSpider.html Doc. documentation
  HTML file elementindex.html Doc. documentation
  HTML file elementindex_MegaSpider.html Doc. documentation
  HTML file index.html Doc. documentation
  HTML file li_MegaSpider.html Doc. documentation
  HTML file todolist.html Doc. documentation

  Files folder image Files  /  docs  /  media  
File Role Description
  Image file background.png Data documentation
  Image file empty.png Data documentation
  Plain text file style.css Data documentation

  Files folder image Files  /  docs  /  MegaSpider  
File Role Description
  HTML file MegaSpider.html Doc. documentation
  HTML file _spider_example_php.html Doc. documentation
  HTML file _spider_spider_class_php.html Doc. documentation

  Files folder image Files  /  docs  /  __filesource  
File Role Description
  HTML file fsource_MegaSpider__example.php.html Doc. Documentation
  HTML file fsource_MegaSpider...ider.class.php.html Doc. documentation

 Version Control Unique User Downloads Download Rankings  
 0%
Total:2,990
This week:0
All time:1,186
This week:901Up
 User Ratings  
 
 All time
Utility:58%StarStarStar
Consistency:50%StarStarStar
Documentation:54%StarStarStar
Examples:66%StarStarStarStar
Tests:-
Videos:-
Overall:46%StarStarStar
Rank:2361