PHP Classes
elePHPant
Icontem

Curl multi sitemap: Generate multiple sitemaps crawling sites

Recommend this page to a friend!
     
  Info   View files View files (2)   DownloadInstall with Composer Download .zip   Reputation   Support forum (5)   Blog    
Last Updated Ratings Unique User Downloads Download Rankings
2011-04-25 (5 years ago) RSS 2.0 feedStarStarStarStar 67%Total: 2,648 All time: 1,389 This week: 1,016Up
Version License PHP version Categories
curl-multi-sitemap 1.0.0GNU General Publi...5.0PHP 5, Searching, SEO
Description Author

This class can be used to generate multiple sitemaps crawling sites.

It can crawl one or more sites to retrieve its pages and follow links recursively and determine the addresses of all pages to include in a XML sitemap.

It can ignore given URLs to avoid crawling and including in the sitemap.

The class uses the Curl extension multi-request support to retrieve multiple site pages at the same time.

You can also notify such services as Google, Yahoo, Bing, Ask and Moreover about your sitemap update.

The class may also notify Google, Bing, Yahoo, Ask and Weblogs when the sitemap is updated.

Innovation Award
PHP Programming Innovation award nominee
August 2010
Number 5

Prize: One copy of VS.PHP		 Sitemaps are important to tell Google and other search engines about the pages of your sites that you would like to be crawled and indexed.

One way to build a sitemap is to crawl the site pages and collect all the followed links. That may take a long time.

This class provides a more efficient way to crawl a site by using Curl extension multiple request support.

Instead of crawling just one page at a time it can crawl multiple pages in parallel, thus taking less time to finish.

Manuel Lemos
Picture of Arturs Sosins
  Performance   Level  
Name: Arturs Sosins <contact>
Classes: 22 packages by
Country: Latvia Latvia

Level 5 StarStarStarStarStar

 Innovation award
Innovation award
Nominee: 13x

Winner: 2x

  Files folder image Files  
File Role Description
Accessible without login Plain text file example.php Example Example usage of class methods
Plain text file sitemap.class.php Class Main class file

Downloadcurl-multi-sitemap-2011-04-25.zip 3KB
Downloadcurl-multi-sitemap-2011-04-25.tar.gz 3KB
Install with ComposerInstall with Composer
 Version Control Unique User Downloads Download Rankings  
 0%
Total:2,648
This week:0
All time:1,389
This week:1,016Up
User Ratings User Comments (2)
 All time
Utility:95%StarStarStarStarStar
Consistency:100%StarStarStarStarStarStar
Documentation:-
Examples:100%StarStarStarStarStarStar
Tests:-
Videos:-
Overall:67%StarStarStarStar
Rank:504
 
nice one
3 years ago (Krunal Doshi)		70%StarStarStarStar
Good class, I am using it at this site : http://sitemapbuilder.
4 years ago (Assontia Patient)		57%StarStarStar
 

  Applications that use this package  
Sitemap Generator
Generates site map using this class

Add link image If you know an application of this package, send a message to the author to add a link here.


  Related pages  
Curl multi sitemap documentation
Documentation and example scripts in action
Curl multi handler usage
Showing difference in performance between file_get_contents, curl and curl multi HTTP handler