Recommend this page to a friend! | Stumble It! | Bookmark in del.icio.us |
All requests | > | What is the best PHP url crawler class? | > | Request new recommendation | > | Featured requests | > | No recommendations | ||
by Dan Beck - 4 days ago (2016-02-21)
+2 | I need a crawler which can extract all pages metadata and URL into a database. |
0 | by Manuel Lemos 11760 - 9 hours ago (2016-02-25) Comment This class does exactly what you ask. It can crawl Web site pages and extract links and metadata. It does not crawl the whole site automatically but the example script demonstrates how to do it calling the class recursively. There are other classes that crawl the site recursively but they do not extract the pages meta data. |
Recommend package | |
|