PHP Classes
elePHPant
Icontem

HTTP Spy: Crawl and retrieve remote site pages

Recommend this page to a friend!
  Info   View files View files (5)   DownloadInstall with Composer Download .zip   Reputation   Support forum   Blog    
Last Updated Ratings Unique User Downloads Download Rankings
2006-12-22 (9 years ago) RSS 2.0 feedNot enough user ratingsTotal: 1,879 This week: 1All time: 2,035 This week: 1,047Up
Version License PHP version Categories
httpspy 1.0Artistic License4.3.0HTTP, Searching
Description Author

This package can be used to crawl and retrieve remote Web site pages.

It retrieves pages of a given Web site and extract the URLs of links and images contained in each page to be able to find other resources in the same site.

Picture of huangjs
Name: huangjs <contact>
Classes: 1 package by
Country: China China

Details
/*---------------------------------------------------------*/
/* Package Name : Http Spy                                 */
/* Author : James Huang (ShagoO)                           */
/* Email : shagoo@gmail.com                                */
/* Version : 1.0                                           */
/* Latest Release : 2006/12/09                             */
/*---------------------------------------------------------*/

[Instruction]

HttpSpy is Class written by James Huang (ShagoO) which extends the Class
Http Clent. Use Can Use it spying infos from website. 

Main Function Description As Follow : 

////////////////////////////////////////////////////////////////////////
// Spy Main Process Methods.

create() : Create a HttpClient Object.
get() : Use "GET" method to get Content from website.
post() : Use "POST" method to get Content from website.
getContent() : Get Page Content after "get" or "post".
useCurl() : Use Curl functions.
setCookiePath() : Set Cookie storage path.
curlLoaded() : Check if Curl is loaded.
curlGetCookie() : Use curl function to get cookies.
curlGetContent() : Use curl to get content.
setConditions() : Set separators to parse page.
getResult() : Get Result after execute().
execute() : Execute search process after getting links and setConditions().

////////////////////////////////////////////////////////////////////////
// Page Content Analyzing funcs.

getHrefs() : get <a href= .. section of the page.
getElements() : get .. src= .. section of the page.
splitPage() : Use separators to split page.
validUrlMaker() : Make all url valid.
htmlTagsFilter() : Filter all html tags.


[User Guild]

1. Decompress package to your DocumentRoot.
2. Use Class MySpy and spy data from Joyo.
3. Make your own Spy Classes :)
  Files folder image Files  
File Role Description
Files folder imageconfig (1 file)
Files folder imagecore (2 files)
Accessible without login Plain text file MySpy.php Example demo file
Accessible without login Plain text file readme.txt Doc. instruction

  Files folder image Files  /  config  
File Role Description
  Plain text file constant.php Class configure

  Files folder image Files  /  core  
File Role Description
  Plain text file HttpClient.php Class Base Http Functions
  Plain text file HttpSpy.php Class Main Class

 Version Control Unique User Downloads Download Rankings  
 0%
Total:1,879
This week:1
All time:2,035
This week:1,047Up