PHP Classes

Auto Weibo Crawler: Scrape and parse pages of the Weibo site profiles

Recommend this page to a friend!
  Info   View files Example   View files View files (7)   DownloadInstall with Composer Download .zip   Reputation   Support forum (1)   Blog    
Last Updated Ratings Unique User Downloads Download Rankings
2024-01-10 (3 days ago) RSS 2.0 feedNot enough user ratingsTotal: 191 All time: 8,554 This week: 319Up
Version License PHP version Categories
autoweibo 1.6Free For Educatio...5PHP 5, Web services
Description 

Author

This class can scrape and parse pages of the Weibo site profiles.

There is one class that uses a Node.js server locally can access the Weibo site and login on behalf of a given user account to have access its profile pages.

Another class retrieves and parses the user profile pages and extract its details like the user posts, titles, body, images, post time, etc..

Picture of Ej Corpuz
Name: Ej Corpuz <contact>
Classes: 1 package by
Country: Philippines Philippines

Example

<?php

include_once 'scrapeweibo.php';

$username = "username";
$password = "password";
$ssoversion = "1.4.18";
$server = "http://localhost:1337/?";
$weiboLink = 'weiboprofile/pagelink';

$scrape = new scrapeWeibo($username, $password, $ssoversion, $server, $weiboLink);
$datas = $scrape -> getScrape();

?>


Details

autoweibocrawler

Crawl a Weibo profile/page via curl using an existing account.


  Files folder image Files  
File Role Description
Files folder imagedebug (1 file)
Files folder imagenode (1 file)
Files folder imageresults (1 file)
Plain text file autoweibo.php Class Class source
Accessible without login Plain text file index.php Example Example script
Accessible without login Plain text file README.md Data Documentation
Plain text file scrapeweibo.php Class Class source

  Files folder image Files  /  debug  
File Role Description
  Accessible without login Plain text file readme.txt Data Dummy file

  Files folder image Files  /  node  
File Role Description
  Accessible without login Plain text file server.js Data Auxiliary data

  Files folder image Files  /  results  
File Role Description
  Accessible without login HTML file pagesite.html Data Sample output

 Version Control Unique User Downloads Download Rankings  
 100%
Total:191
This week:0
All time:8,554
This week:319Up