Menggy Lab Menggy Lab: Internet Data Collection and Extraction


Modern Internet is a pool of massive data, which caught many academic researchers' attention. However, how to handle collect, extract, clease, format and organize data becomes an urgent problem, especially for those researchers who are not majoring in C.S.. Collect data manually is too time-consuming; Purchase data from agents is too expensive, thus many projects stops before it even gets started.
Menggy Lab aims to provide data support for academic researchers, universities or other academic institutions for FREE.

Data Explore          Customize a Dataset

Diven by Data

“Future world will be driven by the Data rather than Petroleum.” - Jack Ma

How much BIG the Internet is

It is estimated that the size of the data that Four Giants owned exceeds 1200PB, i.e., 120w terabytes

The value of the data

“By measuring the entropy of each individual's trajectory, we find a 93% potential predictability in user mobility across the whole user base.” -
Science 19 February 2010

The size of data they collected

Google

5,000 PB

Baidu

2,000 PB

Facebook

300 PB

eBay

90 PB

Menggy Lab collected

Datasets

79

Records

75,587,489

Size

29.67 GB

Web Page

24,113,373

Data Explore

中国高校导航

中国所有大学数据 - 中国高校导航 - www.ccug.net
Update:2016/09/11 - Create:2016/09/11

Records:2,204 | Variables:16 | Size:4.78 MB | Downloads:3 | Views:762
Allen - 11月前
虎扑

虎扑体育论坛全部用户数据 - bbs.hupu.com
Update:2016/08/25 - Create:2016/08/25

Records:114,285 | Variables:17 | Size:48.73 MB | Downloads:0 | Views:635
Allen - 11月前
虎扑

虎扑体育论坛全部回复数据 - bbs.hupu.com
Update:2016/08/26 - Create:2016/08/05

Records:26,739,944 | Variables:14 | Size:9.33 GB | Downloads:0 | Views:682
Allen - 1年前
虎扑

虎扑体育论坛主贴所有数据 - bbs.hupu.com
Update:2016/08/05 - Create:2016/08/01

Records:595,717 | Variables:15 | Size:1.29 GB | Downloads:0 | Views:661
Allen - 1年前
猫扑网

猫扑大杂烩数据-猫扑网 - dzh.mop.com
Update:2016/07/31 - Create:2016/07/30

Records:23,186 | Variables:18 | Size:52.27 MB | Downloads:0 | Views:662
Allen - 1年前
老杳吧

集微网分类资讯数据 - laoyaoba.com
Update:2016/07/26 - Create:2016/07/25

Records:285,055 | Variables:10 | Size:915.85 MB | Downloads:0 | Views:677
Allen - 1年前
新加坡狮城论坛

新加坡狮城论坛全部数据(包含主贴及全部回复数据) - bbs.sgcn.com
Update:2016/07/29 - Create:2016/07/11

Records:11,160,252 | Variables:11 | Size:5.15 GB | Downloads:0 | Views:698
Allen - 1年前
新加坡狮城论坛

新加坡狮城论坛主贴数据 - bbs.sgcn.com
Update:2016/07/09 - Create:2016/07/08

Records:997,723 | Variables:12 | Size:1020.84 MB | Downloads:0 | Views:1052
Allen - 1年前
hclip

成人视频网站数据集, 适用于文本分析, 关键字过滤 - hclips.com
Update:2016/07/05 - Create:2016/07/05

Records:1,166,950 | Variables:19 | Size:533.17 MB | Downloads:0 | Views:784
Allen - 1年前
无忧保姆网

无忧保姆网全部保姆信息 - www.51baomu.cn
Update:2016/07/03 - Create:2016/07/03

Records:90,652 | Variables:13 | Size:22.28 MB | Downloads:0 | Views:779
Allen - 1年前