Menggy Lab Menggy Lab: Internet Data Collection and Extraction


Modern Internet has massive data, which caught many academic researchers' attention. However, how to handle big data (collect, extract, clease, format and organize) becomes an urgent problem, especially for those who are not major in C.S.. Collect data manually is too time-consuming; Buy data from a third-party company is too expensive, many projects have to be stopped before it even gets started.
Menggy Lab aims to provide data support for academic researchers, universities or other academic institutions for FREE.

Data Explore          Customize a Dataset

Diven by Data

“Future world will be driven by the Data rather than Petroleum.” - Jack Ma

How much BIG the Internet is

It is estimated that the size of the data that Four Giants owned exceeds 1200PB, i.e., 120w terabytes

The value of the data

“By measuring the entropy of each individual's trajectory, we find a 93% potential predictability in user mobility across the whole user base.” -
Science 19 February 2010

The size of data they collected

Google

5,000 PB

Baidu

2,000 PB

Facebook

300 PB

eBay

90 PB

Menggy Lab collected

Datasets

73

Records

36,951,901

Size

9.8 GB

Web Page

20,465,031

Data Explore

老杳吧

集微网分类资讯数据 - laoyaoba.com
Update:2016/07/26 - Create:2016/07/25

Records:285,055 | Variables:10 | Size:915.85 MB | Downloads:0 | Views:75
Allen - 2天前
新加坡狮城论坛

新加坡狮城论坛主贴数据 - bbs.sgcn.com
Update:2016/07/09 - Create:2016/07/08

Records:997,723 | Variables:12 | Size:1020.84 MB | Downloads:0 | Views:79
Allen - 19天前
hclip

成人视频网站数据集, 适用于文本分析, 关键字过滤 - hclips.com
Update:2016/07/05 - Create:2016/07/05

Records:1,166,950 | Variables:19 | Size:533.17 MB | Downloads:0 | Views:125
Allen - 22天前
无忧保姆网

无忧保姆网全部保姆信息 - www.51baomu.cn
Update:2016/07/03 - Create:2016/07/03

Records:90,652 | Variables:13 | Size:22.28 MB | Downloads:0 | Views:119
Allen - 24天前
Digi-Key

得捷电子所有电子元件数据(英文主站) - www.digikey.com
Update:2016/07/01 - Create:2016/07/01

Records:4,439,460 | Variables:18 | Size:0 B | Downloads:0 | Views:90
Allen - 26天前
中華黃頁網路電話簿

SuperhiPage中華黃頁網路電話簿 - www.iyp.com.tw
Update:2016/06/30 - Create:2016/06/29

Records:479,722 | Variables:14 | Size:235.15 MB | Downloads:0 | Views:88
Allen - 28天前
Digi-Key

得捷电子所有电子元件数据 - www.digikey.com.cn
Update:2016/06/27 - Create:2016/06/22

Records:4,072,575 | Variables:17 | Size:2.33 GB | Downloads:0 | Views:63
Allen - 1月前
Git Hub

The GitHub 博客数据 - github.com/blog
Update:2016/06/22 - Create:2016/06/22

Records:694 | Variables:10 | Size:1.22 MB | Downloads:0 | Views:136
Allen - 1月前
心食谱

心食谱所有食谱数据 - www.xinshipu.com
Update:2016/06/21 - Create:2016/06/20

Records:69,141 | Variables:14 | Size:62.25 MB | Downloads:0 | Views:115
Allen - 1月前
crowdSPRING

LOGO Projects 用户参与数据 - crowdSPRING - crowdspring.com
Update:2016/06/07 - Create:2016/06/07

Records:35,862 | Variables:10 | Size:5.23 MB | Downloads:0 | Views:201
Allen - 1月前