Big Data Resources

Sep 22, 2015

Courses

MIT 6.S897: Large-Scale Systems(Matei Zaharia)

instructor: Matei Zaharia
homepage: http://people.csail.mit.edu/matei/courses/2015/6.S897/

Papers

Learning to Hash for Indexing Big Data - A Survey

paper: http://arxiv.org/abs/1509.05472v1

Random Forests for Big Data

arxiv: http://arxiv.org/abs/1511.08327

Big data analytics: a survey

paper: http://www.journalofbigdata.com/content/pdf/s40537-015-0030-3.pdf

A Comparison of Big Data Frameworks on a Layered Dataflow Model

arxiv: http://arxiv.org/abs/1606.05293

A survey of machine learning for big data processing

paper: http://link.springer.com/article/10.1186/s13634-016-0355-x

Projects

Open Big Data Group

Open Big Data Group

intro: This website contains a collection of libraries to be used in processing massive data size in highly distributed and paralleled environment
homepage: http://openbigdatagroup.github.io/

PLDA: Parallel C++ implementation of Latent Dirichlet Allocation

homepage: http://openbigdatagroup.github.io/plda/
github: https://github.com/openbigdatagroup/plda

PSVM: Parallelizing Support Vector Machines on Distributed Computers

PFP: Parallel FP-Growth for Query Recommendation

homepage: https://mahout.apache.org/users/misc/parallel-frequent-pattern-mining.html

Pspectralclustering: A parallel C++ implementation of Parallel Spectral Clustering

homepage: http://openbigdatagroup.github.io/pspectralclustering/
github: https://github.com/openbigdatagroup/pspectralclustering

Speedo: Parallelizing Stochastic Gradient Descent for Deep Convolutional Neural Network

homepage: http://openbigdatagroup.github.io/speedo/
github: https://github.com/openbigdatagroup/speedo

Videos

Awesome Big Data Algorithms

youtube: https://www.youtube.com/watch?v=jKBwGlYb13w

Blog

Uncovering Big Bias with Big Data

blog: https://lawyerist.com/110584/big-bias-big-data/