Deep Learning Frameworks

Oct 9, 2015


Amazon DSSTNE

Amazon DSSTNE: Deep Scalable Sparse Tensor Network Engine

Apache SINGA

Blocks

Blocks: A Theano framework for building and training neural networks

Blocks and Fuel: Frameworks for deep learning

BrainCore

BrainCore: The iOS and OS X neural network framework

https://github.com/aleph7/BrainCore

Brainstorm

Brainstorm: Fast, flexible and fun neural networks

Caffe

Caffe: Convolutional Architecture for Fast Feature Embedding

OpenCL Caffe

Caffe on both Linux and Windows

ApolloCaffe: a fork of Caffe that supports dynamic networks

fb-caffe-exts: Some handy utility libraries and tools for the Caffe deep learning framework

Caffe-Android-Lib: Porting caffe to android platform

caffe-android-demo: An android caffe demo app exploiting caffe pre-trained ImageNet model for image classification

Caffe.js: Run Caffe models in the browser using ConvNetJS

Intel Caffe

  • intro: This fork of BVLC/Caffe is dedicated to improving performance of this deep learning framework when running on CPU, in particular Intel® Xeon processors (HSW+) and Intel® Xeon Phi processors
  • github https://github.com/intel/caffe

NVIDIA Caffe

https://github.com/NVIDIA/caffe

Mini-Caffe

Caffe on Mobile Devices

CaffeOnACL

  • intro: Using ARM Compute Library (NEON+GPU) to speed up caffe; Providing utilities to debug, profile and tune application performance
  • github: https://github.com/OAID/caffeOnACL

Multi-GPU / MPI Caffe

Caffe with OpenMPI-based Multi-GPU support

mpi-caffe: Model-distributed Deep Learning with Caffe and MPI

Caffe-MPI for Deep Learning

Caffe Utils

Caffe-model

Caffe2

Caffe2: A New Lightweight, Modular, and Scalable Deep Learning Framework

CDNN2

CDNN2 - CEVA Deep Neural Network Software Framework

Chainer

Chainer: a neural network framework

Introduction to Chainer: Neural Networks in Python

CNTK

CNTK: Computational Network Toolkit

An Introduction to Computational Networks and the Computational Network Toolkit

http://research.microsoft.com/apps/pubs/?id=226641

ConvNetJS

ConvNetJS: Deep Learning in Javascript. Train Convolutional Neural Networks (or ordinary ones) in your browser

DeepBeliefSDK

DeepBeliefSDK: The SDK for Jetpac’s iOS, Android, Linux, and OS X Deep Belief image recognition framework

DeepDetect

DeepDetect: Open Source API & Deep Learning Server

Deeplearning4j (DL4J)

Deeplearning4j: Deep Learning for Java

Deeplearning4j images for cuda and hadoop.

Deeplearning4J Examples

DeepLearningKit

DeepLearningKit: Open Source Deep Learning Framework for Apple’s tvOS, iOS and OS X

Tutorial — Using DeepLearningKit with iOS for iPhone and iPad

https://medium.com/@atveit/tutorial-using-deeplearningkit-with-ios-for-iphone-and-ipad-de727679bae4#.1bvnhxhjo

DeepSpark

DeepSpark: Deeplearning framework running on Spark

DIGITS

DIGITS: the Deep Learning GPU Training System

dp

dp: A deep learning library for streamlining research and development using the Torch7 distribution

Dragon

Dragon: A Computation Graph Virtual Machine Based Deep Learning Framework

DyNet

**DyNet: The Dynamic Neural Network Toolkit **

DyNet Benchmarks

IDLF

IDLF: The Intel® Deep Learning Framework

Keras

Keras: Deep Learning library for Theano and TensorFlow

MarcBS/keras fork

Hera: Train/evaluate a Keras model, get metrics streamed to a dashboard in your browser.

Installing Keras for deep learning

Keras Applications - deep learning models that are made available alongside pre-trained weights

https://keras.io/applications/

Keras resources: Directory of tutorials and open-source code repositories for working with Keras, the Python deep learning library

Keras.js: Run trained Keras models in the browser, with GPU support

keras2cpp

keras-cn: Chinese keras documents with more examples, explanations and tips.

Kerasify: Small library for running Keras models from a C++ application

https://github.com/moof2k/kerasify

Knet

Knet: Koç University deep learning framework

Lasagne

Lasagne: Lightweight library to build and train neural networks in Theano

Leaf

Leaf: The Hacker’s Machine Learning Engine

LightNet

LightNet: A Versatile, Standalone and Matlab-based Environment for Deep Learning

MatConvNet

MatConvNet: CNNs for MATLAB

Marvin

Marvin: A minimalist GPU-only N-dimensional ConvNet framework

MatConvNet: CNNs for MATLAB

Mocha.jl

Mocha.jl: Deep Learning for Julia

MXNet

MXNet

MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems

MXNet Model Gallery: Pre-trained Models of DMLC Project

a short introduction to mxnet design and implementation (chinese)

Deep learning for hackers with MXnet (1) GPU installation and MNIST

https://no2147483647.wordpress.com/2015/12/07/deep-learning-for-hackers-with-mxnet-1/

mxnet_Efficient, Flexible Deep Learning Framework

Use Caffe operator in MXNet

Deep Learning in a Single File for Smart Devices

https://mxnet.readthedocs.org/en/latest/tutorial/smart_device.html

MXNet Pascal Titan X benchmark

用MXnet实战深度学习之一:安装GPU版mxnet并跑一个MNIST手写数字识别

http://phunter.farbox.com/post/mxnet-tutorial1

用MXnet实战深度学习之二:Neural art

http://phunter.farbox.com/post/mxnet-tutorial2

Programming Models and Systems Design for Deep Learning

Awesome MXNet

Getting Started with MXNet

https://indico.io/blog/getting-started-with-mxnet/

gtc_tutorial: MXNet Tutorial for NVidia GTC 2016

MXNET Dependency Engine

MXNET是这样压榨深度学习的内存消耗的

WhatsThis-iOS: MXNet WhatThis Example for iOS

ncnn

neocortex.js

Run trained deep neural networks in the browser or node.js

Neon

Neon: Nervana’s Python-based deep learning library

Tools to convert Caffe models to neon’s serialization format

Nervana’s Deep Learning Course

NNabla

NNabla - Neural Network Libraries by Sony

  • intro: NNabla - Neural Network Libraries NNabla is a deep learning framework that is intended to be used for research, development and production. We aim it running everywhere like desktop PCs, HPC clusters, embedded devices and production servers.
  • homepage: https://nnabla.org/
  • github: https://github.com/sony/nnabla

OpenDeep

OpenDeep: a fully modular & extensible deep learning framework in Python

OpenNN

OpenNN - Open Neural Networks Library

Paddle

PaddlePaddle: PArallel Distributed Deep LEarning

基于Spark的异构分布式深度学习平台

http://geek.csdn.net/news/detail/58867

Petuum

Petuum: a distributed machine learning framework

Platoon

Platoon: Multi-GPU mini-framework for Theano

Poseidon

Poseidon: Distributed Deep Learning Framework on Petuum

Purine

Purine: A bi-graph based deep learning framework

PyTorch

PyTorch

*Datasets, Transforms and Models specific to Computer Vision

https://github.com/pytorch/vision/

Convert torch to pytorch

https://github.com/clcarwin/convert_torch_to_pytorch

TensorFlow

TensorFlow

Benchmarks

TensorDebugger (TDB)

TensorDebugger(TDB): Interactive, node-by-node debugging and visualization for TensorFlow

ofxMSATensorFlow: OpenFrameworks addon for Google’s data-flow graph based numerical computation / machine intelligence library TensorFlow.

TFLearn: Deep learning library featuring a higher-level API for TensorFlow

TensorFlow on Spark

TensorBoard

TensorFlow.jl: A Julia wrapper for the TensorFlow Python library

TensorLayer: Deep learning and Reinforcement learning library for TensorFlow

OpenCL support for TensorFlow

Pretty Tensor: Fluent Networks in TensorFlow

Rust language bindings for TensorFlow

TensorFlow Ecosystem: Integration of TensorFlow with other open-source frameworks

Caffe to TensorFlow

TensorFlow Mobile

https://www.tensorflow.org/mobile/

Papers

TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems

TensorFlow: A system for large-scale machine learning

Tutorials

TensorFlow 官方文档中文版

Theano

Theano

Theano-Tutorials: Bare bones introduction to machine learning from linear regression to convolutional neural networks using Theano

Theano: A Python framework for fast computation of mathematical expressions

Configuring Theano For High Performance Deep Learning

http://www.johnwittenauer.net/configuring-theano-for-high-performance-deep-learning/

Theano: a short practical guide

Ian Goodfellow’s Tutorials on Theano

Plato: A library built on top of Theano

Theano Windows Install Guide

Theano-MPI: a Theano-based Distributed Training Framework

tiny-dnn (tiny-cnn)

tiny-dnn: A header only, dependency-free deep learning framework in C++11

Deep learning with C++ - an introduction to tiny-dnn

Torch

Torch

loadcaffe: Load Caffe networks in Torch7

Applied Deep Learning for Computer Vision with Torch

pytorch: Python wrappers for torch and lua

Torch Toolbox: A collection of snippets and libraries for Torch

cltorch: a Hardware-Agnostic Backend for the Torch Deep Neural Network Library, Based on OpenCL

Torchnet: An Open-Source Platform for (Deep) Learning Research

THFFmpeg: Torch bindings for FFmpeg (reading videos only)

caffegraph: Load Caffe networks in Torch7 using nngraph

Optimized-Torch: Intel Torch is dedicated to improving Torch performance when running on CPU

Torch Video Tutorials

Torch in Action

VELES

VELES: Distributed platform for rapid Deep learning application development

WebDNN

WebDNN: Fastest DNN Execution Framework on Web Browser

Yann

Yann: Yet Another Neural Network Toolbox

Benchmarks

https://github.com/soumith/convnet-benchmarks

Tutorials

Deep Learning Implementations and Frameworks (DLIF)

Papers

Comparative Study of Deep Learning Software Frameworks

Benchmarking State-of-the-Art Deep Learning Software Tools

Projects

TensorFuse: Common interface for Theano, CGT, and TensorFlow

DeepRosetta: An universal deep learning models conversor

References

Frameworks and Libraries for Deep Learning

http://creative-punch.net/2015/07/frameworks-and-libraries-for-deep-learning/

TensorFlow vs. Theano vs. Torch

https://github.com/zer0n/deepframeworks/blob/master/README.md

Evaluation of Deep Learning Toolkits

https://github.com/zer0n/deepframeworks/blob/master/README.md

Deep Machine Learning libraries and frameworks

https://medium.com/@abduljaleel/deep-machine-learning-libraries-and-frameworks-5fdf2bb6bfbe#.q1mhj7c36

Torch vs Theano

Deep Learning Software: NVIDIA Deep Learning SDK

https://developer.nvidia.com/deep-learning-software

A comparison of deep learning frameworks

TensorFlow Meets Microsoft’s CNTK

Is there a case for still using Torch, Theano, Brainstorm, MXNET and not switching to TensorFlow?

  • reddit: [https://www.reddit.com/r/MachineLearning/comments/47qh90/is_there_a_case_for_still_using_torch_theano/][https://www.reddit.com/r/MachineLearning/comments/47qh90/is_there_a_case_for_still_using_torch_theano/]

DL4J vs. Torch vs. Theano vs. Caffe vs. TensorFlow

http://deeplearning4j.org/compare-dl4j-torch7-pylearn.html

Popular Deep Learning Libraries

The simple example of Theano and Lasagne super power

https://grzegorzgwardys.wordpress.com/2016/05/15/the-simple-example-of-theano-and-lasagne-super-power/

Comparison of deep learning software

A Look at Popular Machine Learning Frameworks

5 Deep Learning Projects You Can No Longer Overlook

Comparison of Deep Learning Libraries After Years of Use

Deep Learning Part 1: Comparison of Symbolic Deep Learning Frameworks

Deep Learning Frameworks Compared

DL4J vs. Torch vs. Theano vs. Caffe vs. TensorFlow

https://deeplearning4j.org/compare-dl4j-torch7-pylearn.html

Deep Learning frameworks: a review before finishing 2016

https://medium.com/@ricardo.guerrero/deep-learning-frameworks-a-review-before-finishing-2016-5b3ab4010b06#.a6fdrqssl

The Anatomy of Deep Learning Frameworks

https://medium.com/@gokul_uf/the-anatomy-of-deep-learning-frameworks-46e2a7af5e47

Python Deep Learning Frameworks Reviewed

https://indico.io/blog/python-deep-learning-frameworks-reviewed/

Apple’s deep learning frameworks: BNNS vs. Metal CNN

http://machinethink.net/blog/apple-deep-learning-bnns-versus-metal-cnn/