Fun With Deep Learning

Oct 9, 2015


Painting

Artist Agent: A Reinforcement Learning Approach to Automatic Stroke Generation in Oriental Ink Painting

Neural Art

A Neural Algorithm of Artistic Style

Image Style Transfer Using Convolutional Neural Networks

Artificial Startup Style: Neural art about startup fashion

From Pixels to Paragraphs: How artistic experiments with deep learning guard us from hype

Experiments with style transfer

Style Transfer for Headshot Portraits (SIGGRAPH 2014)

Teaching recurrent Neural Networks about Monet

Content Aware Neural Style Transfer

Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis

Stylenet: Neural Network with Style Synthesis

Ostagram

  • intro: This program presents web-service for algorithm combining the content of one image with the style of another image using convolutional neural networks
  • github: https://github.com/SergeyMorugin/ostagram

Exploring the Neural Algorithm of Artistic Style

Perceptual Losses for Real-Time Style Transfer and Super-Resolution

Image transformation networks with fancy loss functions

Improving the Neural Algorithm of Artistic Style

CubistMirror: an openframeworks app which repeatedly applies real-time style transfer on a webcam

Transfer Style But Not Color

neural-art-mini: Lightweight version of mxnet neural art implementation

Preserving Color in Neural Artistic Style Transfer

End to End Neural Art with Generative Models

Neural Style Explained

Texture Networks: Feed-forward Synthesis of Textures and Stylized Images

Learning Typographic Style

Instance Normalization: The Missing Ingredient for Fast Stylization

Painting style transfer for head portraits using convolutional neural networks

Style-Transfer via Texture-Synthesis

neural-style-tf: TensorFlow implementation of Neural Style

Deep Convolutional Networks as Models of Generalization and Blending Within Visual Creativity

  • intro: In Proceedings of the 7th International Conference on Computational Creativity. Palo Alto: Association for the Advancement of Artificial Intelligence (AAAI) Press (2016)
  • arxiv: https://arxiv.org/abs/1610.02478

A Learned Representation For Artistic Style

How to Fake It As an Artist with Docker, AWS and Deep Learning

Multistyle Pastiche Generator

Fast Style Transfer in TensorFlow

Neural Style Transfer For Chinese Fonts

Neural Style Representations and the Large-Scale Classification of Artistic Style

Controlling Perceptual Factors in Neural Style Transfer

Awesome Typography: Statistics-Based Text Effects Transfer

Fast Patch-based Style Transfer of Arbitrary Style

Demystifying Neural Style Transfer

Son of Zorn’s Lemma: Targeted Style Transfer Using Instance-aware Semantic Segmentation

Bringing Impressionism to Life with Neural Style Transfer in Come Swim

  • intro: a case study of how Neural Style Transfer can be used in a movie production context
  • keywords: Kristen Stewart !
  • arxiv: https://arxiv.org/abs/1701.04928

Pytorch tutorials for Neural Style transfert

Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Losses

Arbitrary Style Transfer In Real-Time With Adaptive Instance Normalization

Picking an optimizer for Style Transfer

Multi-style Generative Network for Real-time Transfer

https://arxiv.org/abs/1703.06953

Deep Photo Style Transfer

Lightweight Neural Style on Pytorch

https://github.com/lizeng614/SqueezeNet-Neural-Style-Pytorch

StyleBank: An Explicit Representation for Neural Image Style Transfer

How to Make an Image More Memorable? A Deep Style Transfer Approach

Visual Attribute Transfer through Deep Image Analogy

Characterizing and Improving Stability in Neural Style Transfer

https://arxiv.org/abs/1705.02092

Towards Metamerism via Foveated Style Transfer

https://arxiv.org/abs/1705.10041

Style Transfer for Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN

https://arxiv.org/abs/1706.03319

Neural Art On Audio

MSc AI Project on generative deep networks and neural style transfer for audio

Neural Song Style

Neural Art On Video

neural-style-video

Instructions for making a Neural-Style movie

Artistic style transfer for videos

How Deep Learning Can Paint Videos in the Style of Art’s Great Masters

DeepMovie: Using Optical Flow and Deep Neural Networks to Stylize Movies

Coherent Online Video Style Transfer

https://arxiv.org/abs/1703.09211

Laplacian-Steered Neural Style Transfer

Real-Time Neural Style Transfer for Videos

Neural Doodle

Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artworks

Neural Doodle

Faster neural doodle

Feed-forward neural doodle

neural image analogies: Generate image analogies using neural matching and blending

Neural doodle with Keras

https://github.com/fchollet/keras/blob/master/examples/neural_doodle.py

Deep Dreams

deepdream

cnn-vis: Use CNNs to generate images

bat-country: A lightweight, extendible, easy to use Python package for deep dreaming and image generation with Caffe and CNNs

DeepDreaming with TensorFlow

deepdraw

Understanding Deep Dreams

Generating Deep Dreams

Audio Deepdream: Optimizing Raw Audio With Convolutional Networks

Emoji

Brewing EmojiNet

Image2Emoji: Zero-shot Emoji Prediction for Visual Media

Teaching Robots to Feel: Emoji & Deep Learning 👾 💭 💕

Text input with relevant emoji sorted with deeplearning

Sketch

Sketch-a-Net that Beats Humans

How Do Humans Sketch Objects?

Learning to Simplify: Fully Convolutional Networks for Rough Sketch Cleanup (SIGGRAPH 2016)

Convolutional Sketch Inversion

Sketch Me That Shoe (CVPR 2016)

Image Stylization

Automatic Portrait Segmentation for Image Stylization

Transfiguring Portraits

Image Colorization

Deep Colorization

Learning Large-Scale Automatic Image Colorization

Learning Representations for Automatic Colorization

Colorful Image Colorization

Automatic Colorization (Tensorflow + VGG)

colornet: Neural Network to colorize grayscale images

https://github.com/pavelgonchar/colornet

Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification (SIGGRAPH 2016)

Convolutional autoencoder to colorize greyscale images

Image-Color: A deep learning approach to colorizing images

Creating an artificial artist: Color your photos using Neural Networks

Paints Chainer: line drawing colorization using chainer

Unsupervised Diverse Colorization via Generative Adversarial Networks

(DE)^2 CO: Deep Depth Colorization

https://arxiv.org/abs/1703.10881

A Neural Representation of Sketch Drawings

Real-Time User-Guided Image Colorization with Learned Deep Priors

PixColor: Pixel Recursive Colorization

cGAN-based Manga Colorization Using a Single Training Image

Sounds

Visually Indicated Sounds

Music

GRUV: Algorithmic Music Generation using Recurrent Neural Networks

DeepHear - Composing and harmonizing music with neural networks

Using AutoHarp and a Character-Based RNN to Create MIDI Drum Loops

Musical Audio Synthesis Using Autoencoding Neural Nets

sound-rnn: Generating sound using recurrent neural networks

Using LSTM Recurrent Neural Networks for Music Generation (Project for AI Prac Fall 2015 at Cornell)

Visually Indicated Sounds (MIT. 2015)

Training a Recurrent Neural Network to Compose Music

LSTM Realbook

LSTMetallica: Generation drum tracks by learning the drum tracks of 60 Metallica songs

deepjazz: Deep learning driven jazz generation using Keras & Theano!

Magenta: Music and Art Generation with Machine Intelligence

Music Transcription with Convolutional Neural Networks

Long Short-Term Memory Recurrent Neural Network Architectures for Generating Music and Japanese Lyrics

BachBot: Use deep learning to generate and harmonize music in the style of Bach

Generate Music in TensorFlow

Generate new lyrics in the style of any artist using LSTMs and TensorFlow

sound-GAN: Generative Adversial Network for music composition

Analyzing Six Deep Learning Tools for Music Generation

WIMP2: Creating Music with AI: Highlights of Current Research

Song From PI: A Musically Plausible Network for Pop Music Generation

Grammar Argumented LSTM Neural Networks with Note-Level Encoding for Music Composition

用TensorFlow生成周杰伦歌词

Hip-Hop - Generating lyrics with RNNs

Metis Final Project: Music Composition with LSTMs

http://blog.naoya.io/metis-final-project-music-composition-with-lstms/

Neural Translation of Musical Style

Poetry

NeuralSnap: Generates poetry from images using convolutional and recurrent neural networks

Generating Chinese Classical Poems with RNN Encoder-Decoder

Chinese Poetry Generation with Planning based Neural Network

Weiqi (Go)

Teaching Deep Convolutional Neural Networks to Play Go

Move Evaluation in Go Using Deep Convolutional Neural Networks(Google DeepMind, Google Brain)

Training Deep Convolutional Neural Networks to Play Go

Computer Go Research - The Challenges Ahead (Martin Müller. IEEE CIG 2015)

GoCNN: Using CNN for Go (Weiqi/Baduk) board evaluation with tensorflow

DarkGo: Go in Darknet

BetaGo: Go bots for the people

DarkForest

Better Computer Go Player with Neural Network and Long-term Prediction (Facebook AI Research)

AlphaGo

Mastering the game of Go with deep neural networks and tree search (AlphaGo. Google DeepMind)

How Alphago Works

AlphaGo in Depth

Leela

  • intro: Leela is a strong Go playing program combining advances in Go programming and further original research into a small, easy to use graphical interface.
  • homepage: https://sjeng.org/leela.html

Chess

Giraffe: Using Deep Reinforcement Learning to Play Chess (MSc thesis)

Spawkfish: neural network based chess engine

Chess position evaluation with convolutional neural network in Julia

Deep Learning for … Chess

DeepChess: End-to-End Deep Neural Network for Automatic Learning in Chess

Game

Learning Game of Life with a Convolutional Neural Network

Reinforcement Learning using Tensor Flow: A deep Q learning demonstration using Google Tensorflow

Poker-CNN: A Pattern Learning Strategy for Making Draws and Bets in Poker Games Using Convolutional Networks

Courses

Learning Machines

http://www.patrickhebron.com/learning-machines/

Learning Bit by Bit

https://itp.nyu.edu/varwiki/Syllabus/LearningBitbyBitS10

MACHINE LEARNING FOR MUSICIANS AND ARTISTS (Course opens January 2016)

https://www.kadenze.com/courses/machine-learning-for-musicians-and-artists/info

Machine learning for artists @ ITP-NYU, Spring 2016

Machine Learning for Artists @ OpenDot, November 2016

The Neural Aesthetic @ SchoolOfMa, Summer 2016

http://ml4a.github.io/classes/neural-aesthetic/

Blogs

Review of machine / deep learning in an artistic context

https://medium.com/@memoakten/machine-deep-learning-in-an-artistic-context-441f28774bcc#.gegpq99ag

Apprentice Work

https://www.technologyreview.com/s/600762/apprentice-work/

Exploring the Intersection of Art and Machine Intelligence

http://googleresearch.blogspot.jp/2016/02/exploring-intersection-of-art-and.html

Using machine learning to generate music

http://www.datasciencecentral.com/profiles/blogs/using-machine-learning-to-generate-music

art in the age of machine intelligence

https://medium.com/artists-and-machine-intelligence/what-is-ami-ccd936394a83#.hyt4ei9a9

Understanding Aesthetics with Deep Learning

https://devblogs.nvidia.com/parallelforall/understanding-aesthetics-deep-learning/

Go, Marvin Minsky, and the Chasm that AI Hasn’t Yet Crossed

blog: https://medium.com/backchannel/has-deepmind-really-passed-go-adc85e256bec#.inx8nfid0

A Return to Machine Learning

Resources

Music, Art and Machine Intelligence Workshop 2016