Does pre-training step help in convolution neural network?

The answer is DEPENDS. When you have a lot of training data, it does not need to have pre-training step (unsupervised) because the weights eventually will converge to certain values. But if you don’t have much labeled data, then go ahead and do unsupervised pre-training.

 

See this: http://www.quora.com/When-does-unsupervised-pre-training-improve-classification-accuracy-for-a-deep-neural-network-When-does-it-not

Advertisements


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s