Does pre-training step help in convolution neural network?

The answer is DEPENDS. When you have a lot of training data, it does not need to have pre-training step (unsupervised) because the weights eventually will converge to certain values. But if you don’t have much labeled data, then go ahead and do unsupervised pre-training.


See this: