Use a pre-trained network to do a novel classification problem