In this paper we tackle the problem of Colorization of Grayscale Videos given a few colored keyframes of the video. We propose a model that extracts keyframes from the video and trains a Convolutional Neural Network from scratch on these colored frames. Once the model has been trained we colorize the rest of the frames of the video given their grayscale versions. An application of this technique is in saving bandwidth while sending raw colored videos that haven't gone through any compression. A raw colored video takes upto three times more memory than it's grayscale version. We can exploit this fact and send a grayscale video along with our trained model instead of a colored one. This will reduce bandwidth usage to upto three times.