Abstract: TOver recent years, there is a huge increase in road accidents which makes us take more surveillance actions to reduce road accidents. In recent due to researches there is a huge improvement in the field of deep learning and computer vision. Our project is mainly focused on developing a vision based alert system for drivers. We built the model with the help of convolution neural networks a sub field of deep learning and computer vision. We have taken road sign data and trained the model to detect 32 different road signs. The data has been collected from German road sign datasets which consists of 20000 images. We developed the learning model with Keras frame- work which is a highlevel API. The Keras works on the Tensor Flow backend which is developed by Google. The Keras framework enables us to build a state-of-the-art model to detect the road sign. For developing the model and to pre-processes the image we have used python language which has a vast number of libraries for image computations and to build deep neural networks. The main aim of our project is to develop a vision based alert system for drivers which will help us to improve road safety. Our model will also help new learners to improve the driving experience.