Internet of things (IoT) plays a big important role in agricultural industry recently in order to provide a support to farmers such as growth monitoring system of temperature, humidity and water supply, and also early disease monitoring and detection system. To provide a smart farming solutions, this paper proposed an IoT system with a bot notification on tomato growing stages. The tomato dataset was obtained from Shinchi Agri-Green, the tomato greenhouse in Fukushima, Japan. We trained and tested the deep learning model to detect the fruit proposal region. Then, the detected regions were classified into 6 stages of fruit growth using the visible wavelength as a feature in SVM classification with the weight accuracy of 91.5%.