a resilient infrastructure system remains a top priority for canada as it is hinged to strong economies. corrosion, ageing, aggressive environments, material defects, and unforeseen mechanical loads can compromise the serviceability and safety of existing infrastructures. introducing artificial intelligence (ai) in smart structural health monitoring (shm) can assist in building an automated and efficient infrastructure condition monitoring method to facilitate an effortless inspection and accurate evaluation of deteriorated infrastructure. over the last decades, vision-based ai has proven successful in pattern recognition applications and motivated this current research to assemble a data-driven damage detection technique. to further explore the possibilities of deep-learning (dl) applications, this dissertation research aims to develop an autonomous damage assessment process using dl techniques to classify and detect two types of defects- crack and spalling on concrete structures. this research started with reviewing existing application of various dl-based technologies for damage detection of concrete structures and identifying the challenges and limitations. one major challenge in dl-based shm technique is the lack of adequate real image database obtained from field inspection. to address these challenges, this research has created a diverse dataset with concrete crack (4087) and spalling (1100) images and used it for damage detection and classification by applying convolutional neural network (cnn) algorithms. for defects classification vgg19, resnet50, inceptionv3, mobilenetv2, and xception cnn models were used, whereas semantic segmentation process adopted encoder-decoder models- u-net and pspnet. for both cases a detailed sensitivity analysis of hyper-parameters (i.e., batch size, optimizers, learning rate) was performed to compare their performances and identify the best-performed model. after assessing all the criteria, the best performance for defects classification was achieved by inceptionv3. on the other hand, for crack and spalling segmentation u-net outperformed the other models. overall, the developed algorithms achieved an excellent performance in damage classification and localization and proved to be successful enough to offer an automated inspection platform for ageing infrastructures. the outcomes of this study signify that the data-driven cnn methods could be a promising solution for the condition assessment of deteriorating concrete structures. the research outcomes can be implemented by practitioners for condition assessment of existing infrastructure and recommending proper rehabilitation measures.