– 2 –
The recent advances of AI have had an enormous effect on automated engineering
systems’ capabilities, with SHM being no exception. Many studies have been focused on visual
inspections and image processing techniques that benefit from deep/machine learning algorithms
(Dong and Catbas 2020; Liang 2019; Sajedi and Liang 2021). Images are valuable sources of
information but face certain limits when it comes to near real-time damage diagnosis. For
example, visual data might not be readily available after an earthquake, and it might only
represent surface damage in concrete bridges (Kashif Ur Rehman et al. 2016). Another limitation
is that quantifying structural damage is challenging or, in cases impossible, using pixel data.
Vibration-based SHM is an alternative damage diagnosis of civil infrastructure that has
the potential to address these problems. Some studies have focused on using data-driven models
solely relying on ground motion signals in seismic assessments (Tamhidi et al. 2020; Xu et al.
2020). However, Bridges can be instrumented with an array of accelerometers where the
vibration data is uploaded into remote servers in near real-time. Instrumented structures have the
potential to provide more accurate and robust information about structural damage. Vibration
patterns can be utilized to obtain quantifiable measures of structural damage as they reflect
dynamic structural characteristics.
The mappings between acceleration time-series and structural damage can be
complicated. Data-driven SHM models have shown promising performance to find such robust
mappings using the state-of-the-art deep/machine learning. Some studies have used the raw
acceleration records as the input (Abdeljaber et al. 2018). Others have proposed methods to
preprocess time-series before feeding them to a data-driven model (Azimi and Pekcan 2020;
Mangalathu and Jeon 2020; Sajedi and Liang 2020). There have been limited studies in the
literature that consider the temporal variations of input acceleration data as a part of the learning
process.
Automatic speech recognition (ASR) is one area where deep learning has shown
impressive success (Chan et al. 2016). Inspired by this progress, this paper investigates the
potential application of Mel Filter Banks (MFBs) and Mel Frequency Cepstral Coefficients
(MFCCs) for vibration-based damage diagnosis. The remainder of the paper first discusses the
steps required to obtain these features. Later, a reinforced concrete bridge in California is
considered to validate the potential use of the proposed signal preprocessing approach for AI-
equipped vibration-based SHM.
FEATURE EXTRACTION WITH MEL FILTER BANKS
Acceleration records due to seismic events are commonly recorded in thousands of time steps.
Using the raw vibration records as the direct input to a machine/deep learning algorithm is often
challenging concerning computational costs. The Recurrent Neural Networks (RNNs) and their
more advanced successors, including the Long Short-Term Memory (LSTM) and Gated
Recurrent Unit (GRU), are the proper models to learn from the temporal signal variations. Given
the raw vibration input size, these models could be ineffective in processing relatively long