**Pre-conference publication**
22 Apr 2020

**Pre-conference publication** | 22 Apr 2020

# Land subsidence modelling using a long short-term memory algorithm based on time-series datasets

Huijun Li, Lin Zhu, Huili Gong, Hanrui Sun, and Jie Yu

**Huijun Li et al.**Huijun Li, Lin Zhu, Huili Gong, Hanrui Sun, and Jie Yu

- Laboratory Cultivation Base of Environment Process and Digital Simulation, Capital Normal University, Beijing, 100048, China

- Laboratory Cultivation Base of Environment Process and Digital Simulation, Capital Normal University, Beijing, 100048, China

**Correspondence**: Lin Zhu (hi-zhulin@163.com)

**Correspondence**: Lin Zhu (hi-zhulin@163.com)

With the rapid growth of data volume and the development of artificial intelligence technology, deep-learning methods are a new way to model land subsidence. We utilized a long short-term memory (LSTM) model, a deep-learning-based time-series processing method to model the land subsidence under multiple influencing factors. Land subsidence has non-linear and time dependency characteristics, which the LSTM model takes into account. This paper modelled the time variation in land subsidence for 38 months from 2011 to 2015. The input variables included the change in land subsidence detected by InSAR technology, the change in confined groundwater level, the thickness of the compressible layer and the permeability coefficient. The results show that the LSTM model performed well in areas where the subsidence is slight but poorly in places with severe subsidence.

The continuous over-pumping of groundwater can result in dramatic drawdown and regional land subsidence, threatening the living environment. Land subsidence is often related to anthropogenic factors that can cause economic losses and casualties, such as municipal infrastructure damage, cracks in transport facilities, and building fractures.

Land subsidence is a complex process influenced by the interaction of anthropogenic activities and the hydrogeological environment. It often develops unevenly and seasonally and can display hysteresis depending on the soil mechanical properties (Ezquerro et al., 2014; Miller and Shirzaei, 2015; Bonì et al., 2016; Gao et al., 2018; Haghighi and Motagh, 2019).

Previous studies on the mechanism of land subsidence were based on the well-understood constitutive model, and the numerical simulation model was established to simulate the future displacement. However, explicit description of hydrogeological information which may have space–time sparseness is required to do so accurately. This constrains its application for large areas. The grey model (GM) based on grey theory is an alternative model to predict the short-term land subsidence, but it ignores the non-linear characteristic of land subsidence. Some researchers proposed the modified GM model combined with artificial neural network (ANN) or other algorithms to deal with the non-linear features (Li et al., 2007). These methods can have a good short-term prediction and perform well when data volume is small, while the deep information cannot be mined when the data volume is large and cannot be used in long-term prediction.

The long short-term memory (LSTM) model is a deep-learning method that can
process a large volume of time-series data and forecast the value of the next
moment. It constructs a multilayer neural network to excavate the temporal
dynamic features of historical data, considering the non-linearity and
temporal dependency characteristics. The prediction period depends on the
time interval of the input data. It has been successfully applied to PM_{2.5}
concentration forecasting, which is a temporal–spatial phenomenon (Qi et al., 2019), but no research used this method to simulate the land subsidence.

With the rapid growth of land subsidence data volume obtained by InSAR technology, the application of deep-learning methods of recent studies shows its potential in time-series land subsidence modelling (Yu et al., 2018). In this paper, we utilized the LSTM method to model the land subsidence under multiple influencing factors.

## 2.1 Study area

The study area is located in the Beijing Plain, where the largest cumulative land subsidence from 2011 to 2015 had been reached at 624.42 mm, as shown in Fig. 1. Due to urban sprawl and groundwater extraction, land subsidence in Beijing has become a matter of concern and is threatening the sustainable development of the city.

## 2.2 Available datasets

As noted in the literature, excessive exploitation of groundwater is the main trigger of land subsidence, and compressible layers are geologically responsible for the land subsidence in the Beijing Plain region (Zhu et al., 2015, 2017; Chen et al., 2016). This study considered these two aspects to be the influencing factors of land subsidence. The available datasets include the confined groundwater level, the thickness of the compressible layer, the permeability coefficient, and the cumulative land subsidence from 2011 to 2015 derived from 38 RadarSat-2 descending images. Constrained by accessible groundwater data, we got 16 487 persistent scatterer (PS) points. Therefore, we have in total 626 506 samples recording the LOS subsidence and the related influencing factors to simulate the land subsidence.

## 2.3 Data processing

The confined groundwater level observed by the monitoring stations was interpolated using the kriging interpolation method into a raster with a 20 m×20 m grid size by a batch process. The thickness of the compressible layer and the permeability coefficient of the study area were both represented by a contour. So, they were converted into points and interpolated using the kriging method. The change in the confined groundwater level was calculated and used as the input variable of the LSTM model together with the other two factors. The cumulative land subsidence was also converted into the variation to eliminate its tendency. All the data were normalized using the min–max scaling method. All these attributes were extracted to the PS points by a spatial analysis tool in ArcGIS.

## 3.1 InSAR technology

InSAR technology records the phase and amplitude of the electromagnetic waves of ground objects. The phase information is used to inversely determine the extent of land subsidence. PS-InSAR (PSI) is the most common and effective method for detecting regional time-series land subsidence by calculating the differential interferometric phase and generating lots of PS points. PSI technology overcomes the problems of temporal and geometrical decorrelation and minimizes the atmospheric and noise phase contributions. The outputs include (1) the coordinates of land subsidence points, (2) the LOS cumulative land subsidence and (3) the land subsidence rate. Increasing availability of the long-term and large amount of land subsidence data detected by InSAR technology has provided the chance for data-driven modelling.

## 3.2 LSTM algorithm

A RNN (recurrent neural network) is a kind of deep neural network for
processing sequence data considering the impact of last moments on the
present. Parameter sharing on a time domain with a loop structure is its
important character. As shown in Fig. 2a, *X*_{t} represents the input
characteristics at time *t*, *A* is the computing unit which is also known as the
hidden layer, and *h*_{t} is the output value. The hidden layer controls the
information conversion process of the sequence data. It fits the mapping
relations between the input multidimensional features and the labels and
learns the weight matrix and bias to calculate the corresponding output
value. However, RNN suffers from vanishing gradient or gradient explosion
problems when dealing with long-term time-series data.

The LSTM proposed by Hochreiter and Schmidhuber (1997) is a computing unit in a
RNN structure. It introduced a gating function to avoid the long-term
dependency problem. As shown in Fig. 2b, *f*_{t}, *i*_{t},
and *o*_{t} are three non-linear gate functions and named the forget gate,
input gate, and output gate in each memory block, respectively. The key to the LSTM
is the cell state *C*_{t}, which has only a small amount of linear
interaction during the entire operation. It can effectively record history
information for a long time through the three gates. For an input vector
*x*_{t}, the calculation equations for an LSTM unit with the three gates are
as follows:

where **W**_{f}, **W**_{i}, **W**_{o}, and **W**_{C} are the weight matrices for input
vectors and *b*_{f}, *b*_{i}, *b*_{o}, and *b*_{C} are the bias vectors at time
*t*, respectively. ${\stackrel{\mathrm{\u0303}}{\mathit{C}}}_{t}$ is the cell state of *x*_{t} involving the
hidden state value *h*_{t-1} from a previous block at time *t*-1. *C*_{t} is the
current unit state controlled by *f*_{t} and *i*_{t}. *h*_{t} is the
current output value controlled by the output gate and the current unit state.
*σ* and tanh are the activation functions, a non-linear
calculation process.

## 3.3 Subsidence modelling

The LSTM model structure established in this study was drawn in Fig. 3.
The orange dots are the PS points, which record the time-series land
subsidence derived from synthetic aperture radar (SAR) images and corresponding attributes that
influence the land subsidence. The green block which contains the LSTM
computing cell is the memory block of the RNN model. *X*_{t} = {*V*_{1t}, *V*_{2t}, *V*_{it}} are the input
data at time *t*. *V*_{it} is the *i*th attribute of each PS point at time *t*.
The model would extract the characteristics of the multiple attributes through
the time-series data from the input samples.

In this study, *X*_{t} = {*V*_{1t},
*V*_{2t}, *V*_{3t}, *V*_{4t}} = {the change in land subsidence, the change in confined groundwater level,
compressible layer thickness, permeability coefficient}. It
was a four-dimensional vector. The subsidence data were as the input labels
and the attribute data were as the input features in the model-learning
period. The model simulates the relationships between the change in
subsidence and influencing factors.

## 4.1 Experimental settings

The detailed experimental settings are listed in Table 1. The datasets were randomly divided into 70 % for the training set and 30 % for the test set to verify the accuracy of the model. The distribution of these data is shown in Fig. 4. The model training stage used the sum of variance between the modelled and accurate values to calculate the loss. The gradient descent optimizer was used for the parameter optimization. The activation function was the common one Tanh. Limited by the data volume, the learning rate was set to 0.001 and the hidden layers were set to eight. A higher value can be set when the data volume is larger.

## 4.2 Experimental results

We got 13 190 points, in total 501 220 records as the training data, and 3297 points, in total 125 286 records, to test the model.

### 4.2.1 Results of LSTM modelling

To evaluate the performance of the model, 12 PS points were selected randomly as the validation point (the black triangle legend in Fig. 1). We compared the modelled land subsidence with the InSAR-derived results and evaluated the errors with root-mean-square error (RMSE). As shown in Table 2, the southern points (P11, P12) with less of a cumulative subsidence have a small error, while those points located in the severe land subsidence areas (P1, P3, P5, P6, P7) have a high RMSE.

To evaluate the impact of land subsidence severity on the model results, we chose P11 and P12 located in the southern area where the subsidence is small, P4 and P10 at the edges of the subsidence regions and P1 and P7 in the severe land subsidence areas. The fitting curves between the modelled and InSAR-derived land subsidence of these points were plotted in Fig. 5.

The results show that the LSTM model performed well in areas where the subsidence is slight but poorly in places with severe subsidence.

Overall, the RMSE and MAE are 14.412 and 10.539, respectively. Notably, the results recorded the change in land subsidence, which means that the RMSE represented the error of the change in land subsidence.

We calculated the change amount of land subsidence back to a cumulative quantity to assess the accuracy of the modelled cumulative land subsidence. The RMSE is 67.599. Figure 6 plotted the deviation between the modelled and InSAR-derived cumulative land subsidence. The deviation is small when the cumulative land subsidence is less than 100 mm. As the land subsidence increases, the deviation increases.

### 4.2.2 Analysis of the error source

As the results show, the severe land subsidence regions got a poor fit. These are areas of intense human activities (e.g. urban construction) and complex hydrogeological conditions, which are not reflected completely in the model.

There are two main error sources. One comes from inaccurate data and the selection of the input variables. In this study, we chose the confined groundwater level, the compressible layer thickness and the permeability coefficient as the influencing factors. The input groundwater level data were interpolated by the kriging method which may ignore the influence of the geological environment. The permeability coefficient has very little impact on the result. The selection of the input variables should include the main factors that affect land subsidence, such as the compressibility. These data are unpublished in our study area. It may be inverse to geotechnical test and geophysical methods in the future.

The other comes from the imperfect method. The LSTM model can process the time-series data well, but cannot deal with spatial phenomena. However, besides the groundwater level, the other two factors are almost constant in the time domain and spatially heterogeneous. This may be solved by combining the convolutional neural network (CNN) model which can extract spatial characteristics. In addition, the LSTM extracts characteristics from data, ignoring the physical process of land subsidence. This may also reduce its accuracy.

This study constructed an LSTM model to simulate the land subsidence using the PS data detected by InSAR technology. Three factors were considered, which are the change in confined groundwater level, compressible layer thickness, and permeability coefficient. The model performed well in the southern areas where the subsidence is slight but poorly in the northern places with severe land subsidence. Land subsidence is a temporal–spatial phenomenon, and the LSTM model is a data analysis method with no consideration of physical mechanisms. In the future, we should combine the CNN model to solve the spatial heterogeneity and consider the physical process such as the consolidation theory in the model. Compared with the numerical simulation model and other grey models, this method requires fewer hydrogeological parameters and can be used for long-term large-area land subsidence modelling.

The data used in this study will be available from the corresponding author on reasonable request.

HJL completed the experiment and paper, LZ and HLG provided rigorous guidance to the thesis, HRS processed part of the datasets, JY revised the paper.

The authors declare that they have no conflict of interest.

This article is part of the special issue “TISOLS: the Tenth International Symposium On Land Subsidence – living with subsidence”. It is a result of the Tenth International Symposium on Land Subsidence, Delft, the Netherlands, 17–21 May 2021.

Bonì, R., Cigna, F., Bricker, S., Meisina, C., and McCormack, H.: Characterisation of hydraulic head changes and aquifer properties in the London Basin using Persistent Scatterer Interferometry ground motion data, J. Hydrol., 540, 835–849, 2016.

Chen, M., Tomaìs, R., Li, Z. H., Motagh, M., Li, T., Hu, L. Y., Gong, H. L., Li, X. J., Yu, J., and Gong, X. L.: Imaging land subsidence induced by groundwater extraction in Beijing (China) using satellite radar interferometry, Remote Sens., 8, 468–489, 2016.

Ezquerro, P., Herrera, G., Marchamalo, M., Tomás, R., Béjar-Pizarro, M., and Martínez, R.: A quasi-elastic aquifer deformational behavior: Madrid aquifer case study, J. Hydrol., 519, 1192–1204, 2014.

Gao, M. L., Gong, H. L., Chen, B. B., Li, X. J., Zhou, C. F., Shi, M., Si, Y., Chen, Z., and Duan, G. Y.: Regional Land Subsidence Analysis in Eastern Beijing Plain by InSAR Time Series and Wavelet Transforms, Remote Sens., 10, 365–382, 2018.

Haghighi, H. M. and Motagh, M.: Ground surface response to continuous compaction of aquifer system in Tehran, Iran: Results from a long-term multi-sensor InSAR analysis, Remote Sens. Environ., 221, 534–550, 2019.

Hochreiter, S. and Schmidhuber, J.: Long short-term memory, Neural Comput., 9, 1735–1780, 1997.

Li, G. D., Yamaguchi, D., and Nagai, M.: A GM(1,1)–Markov chain combined model with an application to predict the number of Chinese international airlines. Technological Forecasting and Social Change, Technol. Forecast. Soc. Change, 74, 1465–1481, 2007.

Miller, M. M. and Shirzaei, M.: Spatiotemporal characterization of land subsidence and uplift in Phoenix using InSAR time series and wavelet transforms, J. Geophys. Res.-Solid Earth, 120, 5822–5842, 2015.

Qi, Y., Li, Q., Karimian, H., and Liu, D.: A hybrid model for spatiotemporal forecasting of PM2.5 based on graph convolutional neural network and long short-term memory, Sci. Total Environ., 664, 1–10, https://doi.org/10.1016/j.scitotenv.2019.01.333, 2019.

Yu, B., Yin, H., and Zhu, Z.: Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecasting, https://doi.org/10.24963/ijcai.2018/505, 2018.

Zhu, L., Gong, H. L., Li, X. J., Wang, R., Chen, B. B., Dai, Z. X., and Teatini, P.: Land subsidence due to groundwater withdrawal in the northern Beijing plain, China, Eng. Geol., 193, 243–255, 2015.

Zhu, L., Gong, H., Dai, Z., Guo, G., and Teatini, P.: Modeling 3-D permeability distribution in alluvial fans using facies architecture and geophysical acquisitions, Hydrol. Earth Syst. Sci., 21, 721–733, https://doi.org/10.5194/hess-21-721-2017, 2017.