Publications

|

Publication Details

25 Feb 19

Assessing the performance of 38 machine learning models: the case of land consumption rates in Bavaria, Germany.

Authors: HAGENAUER Julian, OMRANI Hichem, HELBICH Marco.

Online First: 22/02/2019

DOI: http://doi.org/10.1080/13658816.2019.1579333

Abstract:

Machine learning (ML) is at the forefront of land-use change modeling. Due to numerous available ML approaches, the model choice is complex and usually based on ad hoc decisions, though informed through a few comparative studies that considered a limited number of models. This study contributes a comprehensive comparison of 38 ML models to examine land consumption rates (LCR) (i.e. the transition of landscapes to built-up areas). We modeled LCR for 2009–2015 in Bavaria, Germany, and predicted rates for 2015–2021 at a municipality level. To assess the performance of each approach, we measured the mean absolute error (MAE), the root-mean-square error (RMSE), and the coefficient of determination (R2) using cross-validation. All algorithms consistently predicted that the land consumption rate for Bavaria will increase. eXtreme gradient boosting decision trees performed best with respect to the RMSE (0.500) and R2 (0.183), while the support vector machine with polynomial kernel has the lowest MAE (0.288). The generalized additive model and the random forest models also performed well. We recommend these ML approaches for future land consumption and land-use change studies. A poor performance was found for recursive partitioning by decision trees, self-organizing maps, and partitioning using deletion, substitution, and addition moves.

Reference: HAGENAUER Julian, OMRANI Hichem, HELBICH Marco. Assessing the performance of 38 machine learning models: the case of land consumption rates in Bavaria, Germany. International Journal of Geographical Information Science, 2019.

Keywords:
Land consumption,
land-use,
machine learning,
model comparison,
Germany

Linked publications
WANG Lingzhi, WEI Ye, OMRANI Hichem, PIJANOWSKI Bryan, DOUCETT Jarrod, LI Ke, WU Yang.
Sustainable Cities and Society, 2019.
BELLISARIO Kristen, BROADHEAD Taylor, SAVAGE David, ZHAO Zhao, OMRANI Hichem, ZHANG Saihua, SPRINGER John, PIJANOWSKI Bryan.
Ecological Informatics, 2019.
WANG Lingzhi, OMRANI Hichem, ZHAO Zhao, FRANCOMANO Dante, LI Ke, PIJANOWSKI Bryan.
PLOS One, 2019.
MUSTAFA Ahmed, HEPPENSTALL Alison, OMRANI Hichem, SAADI Ismaïl, COOLS Mario, TELLER Jacques.
Computers, Environment and Urban Systems, 2018, vol. 67, pp. 147-156.