Explainable Transfer Learning Framework for Water Quality Prediction in Data-Scarce Developing Regions
Article Sidebar
Main Article Content
Safe drinking water access continues to be a preva-lent public health challenge for developing nations, in which continuous water quality monitoring becomes infeasible due to the lack of resources, laboratory facilities, and sensors. Machine learning methods have been successfully applied for predicting water quality metrics such as dissolved oxygen (DO), turbidity, and pH. Nonetheless, traditional supervised machine learning models require sufficient amounts of labeled data (greater than 1000 instances) for optimal generalization. Due to the data-scarcity problem, only 100–200 historical instances are usually available for training. As a result, overfitting becomes inevitable. This paper proposes an Explainable Transfer Learning (XTL) approach for water quality prediction called XTL-WQ. We intro-duce three techniques: (i) a pre-trained Long Short-Term Mem-ory (LSTM) model; (ii) Maximum Mean Discrepancy (MMD) for domain adaptation; and (iii) SHapley Additive exPlanations (SHAP) for interpretability. On DO prediction, we achieve an RMSE of 0.42 mg/L with XTL-WQ, compared to 0.61 mg/L for LSTM baseline (+31% improvement). Under extreme data scarcity (less than 30 instances), our model achieves an RMSE of 0.51, while baselines exceed 0.75 mg/L.
Downloads
References
Pan, S. J., and Yang, Q., “A survey on transfer learning,” IEEE Transactions on Knowledge and Data Engineering, vol. 22, no. 10, pp. 1345–1359, 2010.
Lundberg, S. M., and Lee, S. I., “A unified approach to interpreting model predictions,” in Advances in Neural Information Processing Systems, vol. 30, pp. 4765–4774, 2017.
Gretton, A., Borgwardt, K. M., Rasch, M. J., Scho¨lkopf, B., and Smola, A., “A kernel two-sample test,” Journal of Machine Learning Research, vol. 13, pp. 723–773, 2012.
Fig. 36. Comprehensive XTL-WQ performance dashboard summarizing model evaluation metrics, prediction performance, domain adaptation results, and explainability analysis.
Hochreiter, S., and Schmidhuber, J., “Long short-term memory,” Neural Computation, vol. 9, no. 8, pp. 1735–1780, 1997.
Ribeiro, M. T., Singh, S., and Guestrin, C., “Why should I trust you? Explaining the predictions of any classifier,” in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1135–1144, 2016.
Rudin, C., “Stop explaining black box machine learning models for high stakes decisions,” Nature Machine Intelligence, vol. 1, no. 5, pp. 206–215, 2019.
Kargar, K., Sadeghian, A., and Nasseri, M., “Data scarcity in water quality modeling: A systematic review,” Environmental Modelling & Software, vol. 133, pp. 104–118, 2020.
Wang, H., Zhao, Y., and Chen, L., “Transfer learning for water quality prediction in unmonitored catchments,” Water Research, vol. 212, pp. 118–127, 2022.
Ahmed, A. N., Othman, F. B., and Afan, H. A., “Machine learning for water quality classification,” Journal of Hydrology, vol. 579, pp. 124–136, 2019.
Liu, P., and Chen, X., “Comparative analysis of machine learning models for water quality prediction with limited data,” Environmental Science and Pollution Research, vol. 28, no. 34, pp. 46822–46835, 2021.
Zhao, L., Li, X., and Wang, J., “Domain adaptation for soil moisture estimation using transfer learning,” Remote Sensing of Environment, vol. 245, pp. 111–124, 2020.
Xu, Y., Liu, H., and Wang, Z., “Transfer learning for air quality prediction across cities,” Environmental Research Letters, vol. 13, no. 8, pp. 084–092, 2018.
Chen, J., Zhang, D., and Yang, K., “Interpretable machine learning for groundwater arsenic prediction,” Water Resources Research, vol. 57, no. 6, p. e2020WR028124, 2021.
Ghobadi, F., and Kang, D., “A review of explainable artificial intelli-gence applications in water quality modeling,” Environmental Modelling & Software, vol. 157, pp. 105–118, 2022.
Zhang, Y., Li, C., and Wang, H., “LSTM with attention mechanism for water quality prediction,” Journal of Hydrology, vol. 598, pp. 126–138, 2021.
Breiman, L., “Random forests,” Machine Learning, vol. 45, no. 1, pp. 5–32, 2001.
Long, M., Zhu, H., Wang, J., and Jordan, M. I., “Unsupervised domain adaptation by backpropagation,” in International Conference on Machine Learning, pp. 1–9, 2015.
Drucker, H., Burges, C. J., Kaufman, L., Smola, A., and Vapnik, V.,
“Support vector regression machines,” in Advances in Neural Informa-tion Processing Systems, vol. 9, pp. 155–161, 1997.
Chen, T., and Guestrin, C., “XGBoost: A scalable tree boosting system,” in Proceedings of the 22nd ACM SIGKDD International Conference, pp. 785–794, 2016.
Kingma, D. P., and Ba, J., “Adam: A method for stochastic optimiza-tion,” in International Conference on Learning Representations, pp. 1–15, 2015.
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., and Salakhut-dinov, R., “Dropout: A simple way to prevent neural networks from overfitting,” Journal of Machine Learning Research, vol. 15, no. 1, pp. 1929–1958, 2014.
Tibshirani, R., “Regression shrinkage and selection via the lasso,” Journal of the Royal Statistical Society Series B, vol. 58, no. 1, pp. 267–288, 1996.
Zou, H., and Hastie, T., “Regularization and variable selection via the elastic net,” Journal of the Royal Statistical Society Series B, vol. 67, no. 2, pp. 301–320, 2005.
Bengio, Y., “Practical recommendations for gradient-based training of deep architectures,” in Neural Networks: Tricks of the Trade, pp. 437–478, 2012.
Goodfellow, I., Bengio, Y., and Courville, A., Deep Learning. MIT Press, 2016.
Chollet, F., Deep Learning with Python. Manning Publications, 2017.
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., et al., “Scikit-learn: Machine learning in Python,” Journal of Machine Learning Research, vol. 12, pp. 2825–2830, 2011.
United Nations Children’s Fund (UNICEF), “Progress on household drinking water, sanitation and hygiene 2000–2022: Special focus on gender,” WHO/UNICEF Joint Monitoring Programme, 2023.
World Health Organization, Guidelines for Drinking-Water Quality (4th ed.). WHO Press, 2022.
United Nations, “Sustainable Development Goal 6: Clean water and sanitation progress report,” United Nations Publications, 2023.
This work is licensed under a Creative Commons Attribution 4.0 International License.
All articles published in our journal are licensed under CC-BY 4.0, which permits authors to retain copyright of their work. This license allows for unrestricted use, sharing, and reproduction of the articles, provided that proper credit is given to the original authors and the source.