A Feasible Data-Driven Mining System to Optimize Wastewater Treatment Process Design and Operation

Achieving low costs and high efficiency in wastewater treatment plants (WWTPs) is a common challenge in developing countries, although many optimizing tools on process design and operation have been well established. A data-driven optimal strategy without the prerequisite of expensive instruments an...

Full description

Bibliographic Details
Main Authors: Yong Qiu, Ji Li, Xia Huang, Hanchang Shi
Format: Article
Language:English
Published: MDPI AG 2018-09-01
Series:Water
Subjects:
Online Access:http://www.mdpi.com/2073-4441/10/10/1342
id doaj-eba7f6b9c4fb431b9ff71c024bff572a
record_format Article
spelling doaj-eba7f6b9c4fb431b9ff71c024bff572a2020-11-25T00:35:55ZengMDPI AGWater2073-44412018-09-011010134210.3390/w10101342w10101342A Feasible Data-Driven Mining System to Optimize Wastewater Treatment Process Design and OperationYong Qiu0Ji Li1Xia Huang2Hanchang Shi3State Key Joint Laboratory of Environment Simulation and Pollution Control, School of Environment, Tsinghua University, Beijing 100084, ChinaSchool of Environmental and Civil Engineering, Jiangnan University, Wuxi City 214122, ChinaState Key Joint Laboratory of Environment Simulation and Pollution Control, School of Environment, Tsinghua University, Beijing 100084, ChinaState Key Joint Laboratory of Environment Simulation and Pollution Control, School of Environment, Tsinghua University, Beijing 100084, ChinaAchieving low costs and high efficiency in wastewater treatment plants (WWTPs) is a common challenge in developing countries, although many optimizing tools on process design and operation have been well established. A data-driven optimal strategy without the prerequisite of expensive instruments and skilled engineers is thus attractive in practice. In this study, a data mining system was implemented to optimize the process design and operation in WWTPs in China, following an integral procedure including data collection and cleaning, data warehouse, data mining, and web user interface. A data warehouse was demonstrated and analyzed using one-year process data in 30 WWTPs in China. Six sludge removal loading rates on water quality indices, such as chemical oxygen demand (COD), total nitrogen (TN), and total phosphorous (TP), were calculated as derived parameters and organized into fact sheets. A searching algorithm was programmed to find out the five records most similar to the target scenario. A web interface was developed for users to input scenarios, view outputs, and update the database. Two case WWTPs were investigated to verify the data mining system. The results indicated that effluent quality of Case-1 WWTP was improved to meet the discharging criteria through optimal operations, and the process design of Case-2 WWTP could be refined in a feedback loop. A discussion on the gaps, potential, and challenges of data mining in practice was provided. The data mining system in this study is a good candidate for engineers to understand and control their processes in WWTPs.http://www.mdpi.com/2073-4441/10/10/1342wastewater treatment plantdata miningdata warehousedata cleaningprocess designoperational optimization
collection DOAJ
language English
format Article
sources DOAJ
author Yong Qiu
Ji Li
Xia Huang
Hanchang Shi
spellingShingle Yong Qiu
Ji Li
Xia Huang
Hanchang Shi
A Feasible Data-Driven Mining System to Optimize Wastewater Treatment Process Design and Operation
Water
wastewater treatment plant
data mining
data warehouse
data cleaning
process design
operational optimization
author_facet Yong Qiu
Ji Li
Xia Huang
Hanchang Shi
author_sort Yong Qiu
title A Feasible Data-Driven Mining System to Optimize Wastewater Treatment Process Design and Operation
title_short A Feasible Data-Driven Mining System to Optimize Wastewater Treatment Process Design and Operation
title_full A Feasible Data-Driven Mining System to Optimize Wastewater Treatment Process Design and Operation
title_fullStr A Feasible Data-Driven Mining System to Optimize Wastewater Treatment Process Design and Operation
title_full_unstemmed A Feasible Data-Driven Mining System to Optimize Wastewater Treatment Process Design and Operation
title_sort feasible data-driven mining system to optimize wastewater treatment process design and operation
publisher MDPI AG
series Water
issn 2073-4441
publishDate 2018-09-01
description Achieving low costs and high efficiency in wastewater treatment plants (WWTPs) is a common challenge in developing countries, although many optimizing tools on process design and operation have been well established. A data-driven optimal strategy without the prerequisite of expensive instruments and skilled engineers is thus attractive in practice. In this study, a data mining system was implemented to optimize the process design and operation in WWTPs in China, following an integral procedure including data collection and cleaning, data warehouse, data mining, and web user interface. A data warehouse was demonstrated and analyzed using one-year process data in 30 WWTPs in China. Six sludge removal loading rates on water quality indices, such as chemical oxygen demand (COD), total nitrogen (TN), and total phosphorous (TP), were calculated as derived parameters and organized into fact sheets. A searching algorithm was programmed to find out the five records most similar to the target scenario. A web interface was developed for users to input scenarios, view outputs, and update the database. Two case WWTPs were investigated to verify the data mining system. The results indicated that effluent quality of Case-1 WWTP was improved to meet the discharging criteria through optimal operations, and the process design of Case-2 WWTP could be refined in a feedback loop. A discussion on the gaps, potential, and challenges of data mining in practice was provided. The data mining system in this study is a good candidate for engineers to understand and control their processes in WWTPs.
topic wastewater treatment plant
data mining
data warehouse
data cleaning
process design
operational optimization
url http://www.mdpi.com/2073-4441/10/10/1342
work_keys_str_mv AT yongqiu afeasibledatadrivenminingsystemtooptimizewastewatertreatmentprocessdesignandoperation
AT jili afeasibledatadrivenminingsystemtooptimizewastewatertreatmentprocessdesignandoperation
AT xiahuang afeasibledatadrivenminingsystemtooptimizewastewatertreatmentprocessdesignandoperation
AT hanchangshi afeasibledatadrivenminingsystemtooptimizewastewatertreatmentprocessdesignandoperation
AT yongqiu feasibledatadrivenminingsystemtooptimizewastewatertreatmentprocessdesignandoperation
AT jili feasibledatadrivenminingsystemtooptimizewastewatertreatmentprocessdesignandoperation
AT xiahuang feasibledatadrivenminingsystemtooptimizewastewatertreatmentprocessdesignandoperation
AT hanchangshi feasibledatadrivenminingsystemtooptimizewastewatertreatmentprocessdesignandoperation
_version_ 1725307058314543104