Please use this identifier to cite or link to this item:
https://hdl.handle.net/2440/77610
Type: | Conference paper |
Title: | Exploring the impact of data splitting methods on artificial neural network models |
Author: | Wu, W. Maier, H. Dandy, G. May, R. |
Citation: | Proceedings of the 10th International Conference on Hydroinformatics: Understanding Changing Climate and Environment and Finding Solutions, held in Hamburg, Germany, 14-18 July, 2012: pp.1-8 |
Publisher: | HIC2012 |
Publisher Place: | CD |
Issue Date: | 2012 |
Conference Name: | International Conference on Hydroinformatics (10th : 2012 : Hamburg, Germany) |
Statement of Responsibility: | Wenyan Wu, Holger R. Maier, Graeme C. Dandy and Robert May |
Abstract: | Data splitting is an important step in the artificial neural network (ANN) development process whereby data is divided into training, test and validation subsets to ensure good generalization ability of the model. In previous research, guidelines on choosing a suitable data splitting method based on the dimensionality and distribution of the dataset were derived from results obtained using synthetic datasets. This study extends previous research by investigating the impact of three data splitting methods tested in previous research on the predictive performance of ANN models using real-world datasets. Three real-world water resources datasets with varying statistical properties are used. It has been found that the relationship between different data splitting methods and data with different statistical properties obtained in previous research using synthetic data also generally holds for realworld water resources data. However, some data splitting methods produce an optimistically low validation error due to the bias created by allocating the extreme observations to the training set. |
Rights: | Copyright status unknown |
Description (link): | http://www.wqra.com.au/research-strategy/issue-details/49 |
Appears in Collections: | Aurora harvest 4 Civil and Environmental Engineering publications Environment Institute publications |
Files in This Item:
There are no files associated with this item.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.