The Evolutionary Pre-Processor (version 3.0)
Batch Run Report

 

Batch Details
Batch run name satimage_1
Description Satimage 1 on Gauss
This report file final/satimage_1/satimage_1_report.html
data file /home/cssip/jsherrah/EPrep3/data/satimage_1.dat
Time of completion Sat May 23 05:06:06 1998
Duration of Batch 65 hours, 16 minutes, 11 seconds
Random Seed 2183176873 (from clock)
Average generations per run 25.40
Average failed feature creations per run 4207.80
Average fitness evalutions per run 20528.20
Test Set Improvement 2.24 %
 
 

Data Partition
 
Class Training Validation Test Total
0 767 384 382 1533
1 351 175 177 703
2 679 339 340 1358
3 313 156 157 626
4 353 176 178 707
5 754 378 376 1508
Total 3217 1608 1610 6435

Summary of Results

  Original Classification Errors (%)
Classifier Training Validation Test
Parallelepiped(PPD) 32.27 33.40 34.53
Min. Distance to Means(MDTM) 21.54 21.83 23.91

  EPrep Best-of-run Classification Errors (%)
Run
Training
Validation
Test
McNemar confidence
# Features
# Inputs
# Nodes
Classifier
1 24.96 28.61 30.43 0.000 17 36 745 PPD
2 19.21 20.27 24.84 0.000 21 36 516 PPD
3 22.38 24.63 24.91 0.000 11 36 899 PPD
4 22.41 22.64 24.29 0.000 2 6 9 MDTM
5 17.94 19.65 21.68 0.618 25 36 856 PPD
6 20.92 24.25 43.11 0.000 19 36 763 PPD
7 20.42 20.21 22.55 0.970 24 24 24 MDTM
8 24.74 25.56 25.71 0.000 3 8 25 MDTM
9 20.42 20.21 22.55 0.970 24 24 24 MDTM
10 19.18 19.22 21.68 0.203 18 36 856 PPD
Ave. 21.26 (2.23 ) 22.52 (2.98 ) 26.17 (6.15 ) 0.28 (0.39 ) 16.40 (7.98 ) 27.80 (11.40 ) 471.70(381.31) PPD

  Confusion matrix for Best Ever Individual from run 10
Class
Predicted
Total
1
2
3
4
5
6
Ground Truth
1
313 2 17 5 44 1 382
2
3 165 0 2 6 1 177
3
1 0 333 2 2 2 340
4
0 0 63 7 2 85 157
5
20 2 5 1 129 21 178
6
0 0 28 2 32 314 376
Total
337 169 446 19 215 424 1610

Average Operator Probabilities
Operator Average Probability
Delete-Feature Mutation 0.102
Add-Feature Mutation 0.098
Hoist Mutation 0.108
Truncate Mutation 0.098
Swap Mutation 0.098
One-Symbol Mutation 0.093
All-Nodes Mutation 0.097
One-Node Mutation 0.095
Grow Mutation 0.097
High-Level Crossover 0.115
 

Number of Run Terminations attributed to each Criterion
Termination Criterion Number of Terminations
TP Criterion 0
GL Criterion 7
Max. Generations 3
Client Abort 0
Zero Validation Error 0
Total 10
 
 

Related Data Files
Description Filename
satimage_1_gen.m Matlab plot generation function
satimage_1_bogf_ave.{eps,gif} Best-of-generation Fitness, averaged over 10 runs
satimage_1_bogv_ave.{eps,gif} Best-of-generation Validation Set Error, averaged over 10 runs
satimage_1_avef_ave.{eps,gif} Average fitness, averaged over 10 runs
satimage_1_stdf_ave.{eps,gif} Standard deviation of fitness, averaged over 10 runs
satimage_1_nftr_ave.{eps,gif} Average number of features per individual, averaged over 10 runs
satimage_1_nnode_ave.{eps,gif} Average number of nodes per individual, averaged over 10 runs
satimage_1_nint_ave.{eps,gif} Average number of introns per individual, averaged over 10 runs
satimage_1_ntrl_ave.{eps,gif} Average number of RAT trials per individual, averaged over 10 runs
satimage_1_optimp_ave.{eps,gif} Average improvement in fitness due to optimisation, averaged over 10 runs
satimage_1_opprob_ave.{eps,gif} Average probability of each genetic operator, averaged over 10 runs
satimage_1_run_x.dat Binary data file containing results of run x (read by Matlab functions)
satimage_1_bor_x.prep 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Best-of-run individual for run x
satimage_1_run_x.corr 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Feature correlation file for run x
satimage_1_tst_bor_x.pred 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Test set predictions for best-of-run individual from run x
satimage_1_bogf_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Best-of-generation Fitness for run x
satimage_1_bogv_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Best-of-generation Validation Set Error for run x
satimage_1_avef_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Average fitness for run x
satimage_1_stdf_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Standard deviation of fitness for run x
satimage_1_nftr_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Average number of features per individual for run x
satimage_1_nnode_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Average number of nodes per individual for run x
satimage_1_nint_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Average number of introns per individual for run x
satimage_1_ntrl_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Average number of RAT trials per individual for run x
satimage_1_optimp_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Average improvement in fitness due to optimisation for run x
satimage_1_opprob_x.{eps,gif} 
x = 1, 2, 3, 4, 5, 6, 7, 8, 9, 10
Average probability of each genetic operator for run x