• Previous Article
    A density matrix approach to the convergence of the self-consistent field iteration
  • NACO Home
  • This Issue
  • Next Article
    Maximum and minimum ranks and inertias of the Hermitian parts of the least rank solution of the matrix equation AXB = C
March  2021, 11(1): 87-98. doi: 10.3934/naco.2020017

Improving whale optimization algorithm for feature selection with a time-varying transfer function

1. 

Department of Computer sciences, Education College for Pure Sciences, University of Mosul, Mosul, Iraq

2. 

Department of Statistics and Informatics, College of Computer sciences and Mathematics, University of Mosul, Mosul, Iraq

* Corresponding author: Mohammed Abdulrazaq Kahya

Received  July 2019 Revised  October 2019 Published  March 2021 Early access  February 2020

Feature selection is a valuable tool in supervised machine learning research fields, such as pattern recognition or classification problems. Feature selection used to eliminate irrelevant and noise features that adversely affect results. Swarm algorithms are usually used in feature selection problem; these algorithms need transfer functions that change search space from continuous to the discrete. However, transfer functions are the backbone of all binary swarm algorithms. Transfer functions in the current formula cannot provide binary swarm algorithms with a fit balance between exploration and exploitation stages. In this work, a feature selection approach based on the binary whale optimization algorithm with different kinds of updating techniques for the time-varying transfer functions is proposed. To evaluate the performance of the proposed method, three of each chemical and biological binary datasets are used. The results proved that BWOA-TV2 has consistency in feature selection and it gives rise to the high accuracy of the classification with more congruent in the convergence. It worth mentioning that the proposed method is proved advance in performance over competitor optimization algorithms, such as particle swarm optimization (PSO) and firefly optimization (FO) that commonly used in this field.

Citation: Mohammed Abdulrazaq Kahya, Suhaib Abduljabbar Altamir, Zakariya Yahya Algamal. Improving whale optimization algorithm for feature selection with a time-varying transfer function. Numerical Algebra, Control and Optimization, 2021, 11 (1) : 87-98. doi: 10.3934/naco.2020017
References:
[1]

P. AdarshvijayanS. K. NandakumarPr iyadarshini and K. R. Devabalaji, Economic dispatch problem using whale optimization algorithm, International Journal of Pure and Applied Mathematics, 117 (2017), 253-256. 

[2]

Z. Y. Algamal and M. H. Lee, Penalized logistic regression with the adaptive LASSO for gene selection in high-dimensional cancer classification, Expert Systems with Applications, 42 (2015), 9326-9332. 

[3]

I. I. Ali, Optimal location of SSSC based on PSO to improve voltage profile and reduce Iraqi grid system losses, Engineering and Technology Journal, 35 (2017), 372-380. 

[4]

H. Banati and M. Bajaj, Fire fly based feature selection approach, International Journal of Computer Science Issues (IJCSI), 8 (2011), 473.

[5]

R. Barham and I. Aljarah, Link prediction based on whale optimization algorithm, in 2017 International Conference on New Trends in Computing Sciences (ICTCS), IEEE, (2017), 55–60.

[6]

M. L. Bermingham et al., Application of high-dimensional feature selection: evaluation for genomic prediction in man, Scientific reports, 5 (2015), 10312.

[7]

M. ChihC. J. LinM. S. Chern and T. Y. Ou, Particle swarm optimization with time-varying acceleration coefficients for the multidimensional knapsack problem, Applied Mathematical Modelling, 38 (2014), 1338-1350. 

[8]

L. Y. ChuangH. W. ChangC. J. Tu and C. H. Yang, Improved binary PSO for feature selection using gene expression data, Computational Biology and Chemistry, 32 (2008), 29-38. 

[9]

E. Emary, H. M. Zawbaa, K. K. A. Ghany, A. E. Hassanien and B. Parv, Firefly optimization algorithm for feature selection, in Proceedings of the 7th Balkan Conference on Informatics Conference, ACM, (2015), 26.

[10]

T. R. Golub, Molecular classification of cancer: class discovery and class prediction by gene expression monitoring, Science, 286 (1999), 531-537. 

[11]

I. GuyonJ. WestonS. Barnhill and V. Vapnik, Gene selection for cancer classification using support vector machines, Machine Learning, 46 (2002), 389-422. 

[12]

P. Hart, The condensed nearest neighbor rule (Corresp.), IEEE Transactions on Information Theory, 14 (1968), 515-516. 

[13]

M. J. IslamX. Li and Y. Mei, A time-varying transfer function for balancing the exploration and exploitation ability of a binary PSO, Applied Soft Computing, 59 (2017), 182-196. 

[14]

M. Jassim, Improved PSO algorithm to attack transposition cipher, Engineering and Technology Journal, 35 (2017), 144-149. 

[15]

I. J. Kang, Design and efficient synthesis of novel arylthiourea derivatives as potent hepatitis C virus inhibitors, Bioorganic and Medicinal Chemistry Letters, 19 (2009), 6063-6068. 

[16]

I. J. Kang, Design, synthesis, and anti-HCV activity of thiourea compounds, Bioorganic And Medicinal Chemistry Letters, 19 (2009), 1950-1955. 

[17]

I. J. Kang, Synthesis, activity, and pharmacokinetic properties of a series of conformationally - restricted thiourea analogs as novel hepatitis C virus inhibitors, Bioorganic and Medicinal Chemistry, 18 (2010), 6414-6421. 

[18]

A. Kaveh and M. I. Ghazaan, Enhanced whale optimization algorithm for sizing optimization of skeletal structures, Mechanics Based Design of Structures and Mach., 45 (2017), 345-362. 

[19]

J. Kennedy and R. C. Eberhart, A discrete binary version of the particle swarm algorithm, , in 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation, IEEE, (1997), 4104–4108.

[20]

R. Kohavi and G. H. John, Wrappers for feature subset selection, Artificial Intelligence, 97 (1997), 273-324. 

[21]

N. KhatriV. Lather and A. K. Madan, Diverse classification models for anti-hepatitis C virus activity of thiourea derivatives, Chemometrics and Intelligent Laboratory Systems, 140 (2015), 13-21. 

[22]

Y. LiY. KongM. ZhangA. Yan and Z. Liu, Using support vector machine (SVM) for classification of selectivity of H1N1 neuraminidase inhibitors, Molecular informatics, 35 (2016), 116-124. 

[23]

C. Liao, S. Li and Z. Luo, Gene selection using wilcoxon rank sum test and support vector machine for cancer classification, in International Conference on Computational and Information Science (CIS 2006), Springer, (2006), 57-66.

[24]

M. Mafarja, D. Eleyan, S. Abdullah and S. Mirjalili, S-shaped vs. V-shaped transfer functions for ant lion optimization algorithm in feature selection problem, in Proceedings of the International Conference on Future Networks and Distributed Systems, ACM, (2017), 21.

[25]

M. Mafarja, I. Jaber, S. Ahmed and T. Thaher, Whale optimisation algorithm for high-dimensional small-instance feature selection, International Journal of Parallel, Emergent and Distributed Systems, (2019), 1–17.

[26]

M. Mafarja, Binary dragonfly optimization for feature selection using time-varying transfer functions, Knowledge-Based Systems, 161 (2018), 185-204. 

[27]

M. Mafarja, R. Jarrar, S. Ahmad and A. A. Abusnaina, Feature selection using binary particle swarm optimization with time varying inertia weight strategies, , in Proceedings of the 2nd International Conference on Future Networks and Distributed Systems, ACM, (2018), 18.

[28]

M. Mafarja and S. Mirjalili, Whale optimization approaches for wrapper feature selection, Applied Soft Computing, 62 (2018), 441-453. 

[29]

M. M. Mafarja and S. Mirjalili, Hybrid Whale Optimization Algorithm with simulated annealing for feature selection, Neurocomputing, 260 (2017), 302-312. 

[30]

S. Mirjalili and A. Lewis, S-shaped versus V-shaped transfer functions for binary particle swarm optimization, Swarm and Evolutionary Computation, 9 (2013), 1-14. 

[31]

S. Mirjalili and A. Lewis, The whale optimization algorithm, Advances in Engineering Software, 95 (2016), 51-67. 

[32]

R. Y. M. Nakamura, L. A. M. Pereira, K. A. Costa, D. Rodrigues, J. P. Papa and X. S. Yang, BBA: a binary bat algorithm for feature selection, in 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images, IEEE, (2012), 291–297.

[33]

O. S. Qasim and Z. Y. Algamal, Feature selection using particle swarm optimization-based logistic regression model, Chemometrics and Intelligent Laboratory Sys., 182 (2018), 41-46. 

[34]

D. Rodrigues, A wrapper approach for feature selection based on bat algorithm and optimum-path forest, Expert Systems with Applications, 41 (2014), 2250-2258. 

[35]

D. Rodrigues et al., BCS: A binary cuckoo search algorithm for feature selection, in 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013), IEEE, (2013), 465–468.

[36]

D. Singh, Gene expression correlates of clinical prostate cancer behavior, Cancer cell, 1 (2001), 203-209. 

[37]

P. A. Vikhar, Evolutionary algorithms: A critical review and its future prospects, , in 2016 International Conference on Global Trends in Signal Processing, Information Computing and Communication (ICGTSPICC), IEEE, (2016), 261–265.

[38]

X. WangJ. YangX. TengW. Xia and R. Jensen, Feature selection based on rough sets and particle swarm optimization, Pattern Recognition Letters, 28 (2007), 459-471. 

[39]

M. West et al., Predicting the clinical status of human breast cancer by using gene expression profiles, Proceedings of the National Academy of Sciences, 98 (2001), 11462-11467. 

[40]

I. H. Witten, E. Frank, M. A. Hall and C. J. Pal, Data Mining: Practical Machine Learning Tools and Techniques, , Morgan Kaufmann, 2016.

[41]

X. Wu et al., Top 10 algorithms in data mining, Knowledge and Information Systems, 14 (2008), 1-37. 

[42]

J. J. XingY. F. LiuY. Q. LiH. Gong and Y. P. Zhou, QSAR classification model for diverse series of antimicrobial agents using classification tree configured by modified particle swarm optimization, Chemometrics and Intelligent Laboratory Systems, 137 (2014), 82-90. 

[43]

B. XueM. ZhangW. N. Browne and X. Yao, A survey on evolutionary computation approaches to feature selection, IEEE Trans. Evol. Comput., 20 (2016), 606-626. 

[44]

C. YangW. GaoN. Liu and C. Song, Low-discrepancy sequence initialized particle swarm optimization algorithm with high-order nonlinear time-varying inertia weight, Applied Soft Computing, 29 (2015), 386-394. 

[45]

X. S. Yang, Firefly algorithm, Nature-Inspired Metaheuristic Algorithms, 20 (2008), 79-90. 

[46]

B. Zeng, L. Gao and X. Li, Whale swarm algorithm for function optimization, in International Conference on Intelligent Computing, Springer, (2017), 624–639.

show all references

References:
[1]

P. AdarshvijayanS. K. NandakumarPr iyadarshini and K. R. Devabalaji, Economic dispatch problem using whale optimization algorithm, International Journal of Pure and Applied Mathematics, 117 (2017), 253-256. 

[2]

Z. Y. Algamal and M. H. Lee, Penalized logistic regression with the adaptive LASSO for gene selection in high-dimensional cancer classification, Expert Systems with Applications, 42 (2015), 9326-9332. 

[3]

I. I. Ali, Optimal location of SSSC based on PSO to improve voltage profile and reduce Iraqi grid system losses, Engineering and Technology Journal, 35 (2017), 372-380. 

[4]

H. Banati and M. Bajaj, Fire fly based feature selection approach, International Journal of Computer Science Issues (IJCSI), 8 (2011), 473.

[5]

R. Barham and I. Aljarah, Link prediction based on whale optimization algorithm, in 2017 International Conference on New Trends in Computing Sciences (ICTCS), IEEE, (2017), 55–60.

[6]

M. L. Bermingham et al., Application of high-dimensional feature selection: evaluation for genomic prediction in man, Scientific reports, 5 (2015), 10312.

[7]

M. ChihC. J. LinM. S. Chern and T. Y. Ou, Particle swarm optimization with time-varying acceleration coefficients for the multidimensional knapsack problem, Applied Mathematical Modelling, 38 (2014), 1338-1350. 

[8]

L. Y. ChuangH. W. ChangC. J. Tu and C. H. Yang, Improved binary PSO for feature selection using gene expression data, Computational Biology and Chemistry, 32 (2008), 29-38. 

[9]

E. Emary, H. M. Zawbaa, K. K. A. Ghany, A. E. Hassanien and B. Parv, Firefly optimization algorithm for feature selection, in Proceedings of the 7th Balkan Conference on Informatics Conference, ACM, (2015), 26.

[10]

T. R. Golub, Molecular classification of cancer: class discovery and class prediction by gene expression monitoring, Science, 286 (1999), 531-537. 

[11]

I. GuyonJ. WestonS. Barnhill and V. Vapnik, Gene selection for cancer classification using support vector machines, Machine Learning, 46 (2002), 389-422. 

[12]

P. Hart, The condensed nearest neighbor rule (Corresp.), IEEE Transactions on Information Theory, 14 (1968), 515-516. 

[13]

M. J. IslamX. Li and Y. Mei, A time-varying transfer function for balancing the exploration and exploitation ability of a binary PSO, Applied Soft Computing, 59 (2017), 182-196. 

[14]

M. Jassim, Improved PSO algorithm to attack transposition cipher, Engineering and Technology Journal, 35 (2017), 144-149. 

[15]

I. J. Kang, Design and efficient synthesis of novel arylthiourea derivatives as potent hepatitis C virus inhibitors, Bioorganic and Medicinal Chemistry Letters, 19 (2009), 6063-6068. 

[16]

I. J. Kang, Design, synthesis, and anti-HCV activity of thiourea compounds, Bioorganic And Medicinal Chemistry Letters, 19 (2009), 1950-1955. 

[17]

I. J. Kang, Synthesis, activity, and pharmacokinetic properties of a series of conformationally - restricted thiourea analogs as novel hepatitis C virus inhibitors, Bioorganic and Medicinal Chemistry, 18 (2010), 6414-6421. 

[18]

A. Kaveh and M. I. Ghazaan, Enhanced whale optimization algorithm for sizing optimization of skeletal structures, Mechanics Based Design of Structures and Mach., 45 (2017), 345-362. 

[19]

J. Kennedy and R. C. Eberhart, A discrete binary version of the particle swarm algorithm, , in 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation, IEEE, (1997), 4104–4108.

[20]

R. Kohavi and G. H. John, Wrappers for feature subset selection, Artificial Intelligence, 97 (1997), 273-324. 

[21]

N. KhatriV. Lather and A. K. Madan, Diverse classification models for anti-hepatitis C virus activity of thiourea derivatives, Chemometrics and Intelligent Laboratory Systems, 140 (2015), 13-21. 

[22]

Y. LiY. KongM. ZhangA. Yan and Z. Liu, Using support vector machine (SVM) for classification of selectivity of H1N1 neuraminidase inhibitors, Molecular informatics, 35 (2016), 116-124. 

[23]

C. Liao, S. Li and Z. Luo, Gene selection using wilcoxon rank sum test and support vector machine for cancer classification, in International Conference on Computational and Information Science (CIS 2006), Springer, (2006), 57-66.

[24]

M. Mafarja, D. Eleyan, S. Abdullah and S. Mirjalili, S-shaped vs. V-shaped transfer functions for ant lion optimization algorithm in feature selection problem, in Proceedings of the International Conference on Future Networks and Distributed Systems, ACM, (2017), 21.

[25]

M. Mafarja, I. Jaber, S. Ahmed and T. Thaher, Whale optimisation algorithm for high-dimensional small-instance feature selection, International Journal of Parallel, Emergent and Distributed Systems, (2019), 1–17.

[26]

M. Mafarja, Binary dragonfly optimization for feature selection using time-varying transfer functions, Knowledge-Based Systems, 161 (2018), 185-204. 

[27]

M. Mafarja, R. Jarrar, S. Ahmad and A. A. Abusnaina, Feature selection using binary particle swarm optimization with time varying inertia weight strategies, , in Proceedings of the 2nd International Conference on Future Networks and Distributed Systems, ACM, (2018), 18.

[28]

M. Mafarja and S. Mirjalili, Whale optimization approaches for wrapper feature selection, Applied Soft Computing, 62 (2018), 441-453. 

[29]

M. M. Mafarja and S. Mirjalili, Hybrid Whale Optimization Algorithm with simulated annealing for feature selection, Neurocomputing, 260 (2017), 302-312. 

[30]

S. Mirjalili and A. Lewis, S-shaped versus V-shaped transfer functions for binary particle swarm optimization, Swarm and Evolutionary Computation, 9 (2013), 1-14. 

[31]

S. Mirjalili and A. Lewis, The whale optimization algorithm, Advances in Engineering Software, 95 (2016), 51-67. 

[32]

R. Y. M. Nakamura, L. A. M. Pereira, K. A. Costa, D. Rodrigues, J. P. Papa and X. S. Yang, BBA: a binary bat algorithm for feature selection, in 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images, IEEE, (2012), 291–297.

[33]

O. S. Qasim and Z. Y. Algamal, Feature selection using particle swarm optimization-based logistic regression model, Chemometrics and Intelligent Laboratory Sys., 182 (2018), 41-46. 

[34]

D. Rodrigues, A wrapper approach for feature selection based on bat algorithm and optimum-path forest, Expert Systems with Applications, 41 (2014), 2250-2258. 

[35]

D. Rodrigues et al., BCS: A binary cuckoo search algorithm for feature selection, in 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013), IEEE, (2013), 465–468.

[36]

D. Singh, Gene expression correlates of clinical prostate cancer behavior, Cancer cell, 1 (2001), 203-209. 

[37]

P. A. Vikhar, Evolutionary algorithms: A critical review and its future prospects, , in 2016 International Conference on Global Trends in Signal Processing, Information Computing and Communication (ICGTSPICC), IEEE, (2016), 261–265.

[38]

X. WangJ. YangX. TengW. Xia and R. Jensen, Feature selection based on rough sets and particle swarm optimization, Pattern Recognition Letters, 28 (2007), 459-471. 

[39]

M. West et al., Predicting the clinical status of human breast cancer by using gene expression profiles, Proceedings of the National Academy of Sciences, 98 (2001), 11462-11467. 

[40]

I. H. Witten, E. Frank, M. A. Hall and C. J. Pal, Data Mining: Practical Machine Learning Tools and Techniques, , Morgan Kaufmann, 2016.

[41]

X. Wu et al., Top 10 algorithms in data mining, Knowledge and Information Systems, 14 (2008), 1-37. 

[42]

J. J. XingY. F. LiuY. Q. LiH. Gong and Y. P. Zhou, QSAR classification model for diverse series of antimicrobial agents using classification tree configured by modified particle swarm optimization, Chemometrics and Intelligent Laboratory Systems, 137 (2014), 82-90. 

[43]

B. XueM. ZhangW. N. Browne and X. Yao, A survey on evolutionary computation approaches to feature selection, IEEE Trans. Evol. Comput., 20 (2016), 606-626. 

[44]

C. YangW. GaoN. Liu and C. Song, Low-discrepancy sequence initialized particle swarm optimization algorithm with high-order nonlinear time-varying inertia weight, Applied Soft Computing, 29 (2015), 386-394. 

[45]

X. S. Yang, Firefly algorithm, Nature-Inspired Metaheuristic Algorithms, 20 (2008), 79-90. 

[46]

B. Zeng, L. Gao and X. Li, Whale swarm algorithm for function optimization, in International Conference on Intelligent Computing, Springer, (2017), 624–639.

Figure 1.  $ sigmoid(x) $ function with different kinds of the update techniques for time-varying
Figure 2.  The convergence curves of the BWOA with different kinds of updating techniques for TVTFs over different datasets
Table 1.  Some swarm intelligence algorithms with various time-varying mechanisms
Algorithm used Problem Reference
Binary dragonfly optimization Feature selection [26]
BPSO 0-1 knapsack [13]
PSO Numerical optimization [44]
BPSO Multidimensional knapsack [7]
BPSO Feature selection [27]
Algorithm used Problem Reference
Binary dragonfly optimization Feature selection [26]
BPSO 0-1 knapsack [13]
PSO Numerical optimization [44]
BPSO Multidimensional knapsack [7]
BPSO Feature selection [27]
Table 2.  High-dimensional binary datasets
Datasets $ \# $samples $ \# $features Class (+/-) Data type
anti-hepatitis C virus 121 2559 (31/90) chemical
antimicrobial agents 212 3657 (108/104) chemical
H1N1 479 2322 (266/213) chemical
Leukemia 72 7129 (47/25) biological
Breast Cancer 38 7129 (18/20) biological
Prostate Cancer 102 12600 (52/50) biological
Datasets $ \# $samples $ \# $features Class (+/-) Data type
anti-hepatitis C virus 121 2559 (31/90) chemical
antimicrobial agents 212 3657 (108/104) chemical
H1N1 479 2322 (266/213) chemical
Leukemia 72 7129 (47/25) biological
Breast Cancer 38 7129 (18/20) biological
Prostate Cancer 102 12600 (52/50) biological
Table 3.  Comparison between the influence of updating techniques over the proposed method in terms of average CA with standard deviation and $ \# $features according to the training data
Methods
Datasets Indicator BWOA-TV1 BWOA-TV2 BWOA-TV3 BWOA-Sigmoid
anti-hepatitis CA 96.01(0.763) 96.11(0.639) 94.03(1.282) 93.92(1.065)
C virus $ \# $features 10.87 8.77 13.33 14.66
antimicrobial CA 92.05(1.045) 93.99(0.987) 91.57(1.084) 92.65(0.885)
agents $ \# $features 12.60 10.53 16.20 11.76
CA 98.25(0.973) 98.34(1.002) 97.46(1.078) 96.89(1.541)
H1N1 $ \# $features 9.83 7.20 11.45 14.25
CA 96.56(1.289) 97.21(0.587) 96.29(1.972) 93.29(1.18)
Leukemia $ \# $genes 10.56 9.23 13.37 16.34
Breast CA 93.21(0.932) 94.84(1.021) 92.81(2.01) 92.17(1.49)
Cancer $ \# $genes 17.92 17.03 21.49 22.31
Prostate CA 98.22(0.581) 97.82(0.721) 96.21(1.143) 96.03(0.927)
Cancer $ \# $genes 9.29 10.03 10.21 10.33
Methods
Datasets Indicator BWOA-TV1 BWOA-TV2 BWOA-TV3 BWOA-Sigmoid
anti-hepatitis CA 96.01(0.763) 96.11(0.639) 94.03(1.282) 93.92(1.065)
C virus $ \# $features 10.87 8.77 13.33 14.66
antimicrobial CA 92.05(1.045) 93.99(0.987) 91.57(1.084) 92.65(0.885)
agents $ \# $features 12.60 10.53 16.20 11.76
CA 98.25(0.973) 98.34(1.002) 97.46(1.078) 96.89(1.541)
H1N1 $ \# $features 9.83 7.20 11.45 14.25
CA 96.56(1.289) 97.21(0.587) 96.29(1.972) 93.29(1.18)
Leukemia $ \# $genes 10.56 9.23 13.37 16.34
Breast CA 93.21(0.932) 94.84(1.021) 92.81(2.01) 92.17(1.49)
Cancer $ \# $genes 17.92 17.03 21.49 22.31
Prostate CA 98.22(0.581) 97.82(0.721) 96.21(1.143) 96.03(0.927)
Cancer $ \# $genes 9.29 10.03 10.21 10.33
Table 4.  Comparison between the TVTFs kinds in terms of average CA with standard deviation according to the testing data
Methods
Datasets BWOA-TV1 BWOA-TV2 BWOA-TV3 BWOA-Sigmoid
anti-hepatitis C virus 94.56(0.897) 94.87(0.654) 91.75(1.914) 91.49(0.514)
antimicrobial agents 90.32(0.986) 90.95(1.290) 89.12(1.590) 89.85(1.824)
H1N1 96.07(0.904) 97.26(1.561) 94.87(1.721) 94.34(2.005)
Leukemia 94.02(0.836) 94.85(1.051) 93.79(0.652) 90.93(0.329)
Breast Cancer 90.91(0.730) 92.32(0.928) 89.95(0.230) 89.27(0.296)
Prostate Cancer 96.91(0.476) 96.39(0.713) 94.31(0.931) 94.09(1.048)
Methods
Datasets BWOA-TV1 BWOA-TV2 BWOA-TV3 BWOA-Sigmoid
anti-hepatitis C virus 94.56(0.897) 94.87(0.654) 91.75(1.914) 91.49(0.514)
antimicrobial agents 90.32(0.986) 90.95(1.290) 89.12(1.590) 89.85(1.824)
H1N1 96.07(0.904) 97.26(1.561) 94.87(1.721) 94.34(2.005)
Leukemia 94.02(0.836) 94.85(1.051) 93.79(0.652) 90.93(0.329)
Breast Cancer 90.91(0.730) 92.32(0.928) 89.95(0.230) 89.27(0.296)
Prostate Cancer 96.91(0.476) 96.39(0.713) 94.31(0.931) 94.09(1.048)
Table 5.  Basic settings of the BPSO and BFO optimizers
BPSO BFO
$ w=0.5 $ $ \alpha=0.2 $
$ c_1=1 $ $ \beta_0=2 $
$ c_2=3 $ $ \gamma=1 $
BPSO BFO
$ w=0.5 $ $ \alpha=0.2 $
$ c_1=1 $ $ \beta_0=2 $
$ c_2=3 $ $ \gamma=1 $
Table 6.  Comparison between the proposed method and rival methods in terms of average CA with standard deviation and $ \# $features according to the training data
Methods
Datasets Indicator BWOA-TV2 BFO-Sigmoid BPSO-Sigmoid
anti-hepatitis CA 96.11(0.639) 92.51(1.431) 91.04(1.289)
C virus $ \# $features 8.77 17.72 21.33
antimicrobial CA 93.99(0.987) 90.07(1.129) 89.91(1.787)
agents $ \# $features 10.53 20.29 22.31
CA 98.34(1.002) 93.98(1.236) 92.71(1.763)
H1N1 $ \# $features 7.20 17.33 19.83
CA 97.21(0.587) 93.92(1.201) 93.51(1.02)
Leukemia $ \# $genes 9.23 17.41 17.60
Breast CA 94.84(1.021) 91.92(0.921) 91.27(0.907)
Cancer $ \# $genes 17.03 23.39 23.91
Prostate CA 97.82(0.721) 97.28(0.932) 97.65(0.829)
Cancer $ \# $genes 10.03 10.92 10.41
Methods
Datasets Indicator BWOA-TV2 BFO-Sigmoid BPSO-Sigmoid
anti-hepatitis CA 96.11(0.639) 92.51(1.431) 91.04(1.289)
C virus $ \# $features 8.77 17.72 21.33
antimicrobial CA 93.99(0.987) 90.07(1.129) 89.91(1.787)
agents $ \# $features 10.53 20.29 22.31
CA 98.34(1.002) 93.98(1.236) 92.71(1.763)
H1N1 $ \# $features 7.20 17.33 19.83
CA 97.21(0.587) 93.92(1.201) 93.51(1.02)
Leukemia $ \# $genes 9.23 17.41 17.60
Breast CA 94.84(1.021) 91.92(0.921) 91.27(0.907)
Cancer $ \# $genes 17.03 23.39 23.91
Prostate CA 97.82(0.721) 97.28(0.932) 97.65(0.829)
Cancer $ \# $genes 10.03 10.92 10.41
Table 7.  Comparison between the proposed method and rival methods in terms of average CA with standard deviation according to the testing data
Methods
Datasets BWOA-TV2 BFO-Sigmoid BPSO-Sigmoid
anti-hepatitis C virus 94.87(0.654) 90.43(1.752) 89.31(2.801)
antimicrobial agents 90.95(1.290) 88.62(2.006) 87.59(2.582)
H1N1 97.26(1.561) 92.28(1.320) 89.89 (1.920)
Leukemia 94.85(1.051) 91.53(1.838) 90.97(1.308)
Breast Cancer 92.32(0.928) 89.57(1.534) 89.49(1.395)
Prostate Cancer 96.39(0.713) 94.89(0.872) 95.06(0.396)
Methods
Datasets BWOA-TV2 BFO-Sigmoid BPSO-Sigmoid
anti-hepatitis C virus 94.87(0.654) 90.43(1.752) 89.31(2.801)
antimicrobial agents 90.95(1.290) 88.62(2.006) 87.59(2.582)
H1N1 97.26(1.561) 92.28(1.320) 89.89 (1.920)
Leukemia 94.85(1.051) 91.53(1.838) 90.97(1.308)
Breast Cancer 92.32(0.928) 89.57(1.534) 89.49(1.395)
Prostate Cancer 96.39(0.713) 94.89(0.872) 95.06(0.396)
[1]

Mohamed A. Tawhid, Kevin B. Dsouza. Hybrid binary dragonfly enhanced particle swarm optimization algorithm for solving feature selection problems. Mathematical Foundations of Computing, 2018, 1 (2) : 181-200. doi: 10.3934/mfc.2018009

[2]

Yunmei Lu, Mingyuan Yan, Meng Han, Qingliang Yang, Yanqing Zhang. Privacy preserving feature selection and Multiclass Classification for horizontally distributed data. Mathematical Foundations of Computing, 2018, 1 (4) : 331-348. doi: 10.3934/mfc.2018016

[3]

Bingru Zhang, Chuanye Gu, Jueyou Li. Distributed convex optimization with coupling constraints over time-varying directed graphs. Journal of Industrial and Management Optimization, 2021, 17 (4) : 2119-2138. doi: 10.3934/jimo.2020061

[4]

Abdelfettah Hamzaoui, Nizar Hadj Taieb, Mohamed Ali Hammami. Practical partial stability of time-varying systems. Discrete and Continuous Dynamical Systems - B, 2022, 27 (7) : 3585-3603. doi: 10.3934/dcdsb.2021197

[5]

Carlos Nonato, Manoel Jeremias dos Santos, Carlos Raposo. Dynamics of Timoshenko system with time-varying weight and time-varying delay. Discrete and Continuous Dynamical Systems - B, 2022, 27 (1) : 523-553. doi: 10.3934/dcdsb.2021053

[6]

Guangmei Shao, Wei Xue, Gaohang Yu, Xiao Zheng. Improved SVRG for finite sum structure optimization with application to binary classification. Journal of Industrial and Management Optimization, 2020, 16 (5) : 2253-2266. doi: 10.3934/jimo.2019052

[7]

Shu Zhang, Jian Xu. Time-varying delayed feedback control for an internet congestion control model. Discrete and Continuous Dynamical Systems - B, 2011, 16 (2) : 653-668. doi: 10.3934/dcdsb.2011.16.653

[8]

Serge Nicaise, Julie Valein, Emilia Fridman. Stability of the heat and of the wave equations with boundary time-varying delays. Discrete and Continuous Dynamical Systems - S, 2009, 2 (3) : 559-581. doi: 10.3934/dcdss.2009.2.559

[9]

Roberta Fabbri, Russell Johnson, Sylvia Novo, Carmen Núñez. On linear-quadratic dissipative control processes with time-varying coefficients. Discrete and Continuous Dynamical Systems, 2013, 33 (1) : 193-210. doi: 10.3934/dcds.2013.33.193

[10]

Zhen Zhang, Jianhua Huang, Xueke Pu. Pullback attractors of FitzHugh-Nagumo system on the time-varying domains. Discrete and Continuous Dynamical Systems - B, 2017, 22 (10) : 3691-3706. doi: 10.3934/dcdsb.2017150

[11]

Le Viet Cuong, Thai Son Doan. Assignability of dichotomy spectra for discrete time-varying linear control systems. Discrete and Continuous Dynamical Systems - B, 2020, 25 (9) : 3597-3607. doi: 10.3934/dcdsb.2020074

[12]

Robert G. McLeod, John F. Brewster, Abba B. Gumel, Dean A. Slonowsky. Sensitivity and uncertainty analyses for a SARS model with time-varying inputs and outputs. Mathematical Biosciences & Engineering, 2006, 3 (3) : 527-544. doi: 10.3934/mbe.2006.3.527

[13]

Tingwen Huang, Guanrong Chen, Juergen Kurths. Synchronization of chaotic systems with time-varying coupling delays. Discrete and Continuous Dynamical Systems - B, 2011, 16 (4) : 1071-1082. doi: 10.3934/dcdsb.2011.16.1071

[14]

Yangzi Hu, Fuke Wu. The improved results on the stochastic Kolmogorov system with time-varying delay. Discrete and Continuous Dynamical Systems - B, 2015, 20 (5) : 1481-1497. doi: 10.3934/dcdsb.2015.20.1481

[15]

Serge Nicaise, Cristina Pignotti, Julie Valein. Exponential stability of the wave equation with boundary time-varying delay. Discrete and Continuous Dynamical Systems - S, 2011, 4 (3) : 693-722. doi: 10.3934/dcdss.2011.4.693

[16]

Bing Sun. Optimal control of transverse vibration of a moving string with time-varying lengths. Mathematical Control and Related Fields, 2021  doi: 10.3934/mcrf.2021042

[17]

Lu Xian, Henry Adams, Chad M. Topaz, Lori Ziegelmeier. Capturing dynamics of time-varying data via topology. Foundations of Data Science, 2022, 4 (1) : 1-36. doi: 10.3934/fods.2021033

[18]

Nastassia Pouradier Duteil. Mean-field limit of collective dynamics with time-varying weights. Networks and Heterogeneous Media, 2022, 17 (2) : 129-161. doi: 10.3934/nhm.2022001

[19]

Baowei Feng, Carlos Alberto Raposo, Carlos Alberto Nonato, Abdelaziz Soufyane. Analysis of exponential stabilization for Rao-Nakra sandwich beam with time-varying weight and time-varying delay: Multiplier method versus observability. Mathematical Control and Related Fields, 2022  doi: 10.3934/mcrf.2022011

[20]

Jianjun Liu, Min Zeng, Yifan Ge, Changzhi Wu, Xiangyu Wang. Improved Cuckoo Search algorithm for numerical function optimization. Journal of Industrial and Management Optimization, 2020, 16 (1) : 103-115. doi: 10.3934/jimo.2018142

 Impact Factor: 

Metrics

  • PDF downloads (1156)
  • HTML views (914)
  • Cited by (2)

[Back to Top]