Crossref journal-article
MDPI AG
Catalysts (1968)
Abstract

Machine learning has proven to be a powerful technique during the past decades. Artificial neural network (ANN), as one of the most popular machine learning algorithms, has been widely applied to various areas. However, their applications for catalysis were not well-studied until recent decades. In this review, we aim to summarize the applications of ANNs for catalysis research reported in the literature. We show how this powerful technique helps people address the highly complicated problems and accelerate the progress of the catalysis community. From the perspectives of both experiment and theory, this review shows how ANNs can be effectively applied for catalysis prediction, the design of new catalysts, and the understanding of catalytic structures.

Bibliography

Li, H., Zhang, Z., & Liu, Z. (2017). Application of Artificial Neural Networks for Catalysis: A Review. Catalysts, 7(10), 306.

Authors 3
  1. Hao Li (first)
  2. Zhien Zhang (additional)
  3. Zhijian Liu (additional)
References 105 Referenced 179
  1. Witten, I.H., and Frank, E. (2005). Data Mining: Practical Machine Learning Tools and Techniques, Morgan Kaufman.
  2. 10.1016/S0164-1212(00)00005-4 / J. Syst. Softw. / An investigation of machine learning based prediction systems by Mair (2000)
  3. {'key': 'ref_3', 'first-page': '249', 'article-title': 'Supervised Machine Learning: A Review of Classification Techniques', 'volume': '31', 'author': 'Kotsiantis', 'year': '2007', 'journal-title': 'Informatica'} / Informatica / Supervised Machine Learning: A Review of Classification Techniques by Kotsiantis (2007)
  4. 10.1016/0893-6080(91)90012-T / Neural Netw. / ARTMAP: Supervised real-time learning and classification of nonstationary data by a self-organizing neural network by Carpenter (1991)
  5. Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer.
  6. 10.1109/34.75512 / IEEE Trans. Pattern Anal. Mach. Intell. / Small sample size effects in statistical pattern recognition: Recommendations for practitioners by Raudys (1991)
  7. Chen, F., Li, H., Xu, Z., Hou, S., and Yang, D. (2015). User-friendly optimization approach of fed-batch fermentation conditions for the production of iturin A using artificial neural networks and support vector machine. Electron. J. Biotechnol., 18. (10.1016/j.ejbt.2015.05.001)
  8. {'key': 'ref_8', 'first-page': '5529', 'article-title': 'Machine learning in cell biology—Teaching computers to recognize phenotypes', 'volume': '126', 'author': 'Sommer', 'year': '2013', 'journal-title': 'J. Cell Sci.'} / J. Cell Sci. / Machine learning in cell biology—Teaching computers to recognize phenotypes by Sommer (2013)
  9. Tarca, A.L., Carey, V.J., Chen, X., Romero, R., and Drăghici, S. (2007). Machine Learning and Its Applications to Biology. PLoS Comput. Biol., 3. (10.1371/journal.pcbi.0030116)
  10. 10.1109/MSP.2010.936730 / IEEE Signal Proc. Mag. / Machine learning in medical imaging by Wernick (2010)
  11. 10.1038/89044 / Nat. Med. / Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks by Khan (2001)
  12. 10.1161/CIRCULATIONAHA.115.001593 / Circulation / Machine learning in medicine by Deo (2015)
  13. 10.1016/S0196-8904(99)00012-6 / Energy Convers. Manag. / Applications of artificial neural networks in energy systems by Kalogirou (1999)
  14. 10.1016/j.ijrefrig.2013.06.014 / Int. J. Refrig. / Thermal modeling of gas engine driven air to water heat pump systems in heating mode using genetic algorithm and Artificial Neural Network methods by Sanaye (2013)
  15. 10.1016/S0960-1481(98)00787-3 / Renew. Energy / Artificial neural networks used for the performance prediction of a thermosiphon solar water heater by Kalogirou (1999)
  16. Liu, Z., Liu, K., Li, H., Zhang, X., Jin, G., and Cheng, K. (2015). Artificial Neural Networks-Based Software for Measuring Heat Collection Rate and Heat Loss Coefficient of Water-in-Glass Evacuated Tube Solar Water Heaters. PLoS ONE, 10. (10.1371/journal.pone.0143624)
  17. Liu, Z., Li, H., Tang, X., Zhang, X., Lin, F., and Cheng, K. (2016). Extreme learning machine: A new alternative for measuring heat collection rate and heat loss coefficient of water-in-glass evacuated tube solar water heaters. Springerplus, 5. (10.1186/s40064-016-2242-1)
  18. 10.3390/en8088814 / Energies / Novel method for measuring the heat collection rate and heat loss coefficient of water-in-glass evacuated tube solar water heaters based on artificial neural networks and support vector machine by Liu (2015)
  19. 10.1016/j.enbuild.2014.12.029 / Energy Build. / Prediction of building energy consumption using an improved real coded genetic algorithm based least squares support vector machine approach by Jung (2015)
  20. 10.1016/S1352-2310(97)00447-0 / Atmos. Environ. / Artificial neural networks (the multilayer perceptron)—A review of applications in the atmospheric sciences by Gardner (1998)
  21. Liu, Z., Li, H., and Cao, G. (2017). Quick Estimation Model for the Concentration of Indoor Airborne Culturable Bacteria: An Application of Machine Learning. Int. J. Environ. Res. Public Health, 14. (10.3390/ijerph14080857)
  22. 10.1016/S0304-3800(01)00316-7 / Ecol. Modell. / Applications of machine learning to ecological modelling by Recknagel (2001)
  23. 10.1016/j.applthermaleng.2007.03.032 / Appl. Therm. Eng. / Optimal design approach for the plate-fin heat exchangers using neural networks cooperated with genetic algorithms by Peng (2008)
  24. Kalogirou, S.A. (2014). Designing and Modeling Solar Energy Systems. Solar Energy Engineering, Academic Press. (10.1016/B978-0-12-397270-5.00011-X)
  25. Liu, Z., Li, H., Liu, K., Yu, H., and Cheng, K. (2017). Design of high-performance water-in-glass evacuated tube solar water heaters by a high-throughput screening based on machine learning: A combined modeling and experimental study. Sol. Energy. (10.1016/j.solener.2016.12.015)
  26. Gao, J., and Jamidar, R. (2014). Machine Learning Applications for Data Center Optimization. Google White Pap., 1–13.
  27. Li, M. (2014, January 6–8). Scaling Distributed Machine Learning with the Parameter Server. Proceedings of the 2014 International Conference on Big Data Science and Computing—BigDataScience’14, Broomfield, CO, USA. (10.1145/2640087.2644155)
  28. 10.1109/101.8118 / IEEE Circuits Devices Mag. / Artificial neural networks by Hopfield (1988)
  29. {'key': 'ref_29', 'first-page': '413', 'article-title': 'A New Back-Propagation Neural Network Optimized', 'volume': '2013', 'author': 'Nawi', 'year': '2013', 'journal-title': 'ICCSA'} / ICCSA / A New Back-Propagation Neural Network Optimized by Nawi (2013)
  30. 10.1109/72.97934 / IEEE Trans. Neural Netw. / A general regression neural network by Specht (1991)
  31. 10.1016/j.neunet.2014.10.001 / Neural Netw. / Trends in extreme learning machines: A review by Huang (2015)
  32. 10.1016/j.neunet.2014.09.003 / Neural Netw. / Deep Learning in neural networks: An overview by Schmidhuber (2015)
  33. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Adv. Neural Inf. Process. Syst., 1106–1114.
  34. Li, H., Tang, X., Wang, R., Lin, F., Liu, Z., and Cheng, K. (2016). Comparative Study on Theoretical and Machine Learning Methods for Acquiring Compressed Liquid Densities of 1,1,1,2,3,3,3-Heptafluoropropane (R227ea) via Song and Mason Equation, Support Vector Machine, and Artificial Neural Networks. Appl. Sci., 6. (10.3390/app6010025)
  35. 10.1016/S1452-3981(23)06701-9 / Int. J. Electrochem. Sci. / Prediction of Zeta Potential of Decomposed Peat via Machine Learning : Comparative Study of Support Vector Machine and Artificial Neural Networks by Li (2015)
  36. 10.1080/09500839108214654 / Philos. Mag. Lett. / A quantum mechanical calculation of the theoretical strength of metals by Paxton (1991)
  37. Li, H., Liu, Z., Liu, K., and Zhang, Z. (2017). Predictive Power of Machine Learning for Optimizing Solar Water Heater Performance: The Potential Application of High-Throughput Screening. Int. J. Photoenergy. (10.1155/2017/4194251)
  38. 10.1016/j.neucom.2005.12.126 / Neurocomputing / Extreme learning machine: Theory and applications by Huang (2006)
  39. 10.1006/jmps.1999.1279 / J. Math. Psychol. / Cross-Validation Methods by Browne (2000)
  40. 10.1021/ci00027a006 / J. Chem. Inf. Comput. Sci. / Neural Network Studies. 1. Comparison of Overfitting and Overtraining by Tetko (1995)
  41. Kito, S., Hattori, T., and Murakami, Y. (1994). Estimation of catalytic performance by neural network—Product distribution in oxidative dehydrogenation of ethylbenzene. Appl. Catal. A Gen., 114. (10.1016/0926-860X(94)80169-X)
  42. 10.1016/0926-860X(95)00171-9 / Appl. Catal. A Gen. / Application of a neural network to the analysis of catalytic reactions Analysis of NO decomposition over Cu/ZSM-5 zeolite by Sasaki (1995)
  43. 10.1016/j.apcata.2013.06.055 / Appl. Catal. A Gen. / Optimisation of alkene epoxidation catalysed by polymer supported Mo(VI) complexes and application of artificial neural network for the prediction of catalytic performances by Mohammed (2013)
  44. 10.1016/j.jphotochem.2012.05.007 / J. Photochem. Photobiol. A Chem. / Photocatalytic (UV-A/TiO2) degradation of 17α-ethynylestradiol in environmental matrices: Experimental studies and artificial neural network modeling by Frontistis (2012)
  45. 10.1007/s12010-008-8465-z / Appl. Biochem. Biotechnol. / Application of artificial neural network for yield prediction of lipase-catalyzed synthesis of dioctyl adipate by Chaibakhsh (2009)
  46. Günay, M.E., and Yildirim, R. (2011). Neural network analysis of selective CO oxidation over copper-based catalysts for knowledge extraction from published data in the literature. Ind. Eng. Chem. Res., 50. (10.1021/ie2013955)
  47. 10.1038/nature17439 / Nature / Machine-learning-assisted materials discovery using failed experiments by Raccuglia (2016)
  48. {'key': 'ref_48', 'first-page': '26', 'article-title': 'Predictive modeling in catalysis—From dream to reality', 'volume': '105', 'author': 'Maldonado', 'year': '2009', 'journal-title': 'Chem. Eng. Prog.'} / Chem. Eng. Prog. / Predictive modeling in catalysis—From dream to reality by Maldonado (2009)
  49. 10.1002/1439-7641(20021115)3:11<939::AID-CPHC939>3.0.CO;2-E / ChemPhysChem / Application of artificial neural networks to combinatorial catalysis: Modeling and predicting ODHE catalysts by Corma (2002)
  50. {'key': 'ref_50', 'first-page': '451', 'article-title': 'Genetic Algorithm: Review and Application', 'volume': '2', 'author': 'Kumar', 'year': '2010', 'journal-title': 'Int. J. Inf. Technol. Knowl. Manag.'} / Int. J. Inf. Technol. Knowl. Manag. / Genetic Algorithm: Review and Application by Kumar (2010)
  51. 10.1021/ie049609p / Ind. Eng. Chem. Res. / Prediction of Effective Additives to a Ni/Active Carbon Catalyst for Vapor-Phase Carbonylation of Methanol by an Artificial Neural Network by Yamada (2004)
  52. 10.1016/S0926-860X(97)00063-X / Appl. Catal. A Gen. / Artificial neural network aided design of catalyst for propane ammoxidation by Hou (1997)
  53. 10.1021/ie010316v / Ind. Eng. Chem. Res. / Design of a Propane Ammoxidation Catalyst Using Artificial Neural Networks and Genetic Algorithms by Zhao (2001)
  54. 10.1021/ef020241n / Energy Fuels / Optimization of catalyst for methanol synthesis by a combinatorial approach using a parallel activity test and genetic algorithm assisted by a neural network by Umegaki (2003)
  55. 10.1016/S0169-4332(03)00919-X / Appl. Surf. Sci. / Application of a genetic algorithm and a neural network for the discovery and optimization of new solid catalytic materials by Rodemerck (2004)
  56. 10.1002/qsar.200430900 / QSAR Comb. Sci. / Using artificial neural networks to boost high-throughput discovery in heterogeneous catalysis by Baumes (2004)
  57. 10.1021/es801372q / Environ. Sci. Technol. / Modeling and optimization of heterogeneous photo-fenton process with response surface methodology and artificial neural networks by Kasiri (2008)
  58. Basri, M., Rahman, R.N.Z.R.A., Ebrahimpour, A., Salleh, A.B., Gunawan, E.R., and Rahman, M.B.A. (2007). Comparison of estimation capabilities of response surface methodology (RSM) with artificial neural network (ANN) in lipase-catalyzed synthesis of palm-based wax ester. BMC Biotechnol., 7. (10.1186/1472-6750-7-53)
  59. 10.1016/j.ultsonch.2014.10.019 / Ultrason. Sonochem. / Comparison of response surface methodology and artificial neural network approach towards efficient ultrasound-assisted biodiesel production from muskmelon oil by Priya (2015)
  60. 10.1016/j.renene.2014.07.054 / Renew. Energy / Modeling and optimization of bioethanol production from breadfruit starch hydrolyzate vis-a-vis response surface methodology and artificial neural network by Betiku (2015)
  61. 10.1016/j.apenergy.2012.07.018 / Appl. Energy / Transesterification of waste cooking oil by heteropoly acid (HPA) catalyst: Optimization and kinetic model by Amin (2013)
  62. {'key': 'ref_62', 'first-page': '82', 'article-title': 'Optimization of ultrasound-assisted base-catalyzed methanolysis of sunflower oil using response surface and artifical neural network methodologies', 'volume': '215–216', 'year': '2013', 'journal-title': 'Chem. Eng. J.'} / Chem. Eng. J. / Optimization of ultrasound-assisted base-catalyzed methanolysis of sunflower oil using response surface and artifical neural network methodologies (2013)
  63. 10.1016/j.enconman.2013.08.029 / Energy Convers. Manag. / Optimization of oleic acid esterification catalyzed by ionic liquid for green biodiesel synthesis (2013)
  64. 10.1016/j.fuproc.2013.03.038 / Fuel Process. Technol. / Optimization of base-catalyzed ethanolysis of sunflower oil by regression and artificial neural network models (2013)
  65. 10.1021/ie302390b / Ind. Eng. Chem. Res. / Artificial neural networks, optimization and kinetic modeling of amoxicillin degradation in photo-fenton process using aluminum pillared montmorillonite-supported ferrioxalate catalyst by Ayodele (2012)
  66. 10.1016/0009-2614(92)85009-Y / Chem. Phys. Lett. / Kohn—Sham density-functional theory within a finite basis set by Pople (1992)
  67. Grimme, S., Antony, J., Ehrlich, S., and Krieg, H. (2010). A consistent and accurate ab initio parametrization of density functional dispersion correction (DFT-D) for the 94 elements H-Pu. J. Chem. Phys., 132. (10.1063/1.3382344)
  68. 10.1002/anie.199009921 / Angew. Chem. Int. Ed. Engl. / Computer Simulation of Molecular Dynamics: Methodology, Applications, and Perspectives in Chemistry by Berendsen (1990)
  69. 10.1109/5992.743625 / Comput. Sci. Eng. / Molecular dynamics simulation by Rapaport (1999)
  70. 10.1146/annurev.pc.32.100181.001111 / Annu. Rev. Phys. Chem. / Transition State Theory by Pechukas (1981)
  71. 10.1021/jp047349j / J. Phys. Chem. B / Origin of the overpotential for oxygen reduction at a fuel-cell cathode by Rossmeisl (2004)
  72. 10.1149/1.1856988 / J. Electrochem. Soc. / Trends in the Exchange Current for Hydrogen Evolution by Bligaard (2005)
  73. 10.1002/anie.200801479 / Angew. Chem. Int. Ed. / Trends in the catalytic CO oxidation activity of nanoparticles by Falsig (2008)
  74. 10.1039/tf9383400011 / Trans. Faraday Soc. / Inertia and driving force of chemical reactions by Evans (1938)
  75. 10.1006/jcat.2000.3087 / J. Catal. / The Brønsted–Evans–Polanyi Relation and the Volcano Plot for Ammonia Synthesis over Transition Metal Catalysts by Logadottir (2001)
  76. 10.1002/anie.200902800 / Angew. Chem. Int. Ed. / Fast prediction of selectivity in heterogeneous catalysis from extended brønsted-evans-polanyi relations: A theoretical insight by Loffreda (2009)
  77. 10.1002/anie.200705739 / Angew. Chem. Int. Ed. / Scaling relationships for adsorption energies on transition metal oxide, sulfide, and nitride surfaces by Fernndez (2008)
  78. 10.1021/acscatal.6b03403 / ACS Catal. / Scaling Relations for Adsorption Energies on Doped Molybdenum Phosphide Surfaces by Fields (2017)
  79. 10.1021/acs.jpclett.5b01660 / J. Phys. Chem. Lett. / Machine-Learning-Augmented Chemisorption Model for CO2 Electroreduction Catalyst Screening by Ma (2015)
  80. 10.1038/nmat1752 / Nat. Mater. / Computational high-throughput screening of electrocatalytic materials for hydrogen evolution by Greeley (2006)
  81. 10.1038/nchem.367 / Nat. Chem. / Alloys of platinum and early transition metals as oxygen reduction electrocatalysts by Greeley (2009)
  82. 10.1021/ja505192v / J. Am. Chem. Soc. / Selective hydrogen production from formic acid decomposition on Pd-Au bimetallic surfaces by Yu (2014)
  83. 10.1063/1.3369007 / J. Chem. Phys. / Structure and activity relationship for CO and O2 adsorption over gold nanoparticles using density functional theory and artificial neural networks by Yildirim (2010)
  84. Ulissi, Z.W., Tang, M.T., Xiao, J., Liu, X., Torelli, D.A., Karamad, M., Cummins, K., Hahn, C., Lewis, N.S., and Jaramillo, T.F. (2017). Machine-Learning Methods Enable Exhaustive Searches for Active Bimetallic Facets and Reveal Active Site Motifs for CO2 Reduction. ACS Catal., 7b01648. (10.1021/acscatal.7b01648)
  85. 10.1002/cpe.3505 / Concurr. Comput. / FireWorks: A dynamic workflow system designed for high-throughput applications by Jain (2015)
  86. 10.1103/PhysRevB.59.7507 / Phys. Rev. B / Current injection from a metal to a disordered hopping system. I. Monte Carlo simulation by Wolf (1999)
  87. 10.1016/0009-2614(92)85498-Y / Chem. Phys. Lett. / Potential energy surfaces for macromolecules. A neural network technique by Sumpter (1992)
  88. 10.1103/PhysRevB.73.115431 / Phys. Rev. B / Descriptions of surface chemical reactions using a neural network representation of the potential-energy surface by Lorenz (2006)
  89. 10.1016/S0009-2614(97)00448-X / Chem. Phys. Lett. / Description of the potential energy surface of the water dimer with an artificial neural network (1997)
  90. 10.1039/C5NR03903G / Nanoscale / Global minimization of gold clusters by combining neural network potentials and the basin-hopping method by Ouyang (2015)
  91. 10.1126/science.285.5432.1368 / Science / Global Optimization of Clusters, Crystals, and Biomolecules by Wales (1999)
  92. Behler, J., and Parrinello, M. (2007). Generalized neural-network representation of high-dimensional potential-energy surfaces. Phys. Rev. Lett., 98. (10.1103/PhysRevLett.98.146401)
  93. 10.1039/c1cp21668f / Phys. Chem. Chem. Phys. / Neural network potential-energy surfaces in chemistry: A tool for large-scale simulations by Behler (2011)
  94. 10.1002/qua.24890 / Int. J. Q. Chem. / Constructing high-dimensional neural network potentials: A tutorial review by Behler (2015)
  95. 10.1021/jp401225b / J. Phys. Chem. A / A density-functional theory-based neural network potential for water clusters including van der waals corrections by Morawietz (2013)
  96. 10.1039/C6CP05711J / Phys. Chem. Chem. Phys. / Neural network molecular dynamics simulations of solid–liquid interfaces: Water at low-index copper surfaces by Natarajan (2016)
  97. Artrith, N., and Behler, J. (2012). High-dimensional neural network potentials for metal surfaces: A prototype study for copper. Phys. Rev. B—Condens. Matter Mater. Phys., 85. (10.1103/PhysRevB.85.045439)
  98. Chiriki, S., Jindal, S., and Bulusu, S.S. (2017). Neural network potentials for dynamics and thermodynamics of gold nanoparticles. J. Chem. Phys., 146. (10.1063/1.4977050)
  99. 10.1002/qua.25115 / Int. J. Q. Chem. / Neural network and ReaxFF comparison for Au properties by Boes (2016)
  100. 10.1021/acs.jctc.6b00994 / J. Chem. Theory Comput. / Ensemble-Average Representation of Pt Clusters in Conditions of Catalysis Accessed through GPU Accelerated Deep Neural Network Fitting Global Optimization by Zhai (2016)
  101. 10.1016/j.cpc.2016.05.010 / Comput. Phys. Commun. / Amp: A modular approach to machine learning in atomistic simulations by Khorshidi (2016)
  102. 10.1080/08927022.2016.1274984 / Mol. Simul. / Neural network predictions of oxygen interactions on a dynamic Pd surface by Boes (2017)
  103. 10.1021/acs.jpcc.6b12752 / J. Phys. Chem. C / Modeling Segregation on AuPd(111) Surfaces with Density Functional Theory and Monte Carlo Simulations by Boes (2017)
  104. 10.1021/cm100795d / Chem. Mater. / Finding natures missing ternary oxide compounds using machine learning and density functional theory by Hautier (2010)
  105. 10.1023/A:1018628609742 / Neural Process. Lett. / Least Squares Support Vector Machine Classifiers by Suykens (1999)
Dates
Type When
Created 7 years, 10 months ago (Oct. 18, 2017, 11:10 a.m.)
Deposited 1 year, 2 months ago (June 8, 2024, 5:03 p.m.)
Indexed 1 week, 1 day ago (Aug. 12, 2025, 5:29 p.m.)
Issued 7 years, 10 months ago (Oct. 18, 2017)
Published 7 years, 10 months ago (Oct. 18, 2017)
Published Online 7 years, 10 months ago (Oct. 18, 2017)
Funders 0

None

@article{Li_2017, title={Application of Artificial Neural Networks for Catalysis: A Review}, volume={7}, ISSN={2073-4344}, url={http://dx.doi.org/10.3390/catal7100306}, DOI={10.3390/catal7100306}, number={10}, journal={Catalysts}, publisher={MDPI AG}, author={Li, Hao and Zhang, Zhien and Liu, Zhijian}, year={2017}, month=oct, pages={306} }