Dental caries has high prevalence among kids and adults thus it has become one of the global health concerns. The current modern dentistry focused on the preventives measures to reduce the number of dental caries cases. The employment of machine learning coupled with UV spectroscopy plays a crucial role to detect the early stage of caries. Artificial neural network with hyperparameter tuning was employed to train spectral data for the classification based on the International Caries Detection and Assesment System (ICDAS). Spectra preprocessing namely mean center (MC), autoscale (AS) and Savitzky Golay smoothing (SG) were applied on the data for spectra correction. The best performance of ANN model obtained has accuracy of 0.85 with precision of 1.00. Convolutional neural network (CNN) combined with Savitzky Golay smoothing performed on the spectral data has accuracy, precision, sensitivity and specificity for validation data of 1.00 respectively. The result obtained shows that the application of ANN and CNN capable to produce robust model to be used as an early screening of dental caries.
This study employs an artificial neural network optimization algorithm, enhanced with a Genetic Algorithm-Back Propagation (GA-BP) network, to assess the service quality of urban water bodies and green spaces, aiming to promote healthy urban environments. From an initial set of 95 variables, 29 key variables were selected, including 17 input variables, such as water and green space area, population size, and urbanization rate, six hidden layer neurons, such as patch number, patch density, and average patch size, and one output variable for the comprehensive value of blue-green landscape quality. The results indicate that the GA-BP network achieves an average relative error of 0.94772%, which is superior to the 1.5988% of the traditional BP network. Moreover, it boasts a prediction accuracy of 90% for the comprehensive value of landscape quality from 2015 to 2022, significantly outperforming the BP network's approximate 70% accuracy. This method enhances the accuracy of landscape quality assessment but also aids in identifying crucial factors influencing quality. It provides scientific and objective guidance for future urban landscape structure and layout, contributing to high-quality urban development and the creation of exemplary living areas.
Hyperparameter tuning is an important process to maximize the performance of any neural network model. This present study proposed the factorial design of experiment for screening and response surface methodology to optimize the hyperparameter of two artificial neural network algorithms. Feed-forward neural network (FFNN) and radial basis function neural network (RBFNN) are applied to predict the permeate flux of palm oil mill effluent. Permeate pump and transmembrane pressure of the submerge membrane bioreactor system are the input variables. Six hyperparameters of the FFNN model including four numerical factors (neuron numbers, learning rate, momentum, and epoch numbers) and two categorical factors (training and activation function) are used in hyperparameter optimization. RBFNN includes two numerical factors such as a number of neurons and spreads. The conventional method (one-variable-at-a-time) is compared in terms of optimization processing time and the accuracy of the model. The result indicates that the optimal hyperparameters obtained by the proposed approach produce good accuracy with a smaller generalization error. The simulation results show an improvement of more than 65% of training performance, with less repetition and processing time. This proposed methodology can be utilized for any type of neural network application to find the optimum levels of different parameters.
This study employs diverse machine learning models, including classic artificial neural network (ANN), hybrid ANN models, and the imperialist competitive algorithm and emotional artificial neural network (EANN), to predict crucial parameters such as fresh water production and vapor temperatures. Evaluation metrics reveal the integrated ANN-ICA model outperforms the classic ANN, achieving a remarkable 20% reduction in mean squared error (MSE). The emotional artificial neural network (EANN) demonstrates superior accuracy, attaining an impressive 99% coefficient of determination (R2) in predicting freshwater production and vapor temperatures. The comprehensive comparative analysis extends to environmental assessments, displaying the solar desalination system's compatibility with renewable energy sources. Results highlight the potential for the proposed system to conserve water resources and reduce environmental impact, with a substantial decrease in total dissolved solids (TDS) from over 6,000 ppm to below 50 ppm. The findings underscore the efficacy of machine learning models in optimizing solar-driven desalination systems, providing valuable insights into their capabilities for addressing water scarcity challenges and contributing to the global shift toward sustainable and environmentally friendly water production methods.
Metal-organic framework (MOF)--based composites have received significant attention in a variety of applications, including pollutant adsorption processes. The current investigation was designed to model, forecast, and optimize heavy metal (Cu2+) removal from wastewater using a MOF nanocomposite. This work has been modeled by response surface methodology (RSM) and artificial neural network (ANN) algorithms. In addition, the optimization of the mentioned factors has been performed through the RSM method to find the optimal conditions. The findings show that RSM and ANN can accurately forecast the adsorption process's the Cu2+ removal efficiency (RE). The maximum values of RE are achieved at the highest value of time (150 min), the highest value of adsorbent dosage (0.008 g), and the highest value of pH (=6). The R2 values obtained were 0.9995, 0.9992, and 0.9996 for ANN modeling of adsorption capacity based on different adsorbent dosages, Cu2+ solution pHs, and different ion concentrations, respectively. The ANN demonstrated a high level of accuracy in predicting the local minima of the graph. In addition, the RSM optimization results showed that the optimum mode for RE occurred at an adsorbent dosage value of 0.007 g and a time value of 144.229 min.
Groundwater, the world's most abundant source of freshwater, is rapidly depleting in many regions due to a variety of factors. Accurate forecasting of groundwater level (GWL) is essential for effective management of this vital resource, but it remains a complex and challenging task. In recent years, there has been a notable increase in the use of machine learning (ML) techniques to model GWL, with many studies reporting exceptional results. In this paper, we present a comprehensive review of 142 relevant articles indexed by the Web of Science from 2017 to 2023, focusing on key ML models, including artificial neural networks (ANN), adaptive neuro-fuzzy inference systems (ANFIS), support vector regression (SVR), evolutionary computing (EC), deep learning (DL), ensemble learning (EN), and hybrid-modeling (HM). We also discussed key modeling concepts such as dataset size, data splitting, input variable selection, forecasting time-step, performance metrics (PM), study zones, and aquifers, highlighting best practices for optimal GWL forecasting with ML. This review provides valuable insights and recommendations for researchers and water management agencies working in the field of groundwater management and hydrology.
Using bone char for contaminated wastewater treatment and soil remediation is an intriguing approach to environmental management and an environmentally friendly way of recycling waste. The bone char remediation strategy for heavy metal-polluted wastewater was primarily affected by bone char characteristics, factors of solution, and heavy metal (HM) chemistry. Therefore, the optimal parameters of HM sorption by bone char depend on the research being performed. Regarding enhancing HM immobilization by bone char, a generic strategy for determining optimal parameters and predicting outcomes is crucial. The primary objective of this research was to employ artificial neural network (ANN) technology to determine the optimal parameters via sensitivity analysis and to predict objective function through simulation. Sensitivity analysis found that for multi-metals sorption (Cd, Ni, and Zn), the order of significance for pyrolysis parameters was reaction temperature > heating rate > residence time. The primary variables for single metal sorption were solution pH, HM concentration, and pyrolysis temperature. Regarding binary sorption, the incubation parameters were evaluated in the following order: HM concentrations > solution pH > bone char mass > incubation duration. This approach can be used for further experiment design and improve the immobilization of HM by bone char for water remediation.
As one of the most common female cancers, cervical cancer often develops years after a prolonged and reversible pre-cancerous stage. Traditional classification algorithms used for detection of cervical cancer often require cell segmentation and feature extraction techniques, while convolutional neural network (CNN) models demand a large dataset to mitigate over-fitting and poor generalization problems. To this end, this study aims to develop deep learning models for automated cervical cancer detection that do not rely on segmentation methods or custom features. Due to limited data availability, transfer learning was employed with pre-trained CNN models to directly operate on Pap smear images for a seven-class classification task. Thorough evaluation and comparison of 13 pre-trained deep CNN models were performed using the publicly available Herlev dataset and the Keras package in Google Collaboratory. In terms of accuracy and performance, DenseNet-201 is the best-performing model. The pre-trained CNN models studied in this paper produced good experimental results and required little computing time.
Improper municipal solid waste (MSW) management contributes to greenhouse gas emissions, necessitating emissions reduction strategies such as waste reduction, recycling, and composting to move towards a more sustainable, low-carbon future. Machine learning models are applied for MSW-related trend prediction to provide insights on future waste generation or carbon emissions trends and assist the formulation of effective low-carbon policies. Yet, the existing machine learning models are diverse and scattered. This inconsistency poses challenges for researchers in the MSW domain who seek to identify and optimize the machine learning techniques and configurations for their applications. This systematic review focuses on MSW-related trend prediction using the most frequently applied machine learning model, artificial neural network (ANN), while addressing potential methodological improvements for reducing prediction uncertainty. Thirty-two papers published from 2013 to 2023 are included in this review, all applying ANN for MSW-related trend prediction. Observing a decrease in the size of data samples used in studies from daily to annual timescales, the summarized statistics suggest that well-performing ANN models can still be developed with approximately 33 annual data samples. This indicates promising opportunities for modeling macroscale greenhouse gas emissions in future works. Existing literature commonly used the grid search (manual) technique for hyperparameter (e.g., learning rate, number of neurons) optimization and should explore more time-efficient automated optimization techniques. Since there are no one-size-fits-all performance indicators, it is crucial to report the model's predictive performance based on more than one performance indicator and examine its uncertainty. The predictive performance of newly-developed integrated models should also be benchmarked to show performance improvement clearly and promote similar applications in future works. The review analyzed the shortcomings, best practices, and prospects of ANNs for MSW-related trend predictions, supporting the realization of practical applications of ANNs to enhance waste management practices and reduce carbon emissions.
Digital image processing has witnessed a significant transformation, owing to the adoption of deep learning (DL) algorithms, which have proven to be vastly superior to conventional methods for crop detection. These DL algorithms have recently found successful applications across various domains, translating input data, such as images of afflicted plants, into valuable insights, like the identification of specific crop diseases. This innovation has spurred the development of cutting-edge techniques for early detection and diagnosis of crop diseases, leveraging tools such as convolutional neural networks (CNN), K-nearest neighbour (KNN), support vector machines (SVM), and artificial neural networks (ANN). This paper offers an all-encompassing exploration of the contemporary literature on methods for diagnosing, categorizing, and gauging the severity of crop diseases. The review examines the performance analysis of the latest machine learning (ML) and DL techniques outlined in these studies. It also scrutinizes the methodologies and datasets and outlines the prevalent recommendations and identified gaps within different research investigations. As a conclusion, the review offers insights into potential solutions and outlines the direction for future research in this field. The review underscores that while most studies have concentrated on traditional ML algorithms and CNN, there has been a noticeable dearth of focus on emerging DL algorithms like capsule neural networks and vision transformers. Furthermore, it sheds light on the fact that several datasets employed for training and evaluating DL models have been tailored to suit specific crop types, emphasizing the pressing need for a comprehensive and expansive image dataset encompassing a wider array of crop varieties. Moreover, the survey draws attention to the prevailing trend where the majority of research endeavours have concentrated on individual plant diseases, ML, or DL algorithms. In light of this, it advocates for the development of a unified framework that harnesses an ensemble of ML and DL algorithms to address the complexities of multiple plant diseases effectively.
Parkinson's disease (PD) is a progressively debilitating neurodegenerative disorder that primarily affects the dopaminergic system in the basal ganglia, impacting millions of individuals globally. The clinical manifestations of the disease include resting tremors, muscle rigidity, bradykinesia, and postural instability. Diagnosis relies mainly on clinical evaluation, lacking reliable diagnostic tests and being inherently imprecise and subjective. Early detection of PD is crucial for initiating treatments that, while unable to cure the chronic condition, can enhance the life quality of patients and alleviate symptoms. This study explores the potential of utilizing long-short term memory neural networks (LSTM) with attention mechanisms to detect Parkinson's disease based on dual-task walking test data. Given that the performance of networks is significantly inductance by architecture and training parameter choices, a modified version of the recently introduced crayfish optimization algorithm (COA) is proposed, specifically tailored to the requirements of this investigation. The proposed optimizer is assessed on a publicly accessible real-world clinical gait in Parkinson's disease dataset, and the results demonstrate its promise, achieving an accuracy of 87.4187 % for the best-constructed models.
DNA-binding proteins (DBPs) play a significant role in all phases of genetic processes, including DNA recombination, repair, and modification. They are often utilized in drug discovery as fundamental elements of steroids, antibiotics, and anticancer drugs. Predicting them poses the most challenging task in proteomics research. Conventional experimental methods for DBP identification are costly and sometimes biased toward prediction. Therefore, developing powerful computational methods that can accurately and rapidly identify DBPs from sequence information is an urgent need. In this study, we propose a novel deep learning-based method called Deep-WET to accurately identify DBPs from primary sequence information. In Deep-WET, we employed three powerful feature encoding schemes containing Global Vectors, Word2Vec, and fastText to encode the protein sequence. Subsequently, these three features were sequentially combined and weighted using the weights obtained from the elements learned through the differential evolution (DE) algorithm. To enhance the predictive performance of Deep-WET, we applied the SHapley Additive exPlanations approach to remove irrelevant features. Finally, the optimal feature subset was input into convolutional neural networks to construct the Deep-WET predictor. Both cross-validation and independent tests indicated that Deep-WET achieved superior predictive performance compared to conventional machine learning classifiers. In addition, in extensive independent test, Deep-WET was effective and outperformed than several state-of-the-art methods for DBP prediction, with accuracy of 78.08%, MCC of 0.559, and AUC of 0.805. This superior performance shows that Deep-WET has a tremendous predictive capacity to predict DBPs. The web server of Deep-WET and curated datasets in this study are available at https://deepwet-dna.monarcatechnical.com/ . The proposed Deep-WET is anticipated to serve the community-wide effort for large-scale identification of potential DBPs.
Membrane fouling is a critical bottleneck to the widespread adoption of membrane separation processes. It diminishes the membrane permeability and results in high operational energy costs. The current study presents optimizing the operating parameters of a novel rotating biological contactor (RBC) integrated with an external membrane (RBC + ME) that combines membrane technology with an RBC. In the RBC + ME, the membrane panel is placed external to the bioreactor. Response surface methodology (RSM) is applied to optimize the membrane permeability through three operating parameters (hydraulic retention time (HRT), rotational disk speed, and sludge retention time (SRT)). The artificial neural networks (ANN) and support vector machine (SVM) are implemented to depict the statistical modelling approach using experimental data sets. The results showed that all three operating parameters contribute significantly to the performance of the bioreactor. RSM revealed an optimum value of 40.7 rpm disk rotational speed, 18 h HRT and 12.4 d SRT, respectively. An ANN model with ten hidden layers provides the highest R2 value, while the SVM model with the Bayesian optimizer provides the highest R2. RSM, ANN, and SVM models reveal the highest R-square values of 0.97, 0.99, and 0.99, respectively. Machine learning techniques help predict the model based on the experimental results and training data sets.
The practice of aquaculture is associated with the generation of a substantial quantity of effluent. Microalgae must effectively assimilate nitrogen and phosphorus from their surrounding environment for growth. This study modeled the algal biomass film, NO3-N concentration, and pH in the membrane bioreactor using the response surface methodology (RSM) and an artificial neural network (ANN). Furthermore, it was suggested that the optimal condition for each parameter be determined. The results of ANN modeling showed that ANN with a structure of 5-3 and employing the transfer functions tansig-logsig demonstrated the highest level of accuracy. This was evidenced by the obtained values of coefficient (R2) = 0.998, R = 0.999, mean squared error (MAE) = 0.0856, and mean square error (MSE) = 0.143. The ANN model, characterized by a 5-5 structure and employing the tansig-logsig transfer function, demonstrates superior accuracy when predicting the concentration of NO3-N and pH. This is evidenced by the high values of R2 (0.996), R (0.998), MAE (0.00162), and MSE (0.0262). The RSM was afterward employed to maximize the performance of algal film biomass, pH levels, and NO3-N concentrations. The optimal conditions for the algal biomass film were a concentration of 2.884 mg/L and a duration of 6.589 days. Similarly, the most favorable conditions for the NO3-N concentration and pH were 2.984 mg/L and 6.787 days, respectively. Therefore, this research uses non-dominated sorting genetic algorithm II (NSGA II) to find the optimal NO3-N concentration, algal biomass film, and pH for product or process quality. The region has the greatest alkaline pH and lowest NO3-N content.
This study proposes a deep convolutional neural network for the automatic segmentation of glioblastoma brain tumors, aiming sat replacing the manual segmentation method that is both time-consuming and labor-intensive. There are many challenges for automatic segmentation to finely segment sub-regions from multi-sequence magnetic resonance images because of the complexity and variability of glioblastomas, such as the loss of boundary information, misclassified regions, and subregion size. To overcome these challenges, this study introduces a spatial pyramid module and attention mechanism to the automatic segmentation algorithm, which focuses on multi-scale spatial details and context information. The proposed method has been tested in the public benchmarks BraTS 2018, BraTS 2019, BraTS 2020 and BraTS 2021 datasets. The Dice score on the enhanced tumor, whole tumor, and tumor core were respectively 79.90 %, 89.63 %, and 85.89 % on the BraTS 2018 dataset, respectively 77.14 %, 89.58 %, and 83.33 % on the BraTS 2019 dataset, and respectively 77.80 %, 90.04 %, and 83.18 % on the BraTS 2020 dataset, and respectively 83.48 %, 90.70 %, and 88.94 % on the BraTS 2021 dataset offering performance on par with that of state-of-the-art methods with only 1.90 M parameters. In addition, our approach significantly reduced the requirements for experimental equipment, and the average time taken to segment one case was only 1.48 s; these two benefits rendered the proposed network intensely competitive for clinical practice.
The most widely used method for detecting Coronavirus Disease 2019 (COVID-19) is real-time polymerase chain reaction. However, this method has several drawbacks, including high cost, lengthy turnaround time for results, and the potential for false-negative results due to limited sensitivity. To address these issues, additional technologies such as computed tomography (CT) or X-rays have been employed for diagnosing the disease. Chest X-rays are more commonly used than CT scans due to the widespread availability of X-ray machines, lower ionizing radiation, and lower cost of equipment. COVID-19 presents certain radiological biomarkers that can be observed through chest X-rays, making it necessary for radiologists to manually search for these biomarkers. However, this process is time-consuming and prone to errors. Therefore, there is a critical need to develop an automated system for evaluating chest X-rays. Deep learning techniques can be employed to expedite this process. In this study, a deep learning-based method called Custom Convolutional Neural Network (Custom-CNN) is proposed for identifying COVID-19 infection in chest X-rays. The Custom-CNN model consists of eight weighted layers and utilizes strategies like dropout and batch normalization to enhance performance and reduce overfitting. The proposed approach achieved a classification accuracy of 98.19% and aims to accurately classify COVID-19, normal, and pneumonia samples.
This study introduces an augmented Long-Short Term Memory (LSTM) neural network architecture, integrating Symbolic Genetic Programming (SGP), with the objective of forecasting cross-sectional price returns across a comprehensive dataset comprising 4500 listed stocks in the Chinese market over the period from 2014 to 2022. Using the S&P Alpha Pool Dataset for China as basic input, this architecture incorporates data augmentation and feature extraction techniques. The result of this study demonstrates significant improvements in Rank Information coefficient (Rank IC) and IC information ratio (ICIR) by 1128% and 5360% respectively when it is applied to fundamental indicators. For technical indicators, the hybrid model achieves a 206% increase in Rank IC and an impressive surge of 2752% in ICIR. Furthermore, the proposed hybrid SGP-LSTM model outperforms major Chinese stock indexes, generating average annualized excess returns of 31.00%, 24.48%, and 16.38% compared to the CSI 300 index, CSI 500 index, and the average portfolio, respectively. These findings highlight the effectiveness of SGP-LSTM model in improving the accuracy of cross-sectional stock return predictions and provide valuable insights for fund managers, traders, and financial analysts.
Although algal-based membrane bioreactors (AMBRs) have been demonstrated to be effective in treating wastewater (landfill leachate), there needs to be more research into the effectiveness of these systems. This study aims to determine whether AMBR is effective in treating landfill leachate with hydraulic retention times (HRTs) of 8, 12, 14, 16, 21, and 24 h to maximize AMBR's energy efficiency, microalgal biomass production, and removal efficiency using artificial neural network (ANN) models. Experimental results and simulations indicate that biomass production in bioreactors depends heavily on HRT. A decrease in HRT increases algal (Chlorella vulgaris) biomass productivity. Results also showed that 80% of chemical oxygen demand (COD) was removed from algal biomass by bioreactors. To determine the most efficient way to process the features as mentioned above, nondominated sorting genetic algorithm II (NSGA-II) techniques were applied. A mesophilic, suspended-thermophilic, and attached-thermophilic organic loading rate (OLR) of 1.28, 1.06, and 2 kg/m3/day was obtained for each method. Compared to suspended-thermophilic growth (3.43 kg/m3.day) and mesophilic growth (1.28 kg/m3.day), attached-thermophilic growth has a critical loading rate of 10.5 kg/m3.day. An energy audit and an assessment of the system's auto-thermality were performed at the end of the calculation using the Monod equation for biomass production rate (Y) and bacteria death constant (Kd). According to the results, a high removal level of COD (at least 4000 mg COD/liter) leads to auto-thermality.
This study aimed to assess the dynamic simulation models provided by Aspen adsorption (ASPAD) and artificial neural network (ANN) in understanding the adsorption behavior of atenolol (ATN) on gasified Glyricidia sepium woodchips activated carbon (GGSWAC) within fixed bed columns for wastewater treatment. The findings demonstrated that increasing the bed height from 1 to 3 cm extended breakthrough and exhaustion times while enhancing adsorption capacity. Conversely, higher initial ATN concentrations resulted in shorter breakthrough and exhaustion times but increased adsorption capacity. Elevated influent flow rates reduced breakthrough and exhaustion times while maintaining constant adsorption capacity. The ASPAD software demonstrated competence in accurately modeling the crucial exhaustion points. However, there is room for enhancement in forecasting breakthrough times, as it exhibited deviations ranging from 6.52 to 239.53% when compared to the actual experimental data. ANN models in both MATLAB and Python demonstrated precise predictive abilities, with the Python model (R2 = 0.985) outperforming the MATLAB model (R2 = 0.9691). The Python ANN also exhibited superior fitting performance with lower MSE and MAE. The most influential factor was the initial ATN concentration (28.96%), followed by bed height (26.39%), influent flow rate (22.43%), and total effluent time (22.22%). The findings of this study offer an extensive comprehension of breakthrough patterns and enable accurate forecasts of column performance.
Direct recycling of aluminum waste is crucial in sustainable manufacturing to mitigate environmental impact and conserve resources. This work was carried out to study the application of hot press forging (HPF) in recycling AA6061 aluminum chip waste, aiming to optimize operating factors using Response Surface Methodology (RSM), Artificial Neural Network (ANN) and Genetic algorithm (GA) strategy to maximize the strength of recycled parts. The experimental runs were designed using Full factorial and RSM via Minitab 21 software. RSM-ANN models were employed to examine the effect of factors and their interactions on response and to predict output, while GA-RSM and GA-ANN were used for optimization. The chips of different morphology were cold compressed into billet form and then hot forged. The effect of varying forging temperature (Tp, 450-550°C), holding time (HT, 60-120 minutes), and chip surface area to volume ratio (AS:V, 15.4-52.6 mm2/mm3) on ultimate tensile strength (UTS) was examined. Maximum UTS (237.4 MPa) was achieved at 550°C, 120 minutes and 15.4 mm2/mm3 of chip's AS: V. The Tp had the largest contributing effect ratio on the UTS, followed by HT and AS:V according to ANOVA analysis. The proposed optimization process suggested 550°C, 60 minutes, and 15.4 mm2 as the optimal condition yielding the maximum UTS. The developed models' evaluation results showed that ANN (with MSE = 1.48%) outperformed RSM model. Overall, the study promotes sustainable production by demonstrating the potential of integrating RSM and ML to optimize complex manufacturing processes and improve product quality.