Novel Architectures and Training Algorithms for Deep Neural Networks /

Bibliographic Details
Main Author: Medeiros Davi, Caio Cesar (Author)
Other Authors: Braga-Neto, Ulisses (Thesis advisor)
Format: Thesis eBook
Language:English
Published: [College Station, Texas] : [Texas A&M University], [2023]
Subjects:
Online Access:Link to OAKTrust copy

MARC

Tag First Indicator Second Indicator Subfields
LEADER 00000nam a22000007i 4500
001 in00005621321
008 241022s2023 txu∎∎∎∎ obm 000 0 eng d
006 m fo d
007 cr unu||||||||
005 20250326141434.6
035 |a 1463309425 
040 |a TXA  |c TXA  |b eng  |e rda  |e pn 
035 |a (TxCM)https://hdl.handle.net/1969.1/198602 
099 |a 2022  |a Dissertation 
049 |a TXAM 
100 1 |a Medeiros Davi, Caio Cesar,  |e author. 
245 1 0 |a Novel Architectures and Training Algorithms for Deep Neural Networks /  |c by Caio Cesar Medeiros Davi. 
264 1 |a [College Station, Texas] :  |b [Texas A&M University],  |c [2023] 
300 |a 1 online resource. 
336 |a text  |b txt  |2 rdacontent 
337 |a computer  |b c  |2 rdamedia 
338 |a online resource  |b cr  |2 rdacarrier 
347 |a text file  |b PDF  |2 rda 
500 |a "Major Subject: Electrical Engineering" 
500 |a Includes vita. 
502 |b Doctor of Philosophy  |c Texas A&M University  |d 2022  |o https://hdl.handle.net/1969.1/198602 
504 |a Includes bibliographical references. 
516 |a Text (Dissertation) 
520 3 |a Nowadays, machine learning and deep learning are present in the most diverse types of applications. From such diversity, many particular designs, architectures, training methods were created, given the variety of applications of many different areas. Rather than trying to find a multi-purpose scheme to generate and train deep neural networks, which would be an impracticable challenge, this work aims to deliver well suited training techniques for well defined problems in specific fields. Every single domain has its own necessities and specificities, thus it is essential to have individual solutions for each case. In the bio-informatics domain we propose the gGAN, a novel approach to train GANs, which is capable of generating labeled genetic datasets using a small labeled dataset and a larger unlabeled dataset, exploiting concepts of semi-supervised learning and data augmentation to create a new approach to deal with the limited labeled data available to researchers. This method may also be used as a self-aware classifier, a classifier with a second level of confidence. Since it is only based on genetic profiles, it can be applied at any stage of the disease (or even before infection). This allows the usage as a triage tool, able to prognose early-infected patients, avoiding the exposure of healthcare professionals who are sensitive to the disease. This work also addresses a Scientific Machine Learning technique, the Physically Informed Neural Networks (PINNs). Evidence shows that PINN training by gradient descent displays pathologies that often prevent convergence when solving PDEs with irregular solutions. In this work, we propose the use of a Particle Swarm Optimization (PSO) approach to train PINNs. The resulting PSO-PINN algorithm not only mitigates the undesired behaviors of PINNs trained with standard gradient descent but also presents an ensemble approach to PINN that affords the possibility of robust predictions with quantified uncertainty. Comprehensive experimental results show that PSO-PINN, using a modified PSO algorithm with a behavioral coefficient schedule, outperforms other PSO variants for training PINNs, as well as PINN ensembles trained with standard ADAM. Furthermore, we propose two distinct extensions for this method, namely Multi-Objective PSO-PINN and Multi-Modal PSO-PINN. The first one acknowledges the PINN as a multi-objective problem and handles the PSO-PINN training as such. This approach unleashes a new paradigm to deal with PINNs, allowing the analysis of the problem and finding out if the model-driven and data-driven portions of the PINN are in agreement. The latter promotes a desirable characteristic of the PSO-PINN, the diversity of the solutions. The Multi-Modal approach enforces multiple local optima during the training, guaranteeing a solution composed of a diverse ensemble. The electronic version of this dissertation is accessible from https://hdl.handle.net/1969.1/198602 
588 |a Description from author supplied metadata (automated record created 2024-09-05 11:29:52). 
650 4 |a Major Electrical Engineering 
653 |a Deep learning 
653 |a physically informed neural networks 
653 |a particle swarm optimization 
700 1 |a Braga-Neto, Ulisses,  |e thesis advisor. 
710 2 |a Texas A&M University,  |e degree granting institution. 
856 4 0 |3 Texas A&M University  |u https://hdl.handle.net/1969.1/198602  |z Link to OAKTrust copy  |t 0 
999 f f |s c32773de-61b1-4716-b904-7315d9b84253  |i d462b1c5-63b3-4897-b23e-7922602a8e05  |t 0 
952 f f |a Texas A&M University  |b College Station  |c Electronic Resources  |d Available Online  |t 0 
998 f f |t 0  |l Available Online