RTL design and analysis of Softmax Layer in Deep Neural Networks

Simple item page
dc.contributor.advisorJohn, Lizy Kurian
dc.creatorXavier, Jim
dc.date.accessioned2021-01-20T21:57:34Z
dc.date.available2021-01-20T21:57:34Z
dc.date.created2020-05
dc.date.issued2020-05-07
dc.date.submittedMay 2020
dc.date.updated2021-01-20T21:57:35Z
dc.description.abstractDeep neural networks (DNNs) are widely used in modern machine learning systems in the big data era for their superior accuracy. These artificial neural networks suffer from high computational complexity. The structure of DNN layers vary depending on the nature of training and inference tasks. Softmax Layer is a critical layer in DNNs and is usually used as the output layer in multi-category classification tasks. Softmax layer involves exponentiation and division, thereby resulting in high computational complexity and long critical paths. This report focuses on frontend implementation of an efficient microarchitecture of Softmax layer, which tries to address some of the problems associated with a simple, direct implementation. Techniques like pipelining are employed to boost the performance of the complex datapath logic. Error analysis of the hardware is performed with software results from MATLAB. Synthesis of the RTL code is performed on Xilinx Artix-7 FPGA, resulting in a clock frequency of 274.3 MHz.
dc.description.departmentElectrical and Computer Engineering
dc.format.mimetypeapplication/pdf
dc.identifier.urihttps://hdl.handle.net/2152/84355
dc.identifier.urihttp://dx.doi.org/10.26153/tsw/11334
dc.language.isoen
dc.subjectDeep neural networks
dc.subjectSoftmax activation
dc.subjectAXI
dc.subjectCNN
dc.subjectExponentiation
dc.subjectLinear interpolation
dc.titleRTL design and analysis of Softmax Layer in Deep Neural Networks
dc.typeThesis
dc.type.materialtext
thesis.degree.departmentElectrical and Computer Engineering
thesis.degree.disciplineElectrical and Computer Engineering
thesis.degree.grantorThe University of Texas at Austin
thesis.degree.levelMasters
thesis.degree.nameMaster of Science in Engineering

Access full-text files

Original bundle

Now showing 1 - 1 of 1
Thumbnail Image
Name:
XAVIER-MASTERSREPORT-2020.pdf
Size:
940.52 KB
Format:
Adobe Portable Document Format
Download

License bundle

Now showing 1 - 2 of 2
No Thumbnail Available
Name:
PROQUEST_LICENSE.txt
Size:
4.45 KB
Format:
Plain Text
Description:
Download
No Thumbnail Available
Name:
LICENSE.txt
Size:
1.84 KB
Format:
Plain Text
Description:
Download

Collections

UT Electronic Theses and Dissertations