First Advisor

Melanie Mitchell

Term of Graduation

Fall 2020

Date of Publication

10-19-2020

Document Type

Dissertation

Degree Name

Doctor of Philosophy (Ph.D.) in Computer Science

Department

Computer Science

Language

English

Subjects

Natural computation, Machine learning, Neural networks (Computer science), Digital images -- Classification

DOI

10.15760/etd.7484

Physical Description

1 online resource (viii, 109 pages)

Abstract

While deep learning has proven to be successful for various tasks in the field of computer vision, there are several limitations of deep-learning models when compared to human performance. Specifically, human vision is largely robust to noise and distortions, whereas deep learning performance tends to be brittle to modifications of test images, including being susceptible to adversarial examples. Additionally, deep-learning methods typically require very large collections of training examples for good performance on a task, whereas humans can learn to perform the same task with a much smaller number of training examples.

In this dissertation, I investigate whether the use of a biologically informed, unsupervised sparse coding algorithm can help to alleviate these shortcomings within classification networks. I find that (1) the non-linear encoding scheme of convolutional sparse coding, as opposed to the dictionary learned, contributes to classification performance when used within a model. In addition, (2) sparse coding helps classification models trained on clean images to be more robust to adversarial examples and images corrupted with high frequency noise. Finally, (3) sparse coding helps alleviate the number of human-annotated training labels needed for classification on stereo-video data. Overall, using unsupervised sparse coding within supervised models can help alleviate various shortcomings of traditional deep neural networks.

Rights

© 2020 Sheng Y. Lundquist

In Copyright. URI: http://rightsstatements.org/vocab/InC/1.0/ This Item is protected by copyright and/or related rights. You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s).

Persistent Identifier

https://archives.pdx.edu/ds/psu/34530

Download

Share

COinS