Towards End-to-End Semantically Aware 2D Plot Tactile Generation
Public Deposited- Resource Type
- Creator
- Abstract
The goal of this thesis is to automate converting 2D plots including to tactile format. We defined the problem as an image-to-image translation where the source domain belongs to 2D plots and the target domain is the tactile equivalent of the input plot. The proposed method is based on the pix2pix architecture using UNet++ as the generator. We also propose to use gradient penalty and perceptual loss to further enhance the results. To achieve editable outputs, we propose two approaches. One aims to generate RGB outputs. The other aims to generate multichannel outputs where each channel is associated with a component of the 2D plot. We evaluate the proposed models quantitatively and qualitatively. For RGB outputs we use foreground MSE, background MSE, precision, and recall. On the other hand, we use pixel accuracy, Dice coefficient, and Jaccard index to evaluate our channelwise model.
- Subject
- Language
- Publisher
- Thesis Degree Level
- Thesis Degree Name
- Thesis Degree Discipline
- Identifier
- Rights Notes
Copyright © 2022 the author(s). Theses may be used for non-commercial research, educational, or related academic purposes only. Such uses include personal study, research, scholarship, and teaching. Theses may only be shared by linking to Carleton University Institutional Repository and no part may be used without proper attribution to the author. No part may be used for commercial purposes directly or indirectly via a for-profit platform; no adaptation or derivative works are permitted without consent from the copyright owner.
- Date Created
- 2022
Relations
- In Collection:
Items
Thumbnail | Title | Date Uploaded | Visibility | Actions |
---|---|---|---|---|
heydaridastjerdi-towardsendtoendsemanticallyaware2dplottactile.pdf | 2023-05-05 | Public | Download |