Publication: Learning to follow verbal instructions with visual grounding
dc.contributor.department | Department of Electrical and Electronics Engineering | |
dc.contributor.department | Department of Computer Engineering | |
dc.contributor.department | Graduate School of Sciences and Engineering | |
dc.contributor.kuauthor | Can, Ozan Arkan | |
dc.contributor.kuauthor | Ünal, Emre | |
dc.contributor.kuauthor | Yemez, Yücel | |
dc.contributor.schoolcollegeinstitute | College of Engineering | |
dc.contributor.schoolcollegeinstitute | GRADUATE SCHOOL OF SCIENCES AND ENGINEERING | |
dc.date.accessioned | 2024-11-09T23:59:20Z | |
dc.date.issued | 2019 | |
dc.description.abstract | We present a visually grounded deep learning model towards a virtual robot that can follow navigational instructions. Our model is capable of processing raw visual input and natural text instructions. The aim is to develop a model that can learn to follow novel instructions from instruction-perception examples. The proposed model is trained on data collected in a synthetic environment and its architecture allows it to work also with real visual data. We show that our results are on par with the previously proposed methods. | |
dc.description.indexedby | WOS | |
dc.description.indexedby | Scopus | |
dc.description.openaccess | YES | |
dc.description.publisherscope | International | |
dc.description.sponsoredbyTubitakEu | N/A | |
dc.identifier.doi | 10.1109/SIU.2019.8806335 | |
dc.identifier.isbn | 9781-7281-1904-5 | |
dc.identifier.scopus | 2-s2.0-85071986881 | |
dc.identifier.uri | https://doi.org/10.1109/SIU.2019.8806335 | |
dc.identifier.uri | https://hdl.handle.net/20.500.14288/15624 | |
dc.identifier.wos | 518994300061 | |
dc.keywords | Autonomous agents | |
dc.keywords | Computer vision | |
dc.keywords | Natural language processing | |
dc.keywords | Navigational instruction following | |
dc.language.iso | tur | |
dc.publisher | Institute of Electrical and Electronics Engineers (IEEE) | |
dc.relation.ispartof | 27th Signal Processing and Communications Applications Conference, SIU 2019 | |
dc.subject | Civil engineering | |
dc.subject | Electrical electronics engineering | |
dc.subject | Telecommunication | |
dc.title | Learning to follow verbal instructions with visual grounding | |
dc.title.alternative | Sözel komutların takibinin görsel temelli öǧrenilmesi | |
dc.type | Conference Proceeding | |
dspace.entity.type | Publication | |
local.contributor.kuauthor | Ünal, Emre | |
local.contributor.kuauthor | Can, Ozan Arkan | |
local.contributor.kuauthor | Yemez, Yücel | |
local.publication.orgunit1 | College of Engineering | |
local.publication.orgunit1 | GRADUATE SCHOOL OF SCIENCES AND ENGINEERING | |
local.publication.orgunit2 | Department of Electrical and Electronics Engineering | |
local.publication.orgunit2 | Department of Computer Engineering | |
local.publication.orgunit2 | Graduate School of Sciences and Engineering | |
relation.isOrgUnitOfPublication | 21598063-a7c5-420d-91ba-0cc9b2db0ea0 | |
relation.isOrgUnitOfPublication | 89352e43-bf09-4ef4-82f6-6f9d0174ebae | |
relation.isOrgUnitOfPublication | 3fc31c89-e803-4eb1-af6b-6258bc42c3d8 | |
relation.isOrgUnitOfPublication.latestForDiscovery | 21598063-a7c5-420d-91ba-0cc9b2db0ea0 | |
relation.isParentOrgUnitOfPublication | 8e756b23-2d4a-4ce8-b1b3-62c794a8c164 | |
relation.isParentOrgUnitOfPublication | 434c9663-2b11-4e66-9399-c863e2ebae43 | |
relation.isParentOrgUnitOfPublication.latestForDiscovery | 8e756b23-2d4a-4ce8-b1b3-62c794a8c164 |