Publication:
Learning to follow verbal instructions with visual grounding

Simple item page
dc.contributor.departmentDepartment of Electrical and Electronics Engineering
dc.contributor.departmentDepartment of Computer Engineering
dc.contributor.departmentGraduate School of Sciences and Engineering
dc.contributor.kuauthorCan, Ozan Arkan
dc.contributor.kuauthorÜnal, Emre
dc.contributor.kuauthorYemez, Yücel
dc.contributor.schoolcollegeinstituteCollege of Engineering
dc.contributor.schoolcollegeinstituteGRADUATE SCHOOL OF SCIENCES AND ENGINEERING
dc.date.accessioned2024-11-09T23:59:20Z
dc.date.issued2019
dc.description.abstractWe present a visually grounded deep learning model towards a virtual robot that can follow navigational instructions. Our model is capable of processing raw visual input and natural text instructions. The aim is to develop a model that can learn to follow novel instructions from instruction-perception examples. The proposed model is trained on data collected in a synthetic environment and its architecture allows it to work also with real visual data. We show that our results are on par with the previously proposed methods.
dc.description.indexedbyWOS
dc.description.indexedbyScopus
dc.description.openaccessYES
dc.description.publisherscopeInternational
dc.description.sponsoredbyTubitakEuN/A
dc.identifier.doi10.1109/SIU.2019.8806335
dc.identifier.isbn9781-7281-1904-5
dc.identifier.scopus2-s2.0-85071986881
dc.identifier.urihttps://doi.org/10.1109/SIU.2019.8806335
dc.identifier.urihttps://hdl.handle.net/20.500.14288/15624
dc.identifier.wos518994300061
dc.keywordsAutonomous agents
dc.keywordsComputer vision
dc.keywordsNatural language processing
dc.keywordsNavigational instruction following
dc.language.isotur
dc.publisherInstitute of Electrical and Electronics Engineers (IEEE)
dc.relation.ispartof27th Signal Processing and Communications Applications Conference, SIU 2019
dc.subjectCivil engineering
dc.subjectElectrical electronics engineering
dc.subjectTelecommunication
dc.titleLearning to follow verbal instructions with visual grounding
dc.title.alternativeSözel komutların takibinin görsel temelli öǧrenilmesi
dc.typeConference Proceeding
dspace.entity.typePublication
local.contributor.kuauthorÜnal, Emre
local.contributor.kuauthorCan, Ozan Arkan
local.contributor.kuauthorYemez, Yücel
local.publication.orgunit1College of Engineering
local.publication.orgunit1GRADUATE SCHOOL OF SCIENCES AND ENGINEERING
local.publication.orgunit2Department of Electrical and Electronics Engineering
local.publication.orgunit2Department of Computer Engineering
local.publication.orgunit2Graduate School of Sciences and Engineering
relation.isOrgUnitOfPublication21598063-a7c5-420d-91ba-0cc9b2db0ea0
relation.isOrgUnitOfPublication89352e43-bf09-4ef4-82f6-6f9d0174ebae
relation.isOrgUnitOfPublication3fc31c89-e803-4eb1-af6b-6258bc42c3d8
relation.isOrgUnitOfPublication.latestForDiscovery21598063-a7c5-420d-91ba-0cc9b2db0ea0
relation.isParentOrgUnitOfPublication8e756b23-2d4a-4ce8-b1b3-62c794a8c164
relation.isParentOrgUnitOfPublication434c9663-2b11-4e66-9399-c863e2ebae43
relation.isParentOrgUnitOfPublication.latestForDiscovery8e756b23-2d4a-4ce8-b1b3-62c794a8c164

Files

Collections

Publications without Fulltext