Publication:
Learning to follow verbal instructions with visual grounding

Simple item page
dc.conference.dateAPR 24-26, 2019
dc.conference.locationSivas Cumhuriyet Univ, Sivas, TURKEY
dc.conference.organizer2019 27th Signal Processing and Communications Applications Conference (SIU)
dc.contributor.departmentDepartment of Computer Engineering
dc.contributor.facultymemberYes
dc.contributor.kuauthorCan, Ozan Arkan
dc.contributor.kuauthorÜnal, Emre
dc.contributor.kuauthorYemez, Yücel
dc.contributor.schoolcollegeinstituteCollege of Engineering
dc.date.accessioned2024-11-09T23:59:20Z
dc.date.issued2019
dc.description.abstractWe present a visually grounded deep learning model towards a virtual robot that can follow navigational instructions. Our model is capable of processing raw visual input and natural text instructions. The aim is to develop a model that can learn to follow novel instructions from instruction-perception examples. The proposed model is trained on data collected in a synthetic environment and its architecture allows it to work also with real visual data. We show that our results are on par with the previously proposed methods.
dc.description.fulltextNo
dc.description.harvestedfromManual
dc.description.indexedbyWOS
dc.description.indexedbyScopus
dc.description.openaccessYES
dc.description.peerreviewstatusN/A
dc.description.publisherscopeInternational
dc.description.readpublishN/A
dc.description.sponsoredbyTubitakEuTÜBİTAK
dc.description.sponsorshipBu çalışma TÜBİTAK tarafından 114E628 nolu proje kapsamında desteklenmiştir.
dc.description.studentonlypublicationNo
dc.description.studentpublicationYes
dc.description.versionN/A
dc.identifier.WoSQuartileN/A
dc.identifier.doi10.1109/SIU.2019.8806335
dc.identifier.embargoN/A
dc.identifier.grantno14E628
dc.identifier.isbn9781728119045
dc.identifier.scopus2-s2.0-85071986881
dc.identifier.urihttps://doi.org/10.1109/SIU.2019.8806335
dc.identifier.urihttps://hdl.handle.net/20.500.14288/15624
dc.identifier.wos000518994300061
dc.keywordsAutonomous agents
dc.keywordsComputer vision
dc.keywordsNatural language processing
dc.keywordsNavigational instruction following
dc.language.isotur
dc.publisherInstitute of Electrical and Electronics Engineers
dc.relation.affiliationKoç University
dc.relation.collectionKoç University Institutional Repository
dc.relation.ispartofSignal Processing and Communications Applications Conference
dc.relation.openaccessN/A
dc.rightsN/A
dc.subjectCivil engineering
dc.subjectElectrical electronics engineering
dc.subjectTelecommunication
dc.titleLearning to follow verbal instructions with visual grounding
dc.title.alternativeSözel komutların takibinin görsel temelli öǧrenilmesi
dc.typeConference Proceeding
dspace.entity.typePublication
local.contributor.kuauthorÜnal, Emre
local.contributor.kuauthorCan, Ozan Arkan
local.contributor.kuauthorYemez, Yücel
relation.isOrgUnitOfPublication89352e43-bf09-4ef4-82f6-6f9d0174ebae
relation.isOrgUnitOfPublication.latestForDiscovery89352e43-bf09-4ef4-82f6-6f9d0174ebae
relation.isParentOrgUnitOfPublication8e756b23-2d4a-4ce8-b1b3-62c794a8c164
relation.isParentOrgUnitOfPublication.latestForDiscovery8e756b23-2d4a-4ce8-b1b3-62c794a8c164

Files

Collections

Publications without Fulltext