<link rel="stylesheet" href="styles.f3b1fba60ec7970c.css">

Publication:
HyperE2VID: improving event-based video reconstruction via hypernetworks

Loading...
Thumbnail Image

School / College / Institute

Item type:Organizational Unit,
Item type:Organizational Unit,

Program

KU-Authors

Organization Authors

Co-Authors

Ercan, Burak

Eker, Onur

Sağlam, Canberk

Erdem, Erkut

Date

Language

Embargo Status

Journal Title

Journal ISSN

Volume Title

Alternative Title

Abstract

Event-based cameras are becoming increasingly popular for their ability to capture high-speed motion with low latency and high dynamic range. However, generating videos from events remains challenging due to the highly sparse and varying nature of event data. To address this, in this study, we propose HyperE2VID, a dynamic neural network architecture for event-based video reconstruction. Our approach uses hypernetworks to generate per-pixel adaptive filters guided by a context fusion module that combines information from event voxel grids and previously reconstructed intensity images. We also employ a curriculum learning strategy to train the network more robustly. Our comprehensive experimental evaluations across various benchmark datasets reveal that HyperE2VID not only surpasses current state-of-the-art methods in terms of reconstruction quality but also achieves this with fewer parameters, reduced computational requirements, and accelerated inference times.

Source

Publisher

IEEE-Inst Electrical Electronics Engineers Inc

Citation

item.page.haspartof

Source

IEEE Transactions on Image Processing

item.page.ispartofseries

item.page.edition

DOI

10.1109/TIP.2024.3372460

item.page.datauri

item.page.link

Rights

 

Copyrights Note

Rights and licensing

 

Endorsement

Review

Supplemented By

Referenced By

Related Patent

Related Goal

Google Scholar
Scholar'da Ara ↗
Altmetric
Dimensions
PlumX Metrikleri
BIP! Indicators