Researcher:
Dikbayır, Doğa

Profile Picture
ORCID

Job Title

Master Student

First Name

Doğa

Last Name

Dikbayır

Name

Name Variants

Dikbayır, Doğa

Email Address

Birth Date

Filters

20181

Advanced Search

Filter by

Settings

Researcher Of Publications: search.filters.isAuthorOfPublication.5a28efeb-6886-4583-b6b6-e8dea93b2572

Search Results

Now showing 1 - 1 of 1
  • Placeholder
    PublicationMetadata only
    Fast multidimensional reduction and broadcast operations on GPU for machine learning
    (Wiley, 2018) N/A; N/A; N/A; Department of Computer Engineering; Department of Computer Engineering; Dikbayır, Doğa; Çoban, Enis Berk; Kesen, İlker; Yüret, Deniz; Erten, Didem Unat; Master Student; Master Student; PhD Student; Faculty Member; Faculty Member; Department of Computer Engineering; Graduate School of Sciences and Engineering; Graduate School of Sciences and Engineering; Graduate School of Sciences and Engineering; College of Engineering; College of Engineering; N/A; N/A; N/A; 179996; 219274
    Reduction and broadcast operations are commonly used in machine learning algorithms for different purposes. They widely appear in the calculation of the gradient values of a loss function, which are one of the core structures of neural networks. Both operations are implemented naively in many libraries usually for scalar reduction or broadcast; however, to our knowledge, there are no optimized multidimensional implementations available. This fact limits the performance of machine learning models requiring these operations to be performed on tensors. In this work, we address the problem and propose two new strategies that extend the existing implementations to perform on tensors. We introduce formal definitions of both operations using tensor notations, investigate their mathematical properties, and exploit these properties to provide an efficient solution for each. We implement our parallel strategies and test them on a CUDA enabled Tesla K40m GPU accelerator. Our performant implementations achieve up to 75% of the peak device memory bandwidth on different tensor sizes and dimensions. Significant speedups against the implementations available in the Knet Deep Learning framework are also achieved for both operations.