Research Outputs

Permanent URI for this communityhttps://hdl.handle.net/20.500.14288/2

Browse

Search Results

Now showing 1 - 2 of 2
  • Thumbnail Image
    PublicationOpen Access
    A task set proposal for automatic protest information collection across multiple countries
    (Springer, 2019) Department of Sociology; Department of Computer Engineering; Hürriyetoğlu, Ali; Yörük, Erdem; Yoltar, Çağrı; Yüret, Deniz; Gürel, Burak; Duruşan, Fırat; Mutlu, Osman; Teaching Faculty; Faculty Member; Researcher; Faculty Member; Faculty Member; Researcher; Department of Sociology; Department of Computer Engineering; Graduate School of Social Sciences and Humanities; Graduate School of Sciences and Engineering; N/A; 28982; N/A; 179996; 219277; N/A; N/A
    We propose a coherent set of tasks for protest information collection in the context of generalizable natural language processing. The tasks are news article classification, event sentence detection, and event extraction. Having tools for collecting event information from data produced in multiple countries enables comparative sociology and politics studies. We have annotated news articles in English from a source and a target country in order to be able to measure the performance of the tools developed using data from one country on data from a different country. Our preliminary experiments have shown that the performance of the tools developed using English texts from India drops to a level that are not usable when they are applied on English texts from China. We think our setting addresses the challenge of building generalizable NLP tools that perform well independent of the source of the text and will accelerate progress in line of developing generalizable NLP systems.
  • Thumbnail Image
    PublicationOpen Access
    Overview of CLEF 2019 lab protestnews: extracting protests from news in a cross-context setting
    (Springer, 2019) Department of Sociology; Department of Computer Engineering; Hürriyetoğlu, Ali; Yörük, Erdem; Yüret, Deniz; Yoltar, Çağrı; Gürel, Burak; Mutlu, Osman; Akdemir, Arda; Teaching Faculty; Faculty Member; Faculty Member; Researcher; Faculty Member; Researcher; Department of Sociology; Department of Computer Engineering; Graduate School of Social Sciences and Humanities; Graduate School of Sciences and Engineering; N/A; 28982; 179996; N/A; 219277; N/A; N/A
    We present an overview of the CLEF-2019 Lab ProtestNews on Extracting Protests from News in the context of generalizable natural language processing. The lab consists of document, sentence, and token level information classification and extraction tasks that were referred as task 1, task 2, and task 3 respectively in the scope of this lab. The tasks required the participants to identify protest relevant information from English local news at one or more aforementioned levels in a cross-context setting, which is cross-country in the scope of this lab. The training and development data were collected from India and test data was collected from India and China. The lab attracted 58 teams to participate in the lab. 12 and 9 of these teams submitted results and working notes respectively. We have observed neural networks yield the best results and the performance drops significantly for majority of the submissions in the cross-country setting, which is China.