Automatic Main Character Recognition for Photographic Studies

Mert Seker, Anssi Männistö, Alexandros Iosifidis, Jenni Raitoharju

    Publikation: Bidrag til bog/antologi/rapport/proceedingKonferencebidrag i proceedingsForskningpeer review

    2 Citationer (Scopus)

    Abstract

    Main characters in images are the most important humans that catch the viewer's attention upon first look, and they are emphasized by properties such as size, position, color saturation, and sharpness of focus. Identifying the main character in images plays an important role in traditional photographic studies and media analysis, but the task is performed manually and is, thus, slow and laborious. Furthermore, selection of main characters can be sometimes subjective. In this paper, we analyze the feasibility of solving the main character recognition needed for photographic studies automatically and propose a method for identifying the main characters. The proposed method uses machine learning based human pose estimation along with traditional computer vision approaches for this task. We approach the task as a binary classification problem where each detected human is classified either as a main character or not. To evaluate both the subjectivity of the task and the performance of our method, we collected a dataset of 300 varying images from multiple sources and asked five people, a photographic researcher and four other persons, to annotate the main characters. Our analysis showed a relatively high agreement between different annotators. The proposed method achieved a promising F1 score of 0.83 on the full image set and 0.96 on a subset evaluated as most clear and important cases by the photographic researcher.

    OriginalsprogEngelsk
    TitelIEEE 23rd International Workshop on Multimedia Signal Processing, MMSP 2021
    Antal sider6
    ForlagIEEE
    Publikationsdatojun. 2021
    ISBN (Trykt)978-1-6654-3289-4
    ISBN (Elektronisk)978-1-6654-3288-7
    DOI
    StatusUdgivet - jun. 2021
    BegivenhedIEEE International Workshop on Multimedia Signal Processing 2021 - Scandic Rosendahl, Tampere, Finland
    Varighed: 6 okt. 20218 okt. 2021
    https://signalprocessingsociety.org/blog/mmsp-2021-2021-ieee-international-workshop-multimedia-signal-processing

    Konference

    KonferenceIEEE International Workshop on Multimedia Signal Processing 2021
    LokationScandic Rosendahl
    Land/OmrådeFinland
    ByTampere
    Periode06/10/202108/10/2021
    Internetadresse

    Fingeraftryk

    Dyk ned i forskningsemnerne om 'Automatic Main Character Recognition for Photographic Studies'. Sammen danner de et unikt fingeraftryk.

    Citationsformater