Reproducibility Companion Paper: MeTILDA - Platform for Melodic Transcription in Language Documentation and Application

Mitchell Lee; Chris Lee; Sanjay Penmetsa; Min Chen; Mizuki Miyashita; Naatosi Fish; Bo Wu; Omar Khan

doi:10.1145/3591106.3592277

Reproducibility Companion Paper: MeTILDA - Platform for Melodic Transcription in Language Documentation and Application

Mitchell Lee
, Chris Lee
, Sanjay Penmetsa
, Min Chen
, Mizuki Miyashita
, Naatosi Fish
, Bo Wu
, Omar Khan

Anthropology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

This companion paper supports the replication of the development and evaluation of "MeTILDA - Platform for Melodic Transcription in Language Documentation and Application"that we presented in the ICMR 2021. MeTILDA aims to help document and analyze pitch patterns of endangered languages including Blackfoot, whose prosodic system is characterized by pitch movements. It develops a new form of audio analysis (termed MeT scale which is a perceptual scale) and automates the process of creating visual aids (Pitch Art) to provide more effective visuals of perceived changes in pitch movement. In this paper, we explain the file structure of the source code and publish the details of our data as well as system operations. Moreover, we provide a link to the demo video for facilitating the use of our platform.

Original language	English
Title of host publication	ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval
Publisher	Association for Computing Machinery, Inc
Pages	640-643
Number of pages	4
ISBN (Electronic)	9798400701788
DOIs	https://doi.org/10.1145/3591106.3592277
State	Published - Jun 12 2023
Event	2023 ACM International Conference on Multimedia Retrieval, ICMR 2023 - Thessaloniki, Greece Duration: Jun 12 2023 → Jun 15 2023

Publication series

Name	ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval

Conference

Conference	2023 ACM International Conference on Multimedia Retrieval, ICMR 2023
Country/Territory	Greece
City	Thessaloniki
Period	06/12/23 → 06/15/23

Funding

This work is supported by National Science Foundation (NSF BCS-2109654). We also appreciate the late Mr. Earl Old Person for his audio recording as a native speaker and learner of the Blackfoot language.

Funder number
BCS-2109654

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 3 Good Health and Well-being

Keywords

Endangered language
MeTILDA
Perceptual scale
Pitch Art

Access to Document

10.1145/3591106.3592277

Cite this

Lee, M., Lee, C., Penmetsa, S., Chen, M., Miyashita, M., Fish, N., Wu, B., & Khan, O. (2023). Reproducibility Companion Paper: MeTILDA - Platform for Melodic Transcription in Language Documentation and Application. In ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval (pp. 640-643). (ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval). Association for Computing Machinery, Inc. https://doi.org/10.1145/3591106.3592277

Lee, Mitchell ; Lee, Chris ; Penmetsa, Sanjay et al. / Reproducibility Companion Paper : MeTILDA - Platform for Melodic Transcription in Language Documentation and Application. ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval. Association for Computing Machinery, Inc, 2023. pp. 640-643 (ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval).

@inproceedings{39793801c17f431789b56b7d32aea5b7,

title = "Reproducibility Companion Paper: MeTILDA - Platform for Melodic Transcription in Language Documentation and Application",

abstract = "This companion paper supports the replication of the development and evaluation of {"}MeTILDA - Platform for Melodic Transcription in Language Documentation and Application{"}that we presented in the ICMR 2021. MeTILDA aims to help document and analyze pitch patterns of endangered languages including Blackfoot, whose prosodic system is characterized by pitch movements. It develops a new form of audio analysis (termed MeT scale which is a perceptual scale) and automates the process of creating visual aids (Pitch Art) to provide more effective visuals of perceived changes in pitch movement. In this paper, we explain the file structure of the source code and publish the details of our data as well as system operations. Moreover, we provide a link to the demo video for facilitating the use of our platform.",

keywords = "Endangered language, MeTILDA, Perceptual scale, Pitch Art",

author = "Mitchell Lee and Chris Lee and Sanjay Penmetsa and Min Chen and Mizuki Miyashita and Naatosi Fish and Bo Wu and Omar Khan",

note = "Publisher Copyright: {\textcopyright} 2023 Owner/Author.; 2023 ACM International Conference on Multimedia Retrieval, ICMR 2023 ; Conference date: 12-06-2023 Through 15-06-2023",

year = "2023",

month = jun,

day = "12",

doi = "10.1145/3591106.3592277",

language = "English",

series = "ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval",

publisher = "Association for Computing Machinery, Inc",

pages = "640--643",

booktitle = "ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval",

}

Lee, M, Lee, C, Penmetsa, S, Chen, M, Miyashita, M, Fish, N, Wu, B & Khan, O 2023, Reproducibility Companion Paper: MeTILDA - Platform for Melodic Transcription in Language Documentation and Application. in ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval. ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval, Association for Computing Machinery, Inc, pp. 640-643, 2023 ACM International Conference on Multimedia Retrieval, ICMR 2023, Thessaloniki, Greece, 06/12/23. https://doi.org/10.1145/3591106.3592277

Reproducibility Companion Paper: MeTILDA - Platform for Melodic Transcription in Language Documentation and Application. / Lee, Mitchell; Lee, Chris; Penmetsa, Sanjay et al.
ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval. Association for Computing Machinery, Inc, 2023. p. 640-643 (ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Reproducibility Companion Paper

T2 - 2023 ACM International Conference on Multimedia Retrieval, ICMR 2023

AU - Lee, Mitchell

AU - Lee, Chris

AU - Penmetsa, Sanjay

AU - Chen, Min

AU - Miyashita, Mizuki

AU - Fish, Naatosi

AU - Wu, Bo

AU - Khan, Omar

PY - 2023/6/12

Y1 - 2023/6/12

N2 - This companion paper supports the replication of the development and evaluation of "MeTILDA - Platform for Melodic Transcription in Language Documentation and Application"that we presented in the ICMR 2021. MeTILDA aims to help document and analyze pitch patterns of endangered languages including Blackfoot, whose prosodic system is characterized by pitch movements. It develops a new form of audio analysis (termed MeT scale which is a perceptual scale) and automates the process of creating visual aids (Pitch Art) to provide more effective visuals of perceived changes in pitch movement. In this paper, we explain the file structure of the source code and publish the details of our data as well as system operations. Moreover, we provide a link to the demo video for facilitating the use of our platform.

AB - This companion paper supports the replication of the development and evaluation of "MeTILDA - Platform for Melodic Transcription in Language Documentation and Application"that we presented in the ICMR 2021. MeTILDA aims to help document and analyze pitch patterns of endangered languages including Blackfoot, whose prosodic system is characterized by pitch movements. It develops a new form of audio analysis (termed MeT scale which is a perceptual scale) and automates the process of creating visual aids (Pitch Art) to provide more effective visuals of perceived changes in pitch movement. In this paper, we explain the file structure of the source code and publish the details of our data as well as system operations. Moreover, we provide a link to the demo video for facilitating the use of our platform.

KW - Endangered language

KW - MeTILDA

KW - Perceptual scale

KW - Pitch Art

UR - https://www.scopus.com/pages/publications/85163571950

U2 - 10.1145/3591106.3592277

DO - 10.1145/3591106.3592277

M3 - Conference contribution

AN - SCOPUS:85163571950

T3 - ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval

SP - 640

EP - 643

BT - ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval

PB - Association for Computing Machinery, Inc

Y2 - 12 June 2023 through 15 June 2023

ER -

Lee M, Lee C, Penmetsa S, Chen M, Miyashita M, Fish N et al. Reproducibility Companion Paper: MeTILDA - Platform for Melodic Transcription in Language Documentation and Application. In ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval. Association for Computing Machinery, Inc. 2023. p. 640-643. (ICMR 2023 - Proceedings of the 2023 ACM International Conference on Multimedia Retrieval). doi: 10.1145/3591106.3592277

Reproducibility Companion Paper: MeTILDA - Platform for Melodic Transcription in Language Documentation and Application

Abstract

Publication series

Conference

Funding

UN SDGs

Keywords

Access to Document

Other files and links

Fingerprint

Cite this