Skip to main navigation Skip to search Skip to main content

Aging Contrast: A Contrastive Learning Framework for Fish Re-identification Across Seasons and Years

  • Weili Shi
  • , Zhongliang Zhou
  • , Benjamin H. Letcher
  • , Nathaniel Hitt
  • , Yoichiro Kanno
  • , Ryo Futamura
  • , Osamu Kishida
  • , Kentaro Morita
  • , Sheng Li
  • University of Virginia
  • University of Georgia
  • United States Geological Survey
  • Hokkaido University
  • The University of Tokyo

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Scopus citations

Abstract

The fields of biology, ecology, and fisheries management are witnessing a growing demand for distinguishing individual fish. In recent years, deep learning methods have emerged as a promising tool for image-based fish recognition. Our study is focused on the re-identification of masu salmon from Japan, wherein fish were individually marked and photographed to evaluate discriminative body characteristics. Unlike previous studies where fish were sampled during the same time period, we evaluated individual re-identification across seasons and years to address challenges due to aging, seasonal variation, and other factors. In this paper, we propose a new contrastive learning framework called Aging Contrast (AgCo) and evaluate its performance on the masu salmon dataset. Our analysis indicates that, unlike large changes in body size over time, the pattern of parr marks on the lateral line of the fish body remains relatively stable, despite some change in coloration across seasons. AgCo accounts for such seasonally-invariant features and performs re-identification based on the cosine similarity of these features. Extensive experiments show that our AgCo method outperforms other state-of-the-art methods.

Original languageEnglish
Title of host publicationAI 2023
Subtitle of host publicationAdvances in Artificial Intelligence - 36th Australasian Joint Conference on Artificial Intelligence, AI 2023, Proceedings
EditorsTongliang Liu, Geoff Webb, Lin Yue, Dadong Wang
PublisherSpringer Science and Business Media Deutschland GmbH
Pages252-264
Number of pages13
ISBN (Print)9789819983872
DOIs
StatePublished - 2024
Event36th Australasian Joint Conference on Artificial Intelligence, AJCAI 2023 - Brisbane, Australia
Duration: Nov 28 2023Dec 1 2023

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14471 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference36th Australasian Joint Conference on Artificial Intelligence, AJCAI 2023
Country/TerritoryAustralia
CityBrisbane
Period11/28/2312/1/23

Keywords

  • Contrastive Learning
  • Fish Re-identification
  • Seasonally-invariant Features

Fingerprint

Dive into the research topics of 'Aging Contrast: A Contrastive Learning Framework for Fish Re-identification Across Seasons and Years'. Together they form a unique fingerprint.

Cite this