BIBLIOS

  Ciências References Management System

Visitor Mode (Login)
Need help?


Back

Publication details

Document type
Journal articles

Document subtype
Full paper

Title
ExpertosLF: dynamic late fusion of CBIR systems using online learning with relevance feedback

Participants in the publication
Soraia M. Alarcão (Author)
LASIGE - LASIGE Computer Science and Engineering Research Centre
Vânia Mendonça (Author)
Carolina Maruta (Author)
Manuel J. Fonseca (Author)
LASIGE - LASIGE Computer Science and Engineering Research Centre

Scope
International

Refereeing
Yes

Summary
One of the main challenges in CBIR systems is to choose discriminative and compact features, among dozens, to represent the images under comparison. Over the years, a great effort has been made to combine multiple features, mainly using early, late, and hierarchical fusion techniques. Unveiling the perfect combination of features is highly domain-specific and dependent on the type of image. Thus, the process of designing a CBIR system for new\ndatasets or domains involves a huge experimentation overhead, leading to multiple fine tuned CBIR systems. It would be desirable to dynamically find the best combination of CBIR systems without needing to go through such extensive experimentation and without requiring previous domain knowledge. In this paper, we propose ExpertosLF, a model agnostic interpretable late fusion technique based on online learning with expert advice, which dynamically combines CBIR systems without knowing a priori which ones are the best for a given domain. At each query, ExpertosLF takes advantage of user’s feedback to determine each CBIR contribution in the ensemble for the following queries. ExpertosLF\nproduces an interpretable ensemble that is independent of the dataset and domain. Moreover, ExpertosLF is designed to be modular, and scalable. Experiments on 13 benchmark datasets from the Biomedical, Real, and Sketch domains revealed that: (i) ExpertosLF surpasses the performance of state of the art late-fusion techniques; (ii) it successfully and quickly converges to the performance of the best CBIR sets across domains without any previous domain knowledge (in most cases, fewer than 25 queries need to receive human feedback).

Date of Publication
2022-08-20

Institution
FACULDADE DE CIÊNCIAS DA UNIVERSIDADE DE LISBOA

Where published
Multimedia Tools and Applications

Publication Identifiers
ISSN - 1380-7501

Publisher
Springer Science and Business Media LLC

Document Identifiers
DOI - https://doi.org/10.1007/s11042-022-13119-0
URL - http://dx.doi.org/10.1007/s11042-022-13119-0

Rankings
Google Metrics Q1 (2022) - 87 - Multimedia

Keywords
Content-based image retrieval Late fusion Prediction with expert advice Online Learning Relevance feedback


Export

APA
Soraia M. Alarcão, Vânia Mendonça, Carolina Maruta, Manuel J. Fonseca, (2022). ExpertosLF: dynamic late fusion of CBIR systems using online learning with relevance feedback. Multimedia Tools and Applications, ISSN 1380-7501. eISSN . http://dx.doi.org/10.1007/s11042-022-13119-0

IEEE
Soraia M. Alarcão, Vânia Mendonça, Carolina Maruta, Manuel J. Fonseca, "ExpertosLF: dynamic late fusion of CBIR systems using online learning with relevance feedback" in Multimedia Tools and Applications, 2022. 10.1007/s11042-022-13119-0

BIBTEX
@article{55798, author = {Soraia M. Alarcão and Vânia Mendonça and Carolina Maruta and Manuel J. Fonseca}, title = {ExpertosLF: dynamic late fusion of CBIR systems using online learning with relevance feedback}, journal = {Multimedia Tools and Applications}, year = 2022, }