Powered by OpenAIRE graph
Found an issue? Give us feedback
ZENODOarrow_drop_down
ZENODO
Dataset . 2025
License: CC BY
Data sources: Datacite
ZENODO
Dataset . 2024
License: CC BY
Data sources: Datacite
ZENODO
Dataset . 2025
License: CC BY
Data sources: Datacite
versions View all 3 versions
addClaim

CLAP features for Audio Moment Retrieval

Authors: Munakata, Hokuto; Nishimura, Taichi; Nakada, Shota; Komatsu, Tatsuya;

CLAP features for Audio Moment Retrieval

Abstract

This page includes CLAP features of three datasets used in Language-based audio moment retrieval [1]. Clotho-Moment UnAV100-subset TUT Sound Events 2017 Raw wav files are also publicly available here. [1] H. Munakata, T. Nishimura, S. Nakada, T. Komatsu, "Language-based Audio Moment Retrieval", In Proc. ICASSP, 2024. How to Use We can train/evaluate audio moment retrieval models using these features in Lighthouse.Please check the instructions of Lighthouse. Unzip the file with the following commandsClotho-moment: for file in clotho-moment_features.tar.part-*.gz; do gunzip "$file"; done clotho-moment_features.tar.part-* > clotho-moment_features.tar tar -xvf clotho-moment_features.tar UnAV100-subset, TUT Sound Events 2017: tar -xvf tut2017_features.tar.gz tar -xvf unav100-subset_features.tar.gz Set symbolic links in Lighthouseln -s features/{dataset_name} {lighthouse_dir}/features Train the modelpython training/train.py --model qd_detr --dataset clotho-moment --feature clap Evaluate the model model=qd_detr dataset=unav100-subset feature=clap model_path={lighthouse_dir}/results/qd_detr/clotho-moment/clap/best.ckpt eval_split_name=val eval_path=data/unav100-subset/unav100-subset_test_release.jsonl python training/evaluate.py \ --model $model \ --dataset $dataset \ --feature $feature \ --model_path $model_path \ --eval_split_name $eval_split_name \ --eval_path $eval_path

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average