MAviS: A Multimodal Conversational Assistant For Avian Species
Yevheniia Kryklyvets, Mohammed Irfan Kurpath, Sahal Shaji Mullappilly, Jinxing Zhou, Fahad Shahbaz Khan, Rao Muhammad Anwer, Salman Khan, Hisham Cholakkal
Abstract
Canada goose Q: What type of animal is depicted in the image? A: The animals in the image are Canada geese (Branta canadensis). Q: What is the purpose of the Canada goose's loud honking calls during migration? A: The loud honking calls help Canada goose maintain communication and coordination among flock members. Striated heron Q: Where is the natural habitat of this bird typically found? A: The striated heron is commonly found in wetland habitats, such as marshes. Q: What type of sound is heard in the audio clip? A: The audio clip features the song of a striated heron, which is usually a series of soft, croaky notes. Short-eared owl Q: During which times of day are short-eared owls most active? A: They are especially active during dawn and dusk, a behavior known as crepuscular hunting. Q: Whatis the likely purpose of the short-eared owl's call in this recording?. A: The calls in this audio likely serve to communicate with other owls, establish territory, or warn off potential intruders.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on10
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, Steven C. H. HoiICML 2023 · 7,873 citations
- BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationJunnan Li, Dongxu Li, Caiming Xiong, Steven C. H. HoiICML 2022 · 6,549 citations
- MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language ModelsDeyao Zhu, Jun Chen, Xiaoqian Shen, Xiang Li et al.ICLR 2024 · 3,079 citations
Related papers
- Bioacoustic Geolocation: Species Sounds as Geographic SignalsMustafa Chasmai, Wuao Liu, Subhransu Maji, Grant HornICML 2026 · 5 citations
- Adversarial Text to Continuous Image GenerationKilichbek Haydarov, Aashiq Muhamed, Xiaoqian Shen, Jovana Lazarevic et al.CVPR 2024
- Engaging with Nature Sounds & Citizen Science by Designing for Creative & Contextual Audio EncountersJessica L. Oliver, Selen Turkay, Margot Brereton, David M. Watson et al.CHI 2021 · 14 citations
- Democratizing Fine-grained Visual Recognition with Large Language ModelsMingxuan Liu, Subhankar Roy, Wenjing Li, Zhun Zhong et al.ICLR 2024 · 27 citations
- RealBirdID: Benchmarking Bird Species Identification in the Era of MLLMsLogan Lawrence, Oindrila Saha, Rangel Daroya, Mustafa Chasmai et al.CVPR 2026
