论文解读
LadderSym: A Multimodal Interleaved Transformer for Music Practice Error Detection
音乐理解 | 8.0/10
多模态模型
论文解读
Learning multimodal dictionary decompositions with group-sparse autoencoders
跨模态 | 7.5/10
论文解读
LLM2Fx-Tools: Tool Calling for Music Post-Production
音乐信息检索 | 8.0/10
论文解读
MCIF: Multimodal Crosslingual Instruction-Following Benchmark from Scientific Talks
基准测试 | 8.0/10
论文解读
MIAM: Modality Imbalance-Aware Masking for Multimodal Ecological Applications
物种分布建模 | 7.5/10
论文解读
MindMix: A Multimodal Foundation Model for Auditory Perception Decoding via Deep Neural-Acoustic Alignment
音频检索 | 8.5/10
论文解读
MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interaction
语音对话系统 | 8.5/10
论文解读
NExT-OMNI: Towards Any-to-Any Omnimodal Foundation Models with Discrete Flow Matching
多模态模型 | 8.5/10
论文解读
Omni-Captioner: Data Pipeline, Models, and Benchmark for Omni Detailed Perception
音频场景理解 | 9.0/10
论文解读
Omni-Reward: Towards Generalist Omni-Modal Reward Modeling with Free-Form Preferences
多模态模型 | 8.5/10
论文解读
OmniCVR: A Benchmark for Omni-Composed Video Retrieval with Vision, Audio, and Text
音频检索 | 8.5/10
论文解读
OmniVideoBench: Towards Audio-Visual Understanding Evaluation for Omni MLLMs
基准测试 | 7.8/10
论文解读
OmniVinci: Enhancing Architecture and Data for Omni-Modal Understanding LLM
音频问答 | 8.0/10
论文解读
OptMerge: Unifying Multimodal LLM Capabilities and Modalities via Model Merging
多模态模型 | 8.0/10
论文解读
PrismAudio: Decomposed Chain-of-Thought and Multi-dimensional Rewards for Video-to-Audio Generation
音频生成 | 7.0/10
论文解读
Query-Guided Spatial–Temporal–Frequency Interaction for Music Audio–Visual Question Answering
音频问答 | 7.0/10
论文解读
Resp-Agent: An Agent-Based System for Multimodal Respiratory Sound Generation and Disease Diagnosis
音频分类 | 8.5/10
论文解读
RoboOmni: Proactive Robot Manipulation in Omni-modal Context
语音对话系统 | 8.5/10
论文解读
Scalable Multilingual Multimodal Machine Translation with Speech-Text Fusion
语音翻译 | 8.0/10
论文解读
Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memory
音频问答 | 8.0/10