GroupMamba: Efficient Group-Based Visual State Space Model

State-space models (SSMs) have recently shown promise in capturing long-range dependencies with subquadratic computational complexity, making them attractive for various applications. However, purely SSM-based models face critical challenges related to stability and...

Dataset pruning for targeted knowledge distillation

In this technical report, we describe our submission for Task 1 Data-Efficient Low-Complexity Acoustic Scene Classification [1]. We adopt the baseline model and add a specialised knowledge distillation process before proceeding with the baseline training process. Our...