๐Ÿ‡ฒ๐Ÿ‡ฑ

Bambara ASR Leaderboard

Powered by MALIBA-AI โ€ข "No Malian Language Left Behind"

๐ŸŽ™๏ธ
2
Models Evaluated
19.22%
Best Combined Score
27.64%
Average WER
10.94%
Average CER

๐Ÿ† Current Champion: MALIBA-AI/bambara-whisper-small

Main Leaderboard

๐Ÿ”„ Ranking Method

Choose how to rank the models

๐Ÿ“‹ Leaderboard Rankings - Lower scores indicate better performance

๐Ÿ“‹ Leaderboard Rankings - Lower scores indicate better performance
1
bambara-whisper-small
22.64
10.94
๐Ÿฅ‰ Good
Whisper-based
2025-03-15

๐Ÿ“Š Visual Performance Comparison

๐ŸŽฏ Automatic Speech Recognition Evaluation Metrics

Word Error Rate (WER)

WER measures transcription accuracy at the word level:

  • Formula: (Substitutions + Insertions + Deletions) / Total Reference Words
  • Range: 0% (perfect) to 100%+ (very poor)
  • Interpretation:
    • 0-5%: ๐Ÿ† Excellent performance
    • 5-15%: ๐Ÿฅ‰ Good performance
    • 15-30%: ๐Ÿ“ˆ Fair performance
    • 30%+: Poor performance

Character Error Rate (CER)

CER measures transcription accuracy at the character level:

  • Advantage: More granular than WER, captures partial matches
  • Benefit for Bambara: Particularly valuable for agglutinative languages
  • Typical Range: Usually lower than WER values

Combined Score (Primary Ranking Metric)

Formula: Combined Score = 0.7 ร— WER + 0.3 ร— CER

  • Rationale: Balanced evaluation emphasizing word-level accuracy
  • Usage: Primary metric for model ranking

๐ŸŽฏ Performance Categories

  • ๐Ÿ† Excellent: < 15% Combined Score
  • ๐Ÿฅ‰ Good: 15-30% Combined Score
  • ๐Ÿ“ˆ Fair: > 30% Combined Score

๐Ÿ“š Citation

If you use the Bambara ASR Leaderboard for your scientific publication, or if you find the resources useful, please cite our work:

@misc{bambara_asr_leaderboard_2025,
  title={Bambara Speech Recognition Leaderboard},
  author={MALIBA-AI Team},
  year={2025},
  url={https://huggingface.co/spaces/MALIBA-AI/bambara-asr-leaderboard},
  note={A community initiative for advancing Bambara speech recognition technology}
}
            

About MALIBA-AI

MALIBA-AI: Empowering Mali's Future Through Community-Driven AI Innovation
"No Malian Language Left Behind"

This leaderboard is maintained by the MALIBA-AI initiative to track progress in Bambara speech recognition technology. For more information, visit MALIBA-AI or our Hugging Face page.

๐Ÿ‡ฒ๐Ÿ‡ฑ โ€ข ๐Ÿค โ€ข ๐Ÿš€