Transformer-Based Model for Named Entity Recognition in Hausa Language Texts

Named Entity Recognition (NER) is a fundamental problem in Natural Language Processing (NLP) that focuses on identifying and classifying textual entities such as people, places, organizations, dates, and numerical expressions. Although transformer-based architectures have greatly improved NER performance across major global languages, there has been little gain for low-resource African languages like Hausa. The lack of annotated corpora, language variety, orthographic irregularities, and limited computational resources continue to impede the development of strong Hausa NLP systems.

This paper presents a transformer-based framework for Named Entity Recognition in Hausa language texts that uses recent deep learning architectures for low-resource language processing. The proposed framework combines Hausa textual data collection, preprocessing, manual annotation, transformer fine-tuning, and model evaluation. Multiple transformer models, such as Multilingual Bidirectional Encoder Representations from Transformers (mBERT), XLM-RoBERTa, and AfriBERTa, are being investigated for their effectiveness in recognizing named entities in Hausa texts sourced from news articles, social media platforms, educational materials, and online repositories.

The study uses entity annotation schemas, standardized NLP preprocessing methods, and performance evaluation metrics like Precision, Recall, Accuracy, and F1-Score in a supervised learning approach. The study intends to provide a transformer-based entity recognition system, a reusable Hausa NER dataset, and empirical insights into deep learning applications for native African languages.

The findings demonstrated the feasibility of transformer architectures in improving Hausa language entity extraction and advancing the broader ecosystem of low-resource language technologies.

Named Entity Recognition, Hausa Language, Natural Language Processing, Transformers, Deep Learning, Low-Resource Languages, Machine Learning, Artificial Intelligence.

1. D. Jurafsky and J. H. Martin, Speech and Language Processing, 3rd ed. Stanford University, Draft, 2023. [Google Scholar] [Crossref]

2. N. Chinchor, “Overview of MUC-7,” in Proc. Message Understanding Conference (MUC-7), 1998. [Google Scholar] [Crossref]

3. A. McCallum and W. Li, “Early Results for Named Entity Recognition with [Google Scholar] [Crossref]

4. Conditional Random Fields,” in Proc. CoNLL, 2003. [Google Scholar] [Crossref]

5. A. Vaswani et al., “Attention Is All You Need,” in Advances in Neural Information Processing Systems (NeurIPS), 2017. [Google Scholar] [Crossref]

6. J. Devlin, M. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” in Proc. NAACL- HLT, 2019. [Google Scholar] [Crossref]

7. A. Conneau et al., “Unsupervised Cross-lingual Representation Learning at Scale,” in Proc. ACL, 2020. [Google Scholar] [Crossref]

8. Y. Liu et al., “RoBERTa: A Robustly Optimized BERT Pretraining Approach,” arXiv:1907.11692, 2019. [Google Scholar] [Crossref]

9. A. Conneau et al., “XLM-RoBERTa: Unsupervised Cross-lingual Pre-training at Scale,” arXiv:1911.02116, 2020. [Google Scholar] [Crossref]

10. A. Adelani et al., “MasakhaNER: Named Entity Recognition for African Languages,” Transactions of the Association for Computational Linguistics, vol. 9, pp. 1116–1131, 2021. https://doi.org/10.1162/tacl_a_00416 [Google Scholar] [Crossref]

11. J. O. Alabi et al., “Adapting Pretrained Language Models to African Languages via Multilingual Adaptive Fine-Tuning,” arXiv preprint arXiv:2204.06487, 2022. [Google Scholar] [Crossref]

12. T. Wolf et al., “Transformers: State-of-the-Art Natural Language Processing,” in Proc. EMNLP System Demonstrations, 2020. [Google Scholar] [Crossref]

13. S. Bird, E. Klein, and E. Loper, Natural Language Processing with Python, O’Reilly Media, 2009. [Google Scholar] [Crossref]

14. T. Mikolov et al., “Efficient Estimation of Word Representations in Vector Space,” arXiv:1301.3781, 2013. [Google Scholar] [Crossref]

15. Y. Bengio, A. Courville, and P. Vincent, “Representation Learning: A Review and New Perspectives,” IEEE TPAMI, vol. 35, no. 8, pp. 1798–1828, 2013. [Google Scholar] [Crossref]

16. M. Newman, The Hausa Language: An Encyclopedic Reference Grammar, Yale University Press, 2000. [Google Scholar] [Crossref]

17. D. I. Adelani et al., “MasakhaNER 2.0: Africa-centric Transfer Learning for [Google Scholar] [Crossref]

18. Named Entity Recognition,” arXiv:2210.12391, 2022. [Google Scholar] [Crossref]

19. I. Sutskever, O. Vinyals, and Q. V. Le, “Sequence to Sequence Learning with Neural Networks,” in NeurIPS, 2014. [Google Scholar] [Crossref]

20. A. Radford et al., “Language Models are Unsupervised Multitask Learners,” OpenAI Technical Report, 2019. [Google Scholar] [Crossref]

21. T. Kudo and J. Richardson, “SentencePiece: A Simple and Language Independent Subword Tokenizer,” in EMNLP, 2018. [Google Scholar] [Crossref]

22. A. Joulin et al., “FastText.zip: Compressing Text Classification Models,” arXiv:1612.03651, 2016. [Google Scholar] [Crossref]

• Block-Based Programming for Education: A Comprehensive Analysis of Visual Programming Environments in K-12 Learning
• Management of Academic Libraries and Client Satisfaction Towards Digital Utilization: Basis for Monitoring Library Operations in SOCCSKSARGEN Region.
• Revenue Leakages in TPA Insurance Claims and Corporate Claims: An Institutional Overview of Aster Prime Hospital, Hyderabad
• Technology and Innovation in Hospitality and Tourism: A Management Perspective
• Geospatial Distribution of Tarok Sacred Grove of Langtang North and Langtang South Local Government Areas