Enhancing Forensic Audio Transcription with Neural Network-Based Speaker Diarization and Gender Classification

Ullah, Rahmat, Asghar, Ikram, Malik, Hassan, Evans, Gareth, Ahmad, Jawad and Roberts, Dorothy Anne (2025) Enhancing Forensic Audio Transcription with Neural Network-Based Speaker Diarization and Gender Classification. In: International Conference on Engineering and Emerging Technologies (ICEET). International Conference on Engineering and Emerging Technologies, ICEET (2024). The Institute of Electrical and Electronics Engineers (IEEE), ARE.

Preview

PDF (Enhancing_Forensic_Audio_Transcription_with_Neural_Network-Based_Speaker_Diarization_and_Gender_Classification) - Accepted Version Download (548kB) | Preview

Abstract

Forensic audio transcription is often compromised by low-quality recordings, where indistinct speech can hinder the accuracy of conventional Automatic Speech Recognition (ASR) systems. This study addresses this limitation by developing a machine learning-based approach to improve speaker diarization, a process critical for distinguishing between speakers in sensitive audio data. Previous research highlights the inadequacy of traditional ASR in forensic settings, particularly where audio quality is poor and speaker overlap is common. This paper presents a neural network specifically designed for gender classification, using 20 key acoustic features extracted from real forensic audio data. The model architecture includes input, hidden, and output layers tailored to differentiate male and female voices, with dropout regularization to prevent overfitting and hyperparameter optimization ensuring robust generalization across test data. The neural network achieved an average recall of 86.81%, F1 score of 85.67%, precision of 87.95%, and accuracy of 86.83% across varied audio conditions. This model significantly improves transcription accuracy, reducing errors in legal contexts and supporting judicial processes with more reliable, interpretable evidence from sensitive audio data.

Item Type:	Book Section
Uncontrolled Keywords:	forensic linguistics,speech diarization,speech transcription,automatic speech recognition,ml,software,artificial intelligence,signal processing,engineering (miscellaneous),instrumentation,hardware and architecture,computer networks and communications,computer science applications ,/dk/atira/pure/subjectarea/asjc/1700/1712
Faculty \ School:	Faculty of Science > School of Computing Sciences
UEA Research Groups:	Faculty of Science > Research Groups > Cyber Intelligence and Networks Faculty of Science > Research Groups > Data Science and AI
Related URLs:	http://www.scopus.com/inward/record.url?...
Depositing User:	LivePure Connector
Date Deposited:	17 Jul 2025 16:30
Last Modified:	17 Jul 2025 16:30
URI:	https://ueaeprints.uea.ac.uk/id/eprint/99955
DOI:	10.1109/ICEET65156.2024.10913726

Downloads

Actions (login required)

View Item