Almaarefa University
The authoritative source for research information and outputs is Elsevier Scopus, with researcher profile verification from the Deanship of Scientific Research.

المخرجات

Research outputs

Articles, reviews, conference papers and book chapters, indexed by DOI and linked to University researchers.

7 output Results for «Sign language»

ArticleOpen access20251citation· Semantic Scholar

Towards a Lightweight Arabic Sign Language Translation System

Sensors · vol. 25 (17) · 5504-5504

There is a pressing need to build a sign-to-text translation system to simplify communication between deaf and non-deaf people. This study investigates the building of a high-performance, lightweight sign language translation system suitable for real-time applications. Two Saudi Sign Language datasets are used for evaluation. We also investigate the effects of the number of signers and number of repetitions in sign language datasets. To this end, eight experiments are conducted in both signer-dependent and signer-independent modes. A comprehensive ablation study is presented to study the impacts of model components, network depth, and the size of the hidden dimension. The best accuracies achieved are 97.7% and 90.7% for the signer-dependent and signer-independent modes, respectively, using the KSU-SSL dataset. Similarly, the model achieves 98.38% and 96.22% for signer-dependent and signer-independent modes using the ArSL dataset.

Arabic Sign Languagesign language translationsign-to-text translationlightweight neural networks
ArticleOpen access2024

Translate Arabic Text to Arabic Gloss for Sign Language

— · vol. 9 (27)

Arabic Sign Language (ArSL) is a language used by the deaf community across Arab countries, but the lack of familiarity with ArSL among the hearing population often leads to social isolation for deaf individuals. The structural differences between ArSL and spoken Arabic pose significant challenges for machine translation. In this study, we enhance Arabic to ArSL gloss translation by employing data augmentation techniques, expanding the dataset from 600 to over 23,328 samples using sequence-to-sequence transformer models. Our approach achieved a substantial performance improvement, increasing the BLEU score from 11.1% in the baseline model to 52.72% on original test set. The best model achieved a BLEU score of 85.17% on augmented data test, underscoring the effectiveness of data augmentation in enhancing ArSL translation quality.

Arabic Sign Languagesign language translationdata augmentationsequence-to-sequence transformer
ArticleOpen (repository)202329citation· Semantic Scholar

Facilitating the communication with deaf people: Building a largest Saudi sign language dataset

Journal of King Saud University - Computer and Information Sciences · vol. 35 (8) · 101642-101642

Recently, several countries have been trying hard to facilitate the integration of disabled people into their societies by ensuring equal opportunities through ease of access to social services, daily human necessities, and the labor market. Deafness is considered one of the major disabilities separating the deaf from their society. To integrate the deaf fully into society, a two-way mode of communication is required: one from the deaf to the hearing people, and the other from the hearing to the deaf. Communication from the hearing person to the deaf is generally easy and can be done through speech recognition and text-to-sign representations, but communication from the deaf to the hearing is somewhat difficult and requires a sign recognition module that recognizes the sign motions from the deaf and translates it to a text; following this, a speech synthesis module will translate this text to speech. To build the sign recognition module, a sign language dataset is required. This paper contributes to the literature by introducing a comprehensive survey of 17 Arabic sign language datasets and by developing a well-organized framework that is used to build a sign language dataset. This paper also contributes to the literature by creating the largest Saudi Sign Language (SSL) database—the King Saud University Saudi-SSL (KSU-SSL data-base)—with 293 signs, 33 signers, 145035 samples, and 10 domains (healthcare, common, alpha-bets, verbs, pronouns and adverbs, numbers, days, kings, family, and regions). This paper also contributes to the literature by introducing a convolutional graph neural network (CGCN) architecture for sign language recognition and applying the proposed architecture to the built KSU-SSL database. The architecture is made up of a small number of separable 3DGCN layers, and is augmented with a spatial attention mechanism. This study is a part of the project that aims to develop a two-way communication system for Saudi deaf individuals.

sign language datasetsign language recognitiongraph convolutional networksspatial attention
ArticleOpen access202319citation· Semantic Scholar

Enabling Two-Way Communication of Deaf Using Saudi Sign Language

IEEE Access · vol. 11 · 135423-135434

Disabled people are facing many difficulties communicating with others and involving in society. Modern societies have dedicated significant efforts to promote the integration of disabled individuals into their societies and services. Currently, smart healthcare systems are used to facilitate disabled people. The objective of this paper is to enable two-way communication of deaf individuals with the rest of society, thus enabling their migration from marginal elements of society to mainstream contributing elements. In the proposed system, we developed three modules; the sign recognition module (SRM) that recognizes the signs of a deaf individual, the speech recognition and synthesis module (SRSM) that processes the speech of a non-deaf individual and converts it to text, and an Avatar module (AM) to generate and perform the corresponding sign of the non-deaf speech, which were integrated into the sign translation companion system called Saudi deaf companion system (SDCS) to facilitate the communication from the deaf to the hearing and vice versa. This paper also contributes to the literature by utilizing our self-developed database, the largest Saudi Sign Language (SSL) database—the King Saud University Saudi-SSL (KSU-SSL). The proposed SDCS system performs 293 Saudi signs that are recommended by the Saudi Association for Hearing Impairment (SAHI) from 10 domains (healthcare, common, alphabets, verbs, pronouns and adverbs, numbers, days, kings, family, and regions).

sign language recognitionspeech recognitionspeech synthesissign translation
ArticleOpen access202287citation

An Experimental Analysis of Various Machine Learning Algorithms for Hand Gesture Recognition

Electronics · vol. 11 (6) · 968-968

Nowadays, hand gestures have become a booming area for researchers to work on. In communication, hand gestures play an important role so that humans can communicate through this. So, for accurate communication, it is necessary to capture the real meaning behind any hand gesture so that an appropriate response can be sent back. The correct prediction of gestures is a priority for meaningful communication, which will also enhance human–computer interactions. So, there are several techniques, classifiers, and methods available to improve this gesture recognition. In this research, analysis was conducted on some of the most popular classification techniques such as Naïve Bayes, K-Nearest Neighbor (KNN), random forest, XGBoost, Support vector classifier (SVC), logistic regression, Stochastic Gradient Descent Classifier (SGDC), and Convolution Neural Networks (CNN). By performing an analysis and comparative study on classifiers for gesture recognition, we found that the sign language MNIST dataset and random forest outperform traditional machine-learning classifiers, such as SVC, SGDC, KNN, Naïve Bayes, XG Boost, and logistic regression, predicting more accurate results. Still, the best results were obtained by the CNN algorithm.

hand gesture recognitionsign language recognitionclassifier comparisonrandom forest
ArticleOpen access202211citation· Semantic Scholar

Communication Challenges While Dealing With a Deaf Patient in the Emergency Department and Suggested Solutions

Cureus · vol. 14 (11) · e31091-e31091

Background In the emergency department (ED), dealing with deaf patients presents unique difficulties and obstacles. There is insufficient time to arrange for an interpreter. While the voice of the deaf patient was the focus of earlier studies, in this study, we are interested in learning about ED physicians' difficulties and expertise. In addition, we aim to determine which approaches they suggest to address these issues. Methodology A cross-sectional analysis was conducted among 166 emergency physicians working in pediatric and adult departments. The data were collected from physicians working in different centers in Riyadh city from January 2022 to March 2022. The data analysis was performed using SPSS version 23 (IBM Corp., Armonk, NY, USA). Results In their department policy and procedures, 74.1% of participants claimed no policy or procedure for dealing with deaf patients. The majority of available communication methods were family interpreters (63.9%) and writing on paper (16.9%). Overall, 88% of respondents did not attend any training on dealing with deaf patients, despite the fact that 83.7% thought such training should be available. Furthermore, 90.4% of the participants did not know sign language. Concerning information about the Saudi Association for Hearing Impairment Services, 74.1% were unaware of such services. Concerning modern applications on smartphones, 97.6% were unaware of any existing communication app that could aid in communication with deaf patients. Conclusions In this study, we identified a significant deficiency in the knowledge and skills required to communicate with deaf patients. Hence, we recommend mandating education for physicians and requiring each institution to have an interpreter available 24 hours a day, either in person or via high-quality remote video.

deaf patientsemergency department communicationphysician-patient communicationsign language