جامعة المعرفة
المصدر المعتمد للمعلومات البحثية والمخرجات هو قاعدة بيانات سكوبس (Elsevier Scopus) مع تدقيق بيانات الباحثين من عمادة البحث العلمي.

Research outputs

المخرجات البحثية

مقالات ومراجعات وأوراق مؤتمرات وفصول كتب، مفهرسة برقم DOI ومربوطة بباحثي الجامعة.

3 مُخرَج نتائج البحث عن «multi-head self-attention»

مقالوصول مفتوح202454استشهاد· Semantic Scholar

Efficient identification and classification of apple leaf diseases using lightweight vision transformer (ViT)

Discover Sustainability · مجلد 5 (1)

Abstract The timely diagnosis and identification of apple leaf diseases is essential to prevent the spread of diseases and ensure the sound development of the apple industry. Convolutional neural networks (CNNs) have achieved phenomenal success in the area of leaf disease detection, which can greatly benefit the agriculture industry. However, their large size and intricate design continue to pose a challenge when it comes to deploying these models on lightweight devices. Although several successful models (e.g., EfficientNets and MobileNets) have been designed to adapt to resource-constrained devices, these models have not been able to achieve significant results in leaf disease detection tasks and leave a performance gap behind. This research gap has motivated us to develop an apple leaf disease detection model that can not only be deployed on lightweight devices but also outperform existing models. In this work, we propose AppViT, a hybrid vision model, combining the features of convolution blocks and multi-head self-attention, to compete with the best-performing models. Specifically, we begin by introducing the convolution blocks that narrow down the size of the feature maps and help the model encode local features progressively. Then, we stack ViT blocks in combination with convolution blocks, allowing the network to capture non-local dependencies and spatial patterns. Embodied with these designs and a hierarchical structure, AppViT demonstrates excellent performance in apple leaf disease detection tasks. Specifically, it achieves 96.38% precision on Plant Pathology 2021—FGVC8 with about 1.3 million parameters, which is 11.3% and 4.3% more accurate than ResNet-50 and EfficientNet-B3. The precision, recall and F score of our proposed model on Plant Pathology 2021—FGVC8 are 0.967, 0.959, and 0.963 respectively.

apple leaf disease detectionlightweight vision transformerplant disease classificationmulti-head self-attention
ورقة مؤتمروصول مغلق20244استشهاد· Semantic Scholar

Deep Learning-Based Intrusion Detection Model for Internet of Things Environment

IEEE International Conference on Innovations in High Speed Communication and Signal Processing (IHCSP) · 1-8

The proposed IoT intrusion detection model uses machine learning to compensate for data loss in convolutional neural networks' initial pooling layer and the gradient vanishing problem that recurrent neural networks face when processing long sequential input. Time series data for intrusion detection models is optimized using Gramme matrix field visualization. To reduce data loss, the SoftPool pooling layer replaced the original. The recurrent neural network uses a bidirectional gated recurrent unit with fewer parameters and a multi-head structure modeled after the self-attention mechanism. Baseline data will be TON-IoT data. The number of heads multi-head bidirectional gated recurrent unit, pooling layer topologies, and visualization approaches are experimental parameters. The simulation results show that a three-head structure, SoftPool for layer pooling, and for accuracy, precision, detection rate, F1 score, and false positive rate, multi-class classification works well with field and Gramme matrix visualization. The suggested model outperforms state-of-the-art models in accuracy, detection rate, F1 score, and false positive rate by 0.14, 0.09, 0.13, and 0.08. Modern machine learning improves IoT intrusion detection.

IoT intrusion detectionInternet of Things securitybidirectional gated recurrent unitmulti-head self-attention