جامعة المعرفة
المصدر المعتمد للمعلومات البحثية والمخرجات هو قاعدة بيانات سكوبس (Elsevier Scopus) مع تدقيق بيانات الباحثين من عمادة البحث العلمي.

Research outputs

المخرجات البحثية

مقالات ومراجعات وأوراق مؤتمرات وفصول كتب، مفهرسة برقم DOI ومربوطة بباحثي الجامعة.

9 مُخرَج نتائج البحث عن «Reinforcement learning»

مقالوصول مغلق202512استشهاد· Semantic Scholar

Consumer Technology in Task Offloading and Edge Resource Allocation: AIoT and Edge Computing for Next-Generation Communication

IEEE Transactions on Consumer Electronics · مجلد 71 (2) · 5356-5365

Artificial Intelligence of Things (AIoT) edge computing has emerged as a critical enabler for consumer technology, easing the load on distribution grid networks through enhanced data transmission and processing capabilities. The Internet of Things (IoT), a modern network paradigm, connects devices using sensors and communication mediums to enable seamless information exchange. However, the limited computational capacity of edge nodes poses challenges in optimizing AIoT edge resources compared to cloud computing. To address this, a cloud-edge three-layer framework for task offloading and edge resource allocation is proposed in the context of consumer technology and distribution grids. This model incorporates random tasks, limited resources, unequal processing power, and high latency requirements. It features two key phases: a resource auction using a multi-round iterative process and compute offloading managed by a Deep Reinforcement Learning (DRL) approach. Enhanced algorithms such as Double DQN and Dueling DQN are integrated into the job offloading process to improve performance. Simulations validate the convergence of the task offloading algorithm and demonstrate that the proposed methods significantly enhance computational efficiency and resource utilization for edge nodes. These advancements offer promising solutions for the dynamic needs of consumer technology and future communication networks.

task offloadingedge resource allocationAIoTedge computing
مقالوصول مغلق20257استشهاد· Semantic Scholar

Reinforcement Learning for Dynamic Optimization of Lane Change Intention Recognition for Transportation Networks

IEEE Transactions on Intelligent Transportation Systems · مجلد 27 (2) · 2695-2705

Advance driver assistance systems (ADAS) swiftly and effectively detect oncoming cars’ lanes-changing intentions in intelligent transportation, supporting decision support and safety. Current techniques fail to account for vehicle interactions and trajectory data temporal dependencies; hence this research proposes a multi-model fusion-based lane-changing intention recognition framework for intelligent transportation. Using actual vehicle trajectory data from a dataset, the suggested model is verified and contrasted with several well used baseline models. According to the experimental findings, the lane change intention detection technique can greatly increase prediction accuracy by fusing attention processes, reinforcement learning-based CRF, and vehicle interaction data. The system’s main components are input processing and lane-changing intention recognition. Vehicle trajectory data is cleaned, labelled, sliced, and one-hot encoded during input processing BiLSTM-F model detects driver lane-change intent, enhanced by incorporating attention mechanism to the Bidirectional Long Short-Term Memory (BiLSTM) network, the model may give changing weights to input processing section output. This lets the model focus on lane-changing intention-affecting factors. Finally, a Reinforcement Learning-based Conditional Random Field (CRF) efficiently determines the globally optimal lane-changing intention. This field fully represents input data temporal interdependence. The model was trained and tested on the public NGSIM dataset. Validation results show it can achieve up to 97.19% accuracy and predict a vehicle’s lane change intention with 94.16% accuracy, two seconds before the actual maneuver occurs. The suggested model outperforms baseline lane-changing intention recognition models in terms of accuracy, loss performance, F1 score, and stability.

reinforcement learningconditional random fieldsattention mechanismbidirectional LSTM
مقالوصول مغلق20252استشهاد· Semantic Scholar

Blockchain‐Based Anomaly Detection in Vehicular Ad‐Hoc Networks Using Deep Reinforcement Learning

Transactions on Emerging Telecommunications Technologies · مجلد 36 (10)

ABSTRACT Utilizing blockchain in vehicular ad‐hoc networks (VANETs) can proficiently resolve concerns pertaining to data security and privacy. The limited throughput of blockchain obstructs its extensive implementation in VANETs. Current studies on enhancing blockchain throughput frequently encounter the issue of action space proliferation, leading to inadequate scalability. This research presents a strategy for optimizing blockchain performance on VANETs using deep reinforcement learning (DRL). The suggested method enhances blockchain throughput by selecting block producers and consensus methods, and by modifying block size and intervals, while maintaining decentralization, low latency, and security in VANET‐based blockchain systems. Furthermore, to augment network security, an anomaly detection mechanism is incorporated, utilizing machine learning techniques to identify and mitigate potential attacks aimed at VANETs. The proposed system enhances throughput and fortifies resilience against malicious operations by identifying anomalous patterns in network behavior. The method uses the BDQ framework to meticulously partition the action space, tackling the action space explosion issue that occurs with conventional DRL techniques in blockchain throughput optimization. Simulation results indicate that the suggested solution significantly improves the throughput and security of the VANET‐based blockchain system.

vehicular ad hoc networksblockchainanomaly detectiondeep reinforcement learning
مقالوصول مغلق20252استشهاد· Semantic Scholar

Hybrid Optimization Framework for Energy Efficiency Maximization in NOMA-Aided Internet of Vehicles with Beyond Diagonal RIS

IEEE Internet of Things Journal · 1-1

The integration of beyond diagonal reconfigurable intelligent surfaces (BD-RIS) with non-orthogonal multiple access (NOMA) in the Internet of Vehicles (IoV) networks presents the transformative potential for 6G vehicular communications, promising unprecedented gains in energy and spectral efficiency. However, existing research fails to address the joint optimization of BD-RIS configuration, NOMA power allocation, and dynamic IoV association–a critical oversight given their inherent interdependence in practical deployment scenarios. Current literature predominantly examines these components in isolation, with conventional RIS architectures and orthogonal multiple access schemes, leading to suboptimal performance in high-mobility vehicular environments. This work bridges this gap by proposing a novel hybrid optimization framework for NOMA-aided BD-RIS assisted IoV networks. The proposed framework simultaneously optimizes the IoV association with the base station (BS), NOMA power allocation, and BD-RIS phase shift design to maximize the energy efficiency of the system while ensuring the minimum signal-to-interference plus noise ratios (SINRs) of IoVs. The proposed framework is formulated as non-linear optimization due to joint decision variables and rate expressions of IoVs, resulting in an NP-hard problem where achieving a joint optimal solution is computationally complex. To handle this complexity, the original joint formulation is decomposed into three subproblems: IoV association with BS, BS power allocation, and BD-RIS phase shift design. An efficient iterative solution is then developed through the synergistic combination of deep reinforcement learning, first-order Taylor expansion, and manifold optimization methods. For comprehensive evaluation, we introduce a NOMA-aided conventional RIS assisted IoV framework as a benchmark. Extensive numerical results based on Monte Carlo simulations demonstrate that the proposed NOMA-aided BD-RIS assisted IoV network achieves significant improvements of 32% in energy efficiency and 28% in spectral efficiency compared to conventional RIS-assisted architectures, validating its potential for next-generation vehicular networks.

beyond-diagonal reconfigurable intelligent surfacenon-orthogonal multiple accessInternet of Vehiclesenergy efficiency optimization
مقالوصول مغلق2025

Trajectory Planning-Based Reinforcement Learning for 3-D Indoor Navigation of Autonomous Aerial Vehicle

IEEE Communications Standards Magazine · 1-8

The development of indoor navigation and positioning technology autonomous aerial vehicles, or AAVs, are employed extensively in many different industries due to their ease of operation and outstanding mobility. Drones can decrease responder injuries, increase mission effectiveness, and conduct search operations in locations that rescue crews are unable to access when utilized for indoor search and rescue during a disaster. This paper’s goal is to use a reinforcement learning algorithm to suggest a track planning technique for AAVs in indoor post-disaster scenarios. The difficulty of finding a safe path for AAVs in crowded indoor areas that present a significant risk to flight safety is the focus of this research. To address the difficulties caused by the intricate interior environment and the sluggish convergence of current reinforcement learning algorithms, an ensemble strategy based on reinforcement learning has been put forth. By using the coordinate connection between the beginning point and the endpoint to identify the primary barrier and the nodes surrounding it, this strategy seeks to minimize the search for superfluous nodes. The enhanced 3D navigation trajectory planning technique lowered the number of space search nodes by 55.49% and shortened the convergence time by 98.57%, according to simulation and testing of the optimization process in a three-dimensional grid diagram.

trajectory planningreinforcement learningautonomous aerial vehiclesindoor navigation
مقالوصول مغلق202423استشهاد· Semantic Scholar

Edge AI-Based Dynamic Treatment Strategy Generation Model for Consumer Healthcare Technology

IEEE Transactions on Consumer Electronics · مجلد 71 (2) · 4565-4573

Edge AI-based reinforcement learning is less reliant on mathematical models and relies on experience to help with the design and optimization of Consumer Technology models, making it ideal for learning dynamic treatment techniques. However, the current research still has the following problems: 1. The optimality of the learned strategy is considered without taking risks into account, leading to strategies with certain risks. 2. The issue of distribution shift is ignored, resulting in learned strategies that are completely different from those of doctors. 3. The patient’s historical observational data and treatments are ignored, making it difficult to accurately assess the patient’s state, which in turn leads to the inability to learn the optimal strategy. Based on this, we propose the DOSAC-DTR dynamic treatment strategy model, which integrates Dead-ends and offline monitoring into the Actor-Critic framework. First, we consider the risk of treatment actions recommended by the learned strategy and incorporate the concept of Dead-ends into the Actor-Critic framework. Second, to mitigate the distribution shift problem, we integrate physician monitoring into the Actor-Critic framework. This approach achieves better performance, resulting in lower estimated mortality rates and higher Jaccard index scores.

edge AIreinforcement learningdistribution shiftoffline monitoring