جامعة المعرفة
المصدر المعتمد للمعلومات البحثية والمخرجات هو قاعدة بيانات سكوبس (Elsevier Scopus) مع تدقيق بيانات الباحثين من عمادة البحث العلمي.

Research outputs

المخرجات البحثية

مقالات ومراجعات وأوراق مؤتمرات وفصول كتب، مفهرسة برقم DOI ومربوطة بباحثي الجامعة.

13 مُخرَج نتائج البحث عن «Reinforcement learning»

مقالوصول مغلق202512استشهاد· Semantic Scholar

Consumer Technology in Task Offloading and Edge Resource Allocation: AIoT and Edge Computing for Next-Generation Communication

IEEE Transactions on Consumer Electronics · مجلد 71 (2) · 5356-5365

Artificial Intelligence of Things (AIoT) edge computing has emerged as a critical enabler for consumer technology, easing the load on distribution grid networks through enhanced data transmission and processing capabilities. The Internet of Things (IoT), a modern network paradigm, connects devices using sensors and communication mediums to enable seamless information exchange. However, the limited computational capacity of edge nodes poses challenges in optimizing AIoT edge resources compared to cloud computing. To address this, a cloud-edge three-layer framework for task offloading and edge resource allocation is proposed in the context of consumer technology and distribution grids. This model incorporates random tasks, limited resources, unequal processing power, and high latency requirements. It features two key phases: a resource auction using a multi-round iterative process and compute offloading managed by a Deep Reinforcement Learning (DRL) approach. Enhanced algorithms such as Double DQN and Dueling DQN are integrated into the job offloading process to improve performance. Simulations validate the convergence of the task offloading algorithm and demonstrate that the proposed methods significantly enhance computational efficiency and resource utilization for edge nodes. These advancements offer promising solutions for the dynamic needs of consumer technology and future communication networks.

task offloadingedge resource allocationAIoTedge computing
مقالوصول مغلق20257استشهاد· Semantic Scholar

Reinforcement Learning for Dynamic Optimization of Lane Change Intention Recognition for Transportation Networks

IEEE Transactions on Intelligent Transportation Systems · مجلد 27 (2) · 2695-2705

Advance driver assistance systems (ADAS) swiftly and effectively detect oncoming cars’ lanes-changing intentions in intelligent transportation, supporting decision support and safety. Current techniques fail to account for vehicle interactions and trajectory data temporal dependencies; hence this research proposes a multi-model fusion-based lane-changing intention recognition framework for intelligent transportation. Using actual vehicle trajectory data from a dataset, the suggested model is verified and contrasted with several well used baseline models. According to the experimental findings, the lane change intention detection technique can greatly increase prediction accuracy by fusing attention processes, reinforcement learning-based CRF, and vehicle interaction data. The system’s main components are input processing and lane-changing intention recognition. Vehicle trajectory data is cleaned, labelled, sliced, and one-hot encoded during input processing BiLSTM-F model detects driver lane-change intent, enhanced by incorporating attention mechanism to the Bidirectional Long Short-Term Memory (BiLSTM) network, the model may give changing weights to input processing section output. This lets the model focus on lane-changing intention-affecting factors. Finally, a Reinforcement Learning-based Conditional Random Field (CRF) efficiently determines the globally optimal lane-changing intention. This field fully represents input data temporal interdependence. The model was trained and tested on the public NGSIM dataset. Validation results show it can achieve up to 97.19% accuracy and predict a vehicle’s lane change intention with 94.16% accuracy, two seconds before the actual maneuver occurs. The suggested model outperforms baseline lane-changing intention recognition models in terms of accuracy, loss performance, F1 score, and stability.

reinforcement learningconditional random fieldsattention mechanismbidirectional LSTM
مقالوصول مغلق20252استشهاد· Semantic Scholar

Blockchain‐Based Anomaly Detection in Vehicular Ad‐Hoc Networks Using Deep Reinforcement Learning

Transactions on Emerging Telecommunications Technologies · مجلد 36 (10)

ABSTRACT Utilizing blockchain in vehicular ad‐hoc networks (VANETs) can proficiently resolve concerns pertaining to data security and privacy. The limited throughput of blockchain obstructs its extensive implementation in VANETs. Current studies on enhancing blockchain throughput frequently encounter the issue of action space proliferation, leading to inadequate scalability. This research presents a strategy for optimizing blockchain performance on VANETs using deep reinforcement learning (DRL). The suggested method enhances blockchain throughput by selecting block producers and consensus methods, and by modifying block size and intervals, while maintaining decentralization, low latency, and security in VANET‐based blockchain systems. Furthermore, to augment network security, an anomaly detection mechanism is incorporated, utilizing machine learning techniques to identify and mitigate potential attacks aimed at VANETs. The proposed system enhances throughput and fortifies resilience against malicious operations by identifying anomalous patterns in network behavior. The method uses the BDQ framework to meticulously partition the action space, tackling the action space explosion issue that occurs with conventional DRL techniques in blockchain throughput optimization. Simulation results indicate that the suggested solution significantly improves the throughput and security of the VANET‐based blockchain system.

vehicular ad hoc networksblockchainanomaly detectiondeep reinforcement learning
مقالوصول مغلق20252استشهاد· Semantic Scholar

Hybrid Optimization Framework for Energy Efficiency Maximization in NOMA-Aided Internet of Vehicles with Beyond Diagonal RIS

IEEE Internet of Things Journal · 1-1

The integration of beyond diagonal reconfigurable intelligent surfaces (BD-RIS) with non-orthogonal multiple access (NOMA) in the Internet of Vehicles (IoV) networks presents the transformative potential for 6G vehicular communications, promising unprecedented gains in energy and spectral efficiency. However, existing research fails to address the joint optimization of BD-RIS configuration, NOMA power allocation, and dynamic IoV association–a critical oversight given their inherent interdependence in practical deployment scenarios. Current literature predominantly examines these components in isolation, with conventional RIS architectures and orthogonal multiple access schemes, leading to suboptimal performance in high-mobility vehicular environments. This work bridges this gap by proposing a novel hybrid optimization framework for NOMA-aided BD-RIS assisted IoV networks. The proposed framework simultaneously optimizes the IoV association with the base station (BS), NOMA power allocation, and BD-RIS phase shift design to maximize the energy efficiency of the system while ensuring the minimum signal-to-interference plus noise ratios (SINRs) of IoVs. The proposed framework is formulated as non-linear optimization due to joint decision variables and rate expressions of IoVs, resulting in an NP-hard problem where achieving a joint optimal solution is computationally complex. To handle this complexity, the original joint formulation is decomposed into three subproblems: IoV association with BS, BS power allocation, and BD-RIS phase shift design. An efficient iterative solution is then developed through the synergistic combination of deep reinforcement learning, first-order Taylor expansion, and manifold optimization methods. For comprehensive evaluation, we introduce a NOMA-aided conventional RIS assisted IoV framework as a benchmark. Extensive numerical results based on Monte Carlo simulations demonstrate that the proposed NOMA-aided BD-RIS assisted IoV network achieves significant improvements of 32% in energy efficiency and 28% in spectral efficiency compared to conventional RIS-assisted architectures, validating its potential for next-generation vehicular networks.

beyond-diagonal reconfigurable intelligent surfacenon-orthogonal multiple accessInternet of Vehiclesenergy efficiency optimization
ورقة مؤتمروصول مغلق20251استشهاد· Semantic Scholar

Deep Reinforcement Learning-Based Multi-Robotic Agent Motion Planning

OPJU International Technology Conference on Smart Computing for Innovation and Advancement in Industry (OTCON) · 1-6

The deep Q-network (DQN) technique, as a classic value-based deep reinforcement learning process, has been widely applied in fields such as multi-robotic agent motion planning. However, the DQN method faces a series of tasks, such as overestimating Q-values, complex Q-value computations, neural networks lacking historical memory proficiencies, and inefficient exploration when using ε-greedy strategies. This paper proposes a DQN-based multi-robot agent deep reinforcement learning motion planning approach to solve these problems. To accomplish their objectives without colliding with one another, agents can acquire stable and efficient motion planning techniques with the aid of this method. Initially, a Dueling-based optimization tool is suggested, which is based on the DQN approach. It simplifies and improves the calculation of Q-values by calculating state values and advantage function values, and by choosing the appropriate action based on the parameters of the presently updating Q-value network. Additionally, we provide a GRU-based memory mechanism that incorporates GRU modules to facilitate the network's temporal data acquisition and handling of agents' historical information. And lastly, we offer a noise-based exploration technique that works. By introducing parameterized noise, the exploration technique in DQN is modified, improving the examination efficiency of agents, and achieving a balance between exploration and exploitation in multi-robotic agent systems. Tests were conducted in six different simulation scenarios on the PyBullet simulation platform. Experimental results show that the proposed method enables efficient collaboration among multi-robotic agent teams, agreeing them to go where they're going without running into each other, and the methods' training is steady.

multi-robot motion planningdeep Q-networkdueling DQNexploration-exploitation balance
مقالوصول مغلق2025

Trajectory Planning-Based Reinforcement Learning for 3-D Indoor Navigation of Autonomous Aerial Vehicle

IEEE Communications Standards Magazine · 1-8

The development of indoor navigation and positioning technology autonomous aerial vehicles, or AAVs, are employed extensively in many different industries due to their ease of operation and outstanding mobility. Drones can decrease responder injuries, increase mission effectiveness, and conduct search operations in locations that rescue crews are unable to access when utilized for indoor search and rescue during a disaster. This paper’s goal is to use a reinforcement learning algorithm to suggest a track planning technique for AAVs in indoor post-disaster scenarios. The difficulty of finding a safe path for AAVs in crowded indoor areas that present a significant risk to flight safety is the focus of this research. To address the difficulties caused by the intricate interior environment and the sluggish convergence of current reinforcement learning algorithms, an ensemble strategy based on reinforcement learning has been put forth. By using the coordinate connection between the beginning point and the endpoint to identify the primary barrier and the nodes surrounding it, this strategy seeks to minimize the search for superfluous nodes. The enhanced 3D navigation trajectory planning technique lowered the number of space search nodes by 55.49% and shortened the convergence time by 98.57%, according to simulation and testing of the optimization process in a three-dimensional grid diagram.

trajectory planningreinforcement learningautonomous aerial vehiclesindoor navigation
ورقة مؤتمروصول مغلق2025

Deep reinforcement learning-based real-time data analytics of automatic industrial robot for digital transformation

AIP conference proceedings · مجلد 3343 · 040048-040048

In Industry 4.0, industrial robot trajectory planning requires real-time collision avoidance. This is solved by our innovative Collision Criticality (CC) LSTM-DRL approach. This work suggests navigating many landscapes with diverse barriers using deep reinforcement learning (DRL) and long-short-term memory for data analytics in digital transformation. The robot’s current state is used by Crit LSTM DRL to estimate collision timing and obstacle CC. Obstacle courses use CC ranks. Robotics creates a fixed-dimensional vector that accurately represents reality using LSTM models. After that, the robot’s current state is added to this vector to complete its perception and cognition. Deep Reinforcement learning (DRL) optimizes state values using input data. At each time step, Deep Reinforcement Learning (DRL) and Long Short-Term Memory (LSTM) identify the next state values for all possible actions. System operation depends on the highest value’s action. We learned three environmental models in this research. A scenario with five, 10, or one to ten barriers was classified. These models were tested for adaptability to different obstacle densities. In obstacle-rich situations, researchers tested these three models’ strengths and weaknesses. Testing the algorithm in various settings proves its efficacy. The program also considers the combined influence of impediments on the robot by portraying them as a joint state. CC-LSTM-DRL performs well in Industry 4.0’s dynamic and challenging conditions, according to experiments. Mobile robots can confidently navigate changing environments due to their versatility and flexibility, making them ideal industrial tools. Industry 4.0, Collision Criticality, Industrial Robot, Autonomous Systems, Mobile Robots, Collision Risk

deep reinforcement learningreal-time analyticsindustrial robotsdigital transformation
مقالوصول مغلق202423استشهاد· Semantic Scholar

Edge AI-Based Dynamic Treatment Strategy Generation Model for Consumer Healthcare Technology

IEEE Transactions on Consumer Electronics · مجلد 71 (2) · 4565-4573

Edge AI-based reinforcement learning is less reliant on mathematical models and relies on experience to help with the design and optimization of Consumer Technology models, making it ideal for learning dynamic treatment techniques. However, the current research still has the following problems: 1. The optimality of the learned strategy is considered without taking risks into account, leading to strategies with certain risks. 2. The issue of distribution shift is ignored, resulting in learned strategies that are completely different from those of doctors. 3. The patient’s historical observational data and treatments are ignored, making it difficult to accurately assess the patient’s state, which in turn leads to the inability to learn the optimal strategy. Based on this, we propose the DOSAC-DTR dynamic treatment strategy model, which integrates Dead-ends and offline monitoring into the Actor-Critic framework. First, we consider the risk of treatment actions recommended by the learned strategy and incorporate the concept of Dead-ends into the Actor-Critic framework. Second, to mitigate the distribution shift problem, we integrate physician monitoring into the Actor-Critic framework. This approach achieves better performance, resulting in lower estimated mortality rates and higher Jaccard index scores.

edge AIreinforcement learningdistribution shiftoffline monitoring
ورقة مؤتمروصول مغلق20245استشهاد· Semantic Scholar

Deep Reinforcement Learning-Based Real-time Data Analytics of Automatic Industrial Robot for High Speed Communication

IEEE International Conference on Innovations in High Speed Communication and Signal Processing (IHCSP) · 1-8

In Industry 4.0, industrial robot trajectory planning requires real-time collision avoidance. This is solved by our innovative Collision Criticality (CC) LSTM-DRL approach. This work suggests navigating many landscapes with diverse barriers using deep reinforcement learning (DRL) and long-short-term memory for data analytics in high Speed Communication. The robot's current state is used by Crit LSTM DRL to estimate collision timing and obstacle CC. Obstacle courses use CC ranks. Robotics creates a fixed-dimensional vector that accurately represents reality using LSTM models. After that, the robot's current state is added to this vector to complete its perception and cognition. Deep Reinforcement Learning (DRL) optimalizes state values using input data. At each time step, Deep Reinforcement Learning (DRL) and Long Short-Term Memory (LSTM) identify the next state values for all possible actions. System operation depends on the highest value's action. We learned three environmental models in this research. A scenario with five, 10, or one to ten barriers was classified. These models were tested for adaptability to different obstacle densities. In obstacle-rich situations, researchers tested these three models' strengths and weaknesses. Testing the algorithm in various settings proves its efficacy. The program also considers the combined influence of impediments on the robot by portraying them as a joint state. CC-LSTM-DRL performs well in Industry 4.0's dynamic and challenging conditions, according to experiments. Mobile robots can confidently navigate changing environments due to their versatility and flexibility, making them ideal industrial tools.

collision avoidanceLSTMdeep reinforcement learningobstacle density