Artificial Intelligence of Things (AIoT) edge computing has emerged as a critical enabler for consumer technology, easing the load on distribution grid networks through enhanced data transmission and processing capabilities. The Internet of Things (IoT), a modern network paradigm, connects devices using sensors and communication mediums to enable seamless information exchange. However, the limited computational capacity of edge nodes poses challenges in optimizing AIoT edge resources compared to cloud computing. To address this, a cloud-edge three-layer framework for task offloading and edge resource allocation is proposed in the context of consumer technology and distribution grids. This model incorporates random tasks, limited resources, unequal processing power, and high latency requirements. It features two key phases: a resource auction using a multi-round iterative process and compute offloading managed by a Deep Reinforcement Learning (DRL) approach. Enhanced algorithms such as Double DQN and Dueling DQN are integrated into the job offloading process to improve performance. Simulations validate the convergence of the task offloading algorithm and demonstrate that the proposed methods significantly enhance computational efficiency and resource utilization for edge nodes. These advancements offer promising solutions for the dynamic needs of consumer technology and future communication networks.
IEEE Transactions on Intelligent Transportation Systems · مجلد 27 (2) · 2695-2705
Advance driver assistance systems (ADAS) swiftly and effectively detect oncoming cars’ lanes-changing intentions in intelligent transportation, supporting decision support and safety. Current techniques fail to account for vehicle interactions and trajectory data temporal dependencies; hence this research proposes a multi-model fusion-based lane-changing intention recognition framework for intelligent transportation. Using actual vehicle trajectory data from a dataset, the suggested model is verified and contrasted with several well used baseline models. According to the experimental findings, the lane change intention detection technique can greatly increase prediction accuracy by fusing attention processes, reinforcement learning-based CRF, and vehicle interaction data. The system’s main components are input processing and lane-changing intention recognition. Vehicle trajectory data is cleaned, labelled, sliced, and one-hot encoded during input processing BiLSTM-F model detects driver lane-change intent, enhanced by incorporating attention mechanism to the Bidirectional Long Short-Term Memory (BiLSTM) network, the model may give changing weights to input processing section output. This lets the model focus on lane-changing intention-affecting factors. Finally, a Reinforcement Learning-based Conditional Random Field (CRF) efficiently determines the globally optimal lane-changing intention. This field fully represents input data temporal interdependence. The model was trained and tested on the public NGSIM dataset. Validation results show it can achieve up to 97.19% accuracy and predict a vehicle’s lane change intention with 94.16% accuracy, two seconds before the actual maneuver occurs. The suggested model outperforms baseline lane-changing intention recognition models in terms of accuracy, loss performance, F1 score, and stability.
reinforcement learningconditional random fieldsattention mechanismbidirectional LSTM
Transactions on Emerging Telecommunications Technologies · مجلد 36 (10)
ABSTRACT Utilizing blockchain in vehicular ad‐hoc networks (VANETs) can proficiently resolve concerns pertaining to data security and privacy. The limited throughput of blockchain obstructs its extensive implementation in VANETs. Current studies on enhancing blockchain throughput frequently encounter the issue of action space proliferation, leading to inadequate scalability. This research presents a strategy for optimizing blockchain performance on VANETs using deep reinforcement learning (DRL). The suggested method enhances blockchain throughput by selecting block producers and consensus methods, and by modifying block size and intervals, while maintaining decentralization, low latency, and security in VANET‐based blockchain systems. Furthermore, to augment network security, an anomaly detection mechanism is incorporated, utilizing machine learning techniques to identify and mitigate potential attacks aimed at VANETs. The proposed system enhances throughput and fortifies resilience against malicious operations by identifying anomalous patterns in network behavior. The method uses the BDQ framework to meticulously partition the action space, tackling the action space explosion issue that occurs with conventional DRL techniques in blockchain throughput optimization. Simulation results indicate that the suggested solution significantly improves the throughput and security of the VANET‐based blockchain system.
vehicular ad hoc networksblockchainanomaly detectiondeep reinforcement learning
The integration of beyond diagonal reconfigurable intelligent surfaces (BD-RIS) with non-orthogonal multiple access (NOMA) in the Internet of Vehicles (IoV) networks presents the transformative potential for 6G vehicular communications, promising unprecedented gains in energy and spectral efficiency. However, existing research fails to address the joint optimization of BD-RIS configuration, NOMA power allocation, and dynamic IoV association–a critical oversight given their inherent interdependence in practical deployment scenarios. Current literature predominantly examines these components in isolation, with conventional RIS architectures and orthogonal multiple access schemes, leading to suboptimal performance in high-mobility vehicular environments. This work bridges this gap by proposing a novel hybrid optimization framework for NOMA-aided BD-RIS assisted IoV networks. The proposed framework simultaneously optimizes the IoV association with the base station (BS), NOMA power allocation, and BD-RIS phase shift design to maximize the energy efficiency of the system while ensuring the minimum signal-to-interference plus noise ratios (SINRs) of IoVs. The proposed framework is formulated as non-linear optimization due to joint decision variables and rate expressions of IoVs, resulting in an NP-hard problem where achieving a joint optimal solution is computationally complex. To handle this complexity, the original joint formulation is decomposed into three subproblems: IoV association with BS, BS power allocation, and BD-RIS phase shift design. An efficient iterative solution is then developed through the synergistic combination of deep reinforcement learning, first-order Taylor expansion, and manifold optimization methods. For comprehensive evaluation, we introduce a NOMA-aided conventional RIS assisted IoV framework as a benchmark. Extensive numerical results based on Monte Carlo simulations demonstrate that the proposed NOMA-aided BD-RIS assisted IoV network achieves significant improvements of 32% in energy efficiency and 28% in spectral efficiency compared to conventional RIS-assisted architectures, validating its potential for next-generation vehicular networks.
beyond-diagonal reconfigurable intelligent surfacenon-orthogonal multiple accessInternet of Vehiclesenergy efficiency optimization
The development of indoor navigation and positioning technology autonomous aerial vehicles, or AAVs, are employed extensively in many different industries due to their ease of operation and outstanding mobility. Drones can decrease responder injuries, increase mission effectiveness, and conduct search operations in locations that rescue crews are unable to access when utilized for indoor search and rescue during a disaster. This paper’s goal is to use a reinforcement learning algorithm to suggest a track planning technique for AAVs in indoor post-disaster scenarios. The difficulty of finding a safe path for AAVs in crowded indoor areas that present a significant risk to flight safety is the focus of this research. To address the difficulties caused by the intricate interior environment and the sluggish convergence of current reinforcement learning algorithms, an ensemble strategy based on reinforcement learning has been put forth. By using the coordinate connection between the beginning point and the endpoint to identify the primary barrier and the nodes surrounding it, this strategy seeks to minimize the search for superfluous nodes. The enhanced 3D navigation trajectory planning technique lowered the number of space search nodes by 55.49% and shortened the convergence time by 98.57%, according to simulation and testing of the optimization process in a three-dimensional grid diagram.
In Industry 4.0, industrial robot trajectory planning requires real-time collision avoidance. This is solved by our innovative Collision Criticality (CC) LSTM-DRL approach. This work suggests navigating many landscapes with diverse barriers using deep reinforcement learning (DRL) and long-short-term memory for data analytics in digital transformation. The robot’s current state is used by Crit LSTM DRL to estimate collision timing and obstacle CC. Obstacle courses use CC ranks. Robotics creates a fixed-dimensional vector that accurately represents reality using LSTM models. After that, the robot’s current state is added to this vector to complete its perception and cognition. Deep Reinforcement learning (DRL) optimizes state values using input data. At each time step, Deep Reinforcement Learning (DRL) and Long Short-Term Memory (LSTM) identify the next state values for all possible actions. System operation depends on the highest value’s action. We learned three environmental models in this research. A scenario with five, 10, or one to ten barriers was classified. These models were tested for adaptability to different obstacle densities. In obstacle-rich situations, researchers tested these three models’ strengths and weaknesses. Testing the algorithm in various settings proves its efficacy. The program also considers the combined influence of impediments on the robot by portraying them as a joint state. CC-LSTM-DRL performs well in Industry 4.0’s dynamic and challenging conditions, according to experiments. Mobile robots can confidently navigate changing environments due to their versatility and flexibility, making them ideal industrial tools. Industry 4.0, Collision Criticality, Industrial Robot, Autonomous Systems, Mobile Robots, Collision Risk
deep reinforcement learningreal-time analyticsindustrial robotsdigital transformation
The Internet of Things (IoT) is an emerging technology that allow smart devices to communicate through various heterogeneous channels (wired or wireless). However, for conventional networks, it has become a challenging task to efficiently control and manage the data flows of a huge number of devices. Software-defined networking (SDN) is a new way of thinking about networking. Because it is programmable, flexible, agile, and gives you a big picture of the network, it has tried to solve some IoT problems, like scalability, heterogeneity, and complexity. In large-scale SDN-IoT networks, there is a requirement for routing protocols that are both efficient and secure in order to ensure a superior level of quality of service (QoS) and quality of experience (QoE). To address the above stated challenges, a novel deep reinforcement learning (DRL) known as DQQS model is proposed. The aim is to achieve QoS and QoE while also ensuring the security of the SDN-IoT network. The proposed DQQS model dynamically extracts patterns from the past network history by interacting with the underlying network and generating optimized routing policies. This article employs three network metrics—throughput, latency, and the probability of avoiding malicious nodes—to measure the performance of DQQS. Simulations reveal that the proposed framework outperforms four state-of-the-art routing algorithms: OSPF, L-L Routing, Sailfish Routing, and RL-Routing in terms of both throughput and latency. For instance, in an attacked environment, the proposed DQQS model achieved the highest throughput value of 14.5 Mbps, surpassing OSPF at 8 Mbps, L-L at 8.2 Mbps, Sailfish at 9 Mbps, and RL at 9.5 Mbps. Similarly, this model exhibited superior performance in latency, recording the lowest latency value of 52 ms, compared to OSPF 88 ms, L-L 85 ms, Sailfish 72 ms, and RL 75 ms routing algorithms. The experimental results demonstrate that this new DQQS model is a pioneering deep reinforcement learning-based technique that optimally addresses secure routing in the SDN-IoT environment, ensuring enhanced quality of service and experience, and outperforming state-of-the art DL methodologies in both security and network performance metrics.
software-defined networkingInternet of Thingssecure routingdeep reinforcement learning
The number of people with kidney disease rises every day for many reasons. Many existing machine-learning-enabled mechanisms for processing kidney disease suffer from long delays and consume much more resources during processing. In this paper, the study shows how federated and reinforcement learning schemes can be used to develop the best delay scheme. The scheme must optimize both the internal and external states of reinforcement learning and the federated learning fog cloud network. This work presents the Adaptive Federated Reinforcement Learning-Enabled System (AFRLS) for Internet of Things (IoT) consumers’ kidney disease image processing. The main relationship between IoT consumers and kidney image is that the data is collected from different IoT consumer sources, such as ultrasound and X-rays in healthcare clinics. In healthcare applications, kidney urinary tasks reduce the time it takes to preprocess federated learning datasets for training and testing and run them on different fog and cloud nodes. AFRLS decides the scheduling on other nodes and improves constraints based on the decision tree. Based on the simulation results, AFRLS is a new strategy that reduces the time tasks need to be delayed compared to other machine learning methods used in fog cloud networks. The AFRLS improved the delay among nodes by 55%, the delay among internal states by 40%, and the training and testing delay by 51%.
IEEE International Conference on Innovations in High Speed Communication and Signal Processing (IHCSP) · 1-8
In Industry 4.0, industrial robot trajectory planning requires real-time collision avoidance. This is solved by our innovative Collision Criticality (CC) LSTM-DRL approach. This work suggests navigating many landscapes with diverse barriers using deep reinforcement learning (DRL) and long-short-term memory for data analytics in high Speed Communication. The robot's current state is used by Crit LSTM DRL to estimate collision timing and obstacle CC. Obstacle courses use CC ranks. Robotics creates a fixed-dimensional vector that accurately represents reality using LSTM models. After that, the robot's current state is added to this vector to complete its perception and cognition. Deep Reinforcement Learning (DRL) optimalizes state values using input data. At each time step, Deep Reinforcement Learning (DRL) and Long Short-Term Memory (LSTM) identify the next state values for all possible actions. System operation depends on the highest value's action. We learned three environmental models in this research. A scenario with five, 10, or one to ten barriers was classified. These models were tested for adaptability to different obstacle densities. In obstacle-rich situations, researchers tested these three models' strengths and weaknesses. Testing the algorithm in various settings proves its efficacy. The program also considers the combined influence of impediments on the robot by portraying them as a joint state. CC-LSTM-DRL performs well in Industry 4.0's dynamic and challenging conditions, according to experiments. Mobile robots can confidently navigate changing environments due to their versatility and flexibility, making them ideal industrial tools.
collision avoidanceLSTMdeep reinforcement learningobstacle density