Dynamic power management strategies for a sensor node optimised by reinforcement learning
by Lei Zhou; Hao Tang; Huizi Li; Qi Jiang
International Journal of Computational Science and Engineering (IJCSE), Vol. 13, No. 1, 2016

Abstract: Dynamic power management (DPM) is considered in wireless sensor networks for improving the energy efficiency of sensor nodes. DPM usually includes two classical problems, dynamic operating mode (OM) management and adaptive transmission mechanism. In this paper, we propose a new model of Markov decision process that combines dynamic OM management and adaptive transmission mechanism. In addition, a fragment transmission scheme is further integrated to reduce the probability of retransmission failure and improve the data transmission rate. The model takes into account the performance criteria being the expected cost of synthesising the per-packet energy consumption, the buffer overflow, the fragment cost and the energy consumption of operating mode switching. Reinforcement learning algorithm is subsequently proposed to search for the optimal strategies. Furthermore, a state-clustering approach is given to increase the learning speed and lessen the storage requirements. Finally, an example is presented to illustrate the effectiveness of the proposed method and show that the energy consumption is well-balanced dynamically under the optimised policy, while the throughput decreases only slightly. Therefore, the lifetime of the node can be extended under constrained resources.

Online publication date: Thu, 14-Jul-2016

The full text of this article is only available to individual subscribers or to users at subscribing institutions.

 
Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.

Pay per view:
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.

Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Computational Science and Engineering (IJCSE):
Login with your Inderscience username and password:

Username:        Password:          Forgotten your password?

Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.

If you still need assistance, please email subs@inderscience.com