ML p(r)ior | Dynamic Virtual Machine Management via Approximate Markov Decision Process

Dynamic Virtual Machine Management via Approximate Markov Decision Process

2016-01-30
Efficient virtual machine (VM) management can dramatically reduce energy consumption in data centers. Existing VM management algorithms fall into two categories based on whether the VMs' resource demands are assumed to be static or dynamic. The former category fails to maximize the resource utilization as they cannot adapt to the dynamic nature of VMs' resource demands. Most approaches in the latter category are heuristical and lack theoretical performance guarantees. In this work, we formulate dynamic VM management as a large-scale Markov Decision Process (MDP) problem and derive an optimal solution. Our analysis of real-world data traces supports our choice of the modeling approach. However, solving the large-scale MDP problem suffers from the curse of dimensionality. Therefore, we further exploit the special structure of the problem and propose an approximate MDP-based dynamic VM management method, called MadVM. We prove the convergence of MadVM and analyze the bound of its approximation error. Moreover, MadVM can be implemented in a distributed system, which should suit the needs of real data centers. Extensive simulations based on two real-world workload traces show that MadVM achieves significant performance gains over two existing baseline approaches in power consumption, resource shortage and the number of VM migrations. Specifically, the more intensely the resource demands fluctuate, the more MadVM outperforms.
PDF

Highlights - Most important sentences from the article

Login to like/save this paper, take notes and configure your recommendations

Related Articles

2018-10-03

Designing optimal controllers continues to be challenging as systems are becoming complex and are in… show more
PDF

Highlights - Most important sentences from the article

2015-06-17

In mobile edge computing, local edge servers can host cloud-based services, which reduces network ov… show more
PDF

Highlights - Most important sentences from the article

2018-10-23

We consider optimal sensor scheduling with unknown communication channel statistics. We formulate tw… show more
PDF

Highlights - Most important sentences from the article

2018-07-29

In this paper, we address the problem of setting the tap positions of load tap changers (LTCs) for v… show more
PDF

Highlights - Most important sentences from the article

2019-05-07
1905.02606 | cs.SY

Complex social systems are composed of interconnected individuals whose interactions result in group… show more
PDF

Highlights - Most important sentences from the article

2018-02-12
1802.03900 | cs.LG

We consider model-free reinforcement learning for infinite-horizon discounted Markov Decision Proces… show more
PDF

Highlights - Most important sentences from the article

2019-02-26

Effective network slicing requires an infrastructure/network provider to deal with the uncertain dem… show more
PDF

Highlights - Most important sentences from the article

2017-10-01

Scheduling of the transmission of status updates over an error-prone communication channel is studie… show more
PDF

Highlights - Most important sentences from the article

2019-03-22

Reinforcement learning algorithms can be used to optimally solve dynamic decision-making and control… show more
PDF

Highlights - Most important sentences from the article

2019-04-20

This paper studies the performance and resilience of a linear cyber-physical control system (CPCS) w… show more
PDF

Highlights - Most important sentences from the article

2018-10-18

This paper presents a comprehensive literature review on applications of deep reinforcement learning… show more
PDF

Highlights - Most important sentences from the article

2018-05-23

Distribution system operators (DSO) world-wide foresee a rapid roll-out of distributed energy resour… show more
PDF

Highlights - Most important sentences from the article

2018-10-18

Driven by the increasingly serious air pollution problem, the monitoring of air quality has gained m… show more
PDF

Highlights - Most important sentences from the article

2019-03-28

Real-time remote estimation is critical for mission-critical applications including industrial autom… show more
PDF

Highlights - Most important sentences from the article

2019-03-07

Nonlinear optimal control problems are often solved with numerical methods that require knowledge of… show more
PDF

Highlights - Most important sentences from the article

2018-08-06
1808.01876 | cs.AI

Urban Traffic Control (UTC) plays an essential role in Intelligent Transportation System (ITS) but r… show more