Infrastructure for Model-based Control of Distributed IT systems

Az előadások a következő témára: "Infrastructure for Model-based Control of Distributed IT systems"— Előadás másolata:

1 Infrastructure for Model-based Control of Distributed IT systems
Gergely János Paljak Advisors: András Pataricza, Tamás Kovácsházy 15 min presentation + 5 min questions

2 Intelligent system management
Application A Application B Federated, virtualized data center Virtualization Server 1 Central resource pools Server 2 Server 3 Statikus allokáció - első alkalmazás, második alkalmazás Virtualizáció: egyszerűbb újrakonfigurálás, de alapvetően még mindig manuális, ad-hoc folyamatok Cloud computing: automatizált újrakonfigurálás, központi erőforráskezelés Individual servers, static allocation sensors for capacity/utilization monitoring Virtual servers: Easier reconfiguration in runtime Federated DC: centralized management, intelligent decision making for provisioning

3 Manual configuration of system supervision
Software Component Software Component Monitoring Server Presentation Server Historical Data Software Component Software Component A monitorozó rendszer telepítése Szenzorok telepítése A diagnosztika telepítése a legfontosabb, legnagyobb szakértelmet igénylő lépés Configuring alerting & diagnostic logic: Effort larger by orders of magnitude Faulty configurations due to ad-hoc design Deployment of sensors (local agents/agentless): Moderate effort Some configuration faults can be introduced Deployment of supervisory infrastructure: Moderate effort Low probability of faults

4 System Management as a Control Problem
Control theory applied to IT Infrastructures Collect and store data about the state of the infrastucture Controlled Plant Sensors Controller Actuator Service Monitoring provides Control Objective (e.g. SLA) Decision Making Software Component Control Policy Provisioning Based on human expertise or automation deployed on Szabályozástechnikai megközelítés Szenzor: adatgyűltés, állapot adatok Szabályozó: SLA alapján, kézi vagy automatizált, szabály alapú rendszerek Beavatkozó: változások végrehajtása az infrastruktúrában Effectuate changes in the infrastructure Supervised Node Monitoring / Control Node

5 Realistic infrastructure:
Architecture Integrated intelligent data processing (in MatLab) Realistic workload Reconfigurable in runtime Realistic infrastructure: Multi-tier Widely-used components Tőbbrétegű architektúra, széleskörben használt szoftverkomponensek Valós terhelésprofil Újrakonfigurálás futásidőben Integrált rendszer monitorizás Adatfeldolgozás Szabályzás később Integrated system monitoring, wide range of measured metrics

6 Measured attributes Processes Agent Middle-ware Clients Agent Platform
We chose to measure all possibly relevant performance attributes Leave the selection of truly relevant attributes to data processing Ex. MySQL threads, Tomcat processing time, Apache open connections Processes Ex. CPU idle (%), free memory (kb), network bytes sent Agent Middle-ware Clients Agent Platform

7 Variable selection - the dilemma
Linear Entropy based Objective min E(distance error2) max (shape similarity) Feature preservation Simple projection More context Invariance Linear transformation Any bijective function Main characteristics retained Avarege distance Shape Plane mirror Less details Less distortion Spheric mirror More details Huge distortion Paljak, Kocsis, Égel, Tóth, Pataricza: „Sensor Selection for IT infrastructure Monitoring”, AUTONOMICS ‘09

8 Future work Actuator Control (reconfiguration) Service Prediction
metric Service metric Dimension reduction Prediction based on the smaller state space Model-predictive control for proactivity Adaptive reconfiguration metric provides Software Component metric metric metric metric Prediction deployed on Dim red A kisebb állapottér alapján predikció Szabályozás, modell alapú Beavatkozás, újrakonfigurálás metric metric metric metric

9 Summary An infrastructure for evaluating control methods in system management was built The pilot infrastructure is a three-tier server system with integrated system monitoring and data processing We are going to use this infrastructure for Modeling multi-tier systems (identification) Create algorithms for control Evaluate the developped algorithms