Infrastructure for Model-based Control of Distributed IT systems Gergely János Paljak Advisors: András Pataricza, Tamás Kovácsházy 15 min presentation + 5 min questions

Intelligent system management Application A Application B Federated, virtualized data center Virtualization Server 1 Central resource pools Server 2 Server 3 Statikus allokáció - első alkalmazás, második alkalmazás Virtualizáció: egyszerűbb újrakonfigurálás, de alapvetően még mindig manuális, ad-hoc folyamatok Cloud computing: automatizált újrakonfigurálás, központi erőforráskezelés Individual servers, static allocation sensors for capacity/utilization monitoring Virtual servers: Easier reconfiguration in runtime Federated DC: centralized management, intelligent decision making for provisioning

Manual configuration of system supervision Software Component Software Component Monitoring Server Presentation Server Historical Data Software Component Software Component A monitorozó rendszer telepítése Szenzorok telepítése A diagnosztika telepítése a legfontosabb, legnagyobb szakértelmet igénylő lépés Configuring alerting & diagnostic logic: Effort larger by orders of magnitude Faulty configurations due to ad-hoc design Deployment of sensors (local agents/agentless): Moderate effort Some configuration faults can be introduced Deployment of supervisory infrastructure: Moderate effort Low probability of faults

System Management as a Control Problem Control theory applied to IT Infrastructures Collect and store data about the state of the infrastucture Controlled Plant Sensors Controller Actuator Service Monitoring provides Control Objective (e.g. SLA) Decision Making Software Component Control Policy Provisioning Based on human expertise or automation deployed on Szabályozástechnikai megközelítés Szenzor: adatgyűltés, állapot adatok Szabályozó: SLA alapján, kézi vagy automatizált, szabály alapú rendszerek Beavatkozó: változások végrehajtása az infrastruktúrában Effectuate changes in the infrastructure Supervised Node Monitoring / Control Node

Realistic infrastructure: Architecture Integrated intelligent data processing (in MatLab) Realistic workload Reconfigurable in runtime Realistic infrastructure: Multi-tier Widely-used components Tőbbrétegű architektúra, széleskörben használt szoftverkomponensek Valós terhelésprofil Újrakonfigurálás futásidőben Integrált rendszer monitorizás Adatfeldolgozás Szabályzás később Integrated system monitoring, wide range of measured metrics

Measured attributes Processes Agent Middle-ware Clients Agent Platform We chose to measure all possibly relevant performance attributes Leave the selection of truly relevant attributes to data processing Ex. MySQL threads, Tomcat processing time, Apache open connections Processes Ex. CPU idle (%), free memory (kb), network bytes sent Agent Middle-ware Clients Agent Platform

Variable selection - the dilemma Linear Entropy based Objective min E(distance error2) max (shape similarity) Feature preservation Simple projection More context Invariance Linear transformation Any bijective function Main characteristics retained Avarege distance Shape Plane mirror Less details Less distortion Spheric mirror More details Huge distortion Paljak, Kocsis, Égel, Tóth, Pataricza: „Sensor Selection for IT infrastructure Monitoring”, AUTONOMICS ‘09

Future work Actuator Control (reconfiguration) Service Prediction metric Service metric Dimension reduction Prediction based on the smaller state space Model-predictive control for proactivity Adaptive reconfiguration metric provides Software Component metric metric metric metric Prediction deployed on Dim red A kisebb állapottér alapján predikció Szabályozás, modell alapú Beavatkozás, újrakonfigurálás metric metric metric metric

Summary An infrastructure for evaluating control methods in system management was built The pilot infrastructure is a three-tier server system with integrated system monitoring and data processing We are going to use this infrastructure for Modeling multi-tier systems (identification) Create algorithms for control Evaluate the developped algorithms