This course aims to teach learners how to unearth the functional structure of a cloud service using the VM-to-VM traffic matrix. By leveraging clustering algorithms, participants will learn to identify design patterns for scaling, reduce costs for customers, detect anomalous traffic, and potential misconfigurations. The course covers topics such as feature scaling, dimensionality reduction, and hierarchical clustering. The teaching method involves theoretical explanations, practical examples, and case studies. This course is intended for cloud service providers, cloud architects, system administrators, and individuals interested in cloud service management and optimization.
CloudCluster - Unearthing the Functional Structure of a Cloud Service
Overview
Syllabus
Intro
Anatomy of a Cloud Service: The Customer View
Anatomy of a Cloud Service: The Provider View
Today: Monitoring at Different levels of Abstract
A New Abstraction: The Functional Structure
What do we mean by Functional Structure?
The Provider Does Not Know the Functional Stru
Extracting the Functional Structure
Hypothesis
Approach: Use Clustering!
Cloud Cluster: Challenges
The Problem
Insight: Exploit Redundancy in VM-to-VM Traffic
Dimensionality Reduction
Agglomerative Clustering
Generating the Clusters: Where to cut the dendre
Use Cluster Inconsistency to Decide!
Evaluating Clustering Performance
Cloud Cluster. Excellent Agreement with Ground
What is the Functional Structure Useful For?
Visualization
Detecting Traffic Shifts with Cloud Cluster
Detecting Structural Changes
Anomaly Detection
Summary
Taught by
USENIX
