Università degli Studi di Roma Tor Vergata Facoltà di Ingegneria A very simple cloud computing application: video playback How to scale? Classic solution: multithreaded application that exploits multicore parallelism Cons: Design can be complex Single failure impacts many users Valeria Cardellini - SDCC 2012/13 1
A simpler cloud-hosted solution: a singlethreaded video server instantiated once per user and running in a virtual machine Pros: Dramatically simpler design If a player crashes, only a single user is impacted Valeria Cardellini - SDCC 2012/13 2 The real problem: scale and complexity How to realize a system with the following requirements?" Million requests per day to serve" Increase/decrease in the request rate of one order of magnitude (or even more) in a quite short period" Exabytes to store (1 EB=2 60 =10 18 bytes)" There is a problem of scale of services! And scale changes every well known problem in computer research and industry Valeria Cardellini - SDCC 2012/13 3
More than 3G smartphones More than 2G Internet users Facebook: 1G users itunes: more than 400K active apps, more than 10G downloads YouTube: more than 55 hours of video uploaded every minute, more than 2G of video per day Twitter: more than 500M of accounts, more than 200M of tweets per day Akamai: 4TB/s delivery, from 15 to 30% of all Web traffic Google: more than 5G of queries per day Saleforces: more than 100K customers Zynga (social games company): more than 250M users CityVille: more than 61M of MAU (Monthly Active Users) within the first 50 days (http://www.appdata.com for more recent statistics) Valeria Cardellini - SDCC 2012/13 4 Some old and partial answers Utility computing On-demand computing Grid computing Autonomic computing Software as a Service (SaaS) An old idea: application delivery on Internet More recently: XaaS, where X=[Hardware, Infrastructure, Platform, ] HaaS: Hardware as a Service IaaS: Infrastructure as a Service PaaS: Platform as a Service HuaaS: Human as a Service (including crowdsourcing) Valeria Cardellini - SDCC 2012/13 5
Some old and partial answers (2) Some old definitions used by IT companies Pay-as-you-go (Sun) Adaptive enterprise (HP) E-business on demand (IBM) Elastic computing cloud (Amazon) before cloud computing (2006) Many definitions: a transition period Difficult to see where the cloud paradigm would have taken us in the long term After 6 years the picture is clearer The cloud represents one step towards the solution of the scale problem Valeria Cardellini - SDCC 2012/13 6 The origin: from 4 fundamental utilities Water Gas to computing as the fifth utility Electricity Telephony/Network Valeria Cardellini - SDCC 2012/13 7
Utility computing Utility computing: la potenza dei calcolatori e le applicazioni possono essere vendute secondo il modello economico dell utilità (utility) Adozione del modello economico del servizio Illusione di avere a disposizione risorse infinite Tariffazione di tipo pay-as-you-go e a grana fine (ad es. su base oraria) La vision computer utility non è una idea nuova! 1961: John McCarthy If computers of the kind I have advocated become the computers of the future, then computing may someday be organized as a public utility just as the telephone system is a public utility... The computer utility could become the basis of a new and important industry. Valeria Cardellini - SDCC 2012/13 8 1969: Leonard Kleinrock, progetto ARPANET As of now, computer networks are still in their infancy, but as they grow up and become sophisticated, we will probably see the spread of computer utilities, which, like present electric and telephone utilities, will service individual homes and offices across the country. Alcune ridefinizioni di computer 1984: John Gage, Sun Microsystems The network is the computer 2008: David Patterson, Univ. Berkeley The data center is the computer. There are dramatic differences between of developing software for millions to use as a service versus distributing software for millions to run their PCs Valeria Cardellini - SDCC 2012/13 9
2006: Jeff Bezos, Amazon: Let us use our spare resource for making profit by offering them as services to the public In August 2006 Amazon launched Elastic Compute Cloud (EC2) and a paired online storage service called Simple Storage Service (S3) Basic idea: let users rent data storage and computer server time from Amazon like a utility Cloud computing was finally born Today: Cloud is the computer (Rajkumar Buyya, Univ. Melbourne) Valeria Cardellini - SDCC 2012/13 10 Fonte: R. Buyya, Market-Oriented Cloud Computing:, 2008. Un business di milioni di milioni di!? Web Data Center Utility Computing Service Computing Grid Computing + P2P Computing Cloud Computing! Accesso ubiquo! Affidabilità Paradigmi! Scalabilità! Comportamento autonomico! Scoperta dinamica! Composizione Attributi! Quality of Service (QoS)! Service Level Agreement (SLA)! Valeria Cardellini - SDCC 2012/13 11
Search trends: Cluster computing, Grid computing, distributed computing, Cloud computing" Valeria Cardellini - SDCC 2012/13 12 Distributed computing Loosely coupled Heterogeneous Single administration Cluster computing Tightly coupled Homogeneous Single System Image Grid computing Large scale Cross-organizational Geographical distribution Distributed management Cloud computing Provisioned on demand Service guarantee VMs and Web 2.0-based Valeria Cardellini - SDCC 2012/13 Fonte: R. Buyya 13
Cosa si intende? In cosa differisce dagli altri paradigmi e in che direzione li estende? Valeria Cardellini - SDCC 2012/13 14 Una miriade di termini " Virtualization Billing Storage PaaS Pricing SaaS Resource Metering Provisioning on Demand Utility Computing Public Cloud Web 2.0 Privacy Security Amazon EC2 Rackspace Private Cloud Amazon S3 IaaS Google AppEngine Valeria Cardellini - SDCC 2012/13 15
Cloud Computing Cloud è il simbolo grafico generalmente usato per rappresentare Internet Il termine Computing comprende: - Computazione - Logica di coordinazione - Storage Il Cloud computing riguarda lo spostamento del computing da un singolo PC/data center ad Internet Valeria Cardellini - SDCC 2012/13 16 [Armbrust et al., 2009]: : Cloud Computing refers to both the applications delivered as services over the Internet and the hardware and software systems in the data centers that provide those services. The services themselves have long been referred to as Software as a Service (SaaS), so we use that term. The data center hardware and software is what we will call a Cloud. Cloud computing has the following characteristics: (1) The illusion of infinite computing resources (2) The elimination of an up-front commitment by cloud users (3) The ability to pay for use as needed. " [NIST, 2011]: Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction. (16 th definition!)! [Vaquero et al., 2009] Clouds are a large pool of easily usable and accessible virtualized resources (such as hardware, development platforms and/or services). These resources can be dynamically reconfigured to adjust to a variable load (scale), allowing also for an optimum resource utilization. This pool of resources is typically exploited by a pay-per-use model in which guarantees are offered by the infrastructure provider by means of customized SLAs. " Valeria Cardellini - SDCC 2012/13 17
Pay-per-use pricing model" No large up-front acquisition cost" Broad network access" Rapid elasticity or expansion" Elasticity: ability for customers to quickly request, receive, and later release as many resources as needed" Allows for on-demand scale in/out" Resources virtualization" Resources: storage, processing, memory, network bandwidth, and virtual machines" On-demand self-service" Not required human interaction with each service provider" Valeria Cardellini - SDCC 2012/13 18 Altri aspetti caratterizzanti Lʼintero stack (hw & sw) è usato su Internet" Il computing diventa una vera utility usata da tutti" Aziende" Fornitori di servizi" Utenti finali" Ricercatori" Gli aspetti economici assumono maggiore importanza " Tariffazione, determinazione dei prezzi di vendita, Quality of Service (QoS), Service Level Agreement (SLA)" Due differenze significative rispetto al Grid computing Valeria Cardellini - SDCC 2012/13 19
Cloud computing: perché ora? Esperienza con data center di ampie dimensioni" Economie di scala senza precedenti" Altri fattori" Diffusione di Internet a banda larga " Virtualizzazione x86 veloce" Modello di costo pay-per-use " Stack del software standard" Valeria Cardellini - SDCC 2012/13 20 Public cloud Cloud infrastructure: provisioned for open use by the general public Owned, managed, and operated by a business, academic, or government organization, or some combination of them Exists on the premises of the cloud provider Services can be free or fee-based Private cloud Cloud infrastructure: provisioned for exclusive use by a single organization comprising multiple consumers (e.g., business units) Owned, managed, and operated by the organization, a third party, or some combination of them Exists on or off premises Pros: stronger security Cons: lower economic advantages Valeria Cardellini - SDCC 2012/13 21
Community cloud Cloud infrastructure: provisioned for exclusive use by a specific community of consumers from organizations with shared concerns (e.g., mission, security requirements, policy, and compliance considerations) Owned, managed, and operated by one or more of the organizations in the community, a third party, or some combination of them Exists on or off premises Hybrid cloud Cloud infrastructure: composition of two or more distinct cloud infrastructures (private, community, or public) that remain unique entities, but are bound together by standardized or proprietary technology that enables data and application portability Why? E.g., cloud bursting for load balancing between clouds Valeria Cardellini - SDCC 2012/13 22 Valeria Cardellini - SDCC 2012/13 23
Example: need for dynamic hybrid cloud Usage of a dynamic hybrid cloud to manage a variable workload Private cloud used to provide a Web application under normal traffic condition Plus a public cloud used to manage traffic bursts that the private cloud is unable to substain Public cloud Private cloud Valeria Cardellini - SDCC 2012/13 24 Scientific Computing Financial Applications Private Cloud Amusement Google Apps (Gmail, Docs, ) Salesforce.com Web 2.0 Interface Programming API Scripting & Programming Languages Google AppEngine Microsoft Azure Force.com Virtualization VM Management & Deployment Software as a Service Platform as a Service Infrastructure as a Service Amazon S3, EC2 Public Cloud OpenNebula, Eucalyptus Hybrid Cloud Other Grids/ Rackspace Mosso Clouds Clusters Data Centers Storage Valeria Cardellini - SDCC 2012/13 25 Pricing and Billing QoS Metering Accounting SLA Negotiation Admission Control
A more detailed view of the stack Valeria Cardellini - SDCC 2012/13
Software as a Service (SaaS) Customer capability To use the provider s applications running on a cloud infrastructure Applications accessible from various client devices through a thin client interface or a program interface Customer control or management No control over underlying cloud infrastructure Network, servers, operating systems, storage, or even individual application capabilities Possible exception: limited user-specific application configuration settings Valeria Cardellini - SDCC 2012/13 26 Platform as a Service (PaaS): Customer capability To deploy onto the cloud infrastructure consumercreated or -acquired applications created using programming languages and tools supported by the provider Customer control No control over underlying cloud infrastructure Network, servers, operating systems, storage Control over deployed applications and possibly application hosting environment configurations Valeria Cardellini - SDCC 2012/13 27
Infrastructure as a Service (PaaS): Customer capability to provision processing, storage, networks, and other fundamental computing resources where the consumer is able to deploy and run arbitrary software (including operating systems and applications) Customer control No control over underlying cloud infrastructure Control over operating systems, storage, deployed applications Possibly limited control of select networking components (e.g., host firewalls) Valeria Cardellini - SDCC 2012/13 28 Source: Windows Azure Platform: Cloud Development Jump Start Valeria Cardellini - SDCC 2012/13 29
IaaS: risorse computazionali (storage, server) disponibili come servizi a richiesta Esempi Akamai (NetStorage e servizi CDN) Amazon (Elastic Compute Cloud/EC2 e Simple Storage Service/S3) FlexiScale GoGrid (Cloud Servers e Cloud Storage) Joyent (Accelerator) Rackspace Valeria Cardellini - SDCC 2012/13 30 PaaS: piattaforme che consentono sviluppo facile ed implementazione di applicazioni scalabili, senza necessità di investire in (o gestire) qualsiasi infrastruttura sottostante Servizi di più alto livello rispetto a IaaS (ad es. framework applicativi e strumenti di sviluppo) Esempi Akamai (EdgeComputing) Amazon (SimpleDB) Elastra e RightScale (piattaforme per Amazon EC2) Google (App Engine) Microsoft (Azure) Oracle (SaaS Platform) Valeria Cardellini - SDCC 2012/13 31
SaaS: applicazioni a disposizione del Cloud user gestite e distribuite tramite web Categoria più ampia di soluzioni di Cloud computing Esempi Comunicazione: Adobe Web Connect, Cisco WebEx, Google Mail, Hotmail, Yahoo! Mail Produttività personale: Google Docs, Google Calendar Storage di file: Dropbox, SugarSync E-Commerce: Demandware CRM (Customer relationship management): salesforce.com Contabilità, ERP (Enterprise Resource Planning), CRM ed e-commerce: NetSuite Risorse umane, finanza ed altre applicazioni ERP: SAP Business ByDesign, Workday Valeria Cardellini - SDCC 2012/13 32 Usando un IaaS provider Risorse virtualizzate pure CPU, memoria, storage e banda di rete Al più, sistema operativo (es. Amazon EC2) Accesso tramite Web service e/o Web API Usando un PaaS provider Risorse virtualizzate più framework applicativo Ad esempio: RoR (Ruby On Rails), Python,.NET Imposizione dell architettura dell applicazione e dei dati Limiti su come viene costruita l'applicazione Maggiori rischi di vendor lock-in Valeria Cardellini - SDCC 2012/13 33
Different kinds of service providers (SP) High-value SPs Intermediaries SPs Basic SPs Rackspace Infrastructure SPs Valeria Cardellini - SDCC 2012/13 34 Il Cloud customer ottiene le risorse che gli servono nel momento in cui ne ha bisogno" Elasticità nello scale-out e nello scale-in" Legata al modello pay-per-use" Non occorre più dimensionare lʼinfrastruttura sul picco di carico " Valeria Cardellini - SDCC 2012/13 35
Soluzioni tradizionali: sovra-dimensionamento Sovra-dimensionamento dell infrastruttura: comporta sotto-utilizzazione Utilizzazione dei server nei data center tradizionali In genere < 20%; in casi rari 30% Data center di Google: compresa tra 10% e 50% (nel 2007) Utilizzazione delle componenti di rete nei data center tradizionali In genere < 10% Costoso e con impatto negativo sull ambiente Valeria Cardellini - SDCC 2012/13 36 Sotto-dimensionamento dell infrastruttura: comporta forti penalità Valeria Cardellini - SDCC 2012/13 37
Animoto su Facebook (aprile 2008)" Da 25000 a 750000 utenti in soli 3 giorni" Con un picco di 20000 nuovi utenti allʼora" Valeria Cardellini - SDCC 2012/13 38 Contratto formale tra customer e provider di un servizio che specifica: Dettagli del servizio fornito, in termini di parametri ed obiettivi (Service Level Objective, SLO) concordati tra le parti (ad es. massimo tempo di risposta, disponibilità) Sanzioni e/o compensazioni in caso di violazione delle aspettative tra le parti" Valeria Cardellini - SDCC 2012/13 39
Monitoraggio a runtime del servizio Fonte: Sun Microsystems Internet Data Center Group Valeria Cardellini - SDCC 2012/13 40 Service Commitment Amazon EC2: http://aws.amazon.com/ec2-sla/" AWS will use commercially reasonable efforts to make Amazon EC2 available with an Annual Uptime Percentage (defined below) of at least 99.95% during the Service Year. In the event Amazon EC2 does not meet the Annual Uptime Percentage commitment, you will be eligible to receive a Service Credit as described below." Service Commitments and Service Credits If the Annual Uptime Percentage for a customer drops below 99.95% for the Service Year, that customer is eligible to receive a Service Credit equal to 10% of their bill (excluding one-time payments made for Reserved Instances) for the Eligible Credit Period. To file a claim, a customer We will apply any Service Credits only against future Amazon EC2 payments otherwise due from you." Valeria Cardellini - SDCC 2012/13 41
Scientific/Technical applications Business applications Consumer/Social applications Cloud applications Science and technical applications Consumer/Social applications Business applications Valeria Cardellini - SDCC 2012/13 42 Shazam samples music and then recognizes what song is playing Captures fragment of music, sends it to the cloud Precomputed search indexes are used to speed up the search, with a fine-grained match to improve accuracy Less common now, but coming soon: massive parallel search in real-time within a scaled-out cloud service Today s cloud is good at rapid replies but multiple machines rarely cooperate to compute an answer in real-time Valeria Cardellini - SDCC 2012/13 43
Interactive mobile applications" How to manage CPU-intensive and data-intesive applications (e.g., speech recognition, NLP, assisted vision, machine learning, and augmented reality)? " "Computation and storage offloading to a nearby cloud" Mobile devices with cloud-hosted UI" Mobile devices that sense the environment" Cloud-based mobile device management" Valeria Cardellini - SDCC 2012/13 44 How to deliver the capability to mine, search and analyze a huge quantity of data in near real time? Current Cloud-based solution:" Petabytes doubling & doubling Based on MapReduce and Apache Hadoop" Careful: data should be moved to cloud if there is a speedup in data processing (do not forget that latency is not zero!)" Valeria Cardellini - SDCC 2012/13 45
Benefici per l ambiente Benefici di businees Benefici IT Gartner s hype cycle for Cloud computing (Aug. 2012) Valeria Cardellini - SDCC 2012/13 46 Riassumendo: i principali benefici Scalabilità, elasticità, flessibilità" Quantità infinita di risorse disponibile su richiesta" Accessibilità anytime e anywhere" Accesso basato su Internet/Web" Semplicità di gestione" Ad es. versioning e aggiornamento del software" Eliminazione dellʼimpegno anticipato" I costi scalano con lʼutilizzo (infrastruttura come percentuale di profitto e non come costo fisso iniziale)" Innovazione di business più rapida" Maggiore produttività" Riduzione dellʼimpatto ambientale dellʼict in ottica green" Valeria Cardellini - SDCC 2012/13 47
Criticità per Cloud customer Privacy e sicurezza" Chi accede ai miei dati nella cloud?" Quanto mi fido del cloud provider?" E riguardo a recupero, tracciamento ed integrità dei dati?" Questioni legali e politiche" Di chi sono i dati?" Chi può usare i dati?" Dove sono localizzati i dati?" Ad es., AWS Regions per lo storage" Storm clouds?" You have zero privacy anyway. Get over it. (Scott McNealy, SUN CEO, 2009) If you have something that you don t want anyone to know, maybe you shouldn t be doing it in the first place... The reality is that search engines do retain information... It could become available later... (Eric Schmidt, Google CEO, 2009) Valeria Cardellini - SDCC 2012/13 48 Criticità per cloud customer (2) Progettazione di applicazioni scalabili fin dallʼinizio" Elasticità" Sì, ma talvolta manuale anziché automatica" Latenza di comunicazione" Distanza di qualche msec da cloud provider " Applicazioni real-time?" Rischi di vendor lock-in Ad es. data lock-in: difficoltà di migrazione dei dati in caso di cambio del cloud provider Mancanza di capacità di negoziazione e gestione di SLA Definizione di SLA (anche basati sull end-user experience): spesso generici, soprattutto per public cloud Monitoraggio di SLO: spesso a carico del cloud customer (vedi SLA di Amazon EC2) Mancanza di standardizzazione nei servizi offerti " Valeria Cardellini - SDCC 2012/13 49
News on June 30, 2012: Amazon cloud goes down Friday night, taking Netflix, Instagram and Pinterest with it Valeria Cardellini - SDCC 2012/13 50 Criticità per cloud provider Gestione di SLA Quanto costa fornire servizi con SLA? Effetto a cascata causato dalla violazione di un SLA ad un determinato livello dello stack cloud Incertezza e variabilità nella richiesta di servizio Ad es. nel caso di storage: pattern di utilizzo da parte degli utenti, tipo di workload predominante, frequenza di accesso delle risorse, volume di accesso delle risorse, località degli accessi, durata delle risorse, dimensione delle risorse Vincoli posti da cloud customer Richiesta di API aperte/standard Necessità di aggiungere continuamente valore Ogni applicazione è unica! Energy management Interoperabilità tra cloud Valeria Cardellini - SDCC 2012/13 51
Concludendo" Il Cloud computing " Ha le potenzialità per cambiare in modo sostanziale il modo in cui viene progettata l'architettura tecnica e di business delle aziende" Eʼ una tecnologia dirompente, in grado di determinare un conseguente scompiglio creativo" Ma i sistemi che supportano il Cloud computing sono estremamente complessi" Moltissimi server, miriadi di tecnologie, interazioni complesse tra reti e sistemi, miriadi di applicazioni con carichi eterogenei" Problemi già risolti diventano nuovi problemi su una scala senza precedenti " "La sfida: come rendere reali le potenzialità del Cloud"? Valeria Cardellini - SDCC 2012/13 52