1.Microsoft Cloud Services ArchitectureDavid Chou Architect, Microsoft

2. Courtesy wordle.net 3. Which is better? 1 gallon of fuel -> ton of freight; 20 miles 1 gallon of fuel -> 1 ton of freight; 436 miles Can goes anywhere there is a roadCan mostly go from A to B Ready to go anytimeLeaves 2x day at 9.12am and 11.14pmHigh ControlLowLowEconomy of Scale High 4. This is not new Build vs. Buy High ControlLow LowEconomy of Scale High 5. This is new On premises vs. in the cloud HighControl Low LowEconomy of Scale High 6. On premises vs. in the cloudApplication runs Application runs Application runson-premises at a hosterusing cloud servicesBuy my own Co-location cloud fabrichardware, andor(elastic, manage my own Managed infini-scale) data centerserversHighControl Low LowEconomy of Scale High 7. On premises vs. in the cloud Packaged Hosted Software as aBuyApplicationPackagedService An applicationAn applicationA hostedthat I buy off that I buy off application that Build vs. Buythe shelf andthe shelf andI buy from arun myselfrun at a hostervendor Home Built HostedCloudApplication Home Built Platform An applicationAn applicationAn applicationthat I developthat I developthat I developBuildand run myselfmyself, but run myself, but runat a hosterin the cloud On premisesCloud 8. All acceptable options (trade off)PackagedHostedSoftware as aBuyApplication Packaged ServiceMaximumAn applicationthat I buy off theAn applicationthat I buy off the A hosted application that Build vs. BuyControlshelf and run shelf and then I buy from a myself run at a hostervendor Home BuiltHostedCloud PlatformApplicationHome BuiltMaximum applicationAnAn application Economy of Scale An application that I developthat I developthat I develop myself, but runBuildand run myselfmyself, but run atin the clouda hosterOn premisesOn premises vs. CloudCloud 9. A Sample Enterprise PackagedHosted Software as aBuyApplication PackagedServiceERP Build vs. Buy Issue TrackingEmailHome BuiltHostedCloud PlatformApplicationHome BuiltHR SystemMolecule ResearchBuildClinical TrialOn premises On premises vs. CloudCloud 10. A Sample EnterprisePackaged Hosted Software as aBuy ApplicationPackagedService ERP Build vs. Buy Issue TrackingHR System EmailHome BuiltHostedCloud PlatformApplicationHome Built Molecule ResearchBuildClinical TrialOn premises On premises vs. Cloud Cloud 11. More than build vs. buy and hosting location Data ConsistencyShare & Reuse Security & Privacy CustomizabilityHighControlCloud On-Premises Economy of ScaleHigh Ease of ProvisioningGlobal ReachPartitioning & RedundancyData Availability 12. Consistency vs. Availability (ACID vs. BASE) ACID BASE Atomicity Basically Available Consistency Soft state Isolation Eventually consistent Durability Focus on commit Availability first; best effort Conservative (pessimistic) Aggressive (optimistic) 13. CAP (Consistency, Availability, Partition) TheoremAt most two of these properties for any shared-data system A Consistency + Availability C High data integrity P Single site, cluster database, LDAP, xFS file system, etc. 2-phase commit, data replication, etc.Consistency + Partition C A Distributed database, distributed locking, etc. P Pessimistic locking, minority partition unavailable, etc. Availability + Partition C A High scalability P Distributed cache, DNS, etc. Optimistic locking, expiration/leases, etc.Towards Robust Distributed Systems, Dr. Eric A. Brewer, UC Berkeley 14. Spectrum of ChoicesExtend existing Deploy CompleteCompose New Application On-Premise Application Application in the Cloud from Cloud Services 15. 16. Service Workflow DatabaseAnalytics Identity ContactsBus Access Reporting Devices Control Compute StorageManage 17. Cloud services operating system that provides on-demand compute and storage capabilities to host, scale, and manage applicationsCompute Services Scalable and reliable Web applications 64-bit hosting service in the cloud .NET 3.5 SP1, managed code, ASP.NET, IIS 7, SOAP/REST/XML, PHP, Ruby, Python Security supported by flexible Code Access Security policies Small runtime API supports logging and local scratch storageStorage Services Simple data storage for cloud-based applications Blobs, tables, and queues; local and remote REST-based access to data Authenticated access and triple replicationManagement Services Manage the applications, not infrastructure Advanced tracing & logging monitor compute, storage, and bandwidth Dynamically upgrade applications without downtime Resource usage and performance insights; monitoring & meteringDevelopment Tools Model and execute business logic and service interactions Complete offline environment, including compute and storage services Visual Studio add-in enables local debugging (Eclipse soon) 18. Highly scalable and Internet-facing distributed database services in the cloud for storing structured and unstructured data, and processing relational queriesService Bus Exchange messages between loosely coupled, composite applications Connectivity to on-premises applications; secure, federated firewall-friendly messaging;simple, connected pub-sub eventing; extension of WCF Federated namespace shared, hierarchical, Internet-accessible URL Service registry publish service endpoints, lightweight, hierarchical, RSS-based discovery Relay and connectivity NAT traversal, pull-mode message delivery, Web serviceintermediary, WS-*/SOAP, RESTAccess Control Service Rules-driven application access control to users across organizations Security Token Service (STS) User name/password, Windows CardSpace, X.509 certificate,3rd-party STS-issued SAML token, WS-Security, WS-Federation Each .NET Services solution has a private, isolated STS; backing identity infrastructure for allservices published within that solutions Service Bus namespace Claims-based rules-driven authorization configured via claim mappingsWorkflow Service Model and execute business logic and service interactions Reliable and scalable cloud runtime environment for user-defined declarative workflows Extends Windows Workflow Foundation (.NET 3.5) to the cloud Activities optimized for sending, receiving, and manipulating HTTP and Service Bus messages Deploy, manage and track running workflow instances using tools and APIs 19. Highly scalable and Internet-facing distributed database services in the cloud for storing structured and unstructured data, and processing relational queriesSQL Data Services Internet-facing database built on SQL Server relational database Data storage blobs, flexible, structured, birth to archival, multiple consistency levels Data Processing filters, aggregates, user-defined logic, online-offline indexing Data Delivery network proximity aware, locate closest static-content copies, spanning treesfor live-content, failure resiliencyScalable, Flexible, Reliable, and Secure High-availability database, scale as needed and without limits Data partitions limited to single node on cluster efficient replication and load balancing Geo-replication and transactional consistency of data across multiple copies Geo-location configuration helps protect against latency and improve response time HTTPS/SSL support; built on SQL Server security infrastructureDeveloper Agility Standards-based interface and familiar language support Access runtimes through standards-based interfaces and Web services SOAP and REST Perform CRUD operations with authorities, containers, and entities Relational queries via text-based queries, LINQ, typed data in XML wire format Simple filtering, retrieval of complete entities, full-text search, paging queries Flexible data model, no schema required 20. A set of building blocks for handling user data and application resources, and extensible components to build rich social applications and consumer experiencesLive Framework Extensible components to build rich consumer services Mesh Services build applications that span across the web, devices, apps, and services oUser Mesh management and sharing resources across multiple users oDevice facilities for managing the collection of heterogeneous devices; relationship, status, security oSynchronization data and metadata synchronization framework across applications, devices, and cloud oApplication facilities for managing the configuration, deployment, and versioning of applications Identity Services manage identities with associated services; delegated authentication Directory Services manage relationships between identities, data, devices, and apps User-Data Storage Services manage user-centric information; extensible data types Communication and Presence Services transport infrastructure for transient and persistentstate management between applications and devices Search Services facilities for building search capailities for web sites and applications Geospatial Services geocoding/reverse geocoding, routing, search, mapping dataDevelopment Platform Uniform way for programming Live Services from any platform, language, application or device Exposes RESTful programming model for live resources Protocol based open standards usage: HTTP, XML, ATOM, RSS Resource Model: unified model across Live Symmetric client/cloud programming model CRUD/Query, triggers and SPROC based interaction model Libraries: Rich client libraries (.NET, Silverlight, JavaSript etc.) 21. Azure & .NET FrameworkBuild, test, debug, and deploy using a single familiar toolsetClient ServerServices Desktop &On-premises Mobile Experiences & Hosted Servers 22. Design Considerations dataprocess security management read-only stateless claims-based leverage automation authentication public / share- idempotent plan for average load ableidentity isolationaware of application federation reference data lifecycles loosely-coupled end user idntities primary keyrolling changes to live asynchronous access services IPC Not all data ishandle dynamic data fault-tolerant equalschema and (expect failures)configurationchanges 23. Potential Scenarios Parallel and distributed processing Image processing and rendering Media content transcoding and publishing) Finding extra-terrestrials Voting systems Share-able reference data Search indexes Catalogs Maps, profiles, blogs, files, documents, etc. Composite services, mashups Agent architectures Multi-enterprise business applications (MEBA) Inter-organizational (B2B) business processes Extend enterprise SOA to other enterprises 24. Scenario NBC Olympics1.3 billion page views 50 million unique visitors 70 million videos watched 27 minutes of viewing per session 600 million minutes of video delivery 5,000 unique clips viewed per dayduring the final week 35 million mobile views 130,000 peak streams 3.4 petabytes of video delivered 25. Scenario NBC Olympics NBC (New York and Beijing) Microsoft (Redmond) DeltaTre (Italy) Schematic (New York, Atlanta, Costa Rica) Limelight Networks Level3 Digital Rapids Anystream Signiant DoubleClick Omniture Keynote Sliq 26. Scenario NBC Olympics Live Event International 30 RockDMZsLimelight (Beijing) Broadcast (New York) (New& Level3 CenterJersey,(Beijing) Burbank) CDNVideo Video Production Workflow Distribution Player 27. Scenario Next-Generation B2B Collaboration Characteristics Near-time collaboration between many partners Many-to-many relationships Physically distributed locations Complex workflows managing processes that span organizations Shared data Network effect whole > sum of its parts Agile implementation 28. Emerging Patterns De-perimeterization Democratization of industries Dynamic business models Relationship networking core competencies Shifting process centers of gravity Plug-and-play IT architectures Model-driven development, DSL 29. Thank you! david.chou@microsoft.comblogs.msdn.com/dachou 2008 Microsoft Corporation. All rights reserved. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.