KEMBAR78
Chapter 2 Cloud Computing and Databases.pptx
1
Chapter 2
Cloud Computing and Databases
2
Outline
 Overview of Cloud Computing and Databases
 Benefits of Cloud Databases
 Cloud Database Service Providers
3
Cloud Computing Definition
•Cloud computing is using the Internet to access
someone else's software running on someone else's
hardware in someone else's data center
Lewis Cunningham, Cloud Computing with Amazon and Oracle, 2008.
4
Definitions…
• A large-scale distributed computing paradigm that is driven
by economies of scale, in which a pool of abstracted,
virtualized, dynamically scalable, managed computing power,
storage, platforms, and services are delivered on demand to
external customers over the Internet.
Ian Foster, Yong Zhao, Ioan Raicu, Shiyong Lu, Cloud Computing and Grid Computing 360-Degree
Compared, Grid Computing Environments Workshop, 2008.
5
Definitions…
• A Cloud is a type of parallel and distributed system consisting
of a collection of interconnected and virtualized computers
that are dynamically provisioned and presented as one or
more unified computing resources based on service-level
agreements established through negotiation between the
service provider and consumers.
Rajkumar Buyya, Chee Shin Yeo, and Srikumar Venugopal, Market-Oriented Cloud Computing: Vision, Hype,
and Reality for Delivering IT Services as Computing Utilities, International Conference on High Performance
Computing, 2008
6
Definitions…
Cloud Computing is “A model for enabling convenient, on-
demand network access to a shared pool of configurable
computing resources (e.g., networks, servers, storage,
applications, and services) that can be rapidly provisioned and
released with minimal management effort or service provider
interaction”
NIST
7
Definitions…
• On-demand availability of computer system resources, especially data
storage and computing power, without direct active management by
the user
8
Conventional Computing
vs.
Cloud Computing
Conventional
 Manually Provisioned
 Dedicated Hardware
 Fixed Capacity
 Pay for Capacity
 Capital & Operational Expenses
 Managed via Sysadmins
Cloud
 Self-provisioned
 Shared Hardware
 Elastic Capacity
 Pay for Use
 Operational Expenses
 Managed via APIs
9
Essential Characteristics of Cloud Computing
1. Shared / pooled resources
2. Broad network access
3. On-demand self-service
4. Scalable and elastic
5. Metered by use / Measured services
10
Characteristics…
Shared / Pooled Resources:
• Resources are drawn from a common pool
• Common resources build economies of scale
• Common infrastructure runs at high efficiency
11
Characteristics…
Broad Network Access:
• Open standards and APIs
• Almost always IP, HTTP, and REST
• Available from anywhere with an Internet connection
12
Characteristics…
On-Demand Self-Service:
• Completely automated
• Users abstracted from the implementation
• Near real-time delivery (seconds or minutes)
• Services accessed through a self-serve web interface
13
Characteristics…
Scalable and Elastic:
• Resources dynamically-allocated between users
• Additional resources dynamically-released when needed
• Fully automated
14
Characteristics…
Metered by Use:
• Services are metered, like a utility
• Users pay only for services used
• Services can be cancelled at any time
15
Cloud Service Models
 Cloud Software as a Service (SaaS)
 Cloud Platform as a Service (PaaS)
 Cloud Infrastructure as a Service (IaaS)
16
Service Model Overview
17
Cloud Service Models
Software as a
Service (SaaS)
Platform as a
Service (PaaS)
Infrastructure as a
Service (IaaS)
Google
App
Engine
SalesForce CRM
LotusLive
Adopted from: Effectively and Securely Using the Cloud Computing Paradigm by peter Mell, Tim Grance
18
Cloud Service Models …
Service Model at a glance: Picture From http://en.wikipedia.org/wiki/File:Cloud_Computing_Stack.svg
19
Infrastructure as a Service (IaaS)
• The capability provided to the consumer is to provision processing,
storage, networks, and other fundamental computing resources
• Consumer is able to deploy and run arbitrary software, which can
include operating systems and applications
• The consumer does not manage or control the underlying cloud
infrastructure but has control over operating systems, storage,
deployed applications, and possibly limited control of select
networking components (e.g., host firewalls)
• Examples: Amazon EC2, GoGrid, iland, Rackspace Cloud Servers,
ReliaCloud.
20
Infrastructure as a Service …
• System architecture :
21
Infrastructure as a Service…
• Enabling technique - Virtualization
• Virtualization is an abstraction of logical resources away from underlying
physical resources
• Virtualization technique shift OS onto hypervisor
• Multiple OS share the physical hardware and provide different services
• Improve utilization, availability, security and convenience
VM1 VM2 VM3
22
Infrastructure as a Service…
• Properties supported by virtualization technique :
• Manageability and Interoperability
• Availability and Reliability
• Scalability and Elasticity
23
Infrastructure as a Service…
• Provide service –Resource Management Interface
• Several types of virtualized resource :
• Virtual Machine – As an IaaS provider, we should be able to provide the basic virtual
machine operations, such as creation, suspension, resumption and termination, …etc.
• Virtual Storage – As an IaaS provider, we should be able to provide the basic virtual
storage operations, such as space allocation, space release, data writing and data
reading, …etc.
• Virtual Network – As an IaaS provider, we should be able to provide the basic virtual
network operations, such as IP address allocation, domain name register, connection
establishment and bandwidth provision, …etc.
24
Infrastructure as a Service…
• Provide service – System Monitoring Interface
• Several types of monitoring metrics :
• Virtual Machine – As an IaaS provider, we should be able to monitor some system states
of each virtual machine, such as CPU loading, memory utilization, IO loading and internal
network loading, …etc.
• Virtual Storage – As an IaaS provider, we should be able to monitor some storage states
of each virtual storage, such as virtual space utilization, data duplication and storage
device access bandwidth, …etc.
• Virtual Network – As an IaaS provider, we should be able to monitor some network
states of each virtual network, such as virtual network bandwidth, network connectivity
and network load balancing, …etc.
25
Platform as a Service (PaaS)
• The capability provided to the consumer is to deploy onto the cloud
infrastructure consumer created or acquired applications created
using programming languages and tools supported by the provider
• The consumer does not manage or control the underlying cloud
infrastructure including network, servers, operating systems, or
storage, but has control over the deployed applications and possibly
application hosting environment configurations
• Examples: Windows Azure, Google App.
26
Platform as a Service…
• System architecture :
27
Platform as a Service…
• Enabling technique – Runtime Environment Design
• Runtime environment refers to collection of software services available.
Usually implemented by a collection of program libraries.
• Common properties in Runtime Environment :
• Manageability and Interoperability
• Performance and Optimization
• Availability and Reliability
• Scalability and Elasticity
28
Platform as a Service…
• Provide service – Programming IDE
• Users make use of programming IDE to develop their service among PaaS.
• This IDE should integrate the full functionalities which supported from the underling
runtime environment.
• This IDE should also provide some development tools, such as profiler, debugger and
testing environment.
• The programming APIs supported from runtime environment may be various
between different cloud providers, but there are still some common operating
functions.
• Computation, storage and communication resource operation
29
Platform as a Service…
• Provide service – System Control Interface
• Police-Based Control
• Typically described as a principle or rule to guide decisions and achieve rational
outcome(s)
• Make the decision according to some requirements
• Workflow Control
• Describe the flow of installation and configuration of resources
• Workflow processing daemon delivers speedy and efficient construction and
management of cloud resources
30
Software as a Service (SaaS)
• The capability provided to the consumer is to use the provider’s
applications running on a cloud infrastructure
• The applications are accessible from various client devices through a
thin client interface such as a web browser (e.g., web-based email)
• The consumer does not manage or control the underlying cloud
infrastructure including network, servers, operating systems, storage,
or even individual application capabilities, with the possible exception
of limited user specific application configuration settings
• Examples: Caspio, Google Apps, Salesforce, Nivio, Learn.com.
31
Software as a Service…
32
Software as a Service…
• Enabling Technique – Web Service
• Web 2.0 is the trend of using the full potential of the web
• Viewing the Internet as a computing platform
• Running interactive applications through a web browser
• Leveraging interconnectivity and mobility of devices
• Enhanced effectiveness with greater human participation
• Properties provided by Internet :
• Accessibility and Portability
33
Software as a Service…
• Provide service – Web-based Applications
• Conventional applications should translate their access interface onto web-
based platform.
• Applications in different domains
• General Applications – Applications which are designed for general propose, such as
office suit, multimedia and instant message, …etc.
• Business Applications – Application which are designed for business propose, such as
ERP, CRM and market trading system, …etc.
• Scientific Applications – Application which are designed for scientific propose, such as
aerospace simulation and biochemistry simulation, …etc.
• Government Applications – Applications which are designed for government propose,
such as national medical system and public transportation system service, …etc.
34
Software as a Service…
• Provide service – Web Portal
• Apart from the standard search engine feature, web portals offer other
services such as e-mail, news, stock prices, information, databases and
entertainment
• Portals provide a way for enterprises to provide a consistent look and feel
with access control and procedures for multiple applications and databases,
which otherwise would have been different entities altogether
• Some examples :
• iGoogle
• MSNBC
• Netvibes
• Yahoo!
35
Cloud Deployment Model
• There are four primary cloud deployment models :
• Public Cloud
• Private Cloud
• Community Cloud
• Hybrid Cloud
• Their differences lie primarily in the scope and access of published
cloud services, as they are made available to service consumers.
36
Public Cloud
• Public cloud definition
• The cloud infrastructure is made available to the general public or a large
industry group and is owned by an organization selling cloud services
• Also known as external cloud or multi-tenant cloud, this model essentially
represents a cloud environment that is openly accessible
• Basic characteristics :
• Homogeneous infrastructure
• Common policies
• Shared resources and multi-tenant
• Leased or rented infrastructure
• Economies of scale
37
Private Cloud…
• Private cloud definition
• The cloud infrastructure is operated solely for an organization. It may be
managed by the organization or a third party and may exist on premise or off
premise
• Also referred to as internal cloud or on-premise cloud, a private cloud
intentionally limits access to its resources to service consumers that belong to the
same organization that owns the cloud
• Basic characteristics :
• Heterogeneous infrastructure
• Customized and tailored policies
• Dedicated resources
• In-house infrastructure
• End-to-end control
38
Public vs. Private
• Comparison :
Public Cloud Private Cloud
Infrastructure Homogeneous Heterogeneous
Policy Model Common defined Customized & Tailored
Resource Model Shared & Multi-tenant Dedicated
Cost Model Operational expenditure Capital expenditure
Economy Model Large economy of scale End-to-end control
39
Private VS Public Cloud
40
Community Cloud
• Community cloud definition
• The cloud infrastructure is shared by several organizations and supports a
specific community that has shared concerns (e.g., mission, security
requirements, policy, and compliance considerations)
• It may be managed by the organizations or a third party and may exist on-
premises or off-premises
41
Hybrid Cloud
• Hybrid cloud definition
• The cloud infrastructure is a composition of two or more clouds (private,
community, or public) that remain unique entities but are bound together by
standardized or proprietary technology that enables data and application
portability (e.g., cloud bursting for load-balancing between clouds)
42
43
Discussion Point
What can we gain from cloud ?
Cloud computing offers numerous
benefits, including:
1. Scalability
•Easily scale resources up or down based on
demand.
•No need for costly infrastructure investments.
2. Cost Efficiency
•Pay only for what you use (pay-as-you-go
model).
•Reduces capital expenses (CAPEX) on
hardware.
3. Flexibility & Accessibility
•Access data and applications from anywhere
with an internet connection.
•Supports remote work and global
collaboration.
4. Security & Reliability
•Cloud providers offer advanced security
features (encryption, firewalls, threat
monitoring).
•Ensures data backup and disaster recovery.
5. Automatic Updates & Maintenance
•Providers handle software updates and
maintenance.
•Reduces the burden on IT teams.
6. Better Collaboration
•Teams can work on shared documents in real-
time.
•Integrates with collaboration tools like Google
Workspace, Microsoft 365, etc.
7. Big Data & Analytics
•Supports large-scale data storage and
processing.
•Enables AI, machine learning, and business
intelligence applications.
8. Innovation & Speed
•Deploy applications faster with cloud-based
development tools.
•Supports agile development and DevOps practices.
9. Environmental Benefits
•Optimized resource usage reduces energy
consumption.
•Cloud providers invest in energy-efficient data
centers.
10. Disaster Recovery & Business
Continuity
•Data is backed up in multiple locations.
•Minimizes downtime and data loss risks.
44
Benefits From Cloud
• Cloud computing brings many benefits :
• For the market and enterprises
• Reduce initial investment
• Reduce capital expenditure
• Improve industrial specialization
• Improve resource utilization
• For the end user and individuals
• Reduce local computing power
• Reduce local storage power
• Variety of thin client devices in daily life
45
For Market and Enterpeises
46
Reduce Initial Investment
• Traditional process of enterprises to initiate business :
• Survey and analysis the industry and market
• Estimate the quantity of supply and demand
• Purchase and deploy IT infrastructure
• Install and test the software system
• Design and develop enterprise specific business service
• Announce the business service to clients
• Some drawbacks :
• The survey, analysis and estimation may not 100% correct
• Infrastructure deployment is time consuming
• Enterprises should take the risk of wrong investment
47
Reduce Initial Investment
• Initiate business with Cloud Computing services :
• Survey and analysis the industry and market
• Chose one cloud provider for enterprise deployment
• Design and develop business service upon cloud environment
• Announce the business service to clients
• Some benefits :
• Enterprise do not need to own the infrastructure
• Enterprise can develop and deploy business service in short time
• Enterprise can reduce the business loss of wrong investment
48
Reduce Initial Investment
• What dose cloud computing achieve ?
Traditional With Cloud Computing
Investment Risk Enterprise takes the risk Cloud reduces the risk
Infrastructure
Enterprise owns the
infrastructure
Cloud provider owns the
infrastructure
Time duration Long deployment time Fast to business ready
49
Reduce Capital Expenditure
• Traditional capital expenditure of enterprises :
• Each enterprise should establish its own IT department
• IT department should handle the listing jobs
• Manage and administrate hardware and software
• Apply regular data backup and check point process
• Purchase new infrastructure and eliminate outdated one
• Always standby for any unexpected IT problems
• Some drawbacks :
• Enterprise pays for IT investment which is not its business focus
• Enterprise should take the risk of hardware/software malfunction
• Replacing and updating infrastructure is time consuming and risky
50
Reduce Capital Expenditure
• Capital expenditure with Cloud Computing service :
• Enterprise can almost dismiss its IT department
• The jobs of IT department can be achieved by cloud provider
• Dynamically update and upgrade hardware or software
• Dynamically provision and deploy infrastructure for enterprise
• Automatically backup data and check consistency
• Self-recover from disaster or system malfunction
• Some benefits :
• Enterprise can shift effort to its business focus
• Enterprise can reconfigure its IT services in short time
• Enterprise pays to cloud provider as many as the service used
51
Reduce Capital Expenditure
• What dose cloud computing achieve ?
Traditional With Cloud Computing
Business focus Need to own its IT
department
Cloud provider takes
care everything
Payment
Pay for all investment
and human resource
Enterprise pays as the
service used
Time duration Long establish time Fast to business ready
52
Improve Industrial Specialization
• Traditional industry and market :
• Every enterprise has to own its IT department
• IT resource is managed by enterprise themselves
• IT complexity should be well taken care by enterprise themselves
• Some drawbacks :
• IT department is not the business focus of enterprise
• Most of enterprises do not well maintain their IT resources
• Enterprise not often optimizes their IT resource usage
53
Improve Industrial Specialization
• Collaboration with Cloud providers :
• Cloud providers centrally maintain IT infrastructure for clients
• Cloud providers employ experts for management and
administration
• Cloud providers focus on providing reliable IT services
• Enterprises only rent the service they need and care
• Some benefits :
• Industrial specialization will be improved
• IT service performance will be optimized
• Enterprise business focus will be enhanced
• IT resource waste will be reduced
54
Improve Industrial Specialization
• What dose cloud computing achieve ?
Traditional With Cloud Computing
Collaboration Enterprise needs to take
care everything
Enterprise focuses on its
own business
Management
Enterprise works with
poor manageability
Cloud provider applies
professional control
Relationship Stand alone enterprise Win-Win partnership
55
Improve Resource Utilization
• Traditional industry and market :
• Enterprise seldom takes care about IT resource utilization
• Enterprise owns their IT resource without well management
• IT resource usually over invested for peak demand
• Some drawbacks :
• Power and space utilization among enterprises are wasted
• IT resources across enterprises cannot be shared
56
Improve Resource Utilization
• Collaboration with Cloud providers :
• IT resources are centrically managed and optimized
• Cloud provider builds performance optimized hardware
• Cloud provider builds consolidated cooling system
• Cloud provider will consider the geographic issues
• Cloud provider will consider legal policy issues
• Some benefits :
• IT infrastructure can be shared among enterprises
• IT infrastructure performance and utilization can be optimized
• Large-scale integrated optimization can be applied
57
Improve Resource Utilization
• What dose cloud computing achieve ?
Traditional With Cloud Computing
IT Resource
Utilization
IT resource under
utilized most of time
Share to improve
utilization of IT resource
Power
Consumption
Waste power and
cooling system
Cloud system should be
global optimized
58
For End User and Individual
59
Reduce Local Computing Power
• Traditional local computing power requirement :
• One need to buy your own personal computer
• Buy powerful processor if you need intensive computing
• Buy large memory to meet application requirement
• Install plenty of applications in need
• Some drawbacks :
• One can hardly replicate the same system environment
• One needs to regularly update or upgrade software and hardware
• One needs to reinstall all applications if you reinstall the OS
60
Reduce Local Computing Power
• Using Cloud Computing services :
• One can utilize the remote computing power in the cloud
• One needs only basic computing power to connect to internet
• Application in the cloud will automatically upgrade
• Some benefits :
• One can access his/her applications anywhere through the Internet
• One can dynamically request for computing power on demand
• Application may need not to be reinstalled even reinstall the OS
61
Reduce Local Computing Power
• What dose cloud computing achieve ?
Traditional With Cloud Computing
Hardware
Requirement
User needs to buy
powerful hardware
Only basic hardware to
connect to internet
Software
Requirement
Install application in
local computer
No local installation
requirement
Portability Hard to be portable Natively portable
62
Reduce Local Storage Power
• Traditional local storage power requirement :
• User programs and data files are stored in local devices
• User has to backup data regularly preventing hardware damage
• Some drawbacks :
• Storage space may not enough for burst data requirement
• Storage space may be over needed which result in resource waste
• Data consistency is hard to maintain between computers
• Need to sacrifice part of storage space for data backup
63
Reduce Local Storage Power
• Using Cloud Computing services :
• User programs and data files are stored in the cloud
• Cloud service provider will guarantee the data availability
• Some benefits :
• One can dynamically allocate storage space on demand
• One can access data anywhere through the Internet
• No need to care about data consistency between computers
• No need to care about data loss due to hardware damage
64
Reduce Local Storage Power
• What dose cloud computing achieve ?
Traditional With Cloud Computing
Storage Space Limited to local disk,
may be under utilized
Dynamically allocated
on demand
Storage Data
Consistency
Difficult to maintain
data consistency
Data consistency
maintained by cloud
Availability Regular user backup Cloud service guarantee
65
Variety of End Devices
• Traditional computing resource :
• One can connect to the Internet by personal computer
• Only personal computer can deliver reasonable computing power
• Small devices cannot perform incentive computation due to their power and
hardware limitation
• Some drawbacks :
• Computing power is not portable
• Small devices can only perform simplified works
66
Variety of End Devices
• Devices collaborate with Cloud services :
• Device connects to the Internet through wireless network
• Device accesses cloud services through web service interface
• Device sends computing incentive jobs into cloud and wait for
results
• Some benefits :
• User can easily access cloud service through small devices
• User can access almost unlimited computing power anywhere
• Small devices can be intelligently managed through cloud (IoT)
67
Variety of End Devices
• What dose cloud computing achieve ?
Traditional With Cloud Computing
Computing
Power
Only accessed through
desktop computer
Accessed through small
smart devices
Small Device
Intelligence
Functionalities was
limited due to their
power consumption
Shift computing incentive
jobs into cloud, and then
wait for results
68
Advantages of Cloud Computing
• Lower computer costs:
 You do not need a high-powered and high-priced computer to run cloud
computing's web-based applications
 Since applications run in the cloud, not on the desktop PC, your desktop PC
does not need the processing power or hard disk space demanded by
traditional desktop software
 When you are using web-based applications, your PC can be less expensive,
with a smaller hard disk, less memory, more efficient processor...
 In fact, your PC in this scenario does not even need a CD or DVD drive, as no
software programs have to be loaded and no document files need to be saved
69
Advantages of Cloud Computing
• Improved performance:
 With few large programs hogging your computer's memory, you will see
better performance from your PC
 Computers in a cloud computing system boot and run faster because they
have fewer programs and processes loaded into memory…
• Reduced software costs:
 Instead of purchasing expensive software applications, you can get most of
what you need for free-ish!
• most cloud computing applications today, such as the Google Docs suite.
 better than paying for similar commercial software
• which alone may be justification for switching to cloud applications.
70
Advantages of Cloud Computing
• Instant software updates:
 Another advantage to cloud computing is that you are no longer faced with choosing between
obsolete software and high upgrade costs
 When the application is web-based, updates happen automatically
• available the next time you log into the cloud.
 When you access a web-based application, you get the latest version
• without needing to pay for or download an upgrade.
• Improved document format compatibility:
 You do not have to worry about the documents you create on your machine being compatible
with other users' applications or OSes
 There are potentially no format incompatibilities when everyone is sharing documents and
applications in the cloud
71
Advantages of Cloud Computing
• Unlimited storage capacity:
 Cloud computing offers virtually limitless storage
 Your computer's current 1 Tbyte hard drive is small compared to the hundreds
of Pbytes available in the cloud
• Increased data reliability:
 Unlike desktop computing, in which if a hard disk crashes and destroy all your
valuable data, a computer crashing in the cloud should not affect the storage
of your data
• if your personal computer crashes, all your data is still out there in the cloud, still accessible
 In a world where few individual desktop PC users back up their data on a
regular basis, cloud computing is a data-safe computing platform!
72
Advantages of Cloud Computing
• Universal document access:
 That is not a problem with cloud computing, because you do not take your
documents with you
 Instead, they stay in the cloud, and you can access them whenever you have a
computer and an Internet connection
 Documents are instantly available from wherever you are
• Latest version availability:
 When you edit a document at home, that edited version is what you see
when you access the document at work.
 The cloud always hosts the latest version of your documents
• as long as you are connected, you are not in danger of having an outdated version
73
Advantages of Cloud Computing
• Easier group collaboration:
 Sharing documents leads directly to better collaboration
 Many users do this as it is an important advantages of cloud computing
• multiple users can collaborate easily on documents and projects
• Device independence:
 You are no longer tied to a single computer or network
 Changes to computers, applications and documents follow you through the
cloud
 Move to a portable device, and your applications and documents are still
available
74
Disadvantages of Cloud Computing
• Requires a constant Internet connection:
 Cloud computing is impossible if you cannot connect to the Internet
 Since you use the Internet to connect to both your applications and
documents, if you do not have an Internet connection you cannot access
anything, even your own documents
 A dead Internet connection means no work and in areas where Internet
connections are few or inherently unreliable, this could be a deal-breaker
75
Disadvantages of Cloud Computing
• Does not work well with low-speed connections:
 Similarly, a low-speed Internet connection, such as that found with dial-up
services, makes cloud computing painful at best and often impossible
 Web-based applications require a lot of bandwidth to download, as do large
documents
• Features might be limited:
 This situation is bound to change, but today many web-based applications
simply are not as full-featured as their desktop-based applications
• For example, you can do a lot more with Microsoft PowerPoint than with Google
Presentation's web-based offering
76
Disadvantages of Cloud Computing
• Can be slow:
 Even with a fast connection, web-based applications can sometimes be
slower than accessing a similar software program on your desktop PC
 Everything about the program, from the interface to the current document,
has to be sent back and forth from your computer to the computers in the
cloud
 If the cloud servers happen to be backed up at that moment, or if the
Internet is having a slow day, you would not get the instantaneous access
you might expect from desktop applications
77
Disadvantages of Cloud Computing
• Stored data might not be secure:
 With cloud computing, all your data is stored on the cloud
• The questions is How secure is the cloud?
 Can unauthorized users gain access to your confidential data?
• Stored data can be lost:
 Theoretically, data stored in the cloud is safe, replicated across multiple
machines
 But on the off chance that your data goes missing, you have no physical or
local backup.
• Put simply, relying on the cloud puts you at risk if the cloud lets you down
78
Disadvantages of Cloud Computing
• HPC Systems:
 Not clear that you can run compute-intensive HPC applications that use
MPI/OpenMP!
 Scheduling is important with this type of application
• as you want all the VM to be co-located to minimize communication latency!
• General Concerns:
 Each cloud systems uses different protocols and different APIs
• may not be possible to run applications between cloud based systems
 Amazon has created its own DB system (not SQL 92), and workflow system
(many popular workflow systems out there)
• so your normal applications will have to be adapted to execute on these platforms
79
Opportunities and Challenges
• The use of the cloud provides a number of opportunities:
 It enables services to be used without any understanding of their
infrastructure
 Cloud computing works using economies of scale:
• It potentially lowers the outlay expense for start up companies, as they would no longer
need to buy their own software or servers
• Cost would be by on-demand pricing
• Vendors and Service providers claim costs by establishing an ongoing revenue stream
 Data and services are stored remotely but accessible from “anywhere”
80
Opportunities and Challenges
• In parallel there has been backlash against cloud computing:
 Use of cloud computing means dependence on others and that could possibly limit flexibility and
innovation:
• The others are likely become the bigger Internet companies like Google and IBM, who may monopolise the market
• Some argue that this use of supercomputers is a return to the time of mainframe computing that the PC was a
reaction against.
 Security could prove to be a big issue:
• It is still unclear how safe out-sourced data is and when using these services ownership of data is not always clear
 There are also issues relating to policy and access:
• If your data is stored abroad whose policy do you adhere to?
• What happens if the remote server goes down?
• How will you then access files?
• There have been cases of users being locked out of accounts and losing access to data.
81
The Future
 Many of the activities loosely grouped together under cloud computing
have already been happening and centralised computing activity is not a
new phenomena
 Grid Computing was the last research-led centralised approach
 However there are concerns that the mainstream adoption of cloud
computing could cause many problems for users
 Many new open source systems appearing that you can install and run on
your local cluster
• should be able to run a variety of applications on these systems
82
NIST Cloud Computing Reference Architecture
The Conceptual Reference Model
83
NIST Cloud Computing Reference Architecture …
Actors in Cloud Computing
84
NIST Cloud Computing Reference Architecture …
Interaction between the Actors in Cloud Computing
85
NIST Cloud Computing Reference Architecture …
Usage Scenario for Cloud Broker
86
NIST Cloud Computing Reference Architecture …
Usage Scenario for Cloud Carrier
87
NIST Cloud Computing Reference Architecture …
Usage Scenario for Cloud Auditor
88
NIST Cloud Computing Reference Architecture …
Example Services available to a Cloud Consumer
89
NIST Cloud Computing Reference Architecture
…
Cloud Provider- Major Activities
90
Cloud Ecosystem
91
Cloud Ecosystem Actors
• Cloud Service User (CSU): a person or an organization that consumes delivered cloud
services.
• A CSU can include intermediate users that will deliver cloud services provided by a
cloud service provider (CSP) to actual users of the cloud service, i.e. end users.
• End users can be persons, machines, or applications.
92
Cloud Ecosystem Actors
Cloud Service Provider (CSP): an organization that provides and maintains
delivered cloud services
93
Cloud Ecosystem Actors
• Cloud Service Partner (CSN): a person or an organization that
provides support to the building of the service offer of a CSP (e.g.
service integration).
94
The three actors of cloud ecosystem
95
Cloud Database
96
What are Cloud Databases?
• Cloud databases are databases that run on cloud computing
platforms.
• Instead of managing your own database servers, you rely on a cloud
providers (like AWS, Azure, or Google Cloud) to host and manage the
database infrastructure.
97
Key types of cloud databases
• Relational Databases:
• Traditional Structure : Based on the relational model, using tables with rows and columns
linked by keys
• Examples : MySQL , PostgreSQL, SQL Server
• Best for Structured data, transactional applications, complex queries
• No SQL Databases:
• Flexible data models: Not limited to the relational model, offering more flexibility for strong
diverse data types
• Categories:
• Document Database (MongoDB) : Store data in flexible, JSON –like documents
• Key-Value Store (Radis) : Store data as key-value pairs, ideal for caching and session management
• Wide Column Stores (Cassandra) : Designed for high scalable and handling massive data
• Graph Databases (Neo4j) : Represent data as interconnected nodes and relationships, suitable for social
networks and recommendation systems
98
Key types of cloud databases …
• Data Warehouses:
• Optimized for Analytics: Designed for storing and analyzing large volumes of
data for business intelligence and reporting
• Examples: Amazon Redshift, Google BigQuery, Snowflake
• Key features: High performance query processing, data warehousing features like data
loading and transformation
99
Benefits of Using Cloud Databases
Scalability and Flexibility
 Effortless Scaling:
o Scale your database resources up or down quickly and easily to meet fluctuating demands
o Automatically adjust resources based on real-time needs, ensuring optimal performance during peak
usage
o Avoid the upfront costs and delays associated with provisioning additional hardware
 Flexibility and Agility:
o Adapt to changing business requirements with ease
o Quickly provision new databases for development, testing, and production environments
100
Benefits of Using Cloud Databases…
Cost-Effectiveness:
 Pay-as-you-go Pricing:
o Only pay for the resources you consume, eliminating the need for large upfront investments in
hardware and software
o Optimize costs by scaling resources down during periods of low demand
 Reduced Total Cost of Ownership (TCO):
o Lower capital expenditures (CapEx) by eliminating the need for on-premises hardware and
infrastructure
o Reduce operational expenses (OpEx) by minimizing the need for dedicated IT staff for database
administration and maintenance
101
Benefits of Using Cloud Databases…
High Availability and Reliability
 Enhanced Data Availability:
o Built-in redundancy and disaster recovery features ensure high availability and minimize
downtime
o Leverage multiple data centers and automated failover mechanisms to protect against
outages
 Improved Data Resilience:
o Minimize the risk of data loss due to hardware failures, natural disasters, or other
unforeseen events
102
Benefits of Using Cloud Databases…
Reduced Maintenance Overhead
 Simplified Administration:
o Cloud providers handle many of the administrative tasks, such as software updates, security
patches, and hardware maintenance
o Free up your IT team to focus on other strategic initiatives
 Proactive Monitoring and Support:
o Leverage cloud provider monitoring tools and 24/7 support to proactively identify and
resolve potential issues
103
Benefits of Using Cloud Databases…
Enhance Security
 Robust Security Measures:
o Benefit from advanced security features provided by cloud providers, such as encryption,
access controls, and threat detection
o Leverage industry-best practices and compliance certifications to ensure data security and
privacy
 Improved Threat Mitigation:
o Benefit from the expertise and resources of cloud providers in mitigating cyber threats and
protecting your data
104
Benefits of Using Cloud Databases…
Global Reach and Accessibility
 Access Data from Anywhere:
o Access and manage your data from any location with an internet connection
o Facilitate collaboration and data sharing across distributed teams
 Reduced Latency:
o Leverage cloud provider's global infrastructure to minimize latency and improve application
performance for users around the world
105
Benefits of Using Cloud Databases…
•By leveraging these benefits, businesses can gain a competitive advantage by:
 Improving agility and responsiveness to market changes
 Reducing operational costs and increasing efficiency
 Improving data availability and minimizing downtime
 Focusing on core business priorities by offloading IT infrastructure management
 Gaining a competitive edge through data-driven insights and innovation
106
Challenges of Cloud Databases
 Security Concerns: Data privacy and security risks associated with storing data in
the cloud
 Vendor Lock-in: Potential challenges in migrating data to another provider
 Performance Issues: Network latency and bandwidth limitations can impact
performance
 Data Migration: Migrating existing databases to the cloud can be complex and
time-consuming
107
Choosing the Right Cloud Database
Selecting the right cloud database depends on several factors:
 Data Type: Structured, unstructured, or semi-structured
 Workload: Transactional, analytical, or a mix of both
 Scalability Requirements: How much your data volume and processing needs are
likely to grow
 Budget Constraints: Your overall budget and desired cost-efficiency
 Technical Expertise: Your team's experience with different database technologies
108
Top Cloud Database Service Providers
109
Top Cloud Database Service Providers
 Amazon Web Services (AWS):
o Strengths: Wide range of database options (relational, NoSQL, data warehousing), extensive
global infrastructure, strong developer community
o Key Services: Amazon RDS (Relational Database Service), Amazon Aurora, Amazon
DynamoDB, Amazon Redshift, Amazon Neptune
 Microsoft Azure:
o Strengths: Strong integration with Microsoft products, good for .NET applications,
competitive pricing
o Key Services: Azure SQL Database, Azure Cosmos DB, Azure Synapse Analytics, Azure
Database for MySQL, Azure Database for PostgreSQL
110
Top Cloud Database Service Providers…
 Google Cloud Platform (GCP):
o Strengths: Innovative technologies like Spanner (globally distributed database), strong in big
data and machine learning, competitive pricing
o Key Services: Cloud SQL, Cloud Spanner, Cloud Datastore, Cloud Bigtable, Cloud Firestore
 Oracle Cloud Infrastructure (OCI):
o Strengths: Strong in Oracle databases, focus on performance and security, good for
enterprises with existing Oracle investments
o Key Services: Oracle Autonomous Database, Oracle Cloud Infrastructure Database Service
111
Top Cloud Database Service Providers…
 IBM Cloud:
o Strengths: Wide range of database options, strong in hybrid cloud solutions, focus on
enterprise needs
o Key Services: IBM Cloud Databases for PostgreSQL, IBM Cloud Databases for MongoDB, IBM
Db2 on Cloud
112
Factors to Consider When Choosing a Provider
 Specific Database Needs:
o Relational, NoSQL, data warehousing, specific database engine requirements
 Scalability and Performance:
o Required level of scalability, performance demands (e.g., low latency, high throughput)
 Cost:
o Pricing models (pay-as-you-go, reserved instances), total cost of ownership
113
Factors to Consider When Choosing a Provider…
 Security and Compliance:
o Data security and privacy requirements, compliance certifications (e.g., HIPAA, GDPR)
 Integration:
o Integration with existing applications and infrastructure
 Support:
o Level of support required (technical support, customer service)

Chapter 2 Cloud Computing and Databases.pptx

  • 1.
  • 2.
    2 Outline  Overview ofCloud Computing and Databases  Benefits of Cloud Databases  Cloud Database Service Providers
  • 3.
    3 Cloud Computing Definition •Cloudcomputing is using the Internet to access someone else's software running on someone else's hardware in someone else's data center Lewis Cunningham, Cloud Computing with Amazon and Oracle, 2008.
  • 4.
    4 Definitions… • A large-scaledistributed computing paradigm that is driven by economies of scale, in which a pool of abstracted, virtualized, dynamically scalable, managed computing power, storage, platforms, and services are delivered on demand to external customers over the Internet. Ian Foster, Yong Zhao, Ioan Raicu, Shiyong Lu, Cloud Computing and Grid Computing 360-Degree Compared, Grid Computing Environments Workshop, 2008.
  • 5.
    5 Definitions… • A Cloudis a type of parallel and distributed system consisting of a collection of interconnected and virtualized computers that are dynamically provisioned and presented as one or more unified computing resources based on service-level agreements established through negotiation between the service provider and consumers. Rajkumar Buyya, Chee Shin Yeo, and Srikumar Venugopal, Market-Oriented Cloud Computing: Vision, Hype, and Reality for Delivering IT Services as Computing Utilities, International Conference on High Performance Computing, 2008
  • 6.
    6 Definitions… Cloud Computing is“A model for enabling convenient, on- demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction” NIST
  • 7.
    7 Definitions… • On-demand availabilityof computer system resources, especially data storage and computing power, without direct active management by the user
  • 8.
    8 Conventional Computing vs. Cloud Computing Conventional Manually Provisioned  Dedicated Hardware  Fixed Capacity  Pay for Capacity  Capital & Operational Expenses  Managed via Sysadmins Cloud  Self-provisioned  Shared Hardware  Elastic Capacity  Pay for Use  Operational Expenses  Managed via APIs
  • 9.
    9 Essential Characteristics ofCloud Computing 1. Shared / pooled resources 2. Broad network access 3. On-demand self-service 4. Scalable and elastic 5. Metered by use / Measured services
  • 10.
    10 Characteristics… Shared / PooledResources: • Resources are drawn from a common pool • Common resources build economies of scale • Common infrastructure runs at high efficiency
  • 11.
    11 Characteristics… Broad Network Access: •Open standards and APIs • Almost always IP, HTTP, and REST • Available from anywhere with an Internet connection
  • 12.
    12 Characteristics… On-Demand Self-Service: • Completelyautomated • Users abstracted from the implementation • Near real-time delivery (seconds or minutes) • Services accessed through a self-serve web interface
  • 13.
    13 Characteristics… Scalable and Elastic: •Resources dynamically-allocated between users • Additional resources dynamically-released when needed • Fully automated
  • 14.
    14 Characteristics… Metered by Use: •Services are metered, like a utility • Users pay only for services used • Services can be cancelled at any time
  • 15.
    15 Cloud Service Models Cloud Software as a Service (SaaS)  Cloud Platform as a Service (PaaS)  Cloud Infrastructure as a Service (IaaS)
  • 16.
  • 17.
    17 Cloud Service Models Softwareas a Service (SaaS) Platform as a Service (PaaS) Infrastructure as a Service (IaaS) Google App Engine SalesForce CRM LotusLive Adopted from: Effectively and Securely Using the Cloud Computing Paradigm by peter Mell, Tim Grance
  • 18.
    18 Cloud Service Models… Service Model at a glance: Picture From http://en.wikipedia.org/wiki/File:Cloud_Computing_Stack.svg
  • 19.
    19 Infrastructure as aService (IaaS) • The capability provided to the consumer is to provision processing, storage, networks, and other fundamental computing resources • Consumer is able to deploy and run arbitrary software, which can include operating systems and applications • The consumer does not manage or control the underlying cloud infrastructure but has control over operating systems, storage, deployed applications, and possibly limited control of select networking components (e.g., host firewalls) • Examples: Amazon EC2, GoGrid, iland, Rackspace Cloud Servers, ReliaCloud.
  • 20.
    20 Infrastructure as aService … • System architecture :
  • 21.
    21 Infrastructure as aService… • Enabling technique - Virtualization • Virtualization is an abstraction of logical resources away from underlying physical resources • Virtualization technique shift OS onto hypervisor • Multiple OS share the physical hardware and provide different services • Improve utilization, availability, security and convenience VM1 VM2 VM3
  • 22.
    22 Infrastructure as aService… • Properties supported by virtualization technique : • Manageability and Interoperability • Availability and Reliability • Scalability and Elasticity
  • 23.
    23 Infrastructure as aService… • Provide service –Resource Management Interface • Several types of virtualized resource : • Virtual Machine – As an IaaS provider, we should be able to provide the basic virtual machine operations, such as creation, suspension, resumption and termination, …etc. • Virtual Storage – As an IaaS provider, we should be able to provide the basic virtual storage operations, such as space allocation, space release, data writing and data reading, …etc. • Virtual Network – As an IaaS provider, we should be able to provide the basic virtual network operations, such as IP address allocation, domain name register, connection establishment and bandwidth provision, …etc.
  • 24.
    24 Infrastructure as aService… • Provide service – System Monitoring Interface • Several types of monitoring metrics : • Virtual Machine – As an IaaS provider, we should be able to monitor some system states of each virtual machine, such as CPU loading, memory utilization, IO loading and internal network loading, …etc. • Virtual Storage – As an IaaS provider, we should be able to monitor some storage states of each virtual storage, such as virtual space utilization, data duplication and storage device access bandwidth, …etc. • Virtual Network – As an IaaS provider, we should be able to monitor some network states of each virtual network, such as virtual network bandwidth, network connectivity and network load balancing, …etc.
  • 25.
    25 Platform as aService (PaaS) • The capability provided to the consumer is to deploy onto the cloud infrastructure consumer created or acquired applications created using programming languages and tools supported by the provider • The consumer does not manage or control the underlying cloud infrastructure including network, servers, operating systems, or storage, but has control over the deployed applications and possibly application hosting environment configurations • Examples: Windows Azure, Google App.
  • 26.
    26 Platform as aService… • System architecture :
  • 27.
    27 Platform as aService… • Enabling technique – Runtime Environment Design • Runtime environment refers to collection of software services available. Usually implemented by a collection of program libraries. • Common properties in Runtime Environment : • Manageability and Interoperability • Performance and Optimization • Availability and Reliability • Scalability and Elasticity
  • 28.
    28 Platform as aService… • Provide service – Programming IDE • Users make use of programming IDE to develop their service among PaaS. • This IDE should integrate the full functionalities which supported from the underling runtime environment. • This IDE should also provide some development tools, such as profiler, debugger and testing environment. • The programming APIs supported from runtime environment may be various between different cloud providers, but there are still some common operating functions. • Computation, storage and communication resource operation
  • 29.
    29 Platform as aService… • Provide service – System Control Interface • Police-Based Control • Typically described as a principle or rule to guide decisions and achieve rational outcome(s) • Make the decision according to some requirements • Workflow Control • Describe the flow of installation and configuration of resources • Workflow processing daemon delivers speedy and efficient construction and management of cloud resources
  • 30.
    30 Software as aService (SaaS) • The capability provided to the consumer is to use the provider’s applications running on a cloud infrastructure • The applications are accessible from various client devices through a thin client interface such as a web browser (e.g., web-based email) • The consumer does not manage or control the underlying cloud infrastructure including network, servers, operating systems, storage, or even individual application capabilities, with the possible exception of limited user specific application configuration settings • Examples: Caspio, Google Apps, Salesforce, Nivio, Learn.com.
  • 31.
    31 Software as aService…
  • 32.
    32 Software as aService… • Enabling Technique – Web Service • Web 2.0 is the trend of using the full potential of the web • Viewing the Internet as a computing platform • Running interactive applications through a web browser • Leveraging interconnectivity and mobility of devices • Enhanced effectiveness with greater human participation • Properties provided by Internet : • Accessibility and Portability
  • 33.
    33 Software as aService… • Provide service – Web-based Applications • Conventional applications should translate their access interface onto web- based platform. • Applications in different domains • General Applications – Applications which are designed for general propose, such as office suit, multimedia and instant message, …etc. • Business Applications – Application which are designed for business propose, such as ERP, CRM and market trading system, …etc. • Scientific Applications – Application which are designed for scientific propose, such as aerospace simulation and biochemistry simulation, …etc. • Government Applications – Applications which are designed for government propose, such as national medical system and public transportation system service, …etc.
  • 34.
    34 Software as aService… • Provide service – Web Portal • Apart from the standard search engine feature, web portals offer other services such as e-mail, news, stock prices, information, databases and entertainment • Portals provide a way for enterprises to provide a consistent look and feel with access control and procedures for multiple applications and databases, which otherwise would have been different entities altogether • Some examples : • iGoogle • MSNBC • Netvibes • Yahoo!
  • 35.
    35 Cloud Deployment Model •There are four primary cloud deployment models : • Public Cloud • Private Cloud • Community Cloud • Hybrid Cloud • Their differences lie primarily in the scope and access of published cloud services, as they are made available to service consumers.
  • 36.
    36 Public Cloud • Publiccloud definition • The cloud infrastructure is made available to the general public or a large industry group and is owned by an organization selling cloud services • Also known as external cloud or multi-tenant cloud, this model essentially represents a cloud environment that is openly accessible • Basic characteristics : • Homogeneous infrastructure • Common policies • Shared resources and multi-tenant • Leased or rented infrastructure • Economies of scale
  • 37.
    37 Private Cloud… • Privatecloud definition • The cloud infrastructure is operated solely for an organization. It may be managed by the organization or a third party and may exist on premise or off premise • Also referred to as internal cloud or on-premise cloud, a private cloud intentionally limits access to its resources to service consumers that belong to the same organization that owns the cloud • Basic characteristics : • Heterogeneous infrastructure • Customized and tailored policies • Dedicated resources • In-house infrastructure • End-to-end control
  • 38.
    38 Public vs. Private •Comparison : Public Cloud Private Cloud Infrastructure Homogeneous Heterogeneous Policy Model Common defined Customized & Tailored Resource Model Shared & Multi-tenant Dedicated Cost Model Operational expenditure Capital expenditure Economy Model Large economy of scale End-to-end control
  • 39.
  • 40.
    40 Community Cloud • Communitycloud definition • The cloud infrastructure is shared by several organizations and supports a specific community that has shared concerns (e.g., mission, security requirements, policy, and compliance considerations) • It may be managed by the organizations or a third party and may exist on- premises or off-premises
  • 41.
    41 Hybrid Cloud • Hybridcloud definition • The cloud infrastructure is a composition of two or more clouds (private, community, or public) that remain unique entities but are bound together by standardized or proprietary technology that enables data and application portability (e.g., cloud bursting for load-balancing between clouds)
  • 42.
  • 43.
    43 Discussion Point What canwe gain from cloud ? Cloud computing offers numerous benefits, including: 1. Scalability •Easily scale resources up or down based on demand. •No need for costly infrastructure investments. 2. Cost Efficiency •Pay only for what you use (pay-as-you-go model). •Reduces capital expenses (CAPEX) on hardware. 3. Flexibility & Accessibility •Access data and applications from anywhere with an internet connection. •Supports remote work and global collaboration. 4. Security & Reliability •Cloud providers offer advanced security features (encryption, firewalls, threat monitoring). •Ensures data backup and disaster recovery. 5. Automatic Updates & Maintenance •Providers handle software updates and maintenance. •Reduces the burden on IT teams. 6. Better Collaboration •Teams can work on shared documents in real- time. •Integrates with collaboration tools like Google Workspace, Microsoft 365, etc. 7. Big Data & Analytics •Supports large-scale data storage and processing. •Enables AI, machine learning, and business intelligence applications. 8. Innovation & Speed •Deploy applications faster with cloud-based development tools. •Supports agile development and DevOps practices. 9. Environmental Benefits •Optimized resource usage reduces energy consumption. •Cloud providers invest in energy-efficient data centers. 10. Disaster Recovery & Business Continuity •Data is backed up in multiple locations. •Minimizes downtime and data loss risks.
  • 44.
    44 Benefits From Cloud •Cloud computing brings many benefits : • For the market and enterprises • Reduce initial investment • Reduce capital expenditure • Improve industrial specialization • Improve resource utilization • For the end user and individuals • Reduce local computing power • Reduce local storage power • Variety of thin client devices in daily life
  • 45.
    45 For Market andEnterpeises
  • 46.
    46 Reduce Initial Investment •Traditional process of enterprises to initiate business : • Survey and analysis the industry and market • Estimate the quantity of supply and demand • Purchase and deploy IT infrastructure • Install and test the software system • Design and develop enterprise specific business service • Announce the business service to clients • Some drawbacks : • The survey, analysis and estimation may not 100% correct • Infrastructure deployment is time consuming • Enterprises should take the risk of wrong investment
  • 47.
    47 Reduce Initial Investment •Initiate business with Cloud Computing services : • Survey and analysis the industry and market • Chose one cloud provider for enterprise deployment • Design and develop business service upon cloud environment • Announce the business service to clients • Some benefits : • Enterprise do not need to own the infrastructure • Enterprise can develop and deploy business service in short time • Enterprise can reduce the business loss of wrong investment
  • 48.
    48 Reduce Initial Investment •What dose cloud computing achieve ? Traditional With Cloud Computing Investment Risk Enterprise takes the risk Cloud reduces the risk Infrastructure Enterprise owns the infrastructure Cloud provider owns the infrastructure Time duration Long deployment time Fast to business ready
  • 49.
    49 Reduce Capital Expenditure •Traditional capital expenditure of enterprises : • Each enterprise should establish its own IT department • IT department should handle the listing jobs • Manage and administrate hardware and software • Apply regular data backup and check point process • Purchase new infrastructure and eliminate outdated one • Always standby for any unexpected IT problems • Some drawbacks : • Enterprise pays for IT investment which is not its business focus • Enterprise should take the risk of hardware/software malfunction • Replacing and updating infrastructure is time consuming and risky
  • 50.
    50 Reduce Capital Expenditure •Capital expenditure with Cloud Computing service : • Enterprise can almost dismiss its IT department • The jobs of IT department can be achieved by cloud provider • Dynamically update and upgrade hardware or software • Dynamically provision and deploy infrastructure for enterprise • Automatically backup data and check consistency • Self-recover from disaster or system malfunction • Some benefits : • Enterprise can shift effort to its business focus • Enterprise can reconfigure its IT services in short time • Enterprise pays to cloud provider as many as the service used
  • 51.
    51 Reduce Capital Expenditure •What dose cloud computing achieve ? Traditional With Cloud Computing Business focus Need to own its IT department Cloud provider takes care everything Payment Pay for all investment and human resource Enterprise pays as the service used Time duration Long establish time Fast to business ready
  • 52.
    52 Improve Industrial Specialization •Traditional industry and market : • Every enterprise has to own its IT department • IT resource is managed by enterprise themselves • IT complexity should be well taken care by enterprise themselves • Some drawbacks : • IT department is not the business focus of enterprise • Most of enterprises do not well maintain their IT resources • Enterprise not often optimizes their IT resource usage
  • 53.
    53 Improve Industrial Specialization •Collaboration with Cloud providers : • Cloud providers centrally maintain IT infrastructure for clients • Cloud providers employ experts for management and administration • Cloud providers focus on providing reliable IT services • Enterprises only rent the service they need and care • Some benefits : • Industrial specialization will be improved • IT service performance will be optimized • Enterprise business focus will be enhanced • IT resource waste will be reduced
  • 54.
    54 Improve Industrial Specialization •What dose cloud computing achieve ? Traditional With Cloud Computing Collaboration Enterprise needs to take care everything Enterprise focuses on its own business Management Enterprise works with poor manageability Cloud provider applies professional control Relationship Stand alone enterprise Win-Win partnership
  • 55.
    55 Improve Resource Utilization •Traditional industry and market : • Enterprise seldom takes care about IT resource utilization • Enterprise owns their IT resource without well management • IT resource usually over invested for peak demand • Some drawbacks : • Power and space utilization among enterprises are wasted • IT resources across enterprises cannot be shared
  • 56.
    56 Improve Resource Utilization •Collaboration with Cloud providers : • IT resources are centrically managed and optimized • Cloud provider builds performance optimized hardware • Cloud provider builds consolidated cooling system • Cloud provider will consider the geographic issues • Cloud provider will consider legal policy issues • Some benefits : • IT infrastructure can be shared among enterprises • IT infrastructure performance and utilization can be optimized • Large-scale integrated optimization can be applied
  • 57.
    57 Improve Resource Utilization •What dose cloud computing achieve ? Traditional With Cloud Computing IT Resource Utilization IT resource under utilized most of time Share to improve utilization of IT resource Power Consumption Waste power and cooling system Cloud system should be global optimized
  • 58.
    58 For End Userand Individual
  • 59.
    59 Reduce Local ComputingPower • Traditional local computing power requirement : • One need to buy your own personal computer • Buy powerful processor if you need intensive computing • Buy large memory to meet application requirement • Install plenty of applications in need • Some drawbacks : • One can hardly replicate the same system environment • One needs to regularly update or upgrade software and hardware • One needs to reinstall all applications if you reinstall the OS
  • 60.
    60 Reduce Local ComputingPower • Using Cloud Computing services : • One can utilize the remote computing power in the cloud • One needs only basic computing power to connect to internet • Application in the cloud will automatically upgrade • Some benefits : • One can access his/her applications anywhere through the Internet • One can dynamically request for computing power on demand • Application may need not to be reinstalled even reinstall the OS
  • 61.
    61 Reduce Local ComputingPower • What dose cloud computing achieve ? Traditional With Cloud Computing Hardware Requirement User needs to buy powerful hardware Only basic hardware to connect to internet Software Requirement Install application in local computer No local installation requirement Portability Hard to be portable Natively portable
  • 62.
    62 Reduce Local StoragePower • Traditional local storage power requirement : • User programs and data files are stored in local devices • User has to backup data regularly preventing hardware damage • Some drawbacks : • Storage space may not enough for burst data requirement • Storage space may be over needed which result in resource waste • Data consistency is hard to maintain between computers • Need to sacrifice part of storage space for data backup
  • 63.
    63 Reduce Local StoragePower • Using Cloud Computing services : • User programs and data files are stored in the cloud • Cloud service provider will guarantee the data availability • Some benefits : • One can dynamically allocate storage space on demand • One can access data anywhere through the Internet • No need to care about data consistency between computers • No need to care about data loss due to hardware damage
  • 64.
    64 Reduce Local StoragePower • What dose cloud computing achieve ? Traditional With Cloud Computing Storage Space Limited to local disk, may be under utilized Dynamically allocated on demand Storage Data Consistency Difficult to maintain data consistency Data consistency maintained by cloud Availability Regular user backup Cloud service guarantee
  • 65.
    65 Variety of EndDevices • Traditional computing resource : • One can connect to the Internet by personal computer • Only personal computer can deliver reasonable computing power • Small devices cannot perform incentive computation due to their power and hardware limitation • Some drawbacks : • Computing power is not portable • Small devices can only perform simplified works
  • 66.
    66 Variety of EndDevices • Devices collaborate with Cloud services : • Device connects to the Internet through wireless network • Device accesses cloud services through web service interface • Device sends computing incentive jobs into cloud and wait for results • Some benefits : • User can easily access cloud service through small devices • User can access almost unlimited computing power anywhere • Small devices can be intelligently managed through cloud (IoT)
  • 67.
    67 Variety of EndDevices • What dose cloud computing achieve ? Traditional With Cloud Computing Computing Power Only accessed through desktop computer Accessed through small smart devices Small Device Intelligence Functionalities was limited due to their power consumption Shift computing incentive jobs into cloud, and then wait for results
  • 68.
    68 Advantages of CloudComputing • Lower computer costs:  You do not need a high-powered and high-priced computer to run cloud computing's web-based applications  Since applications run in the cloud, not on the desktop PC, your desktop PC does not need the processing power or hard disk space demanded by traditional desktop software  When you are using web-based applications, your PC can be less expensive, with a smaller hard disk, less memory, more efficient processor...  In fact, your PC in this scenario does not even need a CD or DVD drive, as no software programs have to be loaded and no document files need to be saved
  • 69.
    69 Advantages of CloudComputing • Improved performance:  With few large programs hogging your computer's memory, you will see better performance from your PC  Computers in a cloud computing system boot and run faster because they have fewer programs and processes loaded into memory… • Reduced software costs:  Instead of purchasing expensive software applications, you can get most of what you need for free-ish! • most cloud computing applications today, such as the Google Docs suite.  better than paying for similar commercial software • which alone may be justification for switching to cloud applications.
  • 70.
    70 Advantages of CloudComputing • Instant software updates:  Another advantage to cloud computing is that you are no longer faced with choosing between obsolete software and high upgrade costs  When the application is web-based, updates happen automatically • available the next time you log into the cloud.  When you access a web-based application, you get the latest version • without needing to pay for or download an upgrade. • Improved document format compatibility:  You do not have to worry about the documents you create on your machine being compatible with other users' applications or OSes  There are potentially no format incompatibilities when everyone is sharing documents and applications in the cloud
  • 71.
    71 Advantages of CloudComputing • Unlimited storage capacity:  Cloud computing offers virtually limitless storage  Your computer's current 1 Tbyte hard drive is small compared to the hundreds of Pbytes available in the cloud • Increased data reliability:  Unlike desktop computing, in which if a hard disk crashes and destroy all your valuable data, a computer crashing in the cloud should not affect the storage of your data • if your personal computer crashes, all your data is still out there in the cloud, still accessible  In a world where few individual desktop PC users back up their data on a regular basis, cloud computing is a data-safe computing platform!
  • 72.
    72 Advantages of CloudComputing • Universal document access:  That is not a problem with cloud computing, because you do not take your documents with you  Instead, they stay in the cloud, and you can access them whenever you have a computer and an Internet connection  Documents are instantly available from wherever you are • Latest version availability:  When you edit a document at home, that edited version is what you see when you access the document at work.  The cloud always hosts the latest version of your documents • as long as you are connected, you are not in danger of having an outdated version
  • 73.
    73 Advantages of CloudComputing • Easier group collaboration:  Sharing documents leads directly to better collaboration  Many users do this as it is an important advantages of cloud computing • multiple users can collaborate easily on documents and projects • Device independence:  You are no longer tied to a single computer or network  Changes to computers, applications and documents follow you through the cloud  Move to a portable device, and your applications and documents are still available
  • 74.
    74 Disadvantages of CloudComputing • Requires a constant Internet connection:  Cloud computing is impossible if you cannot connect to the Internet  Since you use the Internet to connect to both your applications and documents, if you do not have an Internet connection you cannot access anything, even your own documents  A dead Internet connection means no work and in areas where Internet connections are few or inherently unreliable, this could be a deal-breaker
  • 75.
    75 Disadvantages of CloudComputing • Does not work well with low-speed connections:  Similarly, a low-speed Internet connection, such as that found with dial-up services, makes cloud computing painful at best and often impossible  Web-based applications require a lot of bandwidth to download, as do large documents • Features might be limited:  This situation is bound to change, but today many web-based applications simply are not as full-featured as their desktop-based applications • For example, you can do a lot more with Microsoft PowerPoint than with Google Presentation's web-based offering
  • 76.
    76 Disadvantages of CloudComputing • Can be slow:  Even with a fast connection, web-based applications can sometimes be slower than accessing a similar software program on your desktop PC  Everything about the program, from the interface to the current document, has to be sent back and forth from your computer to the computers in the cloud  If the cloud servers happen to be backed up at that moment, or if the Internet is having a slow day, you would not get the instantaneous access you might expect from desktop applications
  • 77.
    77 Disadvantages of CloudComputing • Stored data might not be secure:  With cloud computing, all your data is stored on the cloud • The questions is How secure is the cloud?  Can unauthorized users gain access to your confidential data? • Stored data can be lost:  Theoretically, data stored in the cloud is safe, replicated across multiple machines  But on the off chance that your data goes missing, you have no physical or local backup. • Put simply, relying on the cloud puts you at risk if the cloud lets you down
  • 78.
    78 Disadvantages of CloudComputing • HPC Systems:  Not clear that you can run compute-intensive HPC applications that use MPI/OpenMP!  Scheduling is important with this type of application • as you want all the VM to be co-located to minimize communication latency! • General Concerns:  Each cloud systems uses different protocols and different APIs • may not be possible to run applications between cloud based systems  Amazon has created its own DB system (not SQL 92), and workflow system (many popular workflow systems out there) • so your normal applications will have to be adapted to execute on these platforms
  • 79.
    79 Opportunities and Challenges •The use of the cloud provides a number of opportunities:  It enables services to be used without any understanding of their infrastructure  Cloud computing works using economies of scale: • It potentially lowers the outlay expense for start up companies, as they would no longer need to buy their own software or servers • Cost would be by on-demand pricing • Vendors and Service providers claim costs by establishing an ongoing revenue stream  Data and services are stored remotely but accessible from “anywhere”
  • 80.
    80 Opportunities and Challenges •In parallel there has been backlash against cloud computing:  Use of cloud computing means dependence on others and that could possibly limit flexibility and innovation: • The others are likely become the bigger Internet companies like Google and IBM, who may monopolise the market • Some argue that this use of supercomputers is a return to the time of mainframe computing that the PC was a reaction against.  Security could prove to be a big issue: • It is still unclear how safe out-sourced data is and when using these services ownership of data is not always clear  There are also issues relating to policy and access: • If your data is stored abroad whose policy do you adhere to? • What happens if the remote server goes down? • How will you then access files? • There have been cases of users being locked out of accounts and losing access to data.
  • 81.
    81 The Future  Manyof the activities loosely grouped together under cloud computing have already been happening and centralised computing activity is not a new phenomena  Grid Computing was the last research-led centralised approach  However there are concerns that the mainstream adoption of cloud computing could cause many problems for users  Many new open source systems appearing that you can install and run on your local cluster • should be able to run a variety of applications on these systems
  • 82.
    82 NIST Cloud ComputingReference Architecture The Conceptual Reference Model
  • 83.
    83 NIST Cloud ComputingReference Architecture … Actors in Cloud Computing
  • 84.
    84 NIST Cloud ComputingReference Architecture … Interaction between the Actors in Cloud Computing
  • 85.
    85 NIST Cloud ComputingReference Architecture … Usage Scenario for Cloud Broker
  • 86.
    86 NIST Cloud ComputingReference Architecture … Usage Scenario for Cloud Carrier
  • 87.
    87 NIST Cloud ComputingReference Architecture … Usage Scenario for Cloud Auditor
  • 88.
    88 NIST Cloud ComputingReference Architecture … Example Services available to a Cloud Consumer
  • 89.
    89 NIST Cloud ComputingReference Architecture … Cloud Provider- Major Activities
  • 90.
  • 91.
    91 Cloud Ecosystem Actors •Cloud Service User (CSU): a person or an organization that consumes delivered cloud services. • A CSU can include intermediate users that will deliver cloud services provided by a cloud service provider (CSP) to actual users of the cloud service, i.e. end users. • End users can be persons, machines, or applications.
  • 92.
    92 Cloud Ecosystem Actors CloudService Provider (CSP): an organization that provides and maintains delivered cloud services
  • 93.
    93 Cloud Ecosystem Actors •Cloud Service Partner (CSN): a person or an organization that provides support to the building of the service offer of a CSP (e.g. service integration).
  • 94.
    94 The three actorsof cloud ecosystem
  • 95.
  • 96.
    96 What are CloudDatabases? • Cloud databases are databases that run on cloud computing platforms. • Instead of managing your own database servers, you rely on a cloud providers (like AWS, Azure, or Google Cloud) to host and manage the database infrastructure.
  • 97.
    97 Key types ofcloud databases • Relational Databases: • Traditional Structure : Based on the relational model, using tables with rows and columns linked by keys • Examples : MySQL , PostgreSQL, SQL Server • Best for Structured data, transactional applications, complex queries • No SQL Databases: • Flexible data models: Not limited to the relational model, offering more flexibility for strong diverse data types • Categories: • Document Database (MongoDB) : Store data in flexible, JSON –like documents • Key-Value Store (Radis) : Store data as key-value pairs, ideal for caching and session management • Wide Column Stores (Cassandra) : Designed for high scalable and handling massive data • Graph Databases (Neo4j) : Represent data as interconnected nodes and relationships, suitable for social networks and recommendation systems
  • 98.
    98 Key types ofcloud databases … • Data Warehouses: • Optimized for Analytics: Designed for storing and analyzing large volumes of data for business intelligence and reporting • Examples: Amazon Redshift, Google BigQuery, Snowflake • Key features: High performance query processing, data warehousing features like data loading and transformation
  • 99.
    99 Benefits of UsingCloud Databases Scalability and Flexibility  Effortless Scaling: o Scale your database resources up or down quickly and easily to meet fluctuating demands o Automatically adjust resources based on real-time needs, ensuring optimal performance during peak usage o Avoid the upfront costs and delays associated with provisioning additional hardware  Flexibility and Agility: o Adapt to changing business requirements with ease o Quickly provision new databases for development, testing, and production environments
  • 100.
    100 Benefits of UsingCloud Databases… Cost-Effectiveness:  Pay-as-you-go Pricing: o Only pay for the resources you consume, eliminating the need for large upfront investments in hardware and software o Optimize costs by scaling resources down during periods of low demand  Reduced Total Cost of Ownership (TCO): o Lower capital expenditures (CapEx) by eliminating the need for on-premises hardware and infrastructure o Reduce operational expenses (OpEx) by minimizing the need for dedicated IT staff for database administration and maintenance
  • 101.
    101 Benefits of UsingCloud Databases… High Availability and Reliability  Enhanced Data Availability: o Built-in redundancy and disaster recovery features ensure high availability and minimize downtime o Leverage multiple data centers and automated failover mechanisms to protect against outages  Improved Data Resilience: o Minimize the risk of data loss due to hardware failures, natural disasters, or other unforeseen events
  • 102.
    102 Benefits of UsingCloud Databases… Reduced Maintenance Overhead  Simplified Administration: o Cloud providers handle many of the administrative tasks, such as software updates, security patches, and hardware maintenance o Free up your IT team to focus on other strategic initiatives  Proactive Monitoring and Support: o Leverage cloud provider monitoring tools and 24/7 support to proactively identify and resolve potential issues
  • 103.
    103 Benefits of UsingCloud Databases… Enhance Security  Robust Security Measures: o Benefit from advanced security features provided by cloud providers, such as encryption, access controls, and threat detection o Leverage industry-best practices and compliance certifications to ensure data security and privacy  Improved Threat Mitigation: o Benefit from the expertise and resources of cloud providers in mitigating cyber threats and protecting your data
  • 104.
    104 Benefits of UsingCloud Databases… Global Reach and Accessibility  Access Data from Anywhere: o Access and manage your data from any location with an internet connection o Facilitate collaboration and data sharing across distributed teams  Reduced Latency: o Leverage cloud provider's global infrastructure to minimize latency and improve application performance for users around the world
  • 105.
    105 Benefits of UsingCloud Databases… •By leveraging these benefits, businesses can gain a competitive advantage by:  Improving agility and responsiveness to market changes  Reducing operational costs and increasing efficiency  Improving data availability and minimizing downtime  Focusing on core business priorities by offloading IT infrastructure management  Gaining a competitive edge through data-driven insights and innovation
  • 106.
    106 Challenges of CloudDatabases  Security Concerns: Data privacy and security risks associated with storing data in the cloud  Vendor Lock-in: Potential challenges in migrating data to another provider  Performance Issues: Network latency and bandwidth limitations can impact performance  Data Migration: Migrating existing databases to the cloud can be complex and time-consuming
  • 107.
    107 Choosing the RightCloud Database Selecting the right cloud database depends on several factors:  Data Type: Structured, unstructured, or semi-structured  Workload: Transactional, analytical, or a mix of both  Scalability Requirements: How much your data volume and processing needs are likely to grow  Budget Constraints: Your overall budget and desired cost-efficiency  Technical Expertise: Your team's experience with different database technologies
  • 108.
    108 Top Cloud DatabaseService Providers
  • 109.
    109 Top Cloud DatabaseService Providers  Amazon Web Services (AWS): o Strengths: Wide range of database options (relational, NoSQL, data warehousing), extensive global infrastructure, strong developer community o Key Services: Amazon RDS (Relational Database Service), Amazon Aurora, Amazon DynamoDB, Amazon Redshift, Amazon Neptune  Microsoft Azure: o Strengths: Strong integration with Microsoft products, good for .NET applications, competitive pricing o Key Services: Azure SQL Database, Azure Cosmos DB, Azure Synapse Analytics, Azure Database for MySQL, Azure Database for PostgreSQL
  • 110.
    110 Top Cloud DatabaseService Providers…  Google Cloud Platform (GCP): o Strengths: Innovative technologies like Spanner (globally distributed database), strong in big data and machine learning, competitive pricing o Key Services: Cloud SQL, Cloud Spanner, Cloud Datastore, Cloud Bigtable, Cloud Firestore  Oracle Cloud Infrastructure (OCI): o Strengths: Strong in Oracle databases, focus on performance and security, good for enterprises with existing Oracle investments o Key Services: Oracle Autonomous Database, Oracle Cloud Infrastructure Database Service
  • 111.
    111 Top Cloud DatabaseService Providers…  IBM Cloud: o Strengths: Wide range of database options, strong in hybrid cloud solutions, focus on enterprise needs o Key Services: IBM Cloud Databases for PostgreSQL, IBM Cloud Databases for MongoDB, IBM Db2 on Cloud
  • 112.
    112 Factors to ConsiderWhen Choosing a Provider  Specific Database Needs: o Relational, NoSQL, data warehousing, specific database engine requirements  Scalability and Performance: o Required level of scalability, performance demands (e.g., low latency, high throughput)  Cost: o Pricing models (pay-as-you-go, reserved instances), total cost of ownership
  • 113.
    113 Factors to ConsiderWhen Choosing a Provider…  Security and Compliance: o Data security and privacy requirements, compliance certifications (e.g., HIPAA, GDPR)  Integration: o Integration with existing applications and infrastructure  Support: o Level of support required (technical support, customer service)

Editor's Notes

  • #17 IaaSdelivers computer infrastructure, typically a platform virtualization environment, as a service. Rather than purchasing servers, software, data center space or network equipment, clients instead buy those resources as a fully outsourced service. PaaSdeliver a computing platform where the developers can develop their own applications. SaaSis a model of software deployment where the software applications are provided to the customers as a service.
  • #80 Freedom of Information == FOI