KEMBAR78
introduction to distributed computing.pptx
UNIT1
Introduction:Evolution of Distributed computing:
Syllabus
-Scalable computing over the Internet Technologies for network based systems
-Clusters of cooperative computers
-Overview of Grid Architecture
-Service oriented architecture
-Challenges in cloud computing
-Exploring the Cloud Computing Stack
-Fundamental Cloud Architectures
What is Cloud Computing
Cloud computing is the delivery of different services through the Internet. These
resources include tools and applications like data storage, servers, databases,
networking, and software.
Rather than keeping files on a proprietary hard drive or local storage
device, cloud-based storage makes it possible to save them to a remote database.
As long as an electronic device has access to the web, it has access to the data
and the software programs to run it.
Cloud computing is a popular option for people and businesses for a number of
reasons including cost savings, increased productivity, speed and efficiency,
performance, and security.
Scalable Computing Over The Internet
Technologies For Network Based Systems
Scalable Computing Over The Internet
Technologies For Network Based Systems
High-Performance Computing
For many years, HPC systems emphasize the raw speed performance. The speed of
HPC systems has increased from Gflops in the early 1990s to now Pflops in 2010.
This improvement was driven mainly by the demands from scientific, engineering,
and manufacturing communities.
High-Throughput Computing
The development of market-oriented high-end computing systems is undergoing a
strategic change from an HPC paradigmto an HTC paradigm. This HTC paradigm
pays more attention to high-flux computing. The main application for high-flux
computing is in Internet searches and web services by millions or more users
simultaneously. The performance goal thusshifts to measure high throughput
or the number of tasks completed per unit of time.
Scalable Computing Over The Internet
Technologies For Network Based Systems
1.4 Three New Computing Paradigms
As Figure 1.1 illustrates, with the introduction of SOA, Web 2.0 services become available.
Advances in virtualization make it possible to see the growth of Internet clouds as a new
computing paradigm. The maturity of radio-frequency identification (RFID),
Global Positioning System (GPS), and sensor technologies has triggered the development
of the Internet of Things (IoT). These new paradigms are only briefly introduced here.
Computing Paradigm Distinctions
1. Centralized Computing
2. Distributed Computing
3. Parallel Computing
4. Cloud Computing
Clusters of Cooperative Computers
Clusters of Cooperative Computers
Figure shows the architecture of a typical server cluster built around a low-
latency, high bandwidth interconnection network. This network can be as simple
as a SAN or a LAN. To build a larger cluster with more nodes, the
interconnection network can be built with multiple levels of Gigabit Ethernet,
Myrinet, or InfiniBand switches.
The cluster is connected to the Internet via a virtual private network (VPN)
gateway. The gateway IP address locates the cluster. The system image of a
computer is decided by the way the OS manages the shared cluster resources.
 Most clusters have loosely coupled node computers. All resources of a server
node are managed by their own OS. Thus, most clusters have multiple system
images as a result of having many autonomous nodes under different OS control.
Overview of Grid Architecture
Grid architecture represents the structure of each computer within the
network. Each node has four layers:
1.The top layer comprises high-level applications, such as software for
specific tasks.
2.The middleware layer manages and allocates resources.
3.The third layer is the collection of available resources such as CPU
and memory.
4.The bottom layer is the connection between the nodes in the grid
network.
Grid Computing
GRID COMPUTING
Working:
A Grid computing network mainly consists of these three types of machines
1.Control Node: A computer, usually a server or a group of servers which administrates the whole network and
keeps the account of the resources in the network pool.
2.Provider: The computer contributes its resources to the network resource pool.
3.User: The computer that uses the resources on the network.
Advantages of Grid Computing:
1.It is not centralized, as there are no servers required, except the control node which is just used for controlling
and not for processing.
2.Multiple heterogeneous machines i.e. machines with different Operating Systems can use a single grid
computing network.
GRID COMPUTING
Disadvantages of Grid Computing:
1.The software of the grid is still in the involution stage.
2.A super-fast interconnect between computer resources is the need of the hour.
3.Licensing across many servers may make it prohibitive for some applications.
4.Many groups are reluctant with sharing resources.
5.Trouble in the control node can come to halt in the whole network.
Service Oriented Architecture
•A Service-Oriented Architecture or SOA is a design pattern which is designed to build distributed
systems that deliver services to other applications through the protocol. It is only a concept and
not limited to any programming language or platform.
Service Oriented Architecture
Characteristics of SOA
The services have the following characteristics:
•They are loosely coupled.
•They support interoperability.
•They are location-transparent
•They are self-contained.
Challenges in cloud computing
Data Security and Privacy
Data security is a major concern when switching to cloud computing. User or
organizational data stored in the cloud is critical and private.
Cost Management
Even as almost all cloud service providers have a “Pay As You Go” model, which reduces
the overall cost of the resources being used, there are times when there are huge costs
incurred to the enterprise using cloud computing.
Multi-Cloud Environments
Due to an increase in the options available to the companies, enterprises not only use a
single cloud but depend on multiple cloud service providers. Most of these companies
use hybrid cloud tactics and close to 84% are dependent on multiple clouds.
Challenges in cloud computing
Performance Challenges
Performance is an important factor while considering cloud-based solutions. If the
performance of the cloud is not satisfactory, it can drive away users and decrease profits.
Even a little latency while loading an app or a web page can result in a huge drop in the
percentage of users.
Interoperability and Flexibility
When an organization uses a specific cloud service provider and wants to switch to
another cloud-based solution, it often turns up to be a tedious procedure since
applications written for one cloud with the application stack are required to be re-
written for the other cloud.
High Dependence on Network
Since cloud computing deals with provisioning resources in real-time, it deals with
enormous amounts of data transfer to and from the servers. This is only made possible
due to the availability of the high-speed network.
Exploring the Cloud Computing Stack
Cloud computing can be described as a stack that is formed by layers, similar to a cake.
Those layers will be built using cloud computing services, servers, and components,
which can leverage several different clouds forming a single application stack. The
network stability and scalability of the stack will determine its resilience and high
availability.
Let’s get more familiar with the types of cloud stack components and concepts that are
common in the cloud world.
Software as a Service
Software as a Service is providing a piece of technology (usually a software) that can be
consumed as a service — for example, GitHub source control. You could choose to host
and manage Git source control on-premises, or you could use GitHub's hosted source
control.
One of the new variations of “Software as a Service” is “Data as a Service.”
Exploring the Cloud Computing Stack
Platform as a Service
Platform as a Service provides several well-integrated software products/technologies to
form solutions that power application development and maintenance.
Heroku and Google App engine are examples of Platform as a Service. These host and
integrate your code to other coupled services.
Atlas App Services cloud services form a similar concept to Platform as a Service where
you host your cloud functions and application content as a service.
Infrastructure as a Service
Infrastructure as a Service is currently one of the low-level services you can expect from
a cloud computing provider. Essentially, it provides servers, network, and virtual
resources to run the compute and cloud storage power you need.
An example for this type is an AWS EC2 offering, where you deploy your
servers/network and security policies managed by the AWS cloud API.
Fundamental Cloud Architectures
Fundamental Cloud Architectures
Workload Distribution Architecture
Resource Pooling Architecture
Dynamic Scalability Architecture
Elastic Resource Capacity Architecture
Service Load Balancing Architecture
Cloud Bursting Architecture
Elastic Disk Provisioning Architecture
Redundant Storage Architecture

introduction to distributed computing.pptx

  • 1.
  • 2.
    Syllabus -Scalable computing overthe Internet Technologies for network based systems -Clusters of cooperative computers -Overview of Grid Architecture -Service oriented architecture -Challenges in cloud computing -Exploring the Cloud Computing Stack -Fundamental Cloud Architectures
  • 3.
    What is CloudComputing Cloud computing is the delivery of different services through the Internet. These resources include tools and applications like data storage, servers, databases, networking, and software. Rather than keeping files on a proprietary hard drive or local storage device, cloud-based storage makes it possible to save them to a remote database. As long as an electronic device has access to the web, it has access to the data and the software programs to run it. Cloud computing is a popular option for people and businesses for a number of reasons including cost savings, increased productivity, speed and efficiency, performance, and security.
  • 4.
    Scalable Computing OverThe Internet Technologies For Network Based Systems
  • 5.
    Scalable Computing OverThe Internet Technologies For Network Based Systems High-Performance Computing For many years, HPC systems emphasize the raw speed performance. The speed of HPC systems has increased from Gflops in the early 1990s to now Pflops in 2010. This improvement was driven mainly by the demands from scientific, engineering, and manufacturing communities. High-Throughput Computing The development of market-oriented high-end computing systems is undergoing a strategic change from an HPC paradigmto an HTC paradigm. This HTC paradigm pays more attention to high-flux computing. The main application for high-flux computing is in Internet searches and web services by millions or more users simultaneously. The performance goal thusshifts to measure high throughput or the number of tasks completed per unit of time.
  • 6.
    Scalable Computing OverThe Internet Technologies For Network Based Systems 1.4 Three New Computing Paradigms As Figure 1.1 illustrates, with the introduction of SOA, Web 2.0 services become available. Advances in virtualization make it possible to see the growth of Internet clouds as a new computing paradigm. The maturity of radio-frequency identification (RFID), Global Positioning System (GPS), and sensor technologies has triggered the development of the Internet of Things (IoT). These new paradigms are only briefly introduced here. Computing Paradigm Distinctions 1. Centralized Computing 2. Distributed Computing 3. Parallel Computing 4. Cloud Computing
  • 7.
  • 8.
    Clusters of CooperativeComputers Figure shows the architecture of a typical server cluster built around a low- latency, high bandwidth interconnection network. This network can be as simple as a SAN or a LAN. To build a larger cluster with more nodes, the interconnection network can be built with multiple levels of Gigabit Ethernet, Myrinet, or InfiniBand switches. The cluster is connected to the Internet via a virtual private network (VPN) gateway. The gateway IP address locates the cluster. The system image of a computer is decided by the way the OS manages the shared cluster resources.  Most clusters have loosely coupled node computers. All resources of a server node are managed by their own OS. Thus, most clusters have multiple system images as a result of having many autonomous nodes under different OS control.
  • 9.
    Overview of GridArchitecture Grid architecture represents the structure of each computer within the network. Each node has four layers: 1.The top layer comprises high-level applications, such as software for specific tasks. 2.The middleware layer manages and allocates resources. 3.The third layer is the collection of available resources such as CPU and memory. 4.The bottom layer is the connection between the nodes in the grid network.
  • 10.
  • 11.
    GRID COMPUTING Working: A Gridcomputing network mainly consists of these three types of machines 1.Control Node: A computer, usually a server or a group of servers which administrates the whole network and keeps the account of the resources in the network pool. 2.Provider: The computer contributes its resources to the network resource pool. 3.User: The computer that uses the resources on the network. Advantages of Grid Computing: 1.It is not centralized, as there are no servers required, except the control node which is just used for controlling and not for processing. 2.Multiple heterogeneous machines i.e. machines with different Operating Systems can use a single grid computing network.
  • 12.
    GRID COMPUTING Disadvantages ofGrid Computing: 1.The software of the grid is still in the involution stage. 2.A super-fast interconnect between computer resources is the need of the hour. 3.Licensing across many servers may make it prohibitive for some applications. 4.Many groups are reluctant with sharing resources. 5.Trouble in the control node can come to halt in the whole network.
  • 13.
    Service Oriented Architecture •AService-Oriented Architecture or SOA is a design pattern which is designed to build distributed systems that deliver services to other applications through the protocol. It is only a concept and not limited to any programming language or platform.
  • 14.
    Service Oriented Architecture Characteristicsof SOA The services have the following characteristics: •They are loosely coupled. •They support interoperability. •They are location-transparent •They are self-contained.
  • 15.
    Challenges in cloudcomputing Data Security and Privacy Data security is a major concern when switching to cloud computing. User or organizational data stored in the cloud is critical and private. Cost Management Even as almost all cloud service providers have a “Pay As You Go” model, which reduces the overall cost of the resources being used, there are times when there are huge costs incurred to the enterprise using cloud computing. Multi-Cloud Environments Due to an increase in the options available to the companies, enterprises not only use a single cloud but depend on multiple cloud service providers. Most of these companies use hybrid cloud tactics and close to 84% are dependent on multiple clouds.
  • 16.
    Challenges in cloudcomputing Performance Challenges Performance is an important factor while considering cloud-based solutions. If the performance of the cloud is not satisfactory, it can drive away users and decrease profits. Even a little latency while loading an app or a web page can result in a huge drop in the percentage of users. Interoperability and Flexibility When an organization uses a specific cloud service provider and wants to switch to another cloud-based solution, it often turns up to be a tedious procedure since applications written for one cloud with the application stack are required to be re- written for the other cloud. High Dependence on Network Since cloud computing deals with provisioning resources in real-time, it deals with enormous amounts of data transfer to and from the servers. This is only made possible due to the availability of the high-speed network.
  • 17.
    Exploring the CloudComputing Stack Cloud computing can be described as a stack that is formed by layers, similar to a cake. Those layers will be built using cloud computing services, servers, and components, which can leverage several different clouds forming a single application stack. The network stability and scalability of the stack will determine its resilience and high availability. Let’s get more familiar with the types of cloud stack components and concepts that are common in the cloud world. Software as a Service Software as a Service is providing a piece of technology (usually a software) that can be consumed as a service — for example, GitHub source control. You could choose to host and manage Git source control on-premises, or you could use GitHub's hosted source control. One of the new variations of “Software as a Service” is “Data as a Service.”
  • 18.
    Exploring the CloudComputing Stack Platform as a Service Platform as a Service provides several well-integrated software products/technologies to form solutions that power application development and maintenance. Heroku and Google App engine are examples of Platform as a Service. These host and integrate your code to other coupled services. Atlas App Services cloud services form a similar concept to Platform as a Service where you host your cloud functions and application content as a service. Infrastructure as a Service Infrastructure as a Service is currently one of the low-level services you can expect from a cloud computing provider. Essentially, it provides servers, network, and virtual resources to run the compute and cloud storage power you need. An example for this type is an AWS EC2 offering, where you deploy your servers/network and security policies managed by the AWS cloud API.
  • 19.
  • 20.
    Fundamental Cloud Architectures WorkloadDistribution Architecture Resource Pooling Architecture Dynamic Scalability Architecture Elastic Resource Capacity Architecture Service Load Balancing Architecture Cloud Bursting Architecture Elastic Disk Provisioning Architecture Redundant Storage Architecture