Introduction to Replication
Brian Bowman
Sr. Solutions Engineer bowman@progress.com
Introduction to Replication
Replication Overview OpenEdge Replication Process Failover, Secondary Replication and Failback Sample Image: details Please Questions
replace it (Insert, Picture, )
Introduction to Replication
2007 Progress Software Corporation
Replication Doesnt Have To Be Hard
Introduction to Replication
2007 Progress Software Corporation
Fact Replication is the process of sharing information between databases (or any other type of server) to ensure that the content is consistent between systems.
Source: about.com
Introduction to Replication
2007 Progress Software Corporation
There Are Many Choices Out There
Pr SAN Veritas bkup & ov o Pr ide rest Pro rs pp tA EMC 4GL Ne HP Triggers nic Leg So ato Fathom After Replication Imaging Solari IBM s
5
Introduction to Replication 2007 Progress Software Corporation
Why use Replication?
Disaster Recovery High Availability Remove some of the burden on Production
Introduction to Replication
2007 Progress Software Corporation
Types of Replication
Log based replication
Backup and restore After imaging Application triggers
3rd party options
EMC Veritas
Vendor based options
OpenEdge Replication
Introduction to Replication
2007 Progress Software Corporation
Log-based Options Overview
Backup and restore After imaging (AI) managed approach No set configuration, must be built Remote database cannot be used Never near real-time Licensing DBA level knowledge of AI processing
Introduction to Replication
2007 Progress Software Corporation
3rd Party Options Overview
Vendor neutral Your choices depend on the vendor
1. Periodic snapshot of disks, transfers to another disk set 2. Real-time update at the block or bit level
HW knowledge is required Backup database is not accessible Licensing
9
Introduction to Replication 2007 Progress Software Corporation
Vendor-specific Replication OpenEdge Replication
Near real-time replication
Near zero-latency No data loss Guaranteed data integrity
Flexible database options
Multiple target databases Read-only query access
Easy deployment Automatic recovery
10
Introduction to Replication 2007 Progress Software Corporation
What is OpenEdge Replication?
Automated data replication of your mission critical database to a hot stand-by. Software that improves application availability with no application changes. Once installed, it just works!
11
Introduction to Replication
2007 Progress Software Corporation
Introduction to Replication
Replication Overview Sample OpenEdge Replication Process Image: Failover, Secondary Replication, and Please Failback details replace it Summary
(Insert, Picture, )
12
Introduction to Replication
2007 Progress Software Corporation
OpenEdge Replication Plus
13
Introduction to Replication
2007 Progress Software Corporation
Configuring a Replication Environment
Hardware
Primary Server 1 or 2 Secondary Servers
Software
Progress 9.1E for Fathom Replication 3.0A OpenEdge 10.0B+ for OpenEdge Replication (failback capabilities enable in 10.1A) After-imaging must be enabled
No Application Changes Needed!
14
Introduction to Replication 2007 Progress Software Corporation
Definitions
Source database
Normal production Original source of updates
Target database
Standby database Target location in OpenEdge Replication
Single point of failure a bad thing.
15
Introduction to Replication
2007 Progress Software Corporation
Definitions
Primary Replication
Normal processing Primary machine performs updates Secondary machine receives updates
Failover
Primary machine fails Secondary machine becomes primary
No Backup a bad thing
16
Introduction to Replication
2007 Progress Software Corporation
Definitions
Secondary Replication
Failed over mode Secondary machine performs updates Primary machine receives updates
Failback
The process to get primary machine back to its original state and the secondary machine to take on its original role to be the backup
Failing to check your backup a bad thing
17
Introduction to Replication
2007 Progress Software Corporation
Definitions
Transition
Process where the databases change roles Configured to be either manual or automatic
Synchronization
Process to make sure the database on primary and secondary are identical This is performed
During database and replication startup Failure recovery processing
18
Introduction to Replication
2007 Progress Software Corporation
OpenEdge Replication Complete Configuration
Primary
Source Database
Secondary
Database Broker Processes
AI Extents
Database Broker Processes
Repl Queue
Target Database
Repl Server
Repl Agent
2007 Progress Software Corporation
19
Introduction to Replication
OpenEdge Replication Functionality
Primary Primary
Source Database AI Extents Database Broker Processes
Configures and manages remote agents Sends all database activity to its replication agents Controls replication agents
Repl Queue
Repl Server
20
Introduction to Replication
2007 Progress Software Corporation
OpenEdge Replication Functionality
Secondary Receives database activity from replication server Performs continuous roll-forward to target database Types of Agents
Asynchronous Synchronous
Repl Agent
Database Broker Processes
Target Database
21
Introduction to Replication
2007 Progress Software Corporation
Modes of Replication Asynchronous
Primary Target One
Target Database
Repl Agent
Source Database
Target Two
Target Database
Repl Agent
22
Introduction to Replication
2007 Progress Software Corporation
Modes of Replication Synchronous
Primary Secondary
Source Database
Repl Agent
Target Database
23
Introduction to Replication
2007 Progress Software Corporation
OpenEdge Replication Failure Conditions
Primary
Source Database
Secondary
Database Broker Processes
AI Extents Database Broker Processes
Repl Queue Repl Server
X
Repl Agent
Target Database
24
Introduction to Replication
2007 Progress Software Corporation
How Does it Work?
Plugs into after-image sub-system TCP connection between server and agent Queue for transfers on source Agent periodically (every 10 blocks) polls server for heart beat (asynchronous mode) Agent will also communicate a synchronization point (ie. extent switch) back to the server
25
Introduction to Replication
2007 Progress Software Corporation
OpenEdge Replication Process (7)
Primary Machine
Replication Replication Server Server DB Shared Memory DB Buffer Pool Repl Queue
Secondary Machine
Replication Replication Agent Agent
DB Shared Memory
DB Buffer Pool
BI
DB
AI
BI
DB
AI
26
Introduction to Replication
2007 Progress Software Corporation
Additional Considerations
Schema changes are replicated AI extents must be managed
AI Management Utility!!!
Ensure that you have enough AI extents space - extents will remain locked until they are replicated in entirety
PSDN Whitepaper Managing AI with and OpenEdge Replication
27
Introduction to Replication 2007 Progress Software Corporation
Machine Setup
Source and target machines must
Have identical architectures Be running the same operating system Be connected via TCP/IP
The target machine must have disk space comparable to the source machine
28
Introduction to Replication
2007 Progress Software Corporation
Progress Requirements
Progress 9.1E for Fathom Replication 3.0A OpenEdge 10.0B+ for OpenEdge Replication (failback capabilities enable in 10.1A) After-imaging must be enabled
29
Introduction to Replication
2007 Progress Software Corporation
Introduction to Replication
Replication Overview Sample OpenEdge Replication Process Image: Failover, Secondary Replication, and Please Failback replace it Summary
(Insert, Picture, )
30
Introduction to Replication
2007 Progress Software Corporation
Replication Modes
Secondary Replication
Primary
Primary Replication
31
Introduction to Replication
2007 Progress Software Corporation
Primary Replication
Secondary
Enabling OpenEdge Replication
Replication enabled
Secondary
Primary
32
Introduction to Replication
2007 Progress Software Corporation
Failover Time Line
Replication enabled
Secondary
Primary
33
Introduction to Replication
2007 Progress Software Corporation
Failover Time Line
Replication enabled
Primary
Source fails
Secondary
Transition to source
34
Introduction to Replication
2007 Progress Software Corporation
Deployment Fail Over
Manual
Transition target to production
dsrutil target -C transition agent Auto Database is automatically transitioned to production Start target database server
35
Introduction to Replication
2007 Progress Software Corporation
Failover Time Line
FR enabled
Primary
Source fails
Secondary
Transition to source Updates begin
Target shutdown and re-started
36
Introduction to Replication 2007 Progress Software Corporation
Failover Time Line
Replication enabled
Primary
Source fails
Restore backup
Secondary
Online Transition backup to source Updates begin
Target shutdown and re-started
37
Introduction to Replication 2007 Progress Software Corporation
Failover Time Line
Replication enabled Reverse roles Restore backup
Primary
Source fails
Secondary
Online Transition backup to source Updates begin
Target shutdown and re-started
38
Introduction to Replication 2007 Progress Software Corporation
Failover Time Line
Replication enabled Reverse roles Restore backup
Primary
Source fails
Secondary
Online Transition backup to source Updates begin
Target shutdown and re-started
39
Introduction to Replication
Target & Source shutdown & re-started
2007 Progress Software Corporation
Replication Failback Transition
Transition based on the properties files Transition will occur based on the following criteria:
Source or target Online or offline Is Replication Server or Agent running? Has failure just occurred?
40
Introduction to Replication
2007 Progress Software Corporation
Replication Modes
Secondary Replication
Primary
Primary Replication
41
Introduction to Replication
2007 Progress Software Corporation
Primary Replication
Secondary
OpenEdge Replication Enables
Online transitions AI automation
Extent add Start
Auto DB control
Shutdown after transition Auto restart
42
Introduction to Replication
2007 Progress Software Corporation
Replication also enables
Scheduled system maintenance capabilities Reporting on Target Database
43
Introduction to Replication
2007 Progress Software Corporation
OpenEdge Replication Summary
Your Benefits
24/7 availability Complete protection of mission-critical data Optimized performance Fast ROI
How It Works
Automatic failover Real-time data replication Query access reporting on the target database No application changes are required
44
Introduction to Replication
2007 Progress Software Corporation
Meeting Business Objectives
Ease of Use
Hard
Log-based Replication Log-based Replication
3rd Party Replication 3rd Party Replication
Vendor Replication Vendor Replication
Easy Inexpensive
45
Introduction to Replication
Expensive
Overall Cost
2007 Progress Software Corporation
In Summary
Protect your business Protect your data Protects your future with OpenEdge Replication
46
Introduction to Replication
2007 Progress Software Corporation
Questions?
47
Introduction to Replication
2007 Progress Software Corporation
48
Introduction to Replication
2007 Progress Software Corporation