<Insert Picture Here>

Advanced Compression with

Oracle Database 11g Release 2
 Agenda

• Data Growth Challenges

• Advanced Compression Feature Overview
• Relational Data Compression
• Unstructured Data Compression
• Backup Data Compression
• Network Transport Data Compression

• Questions and Answers

2
 Challenges

• Explosion in Data Volumes

• Government Regulations (Sarbanes-Oxley, etc)
• User Generated Content (Web 2.0)
• Application Consolidation

• IT Managers Must Support Larger Volumes of Data

with Limited Technology Budgets
• Need to optimize storage consumption
• Also maintain acceptable application performance

• Intelligent and Efficient Compression Technology can

Help Address These Challenges

3
 Oracle Advanced Compression Option

• SecureFiles • Data Pump Data

Compression • Data Guard Redo
• OLTP Table Deduplication
Transport
Compression • SecureFiles • RMAN Fast Backup Compression
Compression Compression

Unstructured
Relational Data Backup Data Network Data
Data
Compression Compression Compression
Compression

• Reduces resource requirements and costs

• Storage System
• Network Bandwidth
• Memory Usage

4
 Oracle Advanced Compression Option

• SecureFiles • Data Pump Data

Compression • Data Guard Redo
• OLTP Table Deduplication
Transport
Compression • SecureFiles • RMAN Fast Backup Compression
Compression Compression

Relational Data Unstructured Data Backup Data Network Data

Compression Compression Compression Compression

• Reduces resource requirements and costs

• Storage System
• Network Bandwidth
• Memory Usage

5
 Table Compression

• Introduced in Oracle Database 9i Release 2

• Compression during bulk load operations (Direct Load, CTAS)
• Data modified using conventional DML not compressed
• Optimized compression algorithm for relational data
• Improved performance for queries accessing large
amounts of data
• Fewer I/Os
• Buffer Cache efficiency
• Data is compressed at the database block level
• Compression enabled at either the table or partition level
• Completely transparent to applications

6
 OLTP Table Compression

• Oracle Database 11g extends table compression for

OLTP data
• Support for conventional DML Operations (INSERT, UPDATE)
• New algorithm significantly reduces write overhead
• Batched compression minimizes impact for OLTP transactions
• No impact on reads
• Reads may actually see improved performance due to fewer I/
Os and enhanced memory efficiency

7
OLTP Table Compression Process

Empty Initially Compressed Partially Compressed

Uncompressed Block Compressed Block
Block Block Block

Legend

Header Data Uncompressed Data

Free Space Compressed Data

8
 Block-Level Batch Compression

• Patent pending algorithm minimizes performance overhead and

maximizes compression
• Individual INSERTs and UPDATEs do not cause recompression
• Compression cost is amortized over several DML operations
• Block-level (Local) compression keeps up with frequent data
changes in OLTP environments
• Competitors use static, fixed size dictionary table thereby
compromising compression benefits

9
OLTP Table Compression

Initially Uncompressed
Employee Table
Block
ID FIRST_NAME LAST_NAME Header
1 John Doe
1•John•Doe 2•Jane•
2 Jane Doe
Doe 3•John•Smith 4•
3 John Smith Jane • Doe
4 Jane Doe Free Space

INSERT INTO EMPLOYEE

VALUES (5, ‘Jack’, ‘Smith’);
COMMIT;

10
OLTP Table Compression

Employee Table Compressed

Block Block
ID FIRST_NAME LAST_NAME Header
John=|Doe=|Jane=|Smith=
1 John Doe
1•• 2•• 3••
1•John•Doe 4•
2•Jane•
2 Jane Doe •Doe
 5•Jack•
3•John•Smith 4•
3 John Smith Jane • Doe
Free Space
4 Jane Doe Free Space

5 Jack Smith

Local
Symbol Table

11
Table Compression Syntax

OLTP Table Compression Syntax:

CREATE TABLE emp (
emp_id NUMBER
, first_name VARCHAR2(128)
, last_name VARCHAR2(128)
) COMPRESS FOR OLTP;

Direct Load Compression Syntax (default):

CREATE TABLE emp (
emp_id NUMBER
, first_name VARCHAR2(128)
, last_name VARCHAR2(128)
) COMPRESS [BASIC];

12
 Table Compression Advisor
Estimate Potential Storage Savings
• Available in 11g Release 2
• Available on OTN *
• Supports Oracle Database 9i Release 2 through 11g Release 1
• Shows projected compression ratio for uncompressed tables
• Reports actual compression ratio for compressed tables (11g Only)

* http://www.oracle.com/technology/products/database/compression/compression-advisor.html

13
 Monitoring Table Compression
• View: DBA_TABLES, columns:
• COMPRESSION ( ENABLED / DISABLED )
• COMPRESS_FOR ( FOR ALL OPERATIONS / DIRECT LOAD ONLY )

14
 <Insert Picture Here>

Table Compression Results

15
 Oracle’s Internal E-Business Suite DB
• Overall database storage savings: 3x
• Table compression 4x
• Index compression 2x
• LOB compression 2.3x
• 95 TB of Total Storage Savings!
• Primary, standby, test, dev, and backup
• Payroll, Order-2-Cash, AP/AR batch flows, Self-Service
flows run without regression, Queries involving full table
scans show speedup

16
 Oracle’s Internal Beehive Email DB

• Average Compression Ratio: 2x

• Oracle Database 11g Release 1
• Exadata Storage Servers
• Storage savings add up with standby, mirroring, flash recovery area
• Phase I in production
• Email for 28K employees
• 195 TB of storage savings with SecureFiles Compression
• Phase II, Dec 2009
• Migrate all 90K employees on this email server
• 581TB estimated storage savings with SecureFiles Compression
• Performance improved by caching more data due to compression -
reducing I/O latencies

17
 SAP R/3, BW, Leading Global Company

• Compression on SAP databases

at leading global company
• Oracle Database 11g Release 2
• SAP R/3 DB
• 4.67TB Uncompressed
• 1.93 TB Compressed
• 2.4x compression ratio
• SAP BW DB
• 1.38 TB Uncompressed
• .53 TB Compressed
• 2.6x compression ratio
• Leverage 11g compression for
Tables, Indexes and LOB data

18
 Real Networks

• Rhapsody Digital Music Subscription Service

• Compression results using 11g Release 1

• Average Compression Ratio: 2.8x
• Highest compression ratio: 8x
• Total Savings: 3.5TB

19
 CERN

• Oracle Database 11g Release 2

• Average Compression Ratio: 2x

• Highest Compression Ratio 6x

• Scientific application supporting particle research

20
 Oracle Advanced Compression Option

• SecureFiles • Data Pump Data

Compression • Data Guard Redo
• OLTP Table Deduplication
Transport
Compression • SecureFiles • RMAN Fast Backup Compression
Compression Compression

Unstructured
Relational Data Backup Data Network Data
Data
Compression Compression Compression
Compression

• Reduces resource requirements and costs

• Storage System
• Network Bandwidth
• Memory Usage

21
 Introduction to SecureFiles

• Next-generation high performance LOB

• Superset of LOB interfaces allows easy migration from LOBs
• Transparent deduplication, compression, and encryption
• Leverage the security, reliability, and scalability of database

• Enables consolidation of file data with associated relational data

• Single security model
• Single view of data
• Single management of data
• Scalable to any level using SMP scale-up or grid scale-out

22
 SecureFiles Deduplication

Secure Hash

• Enables storage of a single physical image for duplicate data

• Significantly reduces space consumption
• Dramatically improves writes and copy operations
• No adverse impact on read operations
• May actually improve read performance for cache data
• Duplicate detection happens within a table, partition or sub-partition
• Specially useful for content management, email applications and
data archival applications

23
 SecureFiles Compression
• Significant storage savings for unstructured data
• Three levels of compression (LOW/[MEDIUM]/ HIGH ) provide desired
ratios
• 2-3x compression for typical files (combination of doc, pdf, xml)
• Compression Level LOW (NEW in 11.2)
• Compression algorithm optimized for high performance
• 3x less CPU utilization than default SecureFiles Compression
• Maintains 80% compression of default SecureFiles Compression

• Allows for random reads and writes to Compressed SecureFile data

• Can be specified at a partition level
• Automatically detects if SecureFile data is compressible
• Independent of table or index compression

24
SecureFiles Compression Syntax
Compression Syntax
CREATE TABLE t1 (a CLOB)
LOB(a) STORE AS SECUREFILE (
COMPRESS
CACHE
);

Deduplication Syntax
CREATE TABLE t1 (a CLOB)
LOB(a) STORE AS SECUREFILE (
DEDUPLICATE
CACHE
);

25
 Oracle Advanced Compression Option

• SecureFiles • Data Pump Data

Compression • Data Guard Redo
• OLTP Table Deduplication
Transport
Compression • SecureFiles • RMAN Fast Backup Compression
Compression Compression

Relational Data Unstructured Data Backup Data Network Data

Compression Compression Compression Compression

• Reduces resource requirements and costs

• Storage System
• Network Bandwidth
• Memory Usage

26
 Data Pump Compression

• Metadata compression available since Oracle Database 10g

• Oracle Database 11g extends compression to table data during
exports
• No need to decompress before import
• COMPRESSION={ALL | DATA_ONLY | [METADATA_ONLY] | NONE}
• Single step compression of both data and metadata
• Compressed data directly hits disk resulting in reduced disk space
requirements
• Internal tests reduced dump file size up to 75%
• Application transparent
• Complete Data Pump functionality available on compressed files

27
 Advanced Compression
New in Oracle Database 11g Release 2
• RMAN Backup Compression
• Compression Level LOW (New in 11.2)
• Fastest compression algorithm
• Best suited when backup is constrained by CPU
• Compression Level MEDIUM (New in 11.1)
• Balance between CPU usage and compression ratio
• Formerly Fast RMAN Backup Compression
• 11.1 syntax supported in 11.2
• Compression LEVEL HIGH (New in 11.2)
• Best compression ratio and highest CPU utilization
• Best suited when backup is constrained by network or I/O

28
Backup Compression Syntax

Data Pump Syntax

PROMPT> expdp hr DIRECTORY=dpump_dir1
DUMPFILE=hr_comp.dmp COMPRESSION=ALL

FAST RMAN Backup Compression Configuration

RMAN> configure compression algorithm 'MEDIUM';

RMAN Backup Compression Syntax

RMAN> BACKUP AS COMPRESSED BACKUPSET DATABASE
PLUS ARCHIVELOG;

29
 <Insert Picture Here>

RMAN Compression Results

30
 RMAN Compression Overview

• Data from Oracle’s implementation of Oracle Applications

• 3.5 GB Database
• Oracle Enterprise Linux
• Oracle Database 11g Release 1
• Test 1: Slow I/O (16 MB/s)
• 11g RMAN without Compression
• 10g RMAN with Compression
• 11g RMAN with MEDIUM Compression
• Test 2: Fast I/O (200 MB/s)
• 11g RMAN without Compression
• 10g RMAN with Compression
• 11g RMAN with MEDIUM Compression

31
 Backup Compression Results

Backup Size Comparison

Compression
reduced backup
size by 6x
GB

32
 Backup Compression
Backup Speed Comparison
Slow I/O (Tape)
11g Compression
is almost 2.5x
faster than 10g
Time (Seconds)

Compression

33
 Backup Compression
Backup Speed Comparison
Fast I/O (Disk)
11g Compression
is almost 2.5x
faster than 10g
Time (Seconds)

Compression

34
 Oracle Advanced Compression Option

• SecureFiles • Data Pump Data

Compression • Data Guard Redo
• OLTP Table Deduplication
Transport
Compression • SecureFiles • RMAN Fast Backup Compression
Compression Compression

Relational Data Unstructured Data Backup Data Network Data

Compression Compression Compression Compression

• Reduces resource requirements and costs

• Storage System
• Network Bandwidth
• Memory Usage

35
 Network Compression
Data Guard Redo Transport Services
• Compress network traffic between primary and standby databases
• Lower bandwidth networks (<100Mbps)
• 15-35% less time required to transmit 1 GB of data
• Bandwidth consumption reduced up to 35%
• High bandwidth networks (>100 Mbps)
• Compression will not reduce transmission time
• But will reduce bandwidth consumption up to 35%
• Syntax:
LOG_ARCHIVE_DEST_3='SERVICE=denver SYNC
COMPRESSION=ENABLE|[DISABLE]'
• Ref. MetaLink 729551.1 Redo Transport Compression in a Data
Guard Environment

36
 Redo Transport Compression

2X Compression !
5X Compression !

• More efficient bandwidth utilization, up to 5x compression ratio

• Compression did not impact throughput or response time

Validation performed by CTC in collaboration with Oracle Japan Grid Center

http://www.ctc-g.co.jp/en/

37
 Summary

• Comprehensive data compression capabilities for all

types of data
• Structured, Unstructured, Backup, Network
• Reduces storage consumption by 2 to 4 times
• Improves read performance
• Enhances memory, buffer cache utilization
• Complete application transparency
• Benefits diverse application workloads

38
 For More Information

search.oracle.com
advanced compression

Or

OTN: http://www.oracle.com/technology/products/database/compression/index.html

39
40
41