Oracle Exadata Rack Size
| Rack Size | DB Servers | Storage Servers | Typical Use |
|---|
| Eighth Rack | 2 | 3 | Dev / Test / DR |
| Quarter Rack | 2 | 5 | Small–Medium Production |
| Half Rack | 4 | 7 | Medium–Large Production |
| Full Rack | 8 | 14 | Large / Mission Critical |
Exadata Interconnect Network / Bond Speed (X5 – X11M)
| Exadata Model | Network Type | Speed Per Port | Bonded Speed |
| X5 | InfiniBand (FDR) | 56 Gbps | 56 Gbps × 2 = 112 Gbps |
| X6 | InfiniBand (FDR) | 56 Gbps | 56 Gbps × 2 = 112 Gbps |
| X7 | InfiniBand (EDR) | 100 Gbps | 100 Gbps × 2 = 200 Gbps |
| X8 | InfiniBand (EDR) | 100 Gbps | 100 Gbps × 2 = 200 Gbps |
| X8M | RoCE (RDMA over Converged Ethernet) | 100 Gbps | 100 Gbps × 2 = 200 Gbps |
| X9M | RoCE | 100 Gbps | 100 Gbps × 2 = 200 Gbps |
| X10M | RoCE | 100 Gbps | 100 Gbps × 2 = 200 Gbps |
| X11M | RoCE | 100 Gbps | 100 Gbps × 2 = 200 Gbps |
Exadata Networking Overview
Oracle Exadata uses a high-speed low-latency internal network connecting
Database Servers, Storage Servers (Cells), and Switches.
This network enables features like Smart Scan, ASM rebalance, RAC cache fusion, and high-speed data transfer.
1. Client Network
| Feature | Description |
|---|
| Purpose | Application connections to the database |
| Traffic | SQL queries, application requests |
| Network Type | Standard Ethernet (10Gb / 25Gb / 40Gb / 100Gb) |
| Example Flow | Application → Client Network → SCAN Listener → RAC Node |
2. RAC Private Interconnect
The private interconnect network is used for communication between RAC database nodes.
| Usage | Description |
|---|
| Cache Fusion | Transfer blocks between RAC nodes |
| Cluster Heartbeat | Maintains RAC node communication |
| Parallel Query | Data exchange between nodes |
| Exadata Model | Networking Technology |
|---|
| X2 – X6 | InfiniBand (40–56 Gb) |
| X7 – X8 | InfiniBand (100 Gb) |
| X8M and Later | RoCE (RDMA over Converged Ethernet) |
3. Storage Network (Database → Storage Cells)
Database nodes communicate with Exadata storage servers using a high-speed RDMA network.
| Feature | Description |
|---|
| Smart Scan | Query processing pushed to storage servers |
| Block Reads | Fast data retrieval from storage cells |
| ASM Rebalance | High-speed disk rebalance operations |
| Flash Cache Reads | Access flash storage with very low latency |
Exadata Network Architecture
| Component | Typical Full Rack Count |
|---|
| Database Servers | 8 |
| Storage Servers | 12 |
| Network Switches | 2 (Redundant) |
Important Exadata Networking Commands
cat /proc/net/bonding/bondib0
ip addr
rdma link
ibstat
Key Advantages of Exadata Networking
| Feature | Benefit |
|---|
| RDMA | Ultra low latency communication |
| High Bandwidth | Faster query processing |
| Redundant Switches | High availability |
| Bonded Interfaces | Network failover and load balancing |
Caution: Your use of any information or materials on this website is entirely at your own risk. It is provided for educational purposes only. It has been tested internally, however, we do not guarantee that it will work for you. Ensure that you run it in your test environment before using.
Thank you,
Rajasekhar Amudala
Email: br8dba@gmail.com
Linkedin: https://www.linkedin.com/in/rajasekhar-amudala/
Oracle Exadata Rack Size
| Rack Size | DB Servers | Storage Servers | Typical Use |
|---|
| Eighth Rack | 2 | 3 | Dev / Test / DR |
| Quarter Rack | 2 | 5 | Small–Medium Production |
| Half Rack | 4 | 7 | Medium–Large Production |
| Full Rack | 8 | 14 | Large / Mission Critical |
Oracle Exadata DB Server (Compute Node) – Memory (X5 to X11M)
| Exadata Model | Memory / DB Server | Quarter Rack (2 DB) | Half Rack (4 DB) | Full Rack (8 DB) |
|---|
| X5 | 256 GB | 256 GB × 2 = 512 GB | 256 GB × 4 = 1 TB | 256 GB × 8 = 2 TB |
| X6 | 1.5 TB | 1.5 TB × 2 = 3 TB | 1.5 TB × 4 = 6 TB | 1.5 TB × 8 = 12 TB |
| X7 | 1.5 TB | 1.5 TB × 2 = 3 TB | 1.5 TB × 4 = 6 TB | 1.5 TB × 8 = 12 TB |
| X8 | 1.5 TB | 1.5 TB × 2 = 3 TB | 1.5 TB × 4 = 6 TB | 1.5 TB × 8 = 12 TB |
| X8M | 1.5 TB | 1.5 TB × 2 = 3 TB | 1.5 TB × 4 = 6 TB | 1.5 TB × 8 = 12 TB |
| X9M | 2 TB | 2 TB × 2 = 4 TB | 2 TB × 4 = 8 TB | 2 TB × 8 = 16 TB |
| X10M | 3 TB | 3 TB × 2 = 6 TB | 3 TB × 4 = 12 TB | 3 TB × 8 = 24 TB |
| X11M | 3 TB | 3 TB × 2 = 6 TB | 3 TB × 4 = 12 TB | 3 TB × 8 = 24 TB |
Caution: Your use of any information or materials on this website is entirely at your own risk. It is provided for educational purposes only. It has been tested internally, however, we do not guarantee that it will work for you. Ensure that you run it in your test environment before using.
Thank you,
Rajasekhar Amudala
Email: br8dba@gmail.com
Linkedin: https://www.linkedin.com/in/rajasekhar-amudala/
Oracle Exadata Rack Size
| Rack Size | DB Servers | Storage Servers | Typical Use |
|---|
| Eighth Rack | 2 | 3 | Dev / Test / DR |
| Quarter Rack | 2 | 5 | Small–Medium Production |
| Half Rack | 4 | 7 | Medium–Large Production |
| Full Rack | 8 | 14 | Large / Mission Critical |
Oracle Exadata DB Server (Compute Node) – CPU (X5 to X11M)
| Exadata Model | CPU (Per DB Server) | Total (Per DB Server) | Total CPU (Quarter Rack – 2 DB Servers) | Total CPU (Half Rack – 4 DB Servers) | Total CPU (Full Rack – 8 DB Servers) |
|---|
| X5 | 2 × 18-core Intel | 36 cores | 36 × 2 = 72 cores | 36 × 4 = 144 cores | 36 × 8 = 288 cores |
| X6 | 2 × 22-core Intel | 44 cores | 44 × 2 = 88 cores | 44 × 4 = 176 cores | 44 × 8 = 352 cores |
| X7 | 2 × 24-core Intel | 48 cores | 48 × 2 = 96 cores | 48 × 4 = 192 cores | 48 × 8 = 384 cores |
| X8 | 2 × 24-core Intel | 48 cores | 48 × 2 = 96 cores | 48 × 4 = 192 cores | 48 × 8 = 384 cores |
| X8M | 2 × 24-core Intel | 48 cores | 48 × 2 = 96 cores | 48 × 4 = 192 cores | 48 × 8 = 384 cores |
| X9M | 2 × 32-core Intel | 64 cores | 64 × 2 = 128 cores | 64 × 4 = 256 cores | 64 × 8 = 512 cores |
| X10M | 2 × 96-core AMD | 192 cores | 192 × 2 = 384 cores | 192 × 4 = 768 cores | 192 × 8 = 1536 cores |
| X11M | 2 × 96-core AMD | 192 cores | 192 × 2 = 384 cores | 192 × 4 = 768 cores | 192 × 8 = 1536 cores |
Caution: Your use of any information or materials on this website is entirely at your own risk. It is provided for educational purposes only. It has been tested internally, however, we do not guarantee that it will work for you. Ensure that you run it in your test environment before using.
Thank you,
Rajasekhar Amudala
Email: br8dba@gmail.com
Linkedin: https://www.linkedin.com/in/rajasekhar-amudala/
Exadata Part Replacement – Quick Notes
Hot Swappable Components
| Component | Replacement Type |
|---|
| LUN / Disk | Hot Swappable |
| Fan | Hot Swappable |
| Single Power Supply | Hot Swappable |
| Flash Disk (From X7) | Hot Swappable |
| DIMM | Shutdown Required |
| Motherboard | Shutdown Required |
Before Replacement (If Shutdown Required)
**** Always verify ASM rebalance activity before making grid disks inactive.
select * from gv$asm_operation;
cellcli -e list griddisk attributes name, asmmodestatus, asmdeactivationoutcome, status
cellcli -e alter griddisk all inactive
cellcli -e list griddisk attributes name, asmmodestatus, asmdeactivationoutcome, status
service celld status
service celld stop
shutdown -h now
After Replacement
service celld status
cellcli -e list griddisk attributes name, asmmodestatus, asmdeactivationoutcome
cellcli -e alter griddisk all active
cellcli -e list griddisk attributes name, asmmodestatus, asmdeactivationoutcome
select * from gv$asm_operation;
Caution: Your use of any information or materials on this website is entirely at your own risk. It is provided for educational purposes only. It has been tested internally, however, we do not guarantee that it will work for you. Ensure that you run it in your test environment before using.
Thank you,
Rajasekhar Amudala
Email: br8dba@gmail.com
Linkedin: https://www.linkedin.com/in/rajasekhar-amudala/
