For 19c, you may refer to: How to Build 19c RAC - 1 of 4 - Preparing Two Database Servers.
Network Design for RAC
Let's see the network design of our cluster database.
[root@primary01 ~]# vi /etc/hosts
# Public
192.168.10.11 primary01 primary01.example.com
192.168.10.12 primary02 primary02.example.com
# Private
192.168.24.11 primary01-priv primary01-priv.example.com
192.168.24.12 primary02-priv primary02-priv.example.com
# VIP
192.168.10.111 primary01-vip primary01-vip.example.com
192.168.10.112 primary02-vip primary02-vip.example.com
# SCAN
# 192.168.10.81 primary-cluster-scan primary-cluster-scan.example.com
# 192.168.10.82 primary-cluster-scan primary-cluster-scan.example.com
# 192.168.10.83 primary-cluster-scan primary-cluster-scan.example.com
# NAS
192.168.10.101 nas nas.example.com
# DNS
192.168.10.56 dns dns.example.com
The network design has been summarized as below:
- Two nodes for RAC servers: primary01 and primary02.
- One NAS for shared storage.
- One DNS for resolving hostname, especially for SCAN name.
- Two network cards, one is for public subnet, another is for private subnet.
- Public subnet (192.168.10.0/24): only for public connection. Later, all virtual IP like SCAN and VIP will dynamically bind with this NIC after running CRS.
- Private subnet (192.168.24.0/24): for both private and ASM connections. This NIC is mainly for node interconnection, not for outside access.
Please note that, you can only have one DNS server in NIC configuration.
Same hosts configuration must also appear in primary02 according to our design.
Security Configuration
We stopped firewall and selinux on both nodes to make RAC installation more smoothly.
[root@primary01 ~]# systemctl stop firewalld
[root@primary01 ~]# systemctl disable firewalld
[root@primary01 ~]# vi /etc/selinux/config
...
SELINUX=disabled
If you couldn't or wouldn't disable firewall, then you may also open port 1521 on Linux for your listener.
NTP Server
Please make sure NTP is working well on both nodes. Here we use the default NTP service chronyd to play the role.
[root@primary01 ~]# systemctl status chronyd
● chronyd.service - NTP client/server
Loaded: loaded (/usr/lib/systemd/system/chronyd.service; enabled; vendor preset: enabled)
Active: active (running) since Mon 2018-11-19 18:38:40 CST; 7h left
Docs: man:chronyd(8)
man:chrony.conf(5)
Process: 1656 ExecStartPost=/usr/libexec/chrony-helper update-daemon (code=exited, status=0/SUCCESS)
Process: 1652 ExecStart=/usr/sbin/chronyd $OPTIONS (code=exited, status=0/SUCCESS)
Main PID: 1654 (chronyd)
CGroup: /system.slice/chronyd.service
└─1654 /usr/sbin/chronyd
Nov 19 18:38:40 primary01.example.com systemd[1]: Starting NTP client/server...
Nov 19 18:38:40 primary01.example.com chronyd[1654]: chronyd version 3.2 star...
Nov 19 18:38:40 primary01.example.com systemd[1]: Started NTP client/server.
Nov 19 18:38:45 primary01.example.com chronyd[1654]: Selected source 118.163....
Nov 19 18:38:45 primary01.example.com chronyd[1654]: System clock wrong by -2...
Nov 19 10:38:44 primary01.example.com chronyd[1654]: System clock was stepped...
Nov 19 10:38:45 primary01.example.com chronyd[1654]: Selected source 211.22.1...
Hint: Some lines were ellipsized, use -l to show in full.
Connect to Shared Storage
In our design, we use a NAS which provides iSCSI sharing service. Our database servers play as iSCSI clients, so we need to install iSCSI initiator package. For Solaris database servers, you may check: How to Configure iSCSI Disk on Solaris.
As I mentioned earlier, I assume that you have already prepared a shared storage for database servers to connect. You may find a tutorial here: How to Build 12c RAC (1/6) - Building a NAS for Shared Storage of RAC.
First of all, we have to install iSCSI initiator on both nodes.
[root@primary01 ~]# yum -y install iscsi-initiator-utils lsscsi
Loaded plugins: ulninfo
Package lsscsi-0.27-6.el7.x86_64 already installed and latest version
Resolving Dependencies
--> Running transaction check
---> Package iscsi-initiator-utils.x86_64 0:6.2.0.874-10.0.1.el7 will be installed
--> Processing Dependency: iscsi-initiator-utils-iscsiuio >= 6.2.0.874-10.0.1.el7 for package: iscsi-initiator-utils-6.2.0.874-10.0.1.el7.x86_64
--> Running transaction check
---> Package iscsi-initiator-utils-iscsiuio.x86_64 0:6.2.0.874-10.0.1.el7 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
================================================================================
Package Arch Version Repository Size
================================================================================
Installing:
iscsi-initiator-utils x86_64 6.2.0.874-10.0.1.el7 ol7_latest 421 k
Installing for dependencies:
iscsi-initiator-utils-iscsiuio x86_64 6.2.0.874-10.0.1.el7 ol7_latest 91 k
Transaction Summary
================================================================================
Install 1 Package (+1 Dependent package)
Total download size: 512 k
Installed size: 2.6 M
Downloading packages:
(1/2): iscsi-initiator-utils-iscsiuio-6.2.0.874-10.0.1.el7 | 91 kB 00:00
(2/2): iscsi-initiator-utils-6.2.0.874-10.0.1.el7.x86_64.r | 421 kB 00:01
--------------------------------------------------------------------------------
Total 297 kB/s | 512 kB 00:01
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Installing : iscsi-initiator-utils-iscsiuio-6.2.0.874-10.0.1.el7.x86_64 1/2
Installing : iscsi-initiator-utils-6.2.0.874-10.0.1.el7.x86_64 2/2
Verifying : iscsi-initiator-utils-6.2.0.874-10.0.1.el7.x86_64 1/2
Verifying : iscsi-initiator-utils-iscsiuio-6.2.0.874-10.0.1.el7.x86_64 2/2
Installed:
iscsi-initiator-utils.x86_64 0:6.2.0.874-10.0.1.el7
Dependency Installed:
iscsi-initiator-utils-iscsiuio.x86_64 0:6.2.0.874-10.0.1.el7
Complete!
Then enable and start iSCSI services on both nodes.
[root@primary01 ~]# systemctl enable iscsid
Created symlink from /etc/systemd/system/multi-user.target.wants/iscsid.service to /usr/lib/systemd/system/iscsid.service.
[root@primary01 ~]# systemctl enable iscsi
[root@primary01 ~]# systemctl start iscsid
[root@primary01 ~]# systemctl start iscsi
Now, we discover all targets from NAS on both nodes. In this case, we prepared 8 iSCSI entents, 16 GB each to associate targets in NAS.
[root@primary01 ~]# iscsiadm -m discovery -t sendtargets -p nas
192.168.10.101:3260,2 iqn.2005-10.org.freenas.ctl:asm-t1
[root@primary01 ~]# iscsiadm -m node --op update -n node.startup -v automatic
[root@primary01 ~]# iscsiadm -m node -p nas --login
Logging in to [iface: default, target: iqn.2005-10.org.freenas.ctl:asm-t1, portal: 192.168.10.101,3260] (multiple)
Login to [iface: default, target: iqn.2005-10.org.freenas.ctl:asm-t1, portal: 192.168.10.101,3260] successful.
...
List all iSCSI lun by path.
[root@primary01 ~]# ll /dev/disk/by-path/
total 0
lrwxrwxrwx 1 root root 9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t1-lun-1 -> ../../sdb
lrwxrwxrwx 1 root root 9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t2-lun-2 -> ../../sdc
lrwxrwxrwx 1 root root 9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t3-lun-3 -> ../../sdd
lrwxrwxrwx 1 root root 9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t4-lun-4 -> ../../sde
lrwxrwxrwx 1 root root 9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t5-lun-5 -> ../../sdf
lrwxrwxrwx 1 root root 9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t6-lun-6 -> ../../sdg
lrwxrwxrwx 1 root root 9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t7-lun-7 -> ../../sdh
lrwxrwxrwx 1 root root 9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t8-lun-8 -> ../../sdi
...
Then we have to partition all the 8 shared disks only on one node. Usually, node 1 is our first choice. The procedures to partition a disk are all the same. So we take /dev/sdb for an example here.
[root@primary01 ~]# fdisk /dev/sdb
Welcome to fdisk (util-linux 2.23.2).
Changes will remain in memory only, until you decide to write them.
Be careful before using the write command.
Device does not contain a recognized partition table
Building a new DOS disklabel with disk identifier 0x0051eb0e.
Command (m for help): n
Partition type:
p primary (0 primary, 0 extended, 4 free)
e extended
Select (default p):
Using default response p
Partition number (1-4, default 1):
First sector (2048-335544319, default 2048):
Using default value 2048
Last sector, +sectors or +size{K,M,G} (2048-335544319, default 335544319):
Using default value 335544319
Partition 1 of type Linux and of size 160 GiB is set
Command (m for help): w
The partition table has been altered!
Calling ioctl() to re-read partition table.
Syncing disks.
Let's see disks after partitioning.
[root@primary01 ~]# ll /dev/disk/by-path/
total 0
lrwxrwxrwx 1 root root 9 Nov 19 11:02 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t1-lun-1 -> ../../sdb
lrwxrwxrwx 1 root root 10 Nov 19 11:02 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t1-lun-1-part1 -> ../../sdb1
lrwxrwxrwx 1 root root 9 Nov 19 11:02 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t2-lun-2 -> ../../sdc
lrwxrwxrwx 1 root root 10 Nov 19 11:02 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t2-lun-2-part1 -> ../../sdc1
...
On the other node, node 2, we have to refresh the partition table to get the newest disk information.
[root@primary02 ~]# partprobe -s
/dev/sda: msdos partitions 1 2
/dev/sdb: msdos partitions 1
/dev/sdc: msdos partitions 1
...
Oracle Preinstall Package
Oracle preinstall package can ease our task on installation. For example, installing required packages and create required users and groups.
On both nodes.
[root@primary01 ~]# yum -y install oracle-database-preinstall-18c.x86_64
Loaded plugins: ulninfo
Resolving Dependencies
--> Running transaction check
---> Package oracle-database-preinstall-18c.x86_64 0:1.0-1.el7 will be installed
--> Processing Dependency: bc for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: sysstat for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: xorg-x11-utils for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: net-tools for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: compat-libcap1 for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: ksh for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: libaio-devel for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: xorg-x11-xauth for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: psmisc for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: unzip for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: glibc-devel for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: compat-libstdc++-33 for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: libstdc++-devel for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: nfs-utils for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: smartmontools for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Running transaction check
---> Package bc.x86_64 0:1.06.95-13.el7 will be installed
---> Package compat-libcap1.x86_64 0:1.10-7.el7 will be installed
---> Package compat-libstdc++-33.x86_64 0:3.2.3-72.el7 will be installed
---> Package glibc-devel.x86_64 0:2.17-260.0.9.el7 will be installed
--> Processing Dependency: glibc-headers = 2.17-260.0.9.el7 for package: glibc-devel-2.17-260.0.9.el7.x86_64
--> Processing Dependency: glibc = 2.17-260.0.9.el7 for package: glibc-devel-2.17-260.0.9.el7.x86_64
--> Processing Dependency: glibc-headers for package: glibc-devel-2.17-260.0.9.el7.x86_64
---> Package ksh.x86_64 0:20120801-139.0.1.el7 will be installed
---> Package libaio-devel.x86_64 0:0.3.109-13.el7 will be installed
---> Package libstdc++-devel.x86_64 0:4.8.5-36.0.1.el7 will be installed
--> Processing Dependency: libstdc++(x86-64) = 4.8.5-36.0.1.el7 for package: libstdc++-devel-4.8.5-36.0.1.el7.x86_64
---> Package net-tools.x86_64 0:2.0-0.24.20131004git.el7 will be installed
---> Package nfs-utils.x86_64 1:1.3.0-0.61.0.1.el7 will be installed
--> Processing Dependency: gssproxy >= 0.7.0-3 for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: libtirpc >= 0.2.4-0.7 for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: rpcbind for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: keyutils for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: quota for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: libevent for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: libnfsidmap for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: libevent-2.0.so.5()(64bit) for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: libtirpc.so.1()(64bit) for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: libnfsidmap.so.0()(64bit) for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
---> Package psmisc.x86_64 0:22.20-15.el7 will be installed
---> Package smartmontools.x86_64 1:6.5-1.el7 will be installed
--> Processing Dependency: mailx for package: 1:smartmontools-6.5-1.el7.x86_64
---> Package sysstat.x86_64 0:10.1.5-17.el7 will be installed
--> Processing Dependency: libsensors.so.4()(64bit) for package: sysstat-10.1.5-17.el7.x86_64
---> Package unzip.x86_64 0:6.0-19.el7 will be installed
---> Package xorg-x11-utils.x86_64 0:7.5-23.el7 will be installed
--> Processing Dependency: libXext.so.6()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXv.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXtst.so.6()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXrender.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXxf86vm.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXxf86misc.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libX11-xcb.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXrandr.so.2()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libdmx.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXinerama.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libX11.so.6()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXxf86dga.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libxcb.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libxcb-shape.so.0()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXi.so.6()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
---> Package xorg-x11-xauth.x86_64 1:1.0.9-1.el7 will be installed
--> Processing Dependency: libXau.so.6()(64bit) for package: 1:xorg-x11-xauth-1.0.9-1.el7.x86_64
--> Processing Dependency: libXmuu.so.1()(64bit) for package: 1:xorg-x11-xauth-1.0.9-1.el7.x86_64
--> Running transaction check
---> Package glibc.x86_64 0:2.17-222.el7 will be updated
--> Processing Dependency: glibc = 2.17-222.el7 for package: glibc-common-2.17-222.el7.x86_64
---> Package glibc.x86_64 0:2.17-260.0.9.el7 will be an update
---> Package glibc-headers.x86_64 0:2.17-260.0.9.el7 will be installed
--> Processing Dependency: kernel-headers >= 2.2.1 for package: glibc-headers-2.17-260.0.9.el7.x86_64
--> Processing Dependency: kernel-headers for package: glibc-headers-2.17-260.0.9.el7.x86_64
---> Package gssproxy.x86_64 0:0.7.0-21.el7 will be installed
--> Processing Dependency: libini_config >= 1.3.1-31 for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libref_array.so.1(REF_ARRAY_0.1.1)(64bit) for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libini_config.so.3(INI_CONFIG_1.1.0)(64bit) for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libini_config.so.3(INI_CONFIG_1.2.0)(64bit) for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libverto-module-base for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libini_config.so.3()(64bit) for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libbasicobjects.so.0()(64bit) for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libref_array.so.1()(64bit) for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libcollection.so.2()(64bit) for package: gssproxy-0.7.0-21.el7.x86_64
---> Package keyutils.x86_64 0:1.5.8-3.el7 will be installed
---> Package libX11.x86_64 0:1.6.5-2.el7 will be installed
--> Processing Dependency: libX11-common >= 1.6.5-2.el7 for package: libX11-1.6.5-2.el7.x86_64
---> Package libXau.x86_64 0:1.0.8-2.1.el7 will be installed
---> Package libXext.x86_64 0:1.3.3-3.el7 will be installed
---> Package libXi.x86_64 0:1.7.9-1.el7 will be installed
---> Package libXinerama.x86_64 0:1.1.3-2.1.el7 will be installed
---> Package libXmu.x86_64 0:1.1.2-2.el7 will be installed
--> Processing Dependency: libXt.so.6()(64bit) for package: libXmu-1.1.2-2.el7.x86_64
---> Package libXrandr.x86_64 0:1.5.1-2.el7 will be installed
---> Package libXrender.x86_64 0:0.9.10-1.el7 will be installed
---> Package libXtst.x86_64 0:1.2.3-1.el7 will be installed
---> Package libXv.x86_64 0:1.0.11-1.el7 will be installed
---> Package libXxf86dga.x86_64 0:1.1.4-2.1.el7 will be installed
---> Package libXxf86misc.x86_64 0:1.0.3-7.1.el7 will be installed
---> Package libXxf86vm.x86_64 0:1.1.4-1.el7 will be installed
---> Package libdmx.x86_64 0:1.1.3-3.el7 will be installed
---> Package libevent.x86_64 0:2.0.21-4.el7 will be installed
---> Package libnfsidmap.x86_64 0:0.25-19.el7 will be installed
---> Package libstdc++.x86_64 0:4.8.5-28.0.1.el7 will be updated
---> Package libstdc++.x86_64 0:4.8.5-36.0.1.el7 will be an update
---> Package libtirpc.x86_64 0:0.2.4-0.15.el7 will be installed
---> Package libxcb.x86_64 0:1.13-1.el7 will be installed
---> Package lm_sensors-libs.x86_64 0:3.4.0-6.20160601gitf9185e5.el7 will be installed
---> Package mailx.x86_64 0:12.5-19.el7 will be installed
---> Package quota.x86_64 1:4.01-17.el7 will be installed
--> Processing Dependency: quota-nls = 1:4.01-17.el7 for package: 1:quota-4.01-17.el7.x86_64
--> Processing Dependency: tcp_wrappers for package: 1:quota-4.01-17.el7.x86_64
---> Package rpcbind.x86_64 0:0.2.0-47.el7 will be installed
--> Running transaction check
---> Package glibc-common.x86_64 0:2.17-222.el7 will be updated
---> Package glibc-common.x86_64 0:2.17-260.0.9.el7 will be an update
---> Package kernel-headers.x86_64 0:3.10.0-957.0.el7 will be installed
---> Package libX11-common.noarch 0:1.6.5-2.el7 will be installed
---> Package libXt.x86_64 0:1.1.5-3.el7 will be installed
--> Processing Dependency: libICE.so.6()(64bit) for package: libXt-1.1.5-3.el7.x86_64
--> Processing Dependency: libSM.so.6()(64bit) for package: libXt-1.1.5-3.el7.x86_64
---> Package libbasicobjects.x86_64 0:0.1.1-32.el7 will be installed
---> Package libcollection.x86_64 0:0.7.0-32.el7 will be installed
---> Package libini_config.x86_64 0:1.3.1-32.el7 will be installed
--> Processing Dependency: libpath_utils.so.1(PATH_UTILS_0.2.1)(64bit) for package: libini_config-1.3.1-32.el7.x86_64
--> Processing Dependency: libpath_utils.so.1()(64bit) for package: libini_config-1.3.1-32.el7.x86_64
---> Package libref_array.x86_64 0:0.1.5-32.el7 will be installed
---> Package libverto-libevent.x86_64 0:0.2.5-4.el7 will be installed
---> Package quota-nls.noarch 1:4.01-17.el7 will be installed
---> Package tcp_wrappers.x86_64 0:7.6-77.el7 will be installed
--> Running transaction check
---> Package libICE.x86_64 0:1.0.9-9.el7 will be installed
---> Package libSM.x86_64 0:1.2.2-2.el7 will be installed
---> Package libpath_utils.x86_64 0:0.2.1-32.el7 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
================================================================================
Package Arch Version Repository Size
================================================================================
Installing:
oracle-database-preinstall-18c
x86_64 1.0-1.el7 ol7_latest 18 k
Installing for dependencies:
bc x86_64 1.06.95-13.el7 ol7_latest 114 k
compat-libcap1 x86_64 1.10-7.el7 ol7_latest 17 k
compat-libstdc++-33 x86_64 3.2.3-72.el7 ol7_latest 190 k
glibc-devel x86_64 2.17-260.0.9.el7 ol7_latest 1.1 M
glibc-headers x86_64 2.17-260.0.9.el7 ol7_latest 684 k
gssproxy x86_64 0.7.0-21.el7 ol7_latest 108 k
kernel-headers x86_64 3.10.0-957.0.el7 ol7_latest 8.0 M
keyutils x86_64 1.5.8-3.el7 ol7_latest 53 k
ksh x86_64 20120801-139.0.1.el7 ol7_latest 883 k
libICE x86_64 1.0.9-9.el7 ol7_latest 66 k
libSM x86_64 1.2.2-2.el7 ol7_latest 39 k
libX11 x86_64 1.6.5-2.el7 ol7_latest 606 k
libX11-common noarch 1.6.5-2.el7 ol7_latest 163 k
libXau x86_64 1.0.8-2.1.el7 ol7_latest 28 k
libXext x86_64 1.3.3-3.el7 ol7_latest 38 k
libXi x86_64 1.7.9-1.el7 ol7_latest 40 k
libXinerama x86_64 1.1.3-2.1.el7 ol7_latest 13 k
libXmu x86_64 1.1.2-2.el7 ol7_latest 70 k
libXrandr x86_64 1.5.1-2.el7 ol7_latest 27 k
libXrender x86_64 0.9.10-1.el7 ol7_latest 25 k
libXt x86_64 1.1.5-3.el7 ol7_latest 172 k
libXtst x86_64 1.2.3-1.el7 ol7_latest 20 k
libXv x86_64 1.0.11-1.el7 ol7_latest 18 k
libXxf86dga x86_64 1.1.4-2.1.el7 ol7_latest 18 k
libXxf86misc x86_64 1.0.3-7.1.el7 ol7_latest 19 k
libXxf86vm x86_64 1.1.4-1.el7 ol7_latest 17 k
libaio-devel x86_64 0.3.109-13.el7 ol7_latest 12 k
libbasicobjects x86_64 0.1.1-32.el7 ol7_latest 25 k
libcollection x86_64 0.7.0-32.el7 ol7_latest 41 k
libdmx x86_64 1.1.3-3.el7 ol7_latest 15 k
libevent x86_64 2.0.21-4.el7 ol7_latest 208 k
libini_config x86_64 1.3.1-32.el7 ol7_latest 63 k
libnfsidmap x86_64 0.25-19.el7 ol7_latest 49 k
libpath_utils x86_64 0.2.1-32.el7 ol7_latest 28 k
libref_array x86_64 0.1.5-32.el7 ol7_latest 27 k
libstdc++-devel x86_64 4.8.5-36.0.1.el7 ol7_latest 1.5 M
libtirpc x86_64 0.2.4-0.15.el7 ol7_latest 88 k
libverto-libevent x86_64 0.2.5-4.el7 ol7_latest 8.2 k
libxcb x86_64 1.13-1.el7 ol7_latest 213 k
lm_sensors-libs x86_64 3.4.0-6.20160601gitf9185e5.el7 ol7_latest 41 k
mailx x86_64 12.5-19.el7 ol7_latest 244 k
net-tools x86_64 2.0-0.24.20131004git.el7 ol7_latest 305 k
nfs-utils x86_64 1:1.3.0-0.61.0.1.el7 ol7_latest 410 k
psmisc x86_64 22.20-15.el7 ol7_latest 140 k
quota x86_64 1:4.01-17.el7 ol7_latest 178 k
quota-nls noarch 1:4.01-17.el7 ol7_latest 90 k
rpcbind x86_64 0.2.0-47.el7 ol7_latest 59 k
smartmontools x86_64 1:6.5-1.el7 ol7_latest 460 k
sysstat x86_64 10.1.5-17.el7 ol7_latest 314 k
tcp_wrappers x86_64 7.6-77.el7 ol7_latest 78 k
unzip x86_64 6.0-19.el7 ol7_latest 169 k
xorg-x11-utils x86_64 7.5-23.el7 ol7_latest 114 k
xorg-x11-xauth x86_64 1:1.0.9-1.el7 ol7_latest 29 k
Updating for dependencies:
glibc x86_64 2.17-260.0.9.el7 ol7_latest 3.6 M
glibc-common x86_64 2.17-260.0.9.el7 ol7_latest 11 M
libstdc++ x86_64 4.8.5-36.0.1.el7 ol7_latest 304 k
Transaction Summary
================================================================================
Install 1 Package (+53 Dependent packages)
Upgrade ( 3 Dependent packages)
Total download size: 33 M
Downloading packages:
Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
(1/57): compat-libcap1-1.10-7.el7.x86_64.rpm | 17 kB 00:03
(2/57): bc-1.06.95-13.el7.x86_64.rpm | 114 kB 00:03
(3/57): glibc-2.17-260.0.9.el7.x86_64.rpm | 3.6 MB 00:18
(4/57): compat-libstdc++-33-3.2.3-72.el7.x86_64.rpm | 190 kB 00:23
(5/57): glibc-devel-2.17-260.0.9.el7.x86_64.rpm | 1.1 MB 00:24
(6/57): glibc-common-2.17-260.0.9.el7.x86_64.rpm | 11 MB 00:33
(7/57): glibc-headers-2.17-260.0.9.el7.x86_64.rpm | 684 kB 00:05
(8/57): gssproxy-0.7.0-21.el7.x86_64.rpm | 108 kB 00:00
(9/57): keyutils-1.5.8-3.el7.x86_64.rpm | 53 kB 00:00
(10/57): ksh-20120801-139.0.1.el7.x86_64.rpm | 883 kB 00:01
(11/57): libICE-1.0.9-9.el7.x86_64.rpm | 66 kB 00:00
(12/57): libSM-1.2.2-2.el7.x86_64.rpm | 39 kB 00:02
(13/57): libX11-1.6.5-2.el7.x86_64.rpm | 606 kB 00:01
(14/57): libX11-common-1.6.5-2.el7.noarch.rpm | 163 kB 00:00
(15/57): libXau-1.0.8-2.1.el7.x86_64.rpm | 28 kB 00:00
(16/57): libXext-1.3.3-3.el7.x86_64.rpm | 38 kB 00:01
(17/57): libXi-1.7.9-1.el7.x86_64.rpm | 40 kB 00:01
(18/57): libXinerama-1.1.3-2.1.el7.x86_64.rpm | 13 kB 00:01
(19/57): libXmu-1.1.2-2.el7.x86_64.rpm | 70 kB 00:02
(20/57): libXrandr-1.5.1-2.el7.x86_64.rpm | 27 kB 00:01
(21/57): libXrender-0.9.10-1.el7.x86_64.rpm | 25 kB 00:01
(22/57): libXt-1.1.5-3.el7.x86_64.rpm | 172 kB 00:01
(23/57): libXtst-1.2.3-1.el7.x86_64.rpm | 20 kB 00:00
(24/57): libXv-1.0.11-1.el7.x86_64.rpm | 18 kB 00:00
(25/57): libXxf86dga-1.1.4-2.1.el7.x86_64.rpm | 18 kB 00:00
(26/57): libXxf86misc-1.0.3-7.1.el7.x86_64.rpm | 19 kB 00:02
(27/57): kernel-headers-3.10.0-957.0.el7.x86_64.rpm | 8.0 MB 00:24
(28/57): libaio-devel-0.3.109-13.el7.x86_64.rpm | 12 kB 00:00
(29/57): libXxf86vm-1.1.4-1.el7.x86_64.rpm | 17 kB 00:00
(30/57): libbasicobjects-0.1.1-32.el7.x86_64.rpm | 25 kB 00:00
(31/57): libcollection-0.7.0-32.el7.x86_64.rpm | 41 kB 00:00
(32/57): libdmx-1.1.3-3.el7.x86_64.rpm | 15 kB 00:01
(33/57): libini_config-1.3.1-32.el7.x86_64.rpm | 63 kB 00:00
(34/57): libevent-2.0.21-4.el7.x86_64.rpm | 208 kB 00:01
(35/57): libpath_utils-0.2.1-32.el7.x86_64.rpm | 28 kB 00:00
(36/57): libref_array-0.1.5-32.el7.x86_64.rpm | 27 kB 00:00
(37/57): libstdc++-4.8.5-36.0.1.el7.x86_64.rpm | 304 kB 00:00
(38/57): libnfsidmap-0.25-19.el7.x86_64.rpm | 49 kB 00:01
(39/57): libtirpc-0.2.4-0.15.el7.x86_64.rpm | 88 kB 00:00
(40/57): libverto-libevent-0.2.5-4.el7.x86_64.rpm | 8.2 kB 00:02
(41/57): libxcb-1.13-1.el7.x86_64.rpm | 213 kB 00:04
(42/57): lm_sensors-libs-3.4.0-6.20160601gitf9185e5.el7.x8 | 41 kB 00:00
(43/57): libstdc++-devel-4.8.5-36.0.1.el7.x86_64.rpm | 1.5 MB 00:08
(44/57): net-tools-2.0-0.24.20131004git.el7.x86_64.rpm | 305 kB 00:01
(45/57): mailx-12.5-19.el7.x86_64.rpm | 244 kB 00:03
(46/57): nfs-utils-1.3.0-0.61.0.1.el7.x86_64.rpm | 410 kB 00:01
(47/57): oracle-database-preinstall-18c-1.0-1.el7.x86_64.r | 18 kB 00:01
(48/57): psmisc-22.20-15.el7.x86_64.rpm | 140 kB 00:01
(49/57): quota-4.01-17.el7.x86_64.rpm | 178 kB 00:01
(50/57): rpcbind-0.2.0-47.el7.x86_64.rpm | 59 kB 00:00
(51/57): quota-nls-4.01-17.el7.noarch.rpm | 90 kB 00:01
(52/57): sysstat-10.1.5-17.el7.x86_64.rpm | 314 kB 00:01
(53/57): smartmontools-6.5-1.el7.x86_64.rpm | 460 kB 00:03
(54/57): tcp_wrappers-7.6-77.el7.x86_64.rpm | 78 kB 00:01
(55/57): xorg-x11-utils-7.5-23.el7.x86_64.rpm | 114 kB 00:00
(56/57): unzip-6.0-19.el7.x86_64.rpm | 169 kB 00:01
(57/57): xorg-x11-xauth-1.0.9-1.el7.x86_64.rpm | 29 kB 00:01
--------------------------------------------------------------------------------
Total 321 kB/s | 33 MB 01:44
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Updating : glibc-2.17-260.0.9.el7.x86_64 1/60
Updating : glibc-common-2.17-260.0.9.el7.x86_64 2/60
Updating : libstdc++-4.8.5-36.0.1.el7.x86_64 3/60
Installing : libXau-1.0.8-2.1.el7.x86_64 4/60
Installing : libxcb-1.13-1.el7.x86_64 5/60
Installing : libref_array-0.1.5-32.el7.x86_64 6/60
Installing : libbasicobjects-0.1.1-32.el7.x86_64 7/60
Installing : libevent-2.0.21-4.el7.x86_64 8/60
Installing : libICE-1.0.9-9.el7.x86_64 9/60
Installing : libcollection-0.7.0-32.el7.x86_64 10/60
Installing : libtirpc-0.2.4-0.15.el7.x86_64 11/60
Installing : rpcbind-0.2.0-47.el7.x86_64 12/60
Installing : libSM-1.2.2-2.el7.x86_64 13/60
Installing : libverto-libevent-0.2.5-4.el7.x86_64 14/60
Installing : libstdc++-devel-4.8.5-36.0.1.el7.x86_64 15/60
Installing : bc-1.06.95-13.el7.x86_64 16/60
Installing : tcp_wrappers-7.6-77.el7.x86_64 17/60
Installing : psmisc-22.20-15.el7.x86_64 18/60
Installing : net-tools-2.0-0.24.20131004git.el7.x86_64 19/60
Installing : libpath_utils-0.2.1-32.el7.x86_64 20/60
Installing : libini_config-1.3.1-32.el7.x86_64 21/60
Installing : gssproxy-0.7.0-21.el7.x86_64 22/60
Installing : lm_sensors-libs-3.4.0-6.20160601gitf9185e5.el7.x86_64 23/60
Installing : sysstat-10.1.5-17.el7.x86_64 24/60
Installing : compat-libcap1-1.10-7.el7.x86_64 25/60
Installing : ksh-20120801-139.0.1.el7.x86_64 26/60
Installing : keyutils-1.5.8-3.el7.x86_64 27/60
Installing : compat-libstdc++-33-3.2.3-72.el7.x86_64 28/60
Installing : libnfsidmap-0.25-19.el7.x86_64 29/60
Installing : unzip-6.0-19.el7.x86_64 30/60
Installing : mailx-12.5-19.el7.x86_64 31/60
Installing : 1:smartmontools-6.5-1.el7.x86_64 32/60
Installing : libaio-devel-0.3.109-13.el7.x86_64 33/60
Installing : kernel-headers-3.10.0-957.0.el7.x86_64 34/60
Installing : glibc-headers-2.17-260.0.9.el7.x86_64 35/60
Installing : glibc-devel-2.17-260.0.9.el7.x86_64 36/60
Installing : 1:quota-nls-4.01-17.el7.noarch 37/60
Installing : 1:quota-4.01-17.el7.x86_64 38/60
Installing : 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64 39/60
Installing : libX11-common-1.6.5-2.el7.noarch 40/60
Installing : libX11-1.6.5-2.el7.x86_64 41/60
Installing : libXext-1.3.3-3.el7.x86_64 42/60
Installing : libXi-1.7.9-1.el7.x86_64 43/60
Installing : libXrender-0.9.10-1.el7.x86_64 44/60
Installing : libXrandr-1.5.1-2.el7.x86_64 45/60
Installing : libXtst-1.2.3-1.el7.x86_64 46/60
Installing : libXxf86misc-1.0.3-7.1.el7.x86_64 47/60
Installing : libXinerama-1.1.3-2.1.el7.x86_64 48/60
Installing : libXxf86vm-1.1.4-1.el7.x86_64 49/60
Installing : libdmx-1.1.3-3.el7.x86_64 50/60
Installing : libXv-1.0.11-1.el7.x86_64 51/60
Installing : libXxf86dga-1.1.4-2.1.el7.x86_64 52/60
Installing : xorg-x11-utils-7.5-23.el7.x86_64 53/60
Installing : libXt-1.1.5-3.el7.x86_64 54/60
Installing : libXmu-1.1.2-2.el7.x86_64 55/60
Installing : 1:xorg-x11-xauth-1.0.9-1.el7.x86_64 56/60
Installing : oracle-database-preinstall-18c-1.0-1.el7.x86_64 57/60
Cleanup : libstdc++-4.8.5-28.0.1.el7.x86_64 58/60
Cleanup : glibc-common-2.17-222.el7.x86_64 59/60
Cleanup : glibc-2.17-222.el7.x86_64 60/60
Verifying : libXext-1.3.3-3.el7.x86_64 1/60
Verifying : libXxf86misc-1.0.3-7.1.el7.x86_64 2/60
Verifying : oracle-database-preinstall-18c-1.0-1.el7.x86_64 3/60
Verifying : libverto-libevent-0.2.5-4.el7.x86_64 4/60
Verifying : libXinerama-1.1.3-2.1.el7.x86_64 5/60
Verifying : libXau-1.0.8-2.1.el7.x86_64 6/60
Verifying : libXrender-0.9.10-1.el7.x86_64 7/60
Verifying : libref_array-0.1.5-32.el7.x86_64 8/60
Verifying : glibc-headers-2.17-260.0.9.el7.x86_64 9/60
Verifying : libXi-1.7.9-1.el7.x86_64 10/60
Verifying : libXxf86vm-1.1.4-1.el7.x86_64 11/60
Verifying : glibc-devel-2.17-260.0.9.el7.x86_64 12/60
Verifying : libdmx-1.1.3-3.el7.x86_64 13/60
Verifying : libxcb-1.13-1.el7.x86_64 14/60
Verifying : libbasicobjects-0.1.1-32.el7.x86_64 15/60
Verifying : libX11-common-1.6.5-2.el7.noarch 16/60
Verifying : sysstat-10.1.5-17.el7.x86_64 17/60
Verifying : bc-1.06.95-13.el7.x86_64 18/60
Verifying : libstdc++-4.8.5-36.0.1.el7.x86_64 19/60
Verifying : libXv-1.0.11-1.el7.x86_64 20/60
Verifying : tcp_wrappers-7.6-77.el7.x86_64 21/60
Verifying : xorg-x11-utils-7.5-23.el7.x86_64 22/60
Verifying : glibc-common-2.17-260.0.9.el7.x86_64 23/60
Verifying : libXtst-1.2.3-1.el7.x86_64 24/60
Verifying : libXt-1.1.5-3.el7.x86_64 25/60
Verifying : 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64 26/60
Verifying : libstdc++-devel-4.8.5-36.0.1.el7.x86_64 27/60
Verifying : psmisc-22.20-15.el7.x86_64 28/60
Verifying : libini_config-1.3.1-32.el7.x86_64 29/60
Verifying : 1:quota-nls-4.01-17.el7.noarch 30/60
Verifying : kernel-headers-3.10.0-957.0.el7.x86_64 31/60
Verifying : net-tools-2.0-0.24.20131004git.el7.x86_64 32/60
Verifying : libpath_utils-0.2.1-32.el7.x86_64 33/60
Verifying : lm_sensors-libs-3.4.0-6.20160601gitf9185e5.el7.x86_64 34/60
Verifying : libevent-2.0.21-4.el7.x86_64 35/60
Verifying : gssproxy-0.7.0-21.el7.x86_64 36/60
Verifying : libX11-1.6.5-2.el7.x86_64 37/60
Verifying : rpcbind-0.2.0-47.el7.x86_64 38/60
Verifying : compat-libcap1-1.10-7.el7.x86_64 39/60
Verifying : libXrandr-1.5.1-2.el7.x86_64 40/60
Verifying : libaio-devel-0.3.109-13.el7.x86_64 41/60
Verifying : 1:quota-4.01-17.el7.x86_64 42/60
Verifying : 1:xorg-x11-xauth-1.0.9-1.el7.x86_64 43/60
Verifying : libICE-1.0.9-9.el7.x86_64 44/60
Verifying : ksh-20120801-139.0.1.el7.x86_64 45/60
Verifying : glibc-2.17-260.0.9.el7.x86_64 46/60
Verifying : libSM-1.2.2-2.el7.x86_64 47/60
Verifying : 1:smartmontools-6.5-1.el7.x86_64 48/60
Verifying : libXxf86dga-1.1.4-2.1.el7.x86_64 49/60
Verifying : libXmu-1.1.2-2.el7.x86_64 50/60
Verifying : keyutils-1.5.8-3.el7.x86_64 51/60
Verifying : compat-libstdc++-33-3.2.3-72.el7.x86_64 52/60
Verifying : libcollection-0.7.0-32.el7.x86_64 53/60
Verifying : libnfsidmap-0.25-19.el7.x86_64 54/60
Verifying : unzip-6.0-19.el7.x86_64 55/60
Verifying : mailx-12.5-19.el7.x86_64 56/60
Verifying : libtirpc-0.2.4-0.15.el7.x86_64 57/60
Verifying : glibc-2.17-222.el7.x86_64 58/60
Verifying : glibc-common-2.17-222.el7.x86_64 59/60
Verifying : libstdc++-4.8.5-28.0.1.el7.x86_64 60/60
Installed:
oracle-database-preinstall-18c.x86_64 0:1.0-1.el7
Dependency Installed:
bc.x86_64 0:1.06.95-13.el7
compat-libcap1.x86_64 0:1.10-7.el7
compat-libstdc++-33.x86_64 0:3.2.3-72.el7
glibc-devel.x86_64 0:2.17-260.0.9.el7
glibc-headers.x86_64 0:2.17-260.0.9.el7
gssproxy.x86_64 0:0.7.0-21.el7
kernel-headers.x86_64 0:3.10.0-957.0.el7
keyutils.x86_64 0:1.5.8-3.el7
ksh.x86_64 0:20120801-139.0.1.el7
libICE.x86_64 0:1.0.9-9.el7
libSM.x86_64 0:1.2.2-2.el7
libX11.x86_64 0:1.6.5-2.el7
libX11-common.noarch 0:1.6.5-2.el7
libXau.x86_64 0:1.0.8-2.1.el7
libXext.x86_64 0:1.3.3-3.el7
libXi.x86_64 0:1.7.9-1.el7
libXinerama.x86_64 0:1.1.3-2.1.el7
libXmu.x86_64 0:1.1.2-2.el7
libXrandr.x86_64 0:1.5.1-2.el7
libXrender.x86_64 0:0.9.10-1.el7
libXt.x86_64 0:1.1.5-3.el7
libXtst.x86_64 0:1.2.3-1.el7
libXv.x86_64 0:1.0.11-1.el7
libXxf86dga.x86_64 0:1.1.4-2.1.el7
libXxf86misc.x86_64 0:1.0.3-7.1.el7
libXxf86vm.x86_64 0:1.1.4-1.el7
libaio-devel.x86_64 0:0.3.109-13.el7
libbasicobjects.x86_64 0:0.1.1-32.el7
libcollection.x86_64 0:0.7.0-32.el7
libdmx.x86_64 0:1.1.3-3.el7
libevent.x86_64 0:2.0.21-4.el7
libini_config.x86_64 0:1.3.1-32.el7
libnfsidmap.x86_64 0:0.25-19.el7
libpath_utils.x86_64 0:0.2.1-32.el7
libref_array.x86_64 0:0.1.5-32.el7
libstdc++-devel.x86_64 0:4.8.5-36.0.1.el7
libtirpc.x86_64 0:0.2.4-0.15.el7
libverto-libevent.x86_64 0:0.2.5-4.el7
libxcb.x86_64 0:1.13-1.el7
lm_sensors-libs.x86_64 0:3.4.0-6.20160601gitf9185e5.el7
mailx.x86_64 0:12.5-19.el7
net-tools.x86_64 0:2.0-0.24.20131004git.el7
nfs-utils.x86_64 1:1.3.0-0.61.0.1.el7
psmisc.x86_64 0:22.20-15.el7
quota.x86_64 1:4.01-17.el7
quota-nls.noarch 1:4.01-17.el7
rpcbind.x86_64 0:0.2.0-47.el7
smartmontools.x86_64 1:6.5-1.el7
sysstat.x86_64 0:10.1.5-17.el7
tcp_wrappers.x86_64 0:7.6-77.el7
unzip.x86_64 0:6.0-19.el7
xorg-x11-utils.x86_64 0:7.5-23.el7
xorg-x11-xauth.x86_64 1:1.0.9-1.el7
Dependency Updated:
glibc.x86_64 0:2.17-260.0.9.el7 glibc-common.x86_64 0:2.17-260.0.9.el7
libstdc++.x86_64 0:4.8.5-36.0.1.el7
Complete!
Create Required Users and Groups
On both nodes.
[root@primary01 ~]# groupadd -g 54321 oinstall
groupadd: group 'oinstall' already exists
[root@primary01 ~]# groupadd -g 54322 dba
groupadd: group 'dba' already exists
[root@primary01 ~]# groupadd -g 54323 oper
groupadd: group 'oper' already exists
[root@primary01 ~]# groupadd -g 54324 backupdba
groupadd: group 'backupdba' already exists
[root@primary01 ~]# groupadd -g 54325 dgdba
groupadd: group 'dgdba' already exists
[root@primary01 ~]# groupadd -g 54326 kmdba
groupadd: group 'kmdba' already exists
[root@primary01 ~]# groupadd -g 54327 asmdba
[root@primary01 ~]# groupadd -g 54328 asmoper
[root@primary01 ~]# groupadd -g 54329 asmadmin
[root@primary01 ~]# groupadd -g 54330 racdba
groupadd: group 'racdba' already exists
[root@primary01 ~]# useradd -u 54322 -g oinstall -G asmoper,asmadmin,asmdba,racdba grid
[root@primary01 ~]# id grid
uid=54322(grid) gid=54321(oinstall) groups=54321(oinstall),54330(racdba),54327(asmdba),54328(asmoper),54329(asmadmin)
[root@primary01 ~]# usermod -a -G asmdba oracle
[root@primary01 ~]# id oracle
uid=54321(oracle) gid=54321(oinstall) groups=54321(oinstall),54322(dba),54323(oper),54324(backupdba),54325(dgdba),54326(kmdba),54330(racdba),54327(asmdba)
Set User Credentials
On both nodes.
[root@primary01 ~]# passwd grid
Changing password for user grid.
New password:
Retype new password:
passwd: all authentication tokens updated successfully.
[root@primary01 ~]# passwd oracle
Changing password for user oracle.
New password:
Retype new password:
passwd: all authentication tokens updated successfully.
Create required Directories
On both nodes.
[root@primary01 ~]# mkdir -p /u01/app/18.0.0/grid
[root@primary01 ~]# mkdir -p /u01/app/grid
[root@primary01 ~]# mkdir -p /u01/app/oracle/product/18.0.0/db_1
[root@primary01 ~]# chown -R grid:oinstall /u01
[root@primary01 ~]# chown -R oracle:oinstall /u01/app/oracle
[root@primary01 ~]# chmod -R 775 /u01/
Set Profiles for grid and oracle
First, we set profiles for user grid on both nodes.
[root@primary01 ~]# su - grid
[grid@primary01 ~]$ vi .bash_profile
...
umask 022
ORACLE_SID=+ASM1
ORACLE_BASE=/u01/app/grid
ORACLE_HOME=/u01/app/18.0.0/grid
LD_LIBRARY_PATH=$ORACLE_HOME/lib
TMP=/tmp
TMPDIR=/tmp
PATH=$PATH:$HOME/.local/bin:$HOME/bin:$ORACLE_HOME/bin
export PATH ORACLE_SID ORACLE_BASE ORACLE_HOME LD_LIBRARY_PATH TMP TMPDIR
[grid@primary01 ~]$ exit
logout
Now turn to user oracle on both nodes.
[root@primary01 ~]# su - oracle
[oracle@primary01 ~]$ vi .bash_profile
...
umask 022
ORACLE_SID=PRIMDB1
ORACLE_BASE=/u01/app/oracle
ORACLE_HOME=$ORACLE_BASE/product/18.0.0/db_1
LD_LIBRARY_PATH=$ORACLE_HOME/lib
TMP=/tmp
TMPDIR=/tmp
PATH=$PATH:$HOME/.local/bin:$HOME/bin:$ORACLE_HOME/bin
export PATH ORACLE_SID ORACLE_BASE ORACLE_HOME LD_LIBRARY_PATH TMP TMPDIR
[oracle@primary01 ~]$ exit
logout
Please change the number in ORACLE_SID for the second node.
Resource Limitations
On both nodes.
[root@primary01 ~]# vi /etc/security/limits.conf
...
grid soft nofile 1024
grid hard nofile 65536
grid soft nproc 2047
grid hard nproc 16384
grid soft stack 10240
grid hard stack 32768
grid soft memlock unlimited
grid hard memlock unlimited
oracle soft nofile 1024
oracle hard nofile 65536
oracle soft nproc 2047
oracle hard nproc 16384
oracle soft stack 10240
oracle hard stack 32768
oracle soft memlock unlimited
oracle hard memlock unlimited
[root@primary01 ~]# sysctl -p
fs.file-max = 6815744
kernel.sem = 250 32000 100 128
kernel.shmmni = 4096
kernel.shmall = 1073741824
kernel.shmmax = 4398046511104
kernel.panic_on_oops = 1
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048576
net.ipv4.conf.all.rp_filter = 2
net.ipv4.conf.default.rp_filter = 2
fs.aio-max-nr = 1048576
net.ipv4.ip_local_port_range = 9000 65500
Upload and Unzip Oracle Software
This step is only on node 1. Starting with Oracle Grid Infrastructure 12c Release 2 (12.2), installation and configuration of Oracle Grid Infrastructure software is simplified with image-based installation. That is to say, we have to upload and extract the source file in grid's ORACLE_HOME.
> cd d:/oracle
> sftp [email protected]:/u01/app/18.0.0/grid
Connected to 192.168.10.11.
Changing to: /u01/app/18.0.0/grid
sftp> put LINUX.X64_180000_grid_home.zip
Uploading LINUX.X64_180000_grid_home.zip to /u01/app/18.0.0/grid/LINUX.X64_18000
LINUX.X64_180000_grid_home.zip 99% 5133MB 52.7MB/s 01:51
sftp> quit
[grid@primary01 ~]$ cd $ORACLE_HOME
[grid@primary01 grid]$ time unzip -q LINUX.X64_180000_grid_home.zip
real 2m24.831s
user 1m24.870s
sys 0m33.634s
Please note that, you don't have to upload zip files to all nodes, only the first node requires those files.
Install Oracle ASMLib
On both nodes.
[root@primary01 ~]# rpm -Uvh http://download.oracle.com/otn_software/asmlib/oracleasmlib-2.0.12-1.el7.x86_64.rpm
Retrieving http://download.oracle.com/otn_software/asmlib/oracleasmlib-2.0.12-1.el7.x86_64.rpm
Preparing... ################################# [100%]
Updating / installing...
1:oracleasmlib-2.0.12-1.el7 ################################# [100%]
[root@primary01 ~]# yum -y install kmod-oracleasm oracleasm-support
Loaded plugins: ulninfo
Resolving Dependencies
--> Running transaction check
---> Package kmod-oracleasm.x86_64 0:2.0.8-22.0.3.el7 will be installed
--> Processing Dependency: kernel(__check_object_size) = 0x88db9f48 for package: kmod-oracleasm-2.0.8-22.0.3.el7.x86_64
--> Processing Dependency: kernel >= 3.10.0-907.el7 for package: kmod-oracleasm-2.0.8-22.0.3.el7.x86_64
---> Package oracleasm-support.x86_64 0:2.1.11-2.el7 will be installed
--> Running transaction check
---> Package kernel.x86_64 0:3.10.0-957.0.el7 will be installed
--> Processing Dependency: linux-firmware >= 20180911-68 for package: kernel-3.10.0-957.0.el7.x86_64
--> Running transaction check
---> Package linux-firmware.noarch 0:20180220-62.git6d51311.0.1.el7 will be updated
---> Package linux-firmware.noarch 999:20181031-999.1.git1baa3486.el7 will be an update
--> Processing Conflict: kernel-3.10.0-957.0.el7.x86_64 conflicts selinux-policy-targeted < 3.13.1-201
--> Restarting Dependency Resolution with new changes.
--> Running transaction check
---> Package selinux-policy-targeted.noarch 0:3.13.1-192.0.1.el7 will be updated
---> Package selinux-policy-targeted.noarch 0:3.13.1-229.0.1.el7_6.5 will be an update
--> Processing Dependency: selinux-policy = 3.13.1-229.0.1.el7_6.5 for package: selinux-policy-targeted-3.13.1-229.0.1.el7_6.5.noarch
--> Running transaction check
---> Package selinux-policy.noarch 0:3.13.1-192.0.1.el7 will be updated
---> Package selinux-policy.noarch 0:3.13.1-229.0.1.el7_6.5 will be an update
--> Finished Dependency Resolution
Dependencies Resolved
================================================================================
Package Arch Version Repository Size
================================================================================
Installing:
kernel x86_64 3.10.0-957.0.el7 ol7_latest 48 M
kmod-oracleasm x86_64 2.0.8-22.0.3.el7 ol7_latest 296 k
oracleasm-support x86_64 2.1.11-2.el7 ol7_latest 85 k
Updating:
selinux-policy-targeted
noarch 3.13.1-229.0.1.el7_6.5 ol7_latest 6.9 M
Updating for dependencies:
linux-firmware noarch 999:20181031-999.1.git1baa3486.el7 ol7_latest 73 M
selinux-policy noarch 3.13.1-229.0.1.el7_6.5 ol7_latest 483 k
Transaction Summary
================================================================================
Install 3 Packages
Upgrade 1 Package (+2 Dependent packages)
Total download size: 129 M
Downloading packages:
Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
(1/6): kmod-oracleasm-2.0.8-22.0.3.el7.x86_64.rpm | 296 kB 00:06
(2/6): kernel-3.10.0-957.0.el7.x86_64.rpm | 48 MB 02:35
(3/6): oracleasm-support-2.1.11-2.el7.x86_64.rpm | 85 kB 00:00
(4/6): selinux-policy-3.13.1-229.0.1.el7_6.5.noarch.rpm | 483 kB 00:01
(5/6): selinux-policy-targeted-3.13.1-229.0.1.el7_6.5.noar | 6.9 MB 00:16
(6/6): linux-firmware-20181031-999.1.git1baa3486.el7.noarc | 73 MB 03:46
--------------------------------------------------------------------------------
Total 567 kB/s | 129 MB 03:52
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Warning: RPMDB altered outside of yum.
Updating : 999:linux-firmware-20181031-999.1.git1baa3486.el7.noarch 1/9
Installing : kernel-3.10.0-957.0.el7.x86_64 2/9
Updating : selinux-policy-3.13.1-229.0.1.el7_6.5.noarch 3/9
Updating : selinux-policy-targeted-3.13.1-229.0.1.el7_6.5.noarch 4/9
Installing : kmod-oracleasm-2.0.8-22.0.3.el7.x86_64 5/9
Installing : oracleasm-support-2.1.11-2.el7.x86_64 6/9
Note: Forwarding request to 'systemctl enable oracleasm.service'.
Created symlink from /etc/systemd/system/multi-user.target.wants/oracleasm.service to /usr/lib/systemd/system/oracleasm.service.
Cleanup : selinux-policy-targeted-3.13.1-192.0.1.el7.noarch 7/9
Cleanup : selinux-policy-3.13.1-192.0.1.el7.noarch 8/9
Cleanup : linux-firmware-20180220-62.git6d51311.0.1.el7.noarch 9/9
Verifying : kernel-3.10.0-957.0.el7.x86_64 1/9
Verifying : selinux-policy-targeted-3.13.1-229.0.1.el7_6.5.noarch 2/9
Verifying : selinux-policy-3.13.1-229.0.1.el7_6.5.noarch 3/9
Verifying : oracleasm-support-2.1.11-2.el7.x86_64 4/9
Verifying : kmod-oracleasm-2.0.8-22.0.3.el7.x86_64 5/9
Verifying : 999:linux-firmware-20181031-999.1.git1baa3486.el7.noarch 6/9
Verifying : selinux-policy-3.13.1-192.0.1.el7.noarch 7/9
Verifying : linux-firmware-20180220-62.git6d51311.0.1.el7.noarch 8/9
Verifying : selinux-policy-targeted-3.13.1-192.0.1.el7.noarch 9/9
Installed:
kernel.x86_64 0:3.10.0-957.0.el7
kmod-oracleasm.x86_64 0:2.0.8-22.0.3.el7
oracleasm-support.x86_64 0:2.1.11-2.el7
Updated:
selinux-policy-targeted.noarch 0:3.13.1-229.0.1.el7_6.5
Dependency Updated:
linux-firmware.noarch 999:20181031-999.1.git1baa3486.el7
selinux-policy.noarch 0:3.13.1-229.0.1.el7_6.5
Complete!
Configure Oracle ASMLib
On both nodes.
[root@primary01 ~]# oracleasm configure -i
Configuring the Oracle ASM library driver.
This will configure the on-boot properties of the Oracle ASM library
driver. The following questions will determine whether the driver is
loaded on boot and what permissions it will have. The current values
will be shown in brackets ('[]'). Hitting <ENTER> without typing an
answer will keep that current value. Ctrl-C will abort.
Default user to own the driver interface []: grid
Default group to own the driver interface []: asmadmin
Start Oracle ASM library driver on boot (y/n) [n]: y
Scan for Oracle ASM disks on boot (y/n) [y]: y
Writing Oracle ASM library driver configuration: done
[root@primary01 ~]# oracleasm init
Creating /dev/oracleasm mount point: /dev/oracleasm
Loading module "oracleasm": oracleasm
Configuring "oracleasm" to use device physical block size
Mounting ASMlib driver filesystem: /dev/oracleasm
Create ASM Disks via ASMLib
Only on node 1.
[root@primary01 ~]# oracleasm createdisk asmdisk01 /dev/disk/by-path/ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t1-lun-1-part1
Writing disk header: done
Instantiating disk: done
[root@primary01 ~]# oracleasm createdisk asmdisk02 /dev/disk/by-path/ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t2-lun-2-part1
Writing disk header: done
Instantiating disk: done
...
On node 2.
[root@primary02 ~]# oracleasm scandisks
Reloading disk partitions: done
Cleaning any stale ASM disks...
Scanning system for ASM disks...
Instantiating disk "ASMDISK01"
Instantiating disk "ASMDISK02"
Instantiating disk "ASMDISK03"
Instantiating disk "ASMDISK04"
Instantiating disk "ASMDISK05"
Instantiating disk "ASMDISK06"
Instantiating disk "ASMDISK07"
Instantiating disk "ASMDISK08"
Try to list all ASM disks.
[root@primary01 ~]# oracleasm listdisks
ASMDISK01
ASMDISK02
ASMDISK03
ASMDISK04
ASMDISK05
ASMDISK06
ASMDISK07
ASMDISK08
Install Cluster Verification Utility
On node 1.
[root@primary01 ~]# cp -p /u01/app/18.0.0/grid/cv/rpm/cvuqdisk-1.0.10-1.rpm /tmp/
[root@primary01 ~]# scp -p /u01/app/18.0.0/grid/cv/rpm/cvuqdisk-1.0.10-1.rpm primary02:/tmp/
...
root@primary02's password:
cvuqdisk-1.0.10-1.rpm 100% 8860 5.3MB/s 00:00
On both nodes.
[root@primary01 ~]# rpm -Uvh /tmp/cvuqdisk-1.0.10-1.rpm
Preparing... ################################# [100%]
Using default group oinstall to install package
Updating / installing...
1:cvuqdisk-1.0.10-1 ################################# [100%]
Rearrange Initialization Order of ASMLib
On both nodes.
[root@primary01 ~]# vi /usr/lib/systemd/system/oracleasm.service
[Unit]
Description=Load oracleasm Modules
Requires=multipathd.service iscsi.service
After=multipathd.service iscsi.service
This can make system discover all available ASM Disks on boot-time.
Hi Ed,
Nice post, only I got stuck from the word go. How was the server setup? Also, what about the storage?
Oh, I assumed that readers have prepared their storage before going further. As for me, the setup steps can be found in this post: How to Build 12c RAC (1/6) – Building a NAS for Shared Storage of RAC.
Some more troubleshooting about storage are worth reading in 18c grid installation:
What is the benefit using ASMLib as opposite to ASM Filter Driver in the instruction. Thanks.
Oracle documents two advantages about ASMFD.
As for me, I choose ASMLib over ASMFD simply because I’m used to use it.