How to Build 18c RAC – 1 of 4 – Preparing Two Database Servers

Network Design for RAC

Let’s see the network design of our cluster database.

[root@primary01 ~]# vi /etc/hosts
# Public
192.168.10.11 primary01 primary01.example.com
192.168.10.12 primary02 primary02.example.com

# Private
192.168.24.11 primary01-priv primary01-priv.example.com
192.168.24.12 primary02-priv primary02-priv.example.com

# VIP
192.168.10.111 primary01-vip primary01-vip.example.com
192.168.10.112 primary02-vip primary02-vip.example.com

# SCAN
# 192.168.10.81 primary-cluster-scan primary-cluster-scan.example.com
# 192.168.10.82 primary-cluster-scan primary-cluster-scan.example.com
# 192.168.10.83 primary-cluster-scan primary-cluster-scan.example.com

# NAS
192.168.10.101 nas nas.example.com

# DNS
192.168.10.56 dns dns.example.com

The network design has been summarized as below:

  • Two nodes for RAC servers: primary01 and primary02.
  • One NAS for shared storage.
  • One DNS for resolving hostname, especially for SCAN name.
  • Please note that, you can only have one DNS server in NIC configuration.

  • Two network cards, one is for public subnet, another is for private subnet.
    • Public subnet (192.168.10.0/24): only for public connection.
    • Private subnet (192.168.24.0/24): for both private and ASM connections.

Same hosts configuration must also appear in primary02 according to our design.

Security Configuration

We stopped firewall and selinux on both nodes to make RAC installation more smoothly.

[root@primary01 ~]# systemctl stop firewalld
[root@primary01 ~]# systemctl disable firewalld
[root@primary01 ~]# vi /etc/selinux/config
...
SELINUX=disabled

Maybe you’d like to open port 1521 on firewall for Oracle connections instead of disabling firewall.

NTP Server

Please make sure NTP is working well on both nodes. Here we use the default NTP service chronyd to play the role.

[root@primary01 ~]# systemctl status chronyd
● chronyd.service - NTP client/server
   Loaded: loaded (/usr/lib/systemd/system/chronyd.service; enabled; vendor preset: enabled)
   Active: active (running) since Mon 2018-11-19 18:38:40 CST; 7h left
     Docs: man:chronyd(8)
           man:chrony.conf(5)
  Process: 1656 ExecStartPost=/usr/libexec/chrony-helper update-daemon (code=exited, status=0/SUCCESS)
  Process: 1652 ExecStart=/usr/sbin/chronyd $OPTIONS (code=exited, status=0/SUCCESS)
 Main PID: 1654 (chronyd)
   CGroup: /system.slice/chronyd.service
           └─1654 /usr/sbin/chronyd

Nov 19 18:38:40 primary01.example.com systemd[1]: Starting NTP client/server...
Nov 19 18:38:40 primary01.example.com chronyd[1654]: chronyd version 3.2 star...
Nov 19 18:38:40 primary01.example.com systemd[1]: Started NTP client/server.
Nov 19 18:38:45 primary01.example.com chronyd[1654]: Selected source 118.163....
Nov 19 18:38:45 primary01.example.com chronyd[1654]: System clock wrong by -2...
Nov 19 10:38:44 primary01.example.com chronyd[1654]: System clock was stepped...
Nov 19 10:38:45 primary01.example.com chronyd[1654]: Selected source 211.22.1...
Hint: Some lines were ellipsized, use -l to show in full.

Connect to Shared Storage

First of all, we have to install iSCSI initiator on both nodes.

[root@primary01 ~]# yum -y install iscsi-initiator-utils lsscsi
Loaded plugins: ulninfo
Package lsscsi-0.27-6.el7.x86_64 already installed and latest version
Resolving Dependencies
--> Running transaction check
---> Package iscsi-initiator-utils.x86_64 0:6.2.0.874-10.0.1.el7 will be installed
--> Processing Dependency: iscsi-initiator-utils-iscsiuio >= 6.2.0.874-10.0.1.el7 for package: iscsi-initiator-utils-6.2.0.874-10.0.1.el7.x86_64
--> Running transaction check
---> Package iscsi-initiator-utils-iscsiuio.x86_64 0:6.2.0.874-10.0.1.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package                        Arch   Version                 Repository  Size
================================================================================
Installing:
 iscsi-initiator-utils          x86_64 6.2.0.874-10.0.1.el7    ol7_latest 421 k
Installing for dependencies:
 iscsi-initiator-utils-iscsiuio x86_64 6.2.0.874-10.0.1.el7    ol7_latest  91 k

Transaction Summary
================================================================================
Install  1 Package (+1 Dependent package)

Total download size: 512 k
Installed size: 2.6 M
Downloading packages:
(1/2): iscsi-initiator-utils-iscsiuio-6.2.0.874-10.0.1.el7 |  91 kB   00:00
(2/2): iscsi-initiator-utils-6.2.0.874-10.0.1.el7.x86_64.r | 421 kB   00:01
--------------------------------------------------------------------------------
Total                                              297 kB/s | 512 kB  00:01
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : iscsi-initiator-utils-iscsiuio-6.2.0.874-10.0.1.el7.x86_64   1/2
  Installing : iscsi-initiator-utils-6.2.0.874-10.0.1.el7.x86_64            2/2
  Verifying  : iscsi-initiator-utils-6.2.0.874-10.0.1.el7.x86_64            1/2
  Verifying  : iscsi-initiator-utils-iscsiuio-6.2.0.874-10.0.1.el7.x86_64   2/2

Installed:
  iscsi-initiator-utils.x86_64 0:6.2.0.874-10.0.1.el7

Dependency Installed:
  iscsi-initiator-utils-iscsiuio.x86_64 0:6.2.0.874-10.0.1.el7

Complete!

Then enable and start iSCSI services on both nodes.

[root@primary01 ~]# systemctl enable iscsid
Created symlink from /etc/systemd/system/multi-user.target.wants/iscsid.service to /usr/lib/systemd/system/iscsid.service.
[root@primary01 ~]# systemctl enable iscsi
[root@primary01 ~]# systemctl start iscsid
[root@primary01 ~]# systemctl start iscsi

Now, we discover all targets from NAS on both nodes. In this case, we prepared 8 iSCSI entents, 16 GB each to associate targets in NAS.

[root@primary01 ~]# iscsiadm -m discovery -t sendtargets -p nas
192.168.10.101:3260,2 iqn.2005-10.org.freenas.ctl:asm-t1
[root@primary01 ~]# iscsiadm -m node --op update -n node.startup -v automatic
[root@primary01 ~]# iscsiadm -m node -p nas --login
Logging in to [iface: default, target: iqn.2005-10.org.freenas.ctl:asm-t1, portal: 192.168.10.101,3260] (multiple)
Login to [iface: default, target: iqn.2005-10.org.freenas.ctl:asm-t1, portal: 192.168.10.101,3260] successful.
...

List all iSCSI lun by path.

[root@primary01 ~]# ll /dev/disk/by-path/
total 0
lrwxrwxrwx 1 root root  9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t1-lun-1 -> ../../sdb
lrwxrwxrwx 1 root root  9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t2-lun-2 -> ../../sdc
lrwxrwxrwx 1 root root  9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t3-lun-3 -> ../../sdd
lrwxrwxrwx 1 root root  9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t4-lun-4 -> ../../sde
lrwxrwxrwx 1 root root  9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t5-lun-5 -> ../../sdf
lrwxrwxrwx 1 root root  9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t6-lun-6 -> ../../sdg
lrwxrwxrwx 1 root root  9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t7-lun-7 -> ../../sdh
lrwxrwxrwx 1 root root  9 Nov 19 11:01 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t8-lun-8 -> ../../sdi
...

Then we have to partition all the 8 shared disks only on one node. Usually, node 1 is our first choice. The procedures to partition a disk are all the same. So we take /dev/sdb for an example here.

[root@primary01 ~]# fdisk /dev/sdb
Welcome to fdisk (util-linux 2.23.2).

Changes will remain in memory only, until you decide to write them.
Be careful before using the write command.

Device does not contain a recognized partition table
Building a new DOS disklabel with disk identifier 0x0051eb0e.

Command (m for help): n
Partition type:
   p   primary (0 primary, 0 extended, 4 free)
   e   extended
Select (default p):
Using default response p
Partition number (1-4, default 1):
First sector (2048-335544319, default 2048):
Using default value 2048
Last sector, +sectors or +size{K,M,G} (2048-335544319, default 335544319):
Using default value 335544319
Partition 1 of type Linux and of size 160 GiB is set

Command (m for help): w
The partition table has been altered!

Calling ioctl() to re-read partition table.
Syncing disks.

Let’s see disks after partitioning.

[root@primary01 ~]# ll /dev/disk/by-path/
total 0
lrwxrwxrwx 1 root root  9 Nov 19 11:02 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t1-lun-1 -> ../../sdb
lrwxrwxrwx 1 root root 10 Nov 19 11:02 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t1-lun-1-part1 -> ../../sdb1
lrwxrwxrwx 1 root root  9 Nov 19 11:02 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t2-lun-2 -> ../../sdc
lrwxrwxrwx 1 root root 10 Nov 19 11:02 ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t2-lun-2-part1 -> ../../sdc1
...

On the other node, node 2, we have to refresh the partition table to get the newest disk information.

[root@primary02 ~]# partprobe -s
/dev/sda: msdos partitions 1 2
/dev/sdb: msdos partitions 1
/dev/sdc: msdos partitions 1
...

Oracle Preinstall Package

Oracle preinstall package can ease our task on installation. For example, installing required packages and create required users and groups.

On both nodes.

[root@primary01 ~]# yum -y install oracle-database-preinstall-18c.x86_64
Loaded plugins: ulninfo
Resolving Dependencies
--> Running transaction check
---> Package oracle-database-preinstall-18c.x86_64 0:1.0-1.el7 will be installed
--> Processing Dependency: bc for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: sysstat for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: xorg-x11-utils for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: net-tools for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: compat-libcap1 for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: ksh for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: libaio-devel for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: xorg-x11-xauth for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: psmisc for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: unzip for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: glibc-devel for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: compat-libstdc++-33 for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: libstdc++-devel for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: nfs-utils for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Processing Dependency: smartmontools for package: oracle-database-preinstall-18c-1.0-1.el7.x86_64
--> Running transaction check
---> Package bc.x86_64 0:1.06.95-13.el7 will be installed
---> Package compat-libcap1.x86_64 0:1.10-7.el7 will be installed
---> Package compat-libstdc++-33.x86_64 0:3.2.3-72.el7 will be installed
---> Package glibc-devel.x86_64 0:2.17-260.0.9.el7 will be installed
--> Processing Dependency: glibc-headers = 2.17-260.0.9.el7 for package: glibc-devel-2.17-260.0.9.el7.x86_64
--> Processing Dependency: glibc = 2.17-260.0.9.el7 for package: glibc-devel-2.17-260.0.9.el7.x86_64
--> Processing Dependency: glibc-headers for package: glibc-devel-2.17-260.0.9.el7.x86_64
---> Package ksh.x86_64 0:20120801-139.0.1.el7 will be installed
---> Package libaio-devel.x86_64 0:0.3.109-13.el7 will be installed
---> Package libstdc++-devel.x86_64 0:4.8.5-36.0.1.el7 will be installed
--> Processing Dependency: libstdc++(x86-64) = 4.8.5-36.0.1.el7 for package: libstdc++-devel-4.8.5-36.0.1.el7.x86_64
---> Package net-tools.x86_64 0:2.0-0.24.20131004git.el7 will be installed
---> Package nfs-utils.x86_64 1:1.3.0-0.61.0.1.el7 will be installed
--> Processing Dependency: gssproxy >= 0.7.0-3 for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: libtirpc >= 0.2.4-0.7 for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: rpcbind for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: keyutils for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: quota for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: libevent for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: libnfsidmap for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: libevent-2.0.so.5()(64bit) for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: libtirpc.so.1()(64bit) for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
--> Processing Dependency: libnfsidmap.so.0()(64bit) for package: 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64
---> Package psmisc.x86_64 0:22.20-15.el7 will be installed
---> Package smartmontools.x86_64 1:6.5-1.el7 will be installed
--> Processing Dependency: mailx for package: 1:smartmontools-6.5-1.el7.x86_64
---> Package sysstat.x86_64 0:10.1.5-17.el7 will be installed
--> Processing Dependency: libsensors.so.4()(64bit) for package: sysstat-10.1.5-17.el7.x86_64
---> Package unzip.x86_64 0:6.0-19.el7 will be installed
---> Package xorg-x11-utils.x86_64 0:7.5-23.el7 will be installed
--> Processing Dependency: libXext.so.6()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXv.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXtst.so.6()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXrender.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXxf86vm.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXxf86misc.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libX11-xcb.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXrandr.so.2()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libdmx.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXinerama.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libX11.so.6()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXxf86dga.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libxcb.so.1()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libxcb-shape.so.0()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
--> Processing Dependency: libXi.so.6()(64bit) for package: xorg-x11-utils-7.5-23.el7.x86_64
---> Package xorg-x11-xauth.x86_64 1:1.0.9-1.el7 will be installed
--> Processing Dependency: libXau.so.6()(64bit) for package: 1:xorg-x11-xauth-1.0.9-1.el7.x86_64
--> Processing Dependency: libXmuu.so.1()(64bit) for package: 1:xorg-x11-xauth-1.0.9-1.el7.x86_64
--> Running transaction check
---> Package glibc.x86_64 0:2.17-222.el7 will be updated
--> Processing Dependency: glibc = 2.17-222.el7 for package: glibc-common-2.17-222.el7.x86_64
---> Package glibc.x86_64 0:2.17-260.0.9.el7 will be an update
---> Package glibc-headers.x86_64 0:2.17-260.0.9.el7 will be installed
--> Processing Dependency: kernel-headers >= 2.2.1 for package: glibc-headers-2.17-260.0.9.el7.x86_64
--> Processing Dependency: kernel-headers for package: glibc-headers-2.17-260.0.9.el7.x86_64
---> Package gssproxy.x86_64 0:0.7.0-21.el7 will be installed
--> Processing Dependency: libini_config >= 1.3.1-31 for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libref_array.so.1(REF_ARRAY_0.1.1)(64bit) for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libini_config.so.3(INI_CONFIG_1.1.0)(64bit) for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libini_config.so.3(INI_CONFIG_1.2.0)(64bit) for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libverto-module-base for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libini_config.so.3()(64bit) for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libbasicobjects.so.0()(64bit) for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libref_array.so.1()(64bit) for package: gssproxy-0.7.0-21.el7.x86_64
--> Processing Dependency: libcollection.so.2()(64bit) for package: gssproxy-0.7.0-21.el7.x86_64
---> Package keyutils.x86_64 0:1.5.8-3.el7 will be installed
---> Package libX11.x86_64 0:1.6.5-2.el7 will be installed
--> Processing Dependency: libX11-common >= 1.6.5-2.el7 for package: libX11-1.6.5-2.el7.x86_64
---> Package libXau.x86_64 0:1.0.8-2.1.el7 will be installed
---> Package libXext.x86_64 0:1.3.3-3.el7 will be installed
---> Package libXi.x86_64 0:1.7.9-1.el7 will be installed
---> Package libXinerama.x86_64 0:1.1.3-2.1.el7 will be installed
---> Package libXmu.x86_64 0:1.1.2-2.el7 will be installed
--> Processing Dependency: libXt.so.6()(64bit) for package: libXmu-1.1.2-2.el7.x86_64
---> Package libXrandr.x86_64 0:1.5.1-2.el7 will be installed
---> Package libXrender.x86_64 0:0.9.10-1.el7 will be installed
---> Package libXtst.x86_64 0:1.2.3-1.el7 will be installed
---> Package libXv.x86_64 0:1.0.11-1.el7 will be installed
---> Package libXxf86dga.x86_64 0:1.1.4-2.1.el7 will be installed
---> Package libXxf86misc.x86_64 0:1.0.3-7.1.el7 will be installed
---> Package libXxf86vm.x86_64 0:1.1.4-1.el7 will be installed
---> Package libdmx.x86_64 0:1.1.3-3.el7 will be installed
---> Package libevent.x86_64 0:2.0.21-4.el7 will be installed
---> Package libnfsidmap.x86_64 0:0.25-19.el7 will be installed
---> Package libstdc++.x86_64 0:4.8.5-28.0.1.el7 will be updated
---> Package libstdc++.x86_64 0:4.8.5-36.0.1.el7 will be an update
---> Package libtirpc.x86_64 0:0.2.4-0.15.el7 will be installed
---> Package libxcb.x86_64 0:1.13-1.el7 will be installed
---> Package lm_sensors-libs.x86_64 0:3.4.0-6.20160601gitf9185e5.el7 will be installed
---> Package mailx.x86_64 0:12.5-19.el7 will be installed
---> Package quota.x86_64 1:4.01-17.el7 will be installed
--> Processing Dependency: quota-nls = 1:4.01-17.el7 for package: 1:quota-4.01-17.el7.x86_64
--> Processing Dependency: tcp_wrappers for package: 1:quota-4.01-17.el7.x86_64
---> Package rpcbind.x86_64 0:0.2.0-47.el7 will be installed
--> Running transaction check
---> Package glibc-common.x86_64 0:2.17-222.el7 will be updated
---> Package glibc-common.x86_64 0:2.17-260.0.9.el7 will be an update
---> Package kernel-headers.x86_64 0:3.10.0-957.0.el7 will be installed
---> Package libX11-common.noarch 0:1.6.5-2.el7 will be installed
---> Package libXt.x86_64 0:1.1.5-3.el7 will be installed
--> Processing Dependency: libICE.so.6()(64bit) for package: libXt-1.1.5-3.el7.x86_64
--> Processing Dependency: libSM.so.6()(64bit) for package: libXt-1.1.5-3.el7.x86_64
---> Package libbasicobjects.x86_64 0:0.1.1-32.el7 will be installed
---> Package libcollection.x86_64 0:0.7.0-32.el7 will be installed
---> Package libini_config.x86_64 0:1.3.1-32.el7 will be installed
--> Processing Dependency: libpath_utils.so.1(PATH_UTILS_0.2.1)(64bit) for package: libini_config-1.3.1-32.el7.x86_64
--> Processing Dependency: libpath_utils.so.1()(64bit) for package: libini_config-1.3.1-32.el7.x86_64
---> Package libref_array.x86_64 0:0.1.5-32.el7 will be installed
---> Package libverto-libevent.x86_64 0:0.2.5-4.el7 will be installed
---> Package quota-nls.noarch 1:4.01-17.el7 will be installed
---> Package tcp_wrappers.x86_64 0:7.6-77.el7 will be installed
--> Running transaction check
---> Package libICE.x86_64 0:1.0.9-9.el7 will be installed
---> Package libSM.x86_64 0:1.2.2-2.el7 will be installed
---> Package libpath_utils.x86_64 0:0.2.1-32.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package                 Arch   Version                        Repository  Size
================================================================================
Installing:
 oracle-database-preinstall-18c
                         x86_64 1.0-1.el7                      ol7_latest  18 k
Installing for dependencies:
 bc                      x86_64 1.06.95-13.el7                 ol7_latest 114 k
 compat-libcap1          x86_64 1.10-7.el7                     ol7_latest  17 k
 compat-libstdc++-33     x86_64 3.2.3-72.el7                   ol7_latest 190 k
 glibc-devel             x86_64 2.17-260.0.9.el7               ol7_latest 1.1 M
 glibc-headers           x86_64 2.17-260.0.9.el7               ol7_latest 684 k
 gssproxy                x86_64 0.7.0-21.el7                   ol7_latest 108 k
 kernel-headers          x86_64 3.10.0-957.0.el7               ol7_latest 8.0 M
 keyutils                x86_64 1.5.8-3.el7                    ol7_latest  53 k
 ksh                     x86_64 20120801-139.0.1.el7           ol7_latest 883 k
 libICE                  x86_64 1.0.9-9.el7                    ol7_latest  66 k
 libSM                   x86_64 1.2.2-2.el7                    ol7_latest  39 k
 libX11                  x86_64 1.6.5-2.el7                    ol7_latest 606 k
 libX11-common           noarch 1.6.5-2.el7                    ol7_latest 163 k
 libXau                  x86_64 1.0.8-2.1.el7                  ol7_latest  28 k
 libXext                 x86_64 1.3.3-3.el7                    ol7_latest  38 k
 libXi                   x86_64 1.7.9-1.el7                    ol7_latest  40 k
 libXinerama             x86_64 1.1.3-2.1.el7                  ol7_latest  13 k
 libXmu                  x86_64 1.1.2-2.el7                    ol7_latest  70 k
 libXrandr               x86_64 1.5.1-2.el7                    ol7_latest  27 k
 libXrender              x86_64 0.9.10-1.el7                   ol7_latest  25 k
 libXt                   x86_64 1.1.5-3.el7                    ol7_latest 172 k
 libXtst                 x86_64 1.2.3-1.el7                    ol7_latest  20 k
 libXv                   x86_64 1.0.11-1.el7                   ol7_latest  18 k
 libXxf86dga             x86_64 1.1.4-2.1.el7                  ol7_latest  18 k
 libXxf86misc            x86_64 1.0.3-7.1.el7                  ol7_latest  19 k
 libXxf86vm              x86_64 1.1.4-1.el7                    ol7_latest  17 k
 libaio-devel            x86_64 0.3.109-13.el7                 ol7_latest  12 k
 libbasicobjects         x86_64 0.1.1-32.el7                   ol7_latest  25 k
 libcollection           x86_64 0.7.0-32.el7                   ol7_latest  41 k
 libdmx                  x86_64 1.1.3-3.el7                    ol7_latest  15 k
 libevent                x86_64 2.0.21-4.el7                   ol7_latest 208 k
 libini_config           x86_64 1.3.1-32.el7                   ol7_latest  63 k
 libnfsidmap             x86_64 0.25-19.el7                    ol7_latest  49 k
 libpath_utils           x86_64 0.2.1-32.el7                   ol7_latest  28 k
 libref_array            x86_64 0.1.5-32.el7                   ol7_latest  27 k
 libstdc++-devel         x86_64 4.8.5-36.0.1.el7               ol7_latest 1.5 M
 libtirpc                x86_64 0.2.4-0.15.el7                 ol7_latest  88 k
 libverto-libevent       x86_64 0.2.5-4.el7                    ol7_latest 8.2 k
 libxcb                  x86_64 1.13-1.el7                     ol7_latest 213 k
 lm_sensors-libs         x86_64 3.4.0-6.20160601gitf9185e5.el7 ol7_latest  41 k
 mailx                   x86_64 12.5-19.el7                    ol7_latest 244 k
 net-tools               x86_64 2.0-0.24.20131004git.el7       ol7_latest 305 k
 nfs-utils               x86_64 1:1.3.0-0.61.0.1.el7           ol7_latest 410 k
 psmisc                  x86_64 22.20-15.el7                   ol7_latest 140 k
 quota                   x86_64 1:4.01-17.el7                  ol7_latest 178 k
 quota-nls               noarch 1:4.01-17.el7                  ol7_latest  90 k
 rpcbind                 x86_64 0.2.0-47.el7                   ol7_latest  59 k
 smartmontools           x86_64 1:6.5-1.el7                    ol7_latest 460 k
 sysstat                 x86_64 10.1.5-17.el7                  ol7_latest 314 k
 tcp_wrappers            x86_64 7.6-77.el7                     ol7_latest  78 k
 unzip                   x86_64 6.0-19.el7                     ol7_latest 169 k
 xorg-x11-utils          x86_64 7.5-23.el7                     ol7_latest 114 k
 xorg-x11-xauth          x86_64 1:1.0.9-1.el7                  ol7_latest  29 k
Updating for dependencies:
 glibc                   x86_64 2.17-260.0.9.el7               ol7_latest 3.6 M
 glibc-common            x86_64 2.17-260.0.9.el7               ol7_latest  11 M
 libstdc++               x86_64 4.8.5-36.0.1.el7               ol7_latest 304 k

Transaction Summary
================================================================================
Install  1 Package  (+53 Dependent packages)
Upgrade             (  3 Dependent packages)

Total download size: 33 M
Downloading packages:
Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
(1/57): compat-libcap1-1.10-7.el7.x86_64.rpm               |  17 kB   00:03
(2/57): bc-1.06.95-13.el7.x86_64.rpm                       | 114 kB   00:03
(3/57): glibc-2.17-260.0.9.el7.x86_64.rpm                  | 3.6 MB   00:18
(4/57): compat-libstdc++-33-3.2.3-72.el7.x86_64.rpm        | 190 kB   00:23
(5/57): glibc-devel-2.17-260.0.9.el7.x86_64.rpm            | 1.1 MB   00:24
(6/57): glibc-common-2.17-260.0.9.el7.x86_64.rpm           |  11 MB   00:33
(7/57): glibc-headers-2.17-260.0.9.el7.x86_64.rpm          | 684 kB   00:05
(8/57): gssproxy-0.7.0-21.el7.x86_64.rpm                   | 108 kB   00:00
(9/57): keyutils-1.5.8-3.el7.x86_64.rpm                    |  53 kB   00:00
(10/57): ksh-20120801-139.0.1.el7.x86_64.rpm               | 883 kB   00:01
(11/57): libICE-1.0.9-9.el7.x86_64.rpm                     |  66 kB   00:00
(12/57): libSM-1.2.2-2.el7.x86_64.rpm                      |  39 kB   00:02
(13/57): libX11-1.6.5-2.el7.x86_64.rpm                     | 606 kB   00:01
(14/57): libX11-common-1.6.5-2.el7.noarch.rpm              | 163 kB   00:00
(15/57): libXau-1.0.8-2.1.el7.x86_64.rpm                   |  28 kB   00:00
(16/57): libXext-1.3.3-3.el7.x86_64.rpm                    |  38 kB   00:01
(17/57): libXi-1.7.9-1.el7.x86_64.rpm                      |  40 kB   00:01
(18/57): libXinerama-1.1.3-2.1.el7.x86_64.rpm              |  13 kB   00:01
(19/57): libXmu-1.1.2-2.el7.x86_64.rpm                     |  70 kB   00:02
(20/57): libXrandr-1.5.1-2.el7.x86_64.rpm                  |  27 kB   00:01
(21/57): libXrender-0.9.10-1.el7.x86_64.rpm                |  25 kB   00:01
(22/57): libXt-1.1.5-3.el7.x86_64.rpm                      | 172 kB   00:01
(23/57): libXtst-1.2.3-1.el7.x86_64.rpm                    |  20 kB   00:00
(24/57): libXv-1.0.11-1.el7.x86_64.rpm                     |  18 kB   00:00
(25/57): libXxf86dga-1.1.4-2.1.el7.x86_64.rpm              |  18 kB   00:00
(26/57): libXxf86misc-1.0.3-7.1.el7.x86_64.rpm             |  19 kB   00:02
(27/57): kernel-headers-3.10.0-957.0.el7.x86_64.rpm        | 8.0 MB   00:24
(28/57): libaio-devel-0.3.109-13.el7.x86_64.rpm            |  12 kB   00:00
(29/57): libXxf86vm-1.1.4-1.el7.x86_64.rpm                 |  17 kB   00:00
(30/57): libbasicobjects-0.1.1-32.el7.x86_64.rpm           |  25 kB   00:00
(31/57): libcollection-0.7.0-32.el7.x86_64.rpm             |  41 kB   00:00
(32/57): libdmx-1.1.3-3.el7.x86_64.rpm                     |  15 kB   00:01
(33/57): libini_config-1.3.1-32.el7.x86_64.rpm             |  63 kB   00:00
(34/57): libevent-2.0.21-4.el7.x86_64.rpm                  | 208 kB   00:01
(35/57): libpath_utils-0.2.1-32.el7.x86_64.rpm             |  28 kB   00:00
(36/57): libref_array-0.1.5-32.el7.x86_64.rpm              |  27 kB   00:00
(37/57): libstdc++-4.8.5-36.0.1.el7.x86_64.rpm             | 304 kB   00:00
(38/57): libnfsidmap-0.25-19.el7.x86_64.rpm                |  49 kB   00:01
(39/57): libtirpc-0.2.4-0.15.el7.x86_64.rpm                |  88 kB   00:00
(40/57): libverto-libevent-0.2.5-4.el7.x86_64.rpm          | 8.2 kB   00:02
(41/57): libxcb-1.13-1.el7.x86_64.rpm                      | 213 kB   00:04
(42/57): lm_sensors-libs-3.4.0-6.20160601gitf9185e5.el7.x8 |  41 kB   00:00
(43/57): libstdc++-devel-4.8.5-36.0.1.el7.x86_64.rpm       | 1.5 MB   00:08
(44/57): net-tools-2.0-0.24.20131004git.el7.x86_64.rpm     | 305 kB   00:01
(45/57): mailx-12.5-19.el7.x86_64.rpm                      | 244 kB   00:03
(46/57): nfs-utils-1.3.0-0.61.0.1.el7.x86_64.rpm           | 410 kB   00:01
(47/57): oracle-database-preinstall-18c-1.0-1.el7.x86_64.r |  18 kB   00:01
(48/57): psmisc-22.20-15.el7.x86_64.rpm                    | 140 kB   00:01
(49/57): quota-4.01-17.el7.x86_64.rpm                      | 178 kB   00:01
(50/57): rpcbind-0.2.0-47.el7.x86_64.rpm                   |  59 kB   00:00
(51/57): quota-nls-4.01-17.el7.noarch.rpm                  |  90 kB   00:01
(52/57): sysstat-10.1.5-17.el7.x86_64.rpm                  | 314 kB   00:01
(53/57): smartmontools-6.5-1.el7.x86_64.rpm                | 460 kB   00:03
(54/57): tcp_wrappers-7.6-77.el7.x86_64.rpm                |  78 kB   00:01
(55/57): xorg-x11-utils-7.5-23.el7.x86_64.rpm              | 114 kB   00:00
(56/57): unzip-6.0-19.el7.x86_64.rpm                       | 169 kB   00:01
(57/57): xorg-x11-xauth-1.0.9-1.el7.x86_64.rpm             |  29 kB   00:01
--------------------------------------------------------------------------------
Total                                              321 kB/s |  33 MB  01:44
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Updating   : glibc-2.17-260.0.9.el7.x86_64                               1/60
  Updating   : glibc-common-2.17-260.0.9.el7.x86_64                        2/60
  Updating   : libstdc++-4.8.5-36.0.1.el7.x86_64                           3/60
  Installing : libXau-1.0.8-2.1.el7.x86_64                                 4/60
  Installing : libxcb-1.13-1.el7.x86_64                                    5/60
  Installing : libref_array-0.1.5-32.el7.x86_64                            6/60
  Installing : libbasicobjects-0.1.1-32.el7.x86_64                         7/60
  Installing : libevent-2.0.21-4.el7.x86_64                                8/60
  Installing : libICE-1.0.9-9.el7.x86_64                                   9/60
  Installing : libcollection-0.7.0-32.el7.x86_64                          10/60
  Installing : libtirpc-0.2.4-0.15.el7.x86_64                             11/60
  Installing : rpcbind-0.2.0-47.el7.x86_64                                12/60
  Installing : libSM-1.2.2-2.el7.x86_64                                   13/60
  Installing : libverto-libevent-0.2.5-4.el7.x86_64                       14/60
  Installing : libstdc++-devel-4.8.5-36.0.1.el7.x86_64                    15/60
  Installing : bc-1.06.95-13.el7.x86_64                                   16/60
  Installing : tcp_wrappers-7.6-77.el7.x86_64                             17/60
  Installing : psmisc-22.20-15.el7.x86_64                                 18/60
  Installing : net-tools-2.0-0.24.20131004git.el7.x86_64                  19/60
  Installing : libpath_utils-0.2.1-32.el7.x86_64                          20/60
  Installing : libini_config-1.3.1-32.el7.x86_64                          21/60
  Installing : gssproxy-0.7.0-21.el7.x86_64                               22/60
  Installing : lm_sensors-libs-3.4.0-6.20160601gitf9185e5.el7.x86_64      23/60
  Installing : sysstat-10.1.5-17.el7.x86_64                               24/60
  Installing : compat-libcap1-1.10-7.el7.x86_64                           25/60
  Installing : ksh-20120801-139.0.1.el7.x86_64                            26/60
  Installing : keyutils-1.5.8-3.el7.x86_64                                27/60
  Installing : compat-libstdc++-33-3.2.3-72.el7.x86_64                    28/60
  Installing : libnfsidmap-0.25-19.el7.x86_64                             29/60
  Installing : unzip-6.0-19.el7.x86_64                                    30/60
  Installing : mailx-12.5-19.el7.x86_64                                   31/60
  Installing : 1:smartmontools-6.5-1.el7.x86_64                           32/60
  Installing : libaio-devel-0.3.109-13.el7.x86_64                         33/60
  Installing : kernel-headers-3.10.0-957.0.el7.x86_64                     34/60
  Installing : glibc-headers-2.17-260.0.9.el7.x86_64                      35/60
  Installing : glibc-devel-2.17-260.0.9.el7.x86_64                        36/60
  Installing : 1:quota-nls-4.01-17.el7.noarch                             37/60
  Installing : 1:quota-4.01-17.el7.x86_64                                 38/60
  Installing : 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64                      39/60
  Installing : libX11-common-1.6.5-2.el7.noarch                           40/60
  Installing : libX11-1.6.5-2.el7.x86_64                                  41/60
  Installing : libXext-1.3.3-3.el7.x86_64                                 42/60
  Installing : libXi-1.7.9-1.el7.x86_64                                   43/60
  Installing : libXrender-0.9.10-1.el7.x86_64                             44/60
  Installing : libXrandr-1.5.1-2.el7.x86_64                               45/60
  Installing : libXtst-1.2.3-1.el7.x86_64                                 46/60
  Installing : libXxf86misc-1.0.3-7.1.el7.x86_64                          47/60
  Installing : libXinerama-1.1.3-2.1.el7.x86_64                           48/60
  Installing : libXxf86vm-1.1.4-1.el7.x86_64                              49/60
  Installing : libdmx-1.1.3-3.el7.x86_64                                  50/60
  Installing : libXv-1.0.11-1.el7.x86_64                                  51/60
  Installing : libXxf86dga-1.1.4-2.1.el7.x86_64                           52/60
  Installing : xorg-x11-utils-7.5-23.el7.x86_64                           53/60
  Installing : libXt-1.1.5-3.el7.x86_64                                   54/60
  Installing : libXmu-1.1.2-2.el7.x86_64                                  55/60
  Installing : 1:xorg-x11-xauth-1.0.9-1.el7.x86_64                        56/60
  Installing : oracle-database-preinstall-18c-1.0-1.el7.x86_64            57/60
  Cleanup    : libstdc++-4.8.5-28.0.1.el7.x86_64                          58/60
  Cleanup    : glibc-common-2.17-222.el7.x86_64                           59/60
  Cleanup    : glibc-2.17-222.el7.x86_64                                  60/60
  Verifying  : libXext-1.3.3-3.el7.x86_64                                  1/60
  Verifying  : libXxf86misc-1.0.3-7.1.el7.x86_64                           2/60
  Verifying  : oracle-database-preinstall-18c-1.0-1.el7.x86_64             3/60
  Verifying  : libverto-libevent-0.2.5-4.el7.x86_64                        4/60
  Verifying  : libXinerama-1.1.3-2.1.el7.x86_64                            5/60
  Verifying  : libXau-1.0.8-2.1.el7.x86_64                                 6/60
  Verifying  : libXrender-0.9.10-1.el7.x86_64                              7/60
  Verifying  : libref_array-0.1.5-32.el7.x86_64                            8/60
  Verifying  : glibc-headers-2.17-260.0.9.el7.x86_64                       9/60
  Verifying  : libXi-1.7.9-1.el7.x86_64                                   10/60
  Verifying  : libXxf86vm-1.1.4-1.el7.x86_64                              11/60
  Verifying  : glibc-devel-2.17-260.0.9.el7.x86_64                        12/60
  Verifying  : libdmx-1.1.3-3.el7.x86_64                                  13/60
  Verifying  : libxcb-1.13-1.el7.x86_64                                   14/60
  Verifying  : libbasicobjects-0.1.1-32.el7.x86_64                        15/60
  Verifying  : libX11-common-1.6.5-2.el7.noarch                           16/60
  Verifying  : sysstat-10.1.5-17.el7.x86_64                               17/60
  Verifying  : bc-1.06.95-13.el7.x86_64                                   18/60
  Verifying  : libstdc++-4.8.5-36.0.1.el7.x86_64                          19/60
  Verifying  : libXv-1.0.11-1.el7.x86_64                                  20/60
  Verifying  : tcp_wrappers-7.6-77.el7.x86_64                             21/60
  Verifying  : xorg-x11-utils-7.5-23.el7.x86_64                           22/60
  Verifying  : glibc-common-2.17-260.0.9.el7.x86_64                       23/60
  Verifying  : libXtst-1.2.3-1.el7.x86_64                                 24/60
  Verifying  : libXt-1.1.5-3.el7.x86_64                                   25/60
  Verifying  : 1:nfs-utils-1.3.0-0.61.0.1.el7.x86_64                      26/60
  Verifying  : libstdc++-devel-4.8.5-36.0.1.el7.x86_64                    27/60
  Verifying  : psmisc-22.20-15.el7.x86_64                                 28/60
  Verifying  : libini_config-1.3.1-32.el7.x86_64                          29/60
  Verifying  : 1:quota-nls-4.01-17.el7.noarch                             30/60
  Verifying  : kernel-headers-3.10.0-957.0.el7.x86_64                     31/60
  Verifying  : net-tools-2.0-0.24.20131004git.el7.x86_64                  32/60
  Verifying  : libpath_utils-0.2.1-32.el7.x86_64                          33/60
  Verifying  : lm_sensors-libs-3.4.0-6.20160601gitf9185e5.el7.x86_64      34/60
  Verifying  : libevent-2.0.21-4.el7.x86_64                               35/60
  Verifying  : gssproxy-0.7.0-21.el7.x86_64                               36/60
  Verifying  : libX11-1.6.5-2.el7.x86_64                                  37/60
  Verifying  : rpcbind-0.2.0-47.el7.x86_64                                38/60
  Verifying  : compat-libcap1-1.10-7.el7.x86_64                           39/60
  Verifying  : libXrandr-1.5.1-2.el7.x86_64                               40/60
  Verifying  : libaio-devel-0.3.109-13.el7.x86_64                         41/60
  Verifying  : 1:quota-4.01-17.el7.x86_64                                 42/60
  Verifying  : 1:xorg-x11-xauth-1.0.9-1.el7.x86_64                        43/60
  Verifying  : libICE-1.0.9-9.el7.x86_64                                  44/60
  Verifying  : ksh-20120801-139.0.1.el7.x86_64                            45/60
  Verifying  : glibc-2.17-260.0.9.el7.x86_64                              46/60
  Verifying  : libSM-1.2.2-2.el7.x86_64                                   47/60
  Verifying  : 1:smartmontools-6.5-1.el7.x86_64                           48/60
  Verifying  : libXxf86dga-1.1.4-2.1.el7.x86_64                           49/60
  Verifying  : libXmu-1.1.2-2.el7.x86_64                                  50/60
  Verifying  : keyutils-1.5.8-3.el7.x86_64                                51/60
  Verifying  : compat-libstdc++-33-3.2.3-72.el7.x86_64                    52/60
  Verifying  : libcollection-0.7.0-32.el7.x86_64                          53/60
  Verifying  : libnfsidmap-0.25-19.el7.x86_64                             54/60
  Verifying  : unzip-6.0-19.el7.x86_64                                    55/60
  Verifying  : mailx-12.5-19.el7.x86_64                                   56/60
  Verifying  : libtirpc-0.2.4-0.15.el7.x86_64                             57/60
  Verifying  : glibc-2.17-222.el7.x86_64                                  58/60
  Verifying  : glibc-common-2.17-222.el7.x86_64                           59/60
  Verifying  : libstdc++-4.8.5-28.0.1.el7.x86_64                          60/60

Installed:
  oracle-database-preinstall-18c.x86_64 0:1.0-1.el7

Dependency Installed:
  bc.x86_64 0:1.06.95-13.el7
  compat-libcap1.x86_64 0:1.10-7.el7
  compat-libstdc++-33.x86_64 0:3.2.3-72.el7
  glibc-devel.x86_64 0:2.17-260.0.9.el7
  glibc-headers.x86_64 0:2.17-260.0.9.el7
  gssproxy.x86_64 0:0.7.0-21.el7
  kernel-headers.x86_64 0:3.10.0-957.0.el7
  keyutils.x86_64 0:1.5.8-3.el7
  ksh.x86_64 0:20120801-139.0.1.el7
  libICE.x86_64 0:1.0.9-9.el7
  libSM.x86_64 0:1.2.2-2.el7
  libX11.x86_64 0:1.6.5-2.el7
  libX11-common.noarch 0:1.6.5-2.el7
  libXau.x86_64 0:1.0.8-2.1.el7
  libXext.x86_64 0:1.3.3-3.el7
  libXi.x86_64 0:1.7.9-1.el7
  libXinerama.x86_64 0:1.1.3-2.1.el7
  libXmu.x86_64 0:1.1.2-2.el7
  libXrandr.x86_64 0:1.5.1-2.el7
  libXrender.x86_64 0:0.9.10-1.el7
  libXt.x86_64 0:1.1.5-3.el7
  libXtst.x86_64 0:1.2.3-1.el7
  libXv.x86_64 0:1.0.11-1.el7
  libXxf86dga.x86_64 0:1.1.4-2.1.el7
  libXxf86misc.x86_64 0:1.0.3-7.1.el7
  libXxf86vm.x86_64 0:1.1.4-1.el7
  libaio-devel.x86_64 0:0.3.109-13.el7
  libbasicobjects.x86_64 0:0.1.1-32.el7
  libcollection.x86_64 0:0.7.0-32.el7
  libdmx.x86_64 0:1.1.3-3.el7
  libevent.x86_64 0:2.0.21-4.el7
  libini_config.x86_64 0:1.3.1-32.el7
  libnfsidmap.x86_64 0:0.25-19.el7
  libpath_utils.x86_64 0:0.2.1-32.el7
  libref_array.x86_64 0:0.1.5-32.el7
  libstdc++-devel.x86_64 0:4.8.5-36.0.1.el7
  libtirpc.x86_64 0:0.2.4-0.15.el7
  libverto-libevent.x86_64 0:0.2.5-4.el7
  libxcb.x86_64 0:1.13-1.el7
  lm_sensors-libs.x86_64 0:3.4.0-6.20160601gitf9185e5.el7
  mailx.x86_64 0:12.5-19.el7
  net-tools.x86_64 0:2.0-0.24.20131004git.el7
  nfs-utils.x86_64 1:1.3.0-0.61.0.1.el7
  psmisc.x86_64 0:22.20-15.el7
  quota.x86_64 1:4.01-17.el7
  quota-nls.noarch 1:4.01-17.el7
  rpcbind.x86_64 0:0.2.0-47.el7
  smartmontools.x86_64 1:6.5-1.el7
  sysstat.x86_64 0:10.1.5-17.el7
  tcp_wrappers.x86_64 0:7.6-77.el7
  unzip.x86_64 0:6.0-19.el7
  xorg-x11-utils.x86_64 0:7.5-23.el7
  xorg-x11-xauth.x86_64 1:1.0.9-1.el7

Dependency Updated:
  glibc.x86_64 0:2.17-260.0.9.el7       glibc-common.x86_64 0:2.17-260.0.9.el7
  libstdc++.x86_64 0:4.8.5-36.0.1.el7

Complete!

Create Required Users and Groups

On both nodes.

[root@primary01 ~]# groupadd -g 54321 oinstall
groupadd: group 'oinstall' already exists
[root@primary01 ~]# groupadd -g 54322 dba
groupadd: group 'dba' already exists
[root@primary01 ~]# groupadd -g 54323 oper
groupadd: group 'oper' already exists
[root@primary01 ~]# groupadd -g 54324 backupdba
groupadd: group 'backupdba' already exists
[root@primary01 ~]# groupadd -g 54325 dgdba
groupadd: group 'dgdba' already exists
[root@primary01 ~]# groupadd -g 54326 kmdba
groupadd: group 'kmdba' already exists
[root@primary01 ~]# groupadd -g 54327 asmdba
[root@primary01 ~]# groupadd -g 54328 asmoper
[root@primary01 ~]# groupadd -g 54329 asmadmin
[root@primary01 ~]# groupadd -g 54330 racdba
groupadd: group 'racdba' already exists
[root@primary01 ~]# useradd -u 54322 -g oinstall -G asmoper,asmadmin,asmdba,racdba grid
[root@primary01 ~]# id grid
uid=54322(grid) gid=54321(oinstall) groups=54321(oinstall),54330(racdba),54327(asmdba),54328(asmoper),54329(asmadmin)
[root@primary01 ~]# usermod -a -G asmdba oracle
[root@primary01 ~]# id oracle
uid=54321(oracle) gid=54321(oinstall) groups=54321(oinstall),54322(dba),54323(oper),54324(backupdba),54325(dgdba),54326(kmdba),54330(racdba),54327(asmdba)

Set User Credentials

On both nodes.

[root@primary01 ~]# passwd grid
Changing password for user grid.
New password:
Retype new password:
passwd: all authentication tokens updated successfully.
[root@primary01 ~]# passwd oracle
Changing password for user oracle.
New password:
Retype new password:
passwd: all authentication tokens updated successfully.

Create required Directories

On both nodes.

[root@primary01 ~]# mkdir -p /u01/app/18.0.0/grid
[root@primary01 ~]# mkdir -p /u01/app/grid
[root@primary01 ~]# mkdir -p /u01/app/oracle/product/18.0.0/db_1
[root@primary01 ~]# chown -R grid:oinstall /u01
[root@primary01 ~]# chown -R oracle:oinstall /u01/app/oracle
[root@primary01 ~]# chmod -R 775 /u01/

Set Profiles for grid and oracle

First, we set profiles for user grid on both nodes.

[root@primary01 ~]# su - grid
[grid@primary01 ~]$ vi .bash_profile
...
umask 022
ORACLE_SID=+ASM1
ORACLE_BASE=/u01/app/grid
ORACLE_HOME=/u01/app/18.0.0/grid
LD_LIBRARY_PATH=$ORACLE_HOME/lib
TMP=/tmp
TMPDIR=/tmp
PATH=$PATH:$HOME/.local/bin:$HOME/bin:$ORACLE_HOME/bin
export PATH ORACLE_SID ORACLE_BASE ORACLE_HOME LD_LIBRARY_PATH TMP TMPDIR
[grid@primary01 ~]$ exit
logout

Now turn to user oracle on both nodes.

[root@primary01 ~]# su - oracle
[oracle@primary01 ~]$ vi .bash_profile
...
umask 022
ORACLE_SID=PRIMDB1
ORACLE_BASE=/u01/app/oracle
ORACLE_HOME=$ORACLE_BASE/product/18.0.0/db_1
LD_LIBRARY_PATH=$ORACLE_HOME/lib
TMP=/tmp
TMPDIR=/tmp
PATH=$PATH:$HOME/.local/bin:$HOME/bin:$ORACLE_HOME/bin
export PATH ORACLE_SID ORACLE_BASE ORACLE_HOME LD_LIBRARY_PATH TMP TMPDIR
[oracle@primary01 ~]$ exit
logout

Resource Limitations

On both nodes.

[root@primary01 ~]# vi /etc/security/limits.conf
...
grid soft nofile 1024
grid hard nofile 65536
grid soft nproc 2047
grid hard nproc 16384
grid soft stack 10240
grid hard stack 32768
grid soft memlock unlimited
grid hard memlock unlimited

oracle soft nofile 1024
oracle hard nofile 65536
oracle soft nproc 2047
oracle hard nproc 16384
oracle soft stack 10240
oracle hard stack 32768
oracle soft memlock unlimited
oracle hard memlock unlimited
[root@primary01 ~]# sysctl -p
fs.file-max = 6815744
kernel.sem = 250 32000 100 128
kernel.shmmni = 4096
kernel.shmall = 1073741824
kernel.shmmax = 4398046511104
kernel.panic_on_oops = 1
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048576
net.ipv4.conf.all.rp_filter = 2
net.ipv4.conf.default.rp_filter = 2
fs.aio-max-nr = 1048576
net.ipv4.ip_local_port_range = 9000 65500

Upload and Unzip Oracle Software

This step is only on node 1. Starting with Oracle Grid Infrastructure 12c Release 2 (12.2), installation and configuration of Oracle Grid Infrastructure software is simplified with image-based installation. That is to say, we have to upload and extract the source file in grid’s ORACLE_HOME.

> cd d:/oracle
> sftp grid@192.168.10.11:/u01/app/18.0.0/grid
Connected to 192.168.10.11.
Changing to: /u01/app/18.0.0/grid
sftp> put LINUX.X64_180000_grid_home.zip
Uploading LINUX.X64_180000_grid_home.zip to /u01/app/18.0.0/grid/LINUX.X64_18000
LINUX.X64_180000_grid_home.zip                 99% 5133MB   52.7MB/s   01:51
sftp> quit

[grid@primary01 ~]$ cd $ORACLE_HOME
[grid@primary01 grid]$ time unzip -q LINUX.X64_180000_grid_home.zip

real    2m24.831s
user    1m24.870s
sys     0m33.634s

Install Oracle ASMLib

On both nodes.

[root@primary01 ~]# rpm -Uvh http://download.oracle.com/otn_software/asmlib/oracleasmlib-2.0.12-1.el7.x86_64.rpm
Retrieving http://download.oracle.com/otn_software/asmlib/oracleasmlib-2.0.12-1.el7.x86_64.rpm
Preparing...                          ################################# [100%]
Updating / installing...
   1:oracleasmlib-2.0.12-1.el7        ################################# [100%]
[root@primary01 ~]# yum -y install kmod-oracleasm oracleasm-support
Loaded plugins: ulninfo
Resolving Dependencies
--> Running transaction check
---> Package kmod-oracleasm.x86_64 0:2.0.8-22.0.3.el7 will be installed
--> Processing Dependency: kernel(__check_object_size) = 0x88db9f48 for package: kmod-oracleasm-2.0.8-22.0.3.el7.x86_64
--> Processing Dependency: kernel >= 3.10.0-907.el7 for package: kmod-oracleasm-2.0.8-22.0.3.el7.x86_64
---> Package oracleasm-support.x86_64 0:2.1.11-2.el7 will be installed
--> Running transaction check
---> Package kernel.x86_64 0:3.10.0-957.0.el7 will be installed
--> Processing Dependency: linux-firmware >= 20180911-68 for package: kernel-3.10.0-957.0.el7.x86_64
--> Running transaction check
---> Package linux-firmware.noarch 0:20180220-62.git6d51311.0.1.el7 will be updated
---> Package linux-firmware.noarch 999:20181031-999.1.git1baa3486.el7 will be an update
--> Processing Conflict: kernel-3.10.0-957.0.el7.x86_64 conflicts selinux-policy-targeted < 3.13.1-201
--> Restarting Dependency Resolution with new changes.
--> Running transaction check
---> Package selinux-policy-targeted.noarch 0:3.13.1-192.0.1.el7 will be updated
---> Package selinux-policy-targeted.noarch 0:3.13.1-229.0.1.el7_6.5 will be an update
--> Processing Dependency: selinux-policy = 3.13.1-229.0.1.el7_6.5 for package: selinux-policy-targeted-3.13.1-229.0.1.el7_6.5.noarch
--> Running transaction check
---> Package selinux-policy.noarch 0:3.13.1-192.0.1.el7 will be updated
---> Package selinux-policy.noarch 0:3.13.1-229.0.1.el7_6.5 will be an update
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package             Arch   Version                            Repository  Size
================================================================================
Installing:
 kernel              x86_64 3.10.0-957.0.el7                   ol7_latest  48 M
 kmod-oracleasm      x86_64 2.0.8-22.0.3.el7                   ol7_latest 296 k
 oracleasm-support   x86_64 2.1.11-2.el7                       ol7_latest  85 k
Updating:
 selinux-policy-targeted
                     noarch 3.13.1-229.0.1.el7_6.5             ol7_latest 6.9 M
Updating for dependencies:
 linux-firmware      noarch 999:20181031-999.1.git1baa3486.el7 ol7_latest  73 M
 selinux-policy      noarch 3.13.1-229.0.1.el7_6.5             ol7_latest 483 k

Transaction Summary
================================================================================
Install  3 Packages
Upgrade  1 Package  (+2 Dependent packages)

Total download size: 129 M
Downloading packages:
Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
(1/6): kmod-oracleasm-2.0.8-22.0.3.el7.x86_64.rpm          | 296 kB   00:06
(2/6): kernel-3.10.0-957.0.el7.x86_64.rpm                  |  48 MB   02:35
(3/6): oracleasm-support-2.1.11-2.el7.x86_64.rpm           |  85 kB   00:00
(4/6): selinux-policy-3.13.1-229.0.1.el7_6.5.noarch.rpm    | 483 kB   00:01
(5/6): selinux-policy-targeted-3.13.1-229.0.1.el7_6.5.noar | 6.9 MB   00:16
(6/6): linux-firmware-20181031-999.1.git1baa3486.el7.noarc |  73 MB   03:46
--------------------------------------------------------------------------------
Total                                              567 kB/s | 129 MB  03:52
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
Warning: RPMDB altered outside of yum.
  Updating   : 999:linux-firmware-20181031-999.1.git1baa3486.el7.noarch     1/9
  Installing : kernel-3.10.0-957.0.el7.x86_64                               2/9
  Updating   : selinux-policy-3.13.1-229.0.1.el7_6.5.noarch                 3/9
  Updating   : selinux-policy-targeted-3.13.1-229.0.1.el7_6.5.noarch        4/9
  Installing : kmod-oracleasm-2.0.8-22.0.3.el7.x86_64                       5/9
  Installing : oracleasm-support-2.1.11-2.el7.x86_64                        6/9
Note: Forwarding request to 'systemctl enable oracleasm.service'.
Created symlink from /etc/systemd/system/multi-user.target.wants/oracleasm.service to /usr/lib/systemd/system/oracleasm.service.
  Cleanup    : selinux-policy-targeted-3.13.1-192.0.1.el7.noarch            7/9
  Cleanup    : selinux-policy-3.13.1-192.0.1.el7.noarch                     8/9
  Cleanup    : linux-firmware-20180220-62.git6d51311.0.1.el7.noarch         9/9
  Verifying  : kernel-3.10.0-957.0.el7.x86_64                               1/9
  Verifying  : selinux-policy-targeted-3.13.1-229.0.1.el7_6.5.noarch        2/9
  Verifying  : selinux-policy-3.13.1-229.0.1.el7_6.5.noarch                 3/9
  Verifying  : oracleasm-support-2.1.11-2.el7.x86_64                        4/9
  Verifying  : kmod-oracleasm-2.0.8-22.0.3.el7.x86_64                       5/9
  Verifying  : 999:linux-firmware-20181031-999.1.git1baa3486.el7.noarch     6/9
  Verifying  : selinux-policy-3.13.1-192.0.1.el7.noarch                     7/9
  Verifying  : linux-firmware-20180220-62.git6d51311.0.1.el7.noarch         8/9
  Verifying  : selinux-policy-targeted-3.13.1-192.0.1.el7.noarch            9/9

Installed:
  kernel.x86_64 0:3.10.0-957.0.el7
  kmod-oracleasm.x86_64 0:2.0.8-22.0.3.el7
  oracleasm-support.x86_64 0:2.1.11-2.el7

Updated:
  selinux-policy-targeted.noarch 0:3.13.1-229.0.1.el7_6.5

Dependency Updated:
  linux-firmware.noarch 999:20181031-999.1.git1baa3486.el7
  selinux-policy.noarch 0:3.13.1-229.0.1.el7_6.5

Complete!

Configure Oracle ASMLib

On both nodes.

[root@primary01 ~]# oracleasm configure -i
Configuring the Oracle ASM library driver.

This will configure the on-boot properties of the Oracle ASM library
driver.  The following questions will determine whether the driver is
loaded on boot and what permissions it will have.  The current values
will be shown in brackets ('[]').  Hitting <ENTER> without typing an
answer will keep that current value.  Ctrl-C will abort.

Default user to own the driver interface []: grid
Default group to own the driver interface []: asmadmin
Start Oracle ASM library driver on boot (y/n) [n]: y
Scan for Oracle ASM disks on boot (y/n) [y]: y
Writing Oracle ASM library driver configuration: done
[root@primary01 ~]# oracleasm init
Creating /dev/oracleasm mount point: /dev/oracleasm
Loading module "oracleasm": oracleasm
Configuring "oracleasm" to use device physical block size
Mounting ASMlib driver filesystem: /dev/oracleasm

Create ASM Disks via ASMLib

Only on node 1.

[root@primary01 ~]# oracleasm createdisk asmdisk01 /dev/disk/by-path/ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t1-lun-1-part1
Writing disk header: done
Instantiating disk: done
[root@primary01 ~]# oracleasm createdisk asmdisk02 /dev/disk/by-path/ip-192.168.10.101:3260-iscsi-iqn.2005-10.org.freenas.ctl:asm-t2-lun-2-part1
Writing disk header: done
Instantiating disk: done
...

On node 2.

[root@primary02 ~]# oracleasm scandisks
Reloading disk partitions: done
Cleaning any stale ASM disks...
Scanning system for ASM disks...
Instantiating disk "ASMDISK01"
Instantiating disk "ASMDISK02"
Instantiating disk "ASMDISK03"
Instantiating disk "ASMDISK04"
Instantiating disk "ASMDISK05"
Instantiating disk "ASMDISK06"
Instantiating disk "ASMDISK07"
Instantiating disk "ASMDISK08"

Try to list all ASM disks.

[root@primary01 ~]# oracleasm listdisks
ASMDISK01
ASMDISK02
ASMDISK03
ASMDISK04
ASMDISK05
ASMDISK06
ASMDISK07
ASMDISK08

Install Cluster Verification Utility

On node 1.

[root@primary01 ~]# cp -p /u01/app/18.0.0/grid/cv/rpm/cvuqdisk-1.0.10-1.rpm /tmp/
[root@primary01 ~]# scp -p /u01/app/18.0.0/grid/cv/rpm/cvuqdisk-1.0.10-1.rpm primary02:/tmp/
...
root@primary02's password:
cvuqdisk-1.0.10-1.rpm                         100% 8860     5.3MB/s   00:00

On both nodes.

[root@primary01 ~]# rpm -Uvh /tmp/cvuqdisk-1.0.10-1.rpm
Preparing...                          ################################# [100%]
Using default group oinstall to install package
Updating / installing...
   1:cvuqdisk-1.0.10-1                ################################# [100%]

Rearrange Initialization Order of ASMLib

On both nodes.

[root@primary01 ~]# vi /usr/lib/systemd/system/oracleasm.service
[Unit]
Description=Load oracleasm Modules
Requires=multipathd.service iscsi.service
After=multipathd.service iscsi.service

This can make system discover all available ASM Disks on boot-time.

2 thoughts on “How to Build 18c RAC – 1 of 4 – Preparing Two Database Servers”

Leave a Reply

Your email address will not be published. Required fields are marked *