See more
See less

Prepare for Grid Infrastructure installation / Presenting ASM Grid disks from exadata cell

  • Filter
  • Time
  • Show
Clear All
new posts

  • Prepare for Grid Infrastructure installation / Presenting ASM Grid disks from exadata cell

    First of all check for rds modules:

    [root@dbmachine01 tmp]# modprobe rds_tcp
    [root@dbmachine01 tmp]# modprobe rds_rdma
    [root@dbmachine01 tmp]# lsmod | grep rds
    rds_rdma               78861  0
    rdma_cm                36555  1 rds_rdma
    ib_core                82732  6 rds_rdma,rdma_cm,ib_cm,iw_cm,ib_sa,ib_mad
    rds_tcp                10581  0
    rds                    96866  2 rds_rdma,rds_tcp
    In order to persist the module loading after reboot create the following file and add the two lines:

    [root@dbmachine01 ~]# cat /etc/rc.modules
    modprobe rds_tcp
    modprobe rds_rdma

    Create two files for cell to db communication (We have no IB switches as this is training setup):

    [root@dbmachine01 tmp]# cat /etc/oracle/cell/network-config/cellinit.ora
    ipaddress1= #DB node IP address
    [root@dbmachine01 tmp]# cat /etc/oracle/cell/network-config/cellip.ora
    cell="" #Cell IP address
    Stop firewall and disable it:

    service iptables stop
    chkconfig iptables off
    Unzip GI software:

    Install the GI software only ! We will need some library files. (This step needs to be revised as I had problems with the RDS and firewall and was unable to see the presented Grid disks. Possibly it is not needed and you can go ahead with RAC install after these are sorted out, just skip the following steps.)
    Then test if grid disks are visible from GI node (kfod.bin is located in the GI unzipped folder):
    [root@dbmachine01 tmp]#export LD_LIBRARY_PATH=/u01/app/12.1.0/grid/lib/
    [root@dbmachine01 tmp]# strace -o check.txt /tmp/grid/stage/ext/bin/kfod.bin disks=all op=DISKS asm_diskstring='o/*/*' verbose=true
     Disk          Size Path                                     User     Group
       1:        976 Mb o/
       2:        976 Mb o/
       3:        976 Mb o/
       4:        976 Mb o/
       5:        976 Mb o/
       6:        976 Mb o/
       7:        976 Mb o/
       8:        976 Mb o/
       9:        976 Mb o/
      10:        976 Mb o/
      11:        976 Mb o/
      12:        976 Mb o/
    If there are missing libraries please check the check.txt file, in my case what I had to additional do was:
    cp /u01/app/12.1.0/grid/lib/lib* /u01/app/12.1.0/grid/lib/tls/x86_64/
    cp /u01/app/12.1.0/grid/lib/lib* /u01/app/12.1.0/grid/lib/tls/
    cp /lib/lib* /u01/app/12.1.0/grid/lib/tls/
    cp /lib64/lib* /u01/app/12.1.0/grid/lib/tls/x86_64/
    cp /u01/app/12.1.0/grid/inventory/Scripts/ext/lib/ /u01/app/12.1.0/grid/lib/tls/x86_64/
    cp /opt/oracle/dbserver_12. /u01/app/12.1.0/grid/lib/tls/x86_64/

    After all of this you can run the GI installer ./runInstaller and proceed with installation , grid disks will be visible with a path of o/*/* (They should already be prepared on the cell)
    Last edited by pepone; 09-01-2017, 21:49.