Exadata – CELLCLI command Line Utility

Exadata storage is managed by CELLCLI command line utility. Management process (MS) will communicate with cellcli to maintain the configuration on the system. CELLCLI utility can be launched by user “celladmin” or “root”. In this article, we will see how to list the storage objects and how to stop/start the cell services using the CELLCLI utility.At the end of the article, we will see how to use the help command to form the command syntax.

1. Login to Exadata storage cell using celladmin user and start cellcli utility.

[[email protected] ~]$ id

uid=1000(celladmin) gid=500(celladmin) groups=500(celladmin),502(cellusers)

[[email protected] ~]$ cellcli

CellCLI: Release 11.2.3.2.1 – Production on Sun Nov 16 16:05:27 GMT+05:30 2014

Copyright (c) 2007, 2012, Oracle.  All rights reserved.

Cell Efficiency Ratio: 1

CellCLI>

Note:CELLCLI is case in-sensitive. So you can use the both upper & lower case.

2. List the cell information. (Exadata storage box)

CellCLI> list cell

         uaexacell1      online

CellCLI> list cell detail

         name:                   uaexacell1

         bbuTempThreshold:       60

         bbuChargeThreshold:     800

         bmcType:                absent

         cellVersion:            OSS_11.2.3.2.1_LINUX.X64_130109

         cpuCount:               1

         diagHistoryDays:        7

         fanCount:               1/1

         fanStatus:              normal

         flashCacheMode:         WriteThrough

         id:                     a3c87541-4d0e-478a-9ec9-8a4bea3eeaac

         interconnectCount:      2

         interconnect1:          eth1

         iormBoost:              0.0

         ipaddress1:             192.168.1.5/24

         kernelVersion:          2.6.39-300.26.1.el5uek

         makeModel:              Fake hardware

         metricHistoryDays:      7

         offloadEfficiency:      1.0

         powerCount:             1/1

         powerStatus:            normal

         releaseVersion:         11.2.3.2.1

         releaseTrackingBug:     14522699

         status:                 online

         temperatureReading:     0.0

         temperatureStatus:      normal

         upTime:                 0 days, 2:24

         cellsrvStatus:          running

         msStatus:               running

         rsStatus:               running

CellCLI>

3. List the available storage devices on the system.It will  list both harddrives and flash disks.

CellCLI> LIST LUN

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK00    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK00    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK01    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK01    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK02    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK02    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK03    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK03    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK04    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK04    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK05    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK05    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK06    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK06    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK07    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK07    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK08    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK08    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK09    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK09    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK10    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK10    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK11    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK11    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK12    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK12    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK13    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK13    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH00   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH00   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH01   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH01   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH02   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH02   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH03   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH03   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH04   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH04   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH05   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH05   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH06   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH06   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH07   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH07   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH08   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH08   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH09   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH09   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH10   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH10   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH11   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH11   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH12   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH12   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH13   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH13   normal

CellCLI>

My Exdata storage is running on virtual hardware. That’s why you are seeing the storage devices are listing with full path. In real hardware, You will be just seeing the controller number and disks numbers. (Ex: 0_0 0_0 normal). Note: Exadata VM will be used by oracle only for training purposes.

4.  The below command will list only the harddisks attached to the exadata server.

CellCLI> list lun where disktype=harddisk

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK00    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK00    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK01    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK01    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK02    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK02    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK03    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK03    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK04    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK04    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK05    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK05    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK06    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK06    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK07    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK07    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK08    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK08    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK09    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK09    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK10    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK10    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK11    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK11    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK12    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK12    normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK13    /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/DISK13    normal

CellCLI>

5.The below command list only the flash devices which are attached to the exadata storage server.

CellCLI> list lun where disktype=flashdisk

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH00   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH00   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH01   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH01   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH02   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH02   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH03   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH03   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH04   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH04   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH05   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH05   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH06   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH06   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH07   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH07   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH08   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH08   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH09   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH09   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH10   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH10   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH11   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH11   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH12   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH12   normal

         /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH13   /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/FLASH13   normal

CellCLI>

6.List the celldisks

CellCLI> list celldisk

         CD_DISK00_uaexacell1    normal

         CD_DISK01_uaexacell1    normal

         CD_DISK02_uaexacell1    normal

         CD_DISK03_uaexacell1    normal

         CD_DISK04_uaexacell1    normal

         CD_DISK05_uaexacell1    normal

         CD_DISK06_uaexacell1    normal

         CD_DISK07_uaexacell1    normal

         CD_DISK08_uaexacell1    normal

         CD_DISK09_uaexacell1    normal

         CD_DISK10_uaexacell1    normal

         CD_DISK11_uaexacell1    normal

         CD_DISK12_uaexacell1    normal

         CD_DISK13_uaexacell1    normal

         FD_00_uaexacell1        normal

         FD_01_uaexacell1        normal

         FD_02_uaexacell1        normal

         FD_03_uaexacell1        normal

         FD_04_uaexacell1        normal

         FD_05_uaexacell1        normal

         FD_06_uaexacell1        normal

         FD_07_uaexacell1        normal

         FD_08_uaexacell1        normal

         FD_09_uaexacell1        normal

         FD_10_uaexacell1        normal

         FD_11_uaexacell1        normal

         FD_12_uaexacell1        normal

         FD_13_uaexacell1        normal

CellCLI>

7. List grid disks

CellCLI> list griddisk

         DATA01_CD_DISK00_uaexacell1     active

         DATA01_CD_DISK01_uaexacell1     active

         DATA01_CD_DISK02_uaexacell1     active

         DATA01_CD_DISK03_uaexacell1     active

         DATA01_CD_DISK04_uaexacell1     active

         DATA01_CD_DISK05_uaexacell1     active

         DATA01_CD_DISK06_uaexacell1     active

         DATA01_CD_DISK07_uaexacell1     active

         DATA01_CD_DISK08_uaexacell1     active

         DATA01_CD_DISK09_uaexacell1     active

         DATA01_CD_DISK10_uaexacell1     active

         DATA01_CD_DISK11_uaexacell1     active

         DATA01_CD_DISK12_uaexacell1     active

         DATA01_CD_DISK13_uaexacell1     active

CellCLI>

8. List the flash disks which are configured as flashcache.

CellCLI> list flashcache detail

         name:                   uaexacell1_FLASHCACHE

         cellDisk:               FD_05_uaexacell1,FD_02_uaexacell1,FD_04_uaexacell1,FD_03_uaexacell1,FD_01_uaexacell1,FD_12_uaexacell1

         creationTime:           2014-11-16T18:57:54+05:30

         degradedCelldisks:

         effectiveCacheSize:     4.3125G

         id:                     f972c16a-5fcc-4cc7-8083-a06b026f662b

         size:                   4.3125G

         status:                 normal

CellCLI>

9.List the flashcache which are configured as flashlog.

CellCLI> list flashlog detail

         name:                   uaexacell1_FLASHLOG

         cellDisk:               FD_13_uaexacell1

         creationTime:           2014-11-16T16:31:23+05:30

         degradedCelldisks:

         effectiveSize:          512M

         efficiency:             100.0

         id:                     1fbc893b-4ab1-4861-b6cc-0b86bd45376d

         size:                   512M

         status:                 normal

CellCLI>

10.List only the status of the RS,MS and CELLSRV status.

CellCLI> list cell attributes rsStatus, msStatus, cellsrvStatus detail

         rsStatus:               running

         msStatus:               running

         cellsrvStatus:          running

11. To stop the services using CELLCLI,

CellCLI> alter cell shutdown services all

Stopping the RS, CELLSRV, and MS services…

The SHUTDOWN of services was successful.

CellCLI>

12.To start the services using CELLCLI,

CellCLI> alter cell startup services all

Starting the RS, CELLSRV, and MS services…

Getting the state of RS services…  running

Starting CELLSRV services…

The STARTUP of CELLSRV services was successful.

Starting MS services…

The STARTUP of MS services was successful.

CellCLI>

13.To restart the services forcefully using CELLCLI,

CellCLI> alter cell restart services all force

Stopping the RS, CELLSRV, and MS services…

The SHUTDOWN of services was successful.

Starting the RS, CELLSRV, and MS services…

Getting the state of RS services…  running

Starting CELLSRV services…

The STARTUP of CELLSRV services was successful.

Starting MS services…

The STARTUP of MS services was successful.

CellCLI>

The same way you can shutdown the services forcefully by swapping the “restart” command with “shutdown”

14. How to get the command syntax  help in Exadata CELLCLI ?

Just execute the command “help” to get the list of commands.

CellCLI> help

 HELP [topic]

   Available Topics:

        ALTER

        ALTER ALERTHISTORY

        ALTER CELL

        ALTER CELLDISK

        ALTER FLASHCACHE

        ALTER GRIDDISK

        ALTER IBPORT

        ALTER IORMPLAN

        ALTER LUN

        ALTER PHYSICALDISK

        ALTER QUARANTINE

        ALTER THRESHOLD

        ASSIGN KEY

        CALIBRATE

        CREATE

        CREATE CELL

        CREATE CELLDISK

        CREATE FLASHCACHE

        CREATE FLASHLOG

        CREATE GRIDDISK

        CREATE KEY

        CREATE QUARANTINE

        CREATE THRESHOLD

        DESCRIBE

        DROP

        DROP ALERTHISTORY

        DROP CELL

        DROP CELLDISK

        DROP FLASHCACHE

        DROP FLASHLOG

        DROP GRIDDISK

        DROP QUARANTINE

        DROP THRESHOLD

        EXPORT CELLDISK

        IMPORT CELLDISK

        LIST

        LIST ACTIVEREQUEST

        LIST ALERTDEFINITION

        LIST ALERTHISTORY

        LIST CELL

        LIST CELLDISK

        LIST FLASHCACHE

        LIST FLASHCACHECONTENT

        LIST FLASHLOG

        LIST GRIDDISK

        LIST IBPORT

        LIST IORMPLAN

        LIST KEY

        LIST LUN

        LIST METRICCURRENT

        LIST METRICDEFINITION

        LIST METRICHISTORY

        LIST PHYSICALDISK

        LIST QUARANTINE

        LIST THRESHOLD

        SET

        SPOOL

        START

CellCLI>

15. To get the help for specific topic,use HELP <TOPIC> command.

CellCLI> HELP LIST

  Enter HELP LIST <object_type> for specific help syntax.

    <object_type>:  {ACTIVEREQUEST | ALERTHISTORY | ALERTDEFINITION | CELL

                     | CELLDISK | FLASHCACHE | FLASHLOG | FLASHCACHECONTENT | GRIDDISK

                     | IBPORT | IORMPLAN | KEY | LUN

                     | METRICCURRENT | METRICDEFINITION | METRICHISTORY

                     | PHYSICALDISK | QUARANTINE | THRESHOLD }

CellCLI>

16.To get the help of specific command,use the below syntax,

CellCLI> HELP LIST CELLDISK

  Usage: LIST CELLDISK [ | ] [<attribute_list>] [DETAIL]

  Purpose: Displays specified attributes for cell disks.

  Arguments:

    :  The name of the cell disk to be displayed.

    :  an expression which determines which cell disks should

                be displayed.

    <attribute_list>: The attributes that are to be displayed.

                      ATTRIBUTES {ALL | attr1 [, attr2]… }

  Options:

    [DETAIL]: Formats the display as an attribute on each line, with

              an attribute descriptor preceding each value.

  Examples:

    LIST CELLDISK cd1 DETAIL

    LIST CELLDISK where freespace > 100M

CellCLI>

You can check the exadata storage cell logs using the below command,

CellCLI> list alerthistory

         1_1     2014-11-15T01:17:14+05:30       critical        “File system “/” is 84% full, which is above the 80% threshold. Accelerated space reclamation has started.  This alert will be cleared when file system “/” becomes less than 75% full. Top three directories ordered by total space usage are as follows: /usr        : 2.35G /tmp        : 1.37G /opt        : 593.27M”

         1_2     2014-11-15T01:25:44+05:30       critical        “File system “/” is 84% full, which is above the 80% threshold. Accelerated space reclamation has started.  This alert will be cleared when file system “/” becomes less than 75% full. Top three directories ordered by total space usage are as follows: /usr        : 2.35G /tmp        : 1.37G /opt        : 593.36M”

         1_3     2014-11-15T01:36:51+05:30       critical        “File system “/” is 84% full, which is above the 80% threshold. Accelerated space reclamation has started.  This alert will be cleared when file system “/” becomes less than 75% full. Top three directories ordered by total space usage are as follows: /usr        : 2.35G /tmp        : 1.37G /opt        : 593.38M”

         1_4     2014-11-15T01:44:27+05:30       critical        “File system “/” is 84% full, which is above the 80% threshold. Accelerated space reclamation has started.  This alert will be cleared when file system “/” becomes less than 75% full. Top three directories ordered by total space usage are as follows: /usr        : 2.35G /tmp        : 1.37G /opt        : 593.39M”

         1_5     2014-11-16T15:00:21+05:30       clear           “File system “/” is 62% full, which is below the 75% threshold. Normal space reclamation will resume.”

         2       2014-11-16T14:47:28+05:30       critical        “RS-7445 [Serv CELLSRV hang detected] [It will be restarted] [] [] [] [] [] [] [] [] [] []”

         3       2014-11-16T15:07:05+05:30       critical        “RS-7445 [Serv MS is absent] [It will be restarted] [] [] [] [] [] [] [] [] [] []”

         4       2014-11-16T16:31:51+05:30       critical        “ORA-07445: exception encountered: core dump [_ZN14FlashCacheCore20fcDeleteMemoryForFciEj()+45] [11] [0x000000000] [] [] []”

         5       2014-11-16T16:32:57+05:30       critical        “ORA-07445: exception encountered: core dump [_ZN14FlashCacheCore20fcDeleteMemoryForFciEj()+45] [11] [0x000000000] [] [] []”

         6       2014-11-16T16:34:42+05:30       critical        “ORA-07445: exception encountered: core dump [_ZN14FlashCacheCore20fcDeleteMemoryForFciEj()+45] [11] [0x000000000] [] [] []”

         7       2014-11-16T16:36:15+05:30       critical        “ORA-07445: exception encountered: core dump [_ZN14FlashCacheCore20fcDeleteMemoryForFciEj()+45] [11] [0x000000000] [] [] []”

         8       2014-11-16T16:44:28+05:30       critical        “ORA-07445: exception encountered: core dump [_ZN14FlashCacheCore20fcDeleteMemoryForFciEj()+45] [11] [0x000000000] [] [] []”

         9       2014-11-16T16:49:00+05:30       critical        “ORA-07445: exception encountered: core dump [_ZN14FlashCacheCore20fcDeleteMemoryForFciEj()+45] [11] [0x000000000] [] [] []”

         10      2014-11-16T16:52:32+05:30       critical        “ORA-07445: exception encountered: core dump [_ZN14FlashCacheCore20fcDeleteMemoryForFciEj()+45] [11] [0x000000000] [] [] []”

         11      2014-11-16T16:58:42+05:30       critical        “ORA-07445: exception encountered: core dump [_ZN14FlashCacheCore20fcDeleteMemoryForFciEj()+45] [11] [0x000000000] [] [] []”

         12      2014-11-16T16:59:48+05:30       critical        “RS-7445 [CELLSRV monitor disabled] [Detected a flood of restarts] [] [] [] [] [] [] [] [] [] []”

         13      2014-11-16T17:07:04+05:30       critical        “ORA-07445: exception encountered: core dump [_ZN14FlashCacheCore20fcDeleteMemoryForFciEj()+45] [11] [0x000000000] [] [] []”

         14      2014-11-16T18:31:17+05:30       critical        “ORA-07445: exception encountered: core dump [_ZN14FlashCacheCore20fcDeleteMemoryForFciEj()+45] [11] [0x000000000] [] [] []”

CellCLI>