ORAchk replaces the popular RACcheck tool, extending the coverage based on prioritization of top issues reported by users, to proactively scan for known problems within the area of:
1. Oracle Database
2. Enterprise Manager Cloud Control
3. E-Business Suite
4. Oracle Sun Systems
ORAchk features:
=============
1. Proactively scans for the most impactful problems across the various layers of your stack
2. Simplifies and streamlines how to investigate and analyze which known issues present a risk to you
3. Lightweight tool that runs within your environment without requiring config data to be sent to Oracle
4. High level reports show your system health risks with the ability to drill down into specific problems and understand their resolutions
5. Can be configured to send email notifications when it detects problems
6. Collection Manager, a companion Application Express web app, provides a single dashboard view of collections across your entire enterprise
login as: oracle
oracle@192.168.0.111's password:
Last login: Fri Feb 1 15:34:36 2013 from oel6-112-rac2.localdomain
[oracle@oel6-112-rac1 ~]$ cd /home/oracle/
-rw-r--r-- 1 oracle oinstall 5.6M Jun 18 15:11 orachk.zip
[oracle@oel6-112-rac1 ~]$ cksum orachk.zip
3306312142 5770368 orachk.zip
[oracle@oel6-112-rac1 ~]$ unzip orachk.zip
Archive: orachk.zip
inflating: UserGuide.txt
inflating: rules.dat
inflating: orachk
creating: .cgrep/
inflating: .cgrep/hiacgrep
inflating: .cgrep/lcgrep5
inflating: .cgrep/auto_upgrade.pl
inflating: .cgrep/check_reblance_free_space.sql
inflating: .cgrep/psqlplus
inflating: .cgrep/scgrepx86
inflating: .cgrep/init.tmpl
inflating: .cgrep/utluppkg.sql
inflating: .cgrep/scgrep
inflating: .cgrep/versions.dat
inflating: .cgrep/raw_data_browser.pl
inflating: .cgrep/lcgrep6
inflating: .cgrep/profiles.dat
inflating: .cgrep/auto_upgrade_check.pl
inflating: .cgrep/CollectionManager_App.sql
inflating: .cgrep/utlu112i.sql
inflating: .cgrep/ggdiscovery.sh
inflating: .cgrep/lcgreps9
inflating: .cgrep/checkDiskFGMapping.sh
inflating: .cgrep/lcgreps10
inflating: .cgrep/pxhcdr.sql
inflating: .cgrep/diff_collections.pl
inflating: .cgrep/rack_comparison.py
inflating: .cgrep/exalogic_zfs_checks.aksh
inflating: .cgrep/lcgrep4
inflating: .cgrep/merge_collections.pl
inflating: .cgrep/acgrep
inflating: .cgrep/show_file_in_html.pl
inflating: .cgrep/scnhealthcheck.sql
inflating: .cgrep/lcgreps11
inflating: .cgrep/reset_crshome.pl
inflating: .cgrep/ogghc_12101.sql
creating: .cgrep/profiles/
inflating: .cgrep/profiles/DF65D0F7FB6F1014E04312C0E50A7808.prf
inflating: .cgrep/profiles/DFE9C207A8F2428CE04313C0E50A6B0A.prf
inflating: .cgrep/profiles/D49C4F9F48735396E0431EC0E50A9A0B.prf
inflating: .cgrep/profiles/D49C0AB26A6D45A8E0431EC0E50ADE06.prf
inflating: .cgrep/profiles/D49BDC2EC9E624AEE0431EC0E50A3E12.prf
inflating: .cgrep/profiles/F9ED0179CCD8256BE04312C0E50A5399.prf
inflating: .cgrep/profiles/F6AFECA37F177C3FE04313C0E50A56BF.prf
inflating: .cgrep/profiles/D49B218473787400E0431EC0E50A0BB9.prf
inflating: .cgrep/profiles/E2E972DDE1E14493E04312C0E50A1AB1.prf
inflating: .cgrep/profiles/F32F44CE0BCD662FE04312C0E50AB058.prf
inflating: .cgrep/profiles/D49AD88F8EE75CD8E0431EC0E50A0BC3.prf
inflating: .cgrep/profiles/E8DF76E07DD82E0DE04313C0E50AA55D.prf
inflating: .cgrep/profiles/EA5EE324E7E05128E04313C0E50A4B2A.prf
inflating: .cgrep/profiles/D462A6F7E9C340FDE0431EC0E50ABE12.prf
inflating: .cgrep/profiles/E1BF012E8F210839E04313C0E50A7B68.prf
inflating: .cgrep/profiles/DF65D6117CB41054E04312C0E50A69D1.prf
inflating: .cgrep/profiles/D8367AD6754763FEE04312C0E50A6FCB.prf
inflating: .cgrep/profiles/D49C0FBF8FBF4B1AE0431EC0E50A0F24.prf
inflating: .cgrep/profiles/DA94919CD0DE0913E04312C0E50A7996.prf
inflating: .cgrep/profiles/EF6C016813C51366E04313C0E50AE11F.prf
extracting: .cgrep/profiles/F13E11974A282AB3E04312C0E50ABCBF.prf
inflating: .cgrep/utlusts.sql
inflating: .cgrep/asrexacheck
inflating: .cgrep/create_version.pl
inflating: .cgrep/oracle-upstarttmpl.conf
inflating: .cgrep/preupgrd.sql
inflating: .cgrep/ogghc_11203.sql
inflating: .cgrep/ogghc_11204.sql
inflating: CollectionManager_App.sql
inflating: raccheck
inflating: readme.txt
inflating: collections.dat
[oracle@oel6-112-rac1 ~]$ ls
CollectionManager_App.sql Desktop Documents grid.rsp node.ccf orachk.zip Pictures raccheck rpm shiphomes Templates Videos
collections.dat disk.sh Downloads Music orachk oradiag_oracle Public readme.txt rules.dat swingbench UserGuide.txt
[oracle@oel6-112-rac1 ~]$ ./orachk -v
ORACHK VERSION: 2.2.5_20140530
[oracle@oel6-112-rac1 ~]$ pwd
/home/oracle
[oracle@oel6-112-rac1 ~]$ chmod 755 orachk
[oracle@oel6-112-rac1 ~]$ ./orachk
CRS stack is running and CRS_HOME is not set. Do you want to set CRS_HOME to /u01/app/12.1.0/grid?[y/n][y]y
Checking ssh user equivalency settings on all nodes in cluster
Node oel6-112-rac2 is configured for ssh user equivalency for oracle user
Searching for running databases . . . . .
. .
List of running databases registered in OCR
1. orcl
2. None of above
Select databases from list for checking best practices. For multiple databases, select 1 for All or comma separated number like 1,2 etc [1-2][1].1
. .
Checking Status of Oracle Software Stack - Clusterware, ASM, RDBMS
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
-------------------------------------------------------------------------------------------------------
Oracle Stack Status
-------------------------------------------------------------------------------------------------------
Host Name CRS Installed ASM HOME RDBMS Installed CRS UP ASM UP RDBMS UP DB Instance Name
-------------------------------------------------------------------------------------------------------
oel6-112-rac1 Yes N/A Yes Yes Yes Yes orcl1
oel6-112-rac2 Yes N/A Yes Yes Yes Yes orcl2
-------------------------------------------------------------------------------------------------------
Copying plug-ins
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . .
16 of the included audit checks require root privileged data collection . If sudo is not configured or the root password is not available, audit checks which require root privileged data collection can be skipped.
1. Enter 1 if you will enter root password for each host when prompted
2. Enter 2 if you have sudo configured for oracle user to execute root_orachk.sh script
3. Enter 3 to skip the root privileged collections
4. Enter 4 to exit and work with the SA to configure sudo or to arrange for root access and run the tool later.
Please indicate your selection from one of the above options for root access[1-4][1]:- 1
*** Checking Best Practice Recommendations (PASS/WARNING/FAIL) ***
Collections and audit checks log file is
/home/oracle/orachk_oel6-112-rac1_orcl_061814_153147/log/orachk.log
Running orachk in serial mode because expect(/usr/bin/expect) is not available to supply root passwords on remote nodes
NOTICE: Installing the expect utility (/usr/bin/expect) will allow orachk to gather root passwords at the beginning of the process and execute orachk on all nodes in parallel speeding up the entire process. For more info - http://www.nist.gov/el/msid/expect.cfm. Expect is available for all major platforms. See User Guide for more details.
Checking for prompts in /home/oracle/.bash_profile on oel6-112-rac1 for oracle user...
Checking for prompts in /home/oracle/.bash_profile on oel6-112-rac2 for oracle user...
=============================================================
Node name - oel6-112-rac1
=============================================================
Collecting - ASM DIsk I/O stats
Collecting - ASM Disk Groups
Collecting - ASM Diskgroup Attributes
Collecting - ASM disk partnership imbalance
Collecting - ASM diskgroup attributes
Collecting - ASM initialization parameters
Collecting - Active sessions load balance for orcl database
Collecting - Archived Destination Status for orcl database
Collecting - Cluster Interconnect Config for orcl database
Collecting - Database Archive Destinations for orcl database
Collecting - Database Files for orcl database
Collecting - Database Instance Settings for orcl database
Collecting - Database Parameters for orcl database
Collecting - Database Parameters for orcl database
Collecting - Database Properties for orcl database
Collecting - Database Registry for orcl database
Collecting - Database Sequences for orcl database
Collecting - Database Undocumented Parameters for orcl database
Collecting - Database Undocumented Parameters for orcl database
Collecting - Database Workload Services for orcl database
Collecting - Dataguard Status for orcl database
Collecting - Files not opened by ASM
Collecting - Log Sequence Numbers for orcl database
Collecting - Percentage of asm disk Imbalance
Collecting - Process for shipping Redo to standby for orcl database
Collecting - RDBMS Feature Usage for orcl database
Collecting - Redo Log information for orcl database
Collecting - Standby redo log creation status before switchover for orcl database
Collecting - /proc/cmdline
Collecting - /proc/modules
Collecting - CPU Information
Collecting - CRS active version
Collecting - CRS oifcfg
Collecting - CRS software version
Collecting - CSS Reboot time
Collecting - CSS disktimout
Collecting - Cluster interconnect (clusterware)
Collecting - Clusterware OCR healthcheck
Collecting - Clusterware Resource Status
Collecting - DiskFree Information
Collecting - DiskMount Information
Collecting - Huge pages configuration
Collecting - Interconnect network card speed
Collecting - Kernel parameters
Collecting - Maximum number of semaphore sets on system
Collecting - Maximum number of semaphores on system
Collecting - Maximum number of semaphores per semaphore set
Collecting - Memory Information
Collecting - NUMA Configuration
Collecting - Network Interface Configuration
Collecting - Network Performance
Collecting - Network Service Switch
Collecting - OS Packages
Collecting - OS version
Collecting - Operating system release information and kernel version
Collecting - Oracle Executable Attributes
Collecting - Patches for Grid Infrastructure
Collecting - Patches for RDBMS Home
Collecting - Shared memory segments
Collecting - Table of file system defaults
Collecting - Voting disks (clusterware)
Collecting - number of semaphore operations per semop system call
Preparing to run root privileged commands oel6-112-rac1. Please enter root password when prompted.
root@oel6-112-rac1's password:
Data collections completed. Checking best practices on oel6-112-rac1.
--------------------------------------------------------------------------------------
WARNING => SYS.AUDSES$ sequence cache size < 10,000 for orcl
WARNING => Without ARCHIVELOG mode the database cannot be recovered from an online backup and Data Guard cannot be used. for orcl
WARNING => OCR is NOT being backed up daily
INFO => $CRS_HOME/log/hostname/client directory has too many older log files.
INFO => user_dump_dest has trace files older than 30 days for orcl
INFO => ORA-07445 errors found in alert log for orcl
INFO => background_dump_dest has files older than 30 days for orcl
INFO => Some tablespaces do not have allocation type as SYSTEM for orcl
INFO => At some times checkpoints are not being completed for orcl
INFO => audit_file_dest has audit files older than 30 days for orcl
WARNING => Controlfile is NOT multiplexed for orcl
WARNING => One or more redo log groups are NOT multiplexed for orcl
WARNING => /tmp is NOT on a dedicated filesystem
WARNING => Shell limit soft nproc for DB is NOT configured according to recommendation
FAIL => Operating system hugepages count does not satisfy total SGA requirements
WARNING => NIC bonding is not configured for interconnect
WARNING => NIC bonding is NOT configured for public network (VIP)
WARNING => OSWatcher is not running as is recommended.
INFO => Jumbo frames (MTU >= 8192) are not configured for interconnect
FAIL => Database parameter DB_LOST_WRITE_PROTECT is NOT set to recommended value on orcl1 instance
WARNING => Database parameter DB_BLOCK_CHECKING on PRIMARY is NOT set to the recommended value. for orcl
FAIL => Flashback on PRIMARY is not configured for orcl
INFO => Operational Best Practices
INFO => Database Consolidation Best Practices
INFO => Computer failure prevention best practices
INFO => Data corruption prevention best practices
INFO => Logical corruption prevention best practices
INFO => Database/Cluster/Site failure prevention best practices
INFO => Client failover operational best practices
FAIL => Some bigfile tablespaces do not have non-default maxbytes values set for orcl
WARNING => fast_start_mttr_target should be greater than or equal to 300. on orcl1 instance
INFO => Information about hanganalyze and systemstate dump
WARNING => Package unixODBC-2.2.14-11.el6-i686 is recommended but NOT installed
WARNING => Package unixODBC-devel-2.2.14-11.el6-i686 is recommended but NOT installed
FAIL => Table AUD$[FGA_LOG$] should use Automatic Segment Space Management for orcl
INFO => Database failure prevention best practices
WARNING => Database Archivelog Mode should be set to ARCHIVELOG for orcl
FAIL => Primary database is NOT protected with Data Guard (standby database) for real-time data protection and availability for orcl
WARNING => Redo log write time is more than 500 milliseconds for orcl
WARNING => TFA Collector is either not installed or not running
WARNING => Package unixODBC-devel-2.2.14-11.el6-x86_64 is recommended but NOT installed
WARNING => Linux transparent huge pages are enabled
WARNING => vm.min_free_kbytes should be set as recommended.
INFO => Oracle recovery manager(rman) best practices
WARNING => RMAN controlfile autobackup should be set to ON for orcl
WARNING => Linux Disk I/O Scheduler should be configured to [Deadline]
INFO => Consider increasing the COREDUMPSIZE size
INFO => Consider investigating the frequency of SGA resize operations and take corrective action for orcl
WARNING => Shell limit soft stack for DB is not configured according to recommendation
Best Practice checking completed.Checking recommended patches on oel6-112-rac1.
---------------------------------------------------------------------------------
Collecting patch inventory on CRS HOME /u01/app/12.1.0/grid
Collecting patch inventory on ORACLE_HOME /u01/app/oracle/product/12.1.0/db_1
---------------------------------------------------------------------------------
1 Recommended CRS patches for 121010 from /u01/app/12.1.0/grid on oel6-112-rac1
---------------------------------------------------------------------------------
Patch# CRS ASM RDBMS RDBMS_HOME Patch-Description
---------------------------------------------------------------------------------
18139660 no no /u01/app/oracle/product/12.1.0/db_1GRID INFRASTRUCTURE SYSTEM PATCH 12.1.0.1.3
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------
1 Recommended RDBMS patches for 121010 from /u01/app/oracle/product/12.1.0/db_1 on oel6-112-rac1
---------------------------------------------------------------------------------
Patch# RDBMS ASM type Patch-Description
---------------------------------------------------------------------------------
18139660 no merge GRID INFRASTRUCTURE SYSTEM PATCH 12.1.0.1.3
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------
Clusterware patches summary report
---------------------------------------------------------------------------------
Total patches Applied on CRS Applied on RDBMS Applied on ASM
---------------------------------------------------------------------------------
1 0 0 0
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------
RDBMS homes patches summary report
---------------------------------------------------------------------------------
Total patches Applied on RDBMS Applied on ASM ORACLE_HOME
---------------------------------------------------------------------------------
1 0 0 /u01/app/oracle/product/12.1.0/db_1
---------------------------------------------------------------------------------
=============================================================
Node name - oel6-112-rac2
=============================================================
Collecting - /proc/cmdline
Collecting - /proc/modules
Collecting - CPU Information
Collecting - CRS active version
Collecting - CRS oifcfg
Collecting - CRS software version
Collecting - Cluster interconnect (clusterware)
Collecting - DiskFree Information
Collecting - DiskMount Information
Collecting - Huge pages configuration
Collecting - Interconnect network card speed
Collecting - Kernel parameters
Collecting - Maximum number of semaphore sets on system
Collecting - Maximum number of semaphores on system
Collecting - Maximum number of semaphores per semaphore set
Collecting - Memory Information
Collecting - NUMA Configuration
Collecting - Network Interface Configuration
Collecting - Network Performance
Collecting - Network Service Switch
Collecting - OS Packages
Collecting - OS version
Collecting - Operating system release information and kernel version
Collecting - Oracle Executable Attributes
Collecting - Patches for Grid Infrastructure
Collecting - Patches for RDBMS Home
Collecting - Shared memory segments
Collecting - Table of file system defaults
Collecting - number of semaphore operations per semop system call
Preparing to run root privileged commands oel6-112-rac2. Please enter root password when prompted.
root@oel6-112-rac2's password:
Collecting - Broadcast Requirements for Networks
Collecting - CRS user time zone check
Collecting - Disk Information
Collecting - Grid Infastructure user shell limits configuration
Collecting - Interconnect interface config
Collecting - Network interface stats
Collecting - Number of RDBMS LMS running in real time
Collecting - OLR Integrity
Collecting - Root user limits
Collecting - Verify no database server kernel out of memory errors
Collecting - root time zone check
Collecting - slabinfo
Data collections completed. Checking best practices on oel6-112-rac2.
-------------------------------------------------------------------------------------
INFO => $CRS_HOME/log/hostname/client directory has too many older log files.
INFO => user_dump_dest has trace files older than 30 days for orcl
INFO => background_dump_dest has files older than 30 days for orcl
INFO => audit_file_dest has audit files older than 30 days for orcl
WARNING => /tmp is NOT on a dedicated filesystem
WARNING => Shell limit soft nproc for DB is NOT configured according to recommendation
FAIL => Operating system hugepages count does not satisfy total SGA requirements
WARNING => NIC bonding is not configured for interconnect
WARNING => NIC bonding is NOT configured for public network (VIP)
WARNING => OSWatcher is not running as is recommended.
INFO => Jumbo frames (MTU >= 8192) are not configured for interconnect
FAIL => Database parameter DB_LOST_WRITE_PROTECT is NOT set to recommended value on orcl2 instance
WARNING => Database parameter DB_BLOCK_CHECKING on PRIMARY is NOT set to the recommended value. for orcl
WARNING => fast_start_mttr_target should be greater than or equal to 300. on orcl2 instance
WARNING => Package unixODBC-2.2.14-11.el6-i686 is recommended but NOT installed
WARNING => Package unixODBC-devel-2.2.14-11.el6-i686 is recommended but NOT installed
WARNING => Redo log write time is more than 500 milliseconds for orcl
WARNING => TFA Collector is either not installed or not running
WARNING => Package unixODBC-devel-2.2.14-11.el6-x86_64 is recommended but NOT installed
WARNING => Linux transparent huge pages are enabled
WARNING => vm.min_free_kbytes should be set as recommended.
WARNING => Linux Disk I/O Scheduler should be configured to [Deadline]
INFO => Consider increasing the COREDUMPSIZE size
WARNING => Shell limit hard nproc for root is NOT configured according to recommendation
WARNING => Shell limit soft stack for DB is not configured according to recommendation
Best Practice checking completed.Checking recommended patches on oel6-112-rac2.
---------------------------------------------------------------------------------
Collecting patch inventory on CRS HOME /u01/app/12.1.0/grid
Collecting patch inventory on ORACLE_HOME /u01/app/oracle/product/12.1.0/db_1
---------------------------------------------------------------------------------
1 Recommended CRS patches for 121010 from /u01/app/12.1.0/grid on oel6-112-rac2
---------------------------------------------------------------------------------
Patch# CRS ASM RDBMS RDBMS_HOME Patch-Description
---------------------------------------------------------------------------------
18139660 no no /u01/app/oracle/product/12.1.0/db_1GRID INFRASTRUCTURE SYSTEM PATCH 12.1.0.1.3
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------
1 Recommended RDBMS patches for 121010 from /u01/app/oracle/product/12.1.0/db_1 on oel6-112-rac2
---------------------------------------------------------------------------------
Patch# RDBMS ASM type Patch-Description
---------------------------------------------------------------------------------
18139660 no merge GRID INFRASTRUCTURE SYSTEM PATCH 12.1.0.1.3
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------
Clusterware patches summary report
---------------------------------------------------------------------------------
Total patches Applied on CRS Applied on RDBMS Applied on ASM
---------------------------------------------------------------------------------
1 0 0 0
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------
RDBMS homes patches summary report
---------------------------------------------------------------------------------
Total patches Applied on RDBMS Applied on ASM ORACLE_HOME
---------------------------------------------------------------------------------
1 0 0 /u01/app/oracle/product/12.1.0/db_1
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------
CLUSTERWIDE CHECKS
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------
Detailed report (html) - /home/oracle/orachk_oel6-112-rac1_orcl_061814_153147/orachk_oel6-112-rac1_orcl_061814_153147.html
UPLOAD(if required) - /home/oracle/orachk_oel6-112-rac1_orcl_061814_153147.zip
[oracle@oel6-112-rac1 ~]$