Wednesday, June 18, 2014

ORAchk Health Checks For The Oracle Stack - ORAchk 2.2.5


ORAchk replaces the popular RACcheck tool, extending the coverage based on prioritization of top issues reported by users, to proactively scan for known problems within the area of:

1. Oracle Database
2. Enterprise Manager Cloud Control
3. E-Business Suite
4. Oracle Sun Systems

ORAchk features:
=============
1. Proactively scans for the most impactful problems across the various layers of your stack
2. Simplifies and streamlines how to investigate and analyze which known issues present a risk to you
3. Lightweight tool that runs within your environment without requiring config data to be sent to Oracle
4. High level reports show your system health risks with the ability to drill down into specific problems and understand their resolutions
5. Can be configured to send email notifications when it detects problems
6. Collection Manager, a companion Application Express web app, provides a single dashboard view of collections across your entire enterprise


login as: oracle
oracle@192.168.0.111's password:
Last login: Fri Feb  1 15:34:36 2013 from oel6-112-rac2.localdomain
 

[oracle@oel6-112-rac1 ~]$ cd /home/oracle/
-rw-r--r--   1 oracle oinstall 5.6M Jun 18 15:11 orachk.zip
 

[oracle@oel6-112-rac1 ~]$ cksum orachk.zip
3306312142 5770368 orachk.zip
 

[oracle@oel6-112-rac1 ~]$ unzip orachk.zip
Archive:  orachk.zip
  inflating: UserGuide.txt
  inflating: rules.dat
  inflating: orachk
   creating: .cgrep/
  inflating: .cgrep/hiacgrep
  inflating: .cgrep/lcgrep5
  inflating: .cgrep/auto_upgrade.pl
  inflating: .cgrep/check_reblance_free_space.sql
  inflating: .cgrep/psqlplus
  inflating: .cgrep/scgrepx86
  inflating: .cgrep/init.tmpl
  inflating: .cgrep/utluppkg.sql
  inflating: .cgrep/scgrep
  inflating: .cgrep/versions.dat
  inflating: .cgrep/raw_data_browser.pl
  inflating: .cgrep/lcgrep6
  inflating: .cgrep/profiles.dat
  inflating: .cgrep/auto_upgrade_check.pl
  inflating: .cgrep/CollectionManager_App.sql
  inflating: .cgrep/utlu112i.sql
  inflating: .cgrep/ggdiscovery.sh
  inflating: .cgrep/lcgreps9
  inflating: .cgrep/checkDiskFGMapping.sh
  inflating: .cgrep/lcgreps10
  inflating: .cgrep/pxhcdr.sql
  inflating: .cgrep/diff_collections.pl
  inflating: .cgrep/rack_comparison.py
  inflating: .cgrep/exalogic_zfs_checks.aksh
  inflating: .cgrep/lcgrep4
  inflating: .cgrep/merge_collections.pl
  inflating: .cgrep/acgrep
  inflating: .cgrep/show_file_in_html.pl
  inflating: .cgrep/scnhealthcheck.sql
  inflating: .cgrep/lcgreps11
  inflating: .cgrep/reset_crshome.pl
  inflating: .cgrep/ogghc_12101.sql
   creating: .cgrep/profiles/
  inflating: .cgrep/profiles/DF65D0F7FB6F1014E04312C0E50A7808.prf
  inflating: .cgrep/profiles/DFE9C207A8F2428CE04313C0E50A6B0A.prf
  inflating: .cgrep/profiles/D49C4F9F48735396E0431EC0E50A9A0B.prf
  inflating: .cgrep/profiles/D49C0AB26A6D45A8E0431EC0E50ADE06.prf
  inflating: .cgrep/profiles/D49BDC2EC9E624AEE0431EC0E50A3E12.prf
  inflating: .cgrep/profiles/F9ED0179CCD8256BE04312C0E50A5399.prf
  inflating: .cgrep/profiles/F6AFECA37F177C3FE04313C0E50A56BF.prf
  inflating: .cgrep/profiles/D49B218473787400E0431EC0E50A0BB9.prf
  inflating: .cgrep/profiles/E2E972DDE1E14493E04312C0E50A1AB1.prf
  inflating: .cgrep/profiles/F32F44CE0BCD662FE04312C0E50AB058.prf
  inflating: .cgrep/profiles/D49AD88F8EE75CD8E0431EC0E50A0BC3.prf
  inflating: .cgrep/profiles/E8DF76E07DD82E0DE04313C0E50AA55D.prf
  inflating: .cgrep/profiles/EA5EE324E7E05128E04313C0E50A4B2A.prf
  inflating: .cgrep/profiles/D462A6F7E9C340FDE0431EC0E50ABE12.prf
  inflating: .cgrep/profiles/E1BF012E8F210839E04313C0E50A7B68.prf
  inflating: .cgrep/profiles/DF65D6117CB41054E04312C0E50A69D1.prf
  inflating: .cgrep/profiles/D8367AD6754763FEE04312C0E50A6FCB.prf
  inflating: .cgrep/profiles/D49C0FBF8FBF4B1AE0431EC0E50A0F24.prf
  inflating: .cgrep/profiles/DA94919CD0DE0913E04312C0E50A7996.prf
  inflating: .cgrep/profiles/EF6C016813C51366E04313C0E50AE11F.prf
 extracting: .cgrep/profiles/F13E11974A282AB3E04312C0E50ABCBF.prf
  inflating: .cgrep/utlusts.sql
  inflating: .cgrep/asrexacheck
  inflating: .cgrep/create_version.pl
  inflating: .cgrep/oracle-upstarttmpl.conf
  inflating: .cgrep/preupgrd.sql
  inflating: .cgrep/ogghc_11203.sql
  inflating: .cgrep/ogghc_11204.sql
  inflating: CollectionManager_App.sql
  inflating: raccheck
  inflating: readme.txt
  inflating: collections.dat
 

[oracle@oel6-112-rac1 ~]$ ls
CollectionManager_App.sql  Desktop  Documents  grid.rsp  node.ccf  orachk.zip      Pictures  raccheck    rpm        shiphomes   Templates      Videos
collections.dat            disk.sh  Downloads  Music     orachk    oradiag_oracle  Public    readme.txt  rules.dat  swingbench  UserGuide.txt
[oracle@oel6-112-rac1 ~]$ ./orachk -v

ORACHK  VERSION: 2.2.5_20140530
[oracle@oel6-112-rac1 ~]$ pwd
/home/oracle
[oracle@oel6-112-rac1 ~]$ chmod 755 orachk
[oracle@oel6-112-rac1 ~]$ ./orachk

CRS stack is running and CRS_HOME is not set. Do you want to set CRS_HOME to /u01/app/12.1.0/grid?[y/n][y]y

Checking ssh user equivalency settings on all nodes in cluster
Node oel6-112-rac2 is configured for ssh user equivalency for oracle user
Searching for running databases . . . . .
. .
List of running databases registered in OCR
1. orcl
2. None of above

Select databases from list for checking best practices. For multiple databases, select 1 for All or comma separated number like 1,2 etc [1-2][1].1
. .

Checking Status of Oracle Software Stack - Clusterware, ASM, RDBMS

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
-------------------------------------------------------------------------------------------------------
                                                 Oracle Stack Status
-------------------------------------------------------------------------------------------------------
Host Name  CRS Installed  ASM HOME       RDBMS Installed  CRS UP    ASM UP    RDBMS UP  DB Instance Name
-------------------------------------------------------------------------------------------------------
oel6-112-rac1 Yes             N/A             Yes             Yes        Yes      Yes      orcl1
oel6-112-rac2 Yes             N/A             Yes             Yes        Yes      Yes      orcl2
-------------------------------------------------------------------------------------------------------
Copying plug-ins
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
. . . . . .

16 of the included audit checks require root privileged data collection . If sudo is not configured or the root password is not available, audit checks which  require root privileged data collection can be skipped.

1. Enter 1 if you will enter root password for each  host when prompted
2. Enter 2 if you have sudo configured for oracle user to execute root_orachk.sh script
3. Enter 3 to skip the root privileged collections
4. Enter 4 to exit and work with the SA to configure sudo  or to arrange for root access and run the tool later.

Please indicate your selection from one of the above options for root access[1-4][1]:- 1
 

*** Checking Best Practice Recommendations (PASS/WARNING/FAIL) ***

Collections and audit checks log file is
/home/oracle/orachk_oel6-112-rac1_orcl_061814_153147/log/orachk.log

Running orachk in serial mode because expect(/usr/bin/expect) is not available to supply root passwords on remote nodes

NOTICE:  Installing the expect utility (/usr/bin/expect) will allow orachk to gather root passwords at the beginning of the process and execute orachk on all nodes in parallel speeding up the entire process. For more info - http://www.nist.gov/el/msid/expect.cfm.  Expect is available for all major platforms.  See User Guide for more details.

Checking for prompts in /home/oracle/.bash_profile on oel6-112-rac1 for oracle user...

Checking for prompts in /home/oracle/.bash_profile on oel6-112-rac2 for oracle user...
 

=============================================================
                    Node name - oel6-112-rac1
=============================================================
Collecting - ASM DIsk I/O stats
Collecting - ASM Disk Groups
Collecting - ASM Diskgroup Attributes
Collecting - ASM disk partnership imbalance
Collecting - ASM diskgroup attributes
Collecting - ASM initialization parameters
Collecting - Active sessions load balance for orcl database
Collecting - Archived Destination Status for orcl database
Collecting - Cluster Interconnect Config for orcl database
Collecting - Database Archive Destinations for orcl database
Collecting - Database Files for orcl database
Collecting - Database Instance Settings for orcl database
Collecting - Database Parameters for orcl database
Collecting - Database Parameters for orcl database
Collecting - Database Properties for orcl database
Collecting - Database Registry for orcl database
Collecting - Database Sequences for orcl database
Collecting - Database Undocumented Parameters for orcl database
Collecting - Database Undocumented Parameters for orcl database
Collecting - Database Workload Services for orcl database
Collecting - Dataguard Status for orcl database
Collecting - Files not opened by ASM
Collecting - Log Sequence Numbers for orcl database
Collecting - Percentage of asm disk  Imbalance
Collecting - Process for shipping Redo to standby for orcl database
Collecting - RDBMS Feature Usage for orcl database
Collecting - Redo Log information for orcl database
Collecting - Standby redo log creation status before switchover for orcl database
Collecting - /proc/cmdline
Collecting - /proc/modules
Collecting - CPU Information
Collecting - CRS active version
Collecting - CRS oifcfg
Collecting - CRS software version
Collecting - CSS Reboot time
Collecting - CSS disktimout
Collecting - Cluster interconnect (clusterware)
Collecting - Clusterware OCR healthcheck
Collecting - Clusterware Resource Status
Collecting - DiskFree Information
Collecting - DiskMount Information
Collecting - Huge pages configuration
Collecting - Interconnect network card speed
Collecting - Kernel parameters
Collecting - Maximum number of semaphore sets on system
Collecting - Maximum number of semaphores on system
Collecting - Maximum number of semaphores per semaphore set
Collecting - Memory Information
Collecting - NUMA Configuration
Collecting - Network Interface Configuration
Collecting - Network Performance
Collecting - Network Service Switch
Collecting - OS Packages
Collecting - OS version
Collecting - Operating system release information and kernel version
Collecting - Oracle Executable Attributes
Collecting - Patches for Grid Infrastructure
Collecting - Patches for RDBMS Home
Collecting - Shared memory segments
Collecting - Table of file system defaults
Collecting - Voting disks (clusterware)
Collecting - number of semaphore operations per semop system call
Preparing to run root privileged commands  oel6-112-rac1.  Please enter root password when prompted.
root@oel6-112-rac1's password:

Data collections completed. Checking best practices on oel6-112-rac1.
--------------------------------------------------------------------------------------
 WARNING => SYS.AUDSES$ sequence cache size < 10,000 for orcl
 WARNING => Without ARCHIVELOG mode the database cannot be recovered from an online backup and Data Guard cannot be used. for orcl
 WARNING => OCR is NOT being backed up daily
 INFO =>    $CRS_HOME/log/hostname/client directory has too many older log files.
 INFO =>    user_dump_dest has trace files older than 30 days for orcl
 INFO =>    ORA-07445 errors found in alert log for orcl
 INFO =>    background_dump_dest has files older than 30 days for orcl
 INFO =>    Some tablespaces do not have allocation type as SYSTEM for orcl
 INFO =>    At some times checkpoints are not being completed for orcl
 INFO =>    audit_file_dest has audit files older than 30 days for orcl
 WARNING => Controlfile is NOT multiplexed for orcl
 WARNING => One or more redo log groups are NOT multiplexed for orcl
 WARNING => /tmp is NOT on a dedicated filesystem
 WARNING => Shell limit soft nproc for DB is NOT configured according to recommendation
 FAIL =>    Operating system hugepages count does not satisfy total SGA requirements
 WARNING => NIC bonding is not configured for interconnect
 WARNING => NIC bonding is NOT configured for public network (VIP)
 WARNING => OSWatcher is not running as is recommended.
 INFO =>    Jumbo frames (MTU >= 8192) are not configured for interconnect
 FAIL =>    Database parameter DB_LOST_WRITE_PROTECT is NOT set to recommended value on orcl1 instance
 WARNING => Database parameter DB_BLOCK_CHECKING on PRIMARY is NOT set to the recommended value. for orcl
 FAIL =>    Flashback on PRIMARY is not configured for orcl
 INFO =>    Operational Best Practices
 INFO =>    Database Consolidation Best Practices
 INFO =>    Computer failure prevention best practices
 INFO =>    Data corruption prevention best practices
 INFO =>    Logical corruption prevention best practices
 INFO =>    Database/Cluster/Site failure prevention best practices
 INFO =>    Client failover operational best practices
 FAIL =>    Some bigfile tablespaces do not have non-default maxbytes values set for orcl
 WARNING => fast_start_mttr_target should be greater than or equal to 300. on orcl1 instance
 INFO =>    Information about hanganalyze and systemstate dump
 WARNING => Package unixODBC-2.2.14-11.el6-i686 is recommended but NOT installed
 WARNING => Package unixODBC-devel-2.2.14-11.el6-i686 is recommended but NOT installed
 FAIL =>    Table AUD$[FGA_LOG$] should use Automatic Segment Space Management for orcl
 INFO =>    Database failure prevention best practices
 WARNING => Database Archivelog Mode should be set to ARCHIVELOG for orcl
 FAIL =>    Primary database is NOT protected with Data Guard (standby database) for real-time data protection and availability for orcl
 WARNING => Redo log write time is more than 500 milliseconds for orcl
 WARNING => TFA Collector is either not installed or not running
 WARNING => Package unixODBC-devel-2.2.14-11.el6-x86_64 is recommended but NOT installed
 WARNING => Linux transparent huge pages are enabled
 WARNING => vm.min_free_kbytes should be set as recommended.
 INFO =>    Oracle recovery manager(rman) best practices
 WARNING => RMAN controlfile autobackup should be set to ON for orcl
 WARNING => Linux Disk I/O Scheduler should be configured to [Deadline]
 INFO =>    Consider increasing the COREDUMPSIZE size
 INFO =>    Consider investigating the frequency of SGA resize operations and take corrective action for orcl
 WARNING => Shell limit soft stack for DB is not configured according to recommendation

Best Practice checking completed.Checking recommended patches on oel6-112-rac1.
---------------------------------------------------------------------------------
Collecting patch inventory on  CRS HOME /u01/app/12.1.0/grid
Collecting patch inventory on ORACLE_HOME /u01/app/oracle/product/12.1.0/db_1
---------------------------------------------------------------------------------
1 Recommended CRS patches for 121010 from /u01/app/12.1.0/grid on oel6-112-rac1
---------------------------------------------------------------------------------
Patch#   CRS  ASM    RDBMS RDBMS_HOME                              Patch-Description
---------------------------------------------------------------------------------
18139660  no          no  /u01/app/oracle/product/12.1.0/db_1GRID INFRASTRUCTURE SYSTEM PATCH 12.1.0.1.3
---------------------------------------------------------------------------------

---------------------------------------------------------------------------------
1 Recommended RDBMS patches for 121010 from /u01/app/oracle/product/12.1.0/db_1 on oel6-112-rac1
---------------------------------------------------------------------------------
Patch#   RDBMS    ASM     type                Patch-Description
---------------------------------------------------------------------------------
18139660  no             merge               GRID INFRASTRUCTURE SYSTEM PATCH 12.1.0.1.3
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------

---------------------------------------------------------------------------------
              Clusterware patches summary report
---------------------------------------------------------------------------------
Total patches  Applied on CRS Applied on RDBMS Applied on ASM
---------------------------------------------------------------------------------
1              0              0                0
---------------------------------------------------------------------------------

---------------------------------------------------------------------------------
              RDBMS homes patches summary report
---------------------------------------------------------------------------------
Total patches  Applied on RDBMS Applied on ASM ORACLE_HOME
---------------------------------------------------------------------------------
 1              0              0                /u01/app/oracle/product/12.1.0/db_1
---------------------------------------------------------------------------------

=============================================================
                    Node name - oel6-112-rac2
=============================================================

Collecting - /proc/cmdline
Collecting - /proc/modules
Collecting - CPU Information
Collecting - CRS active version
Collecting - CRS oifcfg
Collecting - CRS software version
Collecting - Cluster interconnect (clusterware)
Collecting - DiskFree Information
Collecting - DiskMount Information
Collecting - Huge pages configuration
Collecting - Interconnect network card speed
Collecting - Kernel parameters
Collecting - Maximum number of semaphore sets on system
Collecting - Maximum number of semaphores on system
Collecting - Maximum number of semaphores per semaphore set
Collecting - Memory Information
Collecting - NUMA Configuration
Collecting - Network Interface Configuration
Collecting - Network Performance
Collecting - Network Service Switch
Collecting - OS Packages
Collecting - OS version
Collecting - Operating system release information and kernel version
Collecting - Oracle Executable Attributes
Collecting - Patches for Grid Infrastructure
Collecting - Patches for RDBMS Home
Collecting - Shared memory segments
Collecting - Table of file system defaults
Collecting - number of semaphore operations per semop system call
Preparing to run root privileged commands  oel6-112-rac2.  Please enter root password when prompted.
root@oel6-112-rac2's password:
Collecting - Broadcast Requirements for Networks
Collecting - CRS user time zone check
Collecting - Disk Information
Collecting - Grid Infastructure user shell limits configuration
Collecting - Interconnect interface config
Collecting - Network interface stats
Collecting - Number of RDBMS LMS running in real time
Collecting - OLR Integrity
Collecting - Root user limits
Collecting - Verify no database server kernel out of memory errors
Collecting - root time zone check
Collecting - slabinfo

Data collections completed. Checking best practices on oel6-112-rac2.
-------------------------------------------------------------------------------------
 INFO =>    $CRS_HOME/log/hostname/client directory has too many older log files.
 INFO =>    user_dump_dest has trace files older than 30 days for orcl
 INFO =>    background_dump_dest has files older than 30 days for orcl
 INFO =>    audit_file_dest has audit files older than 30 days for orcl
 WARNING => /tmp is NOT on a dedicated filesystem
 WARNING => Shell limit soft nproc for DB is NOT configured according to recommendation
 FAIL =>    Operating system hugepages count does not satisfy total SGA requirements
 WARNING => NIC bonding is not configured for interconnect
 WARNING => NIC bonding is NOT configured for public network (VIP)
 WARNING => OSWatcher is not running as is recommended.
 INFO =>    Jumbo frames (MTU >= 8192) are not configured for interconnect
 FAIL =>    Database parameter DB_LOST_WRITE_PROTECT is NOT set to recommended value on orcl2 instance
 WARNING => Database parameter DB_BLOCK_CHECKING on PRIMARY is NOT set to the recommended value. for orcl
 WARNING => fast_start_mttr_target should be greater than or equal to 300. on orcl2 instance
 WARNING => Package unixODBC-2.2.14-11.el6-i686 is recommended but NOT installed
 WARNING => Package unixODBC-devel-2.2.14-11.el6-i686 is recommended but NOT installed
 WARNING => Redo log write time is more than 500 milliseconds for orcl
 WARNING => TFA Collector is either not installed or not running
 WARNING => Package unixODBC-devel-2.2.14-11.el6-x86_64 is recommended but NOT installed
 WARNING => Linux transparent huge pages are enabled
 WARNING => vm.min_free_kbytes should be set as recommended.
 WARNING => Linux Disk I/O Scheduler should be configured to [Deadline]
 INFO =>    Consider increasing the COREDUMPSIZE size
 WARNING => Shell limit hard nproc for root is NOT configured according to recommendation
 WARNING => Shell limit soft stack for DB is not configured according to recommendation

Best Practice checking completed.Checking recommended patches on oel6-112-rac2.
---------------------------------------------------------------------------------
Collecting patch inventory on  CRS HOME /u01/app/12.1.0/grid
Collecting patch inventory on ORACLE_HOME /u01/app/oracle/product/12.1.0/db_1
---------------------------------------------------------------------------------
1 Recommended CRS patches for 121010 from /u01/app/12.1.0/grid on oel6-112-rac2
---------------------------------------------------------------------------------
Patch#   CRS  ASM    RDBMS RDBMS_HOME                              Patch-Description
---------------------------------------------------------------------------------
18139660  no          no  /u01/app/oracle/product/12.1.0/db_1GRID INFRASTRUCTURE SYSTEM PATCH 12.1.0.1.3
---------------------------------------------------------------------------------

---------------------------------------------------------------------------------
1 Recommended RDBMS patches for 121010 from /u01/app/oracle/product/12.1.0/db_1 on oel6-112-rac2
---------------------------------------------------------------------------------
Patch#   RDBMS    ASM     type                Patch-Description
---------------------------------------------------------------------------------
18139660  no             merge               GRID INFRASTRUCTURE SYSTEM PATCH 12.1.0.1.3
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------

---------------------------------------------------------------------------------
              Clusterware patches summary report
---------------------------------------------------------------------------------
Total patches  Applied on CRS Applied on RDBMS Applied on ASM
---------------------------------------------------------------------------------
1              0              0                0
---------------------------------------------------------------------------------

---------------------------------------------------------------------------------
              RDBMS homes patches summary report
---------------------------------------------------------------------------------
Total patches  Applied on RDBMS Applied on ASM ORACLE_HOME
---------------------------------------------------------------------------------
 1              0              0                /u01/app/oracle/product/12.1.0/db_1
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------
                      CLUSTERWIDE CHECKS
---------------------------------------------------------------------------------
---------------------------------------------------------------------------------

Detailed report (html) - /home/oracle/orachk_oel6-112-rac1_orcl_061814_153147/orachk_oel6-112-rac1_orcl_061814_153147.html

UPLOAD(if required) - /home/oracle/orachk_oel6-112-rac1_orcl_061814_153147.zip

[oracle@oel6-112-rac1 ~]$

No comments:

Post a Comment