Introduction: While updating the patch 25031476 - Exadata Storage Server software 12.1.2.3.4 for Oracle Exadata Storage Servers BIOS and ILOM not updated properly. So, we need to poweroff and Poweron Oracle Exadata Storage Servers to update latest version of ILOM and BIOS version. Sequence of Steps: Login to Oracle Exadata Storage Server [celladmin@exp2cellser01 ~]$ cellcli Check MS, RS and Cellsrv status CellCLI> list cell detail Check griddisk status CellCLI> list griddisk DATAC1_CD_00_exp2cellser01 active DATAC1_CD_01_exp2cellser01 active DATAC1_CD_02_exp2cellser01 active DATAC1_CD_03_exp2cellser01 active DATAC1_CD_04_exp2cellser01 active DATAC1_CD_05_exp2cellser01 active DATAC1_CD_06_exp2cellser01 active DATAC1_CD_07_exp2cellser01 active DATAC1_CD_08_exp2cellser01 active DATAC1_CD_09_exp2cellser01 active DATAC1_CD_10_exp2cellser01 active DATAC1_CD_11_exp2cellser01 active DBFS_DG_CD_02_exp2cellser01 active DBFS_DG_CD_03_exp2cellser01 active DBFS_DG_CD_04_exp2cellser01 active DBFS_DG_CD_05_exp2cellser01 active DBFS_DG_CD_06_exp2cellser01 active DBFS_DG_CD_07_exp2cellser01 active DBFS_DG_CD_08_exp2cellser01 active DBFS_DG_CD_09_exp2cellser01 active DBFS_DG_CD_10_exp2cellser01 active DBFS_DG_CD_11_exp2cellser01 active RECOC1_CD_00_exp2cellser01 active RECOC1_CD_01_exp2cellser01 active RECOC1_CD_02_exp2cellser01 active RECOC1_CD_03_exp2cellser01 active RECOC1_CD_04_exp2cellser01 active RECOC1_CD_05_exp2cellser01 active RECOC1_CD_06_exp2cellser01 active RECOC1_CD_07_exp2cellser01 active RECOC1_CD_08_exp2cellser01 active RECOC1_CD_09_exp2cellser01 active RECOC1_CD_10_exp2cellser01 active RECOC1_CD_11_exp2cellser01 active CellCLI> Note: Before shutdown Oracle Exadara Storage Server, asmdeactivationoutcome should be ‘Yes’ for all the diskgroups in that Storage Server. CellCLI> list griddisk attributes name, status, asmdeactivationoutcome DATAC1_CD_00_exp2cellser01 active Yes DATAC1_CD_01_exp2cellser01 active Yes DATAC1_CD_02_exp2cellser01 active Yes DATAC1_CD_03_exp2cellser01 active Yes DATAC1_CD_04_exp2cellser01 active Yes DATAC1_CD_05_exp2cellser01 active Yes DATAC1_CD_06_exp2cellser01 active Yes DATAC1_CD_07_exp2cellser01 active Yes DATAC1_CD_08_exp2cellser01 active Yes DATAC1_CD_09_exp2cellser01 active Yes DATAC1_CD_10_exp2cellser01 active Yes DATAC1_CD_11_exp2cellser01 active Yes DBFS_DG_CD_02_exp2cellser01 active Yes DBFS_DG_CD_03_exp2cellser01 active Yes DBFS_DG_CD_04_exp2cellser01 active Yes DBFS_DG_CD_05_exp2cellser01 active Yes DBFS_DG_CD_06_exp2cellser01 active Yes DBFS_DG_CD_07_exp2cellser01 active Yes DBFS_DG_CD_08_exp2cellser01 active Yes DBFS_DG_CD_09_exp2cellser01 active Yes DBFS_DG_CD_10_exp2cellser01 active Yes DBFS_DG_CD_11_exp2cellser01 active Yes RECOC1_CD_00_exp2cellser01 active Yes RECOC1_CD_01_exp2cellser01 active Yes RECOC1_CD_02_exp2cellser01 active Yes RECOC1_CD_03_exp2cellser01 active Yes RECOC1_CD_04_exp2cellser01 active Yes RECOC1_CD_05_exp2cellser01 active Yes RECOC1_CD_06_exp2cellser01 active Yes RECOC1_CD_07_exp2cellser01 active Yes RECOC1_CD_08_exp2cellser01 active Yes RECOC1_CD_09_exp2cellser01 active Yes RECOC1_CD_10_exp2cellser01 active Yes RECOC1_CD_11_exp2cellser01 active Yes CellCLI> Shutdown and Restart of Exadata Storage Servers through ILOM Interface SSH to ILOm then run stop -f /SYS check show /SYS wait for 5 minutes after the power is down. start /SYS start /SP/console show /SYS Check cellcli - asmmodestatus a. Login to Storage Server b. cellcli -e list cell detail [celladmin@exp2cellser01 ~]$ cellcli -e list griddisk attributes name, asmmodestatus DATAC1_CD_00_exp2cellser01 ONLINE DATAC1_CD_01_exp2cellser01 ONLINE DATAC1_CD_02_exp2cellser01 ONLINE DATAC1_CD_03_exp2cellser01 ONLINE DATAC1_CD_04_exp2cellser01 ONLINE DATAC1_CD_05_exp2cellser01 ONLINE DATAC1_CD_06_exp2cellser01 ONLINE DATAC1_CD_07_exp2cellser01 ONLINE DATAC1_CD_08_exp2cellser01 ONLINE DATAC1_CD_09_exp2cellser01 ONLINE DATAC1_CD_10_exp2cellser01 ONLINE DATAC1_CD_11_exp2cellser01 ONLINE DBFS_DG_CD_02_exp2cellser01 ONLINE DBFS_DG_CD_03_exp2cellser01 ONLINE DBFS_DG_CD_04_exp2cellser01 ONLINE DBFS_DG_CD_05_exp2cellser01 ONLINE DBFS_DG_CD_06_exp2cellser01 ONLINE DBFS_DG_CD_07_exp2cellser01 ONLINE DBFS_DG_CD_08_exp2cellser01 ONLINE DBFS_DG_CD_09_exp2cellser01 ONLINE DBFS_DG_CD_10_exp2cellser01 ONLINE DBFS_DG_CD_11_exp2cellser01 ONLINE RECOC1_CD_00_exp2cellser01 SYNCING RECOC1_CD_01_exp2cellser01 SYNCING RECOC1_CD_02_exp2cellser01 SYNCING RECOC1_CD_03_exp2cellser01 SYNCING RECOC1_CD_04_exp2cellser01 SYNCING RECOC1_CD_05_exp2cellser01 SYNCING RECOC1_CD_06_exp2cellser01 SYNCING RECOC1_CD_07_exp2cellser01 SYNCING RECOC1_CD_08_exp2cellser01 SYNCING RECOC1_CD_09_exp2cellser01 SYNCING RECOC1_CD_10_exp2cellser01 SYNCING RECOC1_CD_11_exp2cellser01 SYNCING [celladmin@exp2cellser01 ~]$ d. cellcli -e list griddisk Note-1: Waiting the status to change from SYNCING to ONLINE Note-2: Wait for grid disks to SYNC and then move on to next cell server. Alertlog: Published: 12 events ASM ONLINE disk of opcode 3 for diskgroup DATAC1 to: ClientHostName = exp2dbadm01, ClientPID = 333592 Published: 10 events ASM ONLINE disk of opcode 3 for diskgroup DBFS_DG to: ClientHostName = exp2dbadm03, ClientPID = 344462 Published: 12 events ASM ONLINE disk of opcode 3 for diskgroup RECOC1 to: ClientHostName = exp2dbadm04, ClientPID = 291317 2017-04-22 20:30:26.835000 -04:00 Published: 12 events ASM OFFLINE disk due to shutdown of opcode 49 for diskgroup DATAC1 to: ClientHostName = exp2dbadm03, ClientPID = 344462 Published: 10 events ASM OFFLINE disk due to shutdown of opcode 49 for diskgroup DBFS_DG to: ClientHostName = exp2dbadm01, ClientPID = 333592 Published: 12 events ASM OFFLINE disk due to shutdown of opcode 49 for diskgroup RECOC1 to: ClientHostName = exp2dbadm04, ClientPID = 291317 2017-04-22 20:59:29.564000 -04:00 RS version=12.1.2.3.4,label=OSS_12.1.2.3.4_LINUX.X64_170111,Thu_Jan_12_01:51:41_PST_2017 [RS] Started Service RS_MAIN with pid 19853 [RS] Kill previous monitoring processes for RS_BACKUP, MS and CELLSRV [RS] Started monitoring process /opt/oracle/cell/cellsrv/bin/cellrsbmt with pid 19860 [RS] Started monitoring process /opt/oracle/cell/cellsrv/bin/cellrsmmt with pid 19861 [RS] Started monitoring process /opt/oracle/cell/cellsrv/bin/cellrsomt with pid 19862 RSBK version=12.1.2.3.4,label=OSS_12.1.2.3.4_LINUX.X64_170111,Thu_Jan_12_01:51:41_PST_2017 [RS] Started Service RS_BACKUP with pid 19863 [RS] Kill previous monitoring process for core RS [RS] Started monitoring process /opt/oracle/cell/cellsrv/bin/cellrssmt with pid 19874 CELL process id=19867 CELL host name=exp2cellser01 CELL version=12.1.2.3.4,label=OSS_12.1.2.3.4_LINUX.X64_170111,Thu_Jan_12_01:51:48_PST_2017 CELLSRV version md5: e4bd28a1a5d53d2d9e1e5e66fe3ca512 OS Stats: Physical memory: 128618 MB. Num cores: 40 CELLSRV configuration parameters: Memory reserved for cellsrv: 125718 MB Memory for other processes: 2900 MB _cell_fc_persistence_state=WriteBack Successfully allocated 6400 MB for Storage Index. Storage Index memory usage can grow up to a maximum of 12571 MB. CELL communication is configured to use 2 interface(s): 192.168.10.108 192.168.10.109 IPC version: Oracle RDS/IP (generic) IPC Vendor 1 Protocol 3 Version 4.1 2017-04-22 20:59:30.753000 -04:00 MS_ALERT HUGEPAGE CLEAR 2017-04-22 20:59:32.750000 -04:00 Cellsrv Incarnation is set: 11 CellDisk v0.10 name=FD_02_exp2cellser01 guid=41f081d1-e580-45bc-b058-c9ff1ce31e27 dev=/dev/nvme0n1 status=NORMAL CellDisk v0.10 name=FD_01_exp2cellser01 guid=52f98ef1-28c6-4be9-ba8a-777f94a6925e dev=/dev/nvme2n1 status=NORMAL CellDisk v0.10 name=FD_00_exp2cellser01 guid=bf804521-a5e6-4f2e-928e-0ec878e3b551 dev=/dev/nvme3n1 status=NORMAL CellDisk v0.10 name=FD_03_exp2cellser01 guid=b00c9032-5da6-4377-a50d-cc9229bcdf3a dev=/dev/nvme1n1 status=NORMAL CellDisk v0.10 name=CD_03_exp2cellser01 guid=d1e09adf-9688-4293-bf38-df2542bf0920 dev=/dev/sdd status=NORMAL CellDisk v0.10 name=CD_02_exp2cellser01 guid=792e1944-016f-4491-b3c0-340779fddef3 dev=/dev/sdc status=NORMAL GridDisk name=RECOC1_CD_03_exp2cellser01 guid=3fcdbb3a-11a4-4e8d-9012-3a9191dc393a (3382660076) status=GDISK_ACTIVE GridDisk name=DATAC1_CD_03_exp2cellser01 guid=2e3db2a3-c462-4b7b-84ce-010b03738ea3 (2295850524) status=GDISK_ACTIVE cached by FlashCache: 144184636 GridDisk name=DBFS_DG_CD_03_exp2cellser01 guid=038d6e98-bb78-4b65-a338-8f1edfab3983 (3035701804) status=GDISK_ACTIVE cached by FlashCache: 144184636 GridDisk name=RECOC1_CD_02_exp2cellser01 guid=1d29cf2f-2073-4c13-be42-4641b9b5144e (2010707748) status=GDISK_ACTIVE GridDisk name=DATAC1_CD_02_exp2cellser01 guid=63099498-4938-4bef-b0bc-aeb642404bcc (4031275892) status=GDISK_ACTIVE cached by FlashCache: 3909900404 GridDisk name=DBFS_DG_CD_02_exp2cellser01 guid=611830f9-8c9c-4c44-acf3-5d024aa672a8 (3860942228) status=GDISK_ACTIVE cached by FlashCache: 3909900404 CellDisk v0.10 name=CD_09_exp2cellser01 guid=f58aedf9-fe59-4b07-8517-5f9f8393d267 dev=/dev/sdj status=NORMAL CellDisk v0.10 name=CD_06_exp2cellser01 guid=8a11c6a2-4394-43b2-8b8f-8fb8606872ac dev=/dev/sdg status=NORMAL CellDisk v0.10 name=CD_04_exp2cellser01 guid=31417d0b-4bb7-4737-b244-dd149bcdcdc1 dev=/dev/sde status=NORMAL GridDisk name=RECOC1_CD_09_exp2cellser01 guid=48239cd3-12ce-43dd-8f60-efb4f72235b1 (2254531732) status=GDISK_ACTIVE CellDisk v0.10 name=CD_07_exp2cellser01 guid=d26dea0e-d7e4-4bf3-a9ad-8db306fd1ff7 dev=/dev/sdh status=NORMAL GridDisk name=DATAC1_CD_09_exp2cellser01 guid=29aff2d4-ac2a-4931-979b-1452393e1e7f (1494348060) status=GDISK_ACTIVE cached by FlashCache: 1071653524 GridDisk name=DBFS_DG_CD_09_exp2cellser01 guid=f5a277d1-07a2-49b3-a843-29b6a8c6c76b (3693027468) status=GDISK_ACTIVE cached by FlashCache: 1071653524 GridDisk name=RECOC1_CD_06_exp2cellser01 guid=f6810b96-1967-4242-93fa-bd8792b3138a (3216602924) status=GDISK_ACTIVE GridDisk name=DATAC1_CD_06_exp2cellser01 guid=da486922-7051-4e78-84b7-cfd8682468c6 (3872160012) status=GDISK_ACTIVE cached by FlashCache: 3909900404 GridDisk name=DBFS_DG_CD_06_exp2cellser01 guid=adebbe43-0715-4c57-acd6-a3dcc5cb06c4 ( 391051324) status=GDISK_ACTIVE cached by FlashCache: 3909900404 GridDisk name=RECOC1_CD_04_exp2cellser01 guid=f2d3112b-a8c2-4c2d-b193-b20307500fa2 ( 722897908) status=GDISK_ACTIVE GridDisk name=DATAC1_CD_04_exp2cellser01 guid=29eff557-2200-459a-9e09-1fb4e5133b5a (1927686076) status=GDISK_ACTIVE cached by FlashCache: 144184636 GridDisk name=DBFS_DG_CD_04_exp2cellser01 guid=0653d6c1-6433-4c5e-9a1c-1507365533a1 (2211506908) status=GDISK_ACTIVE cached by FlashCache: 144184636 GridDisk name=RECOC1_CD_07_exp2cellser01 guid=185923d6-1062-470d-9fc1-9e7209909dce (1752228692) status=GDISK_ACTIVE GridDisk name=DATAC1_CD_07_exp2cellser01 guid=18f75204-fea4-40fc-a726-590e4b6cd205 (3985897548) status=GDISK_ACTIVE cached by FlashCache: 390767876 GridDisk name=DBFS_DG_CD_07_exp2cellser01 guid=042ff207-1c59-4378-9dc2-b5180ed835d0 (4254859964) status=GDISK_ACTIVE cached by FlashCache: 390767876 CellDisk v0.10 name=CD_05_exp2cellser01 guid=dcdad52f-9754-4732-9582-ed6ae1ff6224 dev=/dev/sdf status=NORMAL CellDisk v0.10 name=CD_10_exp2cellser01 guid=30f88892-2c3a-48f3-9552-3f5b8a0aa26f dev=/dev/sdk status=NORMAL CellDisk v0.10 name=CD_08_exp2cellser01 guid=c4dbf950-e2c8-4d9b-a97f-f8a2fcc47c7b dev=/dev/sdi status=NORMAL GridDisk name=RECOC1_CD_05_exp2cellser01 guid=c26bc482-e4a9-4c1b-8136-e69f53bee904 (4074799916) status=GDISK_ACTIVE CellDisk v0.10 name=CD_01_exp2cellser01 guid=56d81ff3-d44d-4687-ba6d-8a1b97bab34a dev=/dev/sdb3 status=NORMAL GridDisk name=DATAC1_CD_05_exp2cellser01 guid=151695fb-9564-4137-91f3-d7e06935fdfe (2058527788) status=GDISK_ACTIVE cached by FlashCache: 390767876 GridDisk name=DBFS_DG_CD_05_exp2cellser01 guid=58456fb0-9fdc-4583-927f-1193a2bb9f20 (1314698676) status=GDISK_ACTIVE cached by FlashCache: 390767876 GridDisk name=RECOC1_CD_10_exp2cellser01 guid=4b14b557-ab26-4174-a2f0-67aeb08c6ddc (3007942876) status=GDISK_ACTIVE GridDisk name=DATAC1_CD_10_exp2cellser01 guid=5f3a084a-d97a-4c05-82e1-6f1132719ee3 (2963687100) status=GDISK_ACTIVE cached by FlashCache: 1071653524 GridDisk name=DBFS_DG_CD_10_exp2cellser01 guid=35d3112b-645b-4e4e-8f88-9baa8ad0e566 (1449712116) status=GDISK_ACTIVE cached by FlashCache: 1071653524 GridDisk name=RECOC1_CD_08_exp2cellser01 guid=90b53813-492a-478e-84f6-d690d799dc8c (1467455180) status=GDISK_ACTIVE GridDisk name=DATAC1_CD_08_exp2cellser01 guid=41c73862-7da8-4d48-9b52-e5a568f3ea43 ( 609209124) status=GDISK_ACTIVE cached by FlashCache: 390767876 GridDisk name=DBFS_DG_CD_08_exp2cellser01 guid=8ed02352-6126-46e2-99a5-5e36b078f62d ( 221297292) status=GDISK_ACTIVE cached by FlashCache: 390767876 GridDisk name=RECOC1_CD_01_exp2cellser01 guid=80eff78a-dd57-4b47-bd20-ac303a8a0933 ( 771870308) status=GDISK_ACTIVE GridDisk name=DATAC1_CD_01_exp2cellser01 guid=6537f7da-0693-440e-ab26-e8825381956d (3479777268) status=GDISK_ACTIVE cached by FlashCache: 144184636 CellDisk v0.10 name=CD_11_exp2cellser01 guid=90b6f932-7c23-49f4-bf4c-9e08bb65fef2 dev=/dev/sdl status=NORMAL GridDisk name=RECOC1_CD_11_exp2cellser01 guid=aed6c99e-a9ec-477d-932e-3a572bda8c9d (3107202132) status=GDISK_ACTIVE GridDisk name=DATAC1_CD_11_exp2cellser01 guid=a1b471f9-5d6b-44b6-bdfb-00597dcc144a (1588989724) status=GDISK_ACTIVE cached by FlashCache: 1071653524 GridDisk name=DBFS_DG_CD_11_exp2cellser01 guid=ac845edb-253f-4312-9e10-79595d9169e2 ( 641647404) status=GDISK_ACTIVE cached by FlashCache: 1071653524 CellDisk v0.10 name=CD_00_exp2cellser01 guid=ffbf0f44-1474-4bf6-a6bc-d05df0465979 dev=/dev/sda3 status=NORMAL GridDisk name=RECOC1_CD_00_exp2cellser01 guid=36190c48-b89e-46c6-b8d7-d21f1c959ac6 (3904486924) status=GDISK_ACTIVE GridDisk name=DATAC1_CD_00_exp2cellser01 guid=5b50dc4b-9cc2-430c-99c0-505e31be7cc2 (2544290724) status=GDISK_ACTIVE cached by FlashCache: 3909900404 2017-04-22 20:59:41.317000 -04:00 Smart Flash Caching enabled on FlashCache FC-FD_00_exp2cellser01 guid=54ba6a06-852d-4b11-9ce0-82fec68b4a62 (1071653524) size=2980GB cdisk=FD_00_exp2cellser01 Smart Flash Caching enabled on FlashCache FC-FD_02_exp2cellser01 guid=0d35cbc7-6702-4c1e-8077-83f785a499d5 ( 390767876) size=2980GB cdisk=FD_02_exp2cellser01 Smart Flash Caching enabled on FlashCache FC-FD_03_exp2cellser01 guid=ec9d49e6-063d-4e24-b6b6-18eb7ff6dfaf ( 144184636) size=2980GB cdisk=FD_03_exp2cellser01 Smart Flash Caching enabled on FlashCache FC-FD_01_exp2cellser01 guid=de7f8d29-5947-4803-ad4c-d15a5e40ea62 (3909900404) size=2980GB cdisk=FD_01_exp2cellser01 FlashLog FL-FD_00_exp2cellser01 guid=42914cb2-62a9-400f-b50f-395b9d38def0 ( 580904564) cdisk=FD_00_exp2cellser01 is being recovered Smart Flash Logging ENABLED on FlashLog FL-FD_00_exp2cellser01 guid=42914cb2-62a9-400f-b50f-395b9d38def0 ( 580904564) size=128MB cdisk=FD_00_exp2cellser01 FlashLog FL-FD_01_exp2cellser01 guid=db1d3b31-a934-4cc0-b1fe-45c62d0fcac5 (3406766740) cdisk=FD_01_exp2cellser01 is being recovered FlashLog FL-FD_02_exp2cellser01 guid=a2feb2a8-622c-46e6-aa65-1e24cc42af90 (2463701044) cdisk=FD_02_exp2cellser01 is being recovered Smart Flash Logging ENABLED on FlashLog FL-FD_02_exp2cellser01 guid=a2feb2a8-622c-46e6-aa65-1e24cc42af90 (2463701044) size=128MB cdisk=FD_02_exp2cellser01 Smart Flash Logging ENABLED on FlashLog FL-FD_01_exp2cellser01 guid=db1d3b31-a934-4cc0-b1fe-45c62d0fcac5 (3406766740) size=128MB cdisk=FD_01_exp2cellser01 FlashLog FL-FD_03_exp2cellser01 guid=dcf39aec-4914-4e43-9b46-90a7971c303f ( 249645220) cdisk=FD_03_exp2cellser01 is being recovered Smart Flash Logging ENABLED on FlashLog FL-FD_03_exp2cellser01 guid=dcf39aec-4914-4e43-9b46-90a7971c303f ( 249645220) size=128MB cdisk=FD_03_exp2cellser01 Sat Apr 22 20:59:41 2017 CELLSRV Server startup complete Heartbeat with diskmon (pid 325328) started on exp2dbadm03 Heartbeat with diskmon (pid 316734) started on exp2dbadm01 Heartbeat with diskmon (pid 206116) started on exp2dbadm04 Heartbeat with diskmon (pid 386039) started on exp2dbadm02 2017-04-22 20:59:45.396000 -04:00 [RS] Started Service CELLSRV with pid 19867 Successfully registered pkg cellofl-12.1.2.3.4_LINUX.X64_170111 2017-04-22 20:59:46.681000 -04:00 [RS] Started Service MS with pid 19959 2017-04-22 20:59:48.313000 -04:00 Successfully registered pkg cellofl-11.2.3.3.1_LINUX.X64_151006 2017-04-22 20:59:49.422000 -04:00 All offload packages have been successfully registered [RS] Starting offload server with pid 32595 for group SYS_121234_170111, package cellofl-12.1.2.3.4_LINUX.X64_170111 [RS] Starting offload server with pid 32605 for group SYS_112331_151006, package cellofl-11.2.3.3.1_LINUX.X64_151006 2017-04-22 20:59:53.405000 -04:00 [RS] Offload server with pid 32595 for group SYS_121234_170111, package cellofl-12.1.2.3.4_LINUX.X64_170111 successfully started MS_ALERT OFFLOADGROUP_STATEFUL CLEAR SYS_121234_170111 2017-04-22 20:59:55.406000 -04:00 [RS] Offload server with pid 32605 for group SYS_112331_151006, package cellofl-11.2.3.3.1_LINUX.X64_151006 successfully started MS_ALERT OFFLOADGROUP_STATEFUL CLEAR SYS_112331_151006 Alert from Oracle Exadata Database Machine for BIOS and ILOMNote: Cell name removed for security reasons. Conclusion: After restart Oracle Exadata Storage Servers, ILOM and BIOS updated with latest version.
Saturday, April 29, 2017
ILOM and BIOS update: Oracle Exadata Database Machine (x6-2)
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment