MetaDB Corruptions

hans-karri-sc1:sms-svc:1> reset -x -d h

Do you want to send XIR to domain H: (yes/no)? yes
XIR to processor SB1/P0 initiated
XIR to processor SB1/P1 initiated
XIR to processor SB1/P2 initiated
XIR to processor SB1/P3 initiated
XIR initiated to all the ports for domain: H

hans-karri-sc1:sms-svc:2> console -d h
Trying to connect…
Connected to Domain Server.

Exclusive session is in use, disconnecting.

hans-karri-sc1:sms-svc:3> ps -ef | grep -i console
root 13319 1 0 Jul 09 console 0:00 /usr/lib/saf/ttymon -g -h -p hans-karri-sc1 console login: -T vt100 -d /dev/consol
sms-svc 6769 1765 0 17:23:28 pts/3 0:00 console -d h

hans-karri-sc1:sms-svc:4> kill 6769

hans-karri-sc1:sms-svc:5> console -d h
Trying to connect…
Connected to Domain Server.
Your console is in exclusive mode now.

Connection closed – console exit.
hans-karri-sc1:sms-svc:7> showplatform

PLATFORM:
=========
Platform Type: Sun Fire E25K

CSN:
====
Chassis Serial Number: 0705AK2047

COD:
====
Chassis HostID: 5017341Y0B9NS
Proc RTUs installed: 0
PROC Headroom Quantity: 0
Proc RTUs reserved for domain A: 0
Proc RTUs reserved for domain B: 0
Proc RTUs reserved for domain C: 0
Proc RTUs reserved for domain D: 0
Proc RTUs reserved for domain E: 0
Proc RTUs reserved for domain F: 0
Proc RTUs reserved for domain G: 0
Proc RTUs reserved for domain H: 0
Proc RTUs reserved for domain I: 0
Proc RTUs reserved for domain J: 0
Proc RTUs reserved for domain K: 0
Proc RTUs reserved for domain L: 0
Proc RTUs reserved for domain M: 0
Proc RTUs reserved for domain N: 0
Proc RTUs reserved for domain O: 0
Proc RTUs reserved for domain P: 0
Proc RTUs reserved for domain Q: 0
Proc RTUs reserved for domain R: 0

hans-karri-sc1:sms-svc:8> console -d h
Trying to connect…
Connected to Domain Server.
Your console is in exclusive mode now.
The dxs disconnected.
Trying to connect…
Connected to Domain Server.
Your console is in exclusive mode now.

Sun Fire E25K, using IOSRAM based Console
Copyright 2005 Sun Microsystems, Inc. All rights reserved.
OpenBoot 4.21.0, 16384 MB memory installed, Serial #44703051.
Ethernet address 0:0:be:aa:1d:4b, Host ID: 82aa1d4b.

Boot device: rootdisk File and args:
SunOS Release 5.9 Version Generic_122300-08 64-bit
Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.
Use is subject to license terms.
NOTICE: Kernel Cage Splitting is ENABLED
WARNING: /pci@bc,700000/pci@1/pci@1/scsi@2,1 (glm3):
Disconnected tagged cmd(s) (1) timeout for Target 10.0
WARNING: /pci@bc,700000/pci@1/pci@1/scsi@2,1 (glm3):
Disconnected tagged cmd(s) (1) timeout for Target 10.0
WARNING: /pci@bc,700000/pci@1/pci@1/scsi@2,1 (glm3):
Disconnected tagged cmd(s) (1) timeout for Target 10.0
ERROR: Externally Initiated Reset has occurred.

ERROR: Last Trap: Externally Initiated Reset

{20} ok show-disks
a) /pci@bd,600000/SUNW,emlxs@1,1/fp@0,0/disk
b) /pci@bd,600000/SUNW,emlxs@1/fp@0,0/disk
c) /pci@bc,700000/pci@1/pci@1/scsi@2,1/disk
d) /pci@bc,700000/pci@1/pci@1/scsi@2/disk
e) /pci@3d,600000/SUNW,emlxs@1,1/fp@0,0/disk
f) /pci@3d,600000/SUNW,emlxs@1/fp@0,0/disk
g) /pci@3c,700000/pci@1/pci@1/scsi@2,1/disk
h) /pci@3c,700000/pci@1/pci@1/scsi@2/disk
q) NO SELECTION
Enter Selection, q to quit: q

{20} ok devalias
net /pci@3c,70.0000/network@3,1
man-net /pci@3c,70.0000/network@3,1
rootdisk /pci@3c,700000/pci@1/pci@1/scsi@2,1/disk@a,0:a
rootmirror /pci@bc,700000/pci@1/pci@1/scsi@2,1/disk@a,0:a
umiboot /pci@3c,700000/pci@1/pci@1/network@0
name aliases

{20} ok printenv
Variable Name Value Default Value

local-mac-address? true false
silent-mode? false false
scsi-initiator-id 7 7
ansi-terminal? true true
screen-#columns 80 80
screen-#rows 34 34
oem-logo No default
oem-logo? false false
oem-banner No default
oem-banner? false false
error-reset-recovery boot boot
diag-level min min
load-base 16384 16384
network-boot-arguments
boot-command boot boot
diag-file
diag-device net net
boot-file
boot-device rootdisk rootmirror disk net
nvramrc devalias umiboot /pci@3c …
security-password No default
security-#badlogins 0 No default
security-mode none No default
use-nvramrc? true false
fcode-debug? false false
auto-boot? true false
diag-switch? false false

{20} ok boot -sv
Resetting…

Rebooting with command: boot -sv
Boot device: /pci@3c,700000/pci@1/pci@1/scsi@2,1/disk@a,0:a File and args: -sv
The boot filesystem is logging.
The ufs log is empty and will not be used.
Size: 0x6171b+0x2537d+0x6f457 Bytes
SunOS Release 5.9 Version Generic_122300-08 64-bit
Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.
Use is subject to license terms.
NOTICE: VxVM vxdmp V-5-0-34 added disk array DISKS, datype = Disk

NOTICE: VxVM vxdmp V-5-0-34 added disk array 101916, datype = EMC

NOTICE: VxVM vxdmp V-5-3-1700 dmpnode 287/0x0 has migrated from enclosure FAKE_ENCLR_SNO to enclosure DISKS

VxVM sysboot INFO V-5-2-3390 Starting restore daemon…
wrsm0 at root: SAFARI 0xffff 0x0
wrsm0 is /wrsm@ffff,0
pseudo-device: wrsm100

e_ddi_get_dev_info: Illegal major device number <-1>dump on /dev/md/dsk/d1 size 16386 MB
e_ddi_get_dev_info: Illegal major device number <-1>e_ddi_get_dev_info: Illegal major device number <-1>VxVM vxvm-startup2 INFO V-5-2-503 VxVM general startup…
WARNING: /pci@bd,600000/SUNW,emlxs@1/fp@0,0/ssd@w5006048452a6a70c,e34 (ssd40):
Error for Command: read(10) Error Level: Retryable
Requested Block: 288 Error Block: 288
Vendor: EMC Serial Number: 164CD000a
Sense Key: Unit Attention
ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x0
————————————
————————————
Sense Key: Unit Attention
ASC: 0x29 (power on, reset, or bus reset occurred), ASCQ: 0x0, FRU: 0x0
pseudo-device: fcsm0
fcsm0 is /pseudo/fcsm@0

INIT: SINGLE USER MODE

Type control-d to proceed with normal startup,
(or give root password for system maintenance):
————-
—————–
WARNING: Access to this computer system is limited to authorised users only.
Unauthorised users may be subject to prosecution under the Crimes
Act or State legislation.

Please note, ALL CUSTOMER DETAILS are confidential and must not be
disclosed.
You have new mail.
hans-karri $ who -r
. run-level S Aug 7 01:07 S 0 ?
hans-karri $ df -k
Filesystem kbytes used avail capacity Mounted on
/dev/md/dsk/d0 8263373 5133447 3047293 63% /
/proc 0 0 0 0% /proc
mnttab 0 0 0 0% /etc/mnttab
/dev/md/dsk/d3 8263373 1990857 6189883 25% /var
swap 30233728 0 30233728 0% /var/run
dmpfs 30233728 0 30233728 0% /dev/vx/dmp
dmpfs 30233728 0 30233728 0% /dev/vx/rdmp
hans-karri $ echo | format
Searching for disks…done
AVAILABLE DISK SELECTIONS:
0. c0t8d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@3c,700000/pci@1/pci@1/scsi@2/sd@8,0
1. c0t9d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@3c,700000/pci@1/pci@1/scsi@2/sd@9,0
2. c1t10d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@3c,700000/pci@1/pci@1/scsi@2,1/sd@a,0
3. c1t11d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@3c,700000/pci@1/pci@1/scsi@2,1/sd@b,0
4. c2t8d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@bc,700000/pci@1/pci@1/scsi@2/sd@8,0
5. c2t9d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
Specify disk (enter its number): Specify disk (enter its number):

hans-karri $ metastat -p
d4 -m d14 d24 1
d14 1 1 c1t10d0s4
d24 1 1 c3t10d0s4
d3 -m d13 d23 1
d13 1 1 c1t10d0s3
d23 1 1 c3t10d0s3
d1 -m d11 d21 1
d11 1 1 c1t10d0s1
d21 1 1 c3t10d0s1
d0 -m d10 d20 1
d10 1 1 c1t10d0s0
d20 1 1 c3t10d0s0
d55 -p d5 -o 30081248 -b 225280
d5 -m d15 d25 1
d15 1 1 c1t10d0s5
d25 1 1 c3t10d0s5
d54 -p d5 -o 27828416 -b 2252800
d53 -p d5 -o 26701984 -b 1126400
d36 -p d5 -o 16216192 -b 10485760
d35 -p d5 -o 5730400 -b 10485760
d52 -p d5 -o 4194368 -b 1536000
d50 -p d5 -o 32 -b 4194304

hans-karri $ metadb -i
flags first blk block count
a m p luo 16 8192 /dev/dsk/c1t10d0s7
a p luo 8208 8192 /dev/dsk/c1t10d0s7
a p luo 16400 8192 /dev/dsk/c1t10d0s7
a p luo 16 8192 /dev/dsk/c1t11d0s7
a p luo 8208 8192 /dev/dsk/c1t11d0s7
a p luo 16400 8192 /dev/dsk/c1t11d0s7
M p 16 unknown /dev/dsk/c3t10d0s7
M p 8208 unknown /dev/dsk/c3t10d0s7 here is the problem
M p 16400 unknown /dev/dsk/c3t10d0s7
a p luo 16 8192 /dev/dsk/c3t11d0s7
a p luo 8208 8192 /dev/dsk/c3t11d0s7
a p luo 16400 8192 /dev/dsk/c3t11d0s7
r – replica does not have device relocation information
o – replica active prior to last mddb configuration change
u – replica is up to date
l – locator for this replica was read successfully
c – replica’s location was in /etc/lvm/mddb.cf
p – replica’s location was patched in kernel
m – replica is master, this is replica selected as input
W – replica has device write errors
a – replica is active, commits are occurring to this replica
M – replica had problem with master blocks
D – replica had problem with data blocks
F – replica had format problems
S – replica is too small to hold current data base
R – replica had device read errors

hans-karri $ metadb -d /dev/dsk/c3t10d0s7
hans-karri $ metadb -i
flags first blk block count
a m p luo 16 8192 /dev/dsk/c1t10d0s7
a p luo 8208 8192 /dev/dsk/c1t10d0s7
a p luo 16400 8192 /dev/dsk/c1t10d0s7
a p luo 16 8192 /dev/dsk/c1t11d0s7
a p luo 8208 8192 /dev/dsk/c1t11d0s7
a p luo 16400 8192 /dev/dsk/c1t11d0s7
a p luo 16 8192 /dev/dsk/c3t11d0s7
a p luo 8208 8192 /dev/dsk/c3t11d0s7
a p luo 16400 8192 /dev/dsk/c3t11d0s7
r – replica does not have device relocation information
o – replica active prior to last mddb configuration change
u – replica is up to date
l – locator for this replica was read successfully
c – replica’s location was in /etc/lvm/mddb.cf
p – replica’s location was patched in kernel
m – replica is master, this is replica selected as input
W – replica has device write errors
a – replica is active, commits are occurring to this replica
M – replica had problem with master blocks
D – replica had problem with data blocks
F – replica had format problems
S – replica is too small to hold current data base
R – replica had device read errors
hans-karri $ cfgadm -al
Ap_Id Type Receptacle Occupant Condition
IO1 HPCI+ connected configured ok
IO1::pci0 io connected configured ok
IO1::pci1 io connected configured ok
IO1::pci2 io connected configured ok
IO1::pci3 io connected configured ok

hans-karri $ devfsadm -Cv
PCI-device: network@3,1, eri0
eri0 is /pci@3c,700000/pci@1/network@3,1
PCI-device: network@3,1, eri1
eri1 is /pci@bc,700000/pci@1/network@3,1
pseudo-device: fcode0
fcode0 is /pseudo/fcode@0
pseudo-device: fssnap0
fssnap0 is /pseudo/fssnap@0
pseudo-device: ramdisk1024
ramdisk1024 is /pseudo/ramdisk@1024
pseudo-device: winlock0
winlock0 is /pseudo/winlock@0
pseudo-device: lockstat0
lockstat0 is /pseudo/lockstat@0
pseudo-device: wrsmd14
wrsmd14 is /pseudo/wrsmd@14
pseudo-device: wrsmd15
wrsmd15 is /pseudo/wrsmd@15
LLT INFO V-14-1-10009 LLT Protocol available
GAB INFO V-15-1-20021 GAB available
LMX Multiplexor available
hans-karri $ format
Searching for disks…done
AVAILABLE DISK SELECTIONS:
0. c0t8d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@3c,700000/pci@1/pci@1/scsi@2/sd@8,0
1. c0t9d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@3c,700000/pci@1/pci@1/scsi@2/sd@9,0
2. c1t10d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@3c,700000/pci@1/pci@1/scsi@2,1/sd@a,0
3. c1t11d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@3c,700000/pci@1/pci@1/scsi@2,1/sd@b,0

Specify disk (enter its number): 6
selecting c3t10d0
[disk formatted]
FORMAT MENU:
disk – select a disk
type – select (define) a disk type
partition – select (define) a partition table
current – describe the current disk
format – format and analyze the disk
repair – repair a defective sector
label – write label to the disk
analyze – surface analysis
defect – defect list management
backup – search for backup labels
verify – read and display labels
save – save new disk/partition definitions
inquiry – show vendor, product and revision
volname – set 8-character volume name
!<cmd> – execute <cmd>, then return
quit
format> p
PARTITION MENU:
0 – change `0′ partition
1 – change `1′ partition
2 – change `2′ partition
3 – change `3′ partition
4 – change `4′ partition
5 – change `5′ partition
6 – change `6′ partition
7 – change `7′ partition
select – select a predefined table
modify – modify a predefined partition table
name – name the current table
print – display the current table
label – write partition map and label to the disk
!<cmd> – execute <cmd>, then return
quit
partition> p
Current partition table (original):
Total disk cylinders available: 14087 + 2 (reserved cylinders)

Part Tag Flag Cylinders Size Blocks
0 root wm 0 – 25 129.19MB (26/0/0) 264576
1 swap wu 26 – 51 129.19MB (26/0/0) 264576
2 backup wu 0 – 14086 68.35GB (14087/0/0) 143349312
3 unassigned wm 0 0 (0/0/0) 0
4 unassigned wm 0 0 (0/0/0) 0
5 unassigned wm 0 0 (0/0/0) 0
6 usr wm 52 – 14086 68.10GB (14035/0/0) 142820160
7 unassigned wm 0 0 (0/0/0) 0

partition> l
Ready to label disk, continue? y

partition> p
Current partition table (original):
Total disk cylinders available: 14087 + 2 (reserved cylinders)

Part Tag Flag Cylinders Size Blocks
0 root wm 0 – 25 129.19MB (26/0/0) 264576
1 swap wu 26 – 51 129.19MB (26/0/0) 264576
2 backup wu 0 – 14086 68.35GB (14087/0/0) 143349312
3 unassigned wm 0 0 (0/0/0) 0
4 unassigned wm 0 0 (0/0/0) 0
5 unassigned wm 0 0 (0/0/0) 0
6 usr wm 52 – 14086 68.10GB (14035/0/0) 142820160
7 unassigned wm 0 0 (0/0/0) 0

partition> q
FORMAT MENU:
disk – select a disk
type – select (define) a disk type
partition – select (define) a partition table
current – describe the current disk
format – format and analyze the disk
repair – repair a defective sector
label – write label to the disk
analyze – surface analysis
defect – defect list management
backup – search for backup labels
verify – read and display labels
save – save new disk/partition definitions
inquiry – show vendor, product and revision
volname – set 8-character volume name
!<cmd> – execute <cmd>, then return
quit
format> q

hans-karri $ prtconf -pv | grep -i boot
boot-retained-page:
bootargs: ‘-sv’
bootpath: ‘/pci@3c,700000/pci@1/pci@1/scsi@2,1/disk@a,0:a’
error-reset-recovery: ‘boot’
network-boot-arguments:
boot-command: ‘boot’
boot-file:
boot-device: ‘rootdisk rootmirror’
auto-boot?: ‘true’
umiboot: ‘/pci@3c,700000/pci@1/pci@1/network@0’
name: ‘bootbus-controller’
name: ‘bootbus-controller’

hans-karri $ metastat -p
d4 -m d14 d24 1
d14 1 1 c1t10d0s4
d24 1 1 c3t10d0s4
d3 -m d13 d23 1
d13 1 1 c1t10d0s3
d23 1 1 c3t10d0s3
——————-
—————–

hans-karri $ prtvtoc /dev/rdsk/c1t10d0s2 | fmthard -s – /dev/rdsk/c3t10d0s2
fmthard: New volume table of contents now in place.
hans-karri $ prtvtoc /dev/rdsk/c3t10d0s2
* /dev/rdsk/c3t10d0s2 partition map
*
* Dimensions:
* 512 bytes/sector
* 424 sectors/track
* 24 tracks/cylinder
* 10176 sectors/cylinder
* 14089 cylinders
* 14087 accessible cylinders
*
* Flags:
* 1: unmountable
* 10: read-only
*
* First Sector Last
* Partition Tag Flags Sector Count Sector Mount Directory
0 2 00 33560448 16780224 50340671
1 3 01 0 33560448 33560447
2 5 00 0 143349312 143349311
3 7 00 50340672 16780224 67120895
4 0 00 67120896 33560448 100681343
5 0 00 100681344 42138816 142820159
7 0 00 142820160 529152 143349311
hans-karri $ metastat -p
d4 -m d14 d24 1
d14 1 1 c1t10d0s4
d24 1 1 c3t10d0s4
d3 -m d13 d23 1
d13 1 1 c1t10d0s3
———————
————————–
Device Relocation Information:
Device Reloc Device ID
c1t10d0 Yes id1,sd@SFUJITSU_MAW3073NCSUN72G_000704B0JH9E____DAN0P710JH9E

hans-karri $ metasync d0
hans-karri $ metasync d1
hans-karri $ metasync d4
hans-karri $ metastat | grep -i sync
Invoke: metasync d3
Invoke: metasync d5
hans-karri $ metasync d3
hans-karri $ metasync d5
e_ddi_get_dev_info: Illegal major device number <-1>hans-karri $ metastat | grep -i sync
hans-karri $ metastat | grep -i %
hans-karri $ metastat -p
d4 -m d14 d24 1
d14 1 1 c1t10d0s4
d24 1 1 c3t10d0s4
d3 -m d13 d23 1
d13 1 1 c1t10d0s3
d23 1 1 c3t10d0s3
d1 -m d11 d21 1
d11 1 1 c1t10d0s1
d21 1 1 c3t10d0s1
d0 -m d10 d20 1
d10 1 1 c1t10d0s0
d20 1 1 c3t10d0s0
d55 -p d5 -o 30081248 -b 225280
d5 -m d15 d25 1
d15 1 1 c1t10d0s5
d25 1 1 c3t10d0s5
d54 -p d5 -o 27828416 -b 2252800
d53 -p d5 -o 26701984 -b 1126400
d36 -p d5 -o 16216192 -b 10485760
d35 -p d5 -o 5730400 -b 10485760
d52 -p d5 -o 4194368 -b 1536000
d50 -p d5 -o 32 -b 4194304
hans-karri $ metadetach d4 d24
metadetach: hans-karri: d4: attempt an operation on a submirror that has erred components

hans-karri $ metadetach -f d4 d24
d4: submirror d24 is detached
hans-karri $ metastat -p
d4 -m d14 1
d14 1 1 c1t10d0s4
d3 -m d13 d23 1
d13 1 1 c1t10d0s3
d23 1 1 c3t10d0s3
d1 -m d11 d21 1
d11 1 1 c1t10d0s1
d21 1 1 c3t10d0s1
d0 -m d10 d20 1
d10 1 1 c1t10d0s0
d20 1 1 c3t10d0s0
d24 1 1 c3t10d0s4
d55 -p d5 -o 30081248 -b 225280
d5 -m d15 d25 1
d15 1 1 c1t10d0s5
d25 1 1 c3t10d0s5
d54 -p d5 -o 27828416 -b 2252800
d53 -p d5 -o 26701984 -b 1126400
d36 -p d5 -o 16216192 -b 10485760
d35 -p d5 -o 5730400 -b 10485760
d52 -p d5 -o 4194368 -b 1536000
d50 -p d5 -o 32 -b 4194304
hans-karri $ metadetach d3 d23
metadetach: hans-karri: d3: attempt an operation on a submirror that has erred components

hans-karri $ metadetach -f d3 d23
d3: submirror d23 is detached
hans-karri $ metadetach -f d1 d21
d1: submirror d21 is detached
hans-karri $ metadetach -f d0 d20
d0: submirror d20 is detached
hans-karri $ metadetach -f d5 d25
d5: submirror d25 is detached
hans-karri $ metastat -p
d4 -m d14 1
d14 1 1 c1t10d0s4
d3 -m d13 1
d13 1 1 c1t10d0s3
d1 -m d11 1
d11 1 1 c1t10d0s1
d0 -m d10 1
d10 1 1 c1t10d0s0
d24 1 1 c3t10d0s4
d23 1 1 c3t10d0s3
d21 1 1 c3t10d0s1
d25 1 1 c3t10d0s5
d20 1 1 c3t10d0s0
d55 -p d5 -o 30081248 -b 225280
d5 -m d15 1
d15 1 1 c1t10d0s5
d54 -p d5 -o 27828416 -b 2252800
d53 -p d5 -o 26701984 -b 1126400
d36 -p d5 -o 16216192 -b 10485760
d35 -p d5 -o 5730400 -b 10485760
d52 -p d5 -o 4194368 -b 1536000
d50 -p d5 -o 32 -b 4194304
hans-karri $ metaclear d24
d24: Concat/Stripe is cleared
hans-karri $ metaclear d23
d23: Concat/Stripe is cleared
hans-karri $ metaclear d21
d21: Concat/Stripe is cleared
hans-karri $ metaclear d20
d20: Concat/Stripe is cleared
hans-karri $ metaclear d25
d25: Concat/Stripe is cleared
hans-karri $ metastat -p
d4 -m d14 1
d14 1 1 c1t10d0s4
d3 -m d13 1
d13 1 1 c1t10d0s3
d1 -m d11 1
d11 1 1 c1t10d0s1
d0 -m d10 1
d10 1 1 c1t10d0s0
d55 -p d5 -o 30081248 -b 225280
d5 -m d15 1
d15 1 1 c1t10d0s5
d54 -p d5 -o 27828416 -b 2252800
d53 -p d5 -o 26701984 -b 1126400
d36 -p d5 -o 16216192 -b 10485760
d35 -p d5 -o 5730400 -b 10485760
d52 -p d5 -o 4194368 -b 1536000
d50 -p d5 -o 32 -b 4194304

hans-karri $ metadb -a -c 3 /dev/dsk/c3t10d0s7
hans-karri $ metadb -i
flags first blk block count
a m p luo 16 8192 /dev/dsk/c1t10d0s7
a p luo 8208 8192 /dev/dsk/c1t10d0s7
a p luo 16400 8192 /dev/dsk/c1t10d0s7
a p luo 16 8192 /dev/dsk/c1t11d0s7
a p luo 8208 8192 /dev/dsk/c1t11d0s7
a p luo 16400 8192 /dev/dsk/c1t11d0s7
a u 16 8192 /dev/dsk/c3t10d0s7
a u 8208 8192 /dev/dsk/c3t10d0s7
a u 16400 8192 /dev/dsk/c3t10d0s7
a p luo 16 8192 /dev/dsk/c3t11d0s7
a p luo 8208 8192 /dev/dsk/c3t11d0s7
a p luo 16400 8192 /dev/dsk/c3t11d0s7
r – replica does not have device relocation information
o – replica active prior to last mddb configuration change
u – replica is up to date
l – locator for this replica was read successfully
c – replica’s location was in /etc/lvm/mddb.cf
p – replica’s location was patched in kernel
m – replica is master, this is replica selected as input
W – replica has device write errors
a – replica is active, commits are occurring to this replica
M – replica had problem with master blocks
D – replica had problem with data blocks
F – replica had format problems
S – replica is too small to hold current data base
R – replica had device read errors

hans-karri $ metainit d24 1 1 c3t10d0s4
d24: Concat/Stripe is setup
hans-karri $ metainit d23 1 1 c3t10d0s3
d23: Concat/Stripe is setup
hans-karri $ metainit d21 1 1 c3t10d0s1
d21: Concat/Stripe is setup
hans-karri $ metainit d20 1 1 c3t10d0s0
d20: Concat/Stripe is setup
hans-karri $ metainit d25 1 1 c3t10d0s5
d25: Concat/Stripe is setup
hans-karri $ metastat -p
d4 -m d14 1
d14 1 1 c1t10d0s4
d3 -m d13 1
d13 1 1 c1t10d0s3
d1 -m d11 1
d11 1 1 c1t10d0s1
d0 -m d10 1
d10 1 1 c1t10d0s0
d25 1 1 c3t10d0s5
d20 1 1 c3t10d0s0
d21 1 1 c3t10d0s1
d23 1 1 c3t10d0s3
d24 1 1 c3t10d0s4
d55 -p d5 -o 30081248 -b 225280
d5 -m d15 1
d15 1 1 c1t10d0s5
d54 -p d5 -o 27828416 -b 2252800
d53 -p d5 -o 26701984 -b 1126400
d36 -p d5 -o 16216192 -b 10485760
d35 -p d5 -o 5730400 -b 10485760
d52 -p d5 -o 4194368 -b 1536000
d50 -p d5 -o 32 -b 4194304

hans-karri $ shutdown -y -g0 -i0

Shutdown started. Sunday August 7 01:28:47 EST 2011

Changing to init state 0 – please wait

showmount: hans-karri: RPC: Rpcbind failure – RPC: Unable to receive
hans-karri $
—————
————–
————–
Stopping vxfen..
Stopping vxfen.. Done
Shutting down Oracle Cluster Ready Services (CRS):
Shutdown has begun. The daemons should exit soon.

Shutting down Measureware collection software

Shutting down the MeasureWare server daemons

The perflbd process has terminated

The agdbserver process has terminated

The rep_server processes have terminated

The MeasureWare Server has been shut down successfully
Solaris Management Console server not running on port 898.
Sun Aug 7 01:29:57.1408 Disabling keephot for cache passwd since ttl is less than 600 seconds
Sun Aug 7 01:29:57.1410 Disabling keephot for cache group since ttl is less than 600 seconds
Sun Aug 7 01:29:57.1411 Disabling keephot for cache hosts since ttl is less than 600 seconds
Sun Aug 7 01:29:57.1411 Disabling keephot for cache ipnodes since ttl is less than 600 seconds
No running instance of Symantec Private Branch Exchange to stop.
GAB: module not configured
The process id in /opt/Tivoli/lcf/dat/1/lcfd.pid is not an lcfd process id.
Unable to get process id of the Tivoli LCF daemon (pid).
Stopping Veritas Enterprise Administrator Service (vxsvc)
VEA Server was shutdown successfully
Unconfiguring LMX
Stopping TME 10 Enterprise Console Logfile Adapter…
Starting processsing…
If there are any running logfile adapters, specify a name (e.g. init.tecad_logfile stop tecad_logfile) or use the ‘kill’ command.
Cleaning up temporary files…
vxservice version 1.3.16.0
Symantec Corporation
Copyright (c) 2006 Symantec Corporation. All rights reserved.
[Error] V-95-10012 Connection Failed to corbaloc:vxssiop:hans-karri:1556:RootSMF_secsvc/RootSMF.
The system is down.
syncing file systems… done
Program terminated

{22} ok boot -sv
Resetting…
INIT: SINGLE USER MODE

Type control-d to proceed with normal startup,
(or give root password for system maintenance):
single-user privilege assigned to /dev/console.
Entering System Maintenance Mode
hans-karri $ metastat -p
d4 -m d14 1
d14 1 1 c1t10d0s4
d3 -m d13 1
d13 1 1 c1t10d0s3
d1 -m d11 1
d11 1 1 c1t10d0s1
d0 -m d10 1
d10 1 1 c1t10d0s0
d25 1 1 c3t10d0s5
d20 1 1 c3t10d0s0
d21 1 1 c3t10d0s1
d23 1 1 c3t10d0s3
d24 1 1 c3t10d0s4
d55 -p d5 -o 30081248 -b 225280
d5 -m d15 1
d15 1 1 c1t10d0s5
d54 -p d5 -o 27828416 -b 2252800
d53 -p d5 -o 26701984 -b 1126400
d36 -p d5 -o 16216192 -b 10485760
d35 -p d5 -o 5730400 -b 10485760
d52 -p d5 -o 4194368 -b 1536000
d50 -p d5 -o 32 -b 4194304
hans-karri $ who -r
. run-level S Aug 7 01:39 S 0 ?
hans-karri $ metattach d14 d24
metattach: hans-karri: d24: is a metadevice

hans-karri $ metastat -p
d4 -m d14 1
d14 1 1 c1t10d0s4
d3 -m d13 1
d13 1 1 c1t10d0s3
d1 -m d11 1
d11 1 1 c1t10d0s1
d0 -m d10 1
d10 1 1 c1t10d0s0
d25 1 1 c3t10d0s5
d20 1 1 c3t10d0s0
d21 1 1 c3t10d0s1
d23 1 1 c3t10d0s3
d24 1 1 c3t10d0s4
d55 -p d5 -o 30081248 -b 225280
d5 -m d15 1
d15 1 1 c1t10d0s5
d54 -p d5 -o 27828416 -b 2252800
d53 -p d5 -o 26701984 -b 1126400
d36 -p d5 -o 16216192 -b 10485760
d35 -p d5 -o 5730400 -b 10485760
d52 -p d5 -o 4194368 -b 1536000
d50 -p d5 -o 32 -b 4194304
hans-karri $ metattach d4 d24
d4: submirror d24 is attached
hans-karri $ metattach d3 d23
d3: submirror d23 is attached
hans-karri $ metattach metattach d1 d21^C
hans-karri $ metattach d1 d21
d1: submirror d21 is attached
hans-karri $ metattach d0 d20
d0: submirror d20 is attached
hans-karri $ metattach d5 d25
d5: submirror d25 is attached
hans-karri $ metastat -p
d4 -m d14 d24 1
d14 1 1 c1t10d0s4
d24 1 1 c3t10d0s4
d3 -m d13 d23 1
d13 1 1 c1t10d0s3
d23 1 1 c3t10d0s3
d1 -m d11 d21 1
d11 1 1 c1t10d0s1
d21 1 1 c3t10d0s1
d0 -m d10 d20 1
d10 1 1 c1t10d0s0
d20 1 1 c3t10d0s0
d55 -p d5 -o 30081248 -b 225280
d5 -m d15 d25 1
d15 1 1 c1t10d0s5
d25 1 1 c3t10d0s5
d54 -p d5 -o 27828416 -b 2252800
d53 -p d5 -o 26701984 -b 1126400
d36 -p d5 -o 16216192 -b 10485760
d35 -p d5 -o 5730400 -b 10485760
d52 -p d5 -o 4194368 -b 1536000
d50 -p d5 -o 32 -b 4194304
hans-karri $ metastat | grep %
Resync in progress: 2 % done
Resync in progress: 2 % done
Resync in progress: 0 % done
Resync in progress: 0 % done
Resync in progress: 0 % done

hans-karri $ ifconfig -a
———————-
————————-
—————
hans-karri $ metastat | grep %
Resync in progress: 91 % done
Resync in progress: 26 % done
Resync in progress: 39 % done
hans-karri $ metadb -i
flags first blk block count
a m p luo 16 8192 /dev/dsk/c1t10d0s7
a p luo 8208 8192 /dev/dsk/c1t10d0s7

r – replica does not have device relocation information
o – replica active prior to last mddb configuration change
u – replica is up to date
l – locator for this replica was read successfully
c – replica’s location was in /etc/lvm/mddb.cf
p – replica’s location was patched in kernel
m – replica is master, this is replica selected as input
W – replica has device write errors
a – replica is active, commits are occurring to this replica
M – replica had problem with master blocks
D – replica had problem with data blocks
F – replica had format problems
S – replica is too small to hold current data base
R – replica had device read errors
hans-karri $ metastat -p
d4 -m d14 d24 1
d14 1 1 c1t10d0s4
d24 1 1 c3t10d0s4
d3 -m d13 d23 1
——————
————-
—————
Device Reloc Device ID
c3t10d0 Yes id1,sd@SFUJITSU_MAW3073NCSUN72G_000626B0F53H____DAN0P660F53H
c1t10d0 Yes id1,sd@SFUJITSU_MAW3073NCSUN72G_000704B0JH9E____DAN0P710JH9E
hans-karri $ installboot /usr/platform/sun4u/lib/fs/ufs/bootblk /dev/rdsk/c3t10d0s0

hans-karri $ ls -ltr
total 7036
drwx—— 2 root root 8192 Sep 4 2006 lost+found
dr-xr-xr-x 2 root root 512 Sep 4 2006 net
drwxrwxr-x 2 root other 512 Sep 5 2006 mnt1
———————
——————