afts31> afts31> afts31> setup The setup command will rewrite the /etc/rc, /etc/exports, /etc/hosts, /etc/hosts.equiv, /etc/dgateways, /etc/nsswitch.conf, and /etc/resolv.conf files, saving the original contents of these files in .bak files (e.g. /etc/exports.bak). Are you sure you want to continue? [yes] yes NetApp Release 7.2.3P7: Tue Nov 6 03:34:38 PST 2007 System ID: 0084180481 (afts31); partner ID: 0084187653 (afts32) System Serial Number: 3047352 (afts31) System Rev: D0 slot 0: System Board Processors: 2 Processor revision: B2 Processor type: 1250 Memory Size: 1022 MB slot 0: FC Host Adapter 0b 14 Disks: 952.0GB 1 shelf with EFH slot 0: Fibre Channel Target Host Adapter 0c slot 0: Dual SB1250-Gigabit Ethernet Controller e0a MAC Address: 00:a0:98:01:ac:b0 (auto-1000t-fd-up) e0b MAC Address: 00:a0:98:01:ac:b1 (auto-unknown-cfg_down) slot 0: NetApp ATA/IDE Adapter 0a (0x00000000000001f0) 0a.0 245MB Please enter the new hostname [afts31]: Do you want to configure virtual network interfaces? [n]: Please enter the IP address for Network Interface e0a [10.30.44.31]: Please enter the netmask for Network Interface e0a [255.255.254.0]: Should interface e0a take over a partner IP address during failover? [y]: yes Please enter the IP address or interface name to be taken over by e0a [e0a]: e0a Please enter media type for e0a {100tx-fd, tp-fd, 100tx, tp, auto (10/100/1000)} [auto]: Please enter flow control for e0a {none, receive, send, full} [full]: Do you want e0a to support jumbo frames? [n]: Please enter the IP address for Network Interface e0b []: Should interface e0b take over a partner IP address during failover? [n]: Would you like to continue setup through the web interface? [n]: Please enter the name or IP address of the default gateway [10.30.44.1]: The administration host is given root access to the filer's /etc files for system administration. To allow /etc root access to all NFS clients, enter 'all' below. Please enter the name or IP address of the administration host [10.30.44.30]: Please enter timezone [Japan]: Where is the filer located? [Tokyo]: What language will be used for multi-protocol files (Type ? for list)?:? Supported language codes are: C (POSIX) ar (Arabic) cs (Czech) da (Danish) de (German) en (English) en_US (English (US)) es (Spanish) fi (Finnish) fr (French) he (Hebrew) hr (Croatian) hu (Hungarian) it (Italian) ja (Japanese euc-j*) ja_v1 (Japanese euc-j) ja_JP.PCK (Japanese PCK(sjis)*) ja_JP.932 (Japanese cp932*) ja_JP.PCK_v2 (Japanese PCK(sjis)) ko (Korean) no (Norwegian) nl (Dutch) pl (Polish) pt (Portuguese) ro (Romanian) ru (Russian) sk (Slovak) sl (Slovenian) sv (Swedish) tr (Turkish) zh (Simplified Chinese) zh.GBK (Simplified Chinese (GBK)) zh_TW (Traditional Chinese euc-tw) zh_TW.BIG5 (Traditional Chinese Big 5) To use UTF-8 as the NFS character set append '.UTF-8' Language codes flagged with "*" are obsolete versions of those language characte r sets. What language will be used for multi-protocol files (Type ? for list)?:language not set Do you want to run DNS resolver? [n]: Do you want to run NIS client? [n]: This system will send event messages and weekly reports to Network Appliance Tec hnical Support. To disable this feature, enter "options autosupport.support.enab le off" within 24 hours. Enabling Autosupport can significantly speed problem de termination and resolution should a problem occur on your system. For further in formation on Autosupport, please see: http://now.netapp.com/autosupport/ Press the return key to continue. Now type 'reboot' for changes to take effect. afts31> afts31> afts31> afts31> afts31> afts31> lisenc            cense a_sis not licensed cifs site ZOVOSXA expires 04 Jun 2008 cluster site KDQLGBN cluster_remote not licensed disk_sanitization not licensed fcp not licensed flex_cache not licensed flex_clone not licensed gateway_hitachi not licensed http not licensed iscsi not licensed multistore not licensed nearstore_option not licensed nfs site JSPKACN expires 04 Jun 2008 smdomino not licensed smsql not licensed snaplock not licensed snaplock_enterprise JOJTOPJ expires 09 Jul 2009 snapmanagerexchange not licensed snapmirror site UUNLDQC snapmirror_sync not licensed snapmover not licensed snaprestore site XJIGCKE expires 04 Jun 2008 snapvalidator not licensed sv_linux_pri not licensed sv_ontap_pri not licensed sv_ontap_sec not licensed sv_unix_pri not licensed sv_windows_ofm_pri not licensed sv_windows_pri not licensed syncmirror_local not licensed v-series not licensed vld not licensed afts31> afts31> afts31> afts31> afts31> afts31> license add DZZBHDG A cluster 90 day site license has been installed. Clustered Failover already enabled. Make sure that each individual service is licensed on both nodes or on neither node. Remember to configure the network interfaces for the other node. afts31> Wed Mar 5 17:40:10 JST [afts31: rc:notice]: cluster licensed afts31> afts31> license a_sis not licensed cifs site ZOVOSXA expires 04 Jun 2008 cluster site DZZBHDG expires 04 Jun 2008 cluster_remote not licensed disk_sanitization not licensed fcp not licensed flex_cache not licensed flex_clone not licensed gateway_hitachi not licensed http not licensed iscsi not licensed multistore not licensed nearstore_option not licensed nfs site JSPKACN expires 04 Jun 2008 smdomino not licensed smsql not licensed snaplock not licensed snaplock_enterprise JOJTOPJ expires 09 Jul 2009 snapmanagerexchange not licensed snapmirror site UUNLDQC snapmirror_sync not licensed snapmover not licensed snaprestore site XJIGCKE expires 04 Jun 2008 snapvalidator not licensed sv_linux_pri not licensed sv_ontap_pri not licensed sv_ontap_sec not licensed sv_unix_pri not licensed sv_windows_ofm_pri not licensed sv_windows_pri not licensed syncmirror_local not licensed v-series not licensed vld not licensed afts31> Wed Mar 5 17:40:23 JST [afts31: cf.fsm.firmwareStatus:info]: Cluster mo nitor: partner rebooting Wed Mar 5 17:40:26 JST [afts31: cf.fsm.partnerNotResponding:notice]: Cluster mo nitor: partner not responding afts31> afts31> afts31> afts31> reboot CIFS local server is shutting down... waiting 119 seconds more CIFS local server has shut down... Wed Mar 5 17:40:38 JST [afts31: kern.shutdown:notice]: System shut down because : "reboot". CFE version 1.2.0 based on Broadcom CFE: 1.0.35 Copyright (C) 2000,2001,2002,2003 Broadcom Corporation. Portions Copyright (C) 2002,2003 Network Appliance Corporation. CPU type 0x1040102: 650MHz Total memory: 0x40000000 bytes (1024MB) Starting AUTOBOOT press any key to abort... Loading: 0xffffffff80001000/25888 0xffffffff80007520/13091855 Entry at 0xfffffff f80001000 Starting program at 0xffffffff80001000 Press CTRL-C for special boot menu ...........................................Interconnect based upon M-VIA ERing S upport Copyright (c) 1998-2001 Berkeley Lab http://www.nersc.gov/research/FTG/via Wed Mar 5 08:41:04 GMT [cf.nm.nicTransitionUp:info]: Interconnect link 0 is UP Wed Mar 5 08:41:04 GMT [cf.nm.nicReset:warning]: Initiating soft reset on Clust er Interconnect card 0 due to rendezvous jammed NetApp Release 7.2.3P7: Tue Nov 6 03:34:38 PST 2007 Copyright (c) 1992-2007 Network Appliance, Inc. Starting boot on Wed Mar 5 08:41:03 GMT 2008 Wed Mar 5 08:41:08 GMT [nvram.battery.state:info]: The NVRAM battery is current ly ON. Wed Mar 5 08:41:10 GMT [diskown.isEnabled:info]: software ownership has been en abled for this system add net 127.0.0.0Wed Mar 5 08:41:11 GMT [cf.noDiskownShelfCount:info]: Disk she lf count functionality is not supported on software based disk ownership configu rations. : gateway 127.0.0.1 Wed Mar 5 08:41:12 GMT [fmmbx_instanceWorke:info]: normal mailbox instance on l ocal side Wed Mar 5 08:41:12 GMT [fmmb.current.lock.disk:info]: Disk 0b.18 is a local HA mailbox disk. Wed Mar 5 08:41:12 GMT [fmmb.current.lock.disk:info]: Disk 0b.17 is a local HA mailbox disk. Wed Mar 5 08:41:15 GMT [fmmbx_instanceWorke:info]: normal mailbox instance on p artner side Wed Mar 5 08:41:15 GMT [fmmb.current.lock.disk:info]: Disk 0b.25 is a partner H A mailbox disk. Wed Mar 5 08:41:15 GMT [fmmb.current.lock.disk:info]: Disk 0b.24 is a partner H A mailbox disk. Wed Mar 5 08:41:16 GMT [cf.fm.partner:info]: Cluster monitor: partner 'afts32' Wed Mar 5 08:41:16 GMT [cf.fm.kernelMismatch:warning]: Cluster monitor: possibl e kernel mismatch detected local 'NetApp/7.2.3P7', partner 'NetApp/7.2.3' Wed Mar 5 08:41:16 GMT [cf.fm.timeMasterStatus:info]: Acting as cluster time ma ster Wed Mar 5 08:41:17 GMT [raid.cksum.replay.summary:info]: Replayed 0 checksum bl ocks. Wed Mar 5 08:41:17 GMT [raid.stripe.replay.summary:info]: Replayed 0 stripes. Wed Mar 5 08:41:18 GMT [localhost: cf.fm.launch:info]: Launching cluster monito r Wed Mar 5 08:41:18 GMT [localhost: cf.fm.partner:info]: Cluster monitor: partne r 'afts32' Wed Mar 5 08:41:18 GMT [localhost: cf.fm.notkoverClusterDisable:warning]: Clust er monitor: cluster takeover disabled (restart) Wed Mar 5 08:41:19 GMT [localhost: vol.language.unspecified:info]: Language not set on volume MyVolOne. Using language config "C". Use vol lang to set language . Wed Mar 5 08:41:19 GMT [localhost: vol.language.unspecified:info]: Language not set on volume NFSvol. Using language config "C". Use vol lang to set language. Wed Mar 5 08:41:19 GMT [localhost: vol.language.unspecified:info]: Language not set on volume vol0. Using language config "C". Use vol lang to set language. Wed Mar 5 08:41:19 GMT [localhost: vol.language.unspecified:info]: Language not set on volume SSvol. Using language config "C". Use vol lang to set language. Wed Mar 5 08:41:19 GMT [localhost: vol.language.unspecified:info]: Language not set on volume SMvola1. Using language config "C". Use vol lang to set language. Wed Mar 5 08:41:19 GMT [localhost: vol.language.unspecified:info]: Language not set on volume SMvola3. Using language config "C". Use vol lang to set language. Wed Mar 5 08:41:19 GMT [localhost: rc:notice]: The system was down for 38 secon ds Wed Mar 5 08:41:19 GMT [localhost: cf.fsm.takeoverOfPartnerDisabled:notice]: Cl uster monitor: takeover of afts32 disabled (cluster takeover disabled) Wed Mar 5 17:41:20 JST [afts31: dfu.firmwareUpToDate:info]: Firmware is up-to-d ate on all disk drives Wed Mar 5 17:41:21 JST [afts31: ltm_services:info]: Ethernet e0a: Link up add net default: gateway 10.30.44.1 Wed Mar 5 17:41:23 JST [afts31: rc:ALERT]: timed: time daemon started Wed Mar 5 17:41:24 JST [afts31: mgr.boot.disk_done:info]: NetApp Release 7.2.3P 7 boot complete. Last disk update written at Wed Mar 5 17:40:40 JST 2008 Wed Mar 5 17:41:24 JST [afts31: mgr.boot.reason_ok:notice]: System rebooted aft er a reboot command. CIFS local server is running. Data ONTAP (afts31.hq.netapp.com) login: Data ONTAP (afts31.hq.netapp.com) login: Data ONTAP (afts31.hq.netapp.com) login: Data ONTAP (afts31.hq.netapp.com) login: Data ONTAP (afts31.hq.netapp.com) login: Data ONTAP (afts31.hq.netapp.com) login: root Password: afts31> Wed Mar 5 17:41:34 JST [afts31: console_login_mgr:info]: root logged in from console afts31> afts31> afts31> afts31> cf enableWed Mar 5 17:41:49 JST [afts31: nbt.nbns.registrationComplete: info]: NBT: All CIFS name registrations have completed for the local server.          afts31> afts31> afts31> afts31> afts31> afts31> Wed Mar 5 17:42:01 JST [afts31: monitor.globalStatus.critical:CRITICAL] : Cluster failover of afts32 is not possible: cluster takeover disabled. Wed Mar 5 17:42:08 JST [afts31: SB1250-Gigabit/e0a:warning]: Client 10.30.44.60 (xid 2076817427) is trying to access an unexported mount (fileid 100 on volume 0x2d29fa0 [No volume name available]) afts31> afts31> afts31> afts31> afts31> afts31> afts31> Wed Mar 5 17:50:17 JST [afts31: cf.fsm.firmwareStatus:info]: Cluster mo nitor: partner rebooting Wed Mar 5 17:50:20 JST [afts31: cf.fsm.partnerNotResponding:notice]: Cluster mo nitor: partner not responding Wed Mar 5 17:50:39 JST [afts31: cf.fsm.firmwareStatus:info]: Cluster monitor: p artner kernel loaded Wed Mar 5 17:50:47 JST [afts31: cf.fsm.partnerOk:notice]: Cluster monitor: part ner ok afts31> afts31> afts31> afts31> afts31> cf enable afts31> Wed Mar 5 17:54:06 JST [afts31: cf.misc.operatorEnable:warning]: Cluste r monitor: operator initiated enabling of cluster Wed Mar 5 17:54:06 JST [afts31: cf.fsm.takeoverOfPartnerEnabled:notice]: Cluste r monitor: takeover of afts32 enabled Wed Mar 5 17:54:06 JST [afts31: cf.fsm.takeoverByPartnerEnabled:notice]: Cluste r monitor: takeover of afts31 by afts32 enabled afts31> afts31> cf status Cluster enabled, afts32 is up. afts31> afts31> afts31> afts31> cf takeover cf: takeover initiated by operator afts31> Wed Mar 5 17:54:52 JST [afts31: cf.misc.operatorTakeover:warning]: Clus ter monitor: takeover initiated by operator Wed Mar 5 17:54:52 JST [afts31: cf.fsm.nfo.acceptTakeoverReq:warning]: Negotiat ed failover: accepting takeover request by partner, reason: operator initiated c f takeover. Asking partner to shutdown gracefully; will takeover in at most 180 seconds. afts31> afts31> Wed Mar 5 17:55:00 JST [afts31: monitor.globalStatus.ok:info]: The syst em's global status is normal. Wed Mar 5 17:55:01 JST [afts31: cf.fsm.firmwareStatus:info]: Cluster monitor: p artner rebooting Wed Mar 5 17:55:01 JST [afts31: cf.fsm.nfo.partnerShutdown:warning]: Negotiated failover: partner has shutdown Wed Mar 5 17:55:01 JST [afts31: cf.fsm.takeover.nfo:info]: Cluster monitor: tak eover attempted after 'cf takeover'. command Wed Mar 5 17:55:01 JST [afts31: cf.fsm.stateTransit:warning]: Cluster monitor: UP --> TAKEOVER Wed Mar 5 17:55:01 JST [afts31: cf.fm.takeoverStarted:warning]: Cluster monitor : takeover started Wed Mar 5 17:55:02 JST [afts32/afts31: coredump.spare.none:info]: No sparecore disk was found. Wed Mar 5 17:55:02 JST [afts31: cf_takeover:info]: NVRAM takeover: partner nvra m is disabled Replaying takeover WAFL log Wed Mar 5 17:55:03 JST [afts32/afts31: wafl.takeover.nvram.missing:error]: WAFL takeover: no partner area found during wafl replay Wed Mar 5 17:55:03 JST [afts32/afts31: wafl.replay.done:info]: WAFL log replay completed, 0 seconds Wed Mar 5 17:55:04 JST [afts32/afts31: vol.language.unspecified:info]: Language not set on volume vol0. Using language config "C". Use vol lang to set language . Wed Mar 5 17:55:04 JST [afts32/afts31: vol.language.unspecified:info]: Language not set on volume MyVolOne. Using language config "C". Use vol lang to set lang uage. Wed Mar 5 17:55:04 JST [afts32/afts31: vol.language.unspecified:info]: Language not set on volume NFSvol. Using language config "C". Use vol lang to set langua ge. Wed Mar 5 17:55:04 JST [afts32/afts31: vol.language.unspecified:info]: Language not set on volume SSvol. Using language config "C". Use vol lang to set languag e. Wed Mar 5 17:55:04 JST [afts32/afts31: vol.language.unspecified:info]: Language not set on volume SMvola2. Using language config "C". Use vol lang to set langu age. Wed Mar 5 17:55:04 JST [afts32/afts31: vol.language.unspecified:info]: Language not set on volume SMvola4. Using language config "C". Use vol lang to set langu age. add net default: gateway 10.30.44.1 Wed Mar 5 17:55:05 JST [afts32/afts31: cf_takeover:ALERT]: Warning: license set ting for snaplock_enterprise is not the same on both systems Wed Mar 5 17:55:05 JST [afts31: cf.rsrc.takeoverOpFail:error]: Cluster monitor: takeover during license_check failed; takeover continuing... CIFS partner server is running. Wed Mar 5 17:55:05 JST [afts31 (takeover): cf.rsrc.transitTime:notice]: Top Tak eover transit times registry_postrc_phase1=752, wafl=618, rc=453 {ifconfig=138, hostname=99, options=63, options=34, route=1, routed=1}, wafl_sync=265, raid=211 , registry_prerc=187, registry_postrc_phase2=126, tftpd=116, wafl_restart=106 {r estarters=59, vdisk=47}, raid_replay=81 Wed Mar 5 17:55:05 JST [afts31 (takeover): cf.fm.takeoverComplete:warning]: Clu ster monitor: takeover completed afts31(takeover)> afts31(takeover)> afts31(takeover)> afts31(takeover)> afts31(takeover)> afts31(takeover)> Wed Mar 5 17:55:29 JST [afts32/afts31: nbt.nbns.registrationC omplete:info]: NBT: All CIFS name registrations have completed for the partner s erver. afts31(takeover)> afts31(takeover)> afts31(takeover)> afts31(takeover)> afts31(takeover)> afts31(takeover)> Wed Mar 5 17:56:00 JST [afts31 (takeover): monitor.globalStat us.critical:CRITICAL]: This node has taken over afts32. Wed Mar 5 17:56:00 JST [afts32/afts31: monitor.globalStatus.critical:CRITICAL]: afts31 has taken over this node. afts31(takeover)> afts31(takeover)> afts31(takeover)> ifconfig -a e0a: flags=8e8043 mtu 1500 inet 10.30.44.31 netmask 0xfffffe00 broadcast 10.30.45.255 partner inet 10.30.44.32 (e0a) ether 00:a0:98:01:ac:b0 (auto-1000t-fd-up) flowcontrol full e0b: flags=8042 mtu 1500 ether 00:a0:98:01:ac:b1 (auto-unknown-cfg_down) flowcontrol full lo: flags=19e8049 m tu 8160 inet 127.0.0.1 netmask 0xff000000 broadcast 127.0.0.1 ether 60:7a:af:37:04:00 (VIA Provider) afts31(takeover)> afts31(takeover)> afts31(takeover)> afts31(takeover)> cf giveback Partner not waiting for giveback, giveback cancelled. To do a giveback without checking for partner readiness, please either set optio n "cf.giveback.check.partner" to "off" before doing "cf giveback" again, or do " cf giveback -f". The first choice disables checking for all future "cf giveback", until it's turn ed back to "on". The second choice is good for this giveback only. afts31(takeover)> afts31(takeover)> afts31(takeover)> afts31(takeover)> afts31(takeover)> cf giveback Partner not waiting for giveback, giveback cancelled. To do a giveback without checking for partner readiness, please either set optio n "cf.giveback.check.partner" to "off" before doing "cf giveback" again, or do " cf giveback -f". The first choice disables checking for all future "cf giveback", until it's turn ed back to "on". The second choice is good for this giveback only. afts31(takeover)> afts31(takeover)> afts31(takeover)> cf status afts31 has taken over afts32. Takeover due to negotiated failover, reason: operator initiated cf takeover afts31(takeover)> afts31(takeover)> afts31(takeover)> afts31(takeover)> cf     afts31(takeover)> afts31(takeover)> afts31(takeover)> Wed Mar 5 18:00:00 JST [afts31 (takeover): kern.uptime.filer: info]: 6:00pm up 18 mins, 38 NFS ops, 945 CIFS ops, 0 HTTP ops, 0 FCP ops, 0 i SCSI ops Wed Mar 5 18:00:35 JST [afts31 (takeover): cf.nm.nicViError:info]: Interconnect nic 0 has error on VI #4 SEND_DESC_TIMEOUT 7 Wed Mar 5 18:00:35 JST [afts31 (takeover): cf.nm.nicTransitionDown:warning]: Cl uster Interconnect link 0 is DOWN Wed Mar 5 18:00:35 JST [afts31 (takeover): cf.rv.notConnected:error]: Connectio n for cfo_rv failed Wed Mar 5 18:00:38 JST [afts31 (takeover): cf.nm.nicTransitionUp:info]: Interco nnect link 0 is UP afts31(takeover)> afts31(takeover)> afts31(takeover)> cf status afts31 has taken over afts32. afts32 is ready for giveback. Takeover due to negotiated failover, reason: operator initiated cf takeover afts31(takeover)> afts31(takeover)> afts31(takeover)> afts31(takeover)> cf giveback afts31(takeover)> Wed Mar 5 18:02:47 JST [afts31 (takeover): cf.misc.operatorGi veback:info]: Cluster monitor: giveback initiated by operator Wed Mar 5 18:02:47 JST [afts31: cf.fm.givebackStarted:warning]: Cluster monitor : giveback started CIFS partner server is shutting down... CIFS partner server has shut down... Wed Mar 5 18:02:51 JST [afts31: cf.rsrc.transitTime:notice]: Top Giveback trans it times raid=2823, wafl=360 {sync_clean=126, zombie_wait=112}, ndmpd=178, regis try_giveback=82, snapmirror=62, wafl_upfront=34, java=18, nfsd=12, sanown_replay =9, nlm=2 Wed Mar 5 18:02:51 JST [afts31: asup.msg.giveback.delayed:info]: giveback AutoS upport delayed 5 minutes (until after the giveback process is complete). Wed Mar 5 18:02:51 JST [afts31: cf.fm.givebackComplete:warning]: Cluster monito r: giveback completed Wed Mar 5 18:02:51 JST [afts31: cf.fsm.stateTransit:warning]: Cluster monitor: TAKEOVER --> UP Wed Mar 5 18:02:52 JST [afts31: cf.fsm.takeoverByPartnerDisabled:notice]: Clust er monitor: takeover of afts31 by afts32 disabled (unsynchronized log) Wed Mar 5 18:02:57 JST [afts31: cf.fsm.partnerNotResponding:notice]: Cluster mo nitor: partner not responding Wed Mar 5 18:02:57 JST [afts31: cf.fm.timeMasterStatus:info]: Acting as cluster time master Wed Mar 5 18:02:58 JST [afts31: cf.fsm.partnerOk:notice]: Cluster monitor: part ner ok Wed Mar 5 18:02:58 JST [afts31: cf.fsm.takeoverOfPartnerDisabled:notice]: Clust er monitor: takeover of afts32 disabled (partner booting) Wed Mar 5 18:03:01 JST [afts31: cf.fsm.takeoverOfPartnerDisabled:notice]: Clust er monitor: takeover of afts32 disabled (unsynchronized log) Wed Mar 5 18:03:02 JST [afts31: cf.fsm.takeoverOfPartnerEnabled:notice]: Cluste r monitor: takeover of afts32 enabled Wed Mar 5 18:03:02 JST [afts31: cf.fsm.takeoverByPartnerEnabled:notice]: Cluste r monitor: takeover of afts31 by afts32 enabled afts31> afts31> afts31> afts31> afts31> Wed Mar 5 18:04:00 JST [afts31: monitor.globalStatus.ok:info]: The syst em's global status is normal. Wed Mar 5 18:04:03 JST [afts31: cf.fsm.nfo.startingGracefulShutdown:warning]: N egotiated failover: starting graceful shutdown. CIFS local server is shutting down... waiting for CIFS shut down (^C aborts)... CIFS local server has shut down... Wed Mar 5 18:04:05 JST [afts31: kern.shutdown:notice]: System shut down because : "reboot". HALT: cluster partner has taken over (fm) on Wed Mar 5 18:04:08 JST 2008 CFE version 1.2.0 based on Broadcom CFE: 1.0.35 Copyright (C) 2000,2001,2002,2003 Broadcom Corporation. Portions Copyright (C) 2002,2003 Network Appliance Corporation. CPU type 0x1040102: 650MHz Total memory: 0x40000000 bytes (1024MB) Starting AUTOBOOT press any key to abort... Loading: 0xffffffff80001000/25888 0xffffffff80007520/13091855 Entry at 0xfffffff f80001000 Starting program at 0xffffffff80001000 Press CTRL-C for special boot menu ...........................................Interconnect based upon M-VIA ERing S upport Copyright (c) 1998-2001 Berkeley Lab http://www.nersc.gov/research/FTG/via Wed Mar 5 09:04:26 GMT [cf.nm.nicTransitionUp:info]: Interconnect link 0 is UP Wed Mar 5 09:04:26 GMT [cf.nm.nicReset:warning]: Initiating soft reset on Clust er Interconnect card 0 due to rendezvous jammed NetApp Release 7.2.3P7: Tue Nov 6 03:34:38 PST 2007 Copyright (c) 1992-2007 Network Appliance, Inc. Starting boot on Wed Mar 5 09:04:25 GMT 2008 Wed Mar 5 09:04:30 GMT [nvram.battery.state:info]: The NVRAM battery is current ly OFF. Wed Mar 5 09:04:30 GMT [nvram.battery.turned.on:info]: The NVRAM battery is tur ned ON. It is turned OFF during system shutdown. Wed Mar 5 09:04:32 GMT [diskown.isEnabled:info]: software ownership has been en abled for this system Reservation confliWaiting for giveback ct Wed Mar 5 09:04:33 GMT [ses.giveback.wait:info]: Enclosure Services will be unavailable while waiting for giveback. found on this node's disks! Local System ID: 84180481 Press Ctrl-C for Maintenance menu to release disks. Waiting for giveback Disk reservationsWed Mar 5 09:06:40 GMT [ses.giveback.restartAfter:info]: Enclo sure Services restarting after release of reservations. hWed Mar 5 09:06:40 GMT [cf.noDiskownShelfCount:info]: Disk shelf count functi onality is not supported on software based disk ownership configurations. ave been released Wed Mar 5 09:06:41 GMT [fmmbx_instanceWorke:info]: normal mailbox instance on l ocal side Wed Mar 5 09:06:41 GMT [fmmb.current.lock.disk:info]: Disk 0b.18 is a local HA mailbox disk. Wed Mar 5 09:06:41 GMT [fmmb.current.lock.disk:info]: Disk 0b.17 is a local HA mailbox disk. Wed Mar 5 09:06:44 GMT [coredump.spare.none:info]: No sparecore disk was found. Wed Mar 5 09:06:45 GMT [fmmbx_instanceWorke:info]: normal mailbox instance on p artner side Wed Mar 5 09:06:45 GMT [fmmb.current.lock.disk:info]: Disk 0b.25 is a partner H A mailbox disk. Wed Mar 5 09:06:45 GMT [fmmb.current.lock.disk:info]: Disk 0b.24 is a partner H A mailbox disk. Wed Mar 5 09:06:45 GMT [cf.fm.partner:info]: Cluster monitor: partner 'afts32' Wed Mar 5 09:06:45 GMT [cf.fm.kernelMismatch:warning]: Cluster monitor: possibl e kernel mismatch detected local 'NetApp/7.2.3P7', partner 'NetApp/7.2.3' Wed Mar 5 09:06:45 GMT [cf.fm.timeMasterStatus:info]: Acting as cluster time ma ster Wed Mar 5 09:06:46 GMT [raid.cksum.replay.summary:info]: Replayed 0 checksum bl ocks. Wed Mar 5 09:06:46 GMT [raid.stripe.replay.summary:info]: Replayed 0 stripes. Wed Mar 5 09:06:47 GMT [localhost: cf.fm.launch:info]: Launching cluster monito r Wed Mar 5 09:06:47 GMT [localhost: cf.fm.partner:info]: Cluster monitor: partne r 'afts32' Wed Mar 5 09:06:47 GMT [localhost: cf.fm.discardNvram:notice]: Cluster monitor: node was previously taken over, nvram may be discarded add net 127.0.0.0: gateway 127.0.0.1 Wed Mar 5 09:06:48 GMT [localhost: vol.language.unspecified:info]: Language not set on volume MyVolOne. Using language config "C". Use vol lang to set language . Wed Mar 5 09:06:48 GMT [localhost: vol.language.unspecified:info]: Language not set on volume vol0. Using language config "C". Use vol lang to set language. Wed Mar 5 09:06:48 GMT [localhost: vol.language.unspecified:info]: Language not set on volume NFSvol. Using language config "C". Use vol lang to set language. Wed Mar 5 09:06:48 GMT [localhost: vol.language.unspecified:info]: Language not set on volume SSvol. Using language config "C". Use vol lang to set language. Wed Mar 5 09:06:48 GMT [localhost: vol.language.unspecified:info]: Language not set on volume SMvola1. Using language config "C". Use vol lang to set language. Wed Mar 5 09:06:48 GMT [localhost: vol.language.unspecified:info]: Language not set on volume SMvola3. Using language config "C". Use vol lang to set language. Wed Mar 5 09:06:48 GMT [localhost: rc:notice]: The system was down for 54 secon ds Wed Mar 5 18:06:49 JST [afts31: cf.fsm.takeoverOfPartnerEnabled:notice]: Cluste r monitor: takeover of afts32 enabled Wed Mar 5 18:06:49 JST [afts31: cf.fsm.takeoverByPartnerEnabled:notice]: Cluste r monitor: takeover of afts31 by afts32 enabled Wed Mar 5 18:06:50 JST [afts31: dfu.firmwareUpToDate:info]: Firmware is up-to-d ate on all disk drives Wed Mar 5 18:06:50 JST [afts31: ltm_services:info]: Ethernet e0a: Link up add net default: gateway 10.30.44.1 Wed Mar 5 18:06:52 JST [afts31: rc:ALERT]: timed: time daemon started Wed Mar 5 18:06:53 JST [afts31: mgr.boot.disk_done:info]: NetApp Release 7.2.3P 7 boot complete. Last disk update written at Wed Mar 5 18:06:02 JST 2008 Wed Mar 5 18:06:53 JST [afts31: mgr.boot.reason_ok:notice]: System rebooted aft er a giveback. Data ONTAP (afts31.hq.netapp.com) login: Data ONTAP (afts31.hq.netapp.com) login: Data ONTAP (afts31.hq.netapp.com) login: Data ONTAP (afts31.hq.netapp.com) login: root Password: afts31> Wed Mar 5 18:07:17 JST [afts31: console_login_mgr:info]: root logged in from console Wed Mar 5 18:07:18 JST [afts31: nbt.nbns.registrationComplete:info]: NBT: All C IFS name registrations have completed for the local server. afts31> afts31> afts31> afts31> afts31> cf status Cluster enabled, afts32 is up. afts31> afts31> afts31> afts31>