1、NetApp,AddingasecondcontrollermoduletocreateanHApairUpgradingthesystemtoanHApairisamIiltistepprocessinvolvingbothhardwareandsoftwarechangesthatmustbeperformedintheproperorder.Beforeyoubegin AnexistingcontrollermodulemustbeinstalledandconfiguredandrunningDataONTAP.Thiscontrollermoduleisreferredtoasth
2、eexistingcontrollermoduleandinexamplesinthisprocedurehastheconsolepromptexistingctlr.Thecontrollermodulethatisbeingaddedisreferredtoasthenewcontrollermoduleandinexamplesinthisprocedurehastheconsolepromptnewctlr.ThenewcontrollermodulemustbereceivedfromNetAppaspartoftheupgradekit.Thisproceduredoesnota
3、pplytomovingacontrollermodulefromapreexistingsystemorasystemthatwaspreviouslyinanHApair. Whenupgradingtoasingle-chassisHApair(anHApairinwhichbothcontrollermodulesresideinasinglechassis),yoursystemmusthaveanemptyslotavailableforthenewcontrollermodule.Note:Thisconfigurationisnotsupportedonallsystems.W
4、henupgradingtoadual-chassisHApair(anHApairinwhichthecontrollermodulesresideinseparatechassis),youmusthaverackspaceandcablesforthenewcontrollermodule.Note:Thisconfigurationisnotsupportedonallsystems.Eachcontrollermodulemustbeconnectedtothenetworkthroughitseaportor,ifyoursystemhasone,theeOMport.Aboutt
5、histaskThisproceduredocsnotapplytosystemsoperatinginCluster-Mode.Thisprocedurecantakeoveranhour,includingthetimetoinitializethedisks.Thetimetoinitializethedisksdependsonthesizeofthedisks.Steps1. Preparingfortheupgradeonpage22. PreparingacontrollermodulewhenusingStorageEncryptiononpage23. Preparingth
6、enctbootserveronpage34. Installingandcablingthenewcontrollermoduleonpage65. AssigninganIPaddress,netbooting,andinstallingDataONTAPonthenewcontrollermoduleonpage76. SettingupDataONTAPonthenewcontrollermoduleonpage87. Addinglicensestobothcontrollermodulesonpage98. Runningsetupontheexistingcontrollermo
7、duletoaddthepartnerIPaddressonpage99. VerifyingandsettingtheHAstateofaFAS22xx,32xx,or62xxcontrollermoduleandchassisonpage910. RebootingbothcontrollermodulesandenablingtheHApaironpageIO11. InstallingthefirmwareafteraddingasecondcontrollermoduleonpageIO12. Cloningtheconfigurationfromtheexistingcontrol
8、lermoduletothenewcontrollermoduleonpage1113. VerifyingtheconfigurationwiththeConfigurationCheckeronpage1114. SettingupStorageEncryptiononthenewcontrollermoduleonpage12PreparingfortheupgradeTopreparefortheupgradetoanHApair,youmustmakesurethatyoursystemmeetsallrequirementsandthatyouhaveallrequiredinfb
9、nation.Steps1. Ensurethatyoursystemhasatleastthreeunowneddisksforthenewcontrollermodulebyenteringthefollowingcommandontheexistingcontrollermodule:diskshow-nTwodisksarcrequiredforfilesysteminstallationandthethirdisaspare.Thesethreearcinadditiontoasparediskfortheexistingcontrollermodule.Ifyouareadding
10、disksordiskshelvestoyoursystem,seetheDataONTAPStorageManagementGuideforyourversionofDataONTAPontheNetAppSupportSite.Note:InDataONTAP8.x,youmustsettheauto_assignoptiontooffontheexistingcontrollermodulebeforeaddinganynewdisks.SeetheontheNetAppSupportSiteformoreinfbnation.2. Ensurethatyouhavenetworkcab
11、lesandstoragecablesready.3. Ensurethatyouhaveaserialportconsoleavailableforthecontrollermodules.4. ReviewtheSiteRequirementsGuideontheNctAppSupportSiteandgatherallIPaddressesandothernetworkparametersforthenewcontrollermodule.PreparingacontrollermodulewhenusingStorageEncryptionIftheexistingcontroller
12、moduleisconfiguredforStorageEncryption,youmustgatherinformationfromthesystemandrekeytheSeInenCryPlingdisks(SEDs)beforeproceedingtoaddthenewcontrollermodule.Steps1. EnterthefollowingcommandandnotethekeyIDsonalldiskdrivesthatarcusingStorageEncryption:diskencryptshowExampleThecommanddisplaysthestatusof
13、eachself-encryptingdisk:storage-systemdiskencryptshowDiskKeyIDSsssss e e e e e YYYYYY0c.00.1080CFOC8000000000100000000000000A948EE8604F4598ADFFB185B5BB7FED30c.00,0080CFOC8000000000100000000000000A94EEB604F4598ADFFB185B5BB7FED30c.00,3080CFOC8000000000100000000000000A948三三8604F4598ADFFB185B5BB7FED30c.
14、00,4080CFOC8000000000100000000000000A948EE8604F4598ADFFB185B5BB7FED30c.00,2080CFOC8000000000100000000000000A948EE8604F4598ADFFB185B5BB7FED30c.00.5080CFOC8000000000100000000000000A948EE8604F4598ADFFB185B5BB7FED32. Enterthefollowingcommandandnoteallthenecessarycertificatefiles(client.pern,client_priva
15、te.pem,andip_address_key_server_Ch.pern)thathavebeeninstalled:keymgrlistcert1.aterintheprocedureyouneedtoinstallthesesamecertificatefilesonthenewpartnercontrollermodule.3. EnterthefollowingcommandtoidentifytheIPaddressofthekeySerVerorservers:key_managershowAllexternalkeymanagementserversassociatedwi
16、ththestoragesystemarelisted.Laterintheprocedureyouwillneedtoaddthesesamekeyserversonthenewpartnercontrollermodule.ExampleThefollowingcommanddisplaysallexternalkeymanagementserversassociatedwiththestoragesystem:storage-systemkey_managershow172.18.99.175-4. EnterthefollowingcommandandcheckthatthekeyID
17、slistedmatchthoseshownbythediskencryptshowcommandissuedinStep1ofthisprocedure:key_managerqueryExampleThefollowingcommandchecksthestatusofallkeymanagementserverslinkedtothestoragesystemanddisplaysadditionalinformation:storage-systemkey_managerqueryKeyserver172.18.99.175reports4keys.KeytagKeyIDstorage
18、system080CF0C80.storage-system080CF0C80.storage-system080CF0C80.storage-system080CF0C80.5. Backupalldataonallaggregatesusingstandardmethodsforyoursite.6. EnterthefollowingcommandtoresettheauthenticationkeyonthedrivesusingStorageEncryptiontotheirManufacturingSystemID(MSID):diskencryptrekeyOxO*Makesu
19、rethattherearcnodiskencryptrekeyfailures.PreparingthenetbootserverHowyoupreparetonetbootdependsontheversionofDataONTAPyouarerunning.Choices PreparingthenetbootserverinDataONTAP8.xonpage3 PreparingthenetbootserverinDataONTAP7.3.xonpage4PreparingthenetbootserverinDataONTAP8.xYoumustdownloadthecorrectD
20、ataONTAPnetbootimagefromtheNetAppSupportSitetothenetbootserverandknowitsIPaddress.Beforeyoubegin Youmusthaveanattachedcomputerwithaccesstotheexistingstoragesystemtocopyfiles.Seetheformoreinformationaboutaccessingfilesinthestoragesystem,s/etcdirectories.YoumusthaveaccesstotheNetAppSupportS.Thisenable
21、syoutodownloadthenecessarysystemfiles.Aboutthistask YoumustdownloadthenetbootimageforthesameversionofDataONTAPthatisrunningonthenewcontrollermodule.BothcontrollermodulesintheHApairmustrunthesameversionofDataONTAP.ThisproceduredoesnotapplytosystemsoperatinginCluster-Mode.Steps1. Identifythelocationof
22、therootdirectoryforhttpdfilesor,ifnoneisconfigured,configurethedirectory.Thislocationismaintainedinthehttpd.rootdiroption.YoucandisplaythevaluewiththefollowingcommandattheDataONTAPprompt:existing_ctlroptionshttpd.rootdirThisdirectoryisreferredtoastheweb-accessibledirectoryinthefollowingsteps.Ifyouha
23、vecreatedarootdirectory(forexample,volO),youcansetthehttpd.rootdiroptiontothatdirectorywiththefollowingcommandattheDataONTAPprompt:existing_ctlroptionshttpd.rootdirvolvolO2. Downloadandextractthefileusedforperformingthenctbootofyoursystem:a) Downloadtheappropriatenetboot.tgzfileforyourplatformfromth
24、eNetAppSupportSitetoaweb-accessibledirectory.b) Changetotheweb-accessibledirectory.c) Extractthecontentsofthenetboot.tgzfiletothetargetdirectorybyenteringthefollowingcommand:tar-zxvfnetboot.tgzYourdirectorylistingshouldcontainthefollowingdirectory:netboot/3. Downloadtheimage.tgzfilefromtheNetAppSupp
25、ortSitetotheweb-accessibledirectory.Yourdirectorylistingshouldcontainthefollowingfileanddirectory:image.tgznetboot/4. DeterminetheIPaddressoftheexistingcontrollermodule.Thisaddressisreferredtolaterinthisprocedureasip-address-of-existingcontroller.5. Pingip-address-of-existingcontrollertoensurethatth
26、eaddressisaliveandreachable.PreparingthenetbootserverinDataONTAP7.3.xYoumustcopyfilesfromtheexistingcontrollermodules/etcdirectoriestothehttpdrootdirectoryandknowtheexistingcontrollermodulesIPaddress.BeforeyoubeginYoumusthaveanattachedcomputerwithaccesstotheexistingstoragesystemtocopyfiles.SectheDat
27、aONTAPSystemAdministrationGuideformoreinformationaboutaccessingfilesinthestoragesystems/etcdirectories.YoumusthaveaccesstotheNctAppSupportS.Thisenablesyoutodownloadthenecessarysystemfiles.AboutthistaskDataONTAP7.3.xdoesnotsupportallsystems.SeetheSystemConfigurationGforsupportedsystems.Youmustdownloa
28、dthenctbootimageforthesameversionofDataONTAPthatisrunningontheexistingcontrollermodule.BothcontrollermodulesintheHApairmustrunthesameversionofDataONTAP.Steps1. Copythefollowingbootimagefilesfromthecontrollermodulesetcbootandetcsoftwaredirectorytotherootdirectoryforhttpdfiles:a)Determinetherootdirect
29、oryforhttpdfiles.Ifhttpdis.Then.ConfiguredEnterthefollowingcommandattheexistingcontrollermodulesDataONTAPprompttodisplaytherootdirectory:optionshttpd.rootdirhttpd.rootdirThesystemdisplaysthefollowingoutput:httpd.rootdirvolvolOexisting_ctlrIntheprecedingexample,thelocationisvolvolO.Notconfigureda. En
30、ablehttpdbyenteringthefollowingcommandattheexistingcontrollermodulesDataONTAPprompt:optionshttpd.enableonb. Verifythatyoucanviewthefilesintheweb-accessibledirectorybyenteringthefollowingcommandattheexistingcontrollermodulesDataONTAPprompt:optionshttpd.autoindex.enableonC.Settherootdirectorybyenterin
31、gthefollowingcommandattheexistingcontrollermodulesDataONTAPprompt:optionshttpd.rootdirvolvolOb)Copythefollowingfilesfromtheexistingcontrollermodulesetcbootandetcsoftwaredirectoriestotherootdirectoryidentifiedinthepreviousstep:,Fromtheetcbootdirectory,copythefilewithanamesimilartonetapp-x86-64.Fromth
32、eZetcZsoftware/directory,copytheDataONTAPimagefilewithanamesimilartosetup.exe.2. EnterthefollowingcommandtodeterminetheIPaddressoftheexistingcontrollermodule(referredtointhisprocedureasip-address-of-existingcontroller):ifconfig-aExampleInthefollowingexample,theip-address-of-existingcontrolleris172.2
33、2.133.8:existing_ctlrifconfig-aeOM:flags=948043UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUMmtu1500inet172.22.133.8netmaskOxffffeOOObroadcast172.22.159.255partnerinet172.22.130.194(notinuse)ether00:a0:98:09:08:8c(auto-100tx-fd-up)flowcontrolfullexisting_ctlrInstallingandcablingthenewcontrollermoduleYoumus
34、tphysicallyinstallthenewcontrollermoduleinthechassisandcableit.Steps1. Ifyouarenotalreadygrounded,properlygroundyourself.2. Physicallyinstallthenewcontrollermoduleand,ifnecessary,additionalfans:If you are adding a controller module.Then perform these steps.To an empty bay to create a single-chassis
35、HA pair between 3lxxor 62IO controller modulesTo an empty bay to create a single-chassis HA pair between 32xx, FAS22xx, or FAS20xx controller modulesInstall the new system in the rack or system cabinet.a. Installthreeadditionalfansinthechassistocoolthenewcontrollermodule:a. Removethebezelbyusingboth
36、handstoholditbytheopeningsoneachside,andthenpullthebezelawayfromthechassisuntilitreleasesfromthefourballstudsonthechassisframe.b. Removetheblankplatethatcoversthebaythatwillcontainthenewfans.c. InstallthefansasdescribedintheReplacingaFanModuledocumentforyoursystemontheNctAppSupportSite.b. Removetheb
37、lankplateintherearofthechassisthatcoverstheemptybaythatwillcontainthenewcontrollermodule.C.Gentlypushthecontrollermodulehalfvayintothechassis.SeethesystemsHardwareOverviewontheNetAppSupportSiteforanillustration.a. Removetheblankplateintherearofthechassisthatcoverstheemptybaythatwillcontainthenewcont
38、rollermodule.b. Gentlypushthecontrollermodulehalfwayintothechassis.Topreventthecontrollermodulefromautomaticallybting,donotfullyseatitinthechassisuntillaterinthisprocedure.Sccthesystcm,sHardwareOverviewontheNctAppSupportSiteforanillustration.InaseparatechassisfromitsHApartnertocreateadual-chassisHAp
39、air3. CabletheHAinterconnect(ifnecessary)andthediskshelvesasnecessary.SeethesystemsInstallationandSetupInstructions,theDataONTAPHigh-AvailabilityConfigurationGuideorActive/ActiveConfigurationGuideforyourversionofDataONTAP,and,ifapplicable,theUniversalSASandACPCablingGuide.4. Dependingonyourconfigura
40、tion,powerupthenewcontrollermoduleandinterruptthebootprocess:Ifthenewcontrollermoduleis.Then.Inthesamechassisastheexistingcontrollermodulea. Pushthecontrollermodulefirmlyintothebay.Whenfullyseated,thecontrollermodulereceivespowerandautomaticallyboots.b. IntermptthebootprocessbypressingCtrl-c.Inasepa
41、ratechassisfromtheexistingcontrollermodulea. Tumonthepowersuppliesonthenewcontrollermodule.b. InterruptthebootprocessbypressingCtrl-c.Thesystemdisplaysthebootenvironmentprompt(LOADER,LOADER-A,orLOADER-B).Note:Ifthereisnobtenvironmentprompt,recordtheerrormessageandcontacttechnicalsupport.Ifthesystemd
42、isplaysthebootmenu,rebootandattempttointerruptthebootprocessagain.AssigninganIPaddress,netbooting,andinstallingDataONTAPonthenewcontrollermoduleTobootthenewcontrollermoduleandinstalltheoperatingsystemonit,youmustperformaspecificsequenceofsteps.AboutthistaskThisprocedureincludesinitializingdisks.Thet
43、imetoinitializethedisksdependsonthesizeofthedisks.Thesystemautomaticallyassignstwodiskstothenewcontrollermodule.SeetheStorageManagementGuideforyourversionofDataONTAPforinformationaboutmanagingdisksandassigningadditionaldisks.Steps1. Enterthefollowingcommandsatthebootenvironmentprompt(LOADER,LOADER-A
44、orLOADER-B)toconfiguretheIPaddressofthenewcontrollermodule:IfDHCPis.Thenenterthefollowingcommand.AvailableifconfigeOM-autoNotavailableifconfigeOM-addr=new_controller_ip_address-mask=255.255.x.x-gw=x.xx.x.-dns=xxx.xxx.-domainyourC2. Nctbootthenewcontrollermodule,usingtheappropriatecommandsandfilesfo
45、ryourversionofDataONTAP.IfyourversionofDataEnterthefollowingcommandattheLOADERprompt:ONTAPis.7 3xnetboothttp:/ip-address-of-existingcontro!2ernetapp-x86-64ip-address-of-existingcontrolleristheIPaddressdeterminedwhenyouwerepreparingthenetbootserver.8 .xoperatingin7-Modenetboothttp:/ip-address-of-exis
46、tingcontrolIer/netboot/kernelip-address-of-existingcontrolleristheIPaddressdeterminedwhenyouwerepreparingthenetbootsen,er.Thenewcontrollermodulebtsandthebootmenuisdisplayed.3. Selecttheappropriateoptioninthebootmenu,dependingonyourversionofDataONTAP.IfyourversionofThen.DataONTAPis.73.xDependingonthe
47、typeofrootvolumeyourequire,select4)Initializealldisksor4a)foraflexiblerootvolume.8.x operating in 7- ModeIfyourversionofThen.DataONTAPis.a. SelecttheoptionInstallnewsoftwarefirstfromtheboolmenu.ThisbootmenuoptiondownloadsandinstallsthenewDataONTAPimagetothebootdevice.b. Duringthesoftwareinstallationprocess,whenyouarepromptedfortheURLoftheimage.tgzfile,enterthepathasfollows:http:/ip-address-of-existingcontrol2erimage.tgzAfterthesoftwareinstallationiscomplete,youarepromptedtorebootthesystem.C.Rebootthesystem.Thesystem