版 本 | 日 期 | 作 者 | 版本说明 |
|---|---|---|---|
1.0 | 20140728 | NetApp 安装配置文档 | |
2.0 | 20160421 | RAC 系统升级后，根据要求重新调整卷配置 |
目录
一、概述
本文档主要记录了在XXX NetApp 存储实施的相关信息，主要内容包括存储的配置信息、存储部署架构、安装配置流程、基本维护操作等。本文旨在记录NetApp存储的安装实施过程及相关配置信息，以供存档和后续维护查看，并不对相关概念和操作进行原理性的解释说明。
二、NetApp 存储配置信息
2.1、产品配置
产品名称 | 产品描述 | 单位 | 数量 |
Netapp FAS3220 HA | 1） 2个存储控制器，每个存储控制器含4个10Gb SFP+端口（含10GB SFP+ 光模块），4个6GB SAS接口，2个8GB集群接口及相应的软件配置； 2） 2个磁盘柜，每个磁盘柜配置24块600GB 10k SAS硬盘； 3）SAS连接线缆、电源线、安装导轨、集群连接线等附件； 4）存储标准配套软件 | 套 | 1 |
三、存储部署架
3.1、存储架构图
3.2、部署架构说明
- NetApp 控制器A（上面）1口（逻辑端口，由两个物理接口组成）连接 DELL N4032F交换机（上面）21 22口
- NetApp 控制器A（上面）2口（逻辑端口，由两个物理接口组成）连接 DELL N4032F交换机（下面）21 22口
- NetApp 控制器B（上面）3口（逻辑端口，由两个物理接口组成）连接 DELL N4032F交换机（上面）23 24口
- NetApp 控制器B（上面）4口（逻辑端口，由两个物理接口组成）连接 DELL N4032F交换机（下面）23 24口
- DELL N4032F为10GB 以太网光纤交换机
- NetAPP FAS3220 控制器的PCI-E 1槽通过HA线进行连接，用于集群间的数据通信
- NetAPP FAS3220 控制器的PCI-E 2 3槽，用于和外部主机进行数据传输
- 其中Vmware 虚拟化集群有6台服务器；Windows服务器为2台Windows 2012 的服务器；数据库服务器为2台Linux 服务器
四、NetAPP 存储配置信息
4.1、登录信息：
登录方式：
通过telnet 或 NetApp OnCommand System Manager ,通过NetApp OnCommand System Manager图示：
4.2、卷划分
应用系统 | 控制器 | LUN | 大小 | 备注 |
Vmware虚拟化 | A控制器 | /vol/vol_vm1/lun1 | 3.9T | |
Vmware虚拟化 | B控制器 | /vol/vol_vm2/lun2 | 2.0T | |
Oracle for linux | B控制器 | /vol/Vol/ora_data1/LUN_ora_data1 | 200G | ASM 数据盘，RAC两节点共享 |
Oracle for linux | B控制器 | /vol/Vol/ora_data2/LUN_ora_data2 | 200G | ASM 数据盘，RAC两节点共享 |
Oracle for linux | B控制器 | /vol/Vol/ora_data3/LUN_ora_data3 | 200G | ASM 数据盘，RAC两节点共享 |
Oracle for linux | B控制器 | /vol/Vol/ora_vote1/LUN_ora_vote1 | 2G | RAC仲裁盘 |
Oracle for linux | B控制器 | /vol/Vol/ora_vote2/LUN_ora_vote2 | 2G | RAC仲裁盘 |
Oracle for linux | B控制器 | /vol/Vol/ora_vote3/LUN_ora_vote3 | 2G | RAC仲裁盘 |
Windows 2012 | B控制器 | /vol/vol_win1/lun4 | 1000G | 共享卷 |
Windows 2012 | B控制器 | /vol/vol_win1/lun4 | 1000G |
五、初始化安装配置过程
5.1、存储初始化
NetApp FAS是NetApp产品中一款有双机头的磁盘阵列，在出厂时预先会安装好Data OnTap 操作系统 ，需要先在每个机头中配置好操作系统，才能正常使用。
配置步骤如下：
首次配置，需要连接到console口，波特率 9600
1， 通过笔记本电脑或其它Windows平台PC机的串口，连接到机头上的串口上；
- 2， 通过超级终端，以默认值连接来进行操作，进入配置画面。通过setup 命令进行初始化的配置：
fas3220b> setup
The setup command will rewrite the /etc/rc, /etc/exports,
/etc/hosts, /etc/hosts.equiv, /etc/dgateways, /etc/nsswitch.conf,
and /etc/resolv.conf files, saving the original contents of
these files in .bak files (e.g. /etc/exports.bak).
Are you sure you want to continue? [yes]
NetApp Release 8.1.3 7-Mode: Sat Jun 8 08:11:51 PDT 2013
System ID: 2017886331 (fas3220b); partner ID: 2017870126 (fas3220a)
System Serial Number: 450000056236 (fas3220b)
System Rev: B7
System Storage Configuration: Multi-Path HA
System ACP Connectivity: NA
slot 0: System Board
Processors: 4
Processor type: Intel(R) Xeon(R) CPU L5410 @ 2.33GHz
Memory Size: 12288 MB
Memory Attributes: Bank Interleaving
Hoisting
Rank Interleaving
Chipkill ECC
Service Processor Status: Online
IOXM Status: present
Power: Good
Agent version: N/A
Serial Number: 9441912947
Part Number: 111-00647
Version: D1
slot 0: Dual 10G Ethernet Controller T320E-SFP/KR
c0a MAC Address: 00:a0:98:55:9a:8c (auto-unknown-enabling)
c0b MAC Address: 00:a0:98:55:9a:8d (auto-unknown-enabling)
slot 0: Internal BGE 10/100 Ethernet Controller
e0M MAC Address: 00:a0:98:55:9a:8e (auto-100tx-fd-down)
e0P MAC Address: 00:a0:98:55:9a:8f (auto-100tx-fd-up)
slot 0: Dual 10/100/1000 Ethernet Controller G20
e0a MAC Address: 00:a0:98:55:9a:8a (auto-unknown-down)
e0b MAC Address: 00:a0:98:55:9a:8b (auto-unknown-down)
slot 0: SAS Host Adapter 0a
24 Disks: 13440.0GB
1 shelf with IOM6
slot 0: SAS Host Adapter 0b
24 Disks: 13440.0GB
1 shelf with IOM6
slot 0: FC Host Adapter 0c
slot 0: FC Host Adapter 0d
slot 0: Intel ICH USB EHCI Adapter u0a (0xdfb01400)
boot0 Micron Technology Real SSD eUSB 2GB, class 0/0, rev 2.00/11.10, addr 2 1936MB 512B/sect (0FF0022700323779)
slot 1: Dual 10 Gigabit Ethernet Controller IX1-SFP+
e1a MAC Address: 90:e2:ba:54:e4:dc (auto-10g_sr-fd-up)
e1b MAC Address: 90:e2:ba:54:e4:dd (auto-10g_sr-fd-up)
slot 2: Dual 10 Gigabit Ethernet Controller IX1-SFP+
e2a MAC Address: 90:e2:ba:56:22:7c (auto-10g_sr-fd-up)
e2b MAC Address: 90:e2:ba:56:22:7d (auto-10g_sr-fd-up)
slot 3: SAS Host Adapter 3a
slot 3: SAS Host Adapter 3b
24 Disks: 13440.0GB
1 shelf with IOM6
slot 3: SAS Host Adapter 3c
24 Disks: 13440.0GB
1 shelf with IOM6
slot 3: SAS Host Adapter 3d
slot 5: FCVI Host Adapter 5a
slot 5: FCVI Host Adapter 5b
Please enter the new hostname [fas3220b]: #配置主机名
Do you want to enable IPv6? [n]: Thu Jul 24 02:42:00 GMT [fas3220b:monitor.globalStatus.ok:info]: The system's global status is normal.
Do you want to configure interface groups? [y]: #是否需要配置接口组
Number of interface groups to configure? [1] 2 #配置接口组的数量
Name of interface group #1 [vif1]: #配置接口组名称
Is vif1 a single [s], multi [m] or a lacp [l] interface group? [s] #端口状态
#single ---active-standby
#Multi ---active-active
Number of links for vif1? [2] #几个物理端口绑定成一个vif
Name of link #1 for vif1 [e0a]: e1a #端口名字（name可在端口下面看到）
Name of link #2 for vif1 [e0b]: e1b
Name of interface group #2 []: vif2
Is vif2 a single [s], multi [m] or a lacp [l] interface group? [m] s
Number of links for vif2? [0] 2
Name of link #1 for vif2 []: e2a
Name of link #2 for vif2 []: e2b
Please enter the IP address for Network Interface vif1 [10.150.208.9]: 192.168.100.3
#设置vif1 的IP地址
Please enter the netmask for Network Interface vif1 [255.255.255.0]: #子网掩码
Should interface group vif1 take over a partner interface group during failover? [y]:
#是否允许虚拟网卡在故障切换时切换到另一个机头上，这里输入y
Please enter the partner interface name to be taken over by vif1 [vif1]:
#输入另一个机头上的会被切换过来的虚拟网卡的名字
Please enter the IP address for Network Interface vif2 []: 192.168.100.4
#设置vif2 的IP地址
Please enter the netmask for Network Interface vif2 [255.255.255.0]:
Should interface group vif2 take over a partner interface group during failover? [n]: y
#是否允许虚拟网卡在故障切换时切换到另一个机头上，这里输入y
Please enter the partner interface name to be taken over by vif2 []: vif2
#输入vif2另一个机头上的会被切换过来的虚拟网卡的名字
Please enter the IP address for Network Interface e0a []: 10.150.208.9
#设置e0a 管理端口的IP地址
Please enter the netmask for Network Interface e0a [255.0.0.0]: 255.255.255.0 #设置子网掩码
Should interface e0a take over a partner IP address during failover? [n]: y
#是否允许e0a在故障切换时切换到另一个机头上，这里输入y
Please enter the IPv4 address or interface name to be taken over by e0a []: e0a
#输入e0a另一个机头上的会被切换过来的网卡的名字
Please enter media type for e0a {100tx-fd, tp-fd, 100tx, tp, auto (10/100/1000)} [auto]:
#设置网卡类型，这里设置为自适应
Please enter flow control for e0a {none, receive, send, full} [full]:
Do you want e0a to support jumbo frames? [n]: #是否允许巨型帧
Please enter the IP address for Network Interface e0b []: Thu Jul 24 02:43:41 GMT [fas3220b:cf.fsm.partnerOk:notice]: Failover monitor: partner ok
Thu Jul 24 02:43:41 GMT [fas3220b:cf.fsm.takeoverOfPartnerDisabled:notice]: Failover monitor: takeover of fas3220a disabled (interconnect error).
Thu Jul 24 02:43:41 GMT [fas3220b:cf.fsm.takeoverByPartnerDisabled:notice]: Failover monitor: takeover of fas3220b by fas3220a disabled (interconnect error).
Thu Jul 24 02:43:43 GMT [fas3220b:cf.hwassist.DefaultPrtnrAddr:notice]: The system automatically chose 192.168.2.110 as the hardware-assist partner address. If you want to use a different IP address, change it using the command 'options cf.hw_assist.partner.address'.
Thu Jul 24 02:43:43 GMT [fas3220b:cf.hwassist.socBindFailed:error]: hw_assist: bind failed to port 4444 on IP address 192.168.1.219. Error 49
Should interface e0b take over a partner IP address during failover? [n]: Thu Jul 24 02:43:43 GMT [fas3220b:cf.hwassist.localMonitor:warning]: hw_assist: hw_assist functionality is inactive.
Please enter the IP address for FC Network Interface ql5a []: #直接回车
Should interface ql5a take over a partner IP address during failover? [n]:
Please enter the IP address for FC Network Interface ql5b []:
Should interface ql5b take over a partner IP address during failover? [n]:
e0M is a Data ONTAP dedicated management port.
NOTE: Dedicated management ports cannot be used for data
protocols (NFS, CIFS, iSCSI, NDMP or Snap*),
and if they are configured they should be on an isolated management LAN.
The default route will use dedicated mgmt ports only as the last resort,
since data protocol traffic will be blocked by default.
Please enter the IP address for Network Interface e0M []: #直接回车
Should interface e0M take over a partner IP address during failover? [n]:
Please enter the name or IP address of the IPv4 default gateway [10.150.208.254]: 192.168.100.254 #设置数据端口的网关
The administration host is given root access to the filer's
/etc files for system administration. To allow /etc root access
to all NFS clients enter RETURN below.
Please enter the name or IP address of the administration host:
#输入超级管理主机的主机名或IP地址，没有就直接回车；
Please enter timezone [GMT]: #设置时区
Thu Jul 24 02:44:00 GMT [fas3220b:monitor.globalStatus.critical:CRITICAL]: Controller failover of fas3220a is not possible: interconnect error.
Thu Jul 24 02:44:01 GMT [fas3220b:cf.hwassist.DefaultPrtnrAddr:notice]: The system automatically chose 192.168.2.110 as the hardware-assist partner address. If you want to use a different IP address, change it using the command 'options cf.hw_assist.partner.address'.
Asia/Shanghai
Where is the filer located? [zhoushan]: #问磁盘阵列设备的位置，可以随便写
Enter the root directory for HTTP files [/vol/vol0/home/http]:
Do you want to run DNS resolver? [n]: #配置DNS，不需要设置就直接回车
Do you want to run NIS client? [n]:
This system will send event messages and weekly reports to NetApp Technical Support. To disable this feature, enter "options autosupport.support.enable off" within 24 hours. Enabling AutoSupport can significantly speed problem determination and resolution should a problem occur on your system. For further information on AutoSupport, please see: http://now.netapp.com/autosupport/
Press the return key to continue.
The Service Processor (SP) provides remote management capabilities
including console redirection, logging and power control.
It also extends autosupport by sending
additional system event alerts. Your autosupport settings are used
for sending these alerts via email over the SP LAN interface.
Would you like to configure the SP LAN interface [y]:
#是否配置远程管理服务地址，这里输入y
Would you like to enable DHCP on the SP LAN interface [n]: #不使用DHCP
Please enter the IP address for the SP [10.150.208.10]: #设置远程管理服务的地址
Please enter the netmask for the SP [255.255.255.0]:
Please enter the IP address for the SP gateway [10.150.208.254]:
The mail host is required by your system to send SP
alerts and local autosupport email.
Please enter the name or IP address of the mail host [mailhost]:
#配置autosupport 邮件服务器，不需要就直接回车
You may use the autosupport options to configure alert destinations.
The initial aggregate currently contains 3 disks; you may add more
disks to it later using the "aggr add" command.
Now type 'reboot' for changes to take effect.
fas3220b>
fas3220b>
fas3220b>
fas3220b> reboot #配置重启生效
A filer can be configured for multiprotocol access, or as an NTFS-only
filer. Since multiple protocols are currently licensed on this filer,
we recommend that you configure this filer as a multiprotocol filer
(1) Multiprotocol filer
(2) NTFS-only filer
Selection (1-2)? [1]: #设置设置的类型，这里设置为多协议的存储失败
Wed Jul 23 11:06:53 GMT [fas3220b:cf.hwassist.Default.NodemgmtAddr:notice]: The system automatically chose 192.168.1.219 as the local hardware-assist IP address.
Wed Jul 23 11:06:56 GMT [fas3220b:cf.hwassist.DefaultPrtnrAddr:notice]: The system automatically chose 192.168.2.110 as the hardware-assist partner address. If you want to use a different IP address, change it using the command 'options cf.hw_assist.partner.address'.
CIFS requires local /etc/passwd and /etc/group files and default files
will be created. The default passwd file contains entries for 'root',
'pcuser', and 'nobody'.
Enter the password for the root user []: # 配置超级管理用户
Wed Jul 23 11:07:00 GMT [fas3220b:monitor.globalStatus.critical:CRITICAL]: Controller failover of fas3220a is not possible: Controller Failover takeover disabled.
Retype the password: #设置超级用户密码
The default name for this CIFS server is 'FAS3220B'.
Would you like to change this name? [n]:
Data ONTAP CIFS services support four styles of user authentication.
Choose the one from the list below that best suits your situation.
(1) Active Directory domain authentication (Active Directory domains only)
(2) Windows NT 4 domain authentication (Windows NT or Active Directory domains)
(3) Windows Workgroup authentication using the filer's local user accounts
(4) /etc/passwd and/or NIS/LDAP authentication
Selection (1-4)? [1]: #设置认证方式
Wed Jul 23 11:07:08 GMT [fas3220b:diskown.RescanMessageFailed:warning]: Could not send rescan message to fas3220a. Please type disk show on the console of fas3220a for it to scan the newly inserted disks.
3
What is the name of the Workgroup? [WORKGROUP]:
rpc failed: RPC: Timed out
Wed Jul 23 11:07:12 GMT [fas3220b:passwd.changed:info]: passwd for user 'root' changed.
CIFS - Starting SMB protocol...
It is recommended that you create the local administrator account
(FAS3220B\administrator) for this filer.
Do you want to create the FAS3220B\administrator account? [y]:
Enter the new password for FAS3220B\administrator:
Retype the password:
Welcome
to the
Data ONTAP (fas3220b.)
login: WORKGROUP Windows(R) workgroup
CIFS local server is running.
Wed Jul 23 11:07:22 GMT [fas3220b:nbt.nbns.socketError:error]: NBT: Cannot send broadcast message on NBNS socket. Error 0x32: Network is down.
Data ONTAP (fas3220b.)
login: root
Password:
fas3220b>
Wed Jul 23 11:07:35 GMT [fas3220b: console_login_mgr:info]: root logged in from console
Wed Jul 23 11:07:36 GMT [fas3220b:nbt.nbns.registrationComplete:info]: NBT: All CIFS name registrations have completed for the local server.
5.2、查看配置，输入许可
fas3220b>
fas3220b> sysconfig -r
#查看硬盘信息
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3c.10.0 3c 10 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0a.10.1 0a 10 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.2 3c 10 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.10.3 0a 10 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.5 0a 10 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.7 0a 10 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.9 0a 10 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.11 0a 10 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.13 0a 10 13 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.15 0a 10 15 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.17 0a 10 17 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.19 0a 10 19 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.21 0a 10 21 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.23 0a 10 23 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.4 3c 10 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.6 3c 10 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.8 3c 10 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.10 3c 10 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.12 3c 10 12 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.14 3c 10 14 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.16 3c 10 16 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.18 3c 10 18 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.20 3c 10 20 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.22 3c 10 22 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3b.00.3 3b 0 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.6 0b 0 6 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.18 0b 0 18 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.19 3b 0 19 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.4 0b 0 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.20 0b 0 20 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.0 0b 0 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.12 0b 0 12 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.10 0b 0 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.16 0b 0 16 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.14 0b 0 14 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.8 0b 0 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.22 0b 0 22 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.15 3b 0 15 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.1 3b 0 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.9 3b 0 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.23 3b 0 23 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.13 3b 0 13 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.5 3b 0 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.11 3b 0 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.7 3b 0 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.21 3b 0 21 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.17 3b 0 17 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.2 0b 0 2 SA:A 0 SAS 10000 0/0 560208/1147307696
fas3220b> Wed Jul 23 11:07:46 GMT [fas3220b:callhome.performance.snap:info]: Call home for PERFORMANCE SNAPSHOT
fas3220b> Wed Jul 23 11:07:50 GMT [fas3220b:wafl.groupCP.enable:info]: WAFL Group-CP has been enabled.
fas3220b> cf status
Controller Failover disabled.
RDMA Interconnect is down (Link 0 down, Link 1 down).
fas3220b>
fas3220b> sysconfig
NetApp Release 8.1.3 7-Mode: Sat Jun 8 08:11:51 PDT 2013
System ID: 2017886331 (fas3220b); partner ID: 2017870126 (fas3220a)
System Serial Number: 450000056236 (fas3220b)
System Rev: B7
System Storage Configuration: Multi-Path HA
System ACP Connectivity: NA
slot 0: System Board
Processors: 4
Processor type: Intel(R) Xeon(R) CPU L5410 @ 2.33GHz
Memory Size: 12288 MB
Memory Attributes: Bank Interleaving
Hoisting
Rank Interleaving
Chipkill ECC
Service Processor Status: Online
IOXM Status: present
Power: Good
Agent version: N/A
Serial Number: 9441912947
Part Number: 111-00647
Version: D1
slot 0: Dual 10G Ethernet Controller T320E-SFP/KR
c0a MAC Address: 00:a0:98:55:9a:8c (auto-unknown-enabling)
c0b MAC Address: 00:a0:98:55:9a:8d (auto-unknown-enabling)
slot 0: Internal BGE 10/100 Ethernet Controller
e0M MAC Address: 00:a0:98:55:9a:8e (auto-unknown-down)
e0P MAC Address: 00:a0:98:55:9a:8f (auto-100tx-fd-up)
slot 0: Dual 10/100/1000 Ethernet Controller G20
e0a MAC Address: 00:a0:98:55:9a:8a (auto-unknown-down)
e0b MAC Address: 00:a0:98:55:9a:8b (auto-unknown-down)
slot 0: SAS Host Adapter 0a
24 Disks: 13440.0GB
1 shelf with IOM6
slot 0: SAS Host Adapter 0b
24 Disks: 13440.0GB
1 shelf with IOM6
slot 0: FC Host Adapter 0c
slot 0: FC Host Adapter 0d
slot 0: Intel ICH USB EHCI Adapter u0a (0xdfb01400)
boot0 Micron Technology Real SSD eUSB 2GB, class 0/0, rev 2.00/11.10, addr 2 1936MB 512B/sect (0FF0022700323779)
slot 1: Dual 10 Gigabit Ethernet Controller IX1-SFP+
e1a MAC Address: 90:e2:ba:54:e4:dc (auto-unknown-down)
e1b MAC Address: 90:e2:ba:54:e4:dd (auto-unknown-down)
slot 2: Dual 10 Gigabit Ethernet Controller IX1-SFP+
e2a MAC Address: 90:e2:ba:56:22:7c (auto-unknown-down)
e2b MAC Address: 90:e2:ba:56:22:7d (auto-unknown-down)
slot 3: SAS Host Adapter 3a
slot 3: SAS Host Adapter 3b
24 Disks: 13440.0GB
1 shelf with IOM6
slot 3: SAS Host Adapter 3c
24 Disks: 13440.0GB
1 shelf with IOM6
slot 3: SAS Host Adapter 3d
slot 5: FCVI Host Adapter 5a
slot 5: FCVI Host Adapter 5b
fas3220b> fcadmin config
Local
Adapter Type State Status
---------------------------------------------------
0c initiator CONFIGURED. offline
0d initiator CONFIGURED. offline
fas3220b> ifconfig -a
#查看网卡配置
e0a: flags=0xa70c867<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
ether 02:a0:98:55:9a:8a (auto-unknown-down) flowcontrol full
trunked vif1
e0b: flags=0xa70c867<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
ether 02:a0:98:55:9a:8a (auto-unknown-down) flowcontrol full
trunked vif1
e1a: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500
ether 90:e2:ba:54:e4:dc (auto-unknown-down) flowcontrol full
e1b: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500
ether 90:e2:ba:54:e4:dd (auto-unknown-down) flowcontrol full
e2a: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500
ether 90:e2:ba:56:22:7c (auto-unknown-down) flowcontrol full
e2b: flags=0x170c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500
ether 90:e2:ba:56:22:7d (auto-unknown-down) flowcontrol full
c0a: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE
inet 192.168.1.114 netmask 0xffffff00 broadcast 192.168.1.255
ether 00:a0:98:55:9a:8c (auto-unknown-enabling) flowcontrol full
c0b: flags=0x174e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 9000 PRIVATE
inet 192.168.2.194 netmask 0xffffff00 broadcast 192.168.2.255
ether 00:a0:98:55:9a:8d (auto-unknown-enabling) flowcontrol full
e0M: flags=0x230c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,MGMT_PORT> mtu 1500
ether 00:a0:98:55:9a:8e (auto-unknown-down) flowcontrol full
e0P: flags=0x2b4c867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM,ACP_PORT> mtu 1500 PRIVATE
inet 192.168.1.219 netmask 0xfffffc00 broadcast 192.168.3.255 noddns
ether 00:a0:98:55:9a:8f (auto-100tx-fd-up) flowcontrol full
ql5a: flags=0x40<RUNNING> mtu 0
ether 00:00:00:00:00:00 (VIA Provider)
ql5b: flags=0x40<RUNNING> mtu 0
ether 00:00:00:00:00:00 (VIA Provider)
lo: flags=0x1b48049<UP,LOOPBACK,RUNNING,MULTICAST,TCPCKSUM> mtu 8160
inet 127.0.0.1 netmask 0xff000000 broadcast 127.0.0.1
ether 00:00:00:00:00:00 (RNIC Provider)
losk: flags=0x40a400c9<UP,LOOPBACK,RUNNING> mtu 9188
inet 127.0.20.1 netmask 0xff000000 broadcast 127.0.20.1
vif1: flags=0x2274c863<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
inet 10.150.208.9 netmask 0xffffff00 broadcast 10.150.208.255
partner vif1 (not in use)
ether 02:a0:98:55:9a:8a (Disabled interface group)
fas3220b> license #查看许可
a_sis ENABLED
cf WVOCZIE
cf_remote GTZKSHL
cifs not licensed
compression ENABLED
disk_sanitization ENABLED
fcp not licensed
flash_cache ENABLED
flex_clone not licensed
flex_scale ENABLED
flexcache_nfs ENABLED
http ENABLED
insight_balance not licensed
iscsi IYILSHL
multistore ENABLED
nearstore_option ENABLED
nfs not licensed
operations_manager ENABLED
persistent_archive ENABLED
protection_manager ENABLED
provisioning_manager ENABLED
smdomino not licensed
smsql not licensed
snapdrive_windows not licensed
snaplock not licensed
snaplock_enterprise not licensed
snapmanager_hyperv not licensed
snapmanager_oracle not licensed
snapmanager_sap not licensed
snapmanager_sharepoint not licensed
snapmanager_vi not licensed
snapmanagerexchange not licensed
snapmirror not licensed
snapmirror_sync not licensed
snapmover ENABLED
snaprestore not licensed
snapvalidator not licensed
storage_services ENABLED
sv_application_pri not licensed
sv_linux_pri ENABLED
sv_ontap_pri not licensed
sv_ontap_sec not licensed
sv_unix_pri ENABLED
sv_vi_pri ENABLED
sv_windows_ofm_pri ENABLED
sv_windows_pri ENABLED
syncmirror_local WTTITYG
v-series not licensed
vld ENABLED
fas3220b>
fas3220b>
Wed Jul 23 11:11:29 GMT [fas3220b:cf.hwassist.socBindFailed:error]: hw_assist: bind failed to port 4444 on IP address 192.168.1.219. Error 49
fas3220b> sp status #查看服务进程
Service Processor Status: Online
Firmware Version: 1.3.3
Mgmt MAC Address: 00:A0:98:55:9A:90
Ethernet Link: down
Using DHCP: yes
IPv4 configuration:
IP Address: unknown
Netmask: unknown
Gateway: unknown
IPv6 configuration: Disabled
fas3220b>
fas3220b> sp reboot #重启SP服务
NOTE : If your console connection is through the SP,it will be disconnected
Do you want to reboot the SP now? (y/n) :? y
Wed Jul 23 11:12:00 GMT [acp-vfiler@fas3220b:acp.locked.wrench.port.up:info]: The on-board locked wrench port is up.
Wed Jul 23 11:12:00 GMT [acp-vfiler@fas3220b:acp.ioxm.port.up:info]: IOXM switch port 1 is up.
Wed Jul 23 11:12:00 GMT [acp-vfiler@fas3220b:acp.ioxm.port.up:info]: IOXM switch port 2 is up.
Wed Jul 23 11:12:00 GMT [acp-vfiler@fas3220b:acp.ioxm.port.up:info]: IOXM switch port 3 is up.
Wed Jul 23 11:12:00 GMT [acp-vfiler@fas3220b:acp.ioxm.port.up:info]: IOXM switch port 4 is up.
Console connection through the SP will now be dropped
fas3220b>
5.3、配置MetroCluster
5.3.1、配置说明
说明，metro Cluster 的主要步骤如下：
1、先修改Shelf ID号
2、A控单连一个shelf。 B控也单独连一个shelf，不要互联。
将A控看到的磁盘，1半自用，1半给B控
将B控看到的磁盘，1半自用 ，1半给A控
3、设置磁盘归属关系，如果磁盘已经被assign，需要删除ownership！
A控操作
- 物理连接存储
- A控看到的磁盘，分出一半，assign给A控，命名为p0
*> disk assign 0b.00.1 -p 0 (0为Pool 0)
*> disk assign 3b.00.0 -p 0
- 把余下的磁盘assign给B控，并命名为p1，，比如B控ID 为2017886331
*> disk assign 0a.10.14 -s 2017919765 -p 1
*> disk assign 3c.10.15 -s 2017919765 -p 1
B控操作
- 物理安装存储
- B控看到的磁盘，分出一半，assign给B控，命名为p0
*> disk assign 0a.10.1 -p 0 (0为Pool 0)
*> disk assign 3c.10.0 -p 0
- 把余下的磁盘assign给A控，并命名为p1，，比如A控ID 为2017870126
*> disk assign 0b.00.12 -s 2017918867 -p 1
*> disk assign 3b.00.15 -s 2017918867 -p 1
4、零化操作，MEMU，选择4，零化系统
5、待系统零化完成后，完成控制器和磁盘柜之间所有连线（正确连线很重要）
6、关闭disk自动assign 选项
FAS3220a> options disk
FAS3220a> options disk.auto_assign off
6、创建aggr
FAS3220a> aggr add aggr0 xx
A控进入系统后，执行aggr 磁盘添加操作，切记保留热备盘
7、执行aggr mirror
5.3.2、MetroCluster 配置过程
fas3220a> sysconfig -r #查看当硬盘信息
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3b.00.0 3b 0 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0b.00.1 0b 0 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.2 3b 0 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0b.00.3 0b 0 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.5 0b 0 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.7 0b 0 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.9 0b 0 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.11 0b 0 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.13 0b 0 13 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.15 0b 0 15 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.17 0b 0 17 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.19 0b 0 19 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.21 0b 0 21 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.23 0b 0 23 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.4 3b 0 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.6 3b 0 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.8 3b 0 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.10 3b 0 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.12 3b 0 12 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.14 3b 0 14 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.16 3b 0 16 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.18 3b 0 18 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.20 3b 0 20 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.22 3b 0 22 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3c.10.23 3c 10 23 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.21 3c 10 21 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.19 3c 10 19 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.17 3c 10 17 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.15 3c 10 15 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.13 3c 10 13 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.11 3c 10 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.9 3c 10 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.1 3c 10 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.5 3c 10 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.7 3c 10 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.3 3c 10 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.22 0a 10 22 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.20 0a 10 20 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.18 0a 10 18 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.16 0a 10 16 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.14 0a 10 14 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.12 0a 10 12 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.10 0a 10 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.2 0a 10 2 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.8 0a 10 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.0 0a 10 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.4 0a 10 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.6 0a 10 6 SA:A 0 SAS 10000 0/0 560208/1147307696
fas3220a> priv set advanced #设置进入高级命令模式
Warning: These advanced commands are potentially dangerous; use
them only when directed to do so by NetApp
personnel.
fas3220a*>
fas3220a*> disk remove_ownership 0b.00.23 3b.00.22 0b.00.21 3b.00.20 0b.00.19 3b.00.18 0b.00.17 3b.00.16 0b.00.15 3b.00.14
# 移除不正确的磁盘关系
Disk 0b.00.23 will have its ownership removed
Disk 3b.00.22 will have its ownership removed
Disk 0b.00.21 will have its ownership removed
Disk 3b.00.20 will have its ownership removed
Disk 0b.00.19 will have its ownership removed
Disk 3b.00.18 will have its ownership removed
Disk 0b.00.17 will have its ownership removed
Disk 3b.00.16 will have its ownership removed
Disk 0b.00.15 will have its ownership removed
Disk 3b.00.14 will have its ownership removed
Volumes must be taken offline. Are all impacted volumes offline(y/n)??
Please answer yes or no.
Volumes must be taken offline. Are all impacted volumes offline(y/n)?? y
fas3220a*>
fas3220a*>
fas3220a*> disk show -n #查看没有归属关系的磁盘
DISK OWNER POOL SERIAL NUMBER HOME
------------ ------------- ----- ------------- -------------
3b.00.16 Not Owned NONE S0M1JWWD0000N421BXAK
0b.00.15 Not Owned NONE S0M1HS500000M419ZK00
0b.00.19 Not Owned NONE S0M1HSCA0000M419E0C7
3b.00.18 Not Owned NONE S0M1JX3X0000N421AELQ
3b.00.20 Not Owned NONE S0M1HSFZ0000M419E1BL
0b.00.23 Not Owned NONE S0M1HS700000M419E0EY
0b.00.21 Not Owned NONE S0M1Q5FQ0000B426AR0X
3b.00.22 Not Owned NONE S0M1QJ6E0000B426AHL9
3b.00.14 Not Owned NONE S0M1KAGV0000N421BYE4
0b.00.17 Not Owned NONE S0M1KAFP0000N421BYT8
fas3220a*> sysconfig -r #查看硬盘信息
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3b.00.0 3b 0 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0b.00.1 0b 0 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.2 3b 0 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0b.00.3 0b 0 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.5 0b 0 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.7 0b 0 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.9 0b 0 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.11 0b 0 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.13 0b 0 13 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.4 3b 0 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.6 3b 0 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.8 3b 0 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.10 3b 0 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.12 3b 0 12 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3c.10.23 3c 10 23 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.21 3c 10 21 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.19 3c 10 19 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.17 3c 10 17 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.15 3c 10 15 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.13 3c 10 13 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.11 3c 10 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.9 3c 10 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.1 3c 10 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.5 3c 10 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.7 3c 10 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.3 3c 10 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.22 0a 10 22 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.20 0a 10 20 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.18 0a 10 18 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.16 0a 10 16 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.14 0a 10 14 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.12 0a 10 12 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.10 0a 10 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.2 0a 10 2 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.8 0a 10 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.0 0a 10 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.4 0a 10 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.6 0a 10 6 SA:A 0 SAS 10000 0/0 560208/1147307696
fas3220a*>
fas3220a*> disk remove_ownership 0b.00.13 3b.00.12 #删除不正确的磁盘关系
Disk 0b.00.13 will have its ownership removed
Disk 3b.00.12 will have its ownership removed
Volumes must be taken offline. Are all impacted volumes offline(y/n)?? y
fas3220a*>
fas3220a*>
fas3220a*> disk show -n #查看没有归属关系的磁盘
DISK OWNER POOL SERIAL NUMBER HOME
------------ ------------- ----- ------------- -------------
3b.00.16 Not Owned NONE S0M1JWWD0000N421BXAK
0b.00.13 Not Owned NONE S0M1JXAN0000N421BZ0W
0b.00.15 Not Owned NONE S0M1HS500000M419ZK00
0b.00.19 Not Owned NONE S0M1HSCA0000M419E0C7
3b.00.18 Not Owned NONE S0M1JX3X0000N421AELQ
3b.00.20 Not Owned NONE S0M1HSFZ0000M419E1BL
0b.00.23 Not Owned NONE S0M1HS700000M419E0EY
0b.00.21 Not Owned NONE S0M1Q5FQ0000B426AR0X
3b.00.12 Not Owned NONE S0M1JX9N0000N421BY4G
3b.00.22 Not Owned NONE S0M1QJ6E0000B426AHL9
3b.00.14 Not Owned NONE S0M1KAGV0000N421BYE4
0b.00.17 Not Owned NONE S0M1KAFP0000N421BYT8
fas3220a*> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3b.00.0 3b 0 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0b.00.1 0b 0 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.2 3b 0 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0b.00.3 0b 0 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.5 0b 0 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.7 0b 0 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.9 0b 0 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.11 0b 0 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.4 3b 0 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.6 3b 0 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.8 3b 0 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.10 3b 0 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3c.10.23 3c 10 23 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.21 3c 10 21 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.19 3c 10 19 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.17 3c 10 17 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.15 3c 10 15 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.13 3c 10 13 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.11 3c 10 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.9 3c 10 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.1 3c 10 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.5 3c 10 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.7 3c 10 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.3 3c 10 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.22 0a 10 22 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.20 0a 10 20 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.18 0a 10 18 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.16 0a 10 16 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.14 0a 10 14 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.12 0a 10 12 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.10 0a 10 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.2 0a 10 2 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.8 0a 10 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.0 0a 10 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.4 0a 10 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.6 0a 10 6 SA:A 0 SAS 10000 0/0 560208/1147307696
fas3220b> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3c.10.0 3c 10 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0a.10.1 0a 10 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.2 3c 10 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.10.3 0a 10 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.5 0a 10 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.7 0a 10 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.9 0a 10 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.11 0a 10 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.13 0a 10 13 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.15 0a 10 15 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.17 0a 10 17 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.19 0a 10 19 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.21 0a 10 21 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.23 0a 10 23 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.4 3c 10 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.6 3c 10 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.8 3c 10 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.10 3c 10 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.12 3c 10 12 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.14 3c 10 14 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.16 3c 10 16 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.18 3c 10 18 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.20 3c 10 20 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.22 3c 10 22 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3b.00.1 3b 0 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.9 3b 0 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.11 3b 0 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.7 3b 0 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.5 3b 0 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.3 3b 0 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.0 0b 0 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.8 0b 0 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.10 0b 0 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.6 0b 0 6 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.4 0b 0 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.2 0b 0 2 SA:A 0 SAS 10000 0/0 560208/1147307696
fas3220b>
fas3220b> disk show -n
DISK OWNER POOL SERIAL NUMBER HOME
------------ ------------- ----- ------------- -------------
3b.00.19 Not Owned NONE S0M1HSCA0000M419E0C7
3b.00.13 Not Owned NONE S0M1JXAN0000N421BZ0W
3b.00.17 Not Owned NONE S0M1KAFP0000N421BYT8
3b.00.21 Not Owned NONE S0M1Q5FQ0000B426AR0X
3b.00.15 Not Owned NONE S0M1HS500000M419ZK00
3b.00.23 Not Owned NONE S0M1HS700000M419E0EY
0b.00.22 Not Owned NONE S0M1QJ6E0000B426AHL9
0b.00.12 Not Owned NONE S0M1JX9N0000N421BY4G
0b.00.16 Not Owned NONE S0M1JWWD0000N421BXAK
0b.00.18 Not Owned NONE S0M1JX3X0000N421AELQ
0b.00.14 Not Owned NONE S0M1KAGV0000N421BYE4
0b.00.20 Not Owned NONE S0M1HSFZ0000M419E1BL
fas3220b> disk show -v
DISK OWNER POOL SERIAL NUMBER HOME CHKSUM
------------ ------------- ----- ------------- ------------- ------
3b.00.1 fas3220a (2017870126) Pool0 S0M1Q9KT0000B426AL5V fas3220a (2017870126) Block
3b.00.11 fas3220a (2017870126) Pool0 S0M1HSEE0000M419669Y fas3220a (2017870126) Block
3b.00.5 fas3220a (2017870126) Pool0 S0M1QJP60000B426AHN7 fas3220a (2017870126) Block
3b.00.19 Not Owned NONE S0M1HSCA0000M419E0C7 Block
3b.00.3 fas3220a (2017870126) Pool0 S0M1KAGB0000N421BYYU fas3220a (2017870126) Block
3b.00.13 Not Owned NONE S0M1JXAN0000N421BZ0W Block
3b.00.17 Not Owned NONE S0M1KAFP0000N421BYT8 Block
3b.00.9 fas3220a (2017870126) Pool0 S0M1KAK30000N41629LB fas3220a (2017870126) Block
3b.00.21 Not Owned NONE S0M1Q5FQ0000B426AR0X Block
3b.00.15 Not Owned NONE S0M1HS500000M419ZK00 Block
3b.00.23 Not Owned NONE S0M1HS700000M419E0EY Block
3b.00.7 fas3220a (2017870126) Pool0 S0M1K1BJ0000B421CYK0 fas3220a (2017870126) Block
0b.00.8 fas3220a (2017870126) Pool0 S0M1QE1V0000B426BZRA fas3220a (2017870126) Block
0b.00.22 Not Owned NONE S0M1QJ6E0000B426AHL9 Block
0b.00.12 Not Owned NONE S0M1JX9N0000N421BY4G Block
0b.00.16 Not Owned NONE S0M1JWWD0000N421BXAK Block
0b.00.6 fas3220a (2017870126) Pool0 S0M1JX7J0000N421BY5B fas3220a (2017870126) Block
0b.00.0 fas3220a (2017870126) Pool0 S0M1HS6R0000M419DZWT fas3220a (2017870126) Block
0b.00.4 fas3220a (2017870126) Pool0 S0M1QJQM0000B426DS51 fas3220a (2017870126) Block
0b.00.18 Not Owned NONE S0M1JX3X0000N421AELQ Block
0b.00.10 fas3220a (2017870126) Pool0 S0M1JWYV0000N421AE9Z fas3220a (2017870126) Block
0b.00.14 Not Owned NONE S0M1KAGV0000N421BYE4 Block
0b.00.20 Not Owned NONE S0M1HSFZ0000M419E1BL Block
0b.00.2 fas3220a (2017870126) Pool0 S0M1Q3280000M425J5HP fas3220a (2017870126) Block
3c.10.6 fas3220b (2017886331) Pool0 S0M1Q7H00000B4269FBL fas3220b (2017886331) Block
3c.10.8 fas3220b (2017886331) Pool0 S0M1QHLC0000B426DT88 fas3220b (2017886331) Block
3c.10.16 fas3220b (2017886331) Pool0 S0M1Q9NR0000B42690L4 fas3220b (2017886331) Block
3c.10.14 fas3220b (2017886331) Pool0 S0M1Q6T80000B426AK78 fas3220b (2017886331) Block
3c.10.2 fas3220b (2017886331) Pool0 S0M1QHS60000N423BDVP fas3220b (2017886331) Block
3c.10.0 fas3220b (2017886331) Pool0 S0M1JX390000N4216Z70 fas3220b (2017886331) Block
3c.10.12 fas3220b (2017886331) Pool0 S0M1QHGS0000B426DTHH fas3220b (2017886331) Block
3c.10.4 fas3220b (2017886331) Pool0 S0M1QJLS0000B426C6KD fas3220b (2017886331) Block
3c.10.20 fas3220b (2017886331) Pool0 S0M1HS4W0000M419ZJJX fas3220b (2017886331) Block
3c.10.22 fas3220b (2017886331) Pool0 S0M1QHSK0000B425FJ0J fas3220b (2017886331) Block
3c.10.10 fas3220b (2017886331) Pool0 S0M1Q6030000B42690PS fas3220b (2017886331) Block
3c.10.18 fas3220b (2017886331) Pool0 S0M1QHLA0000B426980S fas3220b (2017886331) Block
0a.10.13 fas3220b (2017886331) Pool0 S0M1PG4S0000B426CD8P fas3220b (2017886331) Block
0a.10.1 fas3220b (2017886331) Pool0 S0M1QHTG0000B426APT7 fas3220b (2017886331) Block
0a.10.15 fas3220b (2017886331) Pool0 S0M1Q6QS0000B426AYMV fas3220b (2017886331) Block
0a.10.7 fas3220b (2017886331) Pool0 S0M1QK0Q0000B426ARRM fas3220b (2017886331) Block
0a.10.3 fas3220b (2017886331) Pool0 S0M1QHH40000M425J6TW fas3220b (2017886331) Block
0a.10.21 fas3220b (2017886331) Pool0 S0M1Q3PS0000M425K730 fas3220b (2017886331) Block
0a.10.9 fas3220b (2017886331) Pool0 S0M1QHW80000B424BGSG fas3220b (2017886331) Block
0a.10.17 fas3220b (2017886331) Pool0 S0M1KAJ70000N421BYY6 fas3220b (2017886331) Block
0a.10.11 fas3220b (2017886331) Pool0 S0M1Q5F20000B426AQGY fas3220b (2017886331) Block
0a.10.19 fas3220b (2017886331) Pool0 S0M1QDS40000B426AQ1E fas3220b (2017886331) Block
0a.10.5 fas3220b (2017886331) Pool0 S0M1Q73A0000B4269996 fas3220b (2017886331) Block
0a.10.23 fas3220b (2017886331) Pool0 S0M1Q7A70000B4269971 fas3220b (2017886331) Block
fas3220b> disk show
Thu Jul 24 13:00:04 CST [fas3220b:sp.network.link.down:warning]: Service Processor (SP) network port link down due to cable or network errors.
-a
DISK OWNER POOL SERIAL NUMBER HOME
------------ ------------- ----- ------------- -------------
3b.00.1 fas3220a (2017870126) Pool0 S0M1Q9KT0000B426AL5V fas3220a (2017870126)
3b.00.11 fas3220a (2017870126) Pool0 S0M1HSEE0000M419669Y fas3220a (2017870126)
3b.00.5 fas3220a (2017870126) Pool0 S0M1QJP60000B426AHN7 fas3220a (2017870126)
3b.00.3 fas3220a (2017870126) Pool0 S0M1KAGB0000N421BYYU fas3220a (2017870126)
3b.00.9 fas3220a (2017870126) Pool0 S0M1KAK30000N41629LB fas3220a (2017870126)
3b.00.7 fas3220a (2017870126) Pool0 S0M1K1BJ0000B421CYK0 fas3220a (2017870126)
0b.00.8 fas3220a (2017870126) Pool0 S0M1QE1V0000B426BZRA fas3220a (2017870126)
0b.00.6 fas3220a (2017870126) Pool0 S0M1JX7J0000N421BY5B fas3220a (2017870126)
0b.00.0 fas3220a (2017870126) Pool0 S0M1HS6R0000M419DZWT fas3220a (2017870126)
0b.00.4 fas3220a (2017870126) Pool0 S0M1QJQM0000B426DS51 fas3220a (2017870126)
0b.00.10 fas3220a (2017870126) Pool0 S0M1JWYV0000N421AE9Z fas3220a (2017870126)
0b.00.2 fas3220a (2017870126) Pool0 S0M1Q3280000M425J5HP fas3220a (2017870126)
3c.10.6 fas3220b (2017886331) Pool0 S0M1Q7H00000B4269FBL fas3220b (2017886331)
3c.10.8 fas3220b (2017886331) Pool0 S0M1QHLC0000B426DT88 fas3220b (2017886331)
3c.10.16 fas3220b (2017886331) Pool0 S0M1Q9NR0000B42690L4 fas3220b (2017886331)
3c.10.14 fas3220b (2017886331) Pool0 S0M1Q6T80000B426AK78 fas3220b (2017886331)
3c.10.2 fas3220b (2017886331) Pool0 S0M1QHS60000N423BDVP fas3220b (2017886331)
3c.10.0 fas3220b (2017886331) Pool0 S0M1JX390000N4216Z70 fas3220b (2017886331)
3c.10.12 fas3220b (2017886331) Pool0 S0M1QHGS0000B426DTHH fas3220b (2017886331)
3c.10.4 fas3220b (2017886331) Pool0 S0M1QJLS0000B426C6KD fas3220b (2017886331)
3c.10.20 fas3220b (2017886331) Pool0 S0M1HS4W0000M419ZJJX fas3220b (2017886331)
3c.10.22 fas3220b (2017886331) Pool0 S0M1QHSK0000B425FJ0J fas3220b (2017886331)
3c.10.10 fas3220b (2017886331) Pool0 S0M1Q6030000B42690PS fas3220b (2017886331)
3c.10.18 fas3220b (2017886331) Pool0 S0M1QHLA0000B426980S fas3220b (2017886331)
0a.10.13 fas3220b (2017886331) Pool0 S0M1PG4S0000B426CD8P fas3220b (2017886331)
0a.10.1 fas3220b (2017886331) Pool0 S0M1QHTG0000B426APT7 fas3220b (2017886331)
0a.10.15 fas3220b (2017886331) Pool0 S0M1Q6QS0000B426AYMV fas3220b (2017886331)
0a.10.7 fas3220b (2017886331) Pool0 S0M1QK0Q0000B426ARRM fas3220b (2017886331)
0a.10.3 fas3220b (2017886331) Pool0 S0M1QHH40000M425J6TW fas3220b (2017886331)
0a.10.21 fas3220b (2017886331) Pool0 S0M1Q3PS0000M425K730 fas3220b (2017886331)
0a.10.9 fas3220b (2017886331) Pool0 S0M1QHW80000B424BGSG fas3220b (2017886331)
0a.10.17 fas3220b (2017886331) Pool0 S0M1KAJ70000N421BYY6 fas3220b (2017886331)
0a.10.11 fas3220b (2017886331) Pool0 S0M1Q5F20000B426AQGY fas3220b (2017886331)
0a.10.19 fas3220b (2017886331) Pool0 S0M1QDS40000B426AQ1E fas3220b (2017886331)
0a.10.5 fas3220b (2017886331) Pool0 S0M1Q73A0000B4269996 fas3220b (2017886331)
0a.10.23 fas3220b (2017886331) Pool0 S0M1Q7A70000B4269971 fas3220b (2017886331)
NOTE: Currently 12 disks are unowned. Use 'disk show -n' for additional information.
fas3220b>
fas3220b> sysconfig
NetApp Release 8.1.3 7-Mode: Sat Jun 8 08:11:51 PDT 2013
System ID: 2017886331 (fas3220b); partner ID: 2017870126 (fas3220a)
System Serial Number: 450000056236 (fas3220b)
System Rev: B7
System Storage Configuration: Multi-Path HA
System ACP Connectivity: NA
slot 0: System Board
Processors: 4
Processor type: Intel(R) Xeon(R) CPU L5410 @ 2.33GHz
Memory Size: 12288 MB
Memory Attributes: Bank Interleaving
Hoisting
Rank Interleaving
Chipkill ECC
Service Processor Status: Online
IOXM Status: present
Power: Good
Agent version: N/A
Serial Number: 9441912947
Part Number: 111-00647
Version: D1
slot 0: Dual 10G Ethernet Controller T320E-SFP/KR
c0a MAC Address: 00:a0:98:55:9a:8c (auto-unknown-enabling)
c0b MAC Address: 00:a0:98:55:9a:8d (auto-unknown-enabling)
slot 0: Internal BGE 10/100 Ethernet Controller
e0M MAC Address: 00:a0:98:55:9a:8e (auto-unknown-down)
e0P MAC Address: 00:a0:98:55:9a:8f (auto-100tx-fd-up)
slot 0: Dual 10/100/1000 Ethernet Controller G20
e0a MAC Address: 00:a0:98:55:9a:8a (auto-unknown-down)
e0b MAC Address: 00:a0:98:55:9a:8b (auto-unknown-down)
slot 0: SAS Host Adapter 0a
24 Disks: 13440.0GB
1 shelf with IOM6
slot 0: SAS Host Adapter 0b
24 Disks: 13440.0GB
1 shelf with IOM6
slot 0: FC Host Adapter 0c
slot 0: FC Host Adapter 0d
slot 0: Intel ICH USB EHCI Adapter u0a (0xdfb01400)
boot0 Micron Technology Real SSD eUSB 2GB, class 0/0, rev 2.00/11.10, addr 2 1936MB 512B/sect (0FF0022700323779)
slot 1: FCVI Host Adapter 1a
slot 1: FCVI Host Adapter 1b
slot 2: Dual 10 Gigabit Ethernet Controller IX1-SFP+
e2a MAC Address: 90:e2:ba:56:22:7c (auto-10g_sr-fd-up)
e2b MAC Address: 90:e2:ba:56:22:7d (auto-10g_sr-fd-up)
slot 3: SAS Host Adapter 3a
slot 3: SAS Host Adapter 3b
24 Disks: 13440.0GB
1 shelf with IOM6
slot 3: SAS Host Adapter 3c
24 Disks: 13440.0GB
1 shelf with IOM6
slot 3: SAS Host Adapter 3d
slot 5: Dual 10 Gigabit Ethernet Controller IX1-SFP+
e5a MAC Address: 90:e2:ba:54:e4:dc (auto-10g_sr-fd-up)
e5b MAC Address: 90:e2:ba:54:e4:dd (auto-10g_sr-fd-up)
fas3220b> disk show -n
DISK OWNER POOL SERIAL NUMBER HOME
------------ ------------- ----- ------------- -------------
3b.00.19 Not Owned NONE S0M1HSCA0000M419E0C7
3b.00.13 Not Owned NONE S0M1JXAN0000N421BZ0W
3b.00.17 Not Owned NONE S0M1KAFP0000N421BYT8
3b.00.21 Not Owned NONE S0M1Q5FQ0000B426AR0X
3b.00.15 Not Owned NONE S0M1HS500000M419ZK00
3b.00.23 Not Owned NONE S0M1HS700000M419E0EY
0b.00.22 Not Owned NONE S0M1QJ6E0000B426AHL9
0b.00.12 Not Owned NONE S0M1JX9N0000N421BY4G
0b.00.16 Not Owned NONE S0M1JWWD0000N421BXAK
0b.00.18 Not Owned NONE S0M1JX3X0000N421AELQ
0b.00.14 Not Owned NONE S0M1KAGV0000N421BYE4
0b.00.20 Not Owned NONE S0M1HSFZ0000M419E1BL
fas3220b> options pool
No such option pool
fas3220b> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3c.10.0 3c 10 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0a.10.1 0a 10 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.2 3c 10 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.10.3 0a 10 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.5 0a 10 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.7 0a 10 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.9 0a 10 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.11 0a 10 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.13 0a 10 13 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.15 0a 10 15 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.17 0a 10 17 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.19 0a 10 19 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.21 0a 10 21 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.23 0a 10 23 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.4 3c 10 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.6 3c 10 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.8 3c 10 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.10 3c 10 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.12 3c 10 12 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.14 3c 10 14 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.16 3c 10 16 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.18 3c 10 18 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.20 3c 10 20 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.22 3c 10 22 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3b.00.1 3b 0 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.9 3b 0 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.11 3b 0 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.7 3b 0 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.5 3b 0 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.3 3b 0 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.0 0b 0 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.8 0b 0 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.10 0b 0 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.6 0b 0 6 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.4 0b 0 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.2 0b 0 2 SA:A 0 SAS 10000 0/0 560208/1147307696
fas3220b> priv set advanced
Warning: These advanced commands are potentially dangerous; use
them only when directed to do so by NetApp
personnel.
fas3220b*> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3c.10.0 3c 10 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0a.10.1 0a 10 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.2 3c 10 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.10.3 0a 10 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.5 0a 10 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.7 0a 10 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.9 0a 10 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.11 0a 10 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.13 0a 10 13 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.15 0a 10 15 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.17 0a 10 17 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.19 0a 10 19 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.21 0a 10 21 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.23 0a 10 23 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.4 3c 10 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.6 3c 10 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.8 3c 10 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.10 3c 10 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.12 3c 10 12 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.14 3c 10 14 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.16 3c 10 16 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.18 3c 10 18 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.20 3c 10 20 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.22 3c 10 22 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3b.00.1 3b 0 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.9 3b 0 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.11 3b 0 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.7 3b 0 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.5 3b 0 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.3 3b 0 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.0 0b 0 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.8 0b 0 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.10 0b 0 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.6 0b 0 6 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.4 0b 0 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.2 0b 0 2 SA:A 0 SAS 10000 0/0 560208/1147307696
fas3220b*> disk show -n
DISK OWNER POOL SERIAL NUMBER HOME
------------ ------------- ----- ------------- -------------
3b.00.19 Not Owned NONE S0M1HSCA0000M419E0C7
3b.00.13 Not Owned NONE S0M1JXAN0000N421BZ0W
3b.00.17 Not Owned NONE S0M1KAFP0000N421BYT8
3b.00.21 Not Owned NONE S0M1Q5FQ0000B426AR0X
3b.00.15 Not Owned NONE S0M1HS500000M419ZK00
3b.00.23 Not Owned NONE S0M1HS700000M419E0EY
0b.00.22 Not Owned NONE S0M1QJ6E0000B426AHL9
0b.00.12 Not Owned NONE S0M1JX9N0000N421BY4G
0b.00.16 Not Owned NONE S0M1JWWD0000N421BXAK
0b.00.18 Not Owned NONE S0M1JX3X0000N421AELQ
0b.00.14 Not Owned NONE S0M1KAGV0000N421BYE4
0b.00.20 Not Owned NONE S0M1HSFZ0000M419E1BL
fas3220b*>
fas3220b*>
fas3220b*> disk assign 3b.00.19 -s 2017886331 -p 1
Thu Jul 24 13:23:37 CST [fas3220b:diskown.changingOwner:info]: changing ownership for disk 3b.00.19 (S/N S0M1HSCA0000M419E0C7) from unowned (ID 4294967295) to fas3220b (ID 2017886331)
fas3220b*>
fas3220b*>
fas3220b*> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3c.10.0 3c 10 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0a.10.1 0a 10 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.2 3c 10 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 3b.00.19 3b 0 19 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.10.3 0a 10 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.5 0a 10 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.7 0a 10 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.9 0a 10 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.11 0a 10 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.13 0a 10 13 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.15 0a 10 15 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.17 0a 10 17 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.19 0a 10 19 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.21 0a 10 21 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.23 0a 10 23 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.4 3c 10 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.6 3c 10 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.8 3c 10 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.10 3c 10 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.12 3c 10 12 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.14 3c 10 14 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.16 3c 10 16 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.18 3c 10 18 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.20 3c 10 20 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.22 3c 10 22 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3b.00.1 3b 0 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.9 3b 0 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.11 3b 0 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.7 3b 0 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.5 3b 0 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.3 3b 0 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.0 0b 0 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.8 0b 0 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.10 0b 0 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.6 0b 0 6 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.4 0b 0 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.2 0b 0 2 SA:A 0 SAS 10000 0/0 560208/1147307696
fas3220b*>
fas3220b*>
fas3220b*> disk show -n
DISK OWNER POOL SERIAL NUMBER HOME
------------ ------------- ----- ------------- -------------
3b.00.13 Not Owned NONE S0M1JXAN0000N421BZ0W
3b.00.17 Not Owned NONE S0M1KAFP0000N421BYT8
3b.00.21 Not Owned NONE S0M1Q5FQ0000B426AR0X
3b.00.15 Not Owned NONE S0M1HS500000M419ZK00
3b.00.23 Not Owned NONE S0M1HS700000M419E0EY
0b.00.22 Not Owned NONE S0M1QJ6E0000B426AHL9
0b.00.12 Not Owned NONE S0M1JX9N0000N421BY4G
0b.00.16 Not Owned NONE S0M1JWWD0000N421BXAK
0b.00.18 Not Owned NONE S0M1JX3X0000N421AELQ
0b.00.14 Not Owned NONE S0M1KAGV0000N421BYE4
0b.00.20 Not Owned NONE S0M1HSFZ0000M419E1BL
fas3220b*> disk assign all -p 1 #把没有归属关系的磁盘，设置属于Pool 1
Thu Jul 24 13:25:01 CST [fas3220b:diskown.changingOwner:info]: changing ownership for disk 3b.00.13 (S/N S0M1JXAN0000N421BZ0W) from unowned (ID 4294967295) to fas3220b (ID 2017886331)
fas3220b*> Thu Jul 24 13:25:01 CST [fas3220b:diskown.changingOwner:info]: changing ownership for disk 3b.00.17 (S/N S0M1KAFP0000N421BYT8) from unowned (ID 4294967295) to fas3220b (ID 2017886331)
Thu Jul 24 13:25:01 CST [fas3220b:diskown.changingOwner:info]: changing ownership for disk 3b.00.21 (S/N S0M1Q5FQ0000B426AR0X) from unowned (ID 4294967295) to fas3220b (ID 2017886331)
Thu Jul 24 13:25:01 CST [fas3220b:diskown.changingOwner:info]: changing ownership for disk 3b.00.15 (S/N S0M1HS500000M419ZK00) from unowned (ID 4294967295) to fas3220b (ID 2017886331)
Thu Jul 24 13:25:01 CST [fas3220b:diskown.changingOwner:info]: changing ownership for disk 3b.00.23 (S/N S0M1HS700000M419E0EY) from unowned (ID 4294967295) to fas3220b (ID 2017886331)
Thu Jul 24 13:25:01 CST [fas3220b:diskown.changingOwner:info]: changing ownership for disk 0b.00.22 (S/N S0M1QJ6E0000B426AHL9) from unowned (ID 4294967295) to fas3220b (ID 2017886331)
Thu Jul 24 13:25:01 CST [fas3220b:diskown.changingOwner:info]: changing ownership for disk 0b.00.12 (S/N S0M1JX9N0000N421BY4G) from unowned (ID 4294967295) to fas3220b (ID 2017886331)
Thu Jul 24 13:25:01 CST [fas3220b:diskown.changingOwner:info]: changing ownership for disk 0b.00.16 (S/N S0M1JWWD0000N421BXAK) from unowned (ID 4294967295) to fas3220b (ID 2017886331)
Thu Jul 24 13:25:01 CST [fas3220b:diskown.changingOwner:info]: changing ownership for disk 0b.00.18 (S/N S0M1JX3X0000N421AELQ) from unowned (ID 4294967295) to fas3220b (ID 2017886331)
Thu Jul 24 13:25:01 CST [fas3220b:diskown.changingOwner:info]: changing ownership for disk 0b.00.14 (S/N S0M1KAGV0000N421BYE4) from unowned (ID 4294967295) to fas3220b (ID 2017886331)
Thu Jul 24 13:25:01 CST [fas3220b:diskown.changingOwner:info]: changing ownership for disk 0b.00.20 (S/N S0M1HSFZ0000M419E1BL) from unowned (ID 4294967295) to fas3220b (ID 2017886331)
fas3220b*>
fas3220b*> sysconfig -r #查看硬盘信息
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3c.10.0 3c 10 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0a.10.1 0a 10 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.2 3c 10 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0b.00.12 0b 0 12 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.14 0b 0 14 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.16 0b 0 16 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.18 0b 0 18 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.20 0b 0 20 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.22 0b 0 22 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.13 3b 0 13 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.15 3b 0 15 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.17 3b 0 17 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.19 3b 0 19 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.21 3b 0 21 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.23 3b 0 23 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.10.3 0a 10 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.5 0a 10 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.7 0a 10 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.9 0a 10 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.11 0a 10 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.13 0a 10 13 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.15 0a 10 15 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.17 0a 10 17 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.19 0a 10 19 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.21 0a 10 21 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.23 0a 10 23 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.4 3c 10 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.6 3c 10 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.8 3c 10 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.10 3c 10 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.12 3c 10 12 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.14 3c 10 14 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.16 3c 10 16 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.18 3c 10 18 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.20 3c 10 20 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.22 3c 10 22 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3b.00.1 3b 0 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.9 3b 0 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.11 3b 0 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.7 3b 0 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.5 3b 0 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.3 3b 0 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.0 0b 0 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.8 0b 0 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.10 0b 0 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.6 0b 0 6 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.4 0b 0 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.2 0b 0 2 SA:A 0 SAS 10000 0/0 560208/1147307696
fas3220b*>
fas3220b*> disk remove_ownership 0a.10.23 3c.10.22 0a.10.21 3c.10.20 0a.10.19 3c.10.18 0a.10.17 3c.10.16 0a.10.15 3c.10.14 0a.10.13 3c.10.12
#移除其他没有属于pool 0 的磁盘
Disk 0a.10.23 will have its ownership removed
Disk 3c.10.22 will have its ownership removed
Disk 0a.10.21 will have its ownership removed
Disk 3c.10.20 will have its ownership removed
Disk 0a.10.19 will have its ownership removed
Disk 3c.10.18 will have its ownership removed
Disk 0a.10.17 will have its ownership removed
Disk 3c.10.16 will have its ownership removed
Disk 0a.10.15 will have its ownership removed
Disk 3c.10.14 will have its ownership removed
Disk 0a.10.13 will have its ownership removed
Disk 3c.10.12 will have its ownership removed
Volumes must be taken offline. Are all impacted volumes offline(y/n)?? y
fas3220b*>
fas3220b*>
fas3220b*> disk show -n #查看没有归属关系的磁盘
DISK OWNER POOL SERIAL NUMBER HOME
------------ ------------- ----- ------------- -------------
0a.10.17 Not Owned NONE S0M1KAJ70000N421BYY6
0a.10.23 Not Owned NONE S0M1Q7A70000B4269971
3c.10.18 Not Owned NONE S0M1QHLA0000B426980S
3c.10.22 Not Owned NONE S0M1QHSK0000B425FJ0J
0a.10.15 Not Owned NONE S0M1Q6QS0000B426AYMV
0a.10.13 Not Owned NONE S0M1PG4S0000B426CD8P
3c.10.16 Not Owned NONE S0M1Q9NR0000B42690L4
3c.10.14 Not Owned NONE S0M1Q6T80000B426AK78
3c.10.20 Not Owned NONE S0M1HS4W0000M419ZJJX
0a.10.19 Not Owned NONE S0M1QDS40000B426AQ1E
3c.10.12 Not Owned NONE S0M1QHGS0000B426DTHH
0a.10.21 Not Owned NONE S0M1Q3PS0000M425K730
fas3220b*>
fas3220b*> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3c.10.0 3c 10 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0a.10.1 0a 10 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.2 3c 10 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0b.00.12 0b 0 12 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.14 0b 0 14 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.16 0b 0 16 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.18 0b 0 18 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.20 0b 0 20 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.22 0b 0 22 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.13 3b 0 13 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.15 3b 0 15 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.17 3b 0 17 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.19 3b 0 19 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.21 3b 0 21 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.23 3b 0 23 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.10.3 0a 10 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.5 0a 10 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.7 0a 10 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.9 0a 10 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.11 0a 10 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.4 3c 10 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.6 3c 10 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.8 3c 10 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.10 3c 10 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3b.00.1 3b 0 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.9 3b 0 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.11 3b 0 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.7 3b 0 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.5 3b 0 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.3 3b 0 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.0 0b 0 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.8 0b 0 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.10 0b 0 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.6 0b 0 6 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.4 0b 0 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.2 0b 0 2 SA:A 0 SAS 10000 0/0 560208/1147307696
零化系统.......
.....................................................................................................................................
.....................................................................................................................................
fas3220b> options disk #查看磁盘选项
disk.asup_on_mp_loss on (value might be overwritten in takeover)
disk.auto_assign on (value might be overwritten in takeover)
disk.latency_check.enable on (value might be overwritten in takeover)
disk.maint_center.allowed_entries 1 (value might be overwritten in takeover)
disk.maint_center.enable on (value might be overwritten in takeover)
disk.maint_center.max_disks 84 (value might be overwritten in takeover)
disk.maint_center.rec_allowed_entries 5 (value might be overwritten in takeover)
disk.maint_center.spares_check on (value might be overwritten in takeover)
disk.recovery_needed.count 5 (value might be overwritten in takeover)
fas3220b> options disk.auto_assign off #关闭disk自动assign 选项
You are changing option disk.auto_assign, which applies to
both members of the HA configuration in takeover mode.
This value must be the same on both HA members to ensure correct
takeover and giveback operation.
fas3220b> Thu Jul 24 12:49:47 CST [fas3220b:reg.options.cf.change:warning]: Option disk.auto_assign changed on one cluster node.
fas3220b>
fas3220b> options disk
disk.asup_on_mp_loss on (value might be overwritten in takeover)
disk.auto_assign off (value might be overwritten in takeover)
disk.latency_check.enable on (value might be overwritten in takeover)
disk.maint_center.allowed_entries 1 (value might be overwritten in takeover)
disk.maint_center.enable on (value might be overwritten in takeover)
disk.maint_center.max_disks 84 (value might be overwritten in takeover)
disk.maint_center.rec_allowed_entries 5 (value might be overwritten in takeover)
disk.maint_center.spares_check on (value might be overwritten in takeover)
disk.recovery_needed.count 5 (value might be overwritten in takeover)
fas3220b>
fas3220a>
fas3220a> options disk #在A控制器查看磁盘选项
disk.asup_on_mp_loss on (value might be overwritten in takeover)
disk.auto_assign off (value might be overwritten in takeover)
disk.latency_check.enable on (value might be overwritten in takeover)
disk.maint_center.allowed_entries 1 (value might be overwritten in takeover)
disk.maint_center.enable on (value might be overwritten in takeover)
disk.maint_center.max_disks 84 (value might be overwritten in takeover)
disk.maint_center.rec_allowed_entries 5 (value might be overwritten in takeover)
disk.maint_center.spares_check on (value might be overwritten in takeover)
disk.recovery_needed.count 5 (value might be overwritten in takeover)
fas3220a>
fas3220a> cf status
Controller Failover enabled, fas3220b is up.
fas3220a>
fas3220b*> aggr add aggr0 -d 0a.10.3 0a.10.5 0a.10.7 0a.10.9 3c.10.4 3c.10.6 3c.10.8 3c.10.10
#创建aggr0
Thu Jul 24 13:28:18 CST [fas3220b:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/3c.10.10 Shelf 10 Bay 10 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1Q6030000B42690PS] to aggregate aggr0 has completed successfully
Thu Jul 24 13:28:18 CST [fas3220b:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/3c.10.8 Shelf 10 Bay 8 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1QHLC0000B426DT88] to aggregate aggr0 has completed successfully
Thu Jul 24 13:28:18 CST [fas3220b:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/3c.10.6 Shelf 10 Bay 6 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1Q7H00000B4269FBL] to aggregate aggr0 has completed successfully
Addition of 8 disks to the aggregate has completed.
fas3220b*> Thu Jul 24 13:28:18 CST [fas3220b:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/3c.10.4 Shelf 10 Bay 4 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1QJLS0000B426C6KD] to aggregate aggr0 has completed successfully
Thu Jul 24 13:28:18 CST [fas3220b:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/0a.10.9 Shelf 10 Bay 9 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1QHW80000B424BGSG] to aggregate aggr0 has completed successfully
Thu Jul 24 13:28:18 CST [fas3220b:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/0a.10.7 Shelf 10 Bay 7 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1QK0Q0000B426ARRM] to aggregate aggr0 has completed successfully
Thu Jul 24 13:28:18 CST [fas3220b:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/0a.10.5 Shelf 10 Bay 5 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1Q73A0000B4269996] to aggregate aggr0 has completed successfully
Thu Jul 24 13:28:18 CST [fas3220b:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/0a.10.3 Shelf 10 Bay 3 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1QHH40000M425J6TW] to aggregate aggr0 has completed successfully
fas3220b*>
fas3220b*> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3c.10.0 3c 10 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0a.10.1 0a 10 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.2 3c 10 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0a.10.3 0a 10 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 0a.10.5 0a 10 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 0a.10.7 0a 10 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 0a.10.9 0a 10 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.4 3c 10 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.6 3c 10 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.8 3c 10 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.10 3c 10 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0b.00.12 0b 0 12 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.14 0b 0 14 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.16 0b 0 16 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.18 0b 0 18 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.20 0b 0 20 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.22 0b 0 22 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.13 3b 0 13 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.15 3b 0 15 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.17 3b 0 17 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.19 3b 0 19 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.21 3b 0 21 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.23 3b 0 23 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.10.11 0a 10 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3b.00.1 3b 0 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.9 3b 0 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.11 3b 0 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.7 3b 0 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.5 3b 0 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3b.00.3 3b 0 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.0 0b 0 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.8 0b 0 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.10 0b 0 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.6 0b 0 6 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.4 0b 0 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0b.00.2 0b 0 2 SA:A 0 SAS 10000 0/0 560208/1147307696
fas3220b*> df -Ag #查看aggr 空间
Aggregate total used avail capacity
aggr0 4429GB 469GB 3959GB 11%
aggr0/.snapshot 0GB 0GB 0GB ---%
fas3220b*> df -g #查看卷空间
Filesystem total used avail capacity Mounted on
/vol/vol0/ 443GB 1GB 442GB 0% /vol/vol0/
/vol/vol0/.snapshot 23GB 0GB 23GB 0% /vol/vol0/.snapshot
fas3220b*> vol size vol0 300g #创建vol0 为300g
vol size: Flexible volume 'vol0' size set to 300g.
fas3220b*> df -Ag
Aggregate total used avail capacity
aggr0 4429GB 304GB 4124GB 7%
aggr0/.snapshot 0GB 2GB 0GB ---%
fas3220a*> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3b.00.0 3b 0 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0b.00.1 0b 0 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.2 3b 0 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0b.00.3 0b 0 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.5 0b 0 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.7 0b 0 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.9 0b 0 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 0b.00.11 0b 0 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.4 3b 0 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.6 3b 0 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.8 3b 0 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
spare 3b.00.10 3b 0 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3b.00.22 3b 0 22 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.23 0b 0 23 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.17 0b 0 17 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.13 0b 0 13 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.16 3b 0 16 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.18 3b 0 18 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.21 0b 0 21 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.14 3b 0 14 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.12 3b 0 12 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.20 3b 0 20 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.15 0b 0 15 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.19 0b 0 19 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3c.10.11 3c 10 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.9 3c 10 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.1 3c 10 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.5 3c 10 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.7 3c 10 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.3 3c 10 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.10 0a 10 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.2 0a 10 2 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.8 0a 10 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.0 0a 10 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.4 0a 10 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.6 0a 10 6 SA:A 0 SAS 10000 0/0 560208/1147307696
fas3220a*>
fas3220a*> aggr add aggr0 8 #在A控制器上，创建aggr0
Thu Jul 24 13:30:10 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/3b.00.10 Shelf 0 Bay 10 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1JWYV0000N421AE9Z] to aggregate aggr0 has completed successfully
Thu Jul 24 13:30:10 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/0b.00.9 Shelf 0 Bay 9 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1KAK30000N41629LB] to aggregate aggr0 has completed successfully
Thu Jul 24 13:30:10 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/3b.00.8 Shelf 0 Bay 8 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1QE1V0000B426BZRA] to aggregate aggr0 has completed successfully
Addition of 8 disks to the aggregate has completed.
fas3220a*> Thu Jul 24 13:30:10 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/0b.00.7 Shelf 0 Bay 7 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1K1BJ0000B421CYK0] to aggregate aggr0 has completed successfully
Thu Jul 24 13:30:10 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/3b.00.6 Shelf 0 Bay 6 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1JX7J0000N421BY5B] to aggregate aggr0 has completed successfully
Thu Jul 24 13:30:10 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/0b.00.5 Shelf 0 Bay 5 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1QJP60000B426AHN7] to aggregate aggr0 has completed successfully
Thu Jul 24 13:30:10 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/3b.00.4 Shelf 0 Bay 4 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1QJQM0000B426DS51] to aggregate aggr0 has completed successfully
Thu Jul 24 13:30:10 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex0/rg0/0b.00.3 Shelf 0 Bay 3 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1KAGB0000N421BYYU] to aggregate aggr0 has completed successfully
fas3220a*>
fas3220a*> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3b.00.0 3b 0 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0b.00.1 0b 0 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.2 3b 0 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.3 0b 0 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.4 3b 0 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.5 0b 0 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.6 3b 0 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.7 0b 0 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.8 3b 0 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.9 0b 0 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.10 3b 0 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks (empty)
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0b.00.11 0b 0 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3b.00.22 3b 0 22 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.23 0b 0 23 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.17 0b 0 17 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.13 0b 0 13 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.16 3b 0 16 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.18 3b 0 18 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.21 0b 0 21 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.14 3b 0 14 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.12 3b 0 12 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.20 3b 0 20 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.15 0b 0 15 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.19 0b 0 19 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3c.10.11 3c 10 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.9 3c 10 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.1 3c 10 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.5 3c 10 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.7 3c 10 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.3 3c 10 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.10 0a 10 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.2 0a 10 2 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.8 0a 10 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.0 0a 10 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.4 0a 10 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.6 0a 10 6 SA:A 0 SAS 10000 0/0 560208/1147307696
fas3220a*> disk show -n
DISK OWNER POOL SERIAL NUMBER HOME
------------ ------------- ----- ------------- -------------
3c.10.13 Not Owned NONE S0M1PG4S0000B426CD8P
3c.10.15 Not Owned NONE S0M1Q6QS0000B426AYMV
3c.10.21 Not Owned NONE S0M1Q3PS0000M425K730
3c.10.19 Not Owned NONE S0M1QDS40000B426AQ1E
3c.10.17 Not Owned NONE S0M1KAJ70000N421BYY6
3c.10.23 Not Owned NONE S0M1Q7A70000B4269971
0a.10.12 Not Owned NONE S0M1QHGS0000B426DTHH
0a.10.22 Not Owned NONE S0M1QHSK0000B425FJ0J
0a.10.18 Not Owned NONE S0M1QHLA0000B426980S
0a.10.20 Not Owned NONE S0M1HS4W0000M419ZJJX
0a.10.14 Not Owned NONE S0M1Q6T80000B426AK78
0a.10.16 Not Owned NONE S0M1Q9NR0000B42690L4
fas3220a*> disk assign all -p 1 #在A控制器上，制定所有没有归属关系的磁盘，属于pool 1
Thu Jul 24 13:30:37 CST [fas3220a:diskown.changingOwner:info]: changing ownership for disk 3c.10.13 (S/N S0M1PG4S0000B426CD8P) from unowned (ID 4294967295) to fas3220a (ID 2017870126)
fas3220a*> Thu Jul 24 13:30:37 CST [fas3220a:diskown.changingOwner:info]: changing ownership for disk 3c.10.15 (S/N S0M1Q6QS0000B426AYMV) from unowned (ID 4294967295) to fas3220a (ID 2017870126)
Thu Jul 24 13:30:37 CST [fas3220a:diskown.changingOwner:info]: changing ownership for disk 3c.10.21 (S/N S0M1Q3PS0000M425K730) from unowned (ID 4294967295) to fas3220a (ID 2017870126)
Thu Jul 24 13:30:37 CST [fas3220a:diskown.changingOwner:info]: changing ownership for disk 3c.10.19 (S/N S0M1QDS40000B426AQ1E) from unowned (ID 4294967295) to fas3220a (ID 2017870126)
Thu Jul 24 13:30:37 CST [fas3220a:diskown.changingOwner:info]: changing ownership for disk 3c.10.17 (S/N S0M1KAJ70000N421BYY6) from unowned (ID 4294967295) to fas3220a (ID 2017870126)
Thu Jul 24 13:30:37 CST [fas3220a:diskown.changingOwner:info]: changing ownership for disk 3c.10.23 (S/N S0M1Q7A70000B4269971) from unowned (ID 4294967295) to fas3220a (ID 2017870126)
Thu Jul 24 13:30:37 CST [fas3220a:diskown.changingOwner:info]: changing ownership for disk 0a.10.12 (S/N S0M1QHGS0000B426DTHH) from unowned (ID 4294967295) to fas3220a (ID 2017870126)
Thu Jul 24 13:30:37 CST [fas3220a:diskown.changingOwner:info]: changing ownership for disk 0a.10.22 (S/N S0M1QHSK0000B425FJ0J) from unowned (ID 4294967295) to fas3220a (ID 2017870126)
Thu Jul 24 13:30:37 CST [fas3220a:diskown.changingOwner:info]: changing ownership for disk 0a.10.18 (S/N S0M1QHLA0000B426980S) from unowned (ID 4294967295) to fas3220a (ID 2017870126)
Thu Jul 24 13:30:37 CST [fas3220a:diskown.changingOwner:info]: changing ownership for disk 0a.10.20 (S/N S0M1HS4W0000M419ZJJX) from unowned (ID 4294967295) to fas3220a (ID 2017870126)
Thu Jul 24 13:30:37 CST [fas3220a:diskown.changingOwner:info]: changing ownership for disk 0a.10.14 (S/N S0M1Q6T80000B426AK78) from unowned (ID 4294967295) to fas3220a (ID 2017870126)
Thu Jul 24 13:30:37 CST [fas3220a:diskown.changingOwner:info]: changing ownership for disk 0a.10.16 (S/N S0M1Q9NR0000B42690L4) from unowned (ID 4294967295) to fas3220a (ID 2017870126)
fas3220a*>
fas3220a*>
fas3220a*> sysconfig -r
Aggregate aggr0 (online, raid_dp) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3b.00.0 3b 0 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0b.00.1 0b 0 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.2 3b 0 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.3 0b 0 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.4 3b 0 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.5 0b 0 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.6 3b 0 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.7 0b 0 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.8 3b 0 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.9 0b 0 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.10 3b 0 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0a.10.12 0a 10 12 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.14 0a 10 14 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.16 0a 10 16 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.18 0a 10 18 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.20 0a 10 20 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 0a.10.22 0a 10 22 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.13 3c 10 13 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.15 3c 10 15 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.17 3c 10 17 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.19 3c 10 19 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.21 3c 10 21 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
spare 3c.10.23 3c 10 23 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0b.00.11 0b 0 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3b.00.22 3b 0 22 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.23 0b 0 23 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.17 0b 0 17 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.13 0b 0 13 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.16 3b 0 16 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.18 3b 0 18 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.21 0b 0 21 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.14 3b 0 14 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.12 3b 0 12 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.20 3b 0 20 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.15 0b 0 15 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.19 0b 0 19 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3c.10.11 3c 10 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.9 3c 10 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.1 3c 10 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.5 3c 10 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.7 3c 10 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.3 3c 10 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.10 0a 10 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.2 0a 10 2 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.8 0a 10 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.0 0a 10 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.4 0a 10 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.6 0a 10 6 SA:A 0 SAS 10000 0/0 560208/1147307696
fas3220a*>
fas3220a*> df -Ag #在A控制器上查看aggr
Aggregate total used avail capacity
aggr0 4429GB 469GB 3959GB 11%
aggr0/.snapshot 0GB 0GB 0GB ---%
fas3220a*>
fas3220a*> df -g
Filesystem total used avail capacity Mounted on
/vol/vol0/ 443GB 1GB 442GB 0% /vol/vol0/
/vol/vol0/.snapshot 23GB 0GB 23GB 0% /vol/vol0/.snapshot
fas3220a*> vol size vol0 300g #设置vol0 为300g
vol size: Flexible volume 'vol0' size set to 300g.
fas3220a*> aggr mirror aggr0 #执行aggr mirror
Thu Jul 24 13:31:46 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex3/rg0/0a.10.22 Shelf 10 Bay 22 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1QHSK0000B425FJ0J] to aggregate aggr0 has completed successfully
Thu Jul 24 13:31:46 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex3/rg0/3c.10.21 Shelf 10 Bay 21 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1Q3PS0000M425K730] to aggregate aggr0 has completed successfully
Thu Jul 24 13:31:46 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex3/rg0/0a.10.20 Shelf 10 Bay 20 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1HS4W0000M419ZJJX] to aggregate aggr0 has completed successfully
Thu Jul 24 13:31:46 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex3/rg0/3c.10.19 Shelf 10 Bay 19 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1QDS40000B426AQ1E] to aggregate aggr0 has completed successfully
Creation of a mirror plex with 11 disks has completed.
fas3220a*> Thu Jul 24 13:31:46 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex3/rg0/0a.10.18 Shelf 10 Bay 18 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1QHLA0000B426980S] to aggregate aggr0 has completed successfully
Thu Jul 24 13:31:46 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex3/rg0/3c.10.17 Shelf 10 Bay 17 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1KAJ70000N421BYY6] to aggregate aggr0 has completed successfully
Thu Jul 24 13:31:46 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex3/rg0/0a.10.16 Shelf 10 Bay 16 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1Q9NR0000B42690L4] to aggregate aggr0 has completed successfully
Thu Jul 24 13:31:46 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex3/rg0/3c.10.15 Shelf 10 Bay 15 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1Q6QS0000B426AYMV] to aggregate aggr0 has completed successfully
Thu Jul 24 13:31:46 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex3/rg0/0a.10.14 Shelf 10 Bay 14 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1Q6T80000B426AK78] to aggregate aggr0 has completed successfully
Thu Jul 24 13:31:46 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex3/rg0/3c.10.13 Shelf 10 Bay 13 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1PG4S0000B426CD8P] to aggregate aggr0 has completed successfully
Thu Jul 24 13:31:46 CST [fas3220a:raid.vol.disk.add.done:notice]: Addition of Disk /aggr0/plex3/rg0/0a.10.12 Shelf 10 Bay 12 [NETAPP X422_SLTNG600A10 NA00] S/N [S0M1QHGS0000B426DTHH] to aggregate aggr0 has completed successfully
Thu Jul 24 13:31:47 CST [fas3220a:raid.rg.resync.start:notice]: /aggr0/plex3/rg0: start resynchronization (level 0)
Thu Jul 24 13:31:47 CST [fas3220a:raid.mirror.resync.start:notice]: /aggr0: start resynchronize to target /aggr0/plex3
Thu Jul 24 13:31:47 CST [fas3220a:fmmb.current.lock.disk:info]: Disk 3b.00.0 is a local HA mailbox disk.
Thu Jul 24 13:31:47 CST [fas3220a:fmmb.current.lock.disk:info]: Disk 0b.00.1 is a local HA mailbox disk.
Thu Jul 24 13:31:47 CST [fas3220a:fmmb.current.lock.disk:info]: Disk 0a.10.22 is a local HA mailbox disk.
Thu Jul 24 13:31:47 CST [fas3220a:fmmb.current.lock.disk:info]: Disk 3c.10.21 is a local HA mailbox disk.
fas3220a*>
fas3220a*>
fas3220a*> sysconfig -r
Aggregate aggr0 (online, raid_dp, resyncing) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3b.00.0 3b 0 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0b.00.1 0b 0 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.2 3b 0 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.3 0b 0 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.4 3b 0 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.5 0b 0 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.6 3b 0 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.7 0b 0 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.8 3b 0 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.9 0b 0 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.10 3b 0 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Plex /aggr0/plex3 (online, normal, resyncing 0% completed, pool1)
RAID group /aggr0/plex3/rg0 (level-0 resync in progress, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0a.10.22 0a 10 22 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
parity 3c.10.21 3c 10 21 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
data 0a.10.12 0a 10 12 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.13 3c 10 13 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
data 0a.10.14 0a 10 14 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.15 3c 10 15 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
data 0a.10.16 0a 10 16 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.17 3c 10 17 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
data 0a.10.18 0a 10 18 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.19 3c 10 19 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
data 0a.10.20 0a 10 20 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 3c.10.23 3c 10 23 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0b.00.11 0b 0 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3b.00.22 3b 0 22 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.23 0b 0 23 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.17 0b 0 17 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.13 0b 0 13 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.16 3b 0 16 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.18 3b 0 18 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.21 0b 0 21 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.14 3b 0 14 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.12 3b 0 12 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.20 3b 0 20 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.15 0b 0 15 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.19 0b 0 19 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3c.10.11 3c 10 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.9 3c 10 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.1 3c 10 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.5 3c 10 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.7 3c 10 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.3 3c 10 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.10 0a 10 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.2 0a 10 2 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.8 0a 10 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.0 0a 10 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.4 0a 10 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.6 0a 10 6 SA:A 0 SAS 10000 0/0 560208/1147307696
fas3220a*>
六、配置vol 和lun
fas3220a*>
fas3220a*> priv set
fas3220a>
fas3220a>
fas3220a> df -Ag #查看A控制器的aggr 空间分布
Aggregate total used avail capacity
aggr0 4208GB 302GB 3905GB 7%
aggr0/.snapshot 221GB 2GB 219GB 1%
fas3220a>
fas3220a> df -g #查看A控制器的vol空间分布
Filesystem total used avail capacity Mounted on
/vol/vol0/ 285GB 1GB 283GB 0% /vol/vol0/
/vol/vol0/.snapshot 15GB 0GB 14GB 0% /vol/vol0/.snapshot
fas3220b*> snap reserve -A aggr0 0 #配置B控制器的aggr0快照保留空间为0
fas3220b*> snap sched -A aggr0 0 #取消aggr0 的快照计划
fas3220b*> df -Ag #查看A控制器的aggr 空间分布
Aggregate total used avail capacity
aggr0 4429GB 304GB 4124GB 7%
aggr0/.snapshot 0GB 2GB 0GB ---%
fas3220b*>
fas3220b*> df -g #查看A控制器的vol空间分布
Filesystem total used avail capacity Mounted on
/vol/vol0/ 285GB 1GB 283GB 0% /vol/vol0/
/vol/vol0/.snapshot 15GB 0GB 14GB 0% /vol/vol0/.snapshot
fas3220b*>
fas3220a> snap reserve -A aggr0 0 #配置A控制器的aggr0快照保留空间为0
fas3220a> snap sched -A agg0 0 #取消aggr0 的快照计划
fas3220a>
fas3220a> df -Ag
Aggregate total used avail capacity
aggr0 4429GB 304GB 4124GB 7%
aggr0/.snapshot 0GB 2GB 0GB ---%
fas3220a> sysconfig -r
Aggregate aggr0 (online, raid_dp, mirrored) (block checksums)
Plex /aggr0/plex0 (online, normal, active, pool0)
RAID group /aggr0/plex0/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 3b.00.0 3b 0 0 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
parity 0b.00.1 0b 0 1 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.2 3b 0 2 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.3 0b 0 3 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.4 3b 0 4 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.5 0b 0 5 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.6 3b 0 6 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.7 0b 0 7 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.8 3b 0 8 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
data 0b.00.9 0b 0 9 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
data 3b.00.10 3b 0 10 SA:A 0 SAS 10000 560000/1146880000 560208/1147307696
Plex /aggr0/plex3 (online, normal, active, pool1)
RAID group /aggr0/plex3/rg0 (normal, block checksums)
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
dparity 0a.10.22 0a 10 22 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
parity 3c.10.21 3c 10 21 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
data 0a.10.12 0a 10 12 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.13 3c 10 13 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
data 0a.10.14 0a 10 14 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.15 3c 10 15 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
data 0a.10.16 0a 10 16 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.17 3c 10 17 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
data 0a.10.18 0a 10 18 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
data 3c.10.19 3c 10 19 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
data 0a.10.20 0a 10 20 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
Pool1 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 3c.10.23 3c 10 23 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
Pool0 spare disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
Spare disks for block checksum
spare 0b.00.11 0b 0 11 SA:B 0 SAS 10000 560000/1146880000 560208/1147307696
Partner disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM Used (MB/blks) Phys (MB/blks)
--------- ------ ------------- ---- ---- ---- ----- -------------- --------------
partner 3b.00.22 3b 0 22 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.23 0b 0 23 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.17 0b 0 17 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.13 0b 0 13 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.16 3b 0 16 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.18 3b 0 18 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.21 0b 0 21 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.14 3b 0 14 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.12 3b 0 12 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3b.00.20 3b 0 20 SA:A 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.15 0b 0 15 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 0b.00.19 0b 0 19 SA:B 1 SAS 10000 560000/1146880000 560208/1147307696
partner 3c.10.11 3c 10 11 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.9 3c 10 9 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.1 3c 10 1 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.5 3c 10 5 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.7 3c 10 7 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 3c.10.3 3c 10 3 SA:B 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.10 0a 10 10 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.2 0a 10 2 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.8 0a 10 8 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.0 0a 10 0 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.4 0a 10 4 SA:A 0 SAS 10000 0/0 560208/1147307696
partner 0a.10.6 0a 10 6 SA:A 0 SAS 10000 0/0 560208/1147307696
fas3220a>
fas3220a>
fas3220a> df -Ag
Aggregate total used avail capacity
aggr0 4429GB 304GB 4124GB 7%
aggr0/.snapshot 0GB 2GB 0GB ---%
fas3220a> df -g
Filesystem total used avail capacity Mounted on
/vol/vol0/ 285GB 1GB 283GB 0% /vol/vol0/
/vol/vol0/.snapshot 15GB 0GB 14GB 0% /vol/vol0/.snapshot
fas3220a> vol create vol_vm1 aggr0 4050g #在aggr0 上创建vol_vm1
exportfs [Line 2]: NFS not licensed; local volume /vol/vol0 not exported
exportfs [Line 3]: NFS not licensed; local volume /vol/vol0/home not exported
exportfs [Line 2]: NFS not licensed; local volume /vol/vol_vm1 not exported
Creation of volume 'vol_vm1' with size 4050g on containing aggregate
'aggr0' has completed.
fas3220a> snap reserve vol_vm1 0
fas3220a> snap sched vol_vm1 0
fas3220a> df -g
Filesystem total used avail capacity Mounted on
/vol/vol0/ 285GB 1GB 283GB 0% /vol/vol0/
/vol/vol0/.snapshot 15GB 0GB 14GB 0% /vol/vol0/.snapshot
/vol/vol_vm1/ 4050GB 0GB 4049GB 0% /vol/vol_vm1/
/vol/vol_vm1/.snapshot 0GB 0GB 0GB ---% /vol/vol_vm1/.snapshot
fas3220a>
fas3220a> lun create -s 4000g -t vmware /vol/vol_vm1/lun1
#在vol_vm1上创建lun1,类型为vmware
Thu Jul 24 13:41:20 CST [fas3220a:perf.archive.max_disk_space.changed:info]: Maximum disk space consumption allowed for the performance archiver was changed from '10021110088' to '6442450945' bytes. Change not committed. (11729)
fas3220a> lun show #查看lun
/vol/vol_vm1/lun1 3.9t (4294967296000) (r/w, online)
fas3220a>
fas3220a> df -g #查看A控制器的vol 空间
Filesystem total used avail capacity Mounted on
/vol/vol0/ 285GB 1GB 283GB 0% /vol/vol0/
/vol/vol0/.snapshot 15GB 0GB 14GB 0% /vol/vol0/.snapshot
/vol/vol_vm1/ 4050GB 4015GB 34GB 99% /vol/vol_vm1/
/vol/vol_vm1/.snapshot 0GB 0GB 0GB ---% /vol/vol_vm1/.snapshot
fas3220a>
fas3220a> df -Ag
Aggregate total used avail capacity
aggr0 4429GB 4377GB 52GB 99%
aggr0/.snapshot 0GB 2GB 0GB ---%
fas3220a>
fas3220a>
fas3220a> snap sched -V #查看快照计划
Volume vol0: 0 2 6@8,12,16,20
Volume vol_vm1: 0 0 0
fas3220a>
fas3220b*>
fas3220b*>
fas3220b*> priv set
fas3220b>
fas3220b> df -Ag
Aggregate total used avail capacity
aggr0 4429GB 304GB 4124GB 7%
aggr0/.snapshot 0GB 2GB 0GB ---%
fas3220b>
fas3220b> df -g
Filesystem total used avail capacity Mounted on
/vol/vol0/ 285GB 1GB 283GB 0% /vol/vol0/
/vol/vol0/.snapshot 15GB 0GB 14GB 0% /vol/vol0/.snapshot
fas3220b> vol create vol_vm2 aggr0 2020g #创建vol vol_vm2
Thu Jul 24 13:43:05 CST [fas3220b:perf.archive.max_disk_space.changed:info]: Maximum disk space consumption allowed for the performance archiver was changed from '10021110088' to '6442450945' bytes. Change not committed. (11729)
exportfs [Line 2]: NFS not licensed; local volume /vol/vol0 not exported
exportfs [Line 3]: NFS not licensed; local volume /vol/vol0/home not exported
exportfs [Line 2]: NFS not licensed; local volume /vol/vol_vm2 not exported
Creation of volume 'vol_vm2' with size 2020g on containing aggregate
'aggr0' has completed.
fas3220b>
fas3220b>
fas3220b> df -g
Filesystem total used avail capacity Mounted on
/vol/vol0/ 285GB 1GB 283GB 0% /vol/vol0/
/vol/vol0/.snapshot 15GB 0GB 14GB 0% /vol/vol0/.snapshot
/vol/vol_vm2/ 1919GB 0GB 1918GB 0% /vol/vol_vm2/
/vol/vol_vm2/.snapshot 101GB 0GB 101GB 0% /vol/vol_vm2/.snapshot
fas3220b> snap reserve vol_vm2 0 #设置vol_vm2 的快照保留为0
fas3220b> snap sched vol_vm2 0 #取消vol_vm2 的快照计划
fas3220b>
fas3220b> df -g
Filesystem total used avail capacity Mounted on
/vol/vol0/ 285GB 1GB 283GB 0% /vol/vol0/
/vol/vol0/.snapshot 15GB 0GB 14GB 0% /vol/vol0/.snapshot
/vol/vol_vm2/ 2020GB 0GB 2019GB 0% /vol/vol_vm2/
/vol/vol_vm2/.snapshot 0GB 0GB 0GB ---% /vol/vol_vm2/.snapshot
fas3220b>
fas3220b> lun create -s 2000g -t vmware /vol/vol_vm2/lun2 #在vol_mv2下创建lun lun2
fas3220b>
fas3220b> lun sThu Jul 24 13:44:01 CST [fas3220b:monitor.globalStatus.nonCritical:warning]: /vol/vol_vm2 is full (using or reserving 99% of space and 0% of inodes, using 99% of reserve).
how
/vol/vol_vm2/lun2 2.0t (2147483648000) (r/w, online)
fas3220b>
fas3220b> df -g
Filesystem total used avail capacity Mounted on
/vol/vol0/ 285GB 1GB 283GB 0% /vol/vol0/
/vol/vol0/.snapshot 15GB 0GB 14GB 0% /vol/vol0/.snapshot
/vol/vol_vm2/ 2020GB 2007GB 12GB 99% /vol/vol_vm2/
/vol/vol_vm2/.snapshot 0GB 0GB 0GB ---% /vol/vol_vm2/.snapshot
fas3220b>
fas3220b> df -Ag
Aggregate total used avail capacity
aggr0 4429GB 2336GB 2093GB 53%
aggr0/.snapshot 0GB 2GB 0GB ---%
fas3220b>
fas3220b> vol create vol_ora1 aggr0 510g #创建vol vol_ora1
exportfs [Line 2]: NFS not licensed; local volume /vol/vol_vm2 not exported
exportfs [Line 2]: NFS not licensed; local volume /vol/vol_ora1 not exported
Creation of volume 'vol_ora1' with size 510g on containing aggregate
'aggr0' has completed.
fas3220b> vol create vol_win1 aggr0 510g #创建vol vol_win1
exportfs [Line 2]: NFS not licensed; local volume /vol/vol_ora1 not exported
exportfs [Line 2]: NFS not licensed; local volume /vol/vol_win1 not exported
Creation of volume 'vol_win1' with size 510g on containing aggregate
'aggr0' has completed.
fas3220b> vol create vol_win2 aggr0 510g #创建vol vol_win2
说明：后来vol_win1 和vol_win2 合并为一个vol_win
exportfs [Line 2]: NFS not licensed; local volume /vol/vol_win1 not exported
exportfs [Line 2]: NFS not licensed; local volume /vol/vol_win2 not exported
Creation of volume 'vol_win2' with size 510g on containing aggregate
'aggr0' has completed.
fas3220b>
fas3220b> snap reserve vol_ora1 0
fas3220b> snap reserve vol_win1 0
fas3220b>
fas3220b> snap reserve vol_win2 0
fas3220b> snap sched vol_win2 0
fas3220b> snap sched vol_win1 0
fas3220b> snap sched vol_ora1 0
fas3220b>
fas3220b>
fas3220b> df -g
Filesystem total used avail capacity Mounted on
/vol/vol0/ 285GB 1GB 283GB 0% /vol/vol0/
/vol/vol0/.snapshot 15GB 0GB 14GB 0% /vol/vol0/.snapshot
/vol/vol_vm2/ 2020GB 2007GB 12GB 99% /vol/vol_vm2/
/vol/vol_vm2/.snapshot 0GB 0GB 0GB ---% /vol/vol_vm2/.snapshot
/vol/vol_ora1/ 510GB 0GB 509GB 0% /vol/vol_ora1/
/vol/vol_ora1/.snapshot 0GB 0GB 0GB ---% /vol/vol_ora1/.snapshot
/vol/vol_win1/ 510GB 0GB 509GB 0% /vol/vol_win1/
/vol/vol_win1/.snapshot 0GB 0GB 0GB ---% /vol/vol_win1/.snapshot
/vol/vol_win2/ 510GB 0GB 509GB 0% /vol/vol_win2/
/vol/vol_win2/.snapshot 0GB 0GB 0GB ---% /vol/vol_win2/.snapshot
fas3220b> df -Ag
Aggregate total used avail capacity
aggr0 4429GB 3874GB 554GB 87%
aggr0/.snapshot 0GB 2GB 0GB ---%
fas3220b>
fas3220b>
fas3220b> lun create -s 500g -t linux /vol/vol_ora1/lun3
#在vol_ora1下面创建lun3
lun create: created a LUN of size: 500.1g (536952700928)
fas3220b>
fas3220b> lun create -s 500g -t windows /vol/vol_win1/lun4
#在vol_win1下面创建lun4
lun create: created a LUN of size: 500.1g (536946278400)
fas3220b>
fas3220b> lun create -s 500g -t windows /vol/vol_win2/lun5
#在vol_win2下面创建lun5
说明：后来vol_win1/lun4 和vol_win2/lun5 合并为一个lun4,大小为1000g
lun create: created a LUN of size: 500.1g (536946278400)
fas3220b>
fas3220b>
fas3220b> lun show
/vol/vol_ora1/lun3 500.1g (536952700928) (r/w, online)
/vol/vol_vm2/lun2 2.0t (2147483648000) (r/w, online)
/vol/vol_win1/lun4 500.1g (536946278400) (r/w, online)
/vol/vol_win2/lun5 500.1g (536946278400) (r/w, online)
fas3220b>
fas3220b> ifconfig -a #查看网络接口配置
e0a: flags=0x274c867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
inet 10.150.208.9 netmask 0xffffff00 broadcast 10.150.208.255
partner e0a (not in use)
ether 00:a0:98:55:9a:8a (auto-unknown-down) flowcontrol full
e0b: flags=0x270c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
ether 00:a0:98:55:9a:8b (auto-unknown-down) flowcontrol full
e2a: flags=0x9f0c867<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500
ether 02:a0:98:55:9a:8b (auto-10g_sr-fd-up) flowcontrol full
trunked vif2
e2b: flags=0x9f0c867<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500
ether 02:a0:98:55:9a:8b (auto-10g_sr-fd-up) flowcontrol full
trunked vif2
e5a: flags=0x9f0c867<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500
ether 02:a0:98:55:9a:8a (auto-10g_sr-fd-up) flowcontrol full
trunked vif1
e5b: flags=0x9f0c867<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500
ether 02:a0:98:55:9a:8a (auto-10g_sr-fd-up) flowcontrol full
trunked vif1
c0a: flags=0x170e866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
ether 00:a0:98:55:9a:8c (auto-unknown-enabling) flowcontrol full
c0b: flags=0x170e866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
ether 00:a0:98:55:9a:8d (auto-unknown-enabling) flowcontrol full
e0M: flags=0x230c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,MGMT_PORT> mtu 1500
ether 00:a0:98:55:9a:8e (auto-unknown-down) flowcontrol full
e0P: flags=0x2b4c867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM,ACP_PORT> mtu 1500 PRIVATE
inet 192.168.1.219 netmask 0xfffffc00 broadcast 192.168.3.255 noddns
ether 00:a0:98:55:9a:8f (auto-100tx-fd-up) flowcontrol full
lo: flags=0x1b48049<UP,LOOPBACK,RUNNING,MULTICAST,TCPCKSUM> mtu 8160
inet 127.0.0.1 netmask 0xff000000 broadcast 127.0.0.1
ether 00:00:00:00:00:00 (VIA Provider)
losk: flags=0x40a400c9<UP,LOOPBACK,RUNNING> mtu 9188
inet 127.0.20.1 netmask 0xff000000 broadcast 127.0.20.1
vif1: flags=0x22f4c863<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
inet 192.168.100.3 netmask 0xffffff00 broadcast 192.168.100.255
partner vif1 (not in use)
ether 02:a0:98:55:9a:8a (Enabled interface groups)
vif2: flags=0x22f4c863<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
inet 192.168.100.4 netmask 0xffffff00 broadcast 192.168.100.255
partner vif2 (not in use)
ether 02:a0:98:55:9a:8b (Enabled interface groups)
fas3220b> sysconfig -a #查看所有配置信息
NetApp Release 8.1.3 7-Mode: Sat Jun 8 08:11:51 PDT 2013
System ID: 2017886331 (fas3220b); partner ID: 2017870126 (fas3220a)
System Serial Number: 450000056236 (fas3220b)
System Rev: B7
System Storage Configuration: Multi-Path HA
System ACP Connectivity: NA
slot 0: System Board 2.3 GHz (System Board XVI B7)
Model Name: FAS3220 #硬件型号
Part Number: 111-01061
Revision: B7
Serial Number: 9441445073 #序列号
BIOS version: 5.2.1
Loader version: 3.4
Processors: 4
Processor ID: 0x1067a
Microcode Version: 0xa0b
Processor type: Intel(R) Xeon(R) CPU L5410 @ 2.33GHz
Memory Size: 12288 MB
Memory Attributes: Bank Interleaving
Hoisting
Rank Interleaving
Chipkill ECC
NVMEM Size: 1600 MB of Main Memory Used
CMOS RAM Status: OK
Service Processor Status: Online
Firmware Version: 1.3.3
Mgmt MAC Address: 00:A0:98:55:9A:90
Ethernet Link: down
Using DHCP: no
IPv4 configuration:
IP Address: 10.150.208.10
Netmask: 255.255.255.0
Gateway: 10.150.208.254
IPv6 configuration: Disabled
IOXM Status: present
Power: Good
Agent version: N/A
Serial Number: 9441912947
Part Number: 111-00647
Version: D1
slot 0: Dual 10G Ethernet Controller T320E-SFP/KR
Device Type: CT-FE-3
Version Number: T3-SRAM1.1.0-BR1016-02-01-FW7.7.209-DR04
Serial Number: jb04050693
c0a MAC Address: 00:a0:98:55:9a:8c (auto-unknown-enabling)
c0b MAC Address: 00:a0:98:55:9a:8d (auto-unknown-enabling)
memory mapped I/O base 0xde801000, size 0x1000
memory mapped I/O base 0xde000000, size 0x800000
memory mapped I/O base 0xde800000, size 0x1000
slot 0: Internal BGE 10/100 Ethernet Controller
e0M MAC Address: 00:a0:98:55:9a:8e (auto-unknown-down)
e0P MAC Address: 00:a0:98:55:9a:8f (auto-100tx-fd-up)
Device Type: BCM5721
memory mapped I/O base 0xdf900000, size 0x10000
memory mapped I/O base 0xdfa00000, size 0x10000
slot 0: Dual 10/100/1000 Ethernet Controller G20
e0a MAC Address: 00:a0:98:55:9a:8a (auto-unknown-down)
e0b MAC Address: 00:a0:98:55:9a:8b (auto-unknown-down)
Device Type: Rev 6
memory mapped I/O base 0x00000000df820000, size 0x20000
memory mapped I/O base 0x00000000df800000, size 0x20000
I/O base 0x0000000000003000, size 0x20
memory mapped I/O base 0x00000000df860000, size 0x20000
memory mapped I/O base 0x00000000df840000, size 0x20000
I/O base 0x0000000000003020, size 0x20
slot 0: SAS Host Adapter 0a (PMC-Sierra PM8001 rev. C, SAS, <UP>)
Firmware rev: 01.11.06.00
Base WWN: 5:00a098:0035677:80
Phy State: [0] Enabled, 6.0 Gb/s
[1] Enabled, 6.0 Gb/s
[2] Enabled, 6.0 Gb/s
[3] Enabled, 6.0 Gb/s
QSFP Vendor: Amphenol
QSFP Part Number: 112-00178+A0
QSFP Type: Passive Copper 5m ID:01
QSFP Serial Number: APF13481785U25
10.0 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1JX390000N4216Z70)
10.1 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHTG0000B426APT7)
10.2 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHS60000N423BDVP)
10.3 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHH40000M425J6TW)
10.4 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QJLS0000B426C6KD)
10.5 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q73A0000B4269996)
10.6 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q7H00000B4269FBL)
10.7 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QK0Q0000B426ARRM)
10.8 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHLC0000B426DT88)
10.9 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHW80000B424BGSG)
10.10: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q6030000B42690PS)
10.11: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q5F20000B426AQGY)
10.12: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHGS0000B426DTHH)
10.13: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1PG4S0000B426CD8P)
10.14: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q6T80000B426AK78)
10.15: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q6QS0000B426AYMV)
10.16: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q9NR0000B42690L4)
10.17: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1KAJ70000N421BYY6)
10.18: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHLA0000B426980S)
10.19: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QDS40000B426AQ1E)
10.20: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1HS4W0000M419ZJJX)
10.21: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q3PS0000M425K730)
10.22: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHSK0000B425FJ0J)
10.23: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q7A70000B4269971)
Shelf 10: IOM6 Firmware rev. IOM6 A: 0151 IOM6 B: 0151
slot 0: SAS Host Adapter 0b (PMC-Sierra PM8001 rev. C, SAS, <UP>)
Firmware rev: 01.11.06.00
Base WWN: 5:00a098:0035677:84
Phy State: [4] Enabled, 6.0 Gb/s
[5] Enabled, 6.0 Gb/s
[6] Enabled, 6.0 Gb/s
[7] Enabled, 6.0 Gb/s
QSFP Vendor: Amphenol
QSFP Part Number: 112-00178+A0
QSFP Type: Passive Copper 5m ID:01
QSFP Serial Number: APF13501787CYY
00.0 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1HS6R0000M419DZWT)
00.1 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q9KT0000B426AL5V)
00.2 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q3280000M425J5HP)
00.3 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1KAGB0000N421BYYU)
00.4 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QJQM0000B426DS51)
00.5 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QJP60000B426AHN7)
00.6 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1JX7J0000N421BY5B)
00.7 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1K1BJ0000B421CYK0)
00.8 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QE1V0000B426BZRA)
00.9 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1KAK30000N41629LB)
00.10: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1JWYV0000N421AE9Z)
00.11: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1HSEE0000M419669Y)
00.12: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1JX9N0000N421BY4G)
00.13: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1JXAN0000N421BZ0W)
00.14: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1KAGV0000N421BYE4)
00.15: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1HS500000M419ZK00)
00.16: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1JWWD0000N421BXAK)
00.17: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1KAFP0000N421BYT8)
00.18: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1JX3X0000N421AELQ)
00.19: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1HSCA0000M419E0C7)
00.20: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1HSFZ0000M419E1BL)
00.21: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q5FQ0000B426AR0X)
00.22: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QJ6E0000B426AHL9)
00.23: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1HS700000M419E0EY)
Shelf 0: IOM6 Firmware rev. IOM6 A: 0151 IOM6 B: 0151
memory mapped I/O base 0xdf630000, size 0x10000
memory mapped I/O base 0xdf620000, size 0x10000
memory mapped I/O base 0x00000000df610000, size 0x10000
memory mapped I/O base 0x00000000df600000, size 0x10000
slot 0: FC Host Adapter 0c (QLogic 2432 rev. 2, L-port, <OFFLINE (hard)>)
Firmware rev: 5.4.100
Host Loop Id: 0
FC Node Name: 5:00a:098003:567778
FC Port Name: 5:00a:098003:567778
SFP Vendor: AVAGO
SFP Part Number: AFBR-57R6APZ-NA1
SFP Serial Number: B813522S76
SFP Capabilities: 1, 2 or 4 Gbit
Link Data Rate: N/A
I/O base 0x0000000000002000, size 0x100
memory mapped I/O base 0xdf700000, size 0x4000
slot 0: FC Host Adapter 0d (QLogic 2432 rev. 2, L-port, <OFFLINE (hard)>)
Firmware rev: 5.4.100
Host Loop Id: 0
FC Node Name: 5:00a:098103:567778
FC Port Name: 5:00a:098103:567778
SFP Vendor: AVAGO
SFP Part Number: AFBR-57R6APZ-NA1
SFP Serial Number: B813522S6U
SFP Capabilities: 1, 2 or 4 Gbit
Link Data Rate: N/A
I/O base 0x0000000000002400, size 0x100
memory mapped I/O base 0xdf704000, size 0x4000
slot 0: Intel ICH USB EHCI Adapter u0a (0xdfb01400)
boot0 Micron Technology Real SSD eUSB 2GB, class 0/0, rev 2.00/11.10, addr 2 1936MB 512B/sect (0FF0022700323779)
memory-mapped I/O base 0xdfb01400, size 0x400
slot 1: FCVI Host Adapter 1a (QLogic 2532(2562) rev. 2, N-port, <UP>)
Physical link: UP
FC Node Name: 21:00:00:24:ff:54:2c:7c
Firmware rev: 5.3.140 Serial No: RFD1343R15263
Host Port Id: 0xef
Cacheline size: 8 FC Packet size: 2048
SFP Vendor: AVAGO
SFP Part Number: AFBR-57D9AMZ-QL
SFP Serial Number: AD132430218
SFP Capabilities: 2, 4 or 8 Gbit
Link Data Rate: 8 Gbit
I/O base 0x00000000ffffff00, size 0x100
memory mapped I/O base 0xdee00000, size 0x4000
slot 1: FCVI Host Adapter 1b (QLogic 2532(2562) rev. 2, N-port, <UP>)
Physical link: UP
FC Node Name: 21:00:00:24:ff:54:2c:7d
Firmware rev: 5.3.140 Serial No: RFD1343R15263
Host Port Id: 0xef
Cacheline size: 8 FC Packet size: 2048
SFP Vendor: AVAGO
SFP Part Number: AFBR-57D9AMZ-QL
SFP Serial Number: AD132430237
SFP Capabilities: 2, 4 or 8 Gbit
Link Data Rate: 8 Gbit
I/O base 0x00000000ffffff00, size 0x100
memory mapped I/O base 0xdee04000, size 0x4000
slot 2: Dual 10 Gigabit Ethernet Controller IX1-SFP+
e2a MAC Address: 90:e2:ba:56:22:7c (auto-10g_sr-fd-up)
SFP Vendor: Intel Corp
SFP Part Number: FTLX8571D3BCV-IT
SFP Serial Number: AQ209PK
e2b MAC Address: 90:e2:ba:56:22:7d (auto-10g_sr-fd-up)
SFP Vendor: Intel Corp
SFP Part Number: FTLX8571D3BCV-IT
SFP Serial Number: AQ61L8X
Device Type: 82599, PBA E66560-006
memory mapped I/O base 0xdec00000, size 0x80000
I/O base 0x00000000ffffffe0, size 0x20
memory mapped I/O base 0xded00000, size 0x4000
memory mapped I/O base 0xdec80000, size 0x80000
I/O base 0x00000000ffffffe0, size 0x20
memory mapped I/O base 0xded04000, size 0x4000
slot 3: SAS Host Adapter 3a (PMC-Sierra PM8001 rev. C, SAS, <OFFLINE (hard)>)
MFG Part Number: USI 6086-000010-07 rev. MP V4.10
Part number: 111-00341+F2
Serial number: ST063E160WJ
Date Code: 20140106
Firmware rev: 01.11.06.00
Base WWN: 5:00e004:0002ba2:f8
Phy State: [0] Disabled
[1] Disabled
[2] Disabled
[3] Disabled
QSFP Vendor: not available
QSFP Part Number: not available
QSFP Type: not available
QSFP Serial Number: not available
slot 3: SAS Host Adapter 3b (PMC-Sierra PM8001 rev. C, SAS, <UP>)
MFG Part Number: USI 6086-000010-07 rev. MP V4.10
Part number: 111-00341+F2
Serial number: ST063E160WJ
Date Code: 20140106
Firmware rev: 01.11.06.00
Base WWN: 5:00e004:0002ba2:fc
Phy State: [4] Enabled, 6.0 Gb/s
[5] Enabled, 6.0 Gb/s
[6] Enabled, 6.0 Gb/s
[7] Enabled, 6.0 Gb/s
QSFP Vendor: Amphenol
QSFP Part Number: 112-00178+A0
QSFP Type: Passive Copper 5m ID:00
QSFP Serial Number: APF13501787CCF
00.0 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1HS6R0000M419DZWT)
00.1 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q9KT0000B426AL5V)
00.2 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q3280000M425J5HP)
00.3 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1KAGB0000N421BYYU)
00.4 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QJQM0000B426DS51)
00.5 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QJP60000B426AHN7)
00.6 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1JX7J0000N421BY5B)
00.7 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1K1BJ0000B421CYK0)
00.8 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QE1V0000B426BZRA)
00.9 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1KAK30000N41629LB)
00.10: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1JWYV0000N421AE9Z)
00.11: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1HSEE0000M419669Y)
00.12: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1JX9N0000N421BY4G)
00.13: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1JXAN0000N421BZ0W)
00.14: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1KAGV0000N421BYE4)
00.15: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1HS500000M419ZK00)
00.16: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1JWWD0000N421BXAK)
00.17: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1KAFP0000N421BYT8)
00.18: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1JX3X0000N421AELQ)
00.19: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1HSCA0000M419E0C7)
00.20: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1HSFZ0000M419E1BL)
00.21: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q5FQ0000B426AR0X)
00.22: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QJ6E0000B426AHL9)
00.23: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1HS700000M419E0EY)
Shelf 0: IOM6 Firmware rev. IOM6 A: 0151 IOM6 B: 0151
memory mapped I/O base 0xdf430000, size 0x10000
memory mapped I/O base 0xdf420000, size 0x10000
memory mapped I/O base 0x00000000df410000, size 0x10000
memory mapped I/O base 0x00000000df400000, size 0x10000
slot 3: SAS Host Adapter 3c (PMC-Sierra PM8001 rev. C, SAS, <UP>)
MFG Part Number: USI 6086-000010-07 rev. MP V4.10
Part number: 111-00341+F2
Serial number: ST063E160WJ
Date Code: 20140106
Firmware rev: 01.11.06.00
Base WWN: 5:00e004:0002ba2:f0
Phy State: [0] Enabled, 6.0 Gb/s
[1] Enabled, 6.0 Gb/s
[2] Enabled, 6.0 Gb/s
[3] Enabled, 6.0 Gb/s
QSFP Vendor: Amphenol
QSFP Part Number: 112-00178+A0
QSFP Type: Passive Copper 5m ID:00
QSFP Serial Number: APF13501787D04
10.0 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1JX390000N4216Z70)
10.1 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHTG0000B426APT7)
10.2 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHS60000N423BDVP)
10.3 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHH40000M425J6TW)
10.4 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QJLS0000B426C6KD)
10.5 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q73A0000B4269996)
10.6 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q7H00000B4269FBL)
10.7 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QK0Q0000B426ARRM)
10.8 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHLC0000B426DT88)
10.9 : NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHW80000B424BGSG)
10.10: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q6030000B42690PS)
10.11: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q5F20000B426AQGY)
10.12: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHGS0000B426DTHH)
10.13: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1PG4S0000B426CD8P)
10.14: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q6T80000B426AK78)
10.15: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q6QS0000B426AYMV)
10.16: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q9NR0000B42690L4)
10.17: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1KAJ70000N421BYY6)
10.18: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHLA0000B426980S)
10.19: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QDS40000B426AQ1E)
10.20: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1HS4W0000M419ZJJX)
10.21: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q3PS0000M425K730)
10.22: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1QHSK0000B425FJ0J)
10.23: NETAPP X422_SLTNG600A10 NA00 560.0GB 520B/sect (S0M1Q7A70000B4269971)
Shelf 10: IOM6 Firmware rev. IOM6 A: 0151 IOM6 B: 0151
slot 3: SAS Host Adapter 3d (PMC-Sierra PM8001 rev. C, SAS, <OFFLINE (hard)>)
MFG Part Number: USI 6086-000010-07 rev. MP V4.10
Part number: 111-00341+F2
Serial number: ST063E160WJ
Date Code: 20140106
Firmware rev: 01.11.06.00
Base WWN: 5:00e004:0002ba2:f4
Phy State: [4] Disabled
[5] Disabled
[6] Disabled
[7] Disabled
QSFP Vendor: not available
QSFP Part Number: not available
QSFP Type: not available
QSFP Serial Number: not available
memory mapped I/O base 0xdf330000, size 0x10000
memory mapped I/O base 0xdf320000, size 0x10000
memory mapped I/O base 0x00000000df310000, size 0x10000
memory mapped I/O base 0x00000000df300000, size 0x10000
slot 5: Dual 10 Gigabit Ethernet Controller IX1-SFP+
e5a MAC Address: 90:e2:ba:54:e4:dc (auto-10g_sr-fd-up)
SFP Vendor: Intel Corp
SFP Part Number: FTLX8571D3BCV-IT
SFP Serial Number: AQ61L8S
e5b MAC Address: 90:e2:ba:54:e4:dd (auto-10g_sr-fd-up)
SFP Vendor: Intel Corp
SFP Part Number: FTLX8571D3BCV-IT
SFP Serial Number: AQ61LY3
Device Type: 82599, PBA E66560-006
memory mapped I/O base 0xdf000000, size 0x80000
I/O base 0x00000000ffffffe0, size 0x20
memory mapped I/O base 0xdf100000, size 0x4000
memory mapped I/O base 0xdf080000, size 0x80000
I/O base 0x00000000ffffffe0, size 0x20
memory mapped I/O base 0xdf104000, size 0x4000
fas3220b>
fas3220b>
fas3220b>
fas3220b> rdfile /etc/rc #查看配置文件
#Auto-generated by setup Thu Jul 24 12:41:03 CST 2014
hostname fas3220b
ifgrp create single vif1 e5a e5b
ifgrp create single vif2 e2a e2b
ifconfig vif1 `hostname`-vif1 partner vif1 mtusize 1500
ifconfig vif2 `hostname`-vif2 partner vif2 mtusize 1500
ifconfig e0a `hostname`-e0a mediatype auto flowcontrol full netmask 255.255.255.0 partner e0a mtusize 1500
route add default 192.168.100.254 1
routed on
options dns.enable off
options nis.enable off
savecore
fas3220b> vol create vol_ora2 aggr0 2g #创建vol vol_ora2
exportfs [Line 2]: NFS not licensed; local volume /vol/vol_win2 not exported
exportfs [Line 2]: NFS not licensed; local volume /vol/vol_ora2 not exported
Creation of volume 'vol_ora2' with size 2g on containing aggregate
'aggr0' has completed.
fas3220b> vol create vol_ora3 aggr0 2g #创建vol vol_ora3
exportfs [Line 2]: NFS not licensed; local volume /vol/vol_ora2 not exported
exportfs [Line 2]: NFS not licensed; local volume /vol/vol_ora3 not exported
Creation of volume 'vol_ora3' with size 2g on containing aggregate
'aggr0' has completed.
fas3220b>
fas3220b> snap reserThu Jul 24 14:00:00 CST [fas3220b:kern.uptime.filer:info]: 2:00pm up 1:16 0 NFS ops, 0 CIFS ops, 0 HTTP ops, 0 FCP ops, 0 iSCSI ops
ve vol_ora2 0
fas3220b>
fas3220b> snap reserve vol_ora3 0
fas3220b>
fas3220b> snap sched vol_ora2 0
fas3220b> snap sched vol_ora3 0
fas3220b> snap sched -V
Volume vol0: 0 2 6@8,12,16,20
Volume vol_vm2: 0 0 0
Volume vol_ora1: 0 0 0
Volume vol_win1: 0 0 0
Volume vol_win2: 0 0 0
Volume vol_ora2: 0 0 0
Volume vol_ora3: 0 0 0
fas3220b>
fas3220b>
fas3220b> lun show
/vol/vol_ora1/lun3 500.1g (536952700928) (r/w, online)
/vol/vol_vm2/lun2 2.0t (2147483648000) (r/w, online)
/vol/vol_win1/lun4 500.1g (536946278400) (r/w, online)
/vol/vol_win2/lun5 500.1g (536946278400) (r/w, online)
fas3220b> df -g
Filesystem total used avail capacity Mounted on
/vol/vol0/ 285GB 1GB 283GB 0% /vol/vol0/
/vol/vol0/.snapshot 15GB 0GB 14GB 0% /vol/vol0/.snapshot
/vol/vol_vm2/ 2020GB 2007GB 12GB 99% /vol/vol_vm2/
/vol/vol_vm2/.snapshot 0GB 0GB 0GB ---% /vol/vol_vm2/.snapshot
/vol/vol_ora1/ 510GB 502GB 7GB 98% /vol/vol_ora1/
/vol/vol_ora1/.snapshot 0GB 0GB 0GB ---% /vol/vol_ora1/.snapshot
/vol/vol_win1/ 510GB 502GB 7GB 98% /vol/vol_win1/
/vol/vol_win1/.snapshot 0GB 0GB 0GB ---% /vol/vol_win1/.snapshot
/vol/vol_win2/ 510GB 502GB 7GB 98% /vol/vol_win2/
/vol/vol_win2/.snapshot 0GB 0GB 0GB ---% /vol/vol_win2/.snapshot
/vol/vol_ora2/ 2GB 0GB 1GB 0% /vol/vol_ora2/
/vol/vol_ora2/.snapshot 0GB 0GB 0GB ---% /vol/vol_ora2/.snapshot
/vol/vol_ora3/ 2GB 0GB 1GB 0% /vol/vol_ora3/
/vol/vol_ora3/.snapshot 0GB 0GB 0GB ---% /vol/vol_ora3/.snapshot
fas3220b> lun create -s 1g -t linux /vol/vol_ora2/lun6 #在vol_ora2下创建lun6，类型为linux
fas3220b> lun create -s 1g -t linux /vol/vol_ora3/lun7 #在vol_ora3下创建lun7,类型为linux
fas3220b>
fas3220b> lun show
/vol/vol_ora1/lun3 500.1g (536952700928) (r/w, online)
/vol/vol_ora2/lun6 1g (1073741824) (r/w, online)
/vol/vol_ora3/lun7 1g (1073741824) (r/w, online)
/vol/vol_vm2/lun2 2.0t (2147483648000) (r/w, online)
/vol/vol_win1/lun4 500.1g (536946278400) (r/w, online)
/vol/vol_win2/lun5 500.1g (536946278400) (r/w, online)
fas3220b> df -g
Filesystem total used avail capacity Mounted on
/vol/vol0/ 285GB 1GB 283GB 0% /vol/vol0/
/vol/vol0/.snapshot 15GB 0GB 14GB 0% /vol/vol0/.snapshot
/vol/vol_vm2/ 2020GB 2007GB 12GB 99% /vol/vol_vm2/
/vol/vol_vm2/.snapshot 0GB 0GB 0GB ---% /vol/vol_vm2/.snapshot
/vol/vol_ora1/ 510GB 502GB 7GB 98% /vol/vol_ora1/
/vol/vol_ora1/.snapshot 0GB 0GB 0GB ---% /vol/vol_ora1/.snapshot
/vol/vol_win1/ 510GB 502GB 7GB 98% /vol/vol_win1/
/vol/vol_win1/.snapshot 0GB 0GB 0GB ---% /vol/vol_win1/.snapshot
/vol/vol_win2/ 510GB 502GB 7GB 98% /vol/vol_win2/
/vol/vol_win2/.snapshot 0GB 0GB 0GB ---% /vol/vol_win2/.snapshot
/vol/vol_ora2/ 2GB 1GB 0GB 50% /vol/vol_ora2/
/vol/vol_ora2/.snapshot 0GB 0GB 0GB ---% /vol/vol_ora2/.snapshot
/vol/vol_ora3/ 2GB 1GB 0GB 50% /vol/vol_ora3/
/vol/vol_ora3/.snapshot 0GB 0GB 0GB ---% /vol/vol_ora3/.snapshot
fas3220a> df -g
Filesystem total used avail capacity Mounted on
/vol/vol0/ 285GB 1GB 283GB 0% /vol/vol0/
/vol/vol0/.snapshot 15GB 0GB 14GB 0% /vol/vol0/.snapshot
/vol/vol_vm1/ 4050GB 4015GB 34GB 99% /vol/vol_vm1/
/vol/vol_vm1/.snapshot 0GB 0GB 0GB ---% /vol/vol_vm1/.snapshot
fas3220a>
fas3220a>
fas3220a> lun show
/vol/vol_vm1/lun1 3.9t (4294967296000) (r/w, online)
fas3220a>
fas3220b>
fas3220b> ifconfig -a
e0a: flags=0x274c867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
inet 10.150.208.9 netmask 0xffffff00 broadcast 10.150.208.255
partner e0a (not in use)
ether 00:a0:98:55:9a:8a (auto-unknown-down) flowcontrol full
e0b: flags=0x270c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
ether 00:a0:98:55:9a:8b (auto-unknown-down) flowcontrol full
e2a: flags=0x9f0c867<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500
ether 02:a0:98:55:9a:8b (auto-10g_sr-fd-up) flowcontrol full
trunked vif2
e2b: flags=0x9f0c867<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500
ether 02:a0:98:55:9a:8b (auto-10g_sr-fd-up) flowcontrol full
trunked vif2
e5a: flags=0x9f0c867<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500
ether 02:a0:98:55:9a:8a (auto-10g_sr-fd-up) flowcontrol full
trunked vif1
e5b: flags=0x9f0c867<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,LRO> mtu 1500
ether 02:a0:98:55:9a:8a (auto-10g_sr-fd-up) flowcontrol full
trunked vif1
c0a: flags=0x170e866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
ether 00:a0:98:55:9a:8c (auto-unknown-enabling) flowcontrol full
c0b: flags=0x170e866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
ether 00:a0:98:55:9a:8d (auto-unknown-enabling) flowcontrol full
e0M: flags=0x230c866<BROADCAST,RUNNING,MULTICAST,TCPCKSUM,MGMT_PORT> mtu 1500
ether 00:a0:98:55:9a:8e (auto-unknown-down) flowcontrol full
e0P: flags=0x2b4c867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM,ACP_PORT> mtu 1500 PRIVATE
inet 192.168.1.219 netmask 0xfffffc00 broadcast 192.168.3.255 noddns
ether 00:a0:98:55:9a:8f (auto-100tx-fd-up) flowcontrol full
lo: flags=0x1b48049<UP,LOOPBACK,RUNNING,MULTICAST,TCPCKSUM> mtu 8160
inet 127.0.0.1 netmask 0xff000000 broadcast 127.0.0.1
ether 00:00:00:00:00:00 (VIA Provider)
losk: flags=0x40a400c9<UP,LOOPBACK,RUNNING> mtu 9188
inet 127.0.20.1 netmask 0xff000000 broadcast 127.0.20.1
vif1: flags=0x22f4c863<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
inet 192.168.100.3 netmask 0xffffff00 broadcast 192.168.100.255
partner vif1 (not in use)
ether 02:a0:98:55:9a:8a (Enabled interface groups)
vif2: flags=0x22f4c863<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
inet 192.168.100.4 netmask 0xffffff00 broadcast 192.168.100.255
partner vif2 (not in use)
ether 02:a0:98:55:9a:8b (Enabled interface groups)
fas3220b> lun show
/vol/vol_ora1/lun3 500.1g (536952700928) (r/w, online)
/vol/vol_ora2/lun6 1g (1073741824) (r/w, online)
/vol/vol_ora3/lun7 1g (1073741824) (r/w, online)
/vol/vol_vm2/lun2 2.0t (2147483648000) (r/w, online)
/vol/vol_win1/lun4 500.1g (536946278400) (r/w, online)
/vol/vol_win2/lun5 500.1g (536946278400) (r/w, online)
fas3220b>
七、配置ISCSI 服务和LUN映射
fas3220b> iscsi status #查看ISCSI 服务是否运行
iSCSI service is not running
fas3220b>
fas3220b> iscsi start #启动B控制器ISCSI 服务
Thu Jul 24 14:18:02 CST [fas3220b:iscsi.service.startup:info]: iSCSI service startup
iSCSI service started
fas3220b>
fas3220b>
fas3220a> iscsi start #启动A控制器ISCSI 服务
Thu Jul 24 14:18:13 CST [fas3220a:iscsi.service.startup:info]: iSCSI service startup
iSCSI service started
fas3220a>
fas3220a> iscsi status #再次查看ISCSI 服务
iSCSI service is running
fas3220a>
fas3220b>
fas3220b> iscsi initiator show #查看对端服务器ISCSI唯一识别号
No initiators connected
fas3220b>
fas3220b> iscsi initiator show
Initiators connected:
TSIH TPGroup Initiator/ISID/IGroup
2 2000 iqn.1991-05.com.microsoft:win-g070gju3nri / 40:00:01:37:00:00 /
fas3220b>
fas3220b> df -g #查看卷空间
Filesystem total used avail capacity Mounted on
/vol/vol0/ 285GB 1GB 283GB 0% /vol/vol0/
/vol/vol0/.snapshot 15GB 0GB 14GB 0% /vol/vol0/.snapshot
/vol/vol_vm2/ 2020GB 2007GB 12GB 99% /vol/vol_vm2/
/vol/vol_vm2/.snapshot 0GB 0GB 0GB ---% /vol/vol_vm2/.snapshot
/vol/vol_ora1/ 510GB 502GB 7GB 98% /vol/vol_ora1/
/vol/vol_ora1/.snapshot 0GB 0GB 0GB ---% /vol/vol_ora1/.snapshot
/vol/vol_win1/ 510GB 502GB 7GB 98% /vol/vol_win1/
/vol/vol_win1/.snapshot 0GB 0GB 0GB ---% /vol/vol_win1/.snapshot
/vol/vol_win2/ 510GB 502GB 7GB 98% /vol/vol_win2/
/vol/vol_win2/.snapshot 0GB 0GB 0GB ---% /vol/vol_win2/.snapshot
/vol/vol_ora2/ 2GB 1GB 0GB 50% /vol/vol_ora2/
/vol/vol_ora2/.snapshot 0GB 0GB 0GB ---% /vol/vol_ora2/.snapshot
/vol/vol_ora3/ 2GB 1GB 0GB 50% /vol/vol_ora3/
/vol/vol_ora3/.snapshot 0GB 0GB 0GB ---% /vol/vol_ora3/.snapshot
fas3220b> lun show #查看lun 分配
/vol/vol_ora1/lun3 500.1g (536952700928) (r/w, online)
/vol/vol_ora2/lun6 1g (1073741824) (r/w, online)
/vol/vol_ora3/lun7 1g (1073741824) (r/w, online)
/vol/vol_vm2/lun2 2.0t (2147483648000) (r/w, online)
/vol/vol_win1/lun4 500.1g (536946278400) (r/w, online)
/vol/vol_win2/lun5 500.1g (536946278400) (r/w, online)
fas3220b>
fas3220b> iscsi initiator show
Initiators connected:
TSIH TPGroup Initiator/ISID/IGroup
2 2000 iqn.1991-05.com.microsoft:win-g070gju3nri / 40:00:01:37:00:00 /
fas3220b> igroup create -i -t windows win1 iqn.1991-05.com.microsoft:win-g070gju3nri
#创建igroup 组
fas3220b> igroup show #查看igroup
win1 (iSCSI) (ostype: windows):
iqn.1991-05.com.microsoft:win-g070gju3nri (logged in on: vif1)
fas3220b>
fas3220b> lun show
/vol/vol_ora1/lun3 500.1g (536952700928) (r/w, online)
/vol/vol_ora2/lun6 1g (1073741824) (r/w, online)
/vol/vol_ora3/lun7 1g (1073741824) (r/w, online)
/vol/vol_vm2/lun2 2.0t (2147483648000) (r/w, online)
/vol/vol_win1/lun4 500.1g (536946278400) (r/w, online)
/vol/vol_win2/lun5 500.1g (536946278400) (r/w, online)
fas3220b> lun map /vol/vol_win1/lun4 win1 4
#映射lun，把/vol/vol_win1/lun4映射改win1 这台服务器，并制定LUN ID 为4
fas3220b> Thu Jul 24 14:21:15 CST [fas3220b:lun.map:info]: LUN /vol/vol_win1/lun4 was mapped to initiator group win1=4
fas3220b>
fas3220b> lun show #查看lun，可以看到lun4 已经正常的映射
/vol/vol_ora1/lun3 500.1g (536952700928) (r/w, online)
/vol/vol_ora2/lun6 1g (1073741824) (r/w, online)
/vol/vol_ora3/lun7 1g (1073741824) (r/w, online)
/vol/vol_vm2/lun2 2.0t (2147483648000) (r/w, online)
/vol/vol_win1/lun4 500.1g (536946278400) (r/w, online, mapped)
/vol/vol_win2/lun5 500.1g (536946278400) (r/w, online)
fas3220b> iscsi initiator show
Initiators connected:
TSIH TPGroup Initiator/ISID/IGroup
2 2000 iqn.1991-05.com.microsoft:win-g070gju3nri / 40:00:01:37:00:00 / win1
4 2000 iqn.1991-05.com.microsoft:win-31aaudi8gmo / 40:00:01:37:00:00 /
fas3220b> igroup show
win1 (iSCSI) (ostype: windows):
iqn.1991-05.com.microsoft:win-g070gju3nri (logged in on: vif1)
fas3220b> igroup create -i -t windows win2 iqn.1991-05.com.microsoft:win-31aaudi8gmo
fas3220b> igroup show
win1 (iSCSI) (ostype: windows):
iqn.1991-05.com.microsoft:win-g070gju3nri (logged in on: vif1)
win2 (iSCSI) (ostype: windows):
iqn.1991-05.com.microsoft:win-31aaudi8gmo (logged in on: vif1)
fas3220b> lun show
/vol/vol_ora1/lun3 500.1g (536952700928) (r/w, online)
/vol/vol_ora2/lun6 1g (1073741824) (r/w, online)
/vol/vol_ora3/lun7 1g (1073741824) (r/w, online)
/vol/vol_vm2/lun2 2.0t (2147483648000) (r/w, online)
/vol/vol_win1/lun4 500.1g (536946278400) (r/w, online, mapped)
/vol/vol_win2/lun5 500.1g (536946278400) (r/w, online)
fas3220b> lun map /vol/vol_win2/lun5 win2 5
fas3220b> Thu Jul 24 14:26:31 CST [fas3220b:lun.map:info]: LUN /vol/vol_win2/lun5 was mapped to initiator group win2=5
fas3220b>
fas3220a> lun show
/vol/vol_vm1/lun1 3.9t (4294967296000) (r/w, online, mapped)
fas3220a> igroup show
vm1 (iSCSI) (ostype: vmware):
iqn.1998-01.com.vmware:localhost:1348926019:32 (not logged in)
iqn.1998-01.com.vmware:localhost:1348926019:33 (not logged in)
iqn.1998-01.com.vmware:localhost:1874999878:32 (not logged in)
iqn.1998-01.com.vmware:localhost:1874999878:33 (not logged in)
iqn.1998-01.com.vmware:localhost:400400400:32 (not logged in)
iqn.1998-01.com.vmware:localhost:400400400:33 (not logged in)
iqn.1998-01.com.vmware:localhost:449753077:32 (not logged in)
iqn.1998-01.com.vmware:localhost:449753077:33 (not logged in)
iqn.1998-01.com.vmware:localhost:917357692:32 (not logged in)
iqn.1998-01.com.vmware:localhost:917357692:33 (not logged in)
fas3220a> lun unmap /vol/vol_vm1/lun1 vm1 #取消映射
fas3220a> Thu Jul 24 16:14:01 CST [fas3220a:lun.map.unmap:info]: LUN /vol/vol_vm1/lun1 unmapped from initiator group vm1
fas3220a> igroup destroy vm1 #删除igroup
fas3220a> igroup show
fas3220a>
fas3220a>
fas3220a>
fas3220a> igroup create -i -t vmware vm1
fas3220a> igroup show -v
vm1 (iSCSI):
OS Type: vmware
UUID: 89bc3a12-130a-11e4-ad6e-123478563412
Report SCSI Name in Inquiry Descriptor: Yes
fas3220a> iscsi show initiator
iscsi show initiator: This command has been deprecated.
Please consider using 'iscsi initiator show' instead.
Initiators connected:
TSIH TPGroup Initiator/ISID/IGroup
3 2001 iqn.1998-01.com.vmware:vmware01-02c6bd37 / 00:02:3d:00:00:01 /
7 2001 iqn.1998-01.com.vmware:vmware02-6a0591c9 / 00:02:3d:00:00:01 /
11 2001 iqn.1998-01.com.vmware:vmware03-2151a488 / 00:02:3d:00:00:01 /
14 2001 iqn.1998-01.com.vmware:vmware05-22eb4c9f / 00:02:3d:00:00:01 /
17 2001 iqn.1998-01.com.vmware:vmware06-2ef30d25 / 00:02:3d:00:00:01 /
fas3220a>
fas3220a>
fas3220a> igroup add vm1 iqn.1998-01.com.vmware:vmware01-02c6bd37 iqn.1998-01.com.vmware:vmware02-6a0591c9 iqn.1998-01.com.vmware:vmware03-2151a488 iqn.1998-01.com.vmware:vmware05-22eb4c9f iqn.1998-01.com.vmware:vmware06-2ef30d25
#创建igroup 组，并把所有虚拟机的iqn 填入
fas3220a> igroup show
vm1 (iSCSI) (ostype: vmware):
iqn.1998-01.com.vmware:vmware01-02c6bd37 (logged in on: vif2)
iqn.1998-01.com.vmware:vmware02-6a0591c9 (logged in on: vif2)
iqn.1998-01.com.vmware:vmware03-2151a488 (logged in on: vif2)
iqn.1998-01.com.vmware:vmware05-22eb4c9f (logged in on: vif2)
iqn.1998-01.com.vmware:vmware06-2ef30d25 (logged in on: vif2)
fas3220a>
fas3220a>
fas3220a> lun show
/vol/vol_vm1/lun1 3.9t (4294967296000) (r/w, online)
fas3220a> lun map /vol/vol_vm1/lun1 vm1 1
#把/vol/vol_vm1/lun1 映射到vm1，lun id 为1
fas3220a> Thu Jul 24 16:15:27 CST [fas3220a:lun.map:info]: LUN /vol/vol_vm1/lun1 was mapped to initiator group vm1=1
fas3220a>
fas3220a> lun show
/vol/vol_vm1/lun1 3.9t (4294967296000) (r/w, online, mapped)
fas3220a> Thu Jul 24 16:16:28 CST [fas3220a:iscsi.notice:notice]: ISCSI: New session from initiator iqn.1998-01.com.vmware:vmware01-02c6bd37 at IP addr 192.168.100.5
fas3220a> df -Ag
Aggregate total used avail capacity
aggr0 4429GB 4377GB 51GB 99%
aggr0/.snapshot 0GB 2GB 0GB ---%
fas3220a> df -g
Filesystem total used avail capacity Mounted on
/vol/vol0/ 285GB 1GB 283GB 0% /vol/vol0/
/vol/vol0/.snapshot 15GB 0GB 14GB 0% /vol/vol0/.snapshot
/vol/vol_vm1/ 4050GB 4015GB 34GB 99% /vol/vol_vm1/
/vol/vol_vm1/.snapshot 0GB 0GB 0GB ---% /vol/vol_vm1/.snapshot
fas3220a>
fas3220a> snap list #查看快照计划
Volume vol0
working...
%/used %/total date name
---------- ---------- ------------ --------
0% ( 0%) 0% ( 0%) Jul 24 16:00 hourly.0
9% ( 9%) 0% ( 0%) Jul 24 12:37 hourly.1
16% ( 9%) 0% ( 0%) Jul 24 10:39 hourly.2
17% ( 1%) 0% ( 0%) Jul 24 08:00 nightly.0
17% ( 1%) 0% ( 0%) Jul 24 04:00 hourly.3
18% ( 1%) 0% ( 0%) Jul 24 00:00 hourly.4
18% ( 1%) 0% ( 0%) Jul 23 20:00 hourly.5
Volume vol_vm1
working...
No snapshots exist.
fas3220a> snap list -A
Aggregate aggr0
working...
%/used %/total date name
---------- ---------- ------------ --------
3% ( 3%) 0% ( 0%) Jul 24 15:31 mirror_resync.0724073155(fas3220a) (busy,syncmirror)
35% (33%) 0% ( 0%) Jul 24 10:39 hourly.0
36% ( 3%) 0% ( 0%) Jul 24 08:00 nightly.0
39% ( 6%) 0% ( 0%) Jul 24 03:00 hourly.1
40% ( 3%) 0% ( 0%) Jul 23 22:00 hourly.2
fas3220a> snap delete -A aggr0 hourly.0 #删除hourly.1 开头的快照计划
fas3220a> Thu Jul 24 16:18:14 CST [fas3220a:wafl.snap.delete:info]: Snapshot copy hourly.0 on aggregate aggr0 NetApp was deleted by the Data ONTAP function snapcmd_delete. The unique ID for this Snapshot copy is (4, 5891).
fas3220a> snap delete -A aggr0 hourly.1 #删除hourly.1 开头的快照计划
fas3220a> Thu Jul 24 16:18:19 CST [fas3220a:wafl.snap.delete:info]: Snapshot copy hourly.1 on aggregate aggr0 NetApp was deleted by the Data ONTAP function snapcmd_delete. The unique ID for this Snapshot copy is (2, 3157).
fas3220a>
fas3220a> snap delete -A aggr0 hourly.2
fas3220a> Thu Jul 24 16:18:24 CST [fas3220a:wafl.snap.delete:info]: Snapshot copy hourly.2 on aggregate aggr0 NetApp was deleted by the Data ONTAP function snapcmd_delete. The unique ID for this Snapshot copy is (1, 1370).
fas3220a>
fas3220a> snap delete -A aggr0 nightly.0
Thu Jul 24 16:18:29 CST [fas3220a:iscsi.notice:notice]: ISCSI: New session from initiator iqn.1998-01.com.vmware:vmware02-6a0591c9 at IP addr 192.168.100.6
fas3220a> Thu Jul 24 16:18:35 CST [fas3220a:wafl.snap.delete:info]: Snapshot copy nightly.0 on aggregate aggr0 NetApp was deleted by the Data ONTAP function snapcmd_delete. The unique ID for this Snapshot copy is (3, 4942).
fas3220a>
fas3220a>
fas3220a> snap list -A
Aggregate aggr0
working......
%/used %/total date name
---------- ---------- ------------ --------
7% ( 7%) 0% ( 0%) Jul 24 15:31 mirror_resync.0724073155(fas3220a) (busy,syncmirror)
fas3220a> df -Ag
Aggregate total used avail capacity
aggr0 4429GB 4375GB 53GB 99%
aggr0/.snapshot 0GB 0GB 0GB ---%
fas3220a>
fas3220a> df -Ah
Aggregate total used avail capacity
aggr0 4429GB 4375GB 53GB 99%
aggr0/.snapshot 0MB 299MB 0MB ---%
fas3220a> console
logout
Data ONTAP (fas3220a.)
login:
Thu Jul 24 16:19:15 CST [fas3220a:iscsi.notice:notice]: ISCSI: New session from initiator iqn.1998-01.com.vmware:vmware03-2151a488 at IP addr 192.168.100.7
Thu Jul 24 16:19:26 CST [fas3220a:iscsi.notice:notice]: ISCSI: New session from initiator iqn.1998-01.com.vmware:vmware05-22eb4c9f at IP addr 192.168.100.9
Data ONTAP (fas3220a.)
login: root
Password:
fas3220a> Thu Jul 24 16:20:12 CST [fas3220a: console_login_mgr:info]: root logged in from console
fas3220a>
fas3220a>
fas3220a>
fas3220a> Thu Jul 24 16:22:22 CST [fas3220a:netif.linkUp:info]: Ethernet e0a: Link up.
fas3220a> lun show
/vol/vol_vm1/lun1 3.9t (4294967296000) (r/w, online, mapped)
fas3220b>
fas3220b> lun show
/vol/vol_ora1/lun3 500.1g (536952700928) (r/w, online)
/vol/vol_ora2/lun6 1g (1073741824) (r/w, online)
/vol/vol_ora3/lun7 1g (1073741824) (r/w, online)
/vol/vol_vm2/lun2 2.0t (2147483648000) (r/w, online, mapped)
/vol/vol_win1/lun4 500.1g (536946278400) (r/w, online, mapped)
/vol/vol_win2/lun5 500.1g (536946278400) (r/w, online, mapped)
fas3220b> igroup show
oracle (iSCSI) (ostype: linux):
vm2 (iSCSI) (ostype: vmware):
iqn.1998-01.com.vmware:vmware01-02c6bd37 (logged in on: vif2)
iqn.1998-01.com.vmware:vmware02-6a0591c9 (logged in on: vif2)
iqn.1998-01.com.vmware:vmware03-2151a488 (logged in on: vif2)
iqn.1998-01.com.vmware:vmware05-22eb4c9f (logged in on: vif2)
iqn.1998-01.com.vmware:vmware06-2ef30d25 (logged in on: vif2)
win1 (iSCSI) (ostype: windows):
iqn.1991-05.com.microsoft:win-g070gju3nri (logged in on: vif1)
win2 (iSCSI) (ostype: windows):
iqn.1991-05.com.microsoft:win-31aaudi8gmo (logged in on: vif1)
fas3220b> lun map /vol/vol_ora1/lun3 oracle 3
fas3220b> Thu Jul 24 16:27:16 CST [fas3220b:lun.map:info]: LUN /vol/vol_ora1/lun3 was mapped to initiator group oracle=3
fas3220b>
fas3220b> lun map /vol/vol_ora2/lun6 oracle 6
fas3220b> Thu Jul 24 16:27:31 CST [fas3220b:lun.map:info]: LUN /vol/vol_ora2/lun6 was mapped to initiator group oracle=6
fas3220b>
fas3220b> lun map /vol/vol_ora3/lun7 oracle 7
fas3220b> Thu Jul 24 16:27:44 CST [fas3220b:lun.map:info]: LUN /vol/vol_ora3/lun7 was mapped to initiator group oracle=7
fas3220b>
fas3220b> lun show
/vol/vol_ora1/lun3 500.1g (536952700928) (r/w, online, mapped)
/vol/vol_ora2/lun6 1g (1073741824) (r/w, online, mapped)
/vol/vol_ora3/lun7 1g (1073741824) (r/w, online, mapped)
/vol/vol_vm2/lun2 2.0t (2147483648000) (r/w, online, mapped)
/vol/vol_win1/lun4 500.1g (536946278400) (r/w, online, mapped)
/vol/vol_win2/lun5 500.1g (536946278400) (r/w, online, mapped)
fas3220b>
fas3220b>
fas3220b> igroup show
oracle (iSCSI) (ostype: linux):
vm2 (iSCSI) (ostype: vmware):
iqn.1998-01.com.vmware:vmware01-02c6bd37 (logged in on: vif2)
iqn.1998-01.com.vmware:vmware02-6a0591c9 (logged in on: vif2)
iqn.1998-01.com.vmware:vmware03-2151a488 (logged in on: vif2)
iqn.1998-01.com.vmware:vmware05-22eb4c9f (logged in on: vif2)
iqn.1998-01.com.vmware:vmware06-2ef30d25 (logged in on: vif2)
win1 (iSCSI) (ostype: windows):
iqn.1991-05.com.microsoft:win-g070gju3nri (logged in on: vif1)
win2 (iSCSI) (ostype: windows):
iqn.1991-05.com.microsoft:win-31aaudi8gmo (logged in on: vif1)
八、服务器添加存储
8.1、虚拟机添加存储
1、使用Vsphere登录虚拟机，在“存储适配器”中，点击“添加”
2、选择“Add Software iSCSI Adapter”
说明：在NetApp 配置虚拟机的igroup 之前，应该完成添加Software iSCSI Adapter服务的操作，不然Netapp 无法确定虚拟机的iqn.注意，不能使用本身物理网卡的ISCSI iqn 进行添加映射。
3、添加后，选择对应的iSCSISoftware Adapter，并点击“属性”
4、在常规配置选项卡，确认状态为启动
5、在动态发现里面，填入NetApp 的ISCSI 目标地址
6、在静态发现中，确认Netapp 的iqn 已经正常发现。设置完成后，关闭配置窗口
7、添加完成后，对存储执行重新扫描，即可发现存储
说明：在其他虚拟机执行同样的操作即可，另外在初始化存储的时候，只需要在第一台服务器执行即可，后续的服务器后自动识别。NetApp 在配置共享存储的时候，只需要把存储同时分配给两台服务器或多台服务器即可，LUN ID 保持一致。
8.2、Windows 服务器添加存储
8.2.1、配置iscsi
1、在Windows ISCSI 发起程序中的配置选项卡，可以看到Windows 服务器的iqn
注意：NetApp 在配置Windows igroup 的时候，需要填入此处的iqn
2、在Windows ISCSI 发起程序中的发现选项，填入NetApp的目标地址
3、在目标选项卡，可以对存储进行连接、断开、包括配置自动连接等
4、在Windows 磁盘管理中，扫描磁盘并初始化，即可建立新的磁盘
8.2.2、配置多路径
- Start Windows Server Manager and select Features in the navigation tree.
- Click Add Features.
- Select the Multipath I/O check box and then click Next.
- Follow the instructions on your screen to complete the installation. Reboot the Windows host if prompted.
注：如果安装Windows自带的多路径软件，仍然无法解决问题，请安装官方提供的多路径软件。针对Windows 2003等较老的多路径软件，必须安装netapp提供的多路径软件，且必须要安装对应的hotfix.具体如下：
针对Windows 2003系统多路径软件的安装方法：
1)安装hotfix :
Q945119 安装后需要重启系统
Q982109 需要安装完MPIO后再进行安装
下载链接如下：
http://hotfixv4.microsoft.com/Windows%20Server%202003/sp3/Fix208246/3790/free/332745_CHS_x64_zip.exe
http://hotfixv4.microsoft.com/Windows%20Server%202003/sp3/Fix311678/3790/free/413207_CHS_x64_zip.exe
2)安装MPIO软件
安装时提示需要稍后安装Q982109补丁，点击确定继续安装。后续提示需要许可，联系厂家400获取即可.
安装完成后重启系统
3)安装Q982109 补丁
安装完MPIO后，存储后自动配置多路径，再次进入磁盘管理，发现多块磁盘已经变为一块磁盘
8.3、Linux 服务器添加存储
8.3.1、安装iscsi 软件
说明：以下以Redhat5.3 为例进行说明，版本不同操作可能会稍有不同，本节只是对Linux环境下挂载ISCSI存储进行技术性说明，可能和生产环境会有不同。
1)Redhat5下initiator安装
RHEL 5已开始在内核中加入了对iSCSI的支持，使用的iSCSI Initiator软件是Open-iSCSI Initiator，支持万兆网卡，其配置方式与RHEL 4及更早的RedHat Linux发行版中的iSCSI Initiator有很大的区别。
把RHEL5 x86第一张安装光盘挂载到/mnt目录下，之后进入/mnt/Server目录进行安装。
[root@pe03 Server]# cd /mnt/Server/
[root@pe03 Server]# rpm -ivh iscsi-initiator-utils-6.2.0.742-0.5.el5.i386.rpm
warning: iscsi-initiator-utils-6.2.0.742-0.5.el5.i386.rpm: Header V3 DSA signature: NOKEY, key ID 37017186
Preparing... ########################################### [100%]
1:iscsi-initiator-utils ########################################### [100%]
这个安装将iscsid、iscsiadm安装到/sbin目录下，它还将把默认的配置文件安装到/etc/iscsi目录下：
/etc/iscsi/iscsid.conf所有刚发起的iSCSI session默认都将使用这个文件中的参数设定。
/etc/iscsi/initiatorname.iscsi 软件iSCSI initiator的intiator名称配置文件。
在iscsi启动的时候，iscsid和iscsiadm会读取这两个配置文件。
8.2.2、redhat5下initiator配置
2.1确认iscsi服务随系统启动而启动
2.1)用chkconfig检查iscsi和iscsid服务在运行级别3和5中随系统的启动而自动启动
[root@pe03 Server]# chkconfig --list |grep iscsi
iscsi 0:off 1:off 2:off 3:on 4:on 5:on 6:off
iscsid 0:off 1:off 2:off 3:on 4:on 5:on 6:off
如果iscsid和iscsi没有随系统的启动而启动，则用chkconfig设置这两个服务在系统运行级别为3和5时随系统启动而启动
[root@pe03 Server]# chkconfig iscsi --level 35 on
[root@pe03 Server]# chkconfig iscsid --level 35 on
2.2)设置InitiatorName
用vi编辑/etc/iscsi/initiatorname.iscsi文件，文件内容如下
InitiatorName=iqn.2005-03.com.max:pe03
注意:这个名称是linux 系统对应的名称，需要把这个名称填入到存储上面，而不是在这里填入存储的iqn 名称
InitiatorName这个单词必须注意大小写，同时，必须顶格写，xxxx代表要设置的initiator名称，请遵循iqn命名规范。
iqn规范定义的InitiatorName格式为iqn.domaindate. reverse.domain.name:optional name，例如：iqn.2006-11.com.h3c:dbserver。
2.3)启动iscsi服务
用service iscsi start启动iSCSI服务。
root@pe03 Server]# service iscsi start
Turning off network shutdown. Starting iSCSI daemon: [ OK ]
[ OK ]
Setting up iSCSI targets: [ OK ]
用service iscsi status及service iscsid status查看iscsi相关服务的运行状态
[root@pe03 Server]# service iscsi status
iscsid (pid 3697 3696) is running...
[root@pe03 Server]# service iscsid status
iscsid (pid 3697 3696) is running...
2.4)注:Open-iSCSI是通过以下iSCSI数据库文件来实现永久配置的：
Discovery (/var/lib/iscsi/send_targets)：在/var/lib/iscsi/send_targets目录下包含iSCSI portals的配置信息，每个portal对应一个文件，文件名为“iSCSI portal IP，端口号”（例如“192.168.100.1,3260”）。
Node (/var/lib/iscsi/nodes)：在/var/lib/iscsi/nodes目录下，生成一个或多个以iSCSI存储服务器上的Target名命名的文件夹，在该文件夹下有一个文件名为“iSCSI portal IP，端口号” （例如“192.168.100.1,3260”）的配置参数文件，该文件中是initiator登录target时要使用的参数，这些参数的设置是从/etc/iscsi/iscsi.conf中的参数设置继承而来的，可以通过iscsiadm对某一个参数文件进行更改（需要先注销到target的登录）。
iscsiadm是用来管理（更新、删除、插入、查询）iSCSI配置数据库文件的命令行工具，用户能够用它对iSCSI nodes、sessions、connections和discovery records进行一系列的操作。
2.5)分配存储资源，在Linux上执行target的发现
RHEL 5上当前的iSCSI Initiator版本只支持sendtargets的发现方式，不支持SLP和iSNS
假设后端存储为NetApp，iSCSI业务IP地址为192.168.100.1，则使用下面的命令执行target的发现：
[root@pe03 Server]# iscsiadm -m discovery -t sendtargets -p 192.168.100.1:3260
因为此时还没有在Netapp上创建该initiator并分配卷，这个命令执行成功后没有任何输出，但是此时到NetApp上会查看到有新的initiator生成。
在NetApp上把卷分配给Linux服务器后，再次执行target的发现：
[root@pe03 Server]# iscsiadm -m discovery -t sendtargets -p 192.168.100.1:3260
iscsiadm: unexpected SendTargets data:
200.200.10.200:3260,1 iqn.2007-04.acme.com:h3c:200realm.rhel5
此时发现了一个新的target，target名称为iqn.2007-04.acme.com:h3c:200realm.rhel5
注：在IP SAN存储设备上把相应的存储空间分配给RedHat Linux服务器的具体操作请参照各存储设备相关的指导书
2.6）登录target
这里-T后面跟target名称，最后的-l（英文字母中小写的L），是login的意思。
可以使用iscsiadm -m node --loginall=all
一次登录所有的targets。
[root@pe03 Server]# iscsiadm -m node -T iqn.2007-04.acme.com:h3c:200realm.rhel5 -p 192.168.100.1:3260 -l
2.7）查看iSCSI session信息
用iscsiadm -m session –i查看iSCSI session和设备信息
[root@pe03 Server]# iscsiadm -m node --loginall=all
[root@pe03 ~]# iscsiadm -m session -i
iscsiadm version 2.0-742
************************************
Session (sid 0) using module tcp:
************************************
TargetName: iqn.2007-04.acme.com:h3c:200realm.rhel5
Portal Group Tag: 1
Network Portal: 192.168.100.1:3260
iSCSI Connection State: LOGGED IN
Internal iscsid Session State: NO CHANGE
************************
Negotiated iSCSI params:
************************
HeaderDigest: None
DataDigest: None
MaxRecvDataSegmentLength: 65536
MaxXmitDataSegmentLength: 65536
FirstBurstLength: 65536
MaxBurstLength: 262144
ImmediateData: No
InitialR2T: Yes
MaxOutstandingR2T: 1
************************
Attached SCSI devices:
************************
Host Number: 3 State: running
scsi3 Channel 00 Id 0 Lun: 0
Attached scsi disk sdb State: running
8.2.3、多路径的配置
说明：这里Linux 为RHEL 6.3
- 用fdisk –l 可看到多块磁盘
- 确认需要安装的多路径软件
（需要安装device-mapper-mulitpath* 和device-mapper-mulitpath-libs*）
- 安装多路径软件
先装链接库文件：
#yum install device-mapper-multipath-libs.x86_64
再装多路径包
# yum install device-mapper-multipath.x86_64
- 多路径包已经安装，设置自动启动多路径服务
#chkconfig –level 35 multipathd on
- 生产配置文件
说明：默认没有生产配置文件，需要手动生产配置文件
#mpathconf –enable
- 查看多路径信息
#multipath –ll
- 重新启动多路径服务
#service multipathd restart
- 辑/etc/multipath.conf
说明：先把原来的配置文件备份一份。编辑时将原来的原始的multipath.conf 文件中的
Multipaths 到devices 前的”#”去掉，具体如下：
[root@db1 ~]# vi /etc/multipath.conf
#}
multipaths {
multipath {
wwid 360a9800044345030545d457664774e41
alias netapp-voteDisk1
path_grouping_policy multibus
path_checker readsector0
path_selector "round-robin 0"
failback manual
rr_weight priorities
no_path_retry 5
}
multipath {
wwid 1DEC_____321816758474
alias red
}
}
multipaths {
multipath {
wwid 360a9800044345030545d457664774e41
alias netapp-voteDisk1
path_grouping_policy multibus
path_checker readsector0
path_selector "round-robin 0"
failback manual
rr_weight priorities
no_path_retry 5
}
multipath {
wwid 360a9800044345030545d457664774e43
alias netapp-voteDisk2
path_grouping_policy multibus
path_checker readsector0
path_selector "round-robin 0"
failback manual
rr_weight priorities
no_path_retry 5
}
multipath {
wwid 360a9800044345030545d457664774e45
alias netapp-voteDisk3
path_grouping_policy multibus
path_checker readsector0
path_selector "round-robin 0"
failback manual
rr_weight priorities
no_path_retry 5
}
multipath {
wwid 360a9800044345030545d457664774e47
alias netapp-dataDisk1
path_grouping_policy multibus
path_checker readsector0
path_selector "round-robin 0"
failback manual
rr_weight priorities
no_path_retry 5
}
multipath {
wwid 360a9800044345030545d457664774e49
alias netapp-dataDisk2
path_grouping_policy multibus
path_checker readsector0
path_selector "round-robin 0"
failback manual
rr_weight priorities
no_path_retry 5
}
multipath {
wwid 360a9800044345030545d457664774e4b
alias netapp-dataDisk3
path_grouping_policy multibus
path_checker readsector0
path_selector "round-robin 0"
failback manual
rr_weight priorities
no_path_retry 5
}
multipath {
wwid 1DEC_____321816758474
alias red
}
}
#devices {
# device {
# vendor "COMPAQ "
# product "HSV110 (C)COMPAQ"
# path_grouping_policy multibus
# getuid_callout "/lib/udev/scsi_id --whitelisted --device=/dev/%n"
# path_checker readsector0
# path_selector "round-robin 0"
# hardware_handler "0"
# failback 15
# rr_weight priorities
# no_path_retry queue
# }
# device {
# vendor "COMPAQ "
# product "MSA1000 "
# path_grouping_policy multibus
# }
#}
blacklist {
}
编辑说明：
将multipath –ll看到的盘对应的wwid替换原始文件中的WWID，别名可以随便取为自己方便识别的名字。如果有多个盘，可以复制multipath及其括号里的内容，同样替换WWID及取别名。
- 重启多路径服务，查看多路径信息
#service multipathd restart
[root@db1 ~]# multipath -ll
Apr 20 19:59:07 | multipath.conf line 67, invalid keyword: path_checker
mpathe (360a9800044345030545d457664774e45) dm-6 NETAPP,LUN
size=2.0G features='4 queue_if_no_path pg_init_retries 50 retain_attached_hw_handle' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=2 status=active
|- 4:0:0:5 sdf 8:80 active ready running
|- 5:0:0:5 sdp 8:240 active ready running
`- 3:0:0:5 sdg 8:96 active ready running
mpathd (360a9800044345030545d457664774e4b) dm-5 NETAPP,LUN
size=200G features='4 queue_if_no_path pg_init_retries 50 retain_attached_hw_handle' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=2 status=active
|- 3:0:0:8 sdm 8:192 active ready running
|- 5:0:0:8 sds 65:32 active ready running
`- 4:0:0:8 sdk 8:160 active ready running
mpathc (360a9800044345030545d457664774e43) dm-4 NETAPP,LUN
size=2.0G features='4 queue_if_no_path pg_init_retries 50 retain_attached_hw_handle' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=2 status=active
|- 3:0:0:4 sdd 8:48 active ready running
|- 5:0:0:4 sdo 8:224 active ready running
`- 4:0:0:4 sde 8:64 active ready running
mpathg (360a9800044345030545d457664774e47) dm-9 NETAPP,LUN
size=200G features='4 queue_if_no_path pg_init_retries 50 retain_attached_hw_handle' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=2 status=active
|- 4:0:0:6 sdh 8:112 active ready running
|- 5:0:0:6 sdq 65:0 active ready running
`- 3:0:0:6 sdj 8:144 active ready running
netapp-voteDisk1 (360a9800044345030545d457664774e41) dm-8 NETAPP,LUN
size=2.0G features='4 queue_if_no_path pg_init_retries 50 retain_attached_hw_handle' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=2 status=active
|- 4:0:0:3 sdc 8:32 active ready running
|- 5:0:0:3 sdn 8:208 active ready running
`- 3:0:0:3 sdb 8:16 active ready running
mpathf (360a9800044345030545d457664774e49) dm-7 NETAPP,LUN
size=200G features='4 queue_if_no_path pg_init_retries 50 retain_attached_hw_handle' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=2 status=active
|- 4:0:0:7 sdi 8:128 active ready running
|- 5:0:0:7 sdr 65:16 active ready running
`- 3:0:0:7 sdl 8:176 active ready running
- 使用fdisk -l 查看磁盘信息
[root@db2 etc]# fdisk -l
WARNING: GPT (GUID Partition Table) detected on '/dev/sda'! The util fdisk doesn't support GPT. Use GNU Parted.
Disk /dev/sda: 1099.5 GB, 1099511627776 bytes
255 heads, 63 sectors/track, 133674 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000
Device Boot Start End Blocks Id System
/dev/sda1 1 133675 1073741823+ ee GPT
Disk /dev/mapper/vg_db2-lv_root: 53.7 GB, 53687091200 bytes
255 heads, 63 sectors/track, 6527 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000
Disk /dev/mapper/vg_db2-lv_swap: 16.9 GB, 16894656512 bytes
255 heads, 63 sectors/track, 2053 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000
Disk /dev/mapper/vg_db2-oracle: 974.5 GB, 974504591360 bytes
255 heads, 63 sectors/track, 118476 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000
Disk /dev/mapper/vg_db2-lv_home: 53.7 GB, 53687091200 bytes
255 heads, 63 sectors/track, 6527 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000
Disk /dev/sdb: 2147 MB, 2147483648 bytes
67 heads, 62 sectors/track, 1009 cylinders
Units = cylinders of 4154 * 512 = 2126848 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sdd: 2147 MB, 2147483648 bytes
67 heads, 62 sectors/track, 1009 cylinders
Units = cylinders of 4154 * 512 = 2126848 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sdf: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sde: 2147 MB, 2147483648 bytes
67 heads, 62 sectors/track, 1009 cylinders
Units = cylinders of 4154 * 512 = 2126848 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sdc: 2147 MB, 2147483648 bytes
67 heads, 62 sectors/track, 1009 cylinders
Units = cylinders of 4154 * 512 = 2126848 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sdh: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sdg: 2147 MB, 2147483648 bytes
67 heads, 62 sectors/track, 1009 cylinders
Units = cylinders of 4154 * 512 = 2126848 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sdi: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sdj: 2147 MB, 2147483648 bytes
67 heads, 62 sectors/track, 1009 cylinders
Units = cylinders of 4154 * 512 = 2126848 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sdk: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sdl: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sdm: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/mapper/netapp-dataDisk2: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/mapper/netapp-dataDisk1: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/mapper/netapp-voteDisk2: 2147 MB, 2147483648 bytes
255 heads, 63 sectors/track, 261 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/mapper/netapp-voteDisk3: 2147 MB, 2147483648 bytes
255 heads, 63 sectors/track, 261 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/mapper/netapp-dataDisk3: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/mapper/netapp-voteDisk1: 2147 MB, 2147483648 bytes
255 heads, 63 sectors/track, 261 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sdn: 2147 MB, 2147483648 bytes
67 heads, 62 sectors/track, 1009 cylinders
Units = cylinders of 4154 * 512 = 2126848 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sdo: 2147 MB, 2147483648 bytes
67 heads, 62 sectors/track, 1009 cylinders
Units = cylinders of 4154 * 512 = 2126848 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sdp: 2147 MB, 2147483648 bytes
67 heads, 62 sectors/track, 1009 cylinders
Units = cylinders of 4154 * 512 = 2126848 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sdr: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sdq: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
Disk /dev/sds: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 65536 bytes
Disk identifier: 0x00000000
九、图形化操作使用说明
9.1、登录SystemManager
1、首次登录需要配置NetApp存储的IP地址，也可以使用自动发现进行扫描，发现存储后，填入用户名、密码即可登录。
2、等录NetApp SystemManager
9.2、查看存储信息
1、点击对应的控制器，然后点击Storage--Aggregates,即可查看的aggr的空间使用情况
2、查看磁盘
3、查看LUN信息
4、查看vol 信息
5、查看网络配置
6、查看ISCSI信息。点击Configuration--Network--Protocols--iSCSI
7、查看系统日志。点击Diagnostics--logs--Syslog
9.3、卷的创建
（设置卷名称、位于哪个聚合池、卷的大小、快照保留，一般卷要比LUN 划分的大一点，因为LUN快照会用到卷上面的空闲空间）
9.4、LUN的创建
（设置卷名称、类型、大小）
（选择LUN 要重建那个卷上，这里选择刚才创建的卷）
（设置卷的映射信息）
（确认摘要信息）
（完成卷的配置）
9.5、LUN映射的查看与修改
1、查看lun状态信息。点击Storage--LUNs
2、LUNs的详细信息栏点击“Initiator Groups”,即可看到已经映射的服务器信息
3、选择iGroup 名称，点击“Edit”,进入编辑界面
4、点击“Initiators”,并添加Add可以添加新的主机
9.6、查看Cluster双机配置
1、点击HA Configuration,可以看到双机的运行状态
2、点击Halt System,可以停止相应的控制器
9.7、LUN 映射的取消
在LUN配置的Initiator Groups 中，取消勾选”Map”
9.8、LUN 的删除
1、在删除前首先要把LUN离线
2、删除卷
3、确认删除卷
9.9、Vol 离线与删除
说明：卷删除前，首先要确认卷上没有LUN，且卷处于离线状态
1、卷离线
2、卷删除
十、日常基本维护说明
10.1 开机顺序
先按照磁盘架编号顺序加电磁盘架的双电源，5分钟后加电控制器。
对连接到存储的服务器加电
10.2 关机顺序
确认所有连接的应用程序已经关闭（包括通过FCP或ISCSI连接到存储的Server等服务，和通过NAS连接到存储的应用）
确认连接到存储的服务器已关闭（通过FCP或ISCSI连接的服务器）
通过串口或TELNET登陆到系统。
对机头输入halt -f命令,并且回到CFE>状态
先关控制器电源，依次关闭磁盘架电源。
10.3 性能检测
10.3.1 目测
现场首先进行指示灯和LCD 面板检查，判断是否有异常情况发生。
10.3.2 硬件状态检查
Filer>sysconfig –r 检查磁盘情况
正常情况：发现所有磁盘，每个机头都有一个或多个spare disk。
非正常情况：任何一个机头没有一个spare disk，就是非正常情况。
Filer>sysconfig –v 检查所有硬件以上显示结果应该没有failed,error,warning 等字样.
10.3.3 检查网络是否正常
使用ping 存储设备IP 地址，输入：
>ping 存储的IP地址
检查存储机头的网络连通性。
正常情况：有相应，无丢包。非正常情况：ping 不通或者丢包严重。
Filer>ifconfig –a 主要网口状态应为up
Filer>vif status VIF所有端口是否正常
10.3.4. 检查CLUSTER 状态是否正常
Filer>cf status
正常情况：2个节点状态应该为enable
非正常情况：任何一个机头显示非如上所示，就属于非正常情况。
10.3.5 检查卷容量是否正常
使用df 检查空间使用状况。
Filer>df
正常情况：capacity 低于或等于80%。
非正常情况：capacity 高于80%。
10.3.6 性能检查
Filer>sysstat 3 CPU利用率应该在80%以下
Filer>vifstat 3 vif流量是否均衡
10.3.7 日志文件检查
Filer>rdfile /etc/messages 仔细检查是否有failed,error,warning等字样. 如有,则记录下来
十一、常用命令
- sysconfig -a 查看系统信息(设备序列号 系统软、硬件信息等)
- sysconfig -r 查看RAID信息(spare盘及故障硬盘会在这里显示)
- ifconfig -a 查看网络配置
- rdfile /etc/messages 查看系统日志信息
- vol status 查看卷状态
- lun show -v查看LUN信息
- igroup show 查看igroup信息
- sysstat –x 1 查看系统当前性能信息
- df -Vh 查看卷空间
- df -Ah 查看aggr空间
- snap list 查看快照情况
- vol create vol4 aggr0 1g 创建卷
- lun create -s 500m -t windows /vol/vol4/lun4 创建LUN
- igroup create -i -t windows win4 iqn.1991-05.com.microsoft:node3.tesu.com 创建igroup 组
- igroup show 查看igroup
- lun map /vol/vol4/lun4 win4 4 映射卷
