Discover V7000 on Redhat
Steps to configure the Linux Host
Follow these steps to configure the Linux host:
- Use the latest firmware levels on your host system.
- Install the HBA or HBAs on the Linux server.
- Install the supported HBA driver/firmware and upgrade the kernel, if required.
- Connect the Linux server FC host adapters to the switches.
- Configure the switches (zoning) if needed.
- Install SDD for Linux.
- Configure the host, volumes, and host mapping in the IBM Flex System V7000 Storage Node.
- Rescan for LUNs on the Linux server to discover the volumes that were created on the IBM Flex System V7000 Storage Node.
os kernel
[root@dev1 ~]# uname -a
Linux dev1.egolife.com 2.6.39-400.17.1.el6uek.x86_64 #1 SMP Fri Feb 22 18:16:18 PST 2013 x86_64 x86_64 x86_64 GNU/Linux
hba details
fc device
[root@dev1 ~]# lspci | grep Fibre
8b:00.0 Fibre Channel: Emulex Corporation Saturn-X: LightPulse Fibre Channel Host Adapter (rev 03)
8b:00.1 Fibre Channel: Emulex Corporation Saturn-X: LightPulse Fibre Channel Host Adapter (rev 03)
[root@dev1 ~]# grep Fibre /var/log/dmesg
Emulex LightPulse Fibre Channel SCSI driver 8.3.5.86.2p
scsi3 : Emulex LPe12000 PCIe Fibre Channel Adapter on PCI bus 8b device 00 irq 48
scsi4 : Emulex LPe12000 PCIe Fibre Channel Adapter on PCI bus 8b device 01 irq 58
fc hosts
[root@dev1 ~]# ll /sys/class/fc_host/host*
lrwxrwxrwx. 1 root root 0 Jun 18 10:42 /sys/class/fc_host/host3 -> ../../devices/pci0000:80/0000:80:03.0/0000:8b:00.0/host3/fc_host/host3
lrwxrwxrwx. 1 root root 0 Jun 18 10:42 /sys/class/fc_host/host4 -> ../../devices/pci0000:80/0000:80:03.0/0000:8b:00.1/host4/fc_host/host4
fc_host directory
[root@dev1 ~]# ll /sys/class/fc_host/host3/
total 0
-r--r--r--. 1 root root 4096 Jun 18 10:43 active_fc4s
lrwxrwxrwx. 1 root root 0 Jun 18 10:43 device -> ../../../host3
-rw-r--r--. 1 root root 4096 Jun 18 10:43 dev_loss_tmo
-r--r--r--. 1 root root 4096 Jun 18 10:43 fabric_name
--w-------. 1 root root 4096 Jun 18 10:43 issue_lip
-r--r--r--. 1 root root 4096 Jun 18 10:43 maxframe_size
-r--r--r--. 1 root root 4096 Jun 18 10:43 max_npiv_vports
-r--r--r--. 1 root root 4096 Jun 18 10:43 node_name
-r--r--r--. 1 root root 4096 Jun 18 10:43 npiv_vports_inuse
-r--r--r--. 1 root root 4096 Jun 18 10:43 port_id
-r--r--r--. 1 root root 4096 Jun 18 10:43 port_name
-r--r--r--. 1 root root 4096 Jun 18 10:43 port_state
-r--r--r--. 1 root root 4096 Jun 18 10:43 port_type
drwxr-xr-x. 2 root root 0 Jun 18 10:43 power
-r--r--r--. 1 root root 4096 Jun 18 10:43 speed
drwxr-xr-x. 2 root root 0 Jun 18 10:43 statistics
lrwxrwxrwx. 1 root root 0 Jun 18 10:43 subsystem -> ../../../../../../../class/fc_host
-r--r--r--. 1 root root 4096 Jun 18 10:43 supported_classes
-r--r--r--. 1 root root 4096 Jun 18 10:43 supported_fc4s
-r--r--r--. 1 root root 4096 Jun 18 10:43 supported_speeds
-r--r--r--. 1 root root 4096 Jun 18 10:43 symbolic_name
-rw-r--r--. 1 root root 4096 Jun 18 10:43 tgtid_bind_type
-rw-r--r--. 1 root root 4096 Jun 18 10:43 uevent
--w-------. 1 root root 4096 Jun 18 10:43 vport_create
--w-------. 1 root root 4096 Jun 18 10:43 vport_delete
hba wwn
[root@dev1 ~]# cat /sys/class/fc_host/host*/node_name
0x20000090fa3436de
0x20000090fa3436df
hba hosts in v7000
operation:V7000 -> Cluster -> Hosts -> Ports by Host -> Host Details:APP01
hba name: 10000090FA3436DE 10000090FA3436DF
rpms
install multipath packages
[root@dev1 ~]# yum install -y device-mapper-multipath
[root@dev1 ~]# rpm -qa | grep device-mapper
device-mapper-persistent-data-0.1.4-1.el6.x86_64
device-mapper-event-1.02.77-9.el6.x86_64
device-mapper-1.02.77-9.el6.x86_64
device-mapper-multipath-0.4.9-64.0.1.el6.x86_64
device-mapper-event-libs-1.02.77-9.el6.x86_64
device-mapper-multipath-libs-0.4.9-64.0.1.el6.x86_64
device-mapper-libs-1.02.77-9.el6.x86_64
multipath configure
DM_Multipath
Device mapper multipathing (DM-Multipath) allows you to configure multiple I/O paths between server nodes and storage arrays into a single device. These I/O paths are physical SAN connections that can include separate cables, switches, and controllers. Multipathing aggregates the I/O paths, creating a new device that consists of the aggregated paths
enable multipath
[root@dev1 ~]# mpathconf --enable --with_multipathd y
scan disks
[root@dev1 ~]# fdisk -l
WARNING: GPT (GUID Partition Table) detected on '/dev/sda'! The util fdisk doesn't support GPT. Use GNU Parted.
Disk /dev/sda: 299.0 GB, 298999349248 bytes
255 heads, 63 sectors/track, 36351 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000
Device Boot Start End Blocks Id System
/dev/sda1 1 36352 291991551+ ee GPT
Partition 1 does not start on physical sector boundary.
Disk /dev/sdb: 107.4 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000
Disk /dev/sdc: 107.4 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000
Disk /dev/mapper/mpathc: 107.4 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000
note:sdb,sdc and /dev/mapper/mpathc are new devices added.
show multipath topology
[root@dev1 ~]# multipath -l
mpathc (36005076802810b121800000000000002) dm-0 IBM,2145
size=100G features='1 queue_if_no_path' hwhandler='0' wp=rw
|-+- policy='round-robin 0' prio=0 status=active
| `- 4:0:0:0 sdc 8:32 active undef running
`-+- policy='round-robin 0' prio=0 status=enabled
`- 3:0:0:0 sdb 8:16 active undef running
note:multipathing aggregates the sdb,sdc, and creates a new device mpathc that consists of the aggregated paths.
v7000 volumes detail operation: V7000 -> Cluster -> Volumes -> Volumes –> Volume Details:volume01
!
chkconfig
[root@dev1 ~]# chkconfig multipathd on
fdisk and makefs
fdisk
[root@dev1 ~]# fdisk /dev/mapper/mpathc
makefs
[root@dev1 ~]# mkfs.ext4 /dev/mapper/mpathc
mount
[root@dev1 ~]# mkdir /v7000
[root@dev1 ~]# mount /dev/mapper/mpathc /v7000/
[root@dev1 ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/sda4 179G 3.0G 167G 2% /
tmpfs 32G 88K 32G 1% /dev/shm
/dev/sda2 485M 55M 405M 12% /boot
/dev/sda1 200M 260K 200M 1% /boot/efi
/dev/mapper/mpathc 99G 188M 94G 1% /v7000
dd test
[root@dev1 v7000]# time dd if=/dev/mapper/mpathc of=/dev/null bs=8k
13107200+0 records in
13107200+0 records out
107374182400 bytes (107 GB) copied, 270.831 s, 396 MB/s
real 4m30.834s
user 0m2.224s
sys 2m43.163s
Reference
blog comments powered by Disqus