NetApp – Page 3

NetApp – Get a list of all volumes not being used

May 30, 2012June 21, 2013 Christian Leave a comment

Well, I had another task for today … I have an amount of FlexVolumes (sixty currently per controller), and I didn’t know if we had any, that didn’t have any LUNs on them. Now I thought there was a command for that since my co-worker mentioned something like that. However, once again … there isn’t.

; html-script: false crayon-selected ]#!/bin/bash

MAILTO="san@barfoo.org"
KEY_FILE="/root/.ssh/netapp.dsa"
SSH_OPTS="/root/.ssh/netapp-ssh_config"
FAS_CTRL=$1
TMPDIR="$( mktemp -d )"

ssh_fas() {
  # $@: commands for Data ONTAP
  COMMANDS="$@"
  /usr/bin/ssh -i $KEY_FILE -l root -F $SSH_OPTS $COMMANDS
}

# Get the hostname of the controller, necessary for the reporting
CTRL_HOSTNAME="$( ssh_fas $FAS_CTRL rdfile /etc/rc | grep ^hostname | 
  cut -d  -f2 | tr 'a-z' 'A-Z' )"

# Get a list of all volumes / luns
VOL_LIST="$( ssh_fas $FAS_CTRL vol status | grep ^vol | 
  egrep -v '(nfs|cifs)' | awk '{ print $1 }' )"
LUN_LIST="$( ssh_fas $FAS_CTRL lun show | grep '/vol' | 
  awk '{ print $1 }' )"

for lun in $LUN_LIST; do
  VOL_EXTRACT="$( echo $lun | cut -d/ -f3 )"
  VOL_LIST=${VOL_LIST/${VOL_EXTRACT}/}
done

for vol in $VOL_LIST; do
  echo "Empty Flex Volume: $vol."
done > $TMPDIR/mailcontent

if [ "$( grep Flex $TMPDIR/mailcontent )" ] ; then
  cat $TMPDIR/mailcontent | mailx -r $MAILTO 
    -s "$CTRL_HOSTNAME: Empty volume check" $MAILTO
fi

rm -r $TMPDIR

; html-script: false crayon-selected ]#!/bin/bash

MAILTO="san@barfoo.org"

KEY_FILE="/root/.ssh/netapp.dsa"

SSH_OPTS="/root/.ssh/netapp-ssh_config"

FAS_CTRL=$1

TMPDIR="$( mktemp -d )"

ssh_fas() {

# $@: commands for Data ONTAP

COMMANDS="$@"

/usr/bin/ssh -i $KEY_FILE -l root -F $SSH_OPTS $COMMANDS

}

# Get the hostname of the controller, necessary for the reporting

CTRL_HOSTNAME="$( ssh_fas $FAS_CTRL rdfile /etc/rc | grep ^hostname |

cut -d -f2 | tr 'a-z' 'A-Z' )"

# Get a list of all volumes / luns

VOL_LIST="$( ssh_fas $FAS_CTRL vol status | grep ^vol |

egrep -v '(nfs|cifs)' | awk '{ print $1 }' )"

LUN_LIST="$( ssh_fas $FAS_CTRL lun show | grep '/vol' |

awk '{ print $1 }' )"

for lun in $LUN_LIST; do

VOL_EXTRACT="$( echo $lun | cut -d/ -f3 )"

VOL_LIST=${VOL_LIST/${VOL_EXTRACT}/}

done

for vol in $VOL_LIST; do

echo "Empty Flex Volume: $vol."

done > $TMPDIR/mailcontent

if [ "$( grep Flex $TMPDIR/mailcontent )" ] ; then

cat $TMPDIR/mailcontent | mailx -r $MAILTO

-s "$CTRL_HOSTNAME: Empty volume check" $MAILTO

rm -r $TMPDIR

Automating qual_devices updates

May 30, 2012August 8, 2014 Christian Leave a comment

Well, once again I was presented with a nice AutoSupport warning once I logged into my NOW account. Since we don’t have CIFS and/or NFS licensed on our filers, I wrote a cute little script that does the whole work for me.

; html-script: false  ]#!/bin/bash

TMPDIR="$( mktemp -d )"
KEY_FILE="/root/.ssh/netapp.dsa"
SSH_OPTS="/root/.ssh/netapp-ssh_config"
FAS_CTRL=$1
QUALDEVICES=$2

ssh_fas() {
  # $@: commands for Data ONTAP
  COMMANDS="$@"
  /usr/bin/ssh -i $KEY_FILE -l root -F $SSH_OPTS $COMMANDS
}
#set -x

echo "Updating qual_devices on $FAS_CTRL"

# Enable ftpd if it isn't enabled already
echo -n "Checking FTP subsystem"

FTPD_INITIAL_STATE="$( ssh_fas $FAS_CTRL options ftpd.enable | 
  awk '{ print $2 }' )"
if [ $FTPD_INITIAL_STATE == "off" ] ; then
  ssh_fas $FAS_CTRL options ftpd.enable on
  echo "   .... ok"
else
  echo "   .... ok"
fi

echo
read -s -p "Please supply the root password for $FAS_CTRL: "
ROOT_PASSWD=$REPLY

echo
echo "Checking qual_devices:"
echo -n "     Running: "
mkdir $TMPDIR/fas-version
# Check the old version.
ftp -n $FAS_CTRL >/dev/null <<END_SCRIPT
prompt
user root $ROOT_PASSWD
lcd $TMPDIR/fas-version
cd /etc
mget qual_devices*
quit
END_SCRIPT

FAS_VERSION="$( grep Datecode $TMPDIR/fas-version/qual_devices_v3 | 
  head -n1 | cut -d  -f3 )"

echo "$FAS_VERSION"
# Unzip the qual_devices.zip file and compare it.
ORIGPWD=$PWD
mkdir $TMPDIR/new-version
cd $TMPDIR/new-version
unzip $QUALDEVICES >/dev/null
echo -n "         New: "
NEW_VERSION="$( grep Datecode $TMPDIR/new-version/qual_devices_v3 | 
  head -n1 | cut -d  -f3 )"
echo "$NEW_VERSION"
echo

# Upload the supplied version if the new file doesn't match the one running
# on the controller
if [ $NEW_VERSION != $FAS_VERSION ] ; then
  echo "Uploading qual_devices to $FAS_CTRL"
  ftp -n $FAS_CTRL >/dev/null <<END_SCRIPT
prompt
user root $ROOT_PASSWD
lcd $TMPDIR/new-version
cd /etc
mput qual_devices*
quit
END_SCRIPT

  # Send an asup message, that the issue is corrected
  echo "Generating AutoSupport message"
  ssh_fas $FAS_CTRL options autosupport.doit qual_devices_fixed_$NEW_VERSION
fi

#set +x

# Enable ftpd
if [ $FTPD_INITIAL_STATE == "off" ] ; then
  ssh_fas $FAS_CTRL options ftpd.enable off
fi

rm -r $TMPDIR

; html-script: false ]#!/bin/bash

TMPDIR="$( mktemp -d )"

KEY_FILE="/root/.ssh/netapp.dsa"

SSH_OPTS="/root/.ssh/netapp-ssh_config"

FAS_CTRL=$1

QUALDEVICES=$2

ssh_fas() {

# $@: commands for Data ONTAP

COMMANDS="$@"

/usr/bin/ssh -i $KEY_FILE -l root -F $SSH_OPTS $COMMANDS

}

#set -x

echo "Updating qual_devices on $FAS_CTRL"

# Enable ftpd if it isn't enabled already

echo -n "Checking FTP subsystem"

FTPD_INITIAL_STATE="$( ssh_fas $FAS_CTRL options ftpd.enable |

awk '{ print $2 }' )"

if [ $FTPD_INITIAL_STATE == "off" ] ; then

ssh_fas $FAS_CTRL options ftpd.enable on

echo " .... ok"

else

echo " .... ok"

echo

read -s -p "Please supply the root password for $FAS_CTRL: "

ROOT_PASSWD=$REPLY

echo

echo "Checking qual_devices:"

echo -n " Running: "

mkdir $TMPDIR/fas-version

# Check the old version.

ftp -n $FAS_CTRL >/dev/null <<END_SCRIPT

prompt

user root $ROOT_PASSWD

lcd $TMPDIR/fas-version

cd /etc

mget qual_devices*

quit

END_SCRIPT

FAS_VERSION="$( grep Datecode $TMPDIR/fas-version/qual_devices_v3 |

head -n1 | cut -d -f3 )"

echo "$FAS_VERSION"

# Unzip the qual_devices.zip file and compare it.

ORIGPWD=$PWD

mkdir $TMPDIR/new-version

cd $TMPDIR/new-version

unzip $QUALDEVICES >/dev/null

echo -n " New: "

NEW_VERSION="$( grep Datecode $TMPDIR/new-version/qual_devices_v3 |

head -n1 | cut -d -f3 )"

echo "$NEW_VERSION"

echo

# Upload the supplied version if the new file doesn't match the one running

# on the controller

if [ $NEW_VERSION != $FAS_VERSION ] ; then

echo "Uploading qual_devices to $FAS_CTRL"

ftp -n $FAS_CTRL >/dev/null <<END_SCRIPT

prompt

user root $ROOT_PASSWD

lcd $TMPDIR/new-version

cd /etc

mput qual_devices*

quit

END_SCRIPT

# Send an asup message, that the issue is corrected

echo "Generating AutoSupport message"

ssh_fas $FAS_CTRL options autosupport.doit qual_devices_fixed_$NEW_VERSION

#set +x

# Enable ftpd

if [ $FTPD_INITIAL_STATE == "off" ] ; then

ssh_fas $FAS_CTRL options ftpd.enable off

rm -r $TMPDIR

The whole thing is surly based, that FTP is configured (as I described previously).

TSM and NetApp – Another Quick Hint

May 27, 2012June 21, 2013 Christian Leave a comment

Well, we’ve been trying to come up with a decent way to backup NetApp snapshots to tape (SnapMirror To Tape), so we evaluated all the available methods of using NDMP backups.

There’s Image Backup in two different variants – FULL and DIFFerntial
There’s SnapMirror To Tape

So the Image Backup is one of the ways. However the DIFFerntial backup only works for CIFS and NFS shares (which we don’t use). We only have FC luns (or rather FCoE luns), so there’s only a single (or in case of the boot luns more than one) file in each volume. With that however, each run of the Image Backup with the DIFFerential option, it’s gonna backup the full size of the volume (plus the deduplicated amount).

The SnapMirror To Tape option presents another problem: We intend to use SnapManager for SQL/Oracle, which creates “consistent” snapshots of the database luns. However the SnapMirror To Tape backup doesn’t have an option to use an already existing snapshot, but creates another one. Which puts the whole SnapManager business down the curb. So we either do use a SnapMirror To Disk from one database lun to another controller and then run the SnapMirror To Tape from the second controller or come up with another way to back them up to TSM.

TSM and NetApp – Quick Hint

April 25, 2012June 21, 2013 Christian Leave a comment

Well, to save everyone else the trouble (since it isn’t documented anywhere – and I just spent about an hour finding the cause for this), if you need to configure NDMP on your NetApp Filer, make sure you also configure an interface other than e0M.

Apparently the necessary controlport for NDMP (10000) is being blocked on e0M, thus ndmp may be configured and running, however TSM is gonna complain that it is unable to connect to the specified data mover.

ANR4728E Server connection to file server 172.31.76.100 failed. Please check
the attributes of the file server specified during definition of the datamover.
ANR2146E DEFINE DATAMOVER: Node NAS_DM is not registered.
ANS8001I Return code 11.

ANR4728E Server connection to file server 172.31.76.100 failed. Please check

the attributes of the file server specified during definition of the datamover.

ANR2146E DEFINE DATAMOVER: Node NAS_DM is not registered.

ANS8001I Return code 11.

NetApp FAS/Data ONTAP public key authentification with CIFS/NFS license

March 7, 2012June 21, 2013 Christian 2 Comments

Well as the title says, sadly we bought our FAS6210 without CIFS/NFS license. Thus, in order to create the folder structure/add the authorized_keys file, you’ll have to work for your money a little bit.

First, you need to run cifs setup / cifs passwd somewhere. I did it on our Data ONTAP simulator, which comes in handy for things like that.

You’ll get a cryptic looking password (no clue which format that is), looking like this: _OnWddr)xa.

Now, in order for the ftpd process to work, you need to create a /etc/passwd file. Usually the cifs setup would take care of that, but since we don’t own a CIFS license and I didn’t wanna add a trial license, I simply did what I described above on our simulator.

Now, open a SSH session with your filer. Create a new /etc/passwd file using wrfile. The new passwd file should look like this:

root:_OnWddr)xa.:0:1::/:
pcuser::65534:65534::/:
nobody::65535:65535::/:
ftp::65533:65533:FTP Anonymous:/home/ftp:

root:_OnWddr)xa.:0:1::/:

pcuser::65534:65534::/:

nobody::65535:65535::/:

ftp::65533:65533:FTP Anonymous:/home/ftp:

Now make sure, to replace the whole string in between the double dots with the one you got from the output of cifs passwd. After that is done, enable the FTP daemon using the options command:

; html-script: false ]options ftpd.enable on

1	; html-script: false ]options ftpd.enable on

Now, create your authorized_keys file somewhere (I exported my Public Key using PuTTygen), and from there open a ftp sessions with your root user on the filer. In the ftp shell run this:

cd /etc/sshd
mkdir root
cd root
mkdir .ssh
cd .ssh
lcd D:userschrischieDesktop
prompt
mput authorized_keys

cd /etc/sshd

mkdir root

cd root

mkdir .ssh

cd .ssh

lcd D:userschrischieDesktop

prompt

mput authorized_keys

The above example asumes that you created the authorized_keys file in the folder Desktop (that’s where my Desktop folder is, so replace it to suit your needs). Afterwards, disable the FTP daemon again:

options ftpd.enable off

1	options ftpd.enable off

And, tada … enjoy SSH password-less with your shiny public key.