May 2012 – BAFM

NetApp – Get a list of all volumes not being used

May 30, 2012June 21, 2013 Christian Leave a comment

Well, I had another task for today … I have an amount of FlexVolumes (sixty currently per controller), and I didn’t know if we had any, that didn’t have any LUNs on them. Now I thought there was a command for that since my co-worker mentioned something like that. However, once again … there isn’t.

; html-script: false crayon-selected ]#!/bin/bash

MAILTO="san@barfoo.org"
KEY_FILE="/root/.ssh/netapp.dsa"
SSH_OPTS="/root/.ssh/netapp-ssh_config"
FAS_CTRL=$1
TMPDIR="$( mktemp -d )"

ssh_fas() {
  # $@: commands for Data ONTAP
  COMMANDS="$@"
  /usr/bin/ssh -i $KEY_FILE -l root -F $SSH_OPTS $COMMANDS
}

# Get the hostname of the controller, necessary for the reporting
CTRL_HOSTNAME="$( ssh_fas $FAS_CTRL rdfile /etc/rc | grep ^hostname | 
  cut -d  -f2 | tr 'a-z' 'A-Z' )"

# Get a list of all volumes / luns
VOL_LIST="$( ssh_fas $FAS_CTRL vol status | grep ^vol | 
  egrep -v '(nfs|cifs)' | awk '{ print $1 }' )"
LUN_LIST="$( ssh_fas $FAS_CTRL lun show | grep '/vol' | 
  awk '{ print $1 }' )"

for lun in $LUN_LIST; do
  VOL_EXTRACT="$( echo $lun | cut -d/ -f3 )"
  VOL_LIST=${VOL_LIST/${VOL_EXTRACT}/}
done

for vol in $VOL_LIST; do
  echo "Empty Flex Volume: $vol."
done > $TMPDIR/mailcontent

if [ "$( grep Flex $TMPDIR/mailcontent )" ] ; then
  cat $TMPDIR/mailcontent | mailx -r $MAILTO 
    -s "$CTRL_HOSTNAME: Empty volume check" $MAILTO
fi

rm -r $TMPDIR

; html-script: false crayon-selected ]#!/bin/bash

MAILTO="san@barfoo.org"

KEY_FILE="/root/.ssh/netapp.dsa"

SSH_OPTS="/root/.ssh/netapp-ssh_config"

FAS_CTRL=$1

TMPDIR="$( mktemp -d )"

ssh_fas() {

# $@: commands for Data ONTAP

COMMANDS="$@"

/usr/bin/ssh -i $KEY_FILE -l root -F $SSH_OPTS $COMMANDS

}

# Get the hostname of the controller, necessary for the reporting

CTRL_HOSTNAME="$( ssh_fas $FAS_CTRL rdfile /etc/rc | grep ^hostname |

cut -d -f2 | tr 'a-z' 'A-Z' )"

# Get a list of all volumes / luns

VOL_LIST="$( ssh_fas $FAS_CTRL vol status | grep ^vol |

egrep -v '(nfs|cifs)' | awk '{ print $1 }' )"

LUN_LIST="$( ssh_fas $FAS_CTRL lun show | grep '/vol' |

awk '{ print $1 }' )"

for lun in $LUN_LIST; do

VOL_EXTRACT="$( echo $lun | cut -d/ -f3 )"

VOL_LIST=${VOL_LIST/${VOL_EXTRACT}/}

done

for vol in $VOL_LIST; do

echo "Empty Flex Volume: $vol."

done > $TMPDIR/mailcontent

if [ "$( grep Flex $TMPDIR/mailcontent )" ] ; then

cat $TMPDIR/mailcontent | mailx -r $MAILTO

-s "$CTRL_HOSTNAME: Empty volume check" $MAILTO

rm -r $TMPDIR

Automating qual_devices updates

May 30, 2012August 8, 2014 Christian Leave a comment

Well, once again I was presented with a nice AutoSupport warning once I logged into my NOW account. Since we don’t have CIFS and/or NFS licensed on our filers, I wrote a cute little script that does the whole work for me.

; html-script: false  ]#!/bin/bash

TMPDIR="$( mktemp -d )"
KEY_FILE="/root/.ssh/netapp.dsa"
SSH_OPTS="/root/.ssh/netapp-ssh_config"
FAS_CTRL=$1
QUALDEVICES=$2

ssh_fas() {
  # $@: commands for Data ONTAP
  COMMANDS="$@"
  /usr/bin/ssh -i $KEY_FILE -l root -F $SSH_OPTS $COMMANDS
}
#set -x

echo "Updating qual_devices on $FAS_CTRL"

# Enable ftpd if it isn't enabled already
echo -n "Checking FTP subsystem"

FTPD_INITIAL_STATE="$( ssh_fas $FAS_CTRL options ftpd.enable | 
  awk '{ print $2 }' )"
if [ $FTPD_INITIAL_STATE == "off" ] ; then
  ssh_fas $FAS_CTRL options ftpd.enable on
  echo "   .... ok"
else
  echo "   .... ok"
fi

echo
read -s -p "Please supply the root password for $FAS_CTRL: "
ROOT_PASSWD=$REPLY

echo
echo "Checking qual_devices:"
echo -n "     Running: "
mkdir $TMPDIR/fas-version
# Check the old version.
ftp -n $FAS_CTRL >/dev/null <<END_SCRIPT
prompt
user root $ROOT_PASSWD
lcd $TMPDIR/fas-version
cd /etc
mget qual_devices*
quit
END_SCRIPT

FAS_VERSION="$( grep Datecode $TMPDIR/fas-version/qual_devices_v3 | 
  head -n1 | cut -d  -f3 )"

echo "$FAS_VERSION"
# Unzip the qual_devices.zip file and compare it.
ORIGPWD=$PWD
mkdir $TMPDIR/new-version
cd $TMPDIR/new-version
unzip $QUALDEVICES >/dev/null
echo -n "         New: "
NEW_VERSION="$( grep Datecode $TMPDIR/new-version/qual_devices_v3 | 
  head -n1 | cut -d  -f3 )"
echo "$NEW_VERSION"
echo

# Upload the supplied version if the new file doesn't match the one running
# on the controller
if [ $NEW_VERSION != $FAS_VERSION ] ; then
  echo "Uploading qual_devices to $FAS_CTRL"
  ftp -n $FAS_CTRL >/dev/null <<END_SCRIPT
prompt
user root $ROOT_PASSWD
lcd $TMPDIR/new-version
cd /etc
mput qual_devices*
quit
END_SCRIPT

  # Send an asup message, that the issue is corrected
  echo "Generating AutoSupport message"
  ssh_fas $FAS_CTRL options autosupport.doit qual_devices_fixed_$NEW_VERSION
fi

#set +x

# Enable ftpd
if [ $FTPD_INITIAL_STATE == "off" ] ; then
  ssh_fas $FAS_CTRL options ftpd.enable off
fi

rm -r $TMPDIR

; html-script: false ]#!/bin/bash

TMPDIR="$( mktemp -d )"

KEY_FILE="/root/.ssh/netapp.dsa"

SSH_OPTS="/root/.ssh/netapp-ssh_config"

FAS_CTRL=$1

QUALDEVICES=$2

ssh_fas() {

# $@: commands for Data ONTAP

COMMANDS="$@"

/usr/bin/ssh -i $KEY_FILE -l root -F $SSH_OPTS $COMMANDS

}

#set -x

echo "Updating qual_devices on $FAS_CTRL"

# Enable ftpd if it isn't enabled already

echo -n "Checking FTP subsystem"

FTPD_INITIAL_STATE="$( ssh_fas $FAS_CTRL options ftpd.enable |

awk '{ print $2 }' )"

if [ $FTPD_INITIAL_STATE == "off" ] ; then

ssh_fas $FAS_CTRL options ftpd.enable on

echo " .... ok"

else

echo " .... ok"

echo

read -s -p "Please supply the root password for $FAS_CTRL: "

ROOT_PASSWD=$REPLY

echo

echo "Checking qual_devices:"

echo -n " Running: "

mkdir $TMPDIR/fas-version

# Check the old version.

ftp -n $FAS_CTRL >/dev/null <<END_SCRIPT

prompt

user root $ROOT_PASSWD

lcd $TMPDIR/fas-version

cd /etc

mget qual_devices*

quit

END_SCRIPT

FAS_VERSION="$( grep Datecode $TMPDIR/fas-version/qual_devices_v3 |

head -n1 | cut -d -f3 )"

echo "$FAS_VERSION"

# Unzip the qual_devices.zip file and compare it.

ORIGPWD=$PWD

mkdir $TMPDIR/new-version

cd $TMPDIR/new-version

unzip $QUALDEVICES >/dev/null

echo -n " New: "

NEW_VERSION="$( grep Datecode $TMPDIR/new-version/qual_devices_v3 |

head -n1 | cut -d -f3 )"

echo "$NEW_VERSION"

echo

# Upload the supplied version if the new file doesn't match the one running

# on the controller

if [ $NEW_VERSION != $FAS_VERSION ] ; then

echo "Uploading qual_devices to $FAS_CTRL"

ftp -n $FAS_CTRL >/dev/null <<END_SCRIPT

prompt

user root $ROOT_PASSWD

lcd $TMPDIR/new-version

cd /etc

mput qual_devices*

quit

END_SCRIPT

# Send an asup message, that the issue is corrected

echo "Generating AutoSupport message"

ssh_fas $FAS_CTRL options autosupport.doit qual_devices_fixed_$NEW_VERSION

#set +x

# Enable ftpd

if [ $FTPD_INITIAL_STATE == "off" ] ; then

ssh_fas $FAS_CTRL options ftpd.enable off

rm -r $TMPDIR

The whole thing is surly based, that FTP is configured (as I described previously).

TSM and NetApp – Another Quick Hint

May 27, 2012June 21, 2013 Christian Leave a comment

Well, we’ve been trying to come up with a decent way to backup NetApp snapshots to tape (SnapMirror To Tape), so we evaluated all the available methods of using NDMP backups.

There’s Image Backup in two different variants – FULL and DIFFerntial
There’s SnapMirror To Tape

So the Image Backup is one of the ways. However the DIFFerntial backup only works for CIFS and NFS shares (which we don’t use). We only have FC luns (or rather FCoE luns), so there’s only a single (or in case of the boot luns more than one) file in each volume. With that however, each run of the Image Backup with the DIFFerential option, it’s gonna backup the full size of the volume (plus the deduplicated amount).

The SnapMirror To Tape option presents another problem: We intend to use SnapManager for SQL/Oracle, which creates “consistent” snapshots of the database luns. However the SnapMirror To Tape backup doesn’t have an option to use an already existing snapshot, but creates another one. Which puts the whole SnapManager business down the curb. So we either do use a SnapMirror To Disk from one database lun to another controller and then run the SnapMirror To Tape from the second controller or come up with another way to back them up to TSM.

Setting up a phpMyAdmin auto-update

May 4, 2012May 4, 2012 Christian 1 Comment

Well, just like everybody else, I’ve been using phpMyAdmin to do my casual MySQL fixing/work on this website. However, recently the phpMyAdmin developers switched to Git on SourceForge and then to GitHub shortly after that.

So, the guy over at Network Jack wrote down what I had already been doing:

git clone --depth=1 git://phpmyadmin.git.sf.net/gitroot/phpmyadmin/phpmyadmin
cd phpmyadmin
git checkout --track -b PMASTABLE origin/STABLE

git clone --depth=1 git://phpmyadmin.git.sf.net/gitroot/phpmyadmin/phpmyadmin

cd phpmyadmin

git checkout --track -b PMASTABLE origin/STABLE

However, as I said before, they switched from SourceForge to GitHub, thus you need another URL.

git clone --depth=1 git://github.com/phpmyadmin/phpmyadmin.git
cd phpmyadmin
git checkout --track -b PMASTABLE origin/STABLE

git clone --depth=1 git://github.com/phpmyadmin/phpmyadmin.git

cd phpmyadmin

git checkout --track -b PMASTABLE origin/STABLE

After that, you just need to add a simple cronjob that enters the directory and runs git pull.

S	M	T	W	T	F	S
		1	2	3	4	5
6	7	8	9	10	11	12
13	14	15	16	17	18	19
20	21	22	23	24	25	26
27	28	29	30	31