BASH – BAFM

NetScaler: Generate a simple usage statistic per Vserver

November 21, 2013November 21, 2013 Christian Leave a comment

One of my co-workers recently approached me, that he needed a simple shell script which would generate a simple report about a Vserver’s current connections. After ironing out a few things with him (he had the intention of it being on a CIFS share on our file-server – which I changed to a simple HTML page) I went to work.

Out came two scripts. One is the collection instance, and the other is the processing instance. First the collection script runs, finds the current HA master node and then collects the Vserver’s current connections. After that script has dumped the information (date, time, current connections) into a file, the processing script will go and create a simple HTML page that’ll show exactly those informations.

You’ll also need to have configured the public key authentification on both HA nodes, since entering a password in combination with scripting is a bit lame.

#!/bin/bash

IDENTITY_FILE="/root/.ssh/netscaler"
NS_USER="nsroot"
NS_HOST="$1"
NS_VSERVER="$2"

if [ -z "$2" ] ; then
	echo "Usage: ns-gather-connections.sh <IP/HOSTNAME> <VSERVER_NAME>"
	echo ""
	echo "    o IP/HOSTNAME     -  IP or Hostname of the NetScaler"
	echo "    o VSERVER_NAME    -  Name of the NetScaler vServer"
	echo ""
	exit 1
fi

ns_ssh() {
	COMMANDS="$@"
	ssh -i $IDENTITY_FILE $NS_USER@$NS_HOST $COMMANDS
}

# Get HA information from the NetScaler and check if the current IP is the Master
NS_NODE_STATUS="$( ns_ssh sh ha node | egrep -A2 "IP:.*$NS_HOST" | grep Master | \
	awk '{ print $3 }' )"

if [ "$NS_NODE_STATUS" != "Primary" ] ; then
	# Search for the Primary node
	NS_MASTER_NODE="$( ns_ssh sh ha node | egrep -B2 "Master State: Primary" | \
		grep "IP: " | awk '{ print $2 }' )"
	NS_HOST=$NS_MASTER_NODE

elif [ "$NS_NODE_STATUS" == "Primary" ] ; then
	NS_MASTER_NODE="$NS_HOST"
	NS_HOST=$NS_MASTER_NODE
fi

# Check the connection table
NS_CONNTABLE="$( ns_ssh "sh ns connectiontable \"VSVRNAME = ${NS_VSERVER}\" -detail LINK" | grep 'ESTABLISHED' | wc -l )"

echo "`date '+%F_%R'`;$NS_CONNTABLE" >> /srv/www/${NS_VSERVER}_conntable.log

#!/bin/bash

IDENTITY_FILE="/root/.ssh/netscaler"

NS_USER="nsroot"

NS_HOST="$1"

NS_VSERVER="$2"

if [ -z "$2" ] ; then

echo "Usage: ns-gather-connections.sh <IP/HOSTNAME> <VSERVER_NAME>"

echo ""

echo " o IP/HOSTNAME - IP or Hostname of the NetScaler"

echo " o VSERVER_NAME - Name of the NetScaler vServer"

echo ""

exit 1

ns_ssh() {

COMMANDS="$@"

ssh -i $IDENTITY_FILE $NS_USER@$NS_HOST $COMMANDS

}

# Get HA information from the NetScaler and check if the current IP is the Master

NS_NODE_STATUS="$( ns_ssh sh ha node | egrep -A2 "IP:.*$NS_HOST" | grep Master | \

awk '{ print $3 }' )"

if [ "$NS_NODE_STATUS" != "Primary" ] ; then

# Search for the Primary node

NS_MASTER_NODE="$( ns_ssh sh ha node | egrep -B2 "Master State: Primary" | \

grep "IP: " | awk '{ print $2 }' )"

NS_HOST=$NS_MASTER_NODE

elif [ "$NS_NODE_STATUS" == "Primary" ] ; then

NS_MASTER_NODE="$NS_HOST"

NS_HOST=$NS_MASTER_NODE

# Check the connection table

NS_CONNTABLE="$( ns_ssh "sh ns connectiontable \"VSVRNAME = ${NS_VSERVER}\" -detail LINK" | grep 'ESTABLISHED' | wc -l )"

echo "`date '+%F_%R'`;$NS_CONNTABLE" >> /srv/www/${NS_VSERVER}_conntable.log

#!/bin/bash

NS_VSERVER="$1"
HTML_FILE="/srv/www/htdocs/${NS_VSERVER}.html"

cat > $HTML_FILE << EOF
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"
	"http://www.w3.org/TR/html4/loose.dtd">
<html>
<head>
	<title>$NS_VSERVER - Anzahl Clients nach Datum</title>
	<style>
	.ns {
		margin:0px;padding:0px;
		width:100%;
		border:1px solid #000000;
		-moz-border-radius-bottomleft:0px;
		-webkit-border-bottom-left-radius:0px;
		border-bottom-left-radius:0px;
		-moz-border-radius-bottomright:0px;
		-webkit-border-bottom-right-radius:0px;
		border-bottom-right-radius:0px;
		-moz-border-radius-topright:0px;
		-webkit-border-top-right-radius:0px;
		border-top-right-radius:0px;
		-moz-border-radius-topleft:0px;
		-webkit-border-top-left-radius:0px;
		border-top-left-radius:0px;
	}.ns table{
		border-collapse: collapse;
		border-spacing: 0;
		width:100%;
		height:100%;
		margin:0px;padding:0px;
	}.ns th{
		font-size:14px;
		font-family:Verdana;
		font-weight:bold;
		border:1px solid #000000;
		border-width:0px 1px 1px 0px;
		text-align:left;
		padding:7px;
	}.ns tr:last-child td:last-child {
		-moz-border-radius-bottomright:0px;
		-webkit-border-bottom-right-radius:0px;
		border-bottom-right-radius:0px;
	}
	.ns table tr:first-child td:first-child {
		-moz-border-radius-topleft:0px;
		-webkit-border-top-left-radius:0px;
		border-top-left-radius:0px;
	}
	.ns table tr:first-child td:last-child {
		-moz-border-radius-topright:0px;
		-webkit-border-top-right-radius:0px;
		border-top-right-radius:0px;
	}.ns tr:last-child td:first-child{
		-moz-border-radius-bottomleft:0px;
		-webkit-border-bottom-left-radius:0px;
		border-bottom-left-radius:0px;
	}.ns tr:hover td{

	}
	.ns tr:nth-child(odd){ background-color:#aad4ff; }
	.ns tr:nth-child(even)    { background-color:#ffffff; }.ns td{
		vertical-align:middle;
		border:1px solid #000000;
		border-width:0px 1px 1px 0px;
		text-align:left;
		padding:7px;
		font-size:14px;
		font-family:Verdana;
		font-weight:normal;
		color:#000000;
	}.ns tr:last-child td{
		border-width:0px 1px 0px 0px;
	}.ns tr td:last-child{
		border-width:0px 0px 1px 0px;
	}.ns tr:last-child td:last-child{
		border-width:0px 0px 0px 0px;
	}
	.ns tr:first-child td{
			background:-o-linear-gradient(bottom, #005fbf 5%, #003f7f 100%);	background:-webkit-gradient( linear, left top, left bottom, color-stop(0.05, #005fbf), color-stop(1, #003f7f) );
		background:-moz-linear-gradient( center top, #005fbf 5%, #003f7f 100% );
		filter:progid:DXImageTransform.Microsoft.gradient(startColorstr="#005fbf", endColorstr="#003f7f");	background: -o-linear-gradient(top,#005fbf,003f7f);
		background-color:#005fbf;
		border:0px solid #000000;
		text-align:center;
		border-width:0px 0px 1px 1px;
		font-size:14px;
		font-family:Verdana;
		font-weight:bold;
		color:#ffffff;
	}
	.ns tr:first-child:hover td{
		background:-o-linear-gradient(bottom, #005fbf 5%, #003f7f 100%);	background:-webkit-gradient( linear, left top, left bottom, color-stop(0.05, #005fbf), color-stop(1, #003f7f) );
		background:-moz-linear-gradient( center top, #005fbf 5%, #003f7f 100% );
		filter:progid:DXImageTransform.Microsoft.gradient(startColorstr="#005fbf", endColorstr="#003f7f");	background: -o-linear-gradient(top,#005fbf,003f7f);
		background-color:#005fbf;
	}
	.ns tr:first-child td:first-child{
		border-width:0px 0px 1px 0px;
	}
	.ns tr:first-child td:last-child{
		border-width:0px 0px 1px 1px;
	}
	</style>
</head>
<body>

<h3>NetScaler Vserver $NS_VSERVER - sortiert nach Datum</h1>

<div class="ns">
	<table border="1">
		<tr>
			<th>Datum</th>
			<th>Zeit</th>
			<th>Anzahl Clients</th>
		</tr>
EOF

for line in $( tac /srv/www/${NS_VSERVER}_conntable.log ); do
	DATE="$( echo $line | cut -d\; -f1 | cut -d_ -f1 )"
	TIME="$( echo $line | cut -d\; -f1 | cut -d_ -f2 )"
	CONNECTIONS="$( echo $line | cut -d\; -f2 )"

	cat >> $HTML_FILE << EOF
		<tr>
			<td>$DATE</td>
			<td>$TIME</td>
			<td>$CONNECTIONS</td>
		</tr>
EOF
done

cat >> $HTML_FILE << EOF
</div>
</body>
</html>
EOF

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

#!/bin/bash

NS_VSERVER="$1"

HTML_FILE="/srv/www/htdocs/${NS_VSERVER}.html"

cat > $HTML_FILE << EOF

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"

"http://www.w3.org/TR/html4/loose.dtd">

<html>

<head>

<title>$NS_VSERVER - Anzahl Clients nach Datum</title>

<style>

.ns {

margin:0px;padding:0px;

width:100%;

border:1px solid #000000;

-moz-border-radius-bottomleft:0px;

-webkit-border-bottom-left-radius:0px;

border-bottom-left-radius:0px;

-moz-border-radius-bottomright:0px;

-webkit-border-bottom-right-radius:0px;

border-bottom-right-radius:0px;

-moz-border-radius-topright:0px;

-webkit-border-top-right-radius:0px;

border-top-right-radius:0px;

-moz-border-radius-topleft:0px;

-webkit-border-top-left-radius:0px;

border-top-left-radius:0px;

}.ns table{

border-collapse: collapse;

border-spacing: 0;

width:100%;

height:100%;

margin:0px;padding:0px;

}.ns th{

font-size:14px;

font-family:Verdana;

font-weight:bold;

border:1px solid #000000;

border-width:0px 1px 1px 0px;

text-align:left;

padding:7px;

}.ns tr:last-child td:last-child {

-moz-border-radius-bottomright:0px;

-webkit-border-bottom-right-radius:0px;

border-bottom-right-radius:0px;

}

.ns table tr:first-child td:first-child {

-moz-border-radius-topleft:0px;

-webkit-border-top-left-radius:0px;

border-top-left-radius:0px;

}

.ns table tr:first-child td:last-child {

-moz-border-radius-topright:0px;

-webkit-border-top-right-radius:0px;

border-top-right-radius:0px;

}.ns tr:last-child td:first-child{

-moz-border-radius-bottomleft:0px;

-webkit-border-bottom-left-radius:0px;

border-bottom-left-radius:0px;

}.ns tr:hover td{

}

.ns tr:nth-child(odd){ background-color:#aad4ff; }

.ns tr:nth-child(even) { background-color:#ffffff; }.ns td{

vertical-align:middle;

border:1px solid #000000;

border-width:0px 1px 1px 0px;

text-align:left;

padding:7px;

font-size:14px;

font-family:Verdana;

font-weight:normal;

color:#000000;

}.ns tr:last-child td{

border-width:0px 1px 0px 0px;

}.ns tr td:last-child{

border-width:0px 0px 1px 0px;

}.ns tr:last-child td:last-child{

border-width:0px 0px 0px 0px;

}

.ns tr:first-child td{

background:-o-linear-gradient(bottom, #005fbf 5%, #003f7f 100%); background:-webkit-gradient( linear, left top, left bottom, color-stop(0.05, #005fbf), color-stop(1, #003f7f) );

background:-moz-linear-gradient( center top, #005fbf 5%, #003f7f 100% );

filter:progid:DXImageTransform.Microsoft.gradient(startColorstr="#005fbf", endColorstr="#003f7f"); background: -o-linear-gradient(top,#005fbf,003f7f);

background-color:#005fbf;

border:0px solid #000000;

text-align:center;

border-width:0px 0px 1px 1px;

font-size:14px;

font-family:Verdana;

font-weight:bold;

color:#ffffff;

}

.ns tr:first-child:hover td{

background:-o-linear-gradient(bottom, #005fbf 5%, #003f7f 100%); background:-webkit-gradient( linear, left top, left bottom, color-stop(0.05, #005fbf), color-stop(1, #003f7f) );

background:-moz-linear-gradient( center top, #005fbf 5%, #003f7f 100% );

filter:progid:DXImageTransform.Microsoft.gradient(startColorstr="#005fbf", endColorstr="#003f7f"); background: -o-linear-gradient(top,#005fbf,003f7f);

background-color:#005fbf;

}

.ns tr:first-child td:first-child{

border-width:0px 0px 1px 0px;

}

.ns tr:first-child td:last-child{

border-width:0px 0px 1px 1px;

}

</style>

</head>

<body>

<h3>NetScaler Vserver $NS_VSERVER - sortiert nach Datum</h1>

<tr>

<th>Datum</th>

<th>Anzahl Clients</th>

</tr>

EOF

for line in $( tac /srv/www/${NS_VSERVER}_conntable.log ); do

DATE="$( echo $line | cut -d\; -f1 | cut -d_ -f1 )"

TIME="$( echo $line | cut -d\; -f1 | cut -d_ -f2 )"

CONNECTIONS="$( echo $line | cut -d\; -f2 )"

cat >> $HTML_FILE << EOF

<tr>

<td>$CONNECTIONS</td>

</tr>

EOF

done

cat >> $HTML_FILE << EOF

</div>

</body>

</html>

EOF

NetApp – Copy LUN mappings

June 15, 2012August 8, 2014 Christian 2 Comments

Well, today I had another idea (basically like the one I wrote for SVC’s VDisk mappings a while back) for a script:

; html-script: false  ]#!/bin/bash

KEY_FILE="/root/.ssh/netapp.dsa"
SSH_OPTS="/root/.ssh/netapp-ssh_config"

if [ $# -ne 3 ] ; then
  echo "fas-copy-lunmap: FAS_CONTROLLER SOURCE_IGROUP TARGET_IGROUP"
  echo
  echo "Copy the LUN map from one igroup to another, ie for ESX reinstallation"
  echo
  echo "  Usage:"
  echo "    - FAS_CONTROLLER:   Hostname/IP-adress of the DATA ONTAP controller"
  echo "    - SOURCE_IGROUP:    igroup that is used as a reference for the copy process"
  echo "    - TARGET_IGROUP:    igroup that is actually modified"
  echo
  exit 1
fi

FAS_CTRL=$1
SOURCE=$2
TARGET=$3

ssh_fas() {
  # $@: commands for Data ONTAP
  COMMANDS="$@"
  /usr/bin/ssh -i $KEY_FILE -l root -F $SSH_OPTS $COMMANDS
}

#set -x

# Get the lun list.
for lun in $( ssh_fas $FAS_CTRL lun show -g $SOURCE | awk '{ print $1 }' | sort -u ); do

  # Get the LUN number its mapped
  LUN_ID="$( ssh_fas $FAS_CTRL lun show -m $lun | grep "^/vol" | awk '{ print $3 }' )"

  # If the LUN id is 0, skip otherwise we would copy the boot LUN
  if [ "$LUN_ID" != "0" ] ; then
    # Actually map the lun to our host
    echo "Mapping $lun to $TARGET as LUN_ID $LUN_ID"
    ssh_fas $FAS_CTRL lun map $lun $TARGET $LUN_ID
  fi
done
#set +x

; html-script: false ]#!/bin/bash

KEY_FILE="/root/.ssh/netapp.dsa"

SSH_OPTS="/root/.ssh/netapp-ssh_config"

if [ $# -ne 3 ] ; then

echo "fas-copy-lunmap: FAS_CONTROLLER SOURCE_IGROUP TARGET_IGROUP"

echo

echo "Copy the LUN map from one igroup to another, ie for ESX reinstallation"

echo

echo " Usage:"

echo " - FAS_CONTROLLER: Hostname/IP-adress of the DATA ONTAP controller"

echo " - SOURCE_IGROUP: igroup that is used as a reference for the copy process"

echo " - TARGET_IGROUP: igroup that is actually modified"

echo

exit 1

FAS_CTRL=$1

SOURCE=$2

TARGET=$3

ssh_fas() {

# $@: commands for Data ONTAP

COMMANDS="$@"

/usr/bin/ssh -i $KEY_FILE -l root -F $SSH_OPTS $COMMANDS

}

#set -x

# Get the lun list.

for lun in $( ssh_fas $FAS_CTRL lun show -g $SOURCE | awk '{ print $1 }' | sort -u ); do

# Get the LUN number its mapped

LUN_ID="$( ssh_fas $FAS_CTRL lun show -m $lun | grep "^/vol" | awk '{ print $3 }' )"

# If the LUN id is 0, skip otherwise we would copy the boot LUN

if [ "$LUN_ID" != "0" ] ; then

# Actually map the lun to our host

echo "Mapping $lun to $TARGET as LUN_ID $LUN_ID"

ssh_fas $FAS_CTRL lun map $lun $TARGET $LUN_ID

done

#set +x

I’ll post the counterpart of the script (to remove the LUNs) in a second post later on.

NetApp – Get a list of volumes containing too much LUNs

June 8, 2012June 21, 2013 Christian Leave a comment

Well, after figuring things out (and realizing that if you create a LUN in the same size as the volume it’ll break), I decided to write yet another script to figure out which LUNs needed fixing.

; html-script: false crayon-selected ]#!/bin/bash

KEY_FILE="/root/.ssh/netapp.dsa"
SSH_OPTS="/root/.ssh/netapp-ssh_config"
FAS_CTRL=$1

ssh_fas() {
  # $@: commands for Data ONTAP
  COMMANDS="$@"
  /usr/bin/ssh -i $KEY_FILE -l root -F $SSH_OPTS $COMMANDS
}

for volume in $( ssh_fas $FAS_CTRL vol status | grep "vol.* online" | awk '{ print $1 }' ); do
  VOL_SIZE="$( ssh_fas $FAS_CTRL vol size $volume | awk '{ print $8 }' | sed "s,.,," )"
  VOL_UNIT_PARAM="$( echo "${#VOL_SIZE} - 1" | bc )"
  VOL_UNIT="${VOL_SIZE:$VOL_UNIT_PARAM:1}"

  case $VOL_UNIT in
    k) CONV="1024";;
    m) CONV="1024 * 1024";;
    g) CONV="1024 * 1024 * 1024";;
  esac

  VOL_SIZE="$( echo "scale=0; ${VOL_SIZE/$VOL_UNIT/} * $CONV" | bc )"

  # Subtract the snap reserve (if any)
  SNAP="$( ssh_fas $FAS_CTRL snap reserve $volume | cut -d  -f7 | sed "s,%,," )"

  if [ $SNAP -gt 0 ] ; then
    SNAP_SIZE="$( echo "$VOL_SIZE * $SNAP / 100" | bc )"
    REMAINING_VOL_SIZE="$( echo "$VOL_SIZE - $SNAP_SIZE" | bc )"
  else
    SNAP_SIZE=0
    REMAINING_VOL_SIZE=$VOL_SIZE
  fi

  # Get the luns created inside the volume
  LUN_SIZE_TOTAL=0
  for lunsize in $( ssh_fas $FAS_CTRL lun show -l ${volume} | awk '{ print $3 }' | sed -e "s,(,," -e "s,),," ); do
    LUN_SIZE_TOTAL="$( echo "$LUN_SIZE_TOTAL + $lunsize" | bc )"
    REMAINING_VOL_SIZE="$( echo "$REMAINING_VOL_SIZE - $lunsize" | bc )"
  done

  # Get the estimated space necessary.
  VOL_RESERVE="$( echo "$VOL_SIZE * 3 / 100" | bc )"
  echo "              VOL_NAME: $volume"
  echo "           VOLUME_SIZE: $( echo "scale=2; $VOL_SIZE / 1024 / 1024 / 1024" | bc )G"
  echo "           - SNAP_SIZE: $( echo "scale=2; $SNAP_SIZE / 1024 / 1024 / 1024" | bc )G"
  echo "             SUB_TOTAL: $( echo "scale=2; ($VOL_SIZE - $SNAP_SIZE) / 1024 / 1024 / 1024" | bc )G"
  echo
  echo "      - TOTAL_LUN_SIZE: $( echo "scale=2; $LUN_SIZE_TOTAL / 1024 / 1024 / 1024" | bc )G"
  echo "             SUB_TOTAL: $( echo "scale=2; ($VOL_SIZE - $SNAP_SIZE - $LUN_SIZE_TOTAL) / 1024 / 1024 / 1024" | bc )G"
  echo
  echo "         MISSING_SPACE:"
  DIFFERENCE_VOL_LUN="$( echo "scale=2; ($VOL_SIZE - $SNAP_SIZE - $LUN_SIZE_TOTAL)" | bc | sed "s,-,," )"
  echo "    DIFFERENCE_VOL_LUN: $( echo "scale=2; $DIFFERENCE_VOL_LUN / 1024 / 1024 / 1024" | bc )G"
  echo "         + VOL_RESERVE: $( echo "scale=2; $VOL_RESERVE / 1024 / 1024 / 1024" | bc )G"
  echo "             SUB_TOTAL: $( echo "scale=2; ($DIFFERENCE_VOL_LUN + $VOL_RESERVE) / 1024 / 1024 / 1024" | bc )G"
  echo
  echo
  echo
done

; html-script: false crayon-selected ]#!/bin/bash

KEY_FILE="/root/.ssh/netapp.dsa"

SSH_OPTS="/root/.ssh/netapp-ssh_config"

FAS_CTRL=$1

ssh_fas() {

# $@: commands for Data ONTAP

COMMANDS="$@"

/usr/bin/ssh -i $KEY_FILE -l root -F $SSH_OPTS $COMMANDS

}

for volume in $( ssh_fas $FAS_CTRL vol status | grep "vol.* online" | awk '{ print $1 }' ); do

VOL_SIZE="$( ssh_fas $FAS_CTRL vol size $volume | awk '{ print $8 }' | sed "s,.,," )"

VOL_UNIT_PARAM="$( echo "${#VOL_SIZE} - 1" | bc )"

VOL_UNIT="${VOL_SIZE:$VOL_UNIT_PARAM:1}"

case $VOL_UNIT in

k) CONV="1024";;

m) CONV="1024 * 1024";;

g) CONV="1024 * 1024 * 1024";;

esac

VOL_SIZE="$( echo "scale=0; ${VOL_SIZE/$VOL_UNIT/} * $CONV" | bc )"

# Subtract the snap reserve (if any)

SNAP="$( ssh_fas $FAS_CTRL snap reserve $volume | cut -d -f7 | sed "s,%,," )"

if [ $SNAP -gt 0 ] ; then

SNAP_SIZE="$( echo "$VOL_SIZE * $SNAP / 100" | bc )"

REMAINING_VOL_SIZE="$( echo "$VOL_SIZE - $SNAP_SIZE" | bc )"

else

SNAP_SIZE=0

REMAINING_VOL_SIZE=$VOL_SIZE

# Get the luns created inside the volume

LUN_SIZE_TOTAL=0

for lunsize in $( ssh_fas $FAS_CTRL lun show -l ${volume} | awk '{ print $3 }' | sed -e "s,(,," -e "s,),," ); do

LUN_SIZE_TOTAL="$( echo "$LUN_SIZE_TOTAL + $lunsize" | bc )"

REMAINING_VOL_SIZE="$( echo "$REMAINING_VOL_SIZE - $lunsize" | bc )"

done

# Get the estimated space necessary.

VOL_RESERVE="$( echo "$VOL_SIZE * 3 / 100" | bc )"

echo " VOL_NAME: $volume"

echo " VOLUME_SIZE: $( echo "scale=2; $VOL_SIZE / 1024 / 1024 / 1024" | bc )G"

echo " - SNAP_SIZE: $( echo "scale=2; $SNAP_SIZE / 1024 / 1024 / 1024" | bc )G"

echo " SUB_TOTAL: $( echo "scale=2; ($VOL_SIZE - $SNAP_SIZE) / 1024 / 1024 / 1024" | bc )G"

echo

echo " - TOTAL_LUN_SIZE: $( echo "scale=2; $LUN_SIZE_TOTAL / 1024 / 1024 / 1024" | bc )G"

echo " SUB_TOTAL: $( echo "scale=2; ($VOL_SIZE - $SNAP_SIZE - $LUN_SIZE_TOTAL) / 1024 / 1024 / 1024" | bc )G"

echo

echo " MISSING_SPACE:"

DIFFERENCE_VOL_LUN="$( echo "scale=2; ($VOL_SIZE - $SNAP_SIZE - $LUN_SIZE_TOTAL)" | bc | sed "s,-,," )"

echo " DIFFERENCE_VOL_LUN: $( echo "scale=2; $DIFFERENCE_VOL_LUN / 1024 / 1024 / 1024" | bc )G"

echo " + VOL_RESERVE: $( echo "scale=2; $VOL_RESERVE / 1024 / 1024 / 1024" | bc )G"

echo " SUB_TOTAL: $( echo "scale=2; ($DIFFERENCE_VOL_LUN + $VOL_RESERVE) / 1024 / 1024 / 1024" | bc )G"

echo

done

And with that you have a list of volumes, with the amount of space they need to resized in order to accomodate the contained LUNs and the snapshots.

Convert a bunch of PDF documents to JPEG

February 15, 2012February 15, 2012 Christian Leave a comment

Well, I found a bunch of PDF documents on my disk today, which I wanted converted to JPEG. Now, Debian replaced ImageMagick in the past for GraphicsMagick, which is supposedly a bit faster and leaner than ImageMagick. So first you need to install graphicsmagick — or rewrite the script to use /usr/bin/convert instead.

The script basically takes every .PDF you have in your current working directory, creates a sub-directory, and then extracts each page of the PDF into a single JPEG image in that subdirectory.

#!/bin/bash

# Needs graphicsmagick
[ ! -x /usr/bin/gm ] && exit 1

for file in $PWD/*.pdf; do
        sudo mkdir $PWD/${file%*.pdf}
        sudo chown -R nobody.users $PWD/${file%*.pdf}
        sudo gm convert $PWD/$file 
           JPEG:"$PWD/${file%*.pdf}/${file%*.pdf}%02d.jpg"

        number="$( echo ${file%*.pdf} | cut -d. -f3 )"
        title="$( echo ${file%*.pdf} | cut -d. -f4 | sed "s,., ," )"
        series="$( echo ${file%*.pdf} | cut -d. -f1-2 | sed "s,., ," )"

        # Create the ComicInfo.xml file
        cat << EOF | sudo tee ${file%*.pdf}/ComicInfo.xml &amp;>/dev/null
<?xml version="1.0"?>
<ComicInfo xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
  <Series>$series</Series>
  <Number>$number</Number>
  <Title>$title</Title>
</ComicInfo>
EOF

done

#!/bin/bash

# Needs graphicsmagick

[ ! -x /usr/bin/gm ] && exit 1

for file in $PWD/*.pdf; do

sudo mkdir $PWD/${file%*.pdf}

sudo chown -R nobody.users $PWD/${file%*.pdf}

sudo gm convert $PWD/$file

JPEG:"$PWD/${file%*.pdf}/${file%*.pdf}%02d.jpg"

number="$( echo ${file%*.pdf} | cut -d. -f3 )"

title="$( echo ${file%*.pdf} | cut -d. -f4 | sed "s,., ," )"

series="$( echo ${file%*.pdf} | cut -d. -f1-2 | sed "s,., ," )"

# Create the ComicInfo.xml file

cat << EOF | sudo tee ${file%*.pdf}/ComicInfo.xml &>/dev/null

<?xml version="1.0"?>

<Series>$series</Series>

<Number>$number</Number>

<Title>$title</Title>

</ComicInfo>

EOF

done

What I had to google for was basically on how to actually pad the output number. According to the man-page of gm, you just put %02d (or %03d, depending on how much pages your PDFs have at the max) in the desired output file name.

Handling files/directories with spaces in `for’-loops

July 7, 2007July 7, 2007 Christian 2 Comments

So I have one or the other file, that needs to be extracted to a directory. And why not name it as the archive itself .. Only problem with it is the handling of variables with bash …

Try it yourself, stuff some directories with a space in inside a variables, and use something like this:

epimetheus tmp [0] $ mkdir files
epimetheus tmp [0] $ touch files/"I hate directories.archive" files/"Me luuv you looong time.archive"
epimetheus tmp [0] $ for i in $( /bin/ls --color=none files/ ); do mkdir "${i/.archive/}"; done

epimetheus tmp [0] $ mkdir files

epimetheus tmp [0] $ touch files/"I hate directories.archive" files/"Me luuv you looong time.archive"

epimetheus tmp [0] $ for i in $( /bin/ls --color=none files/ ); do mkdir "${i/.archive/}"; done

And now take a look at the output of that ..

epimetheus tmp [0] $ ls
I/  Me/  directories/  files/  hate/  looong/  luuv/  time/  you/

1 2	epimetheus tmp [0] $ ls I/ Me/ directories/ files/ hate/ looong/ luuv/ time/ you/

Means, the mkdir' created a directory for every entry in the ls‘ output that was separated by a space char … and I’ve no frickin clue on how to get that thing right … 😡

Update:
Thanks to Roy I know how one handles such things … 😳 It’s rather simple *g*

epimetheus tmp [0] $ for i in files/*; do mkdir "$( basename "${i/.archive/}" )"; done

1	epimetheus tmp [0] $ for i in files/*; do mkdir "$( basename "${i/.archive/}" )"; done

That should give you the desired effect ❗