November 2013

One of my co-workers recently approached me, that he needed a simple shell script which would generate a simple report about a Vserver’s current connections. After ironing out a few things with him (he had the intention of it being on a CIFS share on our file-server – which I changed to a simple HTML page) I went to work.

Out came two scripts. One is the collection instance, and the other is the processing instance. First the collection script runs, finds the current HA master node and then collects the Vserver’s current connections. After that script has dumped the information (date, time, current connections) into a file, the processing script will go and create a simple HTML page that’ll show exactly those informations.

You’ll also need to have configured the public key authentification on both HA nodes, since entering a password in combination with scripting is a bit lame.

#!/bin/bash

IDENTITY_FILE="/root/.ssh/netscaler"
NS_USER="nsroot"
NS_HOST="$1"
NS_VSERVER="$2"

if [ -z "$2" ] ; then
	echo "Usage: ns-gather-connections.sh <IP/HOSTNAME> <VSERVER_NAME>"
	echo ""
	echo "    o IP/HOSTNAME     -  IP or Hostname of the NetScaler"
	echo "    o VSERVER_NAME    -  Name of the NetScaler vServer"
	echo ""
	exit 1
fi

ns_ssh() {
	COMMANDS="$@"
	ssh -i $IDENTITY_FILE $NS_USER@$NS_HOST $COMMANDS
}

# Get HA information from the NetScaler and check if the current IP is the Master
NS_NODE_STATUS="$( ns_ssh sh ha node | egrep -A2 "IP:.*$NS_HOST" | grep Master | \
	awk '{ print $3 }' )"

if [ "$NS_NODE_STATUS" != "Primary" ] ; then
	# Search for the Primary node
	NS_MASTER_NODE="$( ns_ssh sh ha node | egrep -B2 "Master State: Primary" | \
		grep "IP: " | awk '{ print $2 }' )"
	NS_HOST=$NS_MASTER_NODE

elif [ "$NS_NODE_STATUS" == "Primary" ] ; then
	NS_MASTER_NODE="$NS_HOST"
	NS_HOST=$NS_MASTER_NODE
fi

# Check the connection table
NS_CONNTABLE="$( ns_ssh "sh ns connectiontable \"VSVRNAME = ${NS_VSERVER}\" -detail LINK" | grep 'ESTABLISHED' | wc -l )"

echo "`date '+%F_%R'`;$NS_CONNTABLE" >> /srv/www/${NS_VSERVER}_conntable.log

#!/bin/bash

IDENTITY_FILE="/root/.ssh/netscaler"

NS_USER="nsroot"

NS_HOST="$1"

NS_VSERVER="$2"

if [ -z "$2" ] ; then

echo "Usage: ns-gather-connections.sh <IP/HOSTNAME> <VSERVER_NAME>"

echo ""

echo " o IP/HOSTNAME - IP or Hostname of the NetScaler"

echo " o VSERVER_NAME - Name of the NetScaler vServer"

echo ""

exit 1

ns_ssh() {

COMMANDS="$@"

ssh -i $IDENTITY_FILE $NS_USER@$NS_HOST $COMMANDS

}

# Get HA information from the NetScaler and check if the current IP is the Master

NS_NODE_STATUS="$( ns_ssh sh ha node | egrep -A2 "IP:.*$NS_HOST" | grep Master | \

awk '{ print $3 }' )"

if [ "$NS_NODE_STATUS" != "Primary" ] ; then

# Search for the Primary node

NS_MASTER_NODE="$( ns_ssh sh ha node | egrep -B2 "Master State: Primary" | \

grep "IP: " | awk '{ print $2 }' )"

NS_HOST=$NS_MASTER_NODE

elif [ "$NS_NODE_STATUS" == "Primary" ] ; then

NS_MASTER_NODE="$NS_HOST"

NS_HOST=$NS_MASTER_NODE

# Check the connection table

NS_CONNTABLE="$( ns_ssh "sh ns connectiontable \"VSVRNAME = ${NS_VSERVER}\" -detail LINK" | grep 'ESTABLISHED' | wc -l )"

echo "`date '+%F_%R'`;$NS_CONNTABLE" >> /srv/www/${NS_VSERVER}_conntable.log

#!/bin/bash

NS_VSERVER="$1"
HTML_FILE="/srv/www/htdocs/${NS_VSERVER}.html"

cat > $HTML_FILE << EOF
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"
	"http://www.w3.org/TR/html4/loose.dtd">
<html>
<head>
	<title>$NS_VSERVER - Anzahl Clients nach Datum</title>
	<style>
	.ns {
		margin:0px;padding:0px;
		width:100%;
		border:1px solid #000000;
		-moz-border-radius-bottomleft:0px;
		-webkit-border-bottom-left-radius:0px;
		border-bottom-left-radius:0px;
		-moz-border-radius-bottomright:0px;
		-webkit-border-bottom-right-radius:0px;
		border-bottom-right-radius:0px;
		-moz-border-radius-topright:0px;
		-webkit-border-top-right-radius:0px;
		border-top-right-radius:0px;
		-moz-border-radius-topleft:0px;
		-webkit-border-top-left-radius:0px;
		border-top-left-radius:0px;
	}.ns table{
		border-collapse: collapse;
		border-spacing: 0;
		width:100%;
		height:100%;
		margin:0px;padding:0px;
	}.ns th{
		font-size:14px;
		font-family:Verdana;
		font-weight:bold;
		border:1px solid #000000;
		border-width:0px 1px 1px 0px;
		text-align:left;
		padding:7px;
	}.ns tr:last-child td:last-child {
		-moz-border-radius-bottomright:0px;
		-webkit-border-bottom-right-radius:0px;
		border-bottom-right-radius:0px;
	}
	.ns table tr:first-child td:first-child {
		-moz-border-radius-topleft:0px;
		-webkit-border-top-left-radius:0px;
		border-top-left-radius:0px;
	}
	.ns table tr:first-child td:last-child {
		-moz-border-radius-topright:0px;
		-webkit-border-top-right-radius:0px;
		border-top-right-radius:0px;
	}.ns tr:last-child td:first-child{
		-moz-border-radius-bottomleft:0px;
		-webkit-border-bottom-left-radius:0px;
		border-bottom-left-radius:0px;
	}.ns tr:hover td{

	}
	.ns tr:nth-child(odd){ background-color:#aad4ff; }
	.ns tr:nth-child(even)    { background-color:#ffffff; }.ns td{
		vertical-align:middle;
		border:1px solid #000000;
		border-width:0px 1px 1px 0px;
		text-align:left;
		padding:7px;
		font-size:14px;
		font-family:Verdana;
		font-weight:normal;
		color:#000000;
	}.ns tr:last-child td{
		border-width:0px 1px 0px 0px;
	}.ns tr td:last-child{
		border-width:0px 0px 1px 0px;
	}.ns tr:last-child td:last-child{
		border-width:0px 0px 0px 0px;
	}
	.ns tr:first-child td{
			background:-o-linear-gradient(bottom, #005fbf 5%, #003f7f 100%);	background:-webkit-gradient( linear, left top, left bottom, color-stop(0.05, #005fbf), color-stop(1, #003f7f) );
		background:-moz-linear-gradient( center top, #005fbf 5%, #003f7f 100% );
		filter:progid:DXImageTransform.Microsoft.gradient(startColorstr="#005fbf", endColorstr="#003f7f");	background: -o-linear-gradient(top,#005fbf,003f7f);
		background-color:#005fbf;
		border:0px solid #000000;
		text-align:center;
		border-width:0px 0px 1px 1px;
		font-size:14px;
		font-family:Verdana;
		font-weight:bold;
		color:#ffffff;
	}
	.ns tr:first-child:hover td{
		background:-o-linear-gradient(bottom, #005fbf 5%, #003f7f 100%);	background:-webkit-gradient( linear, left top, left bottom, color-stop(0.05, #005fbf), color-stop(1, #003f7f) );
		background:-moz-linear-gradient( center top, #005fbf 5%, #003f7f 100% );
		filter:progid:DXImageTransform.Microsoft.gradient(startColorstr="#005fbf", endColorstr="#003f7f");	background: -o-linear-gradient(top,#005fbf,003f7f);
		background-color:#005fbf;
	}
	.ns tr:first-child td:first-child{
		border-width:0px 0px 1px 0px;
	}
	.ns tr:first-child td:last-child{
		border-width:0px 0px 1px 1px;
	}
	</style>
</head>
<body>

<h3>NetScaler Vserver $NS_VSERVER - sortiert nach Datum</h1>

<div class="ns">
	<table border="1">
		<tr>
			<th>Datum</th>
			<th>Zeit</th>
			<th>Anzahl Clients</th>
		</tr>
EOF

for line in $( tac /srv/www/${NS_VSERVER}_conntable.log ); do
	DATE="$( echo $line | cut -d\; -f1 | cut -d_ -f1 )"
	TIME="$( echo $line | cut -d\; -f1 | cut -d_ -f2 )"
	CONNECTIONS="$( echo $line | cut -d\; -f2 )"

	cat >> $HTML_FILE << EOF
		<tr>
			<td>$DATE</td>
			<td>$TIME</td>
			<td>$CONNECTIONS</td>
		</tr>
EOF
done

cat >> $HTML_FILE << EOF
</div>
</body>
</html>
EOF

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

#!/bin/bash

NS_VSERVER="$1"

HTML_FILE="/srv/www/htdocs/${NS_VSERVER}.html"

cat > $HTML_FILE << EOF

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"

"http://www.w3.org/TR/html4/loose.dtd">

<html>

<head>

<title>$NS_VSERVER - Anzahl Clients nach Datum</title>

<style>

.ns {

margin:0px;padding:0px;

width:100%;

border:1px solid #000000;

-moz-border-radius-bottomleft:0px;

-webkit-border-bottom-left-radius:0px;

border-bottom-left-radius:0px;

-moz-border-radius-bottomright:0px;

-webkit-border-bottom-right-radius:0px;

border-bottom-right-radius:0px;

-moz-border-radius-topright:0px;

-webkit-border-top-right-radius:0px;

border-top-right-radius:0px;

-moz-border-radius-topleft:0px;

-webkit-border-top-left-radius:0px;

border-top-left-radius:0px;

}.ns table{

border-collapse: collapse;

border-spacing: 0;

width:100%;

height:100%;

margin:0px;padding:0px;

}.ns th{

font-size:14px;

font-family:Verdana;

font-weight:bold;

border:1px solid #000000;

border-width:0px 1px 1px 0px;

text-align:left;

padding:7px;

}.ns tr:last-child td:last-child {

-moz-border-radius-bottomright:0px;

-webkit-border-bottom-right-radius:0px;

border-bottom-right-radius:0px;

}

.ns table tr:first-child td:first-child {

-moz-border-radius-topleft:0px;

-webkit-border-top-left-radius:0px;

border-top-left-radius:0px;

}

.ns table tr:first-child td:last-child {

-moz-border-radius-topright:0px;

-webkit-border-top-right-radius:0px;

border-top-right-radius:0px;

}.ns tr:last-child td:first-child{

-moz-border-radius-bottomleft:0px;

-webkit-border-bottom-left-radius:0px;

border-bottom-left-radius:0px;

}.ns tr:hover td{

}

.ns tr:nth-child(odd){ background-color:#aad4ff; }

.ns tr:nth-child(even) { background-color:#ffffff; }.ns td{

vertical-align:middle;

border:1px solid #000000;

border-width:0px 1px 1px 0px;

text-align:left;

padding:7px;

font-size:14px;

font-family:Verdana;

font-weight:normal;

color:#000000;

}.ns tr:last-child td{

border-width:0px 1px 0px 0px;

}.ns tr td:last-child{

border-width:0px 0px 1px 0px;

}.ns tr:last-child td:last-child{

border-width:0px 0px 0px 0px;

}

.ns tr:first-child td{

background:-o-linear-gradient(bottom, #005fbf 5%, #003f7f 100%); background:-webkit-gradient( linear, left top, left bottom, color-stop(0.05, #005fbf), color-stop(1, #003f7f) );

background:-moz-linear-gradient( center top, #005fbf 5%, #003f7f 100% );

filter:progid:DXImageTransform.Microsoft.gradient(startColorstr="#005fbf", endColorstr="#003f7f"); background: -o-linear-gradient(top,#005fbf,003f7f);

background-color:#005fbf;

border:0px solid #000000;

text-align:center;

border-width:0px 0px 1px 1px;

font-size:14px;

font-family:Verdana;

font-weight:bold;

color:#ffffff;

}

.ns tr:first-child:hover td{

background:-o-linear-gradient(bottom, #005fbf 5%, #003f7f 100%); background:-webkit-gradient( linear, left top, left bottom, color-stop(0.05, #005fbf), color-stop(1, #003f7f) );

background:-moz-linear-gradient( center top, #005fbf 5%, #003f7f 100% );

filter:progid:DXImageTransform.Microsoft.gradient(startColorstr="#005fbf", endColorstr="#003f7f"); background: -o-linear-gradient(top,#005fbf,003f7f);

background-color:#005fbf;

}

.ns tr:first-child td:first-child{

border-width:0px 0px 1px 0px;

}

.ns tr:first-child td:last-child{

border-width:0px 0px 1px 1px;

}

</style>

</head>

<body>

<h3>NetScaler Vserver $NS_VSERVER - sortiert nach Datum</h1>

<tr>

<th>Datum</th>

<th>Anzahl Clients</th>

</tr>

EOF

for line in $( tac /srv/www/${NS_VSERVER}_conntable.log ); do

DATE="$( echo $line | cut -d\; -f1 | cut -d_ -f1 )"

TIME="$( echo $line | cut -d\; -f1 | cut -d_ -f2 )"

CONNECTIONS="$( echo $line | cut -d\; -f2 )"

cat >> $HTML_FILE << EOF

<tr>

<td>$CONNECTIONS</td>

</tr>

EOF

done

cat >> $HTML_FILE << EOF

</div>

</body>

</html>

EOF

Well, I’ve been fiddling around with SLES and openSUSE VMware templates. I know it’s a stupid idea when you have a PXE server from which you could install this in a matter of minutes (seriously the SLES PXE installation takes about 5 minutes).

However, when dealing with DMZ’s (yeah, they exist!) you usually don’t have any PXE servers there. So I decided to go with simple VMware templates (like we do with Windows already), but had to iron out a few kinks.

There’s no way to run a set of scripts after the deployment scripts from VMware have been run
The hostname isn’t changed everywhere (/etc/postfix/main.cf for example)

So of I went and wrote a short (70 line ..) init script, which will do exactly that.

#!/bin/sh
#
# /etc/init.d/template-deploy
#
### BEGIN INIT INFO
# Provides:             template-deploy
# Required-Start:       $sshd
# Should-Start:
# Required-Stop:        $sshd
# Should-Stop:
# Default-Start:        2 3 5
# Default-Stop:
# Short-Description:    Makes the final adjustments when deployed a template
# Description:          VMware has a few kinks when deploying a linux template.
#                       This init script will handle those kinks and
#                       incorporate the necessary changes to the final system
#                       after the VMware customizations are done.
### END INIT INFO

# Source LSB init functions
. /etc/rc.status

rc_reset

LOGFILES="/var/log/messages* /var/log/mail* /var/log/zypper.log /var/log/localmessages /var/log/warn /var/log/NetworkManager /var/log/zypp/history /var/log/clamd.log /var/log/cksquid.log /var/log/ftp-proxy.log* /var/log/apache2/*_log /var/log/squid/*.log /var/log/pbl.log"

case "$1" in
	start)
		# Read /etc/HOSTNAME and check it against /etc/template
		if [ -f /etc/HOSTNAME -a -f /etc/template ] ; then
			SYS_HOSTNAME="`cat /etc/HOSTNAME`"
			TPL_HOSTNAME="`cat /etc/template`"

			# Only if the hostname isn't like the template name
			# the script will actually run.
			if [ "$SYS_HOSTNAME" != "$TPL_HOSTNAME" ] ; then
				sed -i "s/$TPL_HOSTNAME/$SYS_HOSTNAME/g" \
					/etc/postfix/main.cf /etc/hosts \
					/etc/HOSTNAME

					bash /var/adm/autoinstall/scripts/configure_users.sh

					# Stop services for logfile deletion.
					systemctl stop postfix
					systemctl stop syslog

					# Remove log files
					for file in $LOGFILES; do
						rm -f $file
					done

					rm -f /var/log/YaST2/*
					rm -rf /var/log/vmware-imc

					# Remove the init script
					chkconfig -d template-deploy
					rm -f /etc/template
					rm -f /etc/init.d/template-deploy
				fi
			fi
			rc_status -v
			;;
        *)
			;;
esac
rc_exit

#!/bin/sh

# /etc/init.d/template-deploy

### BEGIN INIT INFO

# Provides: template-deploy

# Required-Start: $sshd

# Should-Start:

# Required-Stop: $sshd

# Should-Stop:

# Default-Start: 2 3 5

# Default-Stop:

# Short-Description: Makes the final adjustments when deployed a template

# Description: VMware has a few kinks when deploying a linux template.

# This init script will handle those kinks and

# incorporate the necessary changes to the final system

# after the VMware customizations are done.

### END INIT INFO

# Source LSB init functions

. /etc/rc.status

rc_reset

LOGFILES="/var/log/messages* /var/log/mail* /var/log/zypper.log /var/log/localmessages /var/log/warn /var/log/NetworkManager /var/log/zypp/history /var/log/clamd.log /var/log/cksquid.log /var/log/ftp-proxy.log* /var/log/apache2/*_log /var/log/squid/*.log /var/log/pbl.log"

case "$1" in

start)

# Read /etc/HOSTNAME and check it against /etc/template

if [ -f /etc/HOSTNAME -a -f /etc/template ] ; then

SYS_HOSTNAME="`cat /etc/HOSTNAME`"

TPL_HOSTNAME="`cat /etc/template`"

# Only if the hostname isn't like the template name

# the script will actually run.

if [ "$SYS_HOSTNAME" != "$TPL_HOSTNAME" ] ; then

sed -i "s/$TPL_HOSTNAME/$SYS_HOSTNAME/g" \

/etc/postfix/main.cf /etc/hosts \

/etc/HOSTNAME

bash /var/adm/autoinstall/scripts/configure_users.sh

# Stop services for logfile deletion.

systemctl stop postfix

systemctl stop syslog

# Remove log files

for file in $LOGFILES; do

rm -f $file

done

rm -f /var/log/YaST2/*

rm -rf /var/log/vmware-imc

# Remove the init script

chkconfig -d template-deploy

rm -f /etc/template

rm -f /etc/init.d/template-deploy

rc_status -v

;;

esac

rc_exit

You’ll also need to create a file (/etc/template), which’ll hold the template’s hostname and will be used for the comparison if VMware’s post-processing is already finished.

Month: November 2013

NetScaler: Generate a simple usage statistic per Vserver

VMware templates: post-processing for SUSE Linux Enterprise Server and openSUSE