TS3500 – BAFM

Well, after yesterday’s episode with our tape library today continued to be a taxing day. After restarting a few exports that were hanging yesterday due to our library problems, something similar returned. TSM was unable to locate a few (two to be exact) tapes in the library.

ANR8300E I/O error on library LIB3584 (OP=00006C03, CC=314, KEY=05, ASC=3B,
ASCQ=0E, SENSE=70.00.05.00.00.00.00.0A.00.00.00.00.3B.0E.00.C0.00-.04.,
Description=The source slot or drive was empty in an attempt to move a
volume). Refer to Appendix C in the 'Messages' manual for recommended action.
ANR8312E Volume 000400 could not be located in library LIB3584.
ANR8358E Audit operation is required for library LIB3584.
ANR8381E LTO volume 000400 could not be mounted in drive DR6 (/dev/rmt0).
ANR1402W Mount request denied for volume 000400 - volume unavailable.
ANR1410W Access mode for volume 000400 now set to "unavailable".

ANR8300E I/O error on library LIB3584 (OP=00006C03, CC=314, KEY=05, ASC=3B,

ASCQ=0E, SENSE=70.00.05.00.00.00.00.0A.00.00.00.00.3B.0E.00.C0.00-.04.,

Description=The source slot or drive was empty in an attempt to move a

volume). Refer to Appendix C in the 'Messages' manual for recommended action.

ANR8312E Volume 000400 could not be located in library LIB3584.

ANR8358E Audit operation is required for library LIB3584.

ANR8381E LTO volume 000400 could not be mounted in drive DR6 (/dev/rmt0).

ANR1402W Mount request denied for volume 000400 - volume unavailable.

ANR1410W Access mode for volume 000400 now set to "unavailable".

Yet the library reported the tapes were still inventoried. *shrug* Here we are again, looking completely baffled. After a short while trying to figure out what to do, we went through the Data Cartridge inventory again. As it turns out, through putting the library in “Pause”-Mode and restarting TSM multiple times, TSM apparently completely forgot that it had these tapes put into drives.

After manually moving the tapes back to their home slot via the management interface of the TS3500 and setting the volume access mode back to read-write, everything is fine now I could finish my pending exports!

Well, today we had a rather weird problem with our TS3500. TSM running on AIX basically went bonko and spit out weird media sense errors, all stating that there is a hardware or media error of unknown nature:

ANR8943E Hardware or media error on library LIB3584 (OP=00006C03, CC=-1,
KEY=04, ASC=44, ASCQ=00,
SENSE=70.00.04.00.00.00.00.46.00.00.00.00.44.00.00.00.00-
     .00.40.82.00.00.00.40.00.00.02.00.48.01.A1.00.00.00.00.0-
      0.06.1B.00.01.09.00.00.00.00.00.00.00.00.00.00.00.00.00.-
      00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00-
     .00.00.00.00.00., Description=An undetermined error has occurred).
Refer to Appendix C in the &#039;Messages&#039; manual for recommended action.
ANR8381E LTO volume HG4480L4 could not be mounted in drive DR9 (/dev/rmt8).

ANR8943E Hardware or media error on library LIB3584 (OP=00006C03, CC=-1,

KEY=04, ASC=44, ASCQ=00,

SENSE=70.00.04.00.00.00.00.46.00.00.00.00.44.00.00.00.00-

.00.40.82.00.00.00.40.00.00.02.00.48.01.A1.00.00.00.00.0-

0.06.1B.00.01.09.00.00.00.00.00.00.00.00.00.00.00.00.00.-

00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00.00-

.00.00.00.00.00., Description=An undetermined error has occurred).

Refer to Appendix C in the 'Messages' manual for recommended action.

ANR8381E LTO volume HG4480L4 could not be mounted in drive DR9 (/dev/rmt8).

After restarting the TSM server (as in the service, not the whole box) five times, which didn’t resolve squat we decided to take a look at the TS3500 itself. We opened up the Management interface and tried moving a tape into a drive. That didn’t work. Hrmmmmm.

We tried the manual move from the LCD display mounted on the front of the TS3500 base frame, that didn’t work either. So we figured the gripper was stuck and placed a call with our trustworthy support provider.

After a few minutes, they called us back and told us: “Try the following: Place the library in “Pause”-Mode and open it up, maybe a tape fell down …“.

We did exactly that, the gripper moved back to it’s pause position (which is in the base frame), and we started looking inside after opening up the base frame and an expansion frame. Nothing …

So we closed it back up, and let the base frame resume it’s normal duties … guess what: After resuming normal operations, it worked again *shrug*

S	M	T	W	T	F	S
	1	2	3	4	5	6
7	8	9	10	11	12	13
14	15	16	17	18	19	20
21	22	23	24	25	26	27
28	29	30	31

Tag: TS3500

Weird TS3500 problem: redux

Weird TS3500 problem