I always forget the NetApp drive definitions so i thought I would post the example I found here so I can recall it later. If any of you wondered which definition TSM uses or would like to know why here is your answer:
rst4l - rewind device, format is: H Format 30 GB
nrst4l - no rewind device, format is: H Format 30 GB
urst4l - unload/reload device, format is: H Format 30 GB
rst4m - rewind device, format is: H Format 30 GB
nrst4m - no rewind device, format is: H Format 30 GB
urst4m - unload/reload device, format is: H Format 30 GB
rst4h - rewind device, format is: H Format 30 GB
nrst4h - no rewind device, format is: H Format 30 GB
urst4h - unload/reload device, format is: H Format 30 GB
rst4a - rewind device, format is: H Format 60 GB comp
nrst4a - no rewind device, format is: H Format 60 GB comp
urst4a - unload/reload device, format is: H Format 60 GB comp
The one is red is the definition TSM uses since it rewinds the tape, but leaves the unload/reload to TSM and not the device itself.
Wednesday, October 24, 2007
Friday, October 19, 2007
FilesX Xpress Restore & TSM
If you click the title of this post you can read the news article that explains this new tool that has been validated to work with TSM. It provides a block level disk backup of application data allowing TSM to work with the Xpress Restore repository enhancing the speed of backups...This is one tool I would like more information on so I will be looking into how it works with TSM.
Thursday, October 18, 2007
Good De-Deuplication Questions
An anonymous reader posted the following comments about the De-Duplication post a few days ago which I thought were good enough to post on the main page and let everyone read them. In the future I hope more of you would post with your name so we can give credit where credit is due. Anyone currently using a De-Duplication product, we would love to hear from you.
I have serveral issues with Backup and DeDupe (most of which are TSM related).
First of, why are people retaining so much data within TSM (i.e. the retention period is increasing). TSM is something that is supposed to be used in response to a data loss event. In other words, data is lost either through hardware failure, logical failure or because of human error and we turn to TSM to recover it.. but an increasing number of people are using it as a filing cabinet for data placing infinite retention on data. I don't think TSM was truly designed to do this. I see this as more of data management function akin to HSM and Archiving.. Yes, TSM has archiving but I think it's pretty weak in terms of functionality, it really needs to be married to an application that can do better indexing and classification in order to make this powerful.
So.. if the data you are storing within TSM cannot truly be used to support a data recovery function, then why keep it? Are you really going to restore a file from 180days ago because someone suddenly discovered that they deleted a file 4 months ago that they now need. I haven't seen much of that, occurences are typically rare.. yet the outlay to stay consistent on such a policy could be expensive. Forget about just the cost of the media - there's much more to it than that.
DeDupe becomes more efficient when you retain more data in the backups, but more versions = bigger TSM DB which often means that you have to spawn another TSM server to keep things well maintained.
In TSM land we're very conscious of the TSM DB.. It's the heart of the system and we go to great lengths to improve it's performance and protect it. In the event that it does become corrupt we can roll it back using TSM DB backup and Reuse delay. The DeDupe engine must also have a index/db.. what do we do if it becomes corrupt? If it does, how do we insure that we can get it synched up with TSM again?
How well will DeDupe work when data is reclaimed? TSM rebuilds aggregates when data is reclaimed, so how much work is that for the DeDupe engine and what's the I/O pattern going to be like on the back end storage.
How does this work in terms of recovery both operationaly and in terms of a disaster? Single file restores, probably great. Recovery of lots of files, probably not too bad.. when recovering lots of small files the client is typically the bottleneck.. not sure that the dedupe engine would impact it much. What about recovery of a large DB? This one I am more skeptical of. We can get great performance from both tape or disk.. potentially the best performance from tape provided that we can get enough mount points and the client isn't bottlenecked in some way. But what if it's deduped on disk.. will the data stream from disk or will we get more random I/O patterns. If it's a 10TB that needs to be recovered, I think that still equates to 10TB that needs to be pushed through TSM, even if it's been deduped to 2TB on the physical disk behind the dedupe engine.
What about DR where you want to recover multiple clients at the same time. Good storage pool design can alleviate some of the issues with tape contention, disk may offer some advantages because the media supports concurrent access (but bear in mind that TSM may not - depending on how you configured it).. If that disk is deduped though, then potentially you have less spindles at your disposal. That could mean more I/O contention and perhaps more difficulty in streaming data.
I have serveral issues with Backup and DeDupe (most of which are TSM related).
First of, why are people retaining so much data within TSM (i.e. the retention period is increasing). TSM is something that is supposed to be used in response to a data loss event. In other words, data is lost either through hardware failure, logical failure or because of human error and we turn to TSM to recover it.. but an increasing number of people are using it as a filing cabinet for data placing infinite retention on data. I don't think TSM was truly designed to do this. I see this as more of data management function akin to HSM and Archiving.. Yes, TSM has archiving but I think it's pretty weak in terms of functionality, it really needs to be married to an application that can do better indexing and classification in order to make this powerful.
So.. if the data you are storing within TSM cannot truly be used to support a data recovery function, then why keep it? Are you really going to restore a file from 180days ago because someone suddenly discovered that they deleted a file 4 months ago that they now need. I haven't seen much of that, occurences are typically rare.. yet the outlay to stay consistent on such a policy could be expensive. Forget about just the cost of the media - there's much more to it than that.
DeDupe becomes more efficient when you retain more data in the backups, but more versions = bigger TSM DB which often means that you have to spawn another TSM server to keep things well maintained.
In TSM land we're very conscious of the TSM DB.. It's the heart of the system and we go to great lengths to improve it's performance and protect it. In the event that it does become corrupt we can roll it back using TSM DB backup and Reuse delay. The DeDupe engine must also have a index/db.. what do we do if it becomes corrupt? If it does, how do we insure that we can get it synched up with TSM again?
How well will DeDupe work when data is reclaimed? TSM rebuilds aggregates when data is reclaimed, so how much work is that for the DeDupe engine and what's the I/O pattern going to be like on the back end storage.
How does this work in terms of recovery both operationaly and in terms of a disaster? Single file restores, probably great. Recovery of lots of files, probably not too bad.. when recovering lots of small files the client is typically the bottleneck.. not sure that the dedupe engine would impact it much. What about recovery of a large DB? This one I am more skeptical of. We can get great performance from both tape or disk.. potentially the best performance from tape provided that we can get enough mount points and the client isn't bottlenecked in some way. But what if it's deduped on disk.. will the data stream from disk or will we get more random I/O patterns. If it's a 10TB that needs to be recovered, I think that still equates to 10TB that needs to be pushed through TSM, even if it's been deduped to 2TB on the physical disk behind the dedupe engine.
What about DR where you want to recover multiple clients at the same time. Good storage pool design can alleviate some of the issues with tape contention, disk may offer some advantages because the media supports concurrent access (but bear in mind that TSM may not - depending on how you configured it).. If that disk is deduped though, then potentially you have less spindles at your disposal. That could mean more I/O contention and perhaps more difficulty in streaming data.
Tivoli's October "Valuable Support Info" E-mail
Are you subscribing to IBM/Tivoli's Valuable Support Information E-mail? If not take the time to subscribe because the links, notices, and information are worth the few minutes it takes. For those of you not subscribing yet here it is in its entirety.
Welcome to the IBM Tivoli Storage Manager (TSM) technical support information update. This communication is designed to help you derive maximum value from your TSM software by providing the most up-to-date technical information, answers to frequently asked questions, and links to other key information. Please take a moment to read through the materials provided below. We are sure that you will find answers to many of your questions. This month's mailing has five main sections:
To Unsubscribe: Please reply to this email and change the Subject field to 'unsubscribe.'
To Subscribe: Please reply to this email and change the Subject field to 'subscribe.'
=========================================================================
Frequently Encountered Situations and FAQs
Title: TSM Journal Based Backup FAQ
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21155524
Title: Library fails with ANR8840E and ANR8418E
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21218357
Title: Replacing a damaged primary storage pool volume
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21219227
Title: Windows 2003 Volume Shadow Copy Service (VSS) Hotfixes for Systemstate Backup
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21242128
Title: IBM Tivoli Storage Manager Administration Center Requirements
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21195062
Title: Overview - Tivoli Storage Manager Supported Operating Systems
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21243309
Title: Upgrade Instructions - Tivoli Storage Manager (TSM) 5.2 to 5.4 or 5.2 to 5.3 Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21251665
Title: MustGather: Read First for Tivoli Storage Manager Products
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21263547
Title: Guideline For Selecting The Appropriate IBM Tape Device Driver for Windows 2000
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21268024
Title: IBM Ultrium Generation 4 (LTO-4) drive and drive encryption support
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg27009625
News & Technical Flashes
Title: URGENT Actions Required: Changes to Daylight Saving Time will affect IBM Tivoli Storage Manager Administrative Interfaces
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21254129
Title: Backupsets should not be used to store Data Protection client or API client data
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21268040
Title: Data loss may occur on TSM 5.4 servers when performing off-site reclamation of a copy storage pool and active-data pools are defined
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21268228
Title: Two security vulnerabilities exist in the IBM Tivoli Storage Manager (TSM) client
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21268775
Title: Featured Documents for Tivoli Storage Manager
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg27009872Recent & Important Downloads
Title: Tivoli APAR notification page
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21177831
Title: Recommended TSM Client and Server Fixes
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21247179
Upcoming Events & Live Technical Trainings
Tivoli's Support Technical Exchange web seminars allows you to participate in live discussions on topics such as deployment, trouble-shooting tips, common issues, problem solving resources and other Support and Services recommendations.
To see the connection information for these seminars, as well as ALL Tivoli products just use the main link below.
Link: http://www.ibm.com/software/sysmgmt/products/support/supp_tech_exch.html
Mark your calendars: Here are the current listings for the FREE seminars though December, 2007
10/18/07 TSM Backup Considerations with Nseries
10/23/07 Overview, setup, and usage of NDMP operations
10/23/07 Understanding TSM HSM for Windows
11/06/07 LVSA / Open File Support
11/15/07 Tivoli Storage Manager Update
11/15/07 Ask the Experts call in session: TSM devices for Windows
11/20/07 Installing the Integrated Solutions Console (ISC) and Administration Center
11/29/07 Tuning Disk for use with Tivoli Storage Manager (TSM)
12/06/07 Exploiting Disk Technology with Tivoli Storage Manager
Help us choose future topics for our calls!
If you have ideas for a future discussion topics for TSM or to report problems with viewing content, please send feedback to: isstte@us.ibm.com
Problem-Solving Resources Online
Visit the IBM Tivoli Storage Manager product support page
Link: http://www.ibm.com/software/sysmgmt/products/support/IBMTivoliStorageManager.html IBM Education Assistant for TSM
Short, task-based audio and visual presentations on pertinent topics.
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21236711
Free IBM Support Assistant product plug-in for TSM A desktop tool to aid in your TSM administration.
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg24009958
Self help support info for new Tivoli Storage Manager Administrators
Link: http://www-1.ibm.com/support/docview.wss?rs=663&uid=swg21212718
Complimentary TSM Concepts Poster & Complimentary Online Self-Paced Training Classes
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21217663
Participate in the ADSM.org and ADSM/L forums:
Link: http://www.adsm.org
Welcome to the IBM Tivoli Storage Manager (TSM) technical support information update. This communication is designed to help you derive maximum value from your TSM software by providing the most up-to-date technical information, answers to frequently asked questions, and links to other key information. Please take a moment to read through the materials provided below. We are sure that you will find answers to many of your questions. This month's mailing has five main sections:
- Frequently Encountered Situations and FAQs
- News & Technical Flashes
- Recent & Important Downloads
- Upcoming Events & Live Technical Trainings
- Problem-Solving Resources on our web site
To Unsubscribe: Please reply to this email and change the Subject field to 'unsubscribe.'
To Subscribe: Please reply to this email and change the Subject field to 'subscribe.'
=========================================================================
Frequently Encountered Situations and FAQs
Title: TSM Journal Based Backup FAQ
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21155524
Title: Library fails with ANR8840E and ANR8418E
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21218357
Title: Replacing a damaged primary storage pool volume
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21219227
Title: Windows 2003 Volume Shadow Copy Service (VSS) Hotfixes for Systemstate Backup
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21242128
Title: IBM Tivoli Storage Manager Administration Center Requirements
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21195062
Title: Overview - Tivoli Storage Manager Supported Operating Systems
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21243309
Title: Upgrade Instructions - Tivoli Storage Manager (TSM) 5.2 to 5.4 or 5.2 to 5.3 Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21251665
Title: MustGather: Read First for Tivoli Storage Manager Products
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21263547
Title: Guideline For Selecting The Appropriate IBM Tape Device Driver for Windows 2000
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21268024
Title: IBM Ultrium Generation 4 (LTO-4) drive and drive encryption support
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg27009625
News & Technical Flashes
Title: URGENT Actions Required: Changes to Daylight Saving Time will affect IBM Tivoli Storage Manager Administrative Interfaces
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21254129
Title: Backupsets should not be used to store Data Protection client or API client data
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21268040
Title: Data loss may occur on TSM 5.4 servers when performing off-site reclamation of a copy storage pool and active-data pools are defined
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21268228
Title: Two security vulnerabilities exist in the IBM Tivoli Storage Manager (TSM) client
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21268775
Title: Featured Documents for Tivoli Storage Manager
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg27009872Recent & Important Downloads
Title: Tivoli APAR notification page
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21177831
Title: Recommended TSM Client and Server Fixes
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21247179
Upcoming Events & Live Technical Trainings
Tivoli's Support Technical Exchange web seminars allows you to participate in live discussions on topics such as deployment, trouble-shooting tips, common issues, problem solving resources and other Support and Services recommendations.
To see the connection information for these seminars, as well as ALL Tivoli products just use the main link below.
Link: http://www.ibm.com/software/sysmgmt/products/support/supp_tech_exch.html
Mark your calendars: Here are the current listings for the FREE seminars though December, 2007
10/18/07 TSM Backup Considerations with Nseries
10/23/07 Overview, setup, and usage of NDMP operations
10/23/07 Understanding TSM HSM for Windows
11/06/07 LVSA / Open File Support
11/15/07 Tivoli Storage Manager Update
11/15/07 Ask the Experts call in session: TSM devices for Windows
11/20/07 Installing the Integrated Solutions Console (ISC) and Administration Center
11/29/07 Tuning Disk for use with Tivoli Storage Manager (TSM)
12/06/07 Exploiting Disk Technology with Tivoli Storage Manager
Help us choose future topics for our calls!
If you have ideas for a future discussion topics for TSM or to report problems with viewing content, please send feedback to: isstte@us.ibm.com
Problem-Solving Resources Online
Visit the IBM Tivoli Storage Manager product support page
Link: http://www.ibm.com/software/sysmgmt/products/support/IBMTivoliStorageManager.html IBM Education Assistant for TSM
Short, task-based audio and visual presentations on pertinent topics.
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21236711
Free IBM Support Assistant product plug-in for TSM A desktop tool to aid in your TSM administration.
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg24009958
Self help support info for new Tivoli Storage Manager Administrators
Link: http://www-1.ibm.com/support/docview.wss?rs=663&uid=swg21212718
Complimentary TSM Concepts Poster & Complimentary Online Self-Paced Training Classes
Link: http://www.ibm.com/support/docview.wss?rs=663&uid=swg21217663
Participate in the ADSM.org and ADSM/L forums:
Link: http://www.adsm.org
Wednesday, October 17, 2007
Backupsets & TCopy
OK, I am going to throw a question out into the TSM world and see what you people think. I was asked at work if a Backupset could be copied using the UNIX tcopy command? I thought about it and since Backupsets are independent of the TSM server I would think, in theory, it should. The only issue I could see would be needing to define the copy to TSM, since it would have no record of it. The benefit would be that I would not need to mount the tapes all over again to run the Backupset. The reason I ask is that a customer wanted two copies of a full backup of a server to archive forever. Anyone ever tried it, any theories? They are all welcome!
New! Free training for TSM v5.4 ISC
If you use the ISC (even though it wastes more time than it saves) you can get some free training from IBM. The trainings cover:
- Installing the Admin Center
- Using the Admin Center
- Managing ISC users and TSM admins
TSM 5.1 Flash!
This flash was posted by IBM on Sept. 25, 2007:
Customers running IBM Tivoli Storage Manager (TSM) 5.1.6 Windows, HP, Sun, AIX and Linux and using devices other than 3570, 3590, or IBM LTO may have problems with the automatic labeling of tapes by the TSM server.
You can click on the title of this post to see the IBM page.
Customers running IBM Tivoli Storage Manager (TSM) 5.1.6 Windows, HP, Sun, AIX and Linux and using devices other than 3570, 3590, or IBM LTO may have problems with the automatic labeling of tapes by the TSM server.
You can click on the title of this post to see the IBM page.
Subscribe to:
Posts (Atom)