| Author |
Message |
Stout
Guest
|
 Posted:
Sun Jan 09, 2005 6:24 pm Post subject:
Large Backups |
|
|
I am trying to find a backup solution that will work for me. I am
currently using Veritas BackupExec to backup millions of 1k files
spread out through thousands of directories. The backup takes 3 to 4
days to finish because it slows down to 1k per minute. Does anyone
have a solution that might work?
Thanks |
|
| Back to top |
|
 |
Al Dykes
Guest
|
| Posted:
Sun Jan 09, 2005 6:46 pm Post subject:
Re: Large Backups |
|
|
In article <1105277058.048212.292170@c13g2000cwb.googlegroups.com>,
Stout <whand27@Yahoo.com> wrote:
| Quote: | I am trying to find a backup solution that will work for me. I am
currently using Veritas BackupExec to backup millions of 1k files
spread out through thousands of directories. The backup takes 3 to 4
days to finish because it slows down to 1k per minute. Does anyone
have a solution that might work?
Thanks
|
What OS ? Lets assume wondows/something
What file system type ?
Is it a server or a stand-alone PC application.
Have you asked Veritas about your perfromance problems ?
What do they say ?
"millions of 1 k files" is only multiples of Gigabytes. not much, on
an aggregate level, unless you multiply that by 1,000. Then we're
talkling real data.
Have you asked about this application on usenet before ? It sounds
familair ?
--
a d y k e s @ p a n i x . c o m
Don't blame me. I voted for Gore. |
|
| Back to top |
|
|
HVB
Guest
|
| Posted:
Sun Jan 09, 2005 8:03 pm Post subject:
Re: Large Backups |
|
|
On 9 Jan 2005 08:46:09 -0500, (Al Dykes) wrote:
| Quote: | Stout <whand27@Yahoo.com> wrote:
I am trying to find a backup solution that will work for me. I am
currently using Veritas BackupExec to backup millions of 1k files
spread out through thousands of directories. The backup takes 3 to 4
days to finish because it slows down to 1k per minute. Does anyone
have a solution that might work?
Thanks
[snip]
"millions of 1 k files" is only multiples of Gigabytes. not much, on
an aggregate level, unless you multiply that by 1,000. Then we're
talkling real data.
|
I suspect that the problem here is that Backup Exec is traversing a
file system to back all these files up. It's not the actual backup
(reading the data) that's taking the time, it's getting to each file
through the directory tree.
Backing up small files is always time consuming.
Possible solution - robocopy the data to another disk(s). Run your
tape backup from there if you need to.
For the OP... What is the data? Do you really need to back it up? In
some cases it's easier/quicker to regenerate lost data that it would
be to recover it if the whole system was lost.
HVB. |
|
| Back to top |
|
|
Al Dykes
Guest
|
| Posted:
Sun Jan 09, 2005 8:09 pm Post subject:
Re: Large Backups |
|
|
In article <hlh2u0ppcjbiuudj1tatfbe72pjfm1bdug@4ax.com>,
HVB <devnull@127.0.0.1> wrote:
| Quote: | On 9 Jan 2005 08:46:09 -0500, (Al Dykes) wrote:
Stout <whand27@Yahoo.com> wrote:
I am trying to find a backup solution that will work for me. I am
currently using Veritas BackupExec to backup millions of 1k files
spread out through thousands of directories. The backup takes 3 to 4
days to finish because it slows down to 1k per minute. Does anyone
have a solution that might work?
Thanks
[snip]
"millions of 1 k files" is only multiples of Gigabytes. not much, on
an aggregate level, unless you multiply that by 1,000. Then we're
talkling real data.
I suspect that the problem here is that Backup Exec is traversing a
file system to back all these files up. It's not the actual backup
(reading the data) that's taking the time, it's getting to each file
through the directory tree.
Backing up small files is always time consuming.
Possible solution - robocopy the data to another disk(s). Run your
tape backup from there if you need to.
For the OP... What is the data? Do you really need to back it up? In
some cases it's easier/quicker to regenerate lost data that it would
be to recover it if the whole system was lost.
HVB.
|
Assuming Windows.... FAT32 or NTFS ? it could make a _big_ difference.
Do you have plenty of RAM available for file system caching ?
--
a d y k e s @ p a n i x . c o m
Don't blame me. I voted for Gore. |
|
| Back to top |
|
|
Benno
Guest
|
| Posted:
Fri Jan 14, 2005 1:03 pm Post subject:
Re: Large Backups |
|
|
HVB wrote:
| Quote: | On 9 Jan 2005 08:46:09 -0500, (Al Dykes) wrote:
Stout <whand27@Yahoo.com> wrote:
I am trying to find a backup solution that will work for me. I am
currently using Veritas BackupExec to backup millions of 1k files
spread out through thousands of directories. The backup takes 3 to 4
days to finish because it slows down to 1k per minute. Does anyone
have a solution that might work?
Thanks
[snip]
"millions of 1 k files" is only multiples of Gigabytes. not much, on
an aggregate level, unless you multiply that by 1,000. Then we're
talkling real data.
I suspect that the problem here is that Backup Exec is traversing a
file system to back all these files up. It's not the actual backup
(reading the data) that's taking the time, it's getting to each file
through the directory tree.
Backing up small files is always time consuming.
Possible solution - robocopy the data to another disk(s). Run your
tape backup from there if you need to.
|
I agree with the above, small files on Windows are a pain in the a.
An other option would be to look into the image backup feature of
BackupExec. |
|
| Back to top |
|
|
|
|
|
|
FAQ
Memberlist
Register
Profile
Log in to check your private messages
Log in