recomended nubers of files per directory.
CASTalk.com Forum Index CASTalk.com
Discussion of DSP, FPGA, storage and embedded system.
 
 FAQFAQ   MemberlistMemberlist     RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 
 
Google
 
Web castalk.com
recomended nubers of files per directory.

 
Post new topic   Reply to topic    CASTalk.com Forum Index -> Storage System
Author Message
Tal Bar-Or
Guest





Posted: Mon Aug 08, 2005 4:17 pm    Post subject: recomended nubers of files per directory. Reply with quote

Hello All,

i have a storage unit shared on the network with one directory with more
than 57000 files on same directory.
when i am browsing the \\server\share its take up to 1.5 min to list content.
My question is what is most recomended to divide # of files per folder to
get better performance.
also microsoft article aboute this issue will be appreciated.
thanks
Back to top
Pat [MSFT]
Guest





Posted: Tue Aug 09, 2005 12:18 am    Post subject: Re: recomended nubers of files per directory. Reply with quote

From a server perspective, it doesn't really matter - i.e. the number of
files in a directory does not affect to a great extent the responsiveness
(except in the case of file creation and even that is not a big deal if 8.3
name creation is disabled). The perf issue you are seeing is pretty much a
client phenomenon. From the client perspective (i.e. using Explorer or any
other GUI based file management), the delay is caused by the time it takes
to iterate the files. From a CMD window if you switch to the directory,
there is no lag b/c the client doesn't iterate the files until you do a
'dir'.

So, the time will increase linearly with file count. The optimum number
then becomes whatever user experience you are going for and the network
latency (not bandwidth) between the client and the server. Cut the file
count in half and the delay cuts in half. Double it and it doubles. From
your data below the client is iterating ~600 files per second. So for a 10
second max you should limit the file count to 6000. If you need more files
in the dir, you may consider changing how the files are managed. As a rule
for high file counts (10's of thousands) it is hard for a user to manually
wade through the files anyway and scripting/specialized clients are more
appropriate.




Pat



"Tal Bar-Or" <TalBarOr@discussions.microsoft.com> wrote in message
news:6727EE22-256D-436D-B189-E1A4726D60C2@microsoft.com...
Quote:
Hello All,

i have a storage unit shared on the network with one directory with more
than 57000 files on same directory.
when i am browsing the \\server\share its take up to 1.5 min to list
content.
My question is what is most recomended to divide # of files per folder to
get better performance.
also microsoft article aboute this issue will be appreciated.
thanks
Back to top
 
Post new topic   Reply to topic    CASTalk.com Forum Index -> Storage System All times are GMT
Page 1 of 1

 
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




VoIP Electronics Powered by phpBB