Mailing List
Home
Forum Home
Linux - General Red Hat Linux discussion list
Enterprise Linux 3 - Discussion of Red Hat Enterprise Linux 3 (Taroon)
Installation - Getting started with Red Hat Linux
Red Hat Linux 9 - Discussion of Red Hat Linux 9 (Shrike)
Red Hat Linux 7.3 - Discussion of Red Hat Linux 7.3 (Valhalla)
Red Hat Linux 7.2 - Discussion of Red Hat Linux 7.2 (Enigma)
Apache Web Server
Oracle database, Microsoft SQL server ...
Subjects
application/x mplayer2 plugin
RPM error: db4 error(16) from dbenv >remove: Device or resource
   busy
Command stream end of file while reading
X Windows problem (xauth)
Upgrading openoffice 1 1 rpm
FTP: connection refused
FTP: connection refused
mount: /dev/cdrom: is not a valid block device
Dell Precision 650, RedHat 9, no sound
how to trace the cause resulting in the crash of bind server
Virus on the list
UNINSTALL RPM MYSQL
usb pen drives: mounting as a user
broadcom network interface
make mrproper
sendmail configuration on redhat
Couldn 't open PID file /var/run/named/named pid Permission denied
Promise 378 controller
kernel 2 6 and /dev/sound/mixer not found
Problem using up2date
mrtg step by step howto/configuration for a newbie?
Compiling and Installing Kernel 2 6
Can 't locate module ppp0, can 't locate module ppp compress 21
HOW I CAN MAKE BOOTABLE FLOPPY DISKET
Lotus Notes under Wine
/etc/security/limits conf question
Intel E/1000 driver
Command stream end of file while reading
rpm database corrupt
qla2300 modules
 
Search:  
Power your search with and, or, +, -, or "some phrase" operators.
10 million files on Redhat?

10 million files on Redhat?

2005-07-11       - By Matthew Melvin

 Back
Reply:     1     2     3     4  

On Mon, 11 Jul 2005 at 4:46pm (-0700), Cabbar Duzayak wrote:

> I am planning to undertake a project where I need to store around 10
> million images on (a) dedicated server(s)... At this point, I am
> trying to decide whether I should store them on the database or on the
> filesystem.
>
> And, my question is do you think Redhat can handle this many files? I
> will probably store them on a RAID 5 system, and of course I will
> partition them over 4 level of directories and one directory will
> contain at most (100 files) or (100 directories), but still, I am
> curios to know if Redhat can handle this?
>
> Does anyone have experience with this many files on linux filesystems?
> Also, can you recommend which FS would be the best (in terms of
> reliability and/or speed) Any suggestions/feedback?
>

I have two mailstores of 19.3 and 18.4 million files each on (mostly*)
vanilla rh7.3 ext3 partitions without drama.  The number of files per dir is
a much bigger issue but your 100 files per dir isn't going to have any
problems there.  Naturally fsck'ing a file system with that many files on it
takes a looooong time but since ext3 I havn't had to do that.

I can't answer if this better or worse than a database for you but it does
work. :)

M.

* bytes per inode was tuned so that inodes and blocks ran out at roughly the
same rate but this isn't relevent to your question - it acutally results in
less indoes than would be available normally.

--
:wq!

--
redhat-list mailing list
unsubscribe mailto:redhat-list-request@(protected)?subject=unsubscribe
https://www.redhat.com/mailman/listinfo/redhat-list

Earn $52 per hosting referral at Lunarpages.