NYCPHP Meetup

[nycphp-talk] XML files

Malcolm, Gary gmalcolm at professionalcredit.com
Wed May 7 11:09:41 EDT 2003


an aside...

	a binary tree is a specific example of a btree... one that can have
up to 2 branches from each node. A generalized btree can have N branches
from a given node. The search depth of an N branch btree (how may nodes to
check b4 you get your info) can give definite advantages if an application
can suck up big bunches of information at any given iteration (example:
reading from disk).  

I agree that a btree is a pretty good solution to the big bunches of files
problem but the very best implementations are already done for us (in db's)

> -----Original Message-----
> From: chalu at egenius.com [mailto:chalu at egenius.com]
> Sent: Tuesday, 06 May, 2003 10:12 PM
> To: NYPHP Talk
> Subject: RE: [nycphp-talk] XML files
> 
> 
> 
> Try to use Btree as in binary tree. In a folder with many 
> files like more than 50,000, it will crawl. Any would.
> 
> That is why in Zope, there is a binary tree by Andy Mckay (is 
> that Andy's work?) to deal with this type of stuff.
>  
> Or you can create many folders (simulating btree with 
> folders). Create hashes (indices) to store where XML files are at. 
> 
> However, the fact you have that many files is like a need to 
> re-think your solution. Perhaps, you can use Sleepycat DB. 
> 
> All the best
> 
> Larry Chuon <LarryC at indexstock.com> wrote ..
> > I'm doing everything that you mention below.  Each file 
> associates with
> > a
> > product.  It also has an image as well.  The image will 
> have IPTC header
> > that describe the product, price, model, make and etc.  Let 
> me know if
> > you
> > need more info.  Thanks.
> > 
> > -----Original Message-----
> > From: Jon Baer [mailto:jonbaer at jonbaer.net]
> > Sent: Tuesday, May 06, 2003 4:46 PM
> > To: NYPHP Talk
> > Subject: Re: [nycphp-talk] XML files
> > 
> > What are you looking to do with the files? (ie, display, 
> query, export,
> > etc)
> > . when in doubt, go SAX :-)
> > 
> > - Jon
> > 
> > ----- Original Message -----
> > From: "Larry Chuon" <LarryC at indexstock.com>
> > To: "NYPHP Talk" <talk at nyphp.org>
> > Sent: Tuesday, May 06, 2003 1:41 PM
> > Subject: [nycphp-talk] XML files
> > 
> > 
> > > I have nearly a million XML files generated from the 
> database for products
> > > in my OSSuite application.  What is the best way to 
> handle so many tiny
> > > files?  Windows crawl to its knees when I try to open up 
> the directory
> > where
> > > the files locate at.  Is there a way to optimize disk I/O?
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > 
> > 
> > 
> > 
> > 
> > 
> > 
> 
> 
> 
> 
> --- Unsubscribe at http://nyphp.org/list/ ---
> 
> 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.nyphp.org/pipermail/talk/attachments/20030507/7b8c48fb/attachment.html>


More information about the talk mailing list