NYCPHP Meetup

[nycphp-talk] MySQL & 2.5 million rows!

jsiegel1 at optonline.net jsiegel1 at optonline.net
Fri Apr 11 12:16:03 EDT 2003


I've gotten a lot of great suggestions (thanks so much for the quick response...I hope to get to one of the NYPHP meetings some day) and I definitely *LIKE* the table renaming idea. 

Now...of course...I've got to make a choice as to which method to use!!  :)

Jeff

----- Original Message -----
From: Andrew Yochum <andrew at digitalpulp.com>
Date: Friday, April 11, 2003 11:46 am
Subject: Re: [nycphp-talk] MySQL & 2.5 million rows!

> A similar suggestion to the one below is to rename the tables to 
> do the move.
> The table naming then can remain human readable at any given time.
> 
> Andrew
> 
> On Fri, Apr 11, 2003 at 11:34:18AM -0400, Jim Hendricks wrote:
> > You may want to save time and not move the data around at all.
> > 
> > The idea would be to have 3 tables all structured the same each 
> named> uniquely.  Start by loading up table 1, then in the 
> application point the
> > data to table1.  When doing the next import, detect that table 1 
> contains> the live data so use table2 to import the data.  If the 
> data imports
> > correctly, change the app to point to table2, table1 now becomes 
> your old
> > data.  Next import table 3 becomes your import, then live, table 
> 2 becomes
> > old, table 1 gets emptied ready for next import.  Next import, 1 
> becomes> import then live, table 3 becomes old, table 2 gets 
> emptied ready for next
> > import.
> > 
> > Hope you get the idea.
> > 
> > Jim
> > ______________________________________________________________
> > Jim Hendricks, President, Biz Computing, Inc
> > Phone:  (201) 599-9380     Email: jim at bizcomputinginc.com
> > Web: www.bizcomputinginc.com
> > Snail:  Jim Hendricks,  Biz Computing, Inc.,  255 McKinley Ave, 
> New Milford,
> > NJ 07646
> > ______________________________________________________________
> > 
> > ----- Original Message -----
> > From: <jsiegel1 at optonline.net>
> > To: "NYPHP Talk" <talk at nyphp.org>
> > Sent: Friday, April 11, 2003 10:24 AM
> > Subject: [nycphp-talk] MySQL & 2.5 million rows!
> > 
> > 
> > > You read the subject line correctly!!! I'm loading 2.5 million 
> rows from
> > an ASCII file into a MySQL database. So...here's a little 
> background on what
> > I've done and then a question. (Please keep in mind I'm a Php/MySQL
> > newbie...though I'm learnin' fast!!)
> > >
> > > I created three tables - data_new, data_old, data_live. The 
> Ascii file
> > gets read, line by line, and inserted into data_new. When it's 
> completed and
> > there are no glitches (i.e., no problem with the Ascii file), I 
> want to move
> > the data from data_live to data_old and then move the new data 
> from data_new
> > to data_live. So...the question...is there a fast way to move 
> the data from
> > one MySQL table to another (from data_new to data_live) other 
> than walking
> > through data_new row by row...creating an Insert statement on 
> the fly...and
> > then inserting the row into data_live?
> > >
> > > BTW, in case you are wondering why there are three different 
> tables, I
> > felt that this was a better way  than my client's present system 
> which> simply wipes out the live data and then reads in the Ascii 
> file. If there is
> > a glitch then they have to empty the table and reload the Ascii. 
> Doing it
> > this way, if they need to go back to the old data, I would move 
> it data from
> > data_old to data_live.
> > >
> > > Jeff
> > >
> > >
> > >
> > > 
> > >
> > >
> > >
> > >
> > 
> > 
> > 
> > 
> > 
> 
> -- 
> Andrew Yochum
> Digital Pulp, Inc.
> 212.679.0676x255
> andrew at digitalpulp.com
> 
> 
> --- Unsubscribe at http://nyphp.org/list/ ---
> 
> 
> 




More information about the talk mailing list