Part of the EllisLab Network
   
 
Large table in MySql with Database Caching
Posted: 09 July 2008 09:32 PM   [ Ignore ]  
Grad Student
Avatar
Rank
Total Posts:  37
Joined  07-12-2007

Hello everyone,

I am getting ready to start on a project that will involve a rather large table within MySql that will need to be queried to verify if a users entry into a form is a valid entry “code”.  This table will need to be queried upon form submission.  Users will have the ability to input 5 “codes” at a time and each one will need to be verified.

The trick is, that the table that contains all of the “valid codes” will be 2.5 million rows, or 2.5 million acceptable codes.

Now I know this is a pretty heavy strain for a database query, and I am wondering if I could see a big improvement on performance by using CI’s db caching to create the serialized text file, or if at the point of having 2.5 million codes it is going to be a hog any way we cut it.

Any suggestions on working with this many rows within CI?  I am doing my homework before I start getting heavy into that side of the development for the application.

Thanks in advance!

Profile
 
 
Posted: 09 July 2008 11:13 PM   [ Ignore ]   [ # 1 ]  
Sr. Research Associate
Avatar
RankRankRankRankRank
Total Posts:  2774
Joined  07-27-2006

If your MySQL server and file system server are one in the same, I’m not sure how much benefit file system caching is going to provide. Is it going to be that much of a hog though? Have you tried it out?

But, at some point, you just have to throw more hardware at a problem like this. That or rethink your system..

 Signature 

Check out the Template Library
Oh yeah, I tweet, too (regarding CodeIgniter on occassion).

Profile
 
 
Posted: 09 July 2008 11:55 PM   [ Ignore ]   [ # 2 ]  
Lab Technician
RankRankRankRank
Total Posts:  1040
Joined  06-19-2007

If you need test data—GenerateData.com.

Randy

 Signature 

My new therapist is working with me every day, the third one gave up… ohh

Profile