Mi-san's Blog

Ok, There where some problems while running the script for a value with 7 characters in it. A little while ago, i was indexing the table with an ID field, which had the type INT that is 32 Bits. Read the previous post for more information about that. Finally the script is completing the 7th length table, but this will take some more day’s to complete. Some stats : 3,204,000,118 records @ 27.5 Million INSERT’s per hour. MySQL data file is @ 174 GB.

Plans have been written out for an application that enables an individual to perform a lookup on my tables, to find the corresponding value by submitting an MD5 Hash. Also there will be a lot of checking the database for it’s accuracy, and consistency. Another thing i like to add is another database that saves the results from lookups that have been made on my tables, a sort of caching if you will. This way, the database will not be overloaded by query’s that have run before. What i also should mention is that i include the possibility of submitting your own value, that will be hashed and stored into the database off course.

Nick ( the kind geek he is ) arranged a VPS for me, and that VPS will be running this application i write about just now. I have limited storage capacity there, so i will not be able to host everything i’ve got on this project. In total when writing this post the current database size is already 174 GB, and the VPS has 10 GB. Therefore i will be hosting lower and upper case with a length from 1 char to 5 chars plus the additional caching database and Manual generated hash database.

So, this project was not a dud, i’m still working on it, and my computer is still crunching the value’s and hashes as i write this post. Keep coming back for more details and links to the new application that is being build the next couple of day’s. Trust your technolust, release you inner geek, and look forward to the day that your Coffee machine has networking capability’s, for me, i am going to bed.