Part of the EllisLab Network
   
 
How to build a Search engine
Posted: 10 May 2008 11:45 AM   [ Ignore ]  
Research Assistant
Avatar
RankRankRank
Total Posts:  801
Joined  04-20-2006

Hi,

That may be a stupid question, and not specially CI related, but I am interested to find out how I can build a search engine to index websites that I can add myself or that people would propose. A kind of link directory but real in the search engine way (eg. like Google)

Do you know existing scripts, even commercial one?

 Signature 

Un blog seo white-hat expliquant quelques techniques intéressantes sur le seo black hat

Ionize CMS - Webdesigner CMS based on CodeIgniter
www.ionizecms.com

My website: Webagency Too Pixel

Profile
 
 
Posted: 10 May 2008 12:15 PM   [ Ignore ]   [ # 1 ]  
Sr. Research Associate
RankRankRankRankRank
Total Posts:  4785
Joined  07-14-2006

I wonder what good would it do to create and index yourself? What will it have extra over custom google or the google search api or even something like rollyo?

Profile
 
 
Posted: 10 May 2008 02:20 PM   [ Ignore ]   [ # 2 ]  
Research Assistant
Avatar
RankRankRank
Total Posts:  801
Joined  04-20-2006

Nothing extra functionality, my goal is not to do a Google clone or to make the next incredible search engine of the web. To explain you, I have a client that want this to index websites concerning only his professional sector, but he want that it looks like a search engine (he don’t want a link directory like I have in my signature for example)

 Signature 

Un blog seo white-hat expliquant quelques techniques intéressantes sur le seo black hat

Ionize CMS - Webdesigner CMS based on CodeIgniter
www.ionizecms.com

My website: Webagency Too Pixel

Profile
 
 
Posted: 10 May 2008 02:28 PM   [ Ignore ]   [ # 3 ]  
Research Assistant
Avatar
RankRankRank
Total Posts:  747
Joined  01-13-2008

Create a link directory style db structure and crud, but then instead of showing categories and links on page make the user search to get results.

 Signature 

Yonti - I am Currently looking for a business partner, to create the best developer hosting out there. If your interested PM me.

Fluxity Lighting - My other company.


I’m a Proud Supporter and Sponser of Tomorrows Web.

Profile
 
 
Posted: 10 May 2008 02:33 PM   [ Ignore ]   [ # 4 ]  
Research Assistant
Avatar
RankRankRank
Total Posts:  801
Joined  04-20-2006

Yes, maybe you are right Tom, I was thinking that too but I wanted to have other people’s thought before start building something myself. There should exists some ready made scripts built I didn’t find something that store links localy, all what I’ve found use a known search engine API.

 Signature 

Un blog seo white-hat expliquant quelques techniques intéressantes sur le seo black hat

Ionize CMS - Webdesigner CMS based on CodeIgniter
www.ionizecms.com

My website: Webagency Too Pixel

Profile
 
 
Posted: 10 May 2008 02:40 PM   [ Ignore ]   [ # 5 ]  
Research Assistant
Avatar
RankRankRank
Total Posts:  747
Joined  01-13-2008

if you could find a dmoz api then you could search there listing, and add ones as well, but you could also limit it to the one category. Unlike a google api which would search all google indexes.

 Signature 

Yonti - I am Currently looking for a business partner, to create the best developer hosting out there. If your interested PM me.

Fluxity Lighting - My other company.


I’m a Proud Supporter and Sponser of Tomorrows Web.

Profile