What is the important a part of search technology?
Distributed file system
Or something like that else?
//Begin sarcastic answer
RAM + CPU + Bandwidth + Really Awesome Internet Search Engine Software
//Finish sarcastic answer
All joking aside, something as complicated as search technology will hinge on numerous issues, as is available already listed. Attempting to pin it to 1 singular silver bullet is actually not relevant.
I believe the larger problem which has not yet been mastered searching is Onotology. You will find there's very hard time understanding and categorizing the produces a human friendly way. Some refer to this as the 'semantic web'. We now have this exaflood of information and indexes, but we classify or make good feeling of it a really poor way. The fault is based on our insufficient being atomically self-significant in ways that search (the formula) can understand.
Search and Ranking are significantly important, same goes with indexing. You'll need efficient calculations to locate results that carefully match the key phrases I joined (ala google, yahoo, etc.) and you have to rank individuals results.
Performance inside a internet search engine is crucial a sluggish services are a defunct one, but it is not the most crucial aspect that badge, I believe, would go to the relevance of results.
We request search engines like google to complete the impossible to consider an expression or perhaps a couple of key phrases and in some way return a lot of results that report exactly as to the we wanted - we might not know precisely what we should were searching for, but the moment we have seen it, we are able to recognise it. Likewise, we all know instantly once the internet search engine is coming back the "wrong factor".
Ultimately, it is all about obtaining a dumb machine to complete what we should mean, not what we should say, that is essentially an unsolvable condition in computing. The very best-quality search solutions will always be likely to be individuals that have probably the most novel methods for ranking results and relevant these to our original queries. This notion is very heavily tied directly into those of ontology, as Wayne Hartman describes in the answer.
I built a little internet search engine included in my final year project and I will tell you that the inverted index is an integral part of the internet search engine.
I possibly could also the Crawler is an integral part.
You might the Page Ranking formula is essential.
You are able to argue clustering is essential.
Exactly what are you searching for? your question appears to broad in my experience.