Can distributed search engines challenge Google's dominance?

Source: Hackernoon

Translation: First Class (First.VIP)

Some startups have proposed the concept of a distributed search engine, focusing on the decentralized ideas behind building Web 3.0. Despite the complexity of creating a fully functional and workable distributed search engine, they are always trying various models to achieve this.

Who would have thought that this story that propelled the rise of the Internet would later give birth to Google and dominate the process of the ever-evolving Internet world?

Although this entity has been at the forefront of the transition from industrial society to post-industrial economy, the same paradigm shift has begun, and it is impossible to predict how it will affect Google's dominance.

The world is gradually moving towards the digital economy, and it remains to be seen whether this huge force can maintain its place in the echelon of the Internet food chain.

This is the essence of this article, because it touches the revolutionary ideas in the minds of innovators who are committed to promoting the development of new Internet of decentralized technology.

Many people claim that Web 3.0 is a new frontier, trying to challenge the status of corporate giants as information custodians .

It is this possibility that has prompted some startups to come up with the concept of a distributed search engine, focusing on the decentralized thinking behind building Web 3.0.

However, given the many years that many companies have failed to challenge Google's dominance in the search engine market, questions have been raised about the potential of this new concept and whether it has the opportunity to fight against a well-established, centralized, and dominant Search engine systems are not groundless.


What is a distributed search engine?

The operations of distributed search engine proponents are based on an argument that condemns the neutrality of the network that monopolizes the erosion of the Internet. They saw that Google search engine, a huge entity, occupied 90% of the market, and also found that in the next stage of the proposed Internet ecosystem, centralized search engines have no place.

For these activists, a centralized search engine will only undermine the freedom and anti-censorship capabilities that the decentralized network brings.

Therefore, we can define a distributed search engine as a system that supports a search model that can eliminate all single-point control in tasks related to indexing, querying, data retrieval, and so on.

Unlike traditional search engines, the functionality of the system relies on a distributed computer network.

Although this definition vaguely describes how a distributed search engine works, there are still technical issues with this solution that make it difficult to implement.

Despite the complexity of creating a fully-featured and workable distributed search engine, there are still some startups that are always experimenting with various models to achieve this.

The Cyber ​​Network framework has such a model, which uses a protocol to compile "information onto a knowledge graph". After compiling this information, the protocol and the interstellar file system IPFS (a distributed hypermedia protocol) use digital tokens and current "network load parameters" to sort the information.

It's worth noting that all these calculations are performed by the validator, eliminating the need for centralized servers such as Google search engine.

As a result, the entire network is protected from third-party factors, such as trying to push content rankings due to money temptations or censoring content that users visit in search results.

Another commendable framework for distributed search engines is Dweb. Dweb recommends that every Internet user run their search engine protocol. It plans to achieve this by combining existing operating technologies, IPFS and IOTA, thereby achieving a distributed database layer and a distributed network.

Essentially, authors (content creators or providers) can upload content to a distributed network and allow others to access it. By signing every piece of information uploaded to the Dweb network, spam and malicious content can be reduced.

This way , users can directly block known sources of malicious content.

These projects are just two of the many solutions to decentralized web search. These platforms must find a solution to the deficiencies of current distributed search engines. First, speed is Google's ultimate weapon.

In order to challenge the first throne, the search speed of distributed search engines should be comparable to that of Google.

Again, these networks must play a role in the field of indexing. Therefore, it is important to design a framework that allows distributed nodes to retrieve information related to search queries, while avoiding being affected by false search entries.

This may require the use of a consensus mechanism, similar to the consensus mechanism on the Bitcoin blockchain, which allows validators to vote on the quality of search results and their rankings.



Just like the concept of a decentralized network, the impact of distributed search engines is enough to subvert the monotonous market like the search engine market dominated by Google.

Although there is no evidence to support this view, promoting this model change and obvious improvement space is a good reason to believe that distributed search engines are effective.

Reprinted please retain copyright information.