[Solved] How to list all the domains in India under one website based on categories [closed]

Question

You just cannot list 100% of Indian websites. If I understand what you want, you want something like a Web crawler for Indian domains. Another “google”. But even big spiders like Google’s, Yahoo’s, Bing’s spiders can’t build a database of all the websites. They do this with algorithms (with partly published algorithms), but I think you need even more, because you need a 100% accurate database, so you would need to have to ask them from all domain registrars, but you obviously can’t do that.

Even if it was possible I definitely would not do this for a client, but created a company for that. But I would say that’s practically impossible.
What you can do is that you can search for a few thousands of sites and categorize them manually or build a small “spider”.

Accepted Answer

You just cannot list 100% of Indian websites. If I understand what you want, you want something like a Web crawler for Indian domains. Another “google”. But even big spiders like Google’s, Yahoo’s, Bing’s spiders can’t build a database of all the websites. They do this with algorithms (with partly published algorithms), but I think you need even more, because you need a 100% accurate database, so you would need to have to ask them from all domain registrars, but you obviously can’t do that.

Even if it was possible I definitely would not do this for a client, but created a company for that. But I would say that’s practically impossible.
What you can do is that you can search for a few thousands of sites and categorize them manually or build a small “spider”.