Scraping Domain Registrations

Question

I am currently scraping newly registered domains with Python, using API from zonefiles.io (zones aggregator)

Is there a more direct way to scrape this.Does ICANN provide access to this type of data?

Would be grateful if anyone knows a good direction.

Answer 1

Nah, you gotta start like everyone else. Make a spider, and have it crawl. There are sites that google doesn't know about and they have spiders crawling 24/7

and follow robots.txt!

Answer 2

Thanks Slick.

Just realised ICANN's Centralised Zone Data Service (CZDS) works for gTLDs which gets updated daily.

However, for ccTLDs, i have not been able to find a solution yet barring crawling which is not really an option.

Answer 3

Anyone if you worked out a solution for ccTLDs, i'm all ears. Thanks in advance guys.