Some details about Domstry
Domstry is a spinoff from Php Ninja. We were looking for a way to be like the cost guards for internet, this tool allowed us to discover domains and monitorize them and be notified when something bad happened to them.
It's the perfect tool for email marketing or market research
The crawler visits domain homepage only. For each domain, the bot is collecting:
First iteration of domstry was made by @betoayesa.
Python, PHP
Database: MYSQL
Libraries/Services: Whois, Dataforseo, Goddady
Sources revised by domstry.com crawler. More than Petabytes here.
https://github.com/tb0hdan/domains Open domains datase index domains database https://all-registered-domains.whoisxmlapi.com/?mc=hackernoon&ref=hackernoon.com 774M database, the biggest index domains database https://blog.majestic.com/development/majestic-million-csv-daily/ csv daily, index https://commoncrawl.org/ non profit index index https://crawler.ninja/ awesome open source directory index https://dnscensus2013.neocities.org/download dns census index https://domains-index.com/ domains list & zones filles, https://domainsproject.org/ petabytes domain dataset index https://github.com/GSA/data gov domains index https://internetstiftelsen.se/en/zone-data/ zone data, .nu, .se index https://www.afnic.fr/en/products-and-services/fr-and-associated-services/shared-data-reuse-fr-data/ fr domains index https://www.cubdomain.com/domains-registered-dates/1 List of registered domains by date index https://www.domcop.com/ open page rank extra https://www.iana.org/domains/root/db Root domains database index domains database https://github.com/kyle-w-brown/majestic_million Majestic million csv -3 years index
Successfully saved!
Anyone with a link can now view this file.
Experience unparalleled growth and engagement in your campaigns. Sign up and show 50 results instead of 20 for free