Domstry is a domain database for SEO, Marketing, Security, Leads, Statistic, etc... A Crawler is visiting domains and gathering all possible metadata. Please get in touch if you need any extra data point, it will be added as soon as posible.
¿What Metadata Domstry collects?
The crawler visits public domain (or subdomain) homepage ONLY, no sub-levels.
Title & Description Meta tags
Technologies used by analyzing server response
Creation & Expiration Date from whois
Http Response code
Dns / Hosting / Network
Time to first byte
Contact Details: Emails & Phone numbers
External links
Domain Availability from GoDaddy's API
Page Rank and ranking from open database
Country and continent from IP
Team
Domstry is backed by AYESA DIGITAL SLU. Please read the terms of service and privacy policy. Domstry is maintained by @betoayesa.
Tech Stack. Programming Languages & Libraries
Python (created by Guido van Rossum, 1991)
BeautifulSoup (bs4) for web scraping (by Leonard Richardson, 2004)
Multi-threading for concurrent processing
PHP (created by Rasmus Lerdorf, 1995)
API + GeoIP functions for geographic location detection
Databases:
MySQL (created by Michael Widenius, David Axmark, and Allan Larsson, 1995): Main storage for structured data
Redis (created by Salvatore Sanfilippo, 2009): Used for technology and keyword caching
Search Engine:
Elasticsearch (created by Shay Banon, 2010):
Domains by Category
By Hosting or Network
Find all domains using the same network or origin.