About

Find and export domain details from this Website & Domain Metadatabase,

Welcome to Domstry

Domstry is a domain database for SEO, Marketing, Security, Leads, Statistic, etc... A Crawler is visiting domains and gathering all possible metadata. Please get in touch if you need any extra data point, it will be added as soon as posible.

¿What Metadata Domstry collects?

The crawler visits public domain (or subdomain) homepage ONLY, no sub-levels.

  • Title & Description Meta tags
  • Technologies used by analyzing server response
  • Creation & Expiration Date from whois
  • Http Response code
  • Dns / Hosting / Network
  • Time to first byte
  • Contact Details: Emails & Phone numbers
  • External links
  • Domain Availability from GoDaddy's API
  • Page Rank and ranking from open database
  • Country and continent from IP

Built with

- Python (created by Guido van Rossum, 1991)
- BeautifulSoup (bs4) for web scraping (by Leonard Richardson, 2004)
- PHP (created by Rasmus Lerdorf, 1995) - API + GeoIP functions for geographic location detection
- MySQL (created by Michael Widenius, David Axmark, and Allan Larsson, 1995): Main storage for structured data
- Redis (created by Salvatore Sanfilippo, 2009): Used for technology and keyword caching
- Search Engine: Elasticsearch (created by Shay Banon, 2010)
- Web: DataTable.js created by Allan Jardine, 2008
- Web: Stripe-Pad created by Beto Ayesa 2024

Team

Domstry is backed by AYESA DIGITAL SLU. Please read the terms of service and privacy policy..

Domains Total Index
110 million
CSV files generated every day
6,600
New Domains added every week
10,000

How Domstry Works

On a Mission to scrape every domain & website

1- Domain Visitation

Our bots visit domains

Automated systems start by scanning domains, ensuring continuous and comprehensive data coverage.

2- Metadata Extraction

Extract and save metadata

Each visit extracts vital domain data, including technology use, operational metrics, and contact details.

3- Queue Management

Add new domains to the queue

Newly discovered domains are added to the queue, ready for subsequent visits and analysis.

4- Continuous Operation

Repeat the process

The cycle repeats, ensuring the database is always expanding and up-to-date with the latest domain information.