TOP

Using the Crawler

Before we get started, there are some little things you need to know. TLDrop is a very configurable software that almost every aspect can be customized yourself.

Because we're going to find domains, let's open the General Settings. There are many crawler context options. Make sure that the type of domains and target TLDs you want to find are checked. Otherwise, TLDrop will ignore them.

Browse into configuration topic to get more information.

To get started with the main function of TLDrop, click the play button located at the very top left of the application window. Or, simply press the F2 key on your keyboard.

A new dialog window will appear asking you to insert some seed items.

TLDrop crawler task window

Seed Items

Seed items could be a list of web page URLs or keywords (search queries) separated by a line. Please note that this is a very crucial thing; these seed items will significantly affect the final results.

List of Web Page URLs

This crawling method is excellent for finding domains that have a link from a specific authority website that lends a lot of credibility to a domain such as news websites, content sharing platforms, etc.

If you're using URLs as a seed item, then the software will crawl those given URLs directly. Therefore, this will prevent TLDrop from making requests to the Search Engines.

List of Keywords

This crawling method is much preferred if you want to search domains in a specific niche. Make sure to check This is keywords (search queries) checkbox.

The software will perform search operation to the search engines and parse the search results. You can select what search engines you want to use at the Crawler Settings.

Of course, you can always insert custom search footprints (or search operators) to every query, for example:

car rental
site:some-car-rental-website.com "car rental"
intitle:"car rental budget"

You might want to prioritize the software to find expired Web 2.0. Then you can use a search operator combination like below.

site:blogspot.com "my keyword 1"
site:blogspot.com "my keyword 2"
site:tumblr.com "my keyword 1"

The downside of this method is that you will need a bunch of proxies to avoid IP ban, especially when crawling through Google Search.

Ready To Go!

We are assuming that you've already insert seed items. Then, click the Run button, that's all!

If TLDrop founds expired domain, dropped domain or expired Web 2.0, then TLDrop will automatically refresh the Result Tab. You can watch the crawler process at the Task Manager by pressing F10 key.