BlackWidow

BlackWidow is a handy website scanner that helps you find and download specific files like pictures and videos. It can also spot different types of links, whether they're broken or external, and lets you use powerful filters to refine your search.

Understanding the Interface

The user interface might not be the prettiest out there, but it’s functional. You can easily switch between key features like web browsing, filters, scanning for broken links, extracting email addresses, grabbing external links, checking website structure, and using the Internet sniffer.

Built-in Browser Features

This tool has a built-in web browser where you can enter custom URLs. You can navigate back and forth between pages, stop loading processes, refresh pages, view page source code, and even take snapshots of what you see!

Automatic Link Searching

Every time BlackWidow grabs a document or scans a site, it automatically looks for links. You can set up filters to modify documents before they get parsed for new links. You can also create link masks to avoid following certain links and filter data by file type.

Website Scanning Options

You have the option to scan an entire site or just start with the homepage. Plus, you can define how deep into the site you want to go. If you're checking external links or setting a default index page name? No problem!

Downloading Data While Scanning

You don’t have to wait until your scan is over to start downloading data! You can limit connections and speed while specifying where everything gets saved. The tool also helps keep your folder structure organized and lets you ignore duplicates during downloads.

Identifying Broken Links

If any links are broken during a scan (meaning they’re not available anymore), BlackWidow lists them along with their error codes in a special panel. It’s also great at identifying email addresses and external links from other websites.

User-Friendly File Browsing

The Explorer-like layout makes it easy to browse through all the files found by the scanner. You can save this structure as a WEB file format so you can pick up where you left off later on or download selected files right away.

Using the Internet Sniffer

This feature captures all URLs and lists them in its window. You choose which network adapter to monitor and even filter results using wildcards or regular expressions!

Exporting Your Findings

You have options when it comes to exporting: saving all files or selecting ones from subfolders in formats like plain text, HTML, or XML.

A Simple Yet Powerful Tool

BlackWidow might look simple but packs quite a punch with its settings! It uses multi-threading for grabbing files fast while testing those pesky links too—perfect for webmasters looking for broken link reports!

A Small Drawback

The only downside? There isn’t a help manual included (just some tips), so newbies might find it tricky figuring out how everything works at first.