Visual Web Spider

Visual Web Spider is a handy web crawler designed to help you grab and index webpages from the Internet. It can specifically find pages with certain keywords and phrases, making your search super targeted.

Easy Project Setup

When you launch Visual Web Spider, you'll see a clean layout that’s easy to navigate. Setting up new projects is a breeze thanks to its wizard-like feature that walks you through every step. Plus, you can save your projects on your computer for future editing!

Create Projects with Ease

To create a project, just input some starting URLs. If you have links in custom files like TXT or CSV, you can add those too. There’s even an option to generate URLs or set up search engine links!

Crawling Rules and Settings

You can get pretty specific with how you want Visual Web Spider to crawl the web. Set rules for how deep it should go, choose what pages to index (like all pages or just one per site), and pick what info you want indexed—this includes page keywords, size, HTTP status codes, and more.

Manage Your Projects

The program gives you control over each project—start, pause, or stop whenever needed! You can reset any failed tasks and filter the information based on conditions that matter to you. Sorting data by ID or URL is also simple.

Exporting Your Data

When you're ready to save your findings, Visual Web Spider lets you export data into Microsoft Access Database or MySQL databases. You can also save it as ASCII, CSV, or HTML files! Choose where to save everything and decide if you want all results in one file or split them across multiple files.

Link Management

You’ll love that this tool can export link maps as HTML files too! Plus, it saves any broken links in formats like HTML, TXT, or CSV while allowing you to choose your encoding type. Tests show that Visual Web Spider runs quickly without hogging system resources—so it won’t slow down your computer!

All in all, Visual Web Spider offers an easy-to-use environment packed with powerful features for automatically collecting or indexing specific web pages.