#

website-structure

Here is 1 public repository matching this topic...

URDev4ever / RoverCrawler

RoverCrawler is a single-file Python web crawler designed to explore websites and generate a tree-mapped representation of their structure.

python cross-platform web-crawler rate-limiting json-export interactive-cli link-discovery data-export reconnaissance cli-tool security-research tree-visualization educational-tool web-recon site-mapping website-structure domain-restricted controlled-crawling

Updated Jan 27, 2026
Python

Improve this page

Add a description, image, and links to the website-structure topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the website-structure topic, visit your repo's landing page and select "manage topics."