A URL extraction tool built for operational SEO
In brief
- Sitemap URL extractor that also crawls when no sitemap exists
- Organises and analyses a site’s URLs
- Exports key SEO data for audits and redirect plans
- Built for operational, day-to-day SEO work
- Stack: Python, crawler, sitemap.xml parsing
The goal was to quickly produce a usable list of a site’s URLs, for building a redirect plan or auditing a website. This grew into a full sitemap URL extractor and SEO crawler.
The need
A first Python prototype read a sitemap.xml and exported all URLs to CSV. But not every site has a usable sitemap, some don’t generate one, others make it hard to reach or leave it incomplete.
The solution
To work around that, the script became a crawler able to traverse a site directly, so it can extract URLs whether or not a clean sitemap exists, then organise and export the SEO data.
Key features
- URL extraction from sitemap.xml or live crawl
- Organised, analysable URL output
- Export of essential SEO data
- Ideal for audits and redirect mapping
Results
Building a redirect plan or auditing a site’s URL structure becomes a quick, repeatable task, even on sites with no usable sitemap.
Need an SEO audit or custom tooling? See my SEO audit and consulting.
Auto Moodle Sync – WordPress Plugin
Capimonial, a professional training organisation, needed a custom plugin to synchronise WordPress and Moodle. It automates online course enrolment and strengthens the user experience and data security.
Newsletter Management – WordPress Plugin
NRV Newsletters is a WordPress newsletter plugin built for the NRV agency. It manages campaigns from WordPress, syncs contacts and templates with the Brevo API, and automates mailings from blog posts.
Import Posts – WordPress Plugin
NRV Publication Importer is a WordPress plugin that imports and exports posts in bulk through Excel or CSV files, images included. It is a fast, efficient way to manage content on e-commerce sites and blogs.
