The short version: a sitemap tool shows you the site you built, not the one you think you built, and the gap between those two things is usually where your traffic is leaking out. Run a visual crawl, find the orphaned pages and the dead ends, then rebuild your internal linking around your five or six most important pages. It takes an afternoon and it will make your SEO agency’s job about ten times easier.
I had a client last year, a home renovation firm in Kent, whose site had 214 pages. When I ran it through a visual sitemap crawler, 61 of those pages had no internal links pointing to them at all. Sixty-one. Google could still find some of them through the XML sitemap, but a human being clicking through the site would never stumble across them, and neither would the AI answer engines that are increasingly deciding whose content gets quoted. That’s the problem a sitemap tool solves. Not “does Google know this page exists” but “does this page function as part of a website, or is it just floating in space.”
What a sitemap tool shows you
There are two very different things people call a “sitemap tool” and it matters which one you’re using.
- XML sitemap generators produce the file you submit to Google Search Console, a flat list of URLs telling search engines what exists. Yoast and Rank Math do this automatically on WordPress. Useful for indexing, useless for structure.
- Visual sitemap crawlers map your site as a tree or a network diagram, showing which pages link to which, how many clicks deep each page sits, and where the orphans are. Tools like Screaming Frog, Sitebulb, and the free options I cover in my free website mapping and sitemap tools roundup do this.
You need the second one to fix structure. The XML file just reports what’s there, it doesn’t tell you anything is wrong.
Step by step: the audit I run on every client site
This is the exact process, no shortcuts, and it takes me about 90 minutes on a mid-sized site of 100 to 300 pages.
- Step 1: Crawl the whole site. Screaming Frog’s free version crawls up to 500 URLs, which covers most small business sites. Paste in the domain, hit start, let it finish.
- Step 2: Pull the orphan pages report. These are pages the crawler only found via the XML sitemap, not through any internal link. If a page is orphaned, no visitor, no bot following links, and increasingly no AI crawler will ever reach it naturally.
- Step 3: Check crawl depth. Any page sitting more than 3 clicks from the homepage is structurally buried. I’ve seen cornerstone service pages sitting at depth 5 because someone nested them under three layers of category pages that made sense to whoever built the site in 2019 and to nobody since.
- Step 4: Map the visual tree. Look at the shape. A healthy small business site looks like a flat fan: homepage at the top, 6 to 10 main sections branching off, each with a handful of children. A broken one looks like a tangled root system with pages linking sideways into nowhere.
- Step 5: List your 10 money pages. These are the pages you want ranking and converting: your services, your pricing, your top 3 blog posts by traffic. Check how many internal links each one currently gets. I’ve routinely found £2,000-a-month service pages with 2 internal links, while a throwaway 2019 blog post about a Christmas party had 40.
- Step 6: Rebuild the links. Add links from your highest-traffic existing pages into your money pages. Not “click here”, use the actual keyword phrase as anchor text.
The uncomfortable bit nobody tells you
Here’s what most guides on this topic skip over: fixing your sitemap will usually mean deleting content, not just relinking it. When I ran that Kent client’s crawl, 22 of those 61 orphaned pages were old blog posts with zero traffic in three years, thin, outdated, and frankly embarrassing to have live. The tempting move is to “rescue” every orphan by adding a link to it. Don’t. Some of those pages should be 301 redirected to a stronger page or deleted outright and cleaned out of the XML sitemap entirely.
Site structure isn’t just about connecting everything you’ve got, it’s about admitting some of what you’ve got isn’t worth connecting. I’ve had clients get uncomfortable at this step because it feels like admitting five years of blogging didn’t work. Sometimes it didn’t. That’s fine. Cut it, redirect it, move on.
Where structure problems come from
In my experience running these audits for small businesses across the UK, US and here in Israel, the same three causes show up again and again:
- Category creep. Someone adds a new blog category every few months without ever pruning old ones, so you end up with 40 categories for 90 posts.
- Platform migrations done badly. Moving from Wix to WordPress, or the other way round, without mapping old URLs to new ones. If you’re planning that move, read my honest comparison of Wix vs WordPress for a small business website before you touch anything, and separately, my SEO tips for website migration guide, because a botched migration is the single fastest way to create hundreds of orphaned pages overnight.
- No one owns the site map. Marketing adds pages, the web developer adds pages, someone in sales asks for a landing page for a trade show, and eighteen months later nobody has the full picture. A sitemap tool is the fastest way to get that picture back.
Fixing the shape, not just the links
Once you’ve run the crawl, the fix usually falls into one of four buckets.
- Flatten deep pages. If your best service page is buried at depth 4, add a direct link to it from your homepage or main navigation. Don’t make Google, or a customer, dig for your best work.
- Consolidate thin pages. Three 300-word blog posts covering nearly the same topic should become one 1,500-word page. Redirect the old two into the new one.
- Build topic clusters. Pick your main service pages as “pillar” pages, then link every related blog post back to that pillar. This is the single biggest structural change I make on client sites and it’s usually good for a 15 to 30% lift in organic traffic to those pillar pages within three months, based on the handful of sites I’ve tracked before and after.
- Kill the dead weight. Redirect or delete pages with no traffic, no backlinks, and no strategic purpose. Fewer, stronger pages beat more, weaker ones every time.
If you want a fuller list of tools beyond Screaming Frog, including some free options that work well for sites under 500 pages, my roundup of top sitemap generator tools covers what I’d recommend depending on your platform and budget. And if you’re newer to why any of this matters for rankings in the first place, it’s worth reading why you should SEO optimize your website alongside this, because sitemap structure is one piece of a bigger picture, not the whole thing.
A quick real example of what changes
Back to that Kent renovation client. After the audit: we deleted 22 dead blog posts, redirected 14 near-duplicate pages into 5 stronger ones, and added direct homepage links to their 4 core service pages which had been sitting at crawl depth 4. Three months later their core “kitchen extension” service page moved from position 14 to position 6 on Google for their main local search term, and organic enquiries through the contact form went from roughly 8 a month to 19. Nothing about their actual writing changed. The content on that page was the same. What changed was that Google, and visitors, could find it and understand it was important.
That’s the whole point of this exercise. A sitemap tool doesn’t write better content for you. It shows you where your good content is buried and stops you burying more of it by accident.
One more thing worth checking while you’re in there
While you’ve got the crawl open, look at your footer links. Most small business footers are a graveyard of “Privacy Policy, Terms, Contact, About” repeated on every single page, which is fine, but I regularly find footers still linking to pages that were deleted two redesigns ago, 404s hiding in plain sight on every page of the site. Fix those while you’re there. It’s a five-minute job once you’ve already got the crawl data in front of you, and it’s the kind of thing that makes a site feel cared for rather than abandoned. Worth a browse through my list of 50 websites you didn’t know existed too, purely because seeing how well-structured sites in completely different niches organise themselves is a good way to spot what your own is missing.
Frequently asked questions
How often should I run a sitemap audit?
Every 6 months for an active site, or immediately after any migration, redesign, or bulk content push. If you’re publishing weekly, check quarterly, because orphaned pages accumulate faster than most people expect.
Do I need a paid tool or does the free version of Screaming Frog work?
The free version handles up to 500 URLs, which covers the vast majority of small business sites. You only need to pay if you’re auditing a site with more pages than that or want scheduled recrawls.
Does a sitemap tool fix my rankings by itself?
No. It shows you the structural problems, buried pages, orphaned content, weak internal linking, but you still have to make the changes yourself. Think of it as an X-ray, not the surgery.
What’s the biggest mistake people make when using a sitemap tool?
Trying to save every page instead of deleting the weak ones. Adding a link to a thin, outdated page just moves the problem, it doesn’t fix it. Sometimes the right structural fix is a redirect or a delete, not another link.
Related reading: How to Schedule an Entire Photo Album on Facebook in Advance and What Is A Website Mapping Tool And Do You Need One.
For the bigger picture, see my full guide to productivity.
