Services consulting

Technical SEO: the unglamorous work everything else depends on

Technical SEO means ensuring search engines can find, crawl, render, index and quickly serve every page you want visible. It is the least visible and most decisive pillar — most sites that "can't rank" have a technical fault.

What does technical SEO cover?

Technical SEO covers everything that determines whether a search engine can successfully access and understand your pages. In practice it is five areas: crawlability, indexability, rendering, performance, and structured data — plus site architecture, which determines how crawl budget flows through the site.

It is unglamorous by design. None of it is a content decision, and none of it produces a launch announcement. But every other SEO activity is downstream of it — a beautifully written page that is not indexed earns nothing, however much authority points at it.

Crawlability

Can the crawler reach the page? robots.txt directives, crawl traps, infinite pagination, session IDs in URLs, blocked user-agents, server errors.

Indexability

Should it be indexed, and is it? noindex directives, canonical errors, duplicate content, soft 404s, conflicting signals.

Rendering

Does the crawler see the finished page? JavaScript dependence, lazy loading, content behind interaction, client-side routing.

Performance

Core Web Vitals — LCP, INP and CLS — plus the underlying causes: server response time, image weight, render-blocking resources, layout shift.

Architecture

Does internal linking distribute authority sensibly? Depth, orphan pages, breadcrumbs, URL structure, faceted navigation on ecommerce.

How does crawling and indexing actually work?

Google's process has distinct stages, and conflating them is the source of much confusion. Understanding which stage has failed tells you what to fix.

The four-stage pipeline. Diagnose which stage breaks before changing anything.
StageWhat happensCommon failureWhere to diagnose
DiscoveryURLs are found via links, sitemaps, past index and external referencesOrphan pages never discoveredSearch Console URL Inspection, sitemap coverage
CrawlingThe crawler requests the URL and receives a response5xx errors, timeouts, blocked by robots.txt, low crawl budgetServer logs, crawl stats report
RenderingJavaScript is executed and the final DOM is producedContent invisible until interaction, hydration errors, blocked resourcesURL inspection live test, rendered HTML vs source
IndexingThe page is parsed, understood and storednoindex, canonical pointing elsewhere, duplicate detection, thin contentPage indexing report, coverage status
ServingIndexed pages are selected and ranked for a queryWeak relevance, poor authority, poor experience signalsPerformance report, manual actions

Note the distinction this creates: a page can be crawled perfectly and still be excluded from the index, and a page can be indexed and still never appear. "My pages are not indexed" and "my pages do not rank" are different problems with different fixes.

Which Core Web Vitals matter and how much?

Three metrics make up Core Web Vitals, assessed at the 75th percentile of real user measurements over 28 days. The thresholds are: LCP good at 2.5 seconds or less, INP good at 200 milliseconds or less, and CLS good at 0.1 or less.

Current Core Web Vitals thresholds. INP replaced FID as a Core Web Vital in March 2024.
MetricMeasuresGoodNeeds improvementPoor
LCP — Largest Contentful PaintHow long until the main content renders≤ 2.5s2.5–4.0s> 4.0s
INP — Interaction to Next PaintHow responsive the page feels when tapped≤ 200ms200–500ms> 500ms
CLS — Cumulative Layout ShiftHow much content jumps around while loading≤ 0.10.1–0.25> 0.25

On ranking impact, be sceptical of anyone claiming a large effect. Core Web Vitals are a relatively small ranking signal compared with relevance and authority, and Google has said as much. The stronger case for fixing them is conversion: a slow site loses a meaningful share of visitors before they ever see what you are selling. Fix them for that reason first.

INP deserves particular attention

INP replaced First Input Delay in March 2024 because FID only measured the latency of the first interaction and ignored everything that happened after it. INP measures the full latency of every interaction throughout the page life, which is why it correlates much better with how responsive a site actually feels. The usual causes are long JavaScript tasks on the main thread, oversized third-party scripts, and hydration work blocking the first tap.

Does JavaScript hurt my SEO?

JavaScript does not inherently hurt SEO, but it adds a failure mode that HTML does not have: the crawler must execute your code before it sees the page. If anything in that chain breaks — an error, a blocked resource, a slow API response — the crawler sees an empty shell and may index nothing.

The practical rules are unexciting but effective. Server-render or statically generate anything that must be indexed: primary content, navigation, internal links, and structured data. Reserve client-side rendering for genuinely interactive authenticated areas. Never lazy-load content that is the main text. And ensure critical content renders without requiring a user interaction — a tab that reveals text on click is invisible to a crawler.

The expensive mistake is a full client-side rendering framework on a site whose content does not need one. You accept rendering risk, hydration cost and INP problems in exchange for an application experience your content site does not need.

How do you migrate without losing traffic?

Site migrations are the most common cause of catastrophic, self-inflicted SEO damage, and they are almost entirely preventable. The risk concentrates in URL changes: every page that moves without a redirect chain loses its accumulated signal and its backlinks.

  1. Map every URL before you move anything. A full export of existing URLs against their equivalents in the new structure. Anything without a match is a decision you have to make deliberately.
  2. Redirect 301, one to one. Every old URL that has a genuine equivalent gets a single permanent redirect to the new one. Do not redirect everything to the homepage — this is the most common and most damaging error, and it wastes the authority you were trying to preserve.
  3. Keep redirects forever. Not six months. Anyone who has removed redirects has regretted it.
  4. Freeze the old structure early. The longer you keep both structures, the more crawl budget you split between them.
  5. Verify in staging with a crawler that executes JavaScript. Then verify again in production within 48 hours, checking status codes, canonical tags and rendered output rather than assuming.
  6. Monitor for at least eight weeks. Coverage, redirect errors and indexed-page count reviewed weekly, with a rollback plan agreed in advance.

Why server logs matter more than any tool

Third-party SEO tools crawl your site from outside, with a synthetic user agent and their own request pattern. That is useful for spotting obvious issues and nearly useless for understanding what Googlebot actually does.

Server logs record every request your site received, including the ones no audit tool can see: how often Googlebot visits, which URLs it ignores repeatedly, how long it spends on your largest pages, and how much of its activity is wasted on parameters and duplicates. Crawl budget problems are essentially invisible without them.

The SEO audit checklist covers the checks you can run yourself, and the Core Web Vitals guide goes deeper on performance.

Related services

SEO Consulting

The broader strategy this work sits inside.

Read more

Core Web Vitals in 2026

LCP, INP and CLS explained and fixed.

Read more

Analytics & Tracking

Confirming the technical work actually changed your numbers.

Read more

Frequently asked questions

How do I know if I have a technical SEO problem?
Check Search Console first. The Page Indexing report lists excluded URLs with the specific reason for exclusion, which is more reliable than any third-party score. Then compare your indexed page count against your expected page count in a sitemap or a crawl. A large gap is the signal — and the reason listed next to each excluded URL tells you what to fix.
Does site speed affect rankings?
Yes, but modestly — and the case for prioritizing it is conversion rather than ranking. Google treats Core Web Vitals as a relatively small signal compared with relevance and authority. A slow site loses a meaningful share of visitors before they see your product, which is usually a larger financial effect. Fix performance for the revenue case and treat the ranking benefit as a bonus.
What is INP and why did it replace FID?
INP stands for Interaction to Next Paint and replaced First Input Delay as a Core Web Vital in March 2024. FID only measured the delay before the first interaction and ignored everything after it, so a page could score well while remaining janky for the rest of the session. INP measures the full latency of every interaction across the page's life, which correlates far better with perceived responsiveness.
Do I need a sitemap?
For a small site under a few hundred pages that is well linked internally, a sitemap helps discovery but is not critical — Google finds pages by following links. For a large site, an XML sitemap is close to essential because it is the most reliable way to ensure deep pages get discovered and to communicate priority and last-modified dates. It must contain only canonical, indexable, 200-status URLs, and it does not override robots.txt or noindex directives.
Should I block low-value pages or noindex them?
Noindex them. Blocking in robots.txt prevents the crawler from seeing the noindex tag, so the URL can remain in the index indefinitely as a bare result. If you want a page out of the index, the crawler must fetch it and read the directive. Blocking is only for crawler-waste situations such as infinite URL spaces, and it is dangerous when misapplied.
How often should a technical SEO audit be repeated?
A full audit annually is reasonable for a stable site, and immediately after any migration, redesign or platform change. Between those points, monthly monitoring of index coverage, Core Web Vitals and crawl errors catches regressions far earlier than an annual review would.
What is crawl budget and do I need to worry about it?
Crawl budget is the number of requests Googlebot will make to your site over a period. It matters most on large sites — hundreds of thousands of pages — or sites that generate unbounded URLs through parameters, calendars or faceted navigation. For a site under a few thousand well-structured pages, it is rarely the limiting factor and optimising for it is usually wasted effort.
Can technical SEO fixes be done without developer resource?
Some can. Meta titles, descriptions, internal linking, content and most structured data need no engineering time. Redirects, robots.txt, canonical implementation, rendering changes and Core Web Vitals remediation almost always do. If you have no developer capacity, we will tell you which items are worth raising as a business case rather than including them in a plan that will quietly stall.

Need technical seo for your business?

Get a free, no-obligation review of where you stand today on technical seo — and the three changes that would move the number that matters. No pitch deck.

Book a free 30-minute audit