Blog

SEO work, explained clearly

Practical guides, product changes, and technical analysis from the people building and using Crawl Foundry.

6 articles3 categories

All Technical SEO3 Keyword Research2 SEO1

How to Block or Allow AI Crawlers: GPTBot, ClaudeBot and Others in robots.txt

Technical SEO

AI SearchLLM SEO / GEO

How to Block or Allow AI Crawlers: GPTBot, ClaudeBot and Others in robots.txt

Training, AI search and user-initiated fetches run through different bots. If you tell them apart in robots.txt, you can opt out of AI training and still appear in AI answers.

Matthias RamahiOct 14, 20267 min read

Rank Tracker: How to Measure Keyword Rankings Reliably

Keyword Research

SERP FeaturesSEO Metrics

Rank Tracker: How to Measure Keyword Rankings Reliably

A Google search in your own browser does not show where you really rank. A rank tracker measures under fixed conditions and turns single values into a trend you can trust.

Matthias RamahiOct 12, 20268 min read

Website Migration SEO Checklist: Relaunch Without Losing Rankings

Technical SEO

Technical SEOSEO Strategy

Website Migration SEO Checklist: Relaunch Without Losing Rankings

Most ranking losses after a relaunch can be avoided. This checklist covers the inventory, the redirect plan, the staging check, launch day and the first weeks afterwards.

Matthias RamahiOct 9, 20268 min read

How to Use Google Keyword Planner for SEO: Guide and Limits

Keyword Research

SEO ResearchKeyword Research

How to Use Google Keyword Planner for SEO: Guide and Limits

Google Keyword Planner is free and its search volumes come straight from Google. It is useful for SEO once you know what its numbers mean and what they leave out.

Matthias RamahiOct 7, 20267 min read

Crawled - Currently Not Indexed: How to Find the Cause and Fix It

Technical SEO

Technical SEOGoogle Search

Crawled - Currently Not Indexed: How to Find the Cause and Fix It

Google visited the page and still left it out of the index. Here is how to tell whether that is a problem, find the cause and make the right decision for each group of pages.

Matthias RamahiOct 5, 20268 min read

Ein abstrakter, gläserner Monolith in dunkler Umgebung wird von einem teal-farbenen Lichtstrahl gescannt, um interne Strukturen und Fehlerpunkte sichtbar zu machen.

SEO

Site Audit in Crawl Foundry: How We Designed Technical SEO from Crawl to Implementation

I show how we built the Site Audit in Crawl Foundry as an end-to-end technical SEO process – from crawl configuration through analysis and prioritization to verifiable implementation.

Matthias RamahiJul 24, 20268 min read

Get new SEO articles by email

Choose your language, confirm the subscription, and unsubscribe whenever you want.