# GEOKit — Comprehensive Full Documentation for AI & LLM Systems

> GEOKit is a free, 100% client-side, privacy-focused web toolkit dedicated to Generative Engine Optimization (GEO). It empowers developers, webmasters, SEO professionals, and content creators to optimize websites for citation, recommendation, and indexing by AI search engines including ChatGPT, Perplexity, Google AI Overviews, Gemini, Claude, and DeepSeek.

---

## Table of Contents
1. Overview & Architectural Principles
2. Detailed Specifications for All 14 Tools
3. Key Technical Standards (llms.txt, AI Robots, Schema)
4. Frequently Asked Questions (FAQ)
5. Privacy, Data Security, & License

---

## 1. Overview & Architectural Principles

Generative Engine Optimization (GEO) represents the paradigm shift from traditional search engine optimization (ranking blue links for keywords) to generative AI optimization (getting cited, synthesized, and recommended in direct conversational answers).

GEOKit provides zero-signup, client-side browser utilities designed to solve technical and structural hurdles in AI indexing:
- **Zero Remote Storage**: Inputs and processing remain in the client browser DOM.
- **Standards Compliant**: Follows official specifications for `llms.txt`, schema.org JSON-LD, and robots.txt User-Agent rules.
- **Machine Readable**: All generated outputs prioritize high signal-to-noise ratio for LLM tokenization.

---

## 2. Detailed Tool Documentation

### 2.1 llms.txt Generator (`/tools/llms-txt-generator`)
- **Purpose**: Generates standardized `/llms.txt` markdown files following the official specification.
- **Inputs**: Site H1 Title, Summary, Section Headings, Link Titles, URLs, and optional notes.
- **Outputs**: Properly formatted H1, blockquote summary, H2 section headers, and bulleted markdown links.

### 2.2 AI Search Grader (`/tools/ai-search-grader`)
- **Purpose**: Evaluates brand visibility and Share of Voice across major LLM search engines.
- **Models Targeted**: ChatGPT (OpenAI), Gemini (Google), Claude (Anthropic), Llama (Meta), Mistral, DeepSeek.
- **Metrics**: Mentions count, position ranking, sentiment, citation presence.

### 2.3 AI Robots.txt Generator (`/tools/ai-robots-txt-generator`)
- **Purpose**: Configures granular crawler permissions for AI scrapers vs traditional search bots.
- **Default User-Agents Handled**: `*`, `GPTBot`, `ClaudeBot`, `PerplexityBot`, `Google-Extended`, `CCBot`, `Bytespider`.

### 2.4 Schema for AI Generator (`/tools/schema-generator`)
- **Purpose**: Produces JSON-LD structured data formats optimized for semantic LLM parsing.
- **Supported Schemas**: WebSite, WebApplication, Organization, Article, Product, FAQPage, HowTo.

### 2.5 AI Readiness Checker (`/tools/ai-readiness-checker`)
- **Purpose**: Audits a given URL against a 0–100 GEO score rubric checking metadata, robots headers, sitemaps, and llms.txt presence.

### 2.6 llms.txt Validator (`/tools/llms-txt-validator`)
- **Purpose**: Lints pasted markdown for H1 presence, valid link syntax, non-relative URLs, and structural compliance.

### 2.7 GEO Checklist (`/tools/geo-checklist`)
- **Purpose**: Interactive, client-persisted checklist guiding users through technical, structural, and content-level GEO tasks.

### 2.8 AI Sitemap Generator (`/tools/ai-sitemap-generator`)
- **Purpose**: Constructs XML sitemaps with custom priority weighting and frequency flags tailored for LLM scrapers.

### 2.9 Meta Tag Generator (`/tools/meta-tag-generator`)
- **Purpose**: Generates HTML `<meta>` tags incorporating OpenGraph, Twitter Cards, citation licenses, and author metadata.

### 2.10 Q&A Content Formatter (`/tools/qa-content-formatter`)
- **Purpose**: Converts dense unstructured prose into conversational Q&A pairs optimal for RAG (Retrieval-Augmented Generation) and direct LLM answer extraction.

### 2.11 AI Crawler Tester (`/tools/ai-crawler-tester`)
- **Purpose**: Simulates requests using AI User-Agents to verify server response codes, JS rendering requirements, and clean text extraction.

### 2.12 GEO Score (`/tools/geo-score`)
- **Purpose**: Grades pasted content with an instant 0–100 GEO Score measuring AI citability: direct answer potential, structure, citation worthiness, and 12 GEO/SEO dimensions.

### 2.13 Schema Validator & Preview (`/tools/schema-validator`)
- **Purpose**: Validates JSON-LD structured data syntax and previews how markup renders in Google Rich Results.

### 2.14 Sitemap Validator & Checker (`/tools/sitemap-validator`)
- **Purpose**: Validates sitemap XML syntax and sitemaps.org namespace compliance, measures file weight against limits, and pings page URLs for HTTP status codes to surface broken links and redirect waste.

---

## 3. Key Technical Standards & Code Templates

### 3.1 Recommended Production `robots.txt` Snippet for AI Search
Below is the standard `robots.txt` configuration generated by GEOKit to allow real-time AI Search models (ChatGPT, Perplexity, DeepSeek) while reserving rights for generic scrapers:

```txt
User-agent: *
Allow: /
Allow: /llms.txt
Allow: /llms-full.txt
Allow: /openapi.yaml

# AI Search & Real-Time RAG Crawlers
User-agent: GPTBot
Allow: /

User-agent: OAI-SearchBot
Allow: /

User-agent: ChatGPT-User
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: ClaudeUser
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: PerplexityUser
Allow: /

User-agent: DeepSeekBot
Allow: /

User-agent: DeepSeek
Allow: /

User-agent: Meta-Llama
Allow: /

User-agent: MistralBot
Allow: /

Sitemap: https://geokit.site/sitemap.xml
```

### 3.2 Standard `llms.txt` Minimal Starter Template
Below is the minimal valid `llms.txt` format according to the specification:

```markdown
# Your Site Name

> Brief 1-2 sentence description summarizing what your site or application does.

## Full Documentation

- [Full Corpus](https://example.com/llms-full.txt): Complete plain-text documentation.

## Core Resources

- [Documentation](https://example.com/docs): Official developer documentation.
- [API Reference](https://example.com/api): Complete API endpoints list.
```

### 3.3 Production WebApplication JSON-LD Schema
```json
{
  "@context": "https://schema.org",
  "@graph": [
    {
      "@type": "WebApplication",
      "@id": "https://geokit.site/#webapp",
      "name": "GEOKit",
      "applicationCategory": "BusinessApplication",
      "operatingSystem": "All",
      "offers": {
        "@type": "Offer",
        "price": "0",
        "priceCurrency": "USD"
      },
      "publisher": {
        "@type": "Organization",
        "@id": "https://geokit.site/#organization"
      }
    },
    {
      "@type": "Organization",
      "@id": "https://geokit.site/#organization",
      "name": "GEOKit",
      "url": "https://geokit.site",
      "logo": "https://geokit.site/icon-512.png"
    }
  ]
}
```

---

## 4. GEO Glossary & Definitions

- **Generative Engine Optimization (GEO)**: The technical discipline of optimizing digital content and infrastructure so Large Language Models (LLMs) and conversational AI engines can crawl, parse, synthesize, and cite the site as an authoritative source.
- **`llms.txt`**: A standardized markdown file placed in the web root (`/llms.txt`) providing a clean index of essential site documentation for AI crawlers without HTML/JS overhead.
- **Citation Density**: The ratio of factual, unambiguous, and synthesizable information blocks relative to decorative layout elements on a webpage.
- **Synthesizable Content**: Text formatted in structured Q&A, bulleted lists, and step-by-step numbers that LLMs can extract verbatim or rephrase directly into chat responses.

---

## 5. Frequently Asked Questions (FAQ)

**Q: What is the difference between SEO and GEO?**
A: Traditional SEO aims to rank web pages on search engine result pages (SERPs) for specific keywords. GEO (Generative Engine Optimization) aims to make content easily digestible, authoritative, and direct for Large Language Models so that AI search engines (like ChatGPT, Perplexity, and DeepSeek) cite your website as an authoritative source in conversational answers.

**Q: Is GEOKit free to use for commercial projects?**
A: Yes. All tools on GEOKit are 100% free for both personal and commercial use without registration or subscription.

**Q: Does GEOKit send user data to remote servers?**
A: No. All diagnostic calculations, generation logic, parsing, and scoring run 100% locally inside your browser DOM.

---

## 6. Contact & Machine Endpoints
- **Website**: https://geokit.site
- **Sitemap**: https://geokit.site/sitemap.xml
- **llms.txt Index**: https://geokit.site/llms.txt
- **llms-full.txt Corpus**: https://geokit.site/llms-full.txt
- **OpenAPI Specification**: https://geokit.site/openapi.yaml
- **AI Plugin Manifest**: https://geokit.site/.well-known/ai-plugin.json