> ## Documentation Index
> Fetch the complete documentation index at: https://docs.aranx.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Search engine notification

> Tell Bing and other search engines about new, updated, and deleted articles with IndexNow and Cloudflare Crawler Hints

[IndexNow](https://www.indexnow.org) is a free protocol that tells search
engines when a page changes. Aranx submits the URLs of new, updated, and
deleted articles to `api.indexnow.org`. IndexNow shares each URL with Bing,
Yandex, Seznam, Naver, and Yep. Bing also powers ChatGPT search.

Google does not use IndexNow.

## Set up IndexNow

Aranx submits URLs for WordPress sites and API connections.

> [card] [WordPress](https://docs.aranx.com/integrations/wordpress.md#indexnow)
>
> Plugin 1.8.0 and later serves the key file. Update the plugin.

> [card] [API connection](https://docs.aranx.com/integrations/custom-webhooks.md#indexnow)
>
> Serve the key file on your site, then verify it.

For other platforms, use [Cloudflare Crawler Hints](#cloudflare-crawler-hints)
if your domain is on Cloudflare.

## The key file

A search engine accepts URLs for a host only from someone who controls that
host. IndexNow checks this with a key file. Aranx generates one key per
website.

The key file must meet these rules:

* The file name is `{key}.txt`, for example
  `3f2a9c41d07e4b6a8c5d2e1f0a9b8c7d.txt`.
* The file is UTF-8 text. Its only content is the key.
* The file is at the root of each host that serves articles, for example
  `https://www.example.com/3f2a9c41d07e4b6a8c5d2e1f0a9b8c7d.txt`.
  `www.example.com` and `example.com` are separate hosts.
* The host serves the file over HTTPS and answers with a direct `200` within
  10 seconds. A redirect, an HTML page, a login page, a firewall block, or a
  bot challenge fails the check.
* The response has `Content-Type: text/plain` if possible.

## Checks and status

Aranx checks the key file on each host before the first submission, then about
every 24 hours. Aranx submits URLs only for hosts whose key file passed the
check.

| Status | Meaning |
| - | - |
| `not_set_up` | The key file never passed a check. Aranx submits no URLs on this host. |
| `verified` | The key file passed the last check. Aranx submits URLs on this host. |
| `failing` | The host was verified before or IndexNow rejected the key, and the key file no longer passes. Aranx stops submitting URLs. |

Keep the key file in place. When the file fails a check, Aranx stops
submitting URLs for that host until the file passes again.

Other SEO plugins and services, such as Rank Math, Yoast SEO Premium, or the
Microsoft IndexNow plugin, can also submit URLs to IndexNow. They use their own
keys, so their key files have different names. Both can run on one site.

## Cloudflare Crawler Hints

[Crawler Hints](https://developers.cloudflare.com/cache/advanced-configuration/crawler-hints/)
is a free Cloudflare setting on all plans. When it is on, Cloudflare tells
IndexNow about a page when its cache sees changed content. It works for any
platform, and it runs next to the Aranx submissions.

Crawler Hints needs two things:

* You control the Cloudflare zone of your domain.
* The DNS records of your site are proxied (orange cloud).

A Shopify, Webflow, or Wix site that runs only on the platform's own
Cloudflare cannot turn it on. Crawler Hints also does not report deleted
pages, which answer `4xx` or `5xx`. Aranx submissions cover deleted articles.

To turn it on:

**1. Open the zone**

In the Cloudflare dashboard, open the zone of your domain.

**2. Turn on Crawler Hints**

Go to **Caching** > **Configuration** and turn on **Crawler Hints**.

## Troubleshooting

* **The key file returned HTTP 404.** The file is missing at the root of the
  host. Check the exact name and the host in `key_file_url`.
* **The key file redirects.** Serve the file directly with a `200` on each
  host. A redirect from `example.com` to `www.example.com` fails the check for
  `example.com`.
* **The key file does not contain the key.** The body must be the key and
  nothing else. Check that no theme, layout, or error page wraps it.
* **The check fails behind a firewall.** Allow requests for the key file
  through the firewall, bot protection, or login. The check must get the file
  with no challenge.


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.