Failed: Blocked due to unauthorized request (401), google indexing error

I’ve deployed my site on vercel and am having issue on google search console it i showing me that my site in not on google and when I try to request to be indexed it is rejecting my request

here is the site, https://www.deboswift.com/

and here is my sitemap file,

import { MetadataRoute } from "next";

export default function sitemap(): MetadataRoute.Sitemap {
  return [
    {
      url: "https://www.deboswift.com",
      lastModified: new Date(),
      changeFrequency: "monthly",
      priority: 1,
    },
    {
      url: "https://www.deboswift.com/about",
      lastModified: new Date(),
      changeFrequency: "monthly",
      priority: 1,
    },
    {
      url: "https://www.deboswift.com/category/All",
      lastModified: new Date(),
      changeFrequency: "weekly",
      priority: 0.5,
    },
    {
      url: "https://www.deboswift.com/category/Educational%20Events?category=Educational%20Events",
      lastModified: new Date(),
      changeFrequency: "weekly",
      priority: 0.5,
    },
    {
      url: "https://www.deboswift.com/category/Concerts?category=Concerts",
      lastModified: new Date(),
      changeFrequency: "weekly",
      priority: 0.5,
    },
    {
      url: "https://www.deboswift.com/category/Travel%20and%20Adventure?category=Travel%20and%20Adventure",
      lastModified: new Date(),
      changeFrequency: "weekly",
      priority: 0.5,
    },
    {
      url: "https://www.deboswift.com/category/Comedy%20Shows?category=Comedy%20Shows",
      lastModified: new Date(),
      changeFrequency: "weekly",
      priority: 0.5,
    },
    {
      url: "https://www.deboswift.com/category/Art%20%26%20Performance?category=Art%20%26%20Performance",
      lastModified: new Date(),
      changeFrequency: "weekly",
      priority: 0.5,
    },
    {
      url: "https://www.deboswift.com/category/Festivals?category=Festivals",
      lastModified: new Date(),
      changeFrequency: "weekly",
      priority: 0.5,
    },
    {
      url: "https://www.deboswift.com/category/Fashion%20Shows?category=Fashion%20Shows",
      lastModified: new Date(),
      changeFrequency: "weekly",
      priority: 0.5,
    },
  ];
}

and here is my robots.txt file,

import type { MetadataRoute } from "next";

export default function robots(): MetadataRoute.Robots {
  return {
    rules: [
      {
        userAgent: "Googlebot",
        allow: "/",
        disallow: [
          "/events/create",
          "/contact-us",
          "/entrance",
          "/terms",
          "/faq",
          "/profile",
          "/events/*",
          "/api/webhook/clerk",
          "/api/webhook/stripe",
          "/api/uploadthing",
        ],
      },
      {
        userAgent: "*",
        allow: "/",
        disallow: [
          "/private/",
          "/events/create",
          "/contact-us",
          "/entrance",
          "/terms",
          "/faq",
          "/profile",
          "/events/*",
          "/api/webhook/clerk",
          "/api/webhook/stripe",
          "/api/uploadthing",
        ],
      },
    ],
    sitemap: "https://www.deboswift.com/sitemap.xml",
  };
}

Hi, @donnebiyu0! Welcome to the Vercel Community. :raised_hands:

I checked your sitemap file on XML Sitemaps Validator and got this result:

This indicates that the sitemap.xml file is not being served with the correct content type. The HTTP header for sitemap.xml should have a Content-Type of "application/xml", but it currently doesn’t have this set, which could prevent search engines from reading it correctly.

Hope that helps!

hi pawlean tnx for ur reply but here is the site map validation result on my side


but still getting same error

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.