Webmasters Stack Exchange
Webmasters Stack Exchange

Questions tagged [sitemap]

A site map (or sitemap) is a list of pages of a web site accessible to crawlers or users.

Making a sitemap to a search engines gives them hints as to which pages it should index and how often they are changed (so should be rescanned). The http://www.sitemaps.org/ site gives details on the syntax for these files.

828 questions
7
votes
1 answer

Solution for large scale site maps

I'm working on a nationwide retail web site with thousands of categories and product pages and my client wants to move from a single sitemap to multiple sitemaps based on page categorization. Here is how the new XML sitemaps for URLs would be…
Mukul
  • 170
  • 1
  • 6
5
votes
6 answers

Looking for a sitemap generator

I am looking for a good way to generate a sitemap for my current site. I inherited a huge site at work and we are going to start the process of IA analysis and redesign. It would be awesome if there was some way to crawl the site and automatically…
Purcell
  • 270
  • 1
  • 6
5
votes
2 answers

Does sitemap.xml contain links to the entire site?

I read up on the limitations and how you can link multiple sitemaps. But my question is, are they to contain links to EVERYTHING or just the most recent X thousand changes?
user1585
4
votes
3 answers

What are some client-side sitemap generators?

Most of the sitemap generators I've found all scan my internal files and base it on that. However using apache and htaccess I have many aliases for things for example: /brand/model/photos/ is empty directory wise, but on the web it relocates it to a…
ParoX
  • 233
  • 3
  • 13
4
votes
3 answers

How do you figure out a large site link/structure?

Suppose you're re-designing an existing large site. The first thing to do is to figure out how the site is structured, how many links, pages, sub domains, etc. Is there a tool you can use to crawl a site and have an easy-to-understand site map…
Andy
4
votes
1 answer

Determining which sitemap entries not indexed by google

We submit a sitemap to google and can see this being indexed in webmaster tools. We have 5140 entries, and have broken this up to 10 child site maps of 500 each. This all seems to be working well. Google, however is not indexing all entries of three…
C4PO
  • 300
  • 2
  • 7
4
votes
1 answer

Is it necessary to re-submit modified sitemaps?

Assuming a sitemap.xml has been registered properly to major players, do these players come and revisit those sitemap.xml from time to time to check for updates and modifications (say new entries are added or removed)? In other words, it is really…
Jérôme Verstrynge
  • 4,625
  • 2
  • 26
  • 49
4
votes
1 answer

Sitemap with pages missing better than no sitemap at all?

I've inherited a site built with a CMS I'm not familiar with. I've created new pages for the site and I can see they do appear in a html sitemap, but not the xml sitemap. Assuming I can't add the pages to the xml sitemap, should I delete the xml…
Evanss
  • 937
  • 7
  • 13
3
votes
1 answer

How often should a sitemap be rebuilt?

How often should a sitemap be rebuilt? Weekly, monthly? I'm curious about adding a dynamic sitemap thats generated weekly. Is that too often?
Maelish
  • 459
  • 1
  • 5
  • 16
3
votes
2 answers

software for mapping links for site migration?

I have a project where I am migrating a website from one platform to another, but the look and feel will still be the same (this is for standardization within an organization). Through re-write rules, I have to maintain any of the links which…
user4994
  • 263
  • 1
  • 5
3
votes
1 answer

How to add sitemap of a blogger blog to Google webmaster tools?

I have two blogs. Let's say http://name.blogspot.com/ and the other one is http://name2.blogspot.com/ For blog 1: While submitting sitemap to Google webmaster tool I selected the option and then added rss.xml at last.…
Chankey Pathak
  • 449
  • 7
  • 16
3
votes
1 answer

Add URL to sitemap to be available in the future

I generate automatically the sitemap.xml on publish of content on my website, however some of the content will be publish starting from an specific date and time. Is there any tag that I can add to a sitemap or any other way to cater for this? so…
mgimeno
  • 31
  • 1
3
votes
1 answer

Is it practical to generate a million page sitemap?

I was recently asked to create a sitemap for an older Apache website with over 20,000 generated database pages. However, halfway through the project I found out that the client neglected to mention that the total inventory was actually around 12…
jcongerkallas1
  • 51
  • 1
  • 2
2
votes
3 answers

Does the sitemap necessarily need to be in the root folder?

I have created a sitemap index and all the additional sitemaps that I want to upload into webmasters tools. Do I need to keep them in the root folder or can I just create a folder called "sitemaps" where I can store them all. The reason I ask is…
ClawDuda
  • 1,197
  • 2
  • 12
  • 23
2
votes
3 answers

Where should sitemap be? (not separate sitemap file)

Most of the big companies got included sitemap at the bottom of thier site. e.g. Piriform / PCTools. I would like to know if there's reason why to put the sitemap above the copyright or they just put it above the copyright because they think its…
Ron
  • 177
  • 2
  • 9
1
2 3