help wanted🕷️ SEO
Repository metrics
- Stars
- (477 stars)
- PR merge metrics
- (Avg merge 15d 21h) (157 merged PRs in 30d)
Description
Problem
- A lot of product pages are not indexed in a timely manner
- Some facets are not indexed in a timely manner
Problem size
- Ensure we have a sitemap.xml for a quick, up to date, canonical compliant and multlingual indexation (site:openfoodfacts.org does not return the volumetry you'd expect, de.openfoodfacts.org is 4K product late, and products from the rest of the world are not indexed in German via world-de)
- Products: 2,6M
- site:openfoodfacts.org: 7,5M
- site:world-*.openfoodfacts.org: 1,47M
- site:de.openfoodfacts.org: 166k
- site:it.openfoodfacts.org: 123k
- site:world-it.openfoodfacts.org: 163k
- site:world-fr.openfoodfacts.org: 177k
- site:fr.openfoodfacts.org: 0,98M
- site:world-de.openfoodfacts.org: 66k
- site:world-zh.openfoodfacts.org: 83k
- site:cn.openfoodfacts.org: 3120
- site:world-es.openfoodfacts.org: 305k
- site:es.openfoodfacts.org: 379k
- site:world-nl.openfoodfacts.org: 37k
- site:nl.openfoodfacts.org: 6470
Proposed solution
- Create a Sitemap for ProductOpener
Why
- Increase indexation speed for new pages (eg new Products, new Packager codes that were fixed)
- Ease the burden on the server by having bots index the valuable stuff
Part of
- #7583