It is possible that our robots cannot access your URLs for various reasons.
To ensure that we can crawl, please consider whitelisting our bots:
IP
Oseox : 92.222.213.109
User agent (default)
Oseox/1.0
Caching and anti-crawl solution
If you are using solutions like DataDome or Cloudflare… we also need to whitelist our robots:
For Cloudflare, create a rule in the Firewall tab.
For DataDome, create a rule in « Custom Rule ».
Hosting
If our bots are still blocked, ask your system administrator for information.