WebCDN and caching with search robots


With the release of jwebcdn version 35, all websites configured with caching will continue to use the cached version of an URL regardless of its expiricy if the client is a search engine robot.
If a normal user visits the URL and cache is expired, a fresh version will be sent and stored in cache. Thus, the search engine will also get the fresh version.

This behaviour should have negligible consequences for content on search engines and AI search engines. Many seach engines give better SEO when a page load is fast.


2025-01-23