Knowledgebase

LiteSpeed’s Crawler is part of the LiteSpeed Cache plugin for WordPress. By default, cache pages are generated when a user first visits an uncached page — after that, other visitors get the cached version. The crawler simulates visits to keep your cache warm and up to date.

Steps to Enable the LiteSpeed Crawler

1. Enable the crawler in LiteSpeed server settings

1. Log in to your LiteSpeed WebAdmin Console at https://YOUR_SERVER:7080 (port 7080 by default).

2. Go to: Configuration → Server → Cache

3. Edit Cache Storage Settings:

   • Set Cache, Crawler, and ESI to On.

4. Save your changes and restart LiteSpeed.

2. Check PHP functions

1. Open the relevant php.ini file (usually located at /usr/local/lsws/lsphpXX/etc/php.ini — where XX is your PHP version, e.g., lsphp80).

2. Find the disable_functions line and ensure these functions are NOT listed:

   • curl_multi_exec, exec, pcntl_exec, popen, proc_close, proc_open

3. Save the file and restart LiteSpeed.

3. Install PHP XML extension

Make sure the PHP XML module is installed. Run:

yum install lsphpXX-xml

Replace XX with your PHP version.

4 For cPanel servers (extra step)

1. Edit pre_main_global.conf and add:

   CacheEngine on crawler
   

2. Apply the changes:

   /scripts/ensure_vhost_includes --all-users
   

3. Restart LiteSpeed.

5. Set up the crawler in LiteSpeed Cache for WordPress

1. In your WordPress dashboard, go to LiteSpeed Cache → Crawler.

2. Under General Settings, enable the crawler.

3. Adjust the server load limit and thread count as needed for your server resources.

4. Save the settings.

Done!
Your LiteSpeed crawler will now keep your site cache fresh automatically.