Manage Crawlers and Background Jobs

Open Crawlers & Jobs from the sidebar and select your website. The Crawlers & Background Jobs page controls which jobs can run for that website. It also shows Job execution & credit usage.

​

Available jobs

​

Manual and automatic controls

Each job has separate manual and automatic switches.

• Manual jobs: allow you to start the corresponding operation from the panel.
• Automatic jobs: allow background refreshes on the service’s configured schedule.

Toggle the setting you need and wait for it to save. These controls apply to the selected website. Turning a job off does not erase its saved results. This page does not let you choose an arbitrary cron schedule. Some research modules have their own schedule settings; see AI Visibility and Competitor monitoring.

​

Credit usage

Read the cost shown for each job before starting a large scan. Some operations include a base cost and an additional charge for each block of pages. Costs come from the current billing rules. Automatic jobs still require the appropriate plan, enough credits, and a reachable website. Enabling a switch does not override these requirements.

​

If results stop updating

Check that the appropriate manual or automatic switch is enabled, select the correct website, and check your subscription and credit balance. Review the last scan time in the relevant module. If a scan fails, check the domain, DNS, SSL, and crawler access before retrying. If background results remain stale, create a Support Ticket with the website, job name, last successful time, and error message.