Troubleshooting

The site is up but datasets never update

• Confirm the worker is running (npm run worker).
• Confirm DATABASE_URL is correct and migrations have run.
• Check Management → Runs and Management → Alerts for errors.

Crawls are slow / time out

• Reduce max_requests_per_run for a project to keep runs bounded.
• Lower rate_limit_rps (be polite).
• Increase concurrency carefully (10 max).

Admin UI shows 401/403

• If using token auth: verify EMERGENCY_ADMIN_TOKEN matches what you entered.
• If using SSO header auth: verify the proxy injects the header configured in ADMIN_TRUSTED_EMAIL_HEADER and the email matches the allowlist.

Filesystem sources fail

• If you set FILESYSTEM_ALLOWED_ROOTS, ensure the path is within one of the allowed roots.