Admin cfd893d24b perf(scraper): switch chapter list to direct HTTP, remove Browserless dependency ...

novelfire.net chapter-list pages (/chapters?page=N) are server-rendered —
verified via curl. Switch urlClient to NewDirectHTTPClient alongside the
existing chapterClient. Remove BROWSERLESS_URL_STRATEGY env var and clean
up the now-irrelevant WaitFor/GotoOptions fields from both ScrapeChapterList
and ScrapeChapterListPage ContentRequests.

2026-03-03 20:46:22 +05:00

7.1 KiB

Raw Blame History

View Raw