kamil/libnovel
1
0
Fork 0
Code Issues Pull Requests 3 Actions Packages Projects Releases 162 Wiki Activity
Files
d14644238f56afbb26b435d7fbce299a94cf979b
libnovel/scraper
History
Admin d14644238f fix(scraper): fix ScrapeCatalogue selectors, zero-byte cache skip, and wire ScrapeRanking into runAsync 
- ScrapeCatalogue: use li.novel-item (was div), extract href from outer <a> and title from h4.novel-title (was h3), detect next page via rel=next (was class=next)
- handleBrowse/triggerBrowseSnapshot: treat zero-byte MinIO cache entries as misses, skip storing empty SingleFile output
- runAsync: after a successful full-catalogue run, call ScrapeRanking and upsert each result into PocketBase ranking collection
2026-03-04 16:54:00 +05:00
..
cmd/scraper
feat(scraper): rewrite browse storage to domain/html+assets structure, populate ranking from snapshot
2026-03-04 15:13:09 +05:00
internal
fix(scraper): fix ScrapeCatalogue selectors, zero-byte cache skip, and wire ScrapeRanking into runAsync
2026-03-04 16:54:00 +05:00
.dockerignore
fix(scraper): replace glibc binary with npm single-file-cli on node:22-alpine
2026-03-04 12:54:51 +05:00
Dockerfile
fix(scraper): replace glibc binary with npm single-file-cli on node:22-alpine
2026-03-04 12:54:51 +05:00
go.mod
feat(scraper): remove HTMX UI — delete ui.go, extract helpers.go, drop goldmark dependency
2026-03-02 22:03:36 +05:00
go.sum
feat(scraper): remove HTMX UI — delete ui.go, extract helpers.go, drop goldmark dependency
2026-03-02 22:03:36 +05:00