added support for robots.txt exclusion in scraping #35

Triggered via push October 1, 2024 04:18

vtempest

master

Status Success

Total duration 23s

Artifacts 1

static.yml

on: push

Produced during runtime

Name	Size
github-pages Expired	106 KB