this is an open source, functionaly equivalent module to http://backfeed.strangecode.com/
From a given domain, try to discover as many old archived RSS feeds as possible using the Internet Archive's Wayback Machine.
The RSS feeds are discovered by searching the Wayback Machine using the CDX Server API. RSS and ATOM feeds are discovered by searching by MIME type and using regular expressions for RSS URLs.
An undocumented id_
flag is used to download unmodified original files as described here.
This may be useful for finding many links and creation dates for content on arbitrary domains.
Each found URL will be printed on standard output on its own line. You may feed this directly into something like wget
.
Example command line usage:
./rsstimemachine.py example.com | wget --force-directories --input-file=-
Example usage as python module
domain = 'https://www.questformeaning.org/feed/'
import rss_timemachine
urls = rss_timemachine.search_archive(domain)
- BUG: The program may find other XML files that are not feeds
- Possibly handle non-200 status codes better
- Merge RSS feeds (from different snapshots in history of feed on archive.org) using an external tool or write it myself