Skip to content

Find archived RSS feeds on archive.org

Notifications You must be signed in to change notification settings

marcmaxson/rsstimemachine

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 

Repository files navigation

RSS Time Machine - forked, python 3 version

this is an open source, functionaly equivalent module to http://backfeed.strangecode.com/

From a given domain, try to discover as many old archived RSS feeds as possible using the Internet Archive's Wayback Machine.

The RSS feeds are discovered by searching the Wayback Machine using the CDX Server API. RSS and ATOM feeds are discovered by searching by MIME type and using regular expressions for RSS URLs.

An undocumented id_ flag is used to download unmodified original files as described here.

This may be useful for finding many links and creation dates for content on arbitrary domains.

Usage

Each found URL will be printed on standard output on its own line. You may feed this directly into something like wget.

Example command line usage:

./rsstimemachine.py example.com | wget --force-directories --input-file=-

Example usage as python module

domain = 'https://www.questformeaning.org/feed/'
import rss_timemachine
urls = rss_timemachine.search_archive(domain)

TODO

  • BUG: The program may find other XML files that are not feeds
  • Possibly handle non-200 status codes better
  • Merge RSS feeds (from different snapshots in history of feed on archive.org) using an external tool or write it myself

About

Find archived RSS feeds on archive.org

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%