[Feature] Store post content

[laundmo]

Storing post content would protect against loosing access to deleted media, 3rd party sites taking down content etc.

Ideally it would be based on a plugin system where its quite easy to create a content extractor for new types of links/posts, with default ones for text and Reddit images/galleries.

Alternatively, or ideally as a plugin for the proposed content storage: Ability to Internet Archive/Wayback Machine links from posts and comments.

[rickcecil]

Just came here to request this!

I get the amount of storage it will take, but I am already doing something like this with Archivebox, so I have the space. It would just be great to be able to have the search and sorting functions specific to Reddit that are in Expanse.

Not sure if something like SingleFile would help with this at all.

Loving what you've done so far @jc9108!

[sugoidogo]

Alternatively, store post content as text by default, and provide a mechanism for a third-party program or plugin to be notified of new posts and their content. Media included in the post can be stored by their direct links and a third-party plugin or program could handle the archiving of said links, and possibly editing the original content to point those links at the archive instead of the web for full offline viewing.

[harveybolton]

+1 I love the concept of this project but after the initial excitement of going through OAuth and seeing my reddit history downloaded I was gutted to learn that images and video aren't included, so I'm still reliant on media being present and not deleted by the user, mods or reddit. Would you consider implementing an image downloader and maybe including yt-dl for video?

I completely understand why you wouldn't want such functionality for your public instance but it would be a great addition to self-hosted variants, perhaps as an additional ENV flag "DL_IMAGES=true and DL_VIDEO=true"

[aplotor]

oops did not mean to reference this issue with that commit. ignore that

[aplotor]

ok. 50 👍 on the issue and i will add this (store locally). good luck

[QtFuta]

I already have something over at my repo 😸
With the plugin system I implemented I can process each post as necessary.
I tried my best to make the system generic and flexible enough, hehe.

In my saveMedia plugin I show how the media content of a post can be saved and how it can be shown in the browser 🥳
I hope this example is enough to show what I had in mind with this system and how it works 😅

I have a new button for each post in the list

When I click it I fetch the data from all the installed plugins inside a modal with tabs

When the pull request #30 is processed I'll check to merge the rest of the code because I have more changes in my repo, hehe 😺
Plus I also have more improvements to make and this pull request would grow more making it more annoying to review 😝