I would like to fetch all recent feed data from particular since time.

[Vignesh-balakrishnan14]

When hitting the recent feed data API, I will get a maximum of 1000, if set the max as 1000. I want to get all recent feed data if the record has more than 1000. Please implement the pagination to retrieve all recent feed data.

[daveajones]

What is the use case for this? What are you trying to do from your side? There are a couple of other endpoints that may give you what you need.

[Vignesh-balakrishnan14]

Hi Dave, Our case is we need to update the podcasts's latest episode details in our application. So, That we tried to use the recent feed API in PodcastIndex.org <http://podcastindex.org/> But we faced previous mentioned issues. Do you have suggestion? Regards, Vignesh

…

On 22-Jun-2021, at 4:59 PM, Dave Jones ***@***.***> wrote: What is the use case for this? What are you trying to do from your side? There are a couple of other endpoints that may give you what you need. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#57 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AUKJJ2T6UKYOIAIXE2E5FSLTUBXY5ANCNFSM47DMWQYA>.

[daveajones]

So, you are trying to track every time any feed in the index is updated?

[Vignesh-balakrishnan14]

Yes, for every 1 or 2 hours.

…

On 22-Jun-2021, at 5:37 PM, Dave Jones ***@***.***> wrote: So, you are trying to track every time any feed in the index is updated? — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#57 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AUKJJ2VTZCVLP7TO3IUJ4G3TUB4JZANCNFSM47DMWQYA>.

[daveajones]

I'm working on a new update endpoint right now that will better suit your needs. We're beta testing it currently. I'll update this issue when it's ready.

[Vignesh-balakrishnan14]

Thanks, @daveajones. Hope that endpoint will have pagination.

[daveajones]

We're using object storage for tracking updates to the index now. The most current feed/episode update data is here:

https://tracking.podcastindex.org/current

You can use the "previousTrackingUrl" of each data block to paginate back in time from wherever you are in the chain. Details here:

https://podcastindex.social/@dave/106456341067494760

[Vignesh-balakrishnan14]

I checked this current feed/episode URL which is useful to us. But we want the iTunes podcast and English language podcasts alone. Have any possibility to add the iTunes ID in feeds array and language filtering in that current feed/episode URL?

[daveajones]

Yes I can add the iTunes id and language to the results. This isn’t a true API endpoint. It’s a data dump to object storage. So, you will need to filter out the languages on your side. This tracks every single change to the database.

The “recent” endpoints put a lot of load on our database, so doing it this way allows us to reduce that.

I will post here when the iTunesID and language are added shortly.

[Vignesh-balakrishnan14]

Okay. Thanks, @daveajones.

[Vignesh-balakrishnan14]

Do you have any idea to include the pagination on the recent feed API?

[daveajones]

Not at this time.

[Vignesh-balakrishnan14]

Okay.

[daveajones]

The itunes id is now added. Language is already there.

[Vignesh-balakrishnan14]

Hi dave,

We need the feed categories. Shall we expect to have the categories attribute in the current feed/episode data?

One more clarification, current feed/episode URL data give currently updated episodes alone or newly created podcasts feed also?

[daveajones]

Let me look and see...

[daveajones]

One more clarification, current feed/episode URL data give currently updated episodes alone or newly created podcasts feed also?

It's both. That is the full firehose of all updates, regardless if they are new or existing.

[Vignesh-balakrishnan14]

Let me look and see...

Please consider. If you don't want to add that attribute. Please let me know.