Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scraper missed an event when Metro changed the event time #267

Closed
reginafcompton opened this issue Mar 9, 2018 · 1 comment
Closed

Scraper missed an event when Metro changed the event time #267

reginafcompton opened this issue Mar 9, 2018 · 1 comment

Comments

@reginafcompton
Copy link
Contributor

Summary
Recently, Metro changed the time of the "Finance, Budget, and Audit Committee" meeting on 3/14. The scraper did not acknowledge the change. Why? The EventLastModifiedUTC read as "2017-12-14T23:05:00.18" - in other words, the timestamp did not correspond with the time that Metro changed the event. As a result, the scraper did not scrape the event.

Brainstorming steps forward
(1) It seems possible that the Legistar EventLastModifiedUTC does not communicate the way our scrapers expect. As a result, we may need to limit the number of times we look for event updates. Once per hour seems reasonable.
(2) Does Metro have any control over this timestamp in the API? Can they insure that the timestamp changes when they update an event, or does Legistar fully automate this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant