Skip to content

Commit

Permalink
RecRefacto download
Browse files Browse the repository at this point in the history
Use requests-cache
Refacto yaml
Rename "field" argument in yaml to "territory"
Handle zip
Handle nested zip/7zip
Handle CSV/DBF pattern (not only shapefiles)
Refacto tests with CachedSession patching
Split download on multiple files (download, scraper, dataset)
  • Loading branch information
tgrandje committed Sep 21, 2023
1 parent dbd5ab2 commit c971233
Show file tree
Hide file tree
Showing 10 changed files with 1,989 additions and 1,039 deletions.
15 changes: 5 additions & 10 deletions cartiflette/download/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -4,23 +4,18 @@
get_cog_year,
)


from cartiflette.download.download import (
Dataset,
BaseScraper,
HttpScraper,
FtpScraper,
MasterScraper,
download_sources,
upload_vectorfile_to_s3,
download_all,
)

__all__ = [
"get_vectorfile_communes_arrondissement",
# "get_BV",
"get_cog_year",
"Dataset",
"BaseScraper",
"HttpScraper",
"FtpScraper",
"MasterScraper",
"download_sources",
"upload_vectorfile_to_s3",
"download_all",
]
Loading

0 comments on commit c971233

Please sign in to comment.