Sito web live in https://rankings.polinetwork.org/
Rewrite in C# della repo https://github.com/PoliNetworkOrg/GraduatorieScript
Note: this may upgrade older versions installed
sudo apt-get update && sudo apt-get install dotnet-sdk-7.0 git
- get git submodules (libraries)
git submodule update --init --recursive
- install dotnet deps
dotnet restore
- run
dotnet run --project PoliNetwork.Graduatorie.Parser
Projects:
PoliNetwork.Graduatorie.Scraper
scrapes links from PoliMi and obtain htmlPoliNetwork.Graduatorie.Parser
runs scraper then parses html into objects/json
Parameters:
--reparse
regenerate all rankings files (use it when make changes to data structure)--data dir
specify where is the data folder
Data folder has been moved to RankingsDati in #128 therefore the script won't find it.
Clone this repo and RankingsDati then follow one of these two methods:
-
Run the script specifying where is the data folder with the
--data dir
param.dotnet run --project PoliNetwork.Graduatorie.Parser --data ../RankingsDati/data
-
Create a symbolic link inside the script repo pointing to the data folder inside RankingsDati so that the script would find it independently.
ln -s ../RankingsDati/data/ dotnet run --project PoliNetwork.Graduatorie.Parser
Git should ignore the link created (because
data
is inside.gitignore
)
The script output will be in the data folder found (copied on reference).
In both cases you may check that RankingsDati is up-to-date to avoid
false positive or incomplete output.