Skip to content

Latest commit

 

History

History

evaluation

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
data
data
 
 
Prepare data.ipynb
Prepare data.ipynb
 
 
Process results.ipynb
Process results.ipynb
 
 
README.md
README.md
 
 
Run benchmark.ipynb
Run benchmark.ipynb
 
 

README.md

Evaluation

To evaluate our tool, we computed the bus factor of 935 popular repositories on GitHub. Datasets are available in data directory.

The whole process is implemented using jupyter notebooks:

  1. Prepare data: loads the most starred repos using GraphQL API
  2. Run benchmark: loads the dataset and executes the bus factor analysis for each repo 10 times and collects the runtime metrics
  3. Process results: loads a CSV with benchmark data and plots a scatter chart based on analysis median time.