motrpac-tools

Scripts and Tools useful for MoTrPAC

make_manifest.py

• Makes manifest for submission MoTrPAC files to BIC
• Requires Python 3.x
• Examples:

  • ./make_manifest.py --help

    outputs help info

  • ./python make_manifest.py /path/to/upload/ file_manifest_YYYYMMDD.csv

    makes manifest.csv based on files in /path/to/upload/

Output file: for Motrpac data submissions, the output must be named: file_manifest_DATE.csv. The format ofDATE must be YYYYMMDD (YYYY = year, MM = month, DD = day)

usage: make_manifest.py [-h] data_path output

Creates manifest for submission to BIC: a comma separated file table of
relative file paths and md5 sums.

positional arguments:
  data_path   Full path to folder containing all files for data submission
  output      Path to the output file

optional arguments:
  -h, --help   Show this help message and exit
  -q, --quiet  Do not show file paths as they are hashed

hash_files.py

• Simple file to show how to make hash digests. NOTE: THIS DOES NOT MATCH THE CURRENT SUBMISSION SPEC
• Requires Python 3.x
• Examples:

  • ./hash_files.py --help

    outputs help info

  • ./hash_files.py --algorithm md5 --ending pdf --recursive --output output.txt --verbose

    gets md5 hash for all files ending in pdf down a directory tree and writes the results to a file called output.txt

  • ./hash_files.py --algorithm sha256 --file text.txt --verbose

    gets sha256 hash for the file text.txt in the current directory and outputs the results to the terminal only

usage: hash_files.py [-h] -a {sha256,sha3_512,sha1,sha512,md5} [-o [OUTPUT]]
                     [-v] [-r] (-f FILE | -e ENDING)

Basic Hashing Tool Using Python's hashlib

optional arguments:
  -h, --help            show this help message and exit
  -a {sha256,sha3_512,sha1,sha512,md5}, --algorithm {sha256,sha3_512,sha1,sha512,md5}
                        algorithm to use
  -o [OUTPUT], --output [OUTPUT]
                        output file
  -v, --verbose         verbose
  -r, --recursive       recursive down directories, when using --ending

choose one option: Hash a single file OR Hash many files:
  -f FILE, --file FILE  file to hash
  -e ENDING, --ending ENDING
                        hash files ending with suffix, e.g. txt