Unify experiment state

[jonakarl]

The Scheduler, the container-deploy/start/stop monroe-sync-experiments /experiments should have a common way to see the state of a experiment (ie deployed/started/running/stopped etc).

Currently the these component detect experiment status via (possibly not complete) :
Scheduler (afaik) :

• return codes from container-* scripts
• ${schedid}.status file

container-deploy:

• /usr/bin/experiments (to see if any experiment is running)
• ps ax|grep docker|grep pull (to see if any container is being download)

container-start:

• docker ps | grep $CONTAINER_NAME) . #!!!Will fail on virtual machines

container-stop:

• docker inspect $CONTAINER_NAME
• ${schedid}.pid . (what process to kill)

monroe-sync-experiments:

• /usr/bin/experiments -a (to list all experiments)
• ${schedid}.stopped . (to see if the experiment is stopped by the container-stop script)
• $SCHEDID.pid . (to see what to kill if over qouta)
• The contents of /$SCHEDID . (if it is empty and .stopped it deltes all files)

experiments:

• directories existing in $USERDIR
• SCHEDID.pid