concourse-tasks

These are some sample tasks and a pipeline for translationCore.

Prerequisits

1. install docker
2. install docker-compose
3. install concourse on either:
   1. a server
   2. your local machine (see quick start guide)
4. install fly on your local machine so you can interact with concourse.
5. deploy the pipeline with fly!

NGINX Reverse Proxy

When running on a server you'll likely want to run concourse behind a domain. You can do this by setting up a reverse proxy in nginx.

upstream concourse {
	server localhost:8080;
}

server {
	listen 80:
	listen [::]:80;

	server_name [your.domain.name];

	location / {
		proxy_set_header Host $http_host;
		proxy_set_header X-Real-IP $remote_addr;
		proxy_set_header X-Forwarded-For proxy_add_x_forwarded_for;

		proxy_redirect off;
		proxy_pass http://concourse;
	}
}

You could also add ssl support in the above configuration if desired.

Note: concourse will still be accessible from port 8080 directly. If this is undesirable you can set up a firewall on your server.

Deployment

These deployment instructions assume you are running concourse on your local machine. If you are running it on a server simply change the target url to the appropriate address and port.

First log into your concourse instance

fly -t ci.door43 login -n tc -c https://ci.door43.org

TRICKY: if you are logging in to any team other than main you'll need to specify the team name with -n as shown above.

Then deploy the pipeline

fly -t ci.door43 set-pipeline -p translation-core -c tc-pipeline.yml -l credentials.yml

NOTE: you'll need to provide the correct credentials inside credentials.yml see Parameters for details.

To debug a job

fly -t ci.door43 intercept -j map/build

To execute a single job without running the entire pipeline

fly -t ci.door43 execute --config tasks/unit-tests.yml

Docker Image

This repo contains the Docker image used in jobs. If you update the image you can deploy it again with the following commands:

docker build -t neutrinog/concourse-tasks .
docker push neutrinog/concourse-tasks:latest

Server Maintenance

You may need to clean up old docker images from time to time (like after rebooting, or hard restarting concourse). See this gist for details.

Concourse can be stopped/started by running

docker-compose stop
docker-compose start