Graduate work

Installation

1. Clone repo.
2. Create .env file according to .env.example.
3. Copy .env.minio.json.example as cdn_api_async_redis/src/.env.minio.json
4. Launch the project docker-compose up --build.
5. Login to every Minio node and create a bucket BUCKET_NAME (not automated yet)

architecture

Architecture for the CDN service described here.

CDN

We use MinIO as an S3 and redis as a cache.

API

• GET http://127.0.0.1/api/v1/films/{object_name} - Get URL to preview object (movie, music, photo). Redirects to url to preview object
• GET http://127.0.0.1/api/v1/films/{object_name}/status - Get status of the object uploading to S3
• POST http://127.0.0.1/api/v1/films/object - upload object to storage
• DELETE http://127.0.0.1/api/v1/films/object - delete object from alll nodes

Scheduler

• finish_in_progress_tasks. If the task failed during last 6 hours, scheduler finish uploading
• abort_old_tasks. The task will remove all in_progress tasks older than 6 hours

Redis

After every action the transition status in the database changes:

in_progress -> finished. scheduler_in_progress -> finished.

• scheduler_in_progress - scheduler is uploading file to S3 now
• in_progress - part of the file was uploaded to S3
• finished - upload finished