Switch to ICU tokenizer #939
FirefoxCI (pull_request)
The task that creates all of the other tasks in the task graph
Details
View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster
Task Status
Started: 2024-11-22T22:50:04.260Z
Resolved: 2024-11-22T22:50:35.102Z
Task Execution Time: 30 seconds, 842 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0
Artifacts
- public/actions.json
- public/docker-contexts/base.tar.gz
- public/docker-contexts/inference.tar.gz
- public/docker-contexts/test.tar.gz
- public/docker-contexts/toolchain-build.tar.gz
- public/docker-contexts/train.tar.gz
- public/fetch-content
- public/full-task-graph.json
- public/label-to-taskid.json
- public/logs/live_backing.log
- public/logs/live.log
- public/optimizations.log
- public/parameters.yml
- public/runnable-jobs.json
- public/run-task
- public/target-tasks.json
- public/task-graph.json
[taskcluster 2024-11-22 22:50:04.324Z] Task ID: KygK5rmiQQSbJCq_hTsFbQ
[taskcluster 2024-11-22 22:50:04.325Z] Worker ID: 2784719848518497444
[taskcluster 2024-11-22 22:50:04.325Z] Worker Group: us-central1-b
[taskcluster 2024-11-22 22:50:04.325Z] Worker Node Type: projects/887720501152/machineTypes/n2-standard-2
[taskcluster 2024-11-22 22:50:04.325Z] Worker Pool: translations-1/decision-gcp
[taskcluster 2024-11-22 22:50:04.325Z] Worker Version: 38.0.5
[taskcluster 2024-11-22 22:50:04.325Z] Public IP: 34.68.83.136
[taskcluster 2024-11-22 22:50:04.325Z] Hostname: translations-1-decision-gcp-aeky2ncrrfqkz7rcxqidhg
[taskcluster 2024-11-22 22:50:04.325Z] using cache "translations-level-1-checkouts-sparse-v2" -> /builds/worker/checkouts
b57ab501a8f4 - Started downloading
3bb7dd3accd0 - Started downloading
559df9a599c4 - Started downloading
559df9a599c4 - Downloaded in 0.158 seconds
b57ab501a8f4 - Downloaded in 0.291 seconds
fad8d951cdaf - Started downloading
fad8d951cdaf - Downloaded in 0.001 seconds
3bb7dd3accd0 - Downloaded in 0.928 seconds
Digest: sha256:8c57e30214c85625856479812e63212dc2873b1ffcd97467a7c93508cbb3075a
Status: Downloaded newer image for mozillareleases/taskgraph@sha256:8c57e30214c85625856479812e63212dc2873b1ffcd97467a7c93508cbb3075a
...(5 lines hidden)...
[vcs 2024-11-22T22:50:16.337Z] WARNING: vcs checkout path (/builds/worker/checkouts/src) not in cache or volume; performance will likely suffer
[setup 2024-11-22T22:50:16.337Z] running as worker:worker
[vcs 2024-11-22T22:50:16.338Z] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/src']
[vcs 2024-11-22T22:50:16.340Z] executing ['git', 'clone', 'https://github.com/mozilla/translations', '/builds/worker/checkouts/src']
[vcs 2024-11-22T22:50:16.342Z] Cloning into '/builds/worker/checkouts/src'...
[vcs 2024-11-22T22:50:17.540Z] executing ['git', 'fetch', 'origin', 'main']
[vcs 2024-11-22T22:50:17.766Z] From https://github.com/mozilla/translations
[vcs 2024-11-22T22:50:17.767Z] * branch main -> FETCH_HEAD
[vcs 2024-11-22T22:50:17.774Z] executing ['git', 'checkout', 'main']
[vcs 2024-11-22T22:50:17.826Z] Already on 'main'
[vcs 2024-11-22T22:50:17.827Z] Your branch is up to date with 'origin/main'.
[vcs 2024-11-22T22:50:17.827Z] executing ['git', 'fetch', 'origin', '3598c784dedd8ccf73e9c21a368fab46bcaa12c8']
[vcs 2024-11-22T22:50:18.047Z] From https://github.com/mozilla/translations
[vcs 2024-11-22T22:50:18.047Z] * branch 3598c784dedd8ccf73e9c21a368fab46bcaa12c8 -> FETCH_HEAD
[vcs 2024-11-22T22:50:18.055Z] executing ['git', 'fetch', '--tags', '--force', 'https://github.com/mozilla/translations', 'icu_tokenizer']
[vcs 2024-11-22T22:50:18.238Z] From https://github.com/mozilla/translations
[vcs 2024-11-22T22:50:18.238Z] * branch icu_tokenizer -> FETCH_HEAD
[vcs 2024-11-22T22:50:18.245Z] executing ['git', 'fetch', '--no-tags', 'https://github.com/mozilla/translations', 'icu_tokenizer']
[vcs 2024-11-22T22:50:18.425Z] From https://github.com/mozilla/translations
[vcs 2024-11-22T22:50:18.425Z] * branch icu_tokenizer -> FETCH_HEAD
[vcs 2024-11-22T22:50:18.433Z] executing ['git', 'checkout', '-f', '-B', 'icu_tokenizer', 'd585a63a6abc04ece83e26ce51a0caa2f7fa21e6']
[vcs 2024-11-22T22:50:18.537Z] Switched to a new branch 'icu_tokenizer'
[vcs 2024-11-22T22:50:18.537Z] executing ['git', 'submodule', 'init']
[vcs 2024-11-22T22:50:18.557Z] Submodule '3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path '3rd_party/browsermt-marian-dev'
[vcs 2024-11-22T22:50:18.558Z] Submodule 'extract-lex' (https://github.com/marian-nmt/extract-lex) registered for path '3rd_party/extract-lex'
[vcs 2024-11-22T22:50:18.558Z] Submodule 'fast_align' (https://github.com/clab/fast_align) registered for path '3rd_party/fast_align'
[vcs 2024-11-22T22:50:18.559Z] Submodule '3rd_party/kenlm' (https://github.com/kpu/kenlm) registered for path '3rd_party/kenlm'
[vcs 2024-11-22T22:50:18.560Z] Submodule '3rd_party/marian-dev' (https://github.com/marian-nmt/marian-dev) registered for path '3rd_party/marian-dev'
[vcs 2024-11-22T22:50:18.560Z] Submodule '3rd_party/preprocess' (https://github.com/kpu/preprocess.git) registered for path '3rd_party/preprocess'
[vcs 2024-11-22T22:50:18.561Z] Submodule 'inference/3rd_party/browsermt-marian-dev' (https://github.com/browsermt/marian-dev) registered for path 'inference/3rd_party/browsermt-marian-dev'
[vcs 2024-11-22T22:50:18.562Z] Submodule 'inference/3rd_party/emsdk' (https://github.com/emscripten-core/emsdk.git) registered for path 'inference/3rd_party/emsdk'
[vcs 2024-11-22T22:50:18.562Z] Submodule 'inference/3rd_party/ssplit-cpp' (https://github.com/browsermt/ssplit-cpp) registered for path 'inference/3rd_party/ssplit-cpp'
[vcs 2024-11-22T22:50:18.563Z] executing ['git', 'submodule', 'update', '--force']
[vcs 2024-11-22T22:50:18.583Z] Cloning into '/builds/worker/checkouts/src/3rd_party/browsermt-marian-dev'...
[vcs 2024-11-22T22:50:20.675Z] Cloning into '/builds/worker/checkouts/src/3rd_party/extract-lex'...
[vcs 2024-11-22T22:50:20.929Z] Cloning into '/builds/worker/checkouts/src/3rd_party/fast_align'...
[vcs 2024-11-22T22:50:21.210Z] Cloning into '/builds/worker/checkouts/src/3rd_party/kenlm'...
[vcs 2024-11-22T22:50:22.011Z] Cloning into '/builds/worker/checkouts/src/3rd_party/marian-dev'...
[vcs 2024-11-22T22:50:24.530Z] Cloning into '/builds/worker/checkouts/src/3rd_party/preprocess'...
[vcs 2024-11-22T22:50:25.001Z] Cloning into '/builds/worker/checkouts/src/inference/3rd_party/browsermt-marian-dev'...
[vcs 2024-11-22T22:50:27.071Z] Cloning into '/builds/worker/checkouts/src/inference/3rd_party/emsdk'...
[vcs 2024-11-22T22:50:27.781Z] Cloning into '/builds/worker/checkouts/src/inference/3rd_party/ssplit-cpp'...
[vcs 2024-11-22T22:50:28.179Z] Submodule path '3rd_party/browsermt-marian-dev': checked out '11c6ae7c46be21ef96ed10c60f28022fa968939f'
[vcs 2024-11-22T22:50:28.185Z] Submodule path '3rd_party/extract-lex': checked out '42fa605b53f32eaf6c6e0b5677255c21c91b3d49'
[vcs 2024-11-22T22:50:28.193Z] Submodule path '3rd_party/fast_align': checked out 'cab1e9aac8d3bb02ff5ae58218d8d225a039fa11'
[vcs 2024-11-22T22:50:28.214Z] Submodule path '3rd_party/kenlm': checked out 'bbf4fc511266c5d4515047055d7bdec659a6e158'
[vcs 2024-11-22T22:50:28.316Z] Submodule path '3rd_party/marian-dev': checked out 'e8a1a2530fb84cbff7383302ebca393e5875c441'
[vcs 2024-11-22T22:50:28.332Z] Submodule path '3rd_party/preprocess': checked out '64307314b4d5a9a0bd529b5c1036b0710d995eec'
[vcs 2024-11-22T22:50:28.397Z] Submodule path 'inference/3rd_party/browsermt-marian-dev': checked out '2781d735d4a10dca876d61be587afdab2726293c'
[vcs 2024-11-22T22:50:28.410Z] Submodule path 'inference/3rd_party/emsdk': checked out '2346baa7bb44a4a0571cc75f1986ab9aaa35aa03'
[vcs 2024-11-22T22:50:28.421Z] Submodule path 'inference/3rd_party/ssplit-cpp': checked out 'a311f9865ade34db1e8e080e6cc146f55dafb067'
[vcs 2024-11-22T22:50:28.422Z] cleaning git checkout...
[vcs 2024-11-22T22:50:28.422Z] executing ['git', 'clean', '-nxdff']
[vcs 2024-11-22T22:50:28.425Z] removing []
[vcs 2024-11-22T22:50:28.425Z] successfully cleaned git checkout!
[vcs 2024-11-22T22:50:28.428Z] TinderboxPrint:<a href='https://github.com/mozilla/translations/commit/d585a63a6abc04ece83e26ce51a0caa2f7fa21e6' title='Built from translations commit d585a63a6abc04ece83e26ce51a0caa2f7fa21e6'>d585a63a6abc04ece83e26ce51a0caa2f7fa21e6</a>
[task 2024-11-22T22:50:28.428Z] executing ['bash', '-cx', "cd /builds/worker/checkouts/src && ln -s /builds/worker/artifacts artifacts && taskgraph decision --pushlog-id='0' --pushdate='0' --project='translations' --owner='[email protected]' --level='1' --repository-type=git --tasks-for='github-pull-request' --base-repository='https://github.com/mozilla/translations' --base-ref='main' --base-rev='3598c784dedd8ccf73e9c21a368fab46bcaa12c8' --head-repository='https://github.com/mozilla/translations' --head-ref='icu_tokenizer' --head-rev='d585a63a6abc04ece83e26ce51a0caa2f7fa21e6' \n"]
[task 2024-11-22T22:50:28.430Z] + cd /builds/worker/checkouts/src
[task 2024-11-22T22:50:28.430Z] + ln -s /builds/worker/artifacts artifacts
[task 2024-11-22T22:50:28.432Z] + taskgraph decision --pushlog-id=0 --pushdate=0 --project=translations [email protected] --level=1 --repository-type=git --tasks-for=github-pull-request --base-repository=https://github.com/mozilla/translations --base-ref=main --base-rev=3598c784dedd8ccf73e9c21a368fab46bcaa12c8 --head-repository=https://github.com/mozilla/translations --head-ref=icu_tokenizer --head-rev=d585a63a6abc04ece83e26ce51a0caa2f7fa21e6
[task 2024-11-22T22:50:28.685Z] 2024-11-22 22:50:28,685 - INFO - Loading graph configuration.
[task 2024-11-22T22:50:28.708Z] 2024-11-22 22:50:28,708 - WARNING - using default project parameters; add translations to PER_PROJECT_PARAMETERS in /usr/local/lib/python3.11/dist-packages/taskgraph/decision.py to customize behavior for this project
[task 2024-11-22T22:50:28.716Z] 2024-11-22 22:50:28,716 - INFO - Using Parameters(id=0d01cb26f4f7) (from defaults)
[task 2024-11-22T22:50:28.718Z] 2024-11-22 22:50:28,718 - INFO - writing artifact file `parameters.yml`
[task 2024-11-22T22:50:28.727Z] 2024-11-22 22:50:28,727 - INFO - writing artifact file `actions.json`
[task 2024-11-22T22:50:28.730Z] 2024-11-22 22:50:28,730 - INFO - Loading kinds
[task 2024-11-22T22:50:28.760Z] 2024-11-22 22:50:28,760 - INFO - Generating full task set
[task 2024-11-22T22:50:28.788Z] 2024-11-22 22:50:28,788 - INFO - Generated 12 tasks for kind dataset
[task 2024-11-22T22:50:28.790Z] 2024-11-22 22:50:28,789 - INFO - Writing docker-contexts/base.tar.gz for docker image base
[task 2024-11-22T22:50:28.806Z] 2024-11-22 22:50:28,806 - INFO - Writing docker-contexts/inference.tar.gz for docker image inference
[task 2024-11-22T22:50:28.807Z] 2024-11-22 22:50:28,807 - INFO - Writing docker-contexts/test.tar.gz for docker image test
[task 2024-11-22T22:50:28.808Z] 2024-11-22 22:50:28,808 - INFO - Writing docker-contexts/train.tar.gz for docker image train
[task 2024-11-22T22:50:28.808Z] 2024-11-22 22:50:28,808 - INFO - Writing docker-contexts/toolchain-build.tar.gz for docker image toolchain-build
[task 2024-11-22T22:50:28.826Z] 2024-11-22 22:50:28,826 - INFO - Generated 5 tasks for kind docker-image
[task 2024-11-22T22:50:28.835Z] 2024-11-22 22:50:28,835 - INFO - Generated 9 tasks for kind fetch
[task 2024-11-22T22:50:28.917Z] 2024-11-22 22:50:28,917 - INFO - Generated 10 tasks for kind toolchain
[task 2024-11-22T22:50:28.922Z] 2024-11-22 22:50:28,922 - INFO - Generated 4 tasks for kind analyze-corpus
[task 2024-11-22T22:50:28.926Z] 2024-11-22 22:50:28,926 - INFO - Generated 4 tasks for kind analyze-mono
[task 2024-11-22T22:50:28.929Z] 2024-11-22 22:50:28,929 - INFO - Generated 1 tasks for kind bicleaner-model
[task 2024-11-22T22:50:28.934Z] 2024-11-22 22:50:28,934 - INFO - Generated 4 tasks for kind clean-corpus
[task 2024-11-22T22:50:28.939Z] 2024-11-22 22:50:28,939 - INFO - Generated 4 tasks for kind bicleaner
[task 2024-11-22T22:50:28.944Z] 2024-11-22 22:50:28,944 - INFO - Generated 4 tasks for kind clean-mono
[task 2024-11-22T22:50:28.949Z] 2024-11-22 22:50:28,949 - INFO - Generated 1 tasks for kind merge-corpus
[task 2024-11-22T22:50:28.953Z] 2024-11-22 22:50:28,953 - INFO - Generated 2 tasks for kind merge-mono
[task 2024-11-22T22:50:28.956Z] 2024-11-22 22:50:28,956 - INFO - Generated 1 tasks for kind train-vocab
[task 2024-11-22T22:50:28.958Z] 2024-11-22 22:50:28,958 - INFO - Generated 1 tasks for kind split-corpus
[task 2024-11-22T22:50:28.961Z] 2024-11-22 22:50:28,961 - INFO - Generated 1 tasks for kind merge-devset
[task 2024-11-22T22:50:28.965Z] 2024-11-22 22:50:28,965 - INFO - Generated 4 tasks for kind inference
[task 2024-11-22T22:50:28.969Z] 2024-11-22 22:50:28,969 - INFO - Generated 1 tasks for kind train-backwards
[task 2024-11-22T22:50:28.972Z] 2024-11-22 22:50:28,972 - INFO - Generated 1 tasks for kind split-mono-src
[task 2024-11-22T22:50:28.974Z] 2024-11-22 22:50:28,974 - INFO - Generated 1 tasks for kind split-mono-trg
[task 2024-11-22T22:50:28.978Z] 2024-11-22 22:50:28,978 - INFO - Generated 6 tasks for kind tests
[task 2024-11-22T22:50:28.984Z] 2024-11-22 22:50:28,983 - INFO - Generated 2 tasks for kind translate-mono-trg
[task 2024-11-22T22:50:28.987Z] 2024-11-22 22:50:28,987 - INFO - Generated 1 tasks for kind collect-mono-trg
[task 2024-11-22T22:50:28.990Z] 2024-11-22 22:50:28,990 - INFO - Generated 1 tasks for kind alignments-original
[task 2024-11-22T22:50:28.992Z] 2024-11-22 22:50:28,992 - INFO - Generated 1 tasks for kind alignments-backtranslated
[task 2024-11-22T22:50:28.996Z] 2024-11-22 22:50:28,995 - INFO - Generated 1 tasks for kind train-teacher
[task 2024-11-22T22:50:28.998Z] 2024-11-22 22:50:28,998 - INFO - Generated 1 tasks for kind evaluate-teacher-ensemble
[task 2024-11-22T22:50:29.003Z] 2024-11-22 22:50:29,003 - INFO - Generated 2 tasks for kind translate-corpus
[task 2024-11-22T22:50:29.006Z] 2024-11-22 22:50:29,006 - INFO - Generated 2 tasks for kind extract-best
[task 2024-11-22T22:50:29.008Z] 2024-11-22 22:50:29,008 - INFO - Generated 1 tasks for kind collect-corpus
[task 2024-11-22T22:50:29.012Z] 2024-11-22 22:50:29,012 - INFO - Generated 2 tasks for kind translate-mono-src
[task 2024-11-22T22:50:29.015Z] 2024-11-22 22:50:29,014 - INFO - Generated 1 tasks for kind collect-mono-src
[task 2024-11-22T22:50:29.017Z] 2024-11-22 22:50:29,017 - INFO - Generated 1 tasks for kind merge-translated
[task 2024-11-22T22:50:29.020Z] 2024-11-22 22:50:29,020 - INFO - Generated 1 tasks for kind score
[task 2024-11-22T22:50:29.022Z] 2024-11-22 22:50:29,022 - INFO - Generated 1 tasks for kind cefilter
[task 2024-11-22T22:50:29.025Z] 2024-11-22 22:50:29,025 - INFO - Generated 1 tasks for kind shortlist
[task 2024-11-22T22:50:29.027Z] 2024-11-22 22:50:29,027 - INFO - Generated 1 tasks for kind alignments-student
[task 2024-11-22T22:50:29.030Z] 2024-11-22 22:50:29,030 - INFO - Generated 1 tasks for kind train-student
[task 2024-11-22T22:50:29.033Z] 2024-11-22 22:50:29,033 - INFO - Generated 1 tasks for kind finetune-student
[task 2024-11-22T22:50:29.035Z] 2024-11-22 22:50:29,035 - INFO - Generated 1 tasks for kind quantize
[task 2024-11-22T22:50:29.038Z] 2024-11-22 22:50:29,038 - INFO - Generated 1 tasks for kind export
[task 2024-11-22T22:50:29.044Z] 2024-11-22 22:50:29,044 - INFO - Generated 4 tasks for kind evaluate
[task 2024-11-22T22:50:29.047Z] 2024-11-22 22:50:29,046 - INFO - Generated 1 tasks for kind evaluate-quantized
[task 2024-11-22T22:50:29.048Z] 2024-11-22 22:50:29,048 - INFO - Generated 1 tasks for kind all-pipeline
[task 2024-11-22T22:50:29.050Z] 2024-11-22 22:50:29,050 - INFO - Generated 1 tasks for kind all-pr-pipeline
[task 2024-11-22T22:50:29.050Z] 2024-11-22 22:50:29,050 - INFO - Generating full task graph
[task 2024-11-22T22:50:29.050Z] 2024-11-22 22:50:29,050 - INFO - Full task graph contains 107 tasks and 300 dependencies
[task 2024-11-22T22:50:29.055Z] 2024-11-22 22:50:29,055 - INFO - writing artifact file `full-task-graph.json`
[task 2024-11-22T22:50:29.076Z] 2024-11-22 22:50:29,076 - INFO - writing artifact file `runnable-jobs.json`
[task 2024-11-22T22:50:29.078Z] 2024-11-22 22:50:29,077 - INFO - Generating target task set
[task 2024-11-22T22:50:29.078Z] 2024-11-22 22:50:29,078 - INFO - Filter filter_target_tasks pruned 86 tasks (21 remain)
[task 2024-11-22T22:50:29.078Z] 2024-11-22 22:50:29,078 - INFO - writing artifact file `target-tasks.json`
[task 2024-11-22T22:50:29.078Z] 2024-11-22 22:50:29,078 - INFO - Generating target task graph
[task 2024-11-22T22:50:29.078Z] 2024-11-22 22:50:29,078 - INFO - Adding 5 tasks with `always_target` attribute
[task 2024-11-22T22:50:29.080Z] 2024-11-22 22:50:29,079 - INFO - Generating optimized task graph
[task 2024-11-22T22:50:29.084Z] 2024-11-22 22:50:29,084 - INFO - Removed 4 tasks by skip-unless-changed (skip-unless-changed) during optimization.
[task 2024-11-22T22:50:29.326Z] 2024-11-22 22:50:29,326 - INFO - Replaced 34 tasks by index-search (index-search) during optimization.
[task 2024-11-22T22:50:29.332Z] 2024-11-22 22:50:29,332 - INFO - writing artifact file `task-graph.json`
[task 2024-11-22T22:50:29.345Z] 2024-11-22 22:50:29,345 - INFO - writing artifact file `label-to-taskid.json`
[task 2024-11-22T22:50:29.347Z] 2024-11-22 22:50:29,347 - INFO - Creating task with taskId KnyIE1GvSz67R9mjL97Now for build-docker-image-train
[task 2024-11-22T22:50:29.349Z] 2024-11-22 22:50:29,349 - INFO - Creating task with taskId Hh9E_87oSLuDxLEPHh2idA for tests-lint-eslint
[task 2024-11-22T22:50:29.353Z] 2024-11-22 22:50:29,352 - INFO - Creating task with taskId R1EFkifFQeGwp4XnSTV8UQ for build-docker-image-test
[task 2024-11-22T22:50:29.467Z] 2024-11-22 22:50:29,467 - INFO - Creating task with taskId GMJxZvHISCeHTsADp_sZ5g for tests-lint-black
[task 2024-11-22T22:50:29.468Z] 2024-11-22 22:50:29,467 - INFO - Creating task with taskId DjwgLZhwSZaJu9EGEsuXrA for tests-taskgraph-definition
[task 2024-11-22T22:50:29.473Z] 2024-11-22 22:50:29,472 - INFO - Creating task with taskId Y7TH1Hm1TSOpW4jryeQWYg for tests-lint-ruff
[task 2024-11-22T22:50:29.476Z] 2024-11-22 22:50:29,475 - INFO - Creating task with taskId ePBOek4iRz6IACB3cq10Zg for tests-test
[task 2024-11-22T22:50:29.479Z] 2024-11-22 22:50:29,478 - INFO - Creating task with taskId YfFsVHFfSteN79KWL7W9pA for merge-devset-ru-en
[task 2024-11-22T22:50:29.480Z] 2024-11-22 22:50:29,480 - INFO - Creating task with taskId LJ7J2aXTSPei1Ws45etnXw for tests-taskgraph-diff
[task 2024-11-22T22:50:29.483Z] 2024-11-22 22:50:29,482 - INFO - Creating task with taskId OBONr18VQ9SHFhHjY4htrA for clean-mono-opus-en-tldr-pages_v2023-08-29-mono-trg
[task 2024-11-22T22:50:29.562Z] 2024-11-22 22:50:29,562 - INFO - Creating task with taskId Oz4GkgELTkSm1v8u0UYYdQ for clean-mono-news-crawl-ru-news_2008-mono-src
[task 2024-11-22T22:50:29.564Z] 2024-11-22 22:50:29,564 - INFO - Creating task with taskId OyDG8CnrRoK5XMk0SzQT8g for clean-mono-opus-ru-tldr-pages_v2023-08-29-mono-src
[task 2024-11-22T22:50:29.567Z] 2024-11-22 22:50:29,567 - INFO - Creating task with taskId Rx0wTHe6RYak9CaIWZYEfw for analyze-corpus-opus-ada83_v1-ru-en
[task 2024-11-22T22:50:29.570Z] 2024-11-22 22:50:29,568 - INFO - Creating task with taskId VfXCBJlxTkKlBWzbDw53qQ for clean-corpus-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-11-22T22:50:29.572Z] 2024-11-22 22:50:29,571 - INFO - Creating task with taskId afKheyZzSgaRL4-WiKSQ7A for clean-corpus-mtdata-ELRC-web_acquired_data_related_to_scientific_resea_78c4de-ru-en
[task 2024-11-22T22:50:29.574Z] 2024-11-22 22:50:29,572 - INFO - Creating task with taskId dVDYmS_ZRO2FvIX099r4mA for analyze-mono-opus-ru-tldr-pages_v2023-08-29
[task 2024-11-22T22:50:29.580Z] 2024-11-22 22:50:29,573 - INFO - Creating task with taskId TZlubEB9SwCm6SlUze7g4Q for clean-corpus-url-gcp_pytest-dataset_a0017e-ru-en
[task 2024-11-22T22:50:29.580Z] 2024-11-22 22:50:29,575 - INFO - Creating task with taskId YgHPpWXiQ1GZN_fLFdNjQw for clean-mono-news-crawl-en-news_2007-mono-trg
[task 2024-11-22T22:50:29.584Z] 2024-11-22 22:50:29,583 - INFO - Creating task with taskId BHcC5QHIT7yALQGtOAVkww for analyze-corpus-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-11-22T22:50:29.585Z] 2024-11-22 22:50:29,585 - INFO - Creating task with taskId GuyCeEWQTX64h_tUBwVocw for analyze-mono-news-crawl-en-news_2007
[task 2024-11-22T22:50:29.585Z] 2024-11-22 22:50:29,585 - INFO - Creating task with taskId Dg8HYrpoTfuxN0lFDdzSMw for analyze-corpus-mtdata-ELRC-web_acquired_data_related_to_scientific_resea_78c4de-ru-en
[task 2024-11-22T22:50:29.589Z] 2024-11-22 22:50:29,589 - INFO - Creating task with taskId ZH93qGhIQiynuLMw8y6eew for analyze-mono-opus-en-tldr-pages_v2023-08-29
[task 2024-11-22T22:50:29.591Z] 2024-11-22 22:50:29,591 - INFO - Creating task with taskId LMHnSwTdSOCbmnrKR1Kx3w for analyze-mono-news-crawl-ru-news_2008
[task 2024-11-22T22:50:29.593Z] 2024-11-22 22:50:29,593 - INFO - Creating task with taskId JohgkEzQRhyi3hO4HUN2Tw for analyze-corpus-url-gcp_pytest-dataset_a0017e-ru-en
[task 2024-11-22T22:50:29.599Z] 2024-11-22 22:50:29,598 - INFO - Creating task with taskId R12XdGPpRoCqwNhtpLocRw for clean-corpus-opus-ada83_v1-ru-en
[task 2024-11-22T22:50:29.689Z] 2024-11-22 22:50:29,689 - INFO - Creating task with taskId Kd3wDfigT_-rzZx25C5y0A for bicleaner-ai-url-gcp_pytest-dataset_a0017e-ru-en
[task 2024-11-22T22:50:29.813Z] 2024-11-22 22:50:29,812 - INFO - Creating task with taskId e1usRcXfTzCAagS0_21b9A for bicleaner-ai-opus-ELRC-3075-wikipedia_health_v1-ru-en
[task 2024-11-22T22:50:29.815Z] 2024-11-22 22:50:29,815 - INFO - Creating task with taskId E6OGzex0TUuRpJ9kzAhVyg for bicleaner-ai-opus-ada83_v1-ru-en
[task 2024-11-22T22:50:29.816Z] 2024-11-22 22:50:29,816 - INFO - Creating task with taskId AIY73J0JRXanRkyp5XJp2A for bicleaner-ai-mtdata-ELRC-web_acquired_data_related_to_scientific_resea_78c4de-ru-en
[task 2024-11-22T22:50:29.973Z] 2024-11-22 22:50:29,972 - INFO - Creating task with taskId CMk3dMWqQrOhiX5_lJExuQ for merge-corpus-ru-en
[task 2024-11-22T22:50:30.074Z] 2024-11-22 22:50:30,074 - INFO - Creating task with taskId Np_OPTT1TWOABShQNn9lUg for alignments-original-ru-en
[task 2024-11-22T22:50:30.075Z] 2024-11-22 22:50:30,074 - INFO - Creating task with taskId WcppjhYBQfyubIQHtK6hMQ for split-corpus-ru-en
[task 2024-11-22T22:50:30.077Z] 2024-11-22 22:50:30,077 - INFO - Creating task with taskId QRGwRMMlR2Chi_A4GizTMQ for merge-mono-src-ru
[task 2024-11-22T22:50:30.079Z] 2024-11-22 22:50:30,078 - INFO - Creating task with taskId QbzA4AsxRWu2LJDlSoyBgA for train-vocab-ru-en
[task 2024-11-22T22:50:30.081Z] 2024-11-22 22:50:30,080 - INFO - Creating task with taskId Cz9fCCvAT3-ivThmX5E9Vw for merge-mono-trg-en
[task 2024-11-22T22:50:30.167Z] 2024-11-22 22:50:30,167 - INFO - Creating task with taskId ScoIWjpTQnO6dK_RhGlJ9A for split-mono-src-ru
[task 2024-11-22T22:50:30.251Z] 2024-11-22 22:50:30,251 - INFO - Creating task with taskId eoiSr17VQ6G18HkfZOYSXQ for split-mono-trg-en
[task 2024-11-22T22:50:30.253Z] 2024-11-22 22:50:30,253 - INFO - Creating task with taskId QxvDNmX3TNWsYrH4IlhFzw for train-backwards-ru-en
[task 2024-11-22T22:50:30.350Z] 2024-11-22 22:50:30,350 - INFO - Creating task with taskId V4BF0x3kRHeb4EPRdU7SNw for translate-mono-trg-ru-en-2/2
[task 2024-11-22T22:50:30.351Z] 2024-11-22 22:50:30,351 - INFO - Creating task with taskId Ab4mBddyQbGHJBTQvK-Gqg for evaluate-backward-flores-devtest-ru-en
[task 2024-11-22T22:50:30.356Z] 2024-11-22 22:50:30,351 - INFO - Creating task with taskId IwGvLXKdQ3G_1ZcVU19tLw for translate-mono-trg-ru-en-1/2
[task 2024-11-22T22:50:30.526Z] 2024-11-22 22:50:30,526 - INFO - Creating task with taskId Ag8vBkagQfO8vGs7iaVTnw for collect-mono-trg-ru-en
[task 2024-11-22T22:50:30.619Z] 2024-11-22 22:50:30,618 - INFO - Creating task with taskId foPd1kEZQIWlMWClhV5UDQ for alignments-backtranslated-ru-en
[task 2024-11-22T22:50:30.704Z] 2024-11-22 22:50:30,704 - INFO - Creating task with taskId KlDVnRvDSHuQP-1N8oPpXA for train-teacher-ru-en-1
[task 2024-11-22T22:50:30.791Z] 2024-11-22 22:50:30,791 - INFO - Creating task with taskId RyJ61H6TRGqTQPiMv5I8mQ for translate-mono-src-ru-en-2/2
[task 2024-11-22T22:50:30.793Z] 2024-11-22 22:50:30,792 - INFO - Creating task with taskId awv3hIhNSTKgbxp-oplK1w for translate-corpus-ru-en-1/2
[task 2024-11-22T22:50:30.795Z] 2024-11-22 22:50:30,795 - INFO - Creating task with taskId Jyya-gYASDqEwKUXANUksg for translate-corpus-ru-en-2/2
[task 2024-11-22T22:50:30.797Z] 2024-11-22 22:50:30,797 - INFO - Creating task with taskId fZG2Un_KQsa3Q1xtadbAaA for evaluate-teacher-ensemble-flores-devtest-ru-en
[task 2024-11-22T22:50:30.799Z] 2024-11-22 22:50:30,799 - INFO - Creating task with taskId eCe1yYBKRyiF3jsBgwVfsA for evaluate-teacher-flores-devtest-ru-en-1
[task 2024-11-22T22:50:30.801Z] 2024-11-22 22:50:30,799 - INFO - Creating task with taskId Lru4vMdrTYCuM3-_YDBaLw for translate-mono-src-ru-en-1/2
[task 2024-11-22T22:50:30.886Z] 2024-11-22 22:50:30,886 - INFO - Creating task with taskId cqLN7OrnTraqCASsqGWIgw for extract-best-ru-en-2/2
[task 2024-11-22T22:50:30.980Z] 2024-11-22 22:50:30,980 - INFO - Creating task with taskId Xt1emcAkQJOYWTQ4C5sr3Q for collect-mono-src-ru-en
[task 2024-11-22T22:50:30.983Z] 2024-11-22 22:50:30,982 - INFO - Creating task with taskId QrnbAhQ4RAeQdw5nd09BpQ for extract-best-ru-en-1/2
[task 2024-11-22T22:50:31.074Z] 2024-11-22 22:50:31,073 - INFO - Creating task with taskId dH4MpUKGRhu5pycJq0qwcg for collect-corpus-ru-en
[task 2024-11-22T22:50:31.175Z] 2024-11-22 22:50:31,175 - INFO - Creating task with taskId BwuOgMajTouEsRWUZXlouA for merge-translated-ru-en
[task 2024-11-22T22:50:31.264Z] 2024-11-22 22:50:31,264 - INFO - Creating task with taskId azCrexE4Sl2u-R4legGokA for score-ru-en
[task 2024-11-22T22:50:31.347Z] 2024-11-22 22:50:31,347 - INFO - Creating task with taskId RQJUIBz7T7qFf49_tmaYvQ for cefilter-ru-en
[task 2024-11-22T22:50:31.458Z] 2024-11-22 22:50:31,458 - INFO - Creating task with taskId Fyo0WEe_TaKHXjVYcCkDBQ for alignments-student-ru-en
[task 2024-11-22T22:50:31.459Z] 2024-11-22 22:50:31,459 - INFO - Creating task with taskId VYX7OmYwSMiSBM4cWKRsoQ for shortlist-ru-en
[task 2024-11-22T22:50:31.553Z] 2024-11-22 22:50:31,553 - INFO - Creating task with taskId A7cuyTW5QzalhM7bME9HLQ for train-student-ru-en
[task 2024-11-22T22:50:31.648Z] 2024-11-22 22:50:31,648 - INFO - Creating task with taskId MT05JjTrRUisfT6grGQ2FA for evaluate-student-flores-devtest-ru-en
[task 2024-11-22T22:50:31.650Z] 2024-11-22 22:50:31,650 - INFO - Creating task with taskId BnXlBoVdTf-7zYLfYV_MPA for finetune-student-ru-en
[task 2024-11-22T22:50:31.750Z] 2024-11-22 22:50:31,750 - INFO - Creating task with taskId Wpo-eEIHTkOA2EtL2MgwMw for evaluate-finetuned-student-flores-devtest-ru-en
[task 2024-11-22T22:50:31.752Z] 2024-11-22 22:50:31,752 - INFO - Creating task with taskId SfKub3XmQoaP6QnvStUlVg for quantize-ru-en
[task 2024-11-22T22:50:31.855Z] 2024-11-22 22:50:31,855 - INFO - Creating task with taskId Wq2TEElKTBaWfuKRBHQKig for evaluate-quantized-flores-devtest-ru-en
[task 2024-11-22T22:50:31.856Z] 2024-11-22 22:50:31,855 - INFO - Creating task with taskId bGCHD8mnQJSIDtSUHnTb-w for export-ru-en
[task 2024-11-22T22:50:31.947Z] 2024-11-22 22:50:31,947 - INFO - Creating task with taskId TnJ0aX9sR6qCw3LFDVyxYg for all-pr-pipeline-ru-en-1
[taskcluster 2024-11-22 22:50:32.385Z] === Task Finished ===
[taskcluster 2024-11-22 22:50:34.602Z] Successful task run with exit code: 0 completed in 30.279 seconds