
Starting experiment gbkwikyqc5
running command...
2025-05-25:14:06:13,044 DEBUG    [generate_data.py:145] Available databuilders: ['knowledge_sdg']
2025-05-25:14:06:13,044 DEBUG    [generate_data.py:179] Builder config for knowledge_sdg: {'name': 'knowledge_sdg', 'blocks': [{'name': 'generator', 'type': 'rits', 'model_id_or_path': 'mistralai/mixtral-8x22B-instruct-v0.1', 'temperature': 0.5, 'max_new_tokens': 1024, 'min_new_tokens': 1, 'base_url': 'https://inference-3scale-apicast-production.apps.rits.fmaas.res.ibm.com/mixtral-8x22b-instruct-v01/v1'}, {'name': 'validator', 'type': 'lm_judge', 'filter': True, 'lm_config': {'type': 'rits', 'model_id_or_path': 'mistralai/mixtral-8x22B-instruct-v0.1', 'temperature': 0.5, 'max_new_tokens': 1024, 'min_new_tokens': 1, 'base_url': 'https://inference-3scale-apicast-production.apps.rits.fmaas.res.ibm.com/mixtral-8x22b-instruct-v01/v1'}}], 'metadata': {'version': 1.0}}
2025-05-25:14:06:13,045 DEBUG    [utils.py:202] Attempting dynamic import of fms_dgt.watsonx.databuilders.instructlab.knowledge_sdg.generate
/app/dgt/fms_dgt/base/prompt.py:28: SyntaxWarning: invalid escape sequence '\{'
  self.input_variables = re.findall("\{\{(.*?)\}\}", self._prompt)
2025-05-25:14:06:18,571 DEBUG    [utils.py:202] Attempting dynamic import of fms_dgt.core.datastores.default
2025-05-25:14:06:18,755 DEBUG    [utils.py:202] Attempting dynamic import of fms_dgt.core.dataloaders.default
2025-05-25:14:06:18,774 DEBUG    [utils.py:202] Attempting dynamic import of fms_dgt.granite.blocks.generators.llm.rits

Running generation tasks:   0%|          | 0/1 [00:00<?, ?it/s]2025-05-25:14:06:19,621 INFO     [generate.py:88] Generating knowledge for the domain IBM Maximo ...


Running generate_batch requests:   0%|          | 0/57 [00:00<?, ?it/s][A

Running generate_batch requests:   2%|▏         | 1/57 [01:16<1:11:29, 76.60s/it][A

Running generate_batch requests:  19%|█▉        | 11/57 [01:54<06:31,  8.52s/it] [A

Running generate_batch requests:  37%|███▋      | 21/57 [02:34<03:34,  5.95s/it][A

Running generate_batch requests:  54%|█████▍    | 31/57 [03:15<02:13,  5.14s/it][A

Running generate_batch requests:  72%|███████▏  | 41/57 [03:52<01:12,  4.56s/it][A

Running generate_batch requests:  89%|████████▉ | 51/57 [04:29<00:25,  4.24s/it][A
Running generate_batch requests: 100%|██████████| 57/57 [04:29<00:00,  4.72s/it]
2025-05-25:14:10:48,838 INFO     [generate.py:99] Verifying knowledge...


Running generate_batch requests:   0%|          | 0/203 [00:00<?, ?it/s][A

Running generate_batch requests:   0%|          | 1/203 [00:16<54:57, 16.33s/it][A

Running generate_batch requests:   5%|▌         | 11/203 [00:27<06:43,  2.10s/it][A

Running generate_batch requests:  10%|█         | 21/203 [00:45<05:52,  1.94s/it][A

Running generate_batch requests:  15%|█▌        | 31/203 [00:51<03:47,  1.32s/it][A

Running generate_batch requests:  20%|██        | 41/203 [00:56<02:45,  1.02s/it][A

Running generate_batch requests:  25%|██▌       | 51/203 [01:06<02:31,  1.00it/s][A

Running generate_batch requests:  30%|███       | 61/203 [01:13<02:09,  1.10it/s][A

Running generate_batch requests:  35%|███▍      | 71/203 [01:21<01:55,  1.15it/s][A

Running generate_batch requests:  40%|███▉      | 81/203 [01:32<01:54,  1.06it/s][A

Running generate_batch requests:  45%|████▍     | 91/203 [01:39<01:36,  1.16it/s][A

Running generate_batch requests:  50%|████▉     | 101/203 [01:46<01:24,  1.21it/s][A

Running generate_batch requests:  55%|█████▍    | 111/203 [02:01<01:33,  1.02s/it][A

Running generate_batch requests:  60%|█████▉    | 121/203 [02:15<01:32,  1.12s/it][A

Running generate_batch requests:  65%|██████▍   | 131/203 [02:27<01:22,  1.15s/it][A

Running generate_batch requests:  69%|██████▉   | 141/203 [02:34<01:02,  1.01s/it][A

Running generate_batch requests:  74%|███████▍  | 151/203 [02:44<00:53,  1.03s/it][A

Running generate_batch requests:  79%|███████▉  | 161/203 [03:05<00:56,  1.34s/it][A

Running generate_batch requests:  84%|████████▍ | 171/203 [03:29<00:53,  1.67s/it][A

Running generate_batch requests:  89%|████████▉ | 181/203 [03:39<00:31,  1.45s/it][A

Running generate_batch requests:  94%|█████████▍| 191/203 [03:48<00:15,  1.30s/it][A

Running generate_batch requests:  99%|█████████▉| 201/203 [03:51<00:02,  1.01s/it][A
Running generate_batch requests: 100%|██████████| 203/203 [03:51<00:00,  1.14s/it]


Running generate_batch requests:   0%|          | 0/195 [00:00<?, ?it/s][A

Running generate_batch requests:   1%|          | 1/195 [00:05<19:22,  5.99s/it][A

Running generate_batch requests:   6%|▌         | 11/195 [00:10<02:37,  1.17it/s][A

Running generate_batch requests:  11%|█         | 21/195 [00:15<01:51,  1.56it/s][A

Running generate_batch requests:  16%|█▌        | 31/195 [00:20<01:34,  1.74it/s][A

Running generate_batch requests:  21%|██        | 41/195 [00:26<01:28,  1.74it/s][A

Running generate_batch requests:  26%|██▌       | 51/195 [00:32<01:22,  1.74it/s][A

Running generate_batch requests:  31%|███▏      | 61/195 [00:37<01:12,  1.84it/s][A

Running generate_batch requests:  36%|███▋      | 71/195 [00:42<01:07,  1.83it/s][A

Running generate_batch requests:  42%|████▏     | 81/195 [00:47<01:00,  1.90it/s][A

Running generate_batch requests:  47%|████▋     | 91/195 [00:53<00:57,  1.80it/s][A

Running generate_batch requests:  52%|█████▏    | 101/195 [00:58<00:51,  1.84it/s][A

Running generate_batch requests:  57%|█████▋    | 111/195 [01:06<00:52,  1.61it/s][A

Running generate_batch requests:  62%|██████▏   | 121/195 [01:11<00:42,  1.75it/s][A

Running generate_batch requests:  67%|██████▋   | 131/195 [01:17<00:37,  1.71it/s][A

Running generate_batch requests:  72%|███████▏  | 141/195 [01:24<00:33,  1.62it/s][A

Running generate_batch requests:  77%|███████▋  | 151/195 [01:28<00:24,  1.80it/s][A

Running generate_batch requests:  83%|████████▎ | 161/195 [01:34<00:19,  1.72it/s][A

Running generate_batch requests:  88%|████████▊ | 171/195 [01:40<00:13,  1.75it/s][A

Running generate_batch requests:  93%|█████████▎| 181/195 [01:47<00:08,  1.65it/s][A

Running generate_batch requests:  98%|█████████▊| 191/195 [01:52<00:02,  1.69it/s][A
Running generate_batch requests: 100%|██████████| 195/195 [01:52<00:00,  1.73it/s]


Running generate_batch requests:   0%|          | 0/187 [00:00<?, ?it/s][A

Running generate_batch requests:   1%|          | 1/187 [00:04<14:37,  4.72s/it][A

Running generate_batch requests:   6%|▌         | 11/187 [00:10<02:37,  1.12it/s][A

Running generate_batch requests:  11%|█         | 21/187 [00:17<02:04,  1.33it/s][A

Running generate_batch requests:  17%|█▋        | 31/187 [00:22<01:41,  1.53it/s][A

Running generate_batch requests:  22%|██▏       | 41/187 [00:28<01:33,  1.56it/s][A

Running generate_batch requests:  27%|██▋       | 51/187 [00:34<01:21,  1.66it/s][A

Running generate_batch requests:  33%|███▎      | 61/187 [00:40<01:18,  1.60it/s][A

Running generate_batch requests:  38%|███▊      | 71/187 [00:46<01:09,  1.66it/s][A

Running generate_batch requests:  43%|████▎     | 81/187 [00:54<01:09,  1.53it/s][A

Running generate_batch requests:  49%|████▊     | 91/187 [00:58<00:55,  1.73it/s][A

Running generate_batch requests:  54%|█████▍    | 101/187 [01:02<00:45,  1.89it/s][A

Running generate_batch requests:  59%|█████▉    | 111/187 [01:10<00:46,  1.64it/s][A

Running generate_batch requests:  65%|██████▍   | 121/187 [01:14<00:35,  1.84it/s][A

Running generate_batch requests:  70%|███████   | 131/187 [01:17<00:26,  2.09it/s][A

Running generate_batch requests:  75%|███████▌  | 141/187 [01:22<00:21,  2.12it/s][A

Running generate_batch requests:  81%|████████  | 151/187 [01:25<00:15,  2.27it/s][A

Running generate_batch requests:  86%|████████▌ | 161/187 [01:33<00:13,  1.88it/s][A

Running generate_batch requests:  91%|█████████▏| 171/187 [01:36<00:07,  2.11it/s][A

Running generate_batch requests:  97%|█████████▋| 181/187 [01:41<00:02,  2.15it/s][A
Running generate_batch requests: 100%|██████████| 187/187 [01:41<00:00,  1.85it/s]

Running generation tasks: 100%|██████████| 1/1 [11:55<00:00, 715.47s/it]2025-05-25:14:18:15,094 INFO     [databuilder.py:301] Generated 129 data in this iteration, 129 data overall
2025-05-25:14:18:15,094 INFO     [databuilder.py:313] Launch postprocessing
2025-05-25:14:18:15,094 INFO     [databuilder.py:315] Postprocessing completed

Running generation tasks: 100%|██████████| 1/1 [11:55<00:00, 715.48s/it]
2025-05-25:14:18:15,103 INFO     [databuilder.py:334] Generation took 715.48s
Generated Data: /gb-afm-read-write/outputs/digit/gbkwikyqc5/tasks/watsonx/instructlab/knowledge/maximo/final_data.jsonl
