R Under development (unstable) (2024-12-15 r87442 ucrt) -- "Unsuffered Consequences" Copyright (C) 2024 The R Foundation for Statistical Computing Platform: x86_64-w64-mingw32/x64 R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome to redistribute it under certain conditions. Type 'license()' or 'licence()' for distribution details. R is a collaborative project with many contributors. Type 'contributors()' for more information and 'citation()' on how to cite R or R packages in publications. Type 'demo()' for some demos, 'help()' for on-line help, or 'help.start()' for an HTML browser interface to help. Type 'q()' to quit R. > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") + library("mlr3tuning") + test_check("mlr3tuning") + } Loading required package: mlr3 Loading required package: paradox # 2024-12-17 11:33:09 CET: Initialization # Elitist race # Elitist new instances: 1 # Elitist limit: 2 # nbIterations: 2 # minNbSurvival: 2 # nbParameters: 1 # seed: 338589155 # confidence level: 0.95 # budget: 42 # mu: 5 # deterministic: FALSE # 2024-12-17 11:33:09 CET: Iteration 1 of 2 # experimentsUsedSoFar: 0 # remainingBudget: 42 # currentBudget: 21 # nbConfigurations: 3 # Markers: x No test is performed. c Configurations are discarded only due to capping. - The test is performed and some configurations are discarded. = The test is performed but no configuration is discarded. ! The test is performed and configurations could be discarded but elite configurations are preserved. . All alive configurations are elite and nothing is discarded. +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ | | Instance| Alive| Best| Mean best| Exp so far| W time| rho|KenW| Qvar| +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ |x| 1| 3| 1| 0.06000000000| 3|00:00:00| NA| NA| NA| |x| 2| 3| 1| 0.07000000000| 6|00:00:00|+1.00|1.00|0.0000| |x| 3| 3| 1| 0.07333333333| 9|00:00:00|+1.00|1.00|0.0000| |x| 4| 3| 1| 0.06000000000| 12|00:00:00|+1.00|1.00|0.0000| |=| 5| 3| 1| 0.06400000000| 15|00:00:00|+1.00|1.00|0.0000| |=| 6| 3| 1| 0.06333333333| 18|00:00:00|+1.00|1.00|0.0000| |=| 7| 3| 1| 0.06571428571| 21|00:00:00|+1.00|1.00|0.0000| +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ Best-so-far configuration: 1 mean value: 0.06571428571 Description of the best-so-far configuration: .ID. cp .PARENT. 1 1 0.283472669124603 NA # 2024-12-17 11:33:11 CET: Elite configurations (first number is the configuration ID; listed from best to worst according to the sum of ranks): cp 1 0.283472669124603 2 0.183472675085068 # 2024-12-17 11:33:11 CET: Iteration 2 of 2 # experimentsUsedSoFar: 21 # remainingBudget: 21 # currentBudget: 21 # nbConfigurations: 4 # Markers: x No test is performed. c Configurations are discarded only due to capping. - The test is performed and some configurations are discarded. = The test is performed but no configuration is discarded. ! The test is performed and configurations could be discarded but elite configurations are preserved. . All alive configurations are elite and nothing is discarded. +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ | | Instance| Alive| Best| Mean best| Exp so far| W time| rho|KenW| Qvar| +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ |x| 8| 4| 1| 0.04000000000| 4|00:00:00| NA| NA| NA| |x| 3| 4| 1| 0.06000000000| 6|00:00:00|+1.00|1.00|0.0000| |x| 4| 4| 1| 0.04666666667| 8|00:00:00|+1.00|1.00|0.0000| |x| 5| 4| 1| 0.05500000000| 10|00:00:00|+1.00|1.00|0.0000| |=| 7| 4| 1| 0.06000000000| 12|00:00:00|+1.00|1.00|0.0000| |=| 1| 4| 1| 0.06000000000| 14|00:00:00|+1.00|1.00|0.0000| |=| 2| 4| 1| 0.06285714286| 16|00:00:00|+1.00|1.00|0.0000| |=| 6| 4| 1| 0.06250000000| 18|00:00:00|+1.00|1.00|0.0000| +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ Best-so-far configuration: 1 mean value: 0.06250000000 Description of the best-so-far configuration: .ID. cp .PARENT. 1 1 0.283472669124603 NA # 2024-12-17 11:33:12 CET: Elite configurations (first number is the configuration ID; listed from best to worst according to the sum of ranks): cp 1 0.283472669124603 2 0.183472675085068 # 2024-12-17 11:33:12 CET: Stopped because there is not enough budget left to race more than the minimum (2). # You may either increase the budget or set 'minNbSurvival' to a lower value. # Iteration: 3 # nbIterations: 3 # experimentsUsedSoFar: 39 # timeUsed: 0 # remainingBudget: 3 # currentBudget: 3 # number of elites: 2 # nbConfigurations: 2 # Total CPU user time: 2.6, CPU sys time: 0.02, Wall-clock time: 2.65 # 2024-12-17 11:33:12 CET: Starting post-selection: # Configurations selected: 1, 2, 4. # Pending instances: 0, 0, 0. # Seed: 338589155 # Configurations: 3 # Available experiments: 3 # minSurvival: 1 # Markers: x No test is performed. c Configurations are discarded only due to capping. - The test is performed and some configurations are discarded. = The test is performed but no configuration is discarded. ! The test is performed and configurations could be discarded but elite configurations are preserved. . All alive configurations are elite and nothing is discarded. +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ | | Instance| Alive| Best| Mean best| Exp so far| W time| rho|KenW| Qvar| +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ |.| 4| 3| 1| 0.02000000000| 0|00:00:00| NA| NA| NA| |.| 2| 3| 1| 0.05000000000| 0|00:00:00|+1.00|1.00|0.0000| |.| 6| 3| 1| 0.05333333333| 0|00:00:00|+1.00|1.00|0.0000| |.| 3| 3| 1| 0.06000000000| 0|00:00:00|+1.00|1.00|0.0000| |.| 5| 3| 1| 0.06400000000| 0|00:00:00|+1.00|1.00|0.0000| |.| 1| 3| 1| 0.06333333333| 0|00:00:00|+1.00|1.00|0.0000| |.| 8| 3| 1| 0.06000000000| 0|00:00:00|+1.00|1.00|0.0000| |.| 7| 3| 1| 0.06250000000| 0|00:00:00|+1.00|1.00|0.0000| |=| 9| 3| 1| 0.06000000000| 3|00:00:00|+1.00|1.00|0.0000| +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ Best-so-far configuration: 1 mean value: 0.06000000000 Description of the best-so-far configuration: .ID. cp .PARENT. 1 1 0.283472669124603 NA # 2024-12-17 11:33:12 CET: Elite configurations (first number is the configuration ID; listed from best to worst according to the sum of ranks): cp 1 0.283472669124603 2 0.183472675085068 # Total CPU user time: 2.8, CPU sys time: 0.03, Wall-clock time: 2.87 [ FAIL 0 | WARN 0 | SKIP 61 | PASS 4549 ] ══ Skipped tests (61) ══════════════════════════════════════════════════════════ • On CRAN (60): 'test_ArchiveAsyncTuning.R:2:3', 'test_ArchiveAsyncTuning.R:55:3', 'test_ArchiveAsyncTuning.R:110:3', 'test_ArchiveAsyncTuning.R:134:3', 'test_ArchiveAsyncTuning.R:154:3', 'test_ArchiveAsyncTuning.R:191:3', 'test_ArchiveAsyncTuning.R:230:3', 'test_ArchiveAsyncTuning.R:261:3', 'test_ArchiveAsyncTuningFrozen.R:2:3', 'test_AutoTuner.R:618:3', 'test_CallbackAsyncTuning.R:4:3', 'test_CallbackAsyncTuning.R:29:3', 'test_CallbackAsyncTuning.R:55:3', 'test_CallbackAsyncTuning.R:80:3', 'test_CallbackAsyncTuning.R:107:3', 'test_CallbackAsyncTuning.R:139:3', 'test_CallbackAsyncTuning.R:162:3', 'test_CallbackAsyncTuning.R:192:3', 'test_CallbackAsyncTuning.R:219:3', 'test_CallbackAsyncTuning.R:244:3', 'test_CallbackAsyncTuning.R:271:3', 'test_CallbackAsyncTuning.R:298:3', 'test_CallbackAsyncTuning.R:324:3', 'test_Tuner.R:68:3', 'test_TunerAsyncDesignPoints.R:2:3', 'test_TunerAsyncGridSearch.R:2:3', 'test_TunerAsyncRandomSearch.R:2:3', 'test_TuningInstanceAsyncMultiCrit.R:2:3', 'test_TuningInstanceAsyncMultiCrit.R:28:3', 'test_TuningInstanceAsyncMultiCrit.R:51:3', 'test_TuningInstanceAsyncMultiCrit.R:73:3', 'test_TuningInstanceAsyncMultiCrit.R:95:3', 'test_TuningInstanceAsyncMultiCrit.R:121:3', 'test_TuningInstanceAsyncMultiCrit.R:174:3', 'test_TuningInstanceAsyncSingleCrit.R:2:3', 'test_TuningInstanceAsyncSingleCrit.R:27:3', 'test_TuningInstanceAsyncSingleCrit.R:48:3', 'test_TuningInstanceAsyncSingleCrit.R:70:3', 'test_TuningInstanceAsyncSingleCrit.R:94:3', 'test_TuningInstanceAsyncSingleCrit.R:119:3', 'test_TuningInstanceAsyncSingleCrit.R:167:3', 'test_TuningInstanceAsyncSingleCrit.R:195:3', 'test_TuningInstanceAsyncSingleCrit.R:208:3', 'test_auto_tuner.R:25:3', 'test_auto_tuner.R:46:3', 'test_mlr_callbacks.R:40:3', 'test_mlr_callbacks.R:91:3', 'test_mlr_callbacks.R:113:3', 'test_mlr_callbacks.R:135:3', 'test_mlr_callbacks.R:154:3', 'test_mlr_callbacks.R:182:3', 'test_mlr_callbacks.R:206:3', 'test_mlr_callbacks.R:237:3', 'test_mlr_callbacks.R:394:3', 'test_mlr_callbacks.R:434:3', 'test_mlr_callbacks.R:458:3', 'test_ti_async.R:2:3', 'test_ti_async.R:16:3', 'test_ti_async.R:30:3', 'test_ti_async.R:42:3' • On Windows (1): 'test_TunerBatchNLoptr.R:2:3' [ FAIL 0 | WARN 0 | SKIP 61 | PASS 4549 ] > > proc.time() user system elapsed 213.37 5.26 218.70