R Under development (unstable) (2025-11-06 r88990 ucrt) -- "Unsuffered Consequences" Copyright (C) 2025 The R Foundation for Statistical Computing Platform: x86_64-w64-mingw32/x64 R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome to redistribute it under certain conditions. Type 'license()' or 'licence()' for distribution details. R is a collaborative project with many contributors. Type 'contributors()' for more information and 'citation()' on how to cite R or R packages in publications. Type 'demo()' for some demos, 'help()' for on-line help, or 'help.start()' for an HTML browser interface to help. Type 'q()' to quit R. > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") + library("mlr3tuning") + test_check("mlr3tuning") + } Loading required package: mlr3 Loading required package: paradox # 2025-11-07 13:13:54 CET: Initialization # Elitist race # Elitist new instances: 1 # Elitist limit: 2 # nbIterations: 2 # minNbSurvival: 2 # nbParameters: 1 # seed: 1859297908 # confidence level: 0.95 # budget: 42 # mu: 5 # deterministic: FALSE # 2025-11-07 13:13:54 CET: Iteration 1 of 2 # experimentsUsed: 0 # remainingBudget: 42 # currentBudget: 21 # nbConfigurations: 3 # Markers: x No test is performed. c Configurations are discarded only due to capping. - The test is performed and some configurations are discarded. = The test is performed but no configuration is discarded. ! The test is performed and configurations could be discarded but elite configurations are preserved. . All alive configurations are elite and nothing is discarded. +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ | | Instance| Alive| Best| Mean best| Exp so far| W time| rho|KenW| Qvar| +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ |x| 1| 3| 1| 0.06000000000| 3|00:00:00| NA| NA| NA| |x| 2| 3| 1| 0.06000000000| 6|00:00:00|+1.00|1.00|0.0000| |x| 3| 3| 1| 0.06000000000| 9|00:00:00|+1.00|1.00|0.0000| |x| 4| 3| 1| 0.05500000000| 12|00:00:00|+1.00|1.00|0.0000| |=| 5| 3| 1| 0.06000000000| 15|00:00:00|+1.00|1.00|0.0000| |=| 6| 3| 1| 0.06333333333| 18|00:00:00|+1.00|1.00|0.0000| |=| 7| 3| 1| 0.06000000000| 21|00:00:00|+1.00|1.00|0.0000| +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ Best-so-far configuration: 1 mean value: 0.06000000000 Description of the best-so-far configuration: .ID. cp .PARENT. 1 1 0.168553721904755 NA # 2025-11-07 13:13:56 CET: Elite configurations (first number is the configuration ID; listed from best to worst according to the sum of ranks): cp 1 0.168553721904755 2 0.268553721904755 # 2025-11-07 13:13:56 CET: Iteration 2 of 2 # experimentsUsed: 21 # remainingBudget: 21 # currentBudget: 21 # nbConfigurations: 4 # Markers: x No test is performed. c Configurations are discarded only due to capping. - The test is performed and some configurations are discarded. = The test is performed but no configuration is discarded. ! The test is performed and configurations could be discarded but elite configurations are preserved. . All alive configurations are elite and nothing is discarded. +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ | | Instance| Alive| Best| Mean best| Exp so far| W time| rho|KenW| Qvar| +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ |x| 8| 4| 1| 0.08000000000| 4|00:00:00| NA| NA| NA| |x| 4| 4| 1| 0.06000000000| 6|00:00:00|+1.00|1.00|0.0000| |x| 6| 4| 1| 0.06666666667| 8|00:00:00|+1.00|1.00|0.0000| |x| 1| 4| 1| 0.06500000000| 10|00:00:00|+1.00|1.00|0.0000| |=| 5| 4| 1| 0.06800000000| 12|00:00:00|+1.00|1.00|0.0000| |=| 7| 4| 1| 0.06333333333| 14|00:00:00|+1.00|1.00|0.0000| |=| 2| 4| 1| 0.06285714286| 16|00:00:00|+1.00|1.00|0.0000| |=| 3| 4| 1| 0.06250000000| 18|00:00:00|+1.00|1.00|0.0000| +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ Best-so-far configuration: 1 mean value: 0.06250000000 Description of the best-so-far configuration: .ID. cp .PARENT. 1 1 0.168553721904755 NA # 2025-11-07 13:13:57 CET: Elite configurations (first number is the configuration ID; listed from best to worst according to the sum of ranks): cp 1 0.168553721904755 2 0.268553721904755 # 2025-11-07 13:13:57 CET: Stopped because there is not enough budget left to race more than the minimum (2). # You may either increase the budget or set 'minNbSurvival' to a lower value. # Iteration: 3 # nbIterations: 3 # experimentsUsed: 39 # timeUsed: 0 # remainingBudget: 3 # currentBudget: 3 # number of elites: 2 # nbConfigurations: 2 # Total CPU user time: 3.14, CPU sys time: 0.03, Wall-clock time: 3.18 # 2025-11-07 13:13:57 CET: Starting post-selection: # Configurations selected: 1, 2, 4. # Pending instances: 0, 0, 0. # 2025-11-07 13:13:57 CET: seed: 1859297908 # Configurations: 3 # Available experiments: 3 # minSurvival: 1 # Markers: x No test is performed. c Configurations are discarded only due to capping. - The test is performed and some configurations are discarded. = The test is performed but no configuration is discarded. ! The test is performed and configurations could be discarded but elite configurations are preserved. . All alive configurations are elite and nothing is discarded. +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ | | Instance| Alive| Best| Mean best| Exp so far| W time| rho|KenW| Qvar| +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ |.| 5| 3| 1| 0.08000000000| 0|00:00:00| NA| NA| NA| |.| 3| 3| 1| 0.07000000000| 0|00:00:00|+1.00|1.00|0.0000| |.| 1| 3| 1| 0.06666666667| 0|00:00:00|+1.00|1.00|0.0000| |.| 4| 3| 1| 0.06000000000| 0|00:00:00|+1.00|1.00|0.0000| |.| 7| 3| 1| 0.05600000000| 0|00:00:00|+1.00|1.00|0.0000| |.| 2| 3| 1| 0.05666666667| 0|00:00:00|+1.00|1.00|0.0000| |.| 6| 3| 1| 0.06000000000| 0|00:00:00|+1.00|1.00|0.0000| |.| 8| 3| 1| 0.06250000000| 0|00:00:00|+1.00|1.00|0.0000| |=| 9| 3| 1| 0.06222222222| 3|00:00:00|+1.00|1.00|0.0000| +-+-----------+-----------+-----------+----------------+-----------+--------+-----+----+------+ Best-so-far configuration: 1 mean value: 0.06222222222 Description of the best-so-far configuration: .ID. cp .PARENT. 1 1 0.168553721904755 NA # 2025-11-07 13:13:58 CET: Elite configurations (first number is the configuration ID; listed from best to worst according to the sum of ranks): cp 1 0.168553721904755 2 0.268553721904755 # Total CPU user time: 3.39, CPU sys time: 0.04, Wall-clock time: 3.44 [ FAIL 0 | WARN 0 | SKIP 69 | PASS 4655 ] ══ Skipped tests (69) ══════════════════════════════════════════════════════════ • On CRAN (68): 'test_ArchiveAsyncTuning.R:2:3', 'test_ArchiveAsyncTuning.R:61:3', 'test_ArchiveAsyncTuning.R:119:3', 'test_ArchiveAsyncTuning.R:146:3', 'test_ArchiveAsyncTuning.R:169:3', 'test_ArchiveAsyncTuning.R:209:3', 'test_ArchiveAsyncTuning.R:251:3', 'test_ArchiveAsyncTuning.R:284:3', 'test_ArchiveAsyncTuningFrozen.R:2:3', 'test_AutoTuner.R:640:3', 'test_CallbackAsyncTuning.R:4:3', 'test_CallbackAsyncTuning.R:33:3', 'test_CallbackAsyncTuning.R:64:3', 'test_CallbackAsyncTuning.R:93:3', 'test_CallbackAsyncTuning.R:124:3', 'test_CallbackAsyncTuning.R:160:3', 'test_CallbackAsyncTuning.R:188:3', 'test_CallbackAsyncTuning.R:222:3', 'test_CallbackAsyncTuning.R:252:3', 'test_CallbackAsyncTuning.R:281:3', 'test_CallbackAsyncTuning.R:312:3', 'test_CallbackAsyncTuning.R:343:3', 'test_CallbackAsyncTuning.R:373:3', 'test_CallbackAsyncTuning.R:405:3', 'test_CallbackAsyncTuning.R:443:3', 'test_CallbackAsyncTuning.R:480:3', 'test_CallbackAsyncTuning.R:516:3', 'test_Tuner.R:68:3', 'test_TunerAsyncDesignPoints.R:2:3', 'test_TunerAsyncGridSearch.R:2:3', 'test_TunerAsyncRandomSearch.R:2:3', 'test_TuningInstanceAsyncMultiCrit.R:2:3', 'test_TuningInstanceAsyncMultiCrit.R:30:3', 'test_TuningInstanceAsyncMultiCrit.R:57:3', 'test_TuningInstanceAsyncMultiCrit.R:81:3', 'test_TuningInstanceAsyncMultiCrit.R:106:3', 'test_TuningInstanceAsyncMultiCrit.R:134:3', 'test_TuningInstanceAsyncMultiCrit.R:189:3', 'test_TuningInstanceAsyncMultiCrit.R:236:3', 'test_TuningInstanceAsyncMultiCrit.R:261:3', 'test_TuningInstanceAsyncSingleCrit.R:2:3', 'test_TuningInstanceAsyncSingleCrit.R:29:3', 'test_TuningInstanceAsyncSingleCrit.R:54:3', 'test_TuningInstanceAsyncSingleCrit.R:78:3', 'test_TuningInstanceAsyncSingleCrit.R:104:3', 'test_TuningInstanceAsyncSingleCrit.R:131:3', 'test_TuningInstanceAsyncSingleCrit.R:182:3', 'test_TuningInstanceAsyncSingleCrit.R:213:3', 'test_TuningInstanceAsyncSingleCrit.R:226:3', 'test_TuningInstanceAsyncSingleCrit.R:240:3', 'test_TuningInstanceAsyncSingleCrit.R:266:3', 'test_auto_tuner.R:25:3', 'test_auto_tuner.R:48:3', 'test_mlr_callbacks.R:40:3', 'test_mlr_callbacks.R:93:3', 'test_mlr_callbacks.R:117:3', 'test_mlr_callbacks.R:141:3', 'test_mlr_callbacks.R:162:3', 'test_mlr_callbacks.R:192:3', 'test_mlr_callbacks.R:218:3', 'test_mlr_callbacks.R:251:3', 'test_mlr_callbacks.R:410:3', 'test_mlr_callbacks.R:452:3', 'test_mlr_callbacks.R:480:3', 'test_ti_async.R:2:3', 'test_ti_async.R:16:3', 'test_ti_async.R:30:3', 'test_ti_async.R:42:3' • On Windows (1): 'test_TunerBatchNLoptr.R:2:3' [ FAIL 0 | WARN 0 | SKIP 69 | PASS 4655 ] > > proc.time() user system elapsed 272.87 6.18 279.09