R Under development (unstable) (2025-12-10 r89137 ucrt) -- "Unsuffered Consequences" Copyright (C) 2025 The R Foundation for Statistical Computing Platform: x86_64-w64-mingw32/x64 R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome to redistribute it under certain conditions. Type 'license()' or 'licence()' for distribution details. R is a collaborative project with many contributors. Type 'contributors()' for more information and 'citation()' on how to cite R or R packages in publications. Type 'demo()' for some demos, 'help()' for on-line help, or 'help.start()' for an HTML browser interface to help. Type 'q()' to quit R. > # This file is part of the standard setup for testthat. > # It is recommended that you do not modify it. > # > # Where should you do additional test configuration? > # Learn more about the roles of various files in: > # * https://r-pkgs.org/testing-design.html#sec-tests-files-overview > # * https://testthat.r-lib.org/articles/special-files.html > > library(testthat) > library(pairwiseLLM) > > test_check("pairwiseLLM") - OpenAI (openai): OPENAI_API_KEY is set. - Anthropic (anthropic): ANTHROPIC_API_KEY is not set. Set it for this session with: Sys.setenv(ANTHROPIC_API_KEY = "YOUR_KEY_HERE") Or persistently via: usethis::edit_r_environ() and add a line like: ANTHROPIC_API_KEY = "YOUR_KEY_HERE" - Google Gemini (gemini): GEMINI_API_KEY is not set. Set it for this session with: Sys.setenv(GEMINI_API_KEY = "YOUR_KEY_HERE") Or persistently via: usethis::edit_r_environ() and add a line like: GEMINI_API_KEY = "YOUR_KEY_HERE" - Together.ai (together): TOGETHER_API_KEY is not set. Set it for this session with: Sys.setenv(TOGETHER_API_KEY = "YOUR_KEY_HERE") Or persistently via: usethis::edit_r_environ() and add a line like: TOGETHER_API_KEY = "YOUR_KEY_HERE" **** Iteration 1 | Maximum parameter change=0.98 **** Iteration 2 | Maximum parameter change=0.9604 **** Iteration 3 | Maximum parameter change=0.941192 **** Iteration 4 | Maximum parameter change=0.9223682 **** Iteration 5 | Maximum parameter change=0.9039208 **** Iteration 6 | Maximum parameter change=0.8858424 **** Iteration 7 | Maximum parameter change=0.8681255 **** Iteration 8 | Maximum parameter change=0.850763 **** Iteration 9 | Maximum parameter change=0.8337478 **** Iteration 10 | Maximum parameter change=0.8170728 **** Iteration 11 | Maximum parameter change=0.8007314 **** Iteration 12 | Maximum parameter change=0.7847167 **** Iteration 13 | Maximum parameter change=0.7690224 **** Iteration 14 | Maximum parameter change=0.7536419 **** Iteration 15 | Maximum parameter change=0.7385691 **** Iteration 16 | Maximum parameter change=0.7237977 **** Iteration 17 | Maximum parameter change=0.7093218 **** Iteration 18 | Maximum parameter change=0.6951353 **** Iteration 19 | Maximum parameter change=0.6812326 **** Iteration 20 | Maximum parameter change=0.667608 **** Iteration 21 | Maximum parameter change=0.6542558 **** Iteration 22 | Maximum parameter change=0.6411707 **** Iteration 23 | Maximum parameter change=0.6283473 **** Iteration 24 | Maximum parameter change=0.6157803 **** Iteration 25 | Maximum parameter change=0.6034647 **** Iteration 26 | Maximum parameter change=0.5913954 **** Iteration 27 | Maximum parameter change=0.5795675 **** Iteration 28 | Maximum parameter change=0.5679762 **** Iteration 29 | Maximum parameter change=0.5566167 **** Iteration 30 | Maximum parameter change=0.5454843 **** Iteration 31 | Maximum parameter change=0.5345746 **** Iteration 32 | Maximum parameter change=0.5238831 **** Iteration 33 | Maximum parameter change=0.5134055 **** Iteration 34 | Maximum parameter change=0.5031374 **** Iteration 35 | Maximum parameter change=0.4930746 **** Iteration 36 | Maximum parameter change=0.4832131 **** Iteration 37 | Maximum parameter change=0.4735489 **** Iteration 38 | Maximum parameter change=0.4640779 **** Iteration 39 | Maximum parameter change=0.4547963 **** Iteration 40 | Maximum parameter change=0.4457004 **** Iteration 41 | Maximum parameter change=0.4367864 **** Iteration 42 | Maximum parameter change=0.4280507 **** Iteration 43 | Maximum parameter change=0.4194897 **** Iteration 44 | Maximum parameter change=0.4110999 **** Iteration 45 | Maximum parameter change=0.4028779 **** Iteration 46 | Maximum parameter change=0.3948203 **** Iteration 47 | Maximum parameter change=0.3869239 **** Iteration 48 | Maximum parameter change=0.3791854 **** Iteration 49 | Maximum parameter change=0.3716017 **** Iteration 50 | Maximum parameter change=0.3641697 **** Iteration 51 | Maximum parameter change=0.3568863 **** Iteration 52 | Maximum parameter change=0.3497486 **** Iteration 53 | Maximum parameter change=0.3427536 **** Iteration 54 | Maximum parameter change=0.3358985 **** Iteration 55 | Maximum parameter change=0.3291805 **** Iteration 56 | Maximum parameter change=0.3225969 **** Iteration 57 | Maximum parameter change=0.316145 **** Iteration 58 | Maximum parameter change=0.3098221 **** Iteration 59 | Maximum parameter change=0.3036257 **** Iteration 60 | Maximum parameter change=0.2975531 **** Iteration 61 | Maximum parameter change=0.2916021 **** Iteration 62 | Maximum parameter change=0.28577 **** Iteration 63 | Maximum parameter change=0.2800546 **** Iteration 64 | Maximum parameter change=0.2744535 **** Iteration 65 | Maximum parameter change=0.2689645 **** Iteration 66 | Maximum parameter change=0.2635852 **** Iteration 67 | Maximum parameter change=0.2583135 **** Iteration 68 | Maximum parameter change=0.2531472 **** Iteration 69 | Maximum parameter change=0.2480843 **** Iteration 70 | Maximum parameter change=0.2431226 **** Iteration 71 | Maximum parameter change=0.2382601 **** Iteration 72 | Maximum parameter change=0.2334949 **** Iteration 73 | Maximum parameter change=0.228825 **** Iteration 74 | Maximum parameter change=0.2242485 **** Iteration 75 | Maximum parameter change=0.2197636 **** Iteration 76 | Maximum parameter change=0.2153683 **** Iteration 77 | Maximum parameter change=0.2110609 **** Iteration 78 | Maximum parameter change=0.2068397 **** Iteration 79 | Maximum parameter change=0.2027029 **** Iteration 80 | Maximum parameter change=0.1986489 **** Iteration 81 | Maximum parameter change=0.1946759 **** Iteration 82 | Maximum parameter change=0.1907824 **** Iteration 83 | Maximum parameter change=0.1869667 **** Iteration 84 | Maximum parameter change=0.1832274 **** Iteration 85 | Maximum parameter change=0.1795628 **** Iteration 86 | Maximum parameter change=0.1759716 **** Iteration 87 | Maximum parameter change=0.1724521 **** Iteration 88 | Maximum parameter change=0.1690031 **** Iteration 89 | Maximum parameter change=0.165623 **** Iteration 90 | Maximum parameter change=0.1623106 **** Iteration 91 | Maximum parameter change=0.1590644 **** Iteration 92 | Maximum parameter change=0.1558831 **** Iteration 93 | Maximum parameter change=0.1527654 **** Iteration 94 | Maximum parameter change=0.1497101 **** Iteration 95 | Maximum parameter change=0.1467159 **** Iteration 96 | Maximum parameter change=0.1437816 **** Iteration 97 | Maximum parameter change=0.140906 **** Iteration 98 | Maximum parameter change=0.1380878 **** Iteration 99 | Maximum parameter change=0.1353261 **** Iteration 100 | Maximum parameter change=0.1326196 **** Iteration 1 | Maximum parameter change=0.98 **** Iteration 2 | Maximum parameter change=0.9604 **** Iteration 3 | Maximum parameter change=0.941192 **** Iteration 4 | Maximum parameter change=0.9223682 **** Iteration 5 | Maximum parameter change=0.9039208 **** Iteration 6 | Maximum parameter change=0.8858424 **** Iteration 7 | Maximum parameter change=0.8681255 **** Iteration 8 | Maximum parameter change=0.850763 **** Iteration 9 | Maximum parameter change=0.8337478 **** Iteration 10 | Maximum parameter change=0.8170728 **** Iteration 11 | Maximum parameter change=0.8007314 **** Iteration 12 | Maximum parameter change=0.7847167 **** Iteration 13 | Maximum parameter change=0.7690224 **** Iteration 14 | Maximum parameter change=0.7536419 **** Iteration 15 | Maximum parameter change=0.7385691 **** Iteration 16 | Maximum parameter change=0.7237977 **** Iteration 17 | Maximum parameter change=0.7093218 **** Iteration 18 | Maximum parameter change=0.6951353 **** Iteration 19 | Maximum parameter change=0.6812326 **** Iteration 20 | Maximum parameter change=0.667608 **** Iteration 21 | Maximum parameter change=0.6542558 **** Iteration 22 | Maximum parameter change=0.6411707 **** Iteration 23 | Maximum parameter change=0.6283473 **** Iteration 24 | Maximum parameter change=0.6157803 **** Iteration 25 | Maximum parameter change=0.6034647 **** Iteration 26 | Maximum parameter change=0.5913954 **** Iteration 27 | Maximum parameter change=0.5795675 **** Iteration 28 | Maximum parameter change=0.5679762 **** Iteration 29 | Maximum parameter change=0.5566167 **** Iteration 30 | Maximum parameter change=0.5454843 **** Iteration 31 | Maximum parameter change=0.5345746 **** Iteration 32 | Maximum parameter change=0.5238831 **** Iteration 33 | Maximum parameter change=0.5134055 **** Iteration 34 | Maximum parameter change=0.5031374 **** Iteration 35 | Maximum parameter change=0.4930746 **** Iteration 36 | Maximum parameter change=0.4832131 **** Iteration 37 | Maximum parameter change=0.4735489 **** Iteration 38 | Maximum parameter change=0.4640779 **** Iteration 39 | Maximum parameter change=0.4547963 **** Iteration 40 | Maximum parameter change=0.4457004 **** Iteration 41 | Maximum parameter change=0.4367864 **** Iteration 42 | Maximum parameter change=0.4280507 **** Iteration 43 | Maximum parameter change=0.4194897 **** Iteration 44 | Maximum parameter change=0.4110999 **** Iteration 45 | Maximum parameter change=0.4028779 **** Iteration 46 | Maximum parameter change=0.3948203 **** Iteration 47 | Maximum parameter change=0.3869239 **** Iteration 48 | Maximum parameter change=0.3791854 **** Iteration 49 | Maximum parameter change=0.3716017 **** Iteration 50 | Maximum parameter change=0.3641697 **** Iteration 51 | Maximum parameter change=0.3568863 **** Iteration 52 | Maximum parameter change=0.3497486 **** Iteration 53 | Maximum parameter change=0.3427536 **** Iteration 54 | Maximum parameter change=0.3358985 **** Iteration 55 | Maximum parameter change=0.3291805 **** Iteration 56 | Maximum parameter change=0.3225969 **** Iteration 57 | Maximum parameter change=0.316145 **** Iteration 58 | Maximum parameter change=0.3098221 **** Iteration 59 | Maximum parameter change=0.3036257 **** Iteration 60 | Maximum parameter change=0.2975531 **** Iteration 61 | Maximum parameter change=0.2916021 **** Iteration 62 | Maximum parameter change=0.28577 **** Iteration 63 | Maximum parameter change=0.2800546 **** Iteration 64 | Maximum parameter change=0.2744535 **** Iteration 65 | Maximum parameter change=0.2689645 **** Iteration 66 | Maximum parameter change=0.2635852 **** Iteration 67 | Maximum parameter change=0.2583135 **** Iteration 68 | Maximum parameter change=0.2531472 **** Iteration 69 | Maximum parameter change=0.2480843 **** Iteration 70 | Maximum parameter change=0.2431226 **** Iteration 71 | Maximum parameter change=0.2382601 **** Iteration 72 | Maximum parameter change=0.2334949 **** Iteration 73 | Maximum parameter change=0.228825 **** Iteration 74 | Maximum parameter change=0.2242485 **** Iteration 75 | Maximum parameter change=0.2197636 **** Iteration 76 | Maximum parameter change=0.2153683 **** Iteration 77 | Maximum parameter change=0.2110609 **** Iteration 78 | Maximum parameter change=0.2068397 **** Iteration 79 | Maximum parameter change=0.2027029 **** Iteration 80 | Maximum parameter change=0.1986489 **** Iteration 81 | Maximum parameter change=0.1946759 **** Iteration 82 | Maximum parameter change=0.1907824 **** Iteration 83 | Maximum parameter change=0.1869667 **** Iteration 84 | Maximum parameter change=0.1832274 **** Iteration 85 | Maximum parameter change=0.1795628 **** Iteration 86 | Maximum parameter change=0.1759716 **** Iteration 87 | Maximum parameter change=0.1724521 **** Iteration 88 | Maximum parameter change=0.1690031 **** Iteration 89 | Maximum parameter change=0.165623 **** Iteration 90 | Maximum parameter change=0.1623106 **** Iteration 91 | Maximum parameter change=0.1590644 **** Iteration 92 | Maximum parameter change=0.1558831 **** Iteration 93 | Maximum parameter change=0.1527654 **** Iteration 94 | Maximum parameter change=0.1497101 **** Iteration 95 | Maximum parameter change=0.1467159 **** Iteration 96 | Maximum parameter change=0.1437816 **** Iteration 97 | Maximum parameter change=0.140906 **** Iteration 98 | Maximum parameter change=0.1380878 **** Iteration 99 | Maximum parameter change=0.1353261 **** Iteration 100 | Maximum parameter change=0.1326196 **** Iteration 1 | Maximum parameter change=0.98 **** Iteration 2 | Maximum parameter change=0.9604 **** Iteration 3 | Maximum parameter change=0.941192 **** Iteration 4 | Maximum parameter change=0.9223682 **** Iteration 5 | Maximum parameter change=0.9039208 **** Iteration 6 | Maximum parameter change=0.8858424 **** Iteration 7 | Maximum parameter change=0.8681255 **** Iteration 8 | Maximum parameter change=0.850763 **** Iteration 9 | Maximum parameter change=0.8337478 **** Iteration 10 | Maximum parameter change=0.8170728 **** Iteration 11 | Maximum parameter change=0.8007314 **** Iteration 12 | Maximum parameter change=0.7847167 **** Iteration 13 | Maximum parameter change=0.7690224 **** Iteration 14 | Maximum parameter change=0.7536419 **** Iteration 15 | Maximum parameter change=0.7385691 **** Iteration 16 | Maximum parameter change=0.7237977 **** Iteration 17 | Maximum parameter change=0.7093218 **** Iteration 18 | Maximum parameter change=0.6951353 **** Iteration 19 | Maximum parameter change=0.6812326 **** Iteration 20 | Maximum parameter change=0.667608 **** Iteration 21 | Maximum parameter change=0.6542558 **** Iteration 22 | Maximum parameter change=0.6411707 **** Iteration 23 | Maximum parameter change=0.6283473 **** Iteration 24 | Maximum parameter change=0.6157803 **** Iteration 25 | Maximum parameter change=0.6034647 **** Iteration 26 | Maximum parameter change=0.5913954 **** Iteration 27 | Maximum parameter change=0.5795675 **** Iteration 28 | Maximum parameter change=0.5679762 **** Iteration 29 | Maximum parameter change=0.5566167 **** Iteration 30 | Maximum parameter change=0.5454843 **** Iteration 31 | Maximum parameter change=0.5345746 **** Iteration 32 | Maximum parameter change=0.5238831 **** Iteration 33 | Maximum parameter change=0.5134055 **** Iteration 34 | Maximum parameter change=0.5031374 **** Iteration 35 | Maximum parameter change=0.4930746 **** Iteration 36 | Maximum parameter change=0.4832131 **** Iteration 37 | Maximum parameter change=0.4735489 **** Iteration 38 | Maximum parameter change=0.4640779 **** Iteration 39 | Maximum parameter change=0.4547963 **** Iteration 40 | Maximum parameter change=0.4457004 **** Iteration 41 | Maximum parameter change=0.4367864 **** Iteration 42 | Maximum parameter change=0.4280507 **** Iteration 43 | Maximum parameter change=0.4194897 **** Iteration 44 | Maximum parameter change=0.4110999 **** Iteration 45 | Maximum parameter change=0.4028779 **** Iteration 46 | Maximum parameter change=0.3948203 **** Iteration 47 | Maximum parameter change=0.3869239 **** Iteration 48 | Maximum parameter change=0.3791854 **** Iteration 49 | Maximum parameter change=0.3716017 **** Iteration 50 | Maximum parameter change=0.3641697 **** Iteration 51 | Maximum parameter change=0.3568863 **** Iteration 52 | Maximum parameter change=0.3497486 **** Iteration 53 | Maximum parameter change=0.3427536 **** Iteration 54 | Maximum parameter change=0.3358985 **** Iteration 55 | Maximum parameter change=0.3291805 **** Iteration 56 | Maximum parameter change=0.3225969 **** Iteration 57 | Maximum parameter change=0.316145 **** Iteration 58 | Maximum parameter change=0.3098221 **** Iteration 59 | Maximum parameter change=0.3036257 **** Iteration 60 | Maximum parameter change=0.2975531 **** Iteration 61 | Maximum parameter change=0.2916021 **** Iteration 62 | Maximum parameter change=0.28577 **** Iteration 63 | Maximum parameter change=0.2800546 **** Iteration 64 | Maximum parameter change=0.2744535 **** Iteration 65 | Maximum parameter change=0.2689645 **** Iteration 66 | Maximum parameter change=0.2635852 **** Iteration 67 | Maximum parameter change=0.2583135 **** Iteration 68 | Maximum parameter change=0.2531472 **** Iteration 69 | Maximum parameter change=0.2480843 **** Iteration 70 | Maximum parameter change=0.2431226 **** Iteration 71 | Maximum parameter change=0.2382601 **** Iteration 72 | Maximum parameter change=0.2334949 **** Iteration 73 | Maximum parameter change=0.228825 **** Iteration 74 | Maximum parameter change=0.2242485 **** Iteration 75 | Maximum parameter change=0.2197636 **** Iteration 76 | Maximum parameter change=0.2153683 **** Iteration 77 | Maximum parameter change=0.2110609 **** Iteration 78 | Maximum parameter change=0.2068397 **** Iteration 79 | Maximum parameter change=0.2027029 **** Iteration 80 | Maximum parameter change=0.1986489 **** Iteration 81 | Maximum parameter change=0.1946759 **** Iteration 82 | Maximum parameter change=0.1907824 **** Iteration 83 | Maximum parameter change=0.1869667 **** Iteration 84 | Maximum parameter change=0.1832274 **** Iteration 85 | Maximum parameter change=0.1795628 **** Iteration 86 | Maximum parameter change=0.1759716 **** Iteration 87 | Maximum parameter change=0.1724521 **** Iteration 88 | Maximum parameter change=0.1690031 **** Iteration 89 | Maximum parameter change=0.165623 **** Iteration 90 | Maximum parameter change=0.1623106 **** Iteration 91 | Maximum parameter change=0.1590644 **** Iteration 92 | Maximum parameter change=0.1558831 **** Iteration 93 | Maximum parameter change=0.1527654 **** Iteration 94 | Maximum parameter change=0.1497101 **** Iteration 95 | Maximum parameter change=0.1467159 **** Iteration 96 | Maximum parameter change=0.1437816 **** Iteration 97 | Maximum parameter change=0.140906 **** Iteration 98 | Maximum parameter change=0.1380878 **** Iteration 99 | Maximum parameter change=0.1353261 **** Iteration 100 | Maximum parameter change=0.1326196 Creating Gemini batch for 1 pair(s) (model = gemini-3-pro-preview, thinking_level = low)... Batch batches/timeout state: BATCH_STATE_RUNNING Creating Gemini batch for 1 pair(s) (model = gemini-3-pro-preview, thinking_level = low)... Submitting 1 live pair(s) for comparison (backend=ollama, model=mistral-small3.2:24b)... | | | 0% | |======================================================================| 100% WARNING: Ollama error (status 500): backend failure Completed 1 live pair(s) in 0.0s (avg 0.00s per pair). Submitting 1 live pair(s) for comparison (backend=ollama, model=mistral-small3.2:24b)... Completed 1 live pair(s) in 0.0s (avg 0.00s per pair). Unable to run `ollama ps`: simulated failure from ollama ps `ollama ps` failed or returned no output; no models will be unloaded. [ FAIL 0 | WARN 0 | SKIP 1 | PASS 1320 ] ══ Skipped tests (1) ═══════════════════════════════════════════════════════════ • EloChoice is installed; cannot test missing-package behaviour. (1): 'test-elo_model.R:74:3' [ FAIL 0 | WARN 0 | SKIP 1 | PASS 1320 ] > > proc.time() user system elapsed 19.37 2.98 23.01