R Under development (unstable) (2026-02-11 r89406 ucrt) -- "Unsuffered Consequences" Copyright (C) 2026 The R Foundation for Statistical Computing Platform: x86_64-w64-mingw32/x64 R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome to redistribute it under certain conditions. Type 'license()' or 'licence()' for distribution details. R is a collaborative project with many contributors. Type 'contributors()' for more information and 'citation()' on how to cite R or R packages in publications. Type 'demo()' for some demos, 'help()' for on-line help, or 'help.start()' for an HTML browser interface to help. Type 'q()' to quit R. > # This file is part of the standard setup for testthat. > # It is recommended that you do not modify it. > # > # Where should you do additional test configuration? > # Learn more about the roles of various files in: > # * https://r-pkgs.org/testing-design.html#sec-tests-files-overview > # * https://testthat.r-lib.org/articles/special-files.html > > library(testthat) > library(quallmer) Loading required package: ellmer > > test_check("quallmer") # quallmer coded object # Run: original # Codebook: Test Codebook # Model: test/model # Units: 3 # A tibble: 3 x 2 .id score * 1 1 0.5 2 2 -0.3 3 3 0.8 -- Inter-rater reliability -- Subjects: 5 Raters: 2 -- score (interval) Percent agreement: 0.6000 Krippendorff's alpha: 0.6786 ICC: 0.6923 Pearson's r: 0.6429 i Converting 2 plain data frames to objects. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting 2 plain data frames to objects. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting 3 plain data frames to objects. i Use `as_qlm_coded()` directly to provide coder names and metadata. v Trail saved to 'D:\temp\2026_02_12_11_40_17_28653\RtmpQLp0dr/test_trail.rds' v Report saved to 'D:\temp\2026_02_12_11_40_17_28653\RtmpQLp0dr/test_trail.qmd' i Render with `quarto::quarto_render("D:\temp\2026_02_12_11_40_17_28653\RtmpQLp0dr/test_trail.qmd")` v Trail saved to 'D:\temp\2026_02_12_11_40_17_28653\RtmpQLp0dr/test_trail_comp.rds' v Report saved to 'D:\temp\2026_02_12_11_40_17_28653\RtmpQLp0dr/test_trail_comp.qmd' i Render with `quarto::quarto_render("D:\temp\2026_02_12_11_40_17_28653\RtmpQLp0dr/test_trail_comp.qmd")` v Trail saved to 'D:\temp\2026_02_12_11_40_17_28653\RtmpQLp0dr/test_trail_val.rds' v Report saved to 'D:\temp\2026_02_12_11_40_17_28653\RtmpQLp0dr/test_trail_val.qmd' i Render with `quarto::quarto_render("D:\temp\2026_02_12_11_40_17_28653\RtmpQLp0dr/test_trail_val.qmd")` v Trail saved to 'D:\temp\2026_02_12_11_40_17_28653\RtmpQLp0dr/test_trail_multi.rds' v Report saved to 'D:\temp\2026_02_12_11_40_17_28653\RtmpQLp0dr/test_trail_multi.qmd' i Render with `quarto::quarto_render("D:\temp\2026_02_12_11_40_17_28653\RtmpQLp0dr/test_trail_multi.qmd")` v Trail saved to 'D:\temp\2026_02_12_11_40_17_28653\RtmpQLp0dr/test_trail_cb.rds' v Report saved to 'D:\temp\2026_02_12_11_40_17_28653\RtmpQLp0dr/test_trail_cb.qmd' i Render with `quarto::quarto_render("D:\temp\2026_02_12_11_40_17_28653\RtmpQLp0dr/test_trail_cb.qmd")` i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. -- quallmer validation -- n: 10 -- category (nominal) By class: : accuracy: 1.0000 precision: 1.0000 recall: 1.0000 F1: 1.0000 Cohen's kappa: 1.0000 i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. -- quallmer validation -- n: 12 -- category (nominal) Global: accuracy: 1.0000 precision: 1.0000 recall: 1.0000 F1: 1.0000 Cohen's kappa: 1.0000 By class: A: precision: 1.0000 recall: 1.0000 F1: 1.0000 B: precision: 1.0000 recall: 1.0000 F1: 1.0000 C: precision: 1.0000 recall: 1.0000 F1: 1.0000 i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. -- quallmer validation -- n: 10 -- rating (ordinal) Spearman's rho: 1.0000 Kendall's tau: 1.0000 MAE: 0.0000 i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. -- quallmer validation -- n: 10 -- rating (nominal) By class: : accuracy: 1.0000 precision: 1.0000 recall: 1.0000 F1: 1.0000 Cohen's kappa: 1.0000 i Converting 1 plain data frame to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting 1 plain data frame to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. i Converting `gold` to object. i Use `as_qlm_coded()` directly to provide coder names and metadata. [ FAIL 0 | WARN 2 | SKIP 1 | PASS 562 ] ══ Skipped tests (1) ═══════════════════════════════════════════════════════════ • Warning detection in test environment is inconsistent; manually verified to work (1): 'test-annotate.R:65:3' [ FAIL 0 | WARN 2 | SKIP 1 | PASS 562 ] > > proc.time() user system elapsed 12.32 2.26 14.65