R Under development (unstable) (2025-08-24 r88696 ucrt) -- "Unsuffered Consequences" Copyright (C) 2025 The R Foundation for Statistical Computing Platform: x86_64-w64-mingw32/x64 R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome to redistribute it under certain conditions. Type 'license()' or 'licence()' for distribution details. R is a collaborative project with many contributors. Type 'contributors()' for more information and 'citation()' on how to cite R or R packages in publications. Type 'demo()' for some demos, 'help()' for on-line help, or 'help.start()' for an HTML browser interface to help. Type 'q()' to quit R. > # This file is part of the standard setup for testthat. > # It is recommended that you do not modify it. > # > # Where should you do additional test configuration? > # Learn more about the roles of various files in: > # * https://r-pkgs.org/testing-design.html#sec-tests-files-overview > # * https://testthat.r-lib.org/articles/special-files.html > > library(testthat) > library(tidyprompt) > > test_check("tidyprompt") --- Sending request to LLM provider (llama3.1:8b): --- Hi! --- Receiving response from LLM provider: --- I'm a fake LLM! This is my default response. --- Sending request to LLM provider (llama3.1:8b): --- Hi --- Receiving response from LLM provider: --- I'm a fake LLM! This is my default response. --- Sending request to LLM provider (llama3.1:8b): --- Hi How are you? --- Receiving response from LLM provider: --- I'm a fake LLM! This is my default response. --- Sending request to LLM provider (llama3.1:8b): --- Hi What is 2 + 2? You must answer with only an integer (use no other characters). --- Receiving response from LLM provider: --- 4 --- Sending request to LLM provider (llama3.1:8b): --- You are given a user's prompt. To answer the user's prompt, you need to think step by step to arrive at a final answer. ----- START OF USER'S PROMPT ----- What is 2 + 2? You must answer with only an integer (use no other characters). ----- END OF USER'S PROMPT ----- What are the steps you would take to answer the user's prompt? Describe your thought process in the following format: >> step 1: >> step 2: (etc.) When you are done, you must type: FINISH[] Make sure your final answer follows the logical conclusion of your thought process. --- Receiving response from LLM provider: --- >> step 1: Identify the mathematical operation in the prompt, which is a simple addition problem. >> step 2: Recall the basic arithmetic fact that 2 + 2 equals a specific numerical value. >> step 3: Apply this knowledge to determine the result of the addition problem, using the known facts about numbers and their operations. >> step 4: Conclude that based on this mathematical understanding, the solution to the prompt "What is 2 + 2?" is a fixed numerical quantity. FINISH[4] --- Sending request to LLM provider (no model specified): --- Hello NA Hello! --- Sending request to LLM provider (llama3.1:8b): --- Hi --- Receiving response from LLM provider: --- beepido boop ba --- Sending request to LLM provider (llama3.1:8b): --- Hi --- Receiving response from LLM provider: --- I'm a fake LLM! This is my default response. --- Sending request to LLM provider (llama3.1:8b): --- You are given a user's prompt. To answer the user's prompt, you need to think step by step to arrive at a final answer. ----- START OF USER'S PROMPT ----- What is 2 + 2? You must answer with only an integer (use no other characters). ----- END OF USER'S PROMPT ----- What are the steps you would take to answer the user's prompt? Describe your thought process in the following format: >> step 1: >> step 2: (etc.) When you are done, you must type: FINISH[] Make sure your final answer follows the logical conclusion of your thought process. --- Receiving response from LLM provider: --- >> step 1: Identify the mathematical operation in the prompt, which is a simple addition problem. >> step 2: Recall the basic arithmetic fact that 2 + 2 equals a specific numerical value. >> step 3: Apply this knowledge to determine the result of the addition problem, using the known facts about numbers and their operations. >> step 4: Conclude that based on this mathematical understanding, the solution to the prompt "What is 2 + 2?" is a fixed numerical quantity. FINISH[4] --- Sending request to LLM provider (llama3.1:8b): --- hi --- Receiving response from LLM provider: --- I'm a fake LLM! This is my default response. [ FAIL 0 | WARN 0 | SKIP 26 | PASS 165 ] ══ Skipped tests (26) ══════════════════════════════════════════════════════════ • OPENAI_API_KEY not set; skipping OpenAI tests (1): 'test-openai_request.R:14:1' • skip test: Ollama not available (8): 'test-answer-as-boolean.R:2:3', 'test-answer-as-json.R:180:3', 'test-answer_as_integer.R:2:3', 'test-answer_as_key_value.R:32:3', 'test-answer_as_list.R:27:3', 'test-answer_using_r.R:2:3', 'test-answer_using_tools.R:84:3', 'test-quit-if.R:2:3' • skip test: OpenAI API key not found (17): 'test-answer-as-json.R:2:3', 'test-answer-as-json.R:16:3', 'test-answer-as-json.R:142:3', 'test-answer-as-json.R:218:3', 'test-answer-as-json.R:292:3', 'test-answer-as-json.R:336:3', 'test-answer-as-json.R:370:3', 'test-answer-as-json.R:405:3', 'test-answer-as-json.R:441:3', 'test-answer_using_tools.R:26:3', 'test-answer_using_tools.R:38:3', 'test-answer_using_tools.R:94:3', 'test-answer_using_tools.R:109:3', 'test-answer_using_tools.R:124:3', 'test-answer_using_tools.R:142:3', 'test-answer_using_tools.R:157:3', 'test-answer_using_tools.R:172:3' [ FAIL 0 | WARN 0 | SKIP 26 | PASS 165 ] > > proc.time() user system elapsed 2.67 0.60 21.14