R Under development (unstable) (2024-12-21 r87453 ucrt) -- "Unsuffered Consequences" Copyright (C) 2024 The R Foundation for Statistical Computing Platform: x86_64-w64-mingw32/x64 R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome to redistribute it under certain conditions. Type 'license()' or 'licence()' for distribution details. R is a collaborative project with many contributors. Type 'contributors()' for more information and 'citation()' on how to cite R or R packages in publications. Type 'demo()' for some demos, 'help()' for on-line help, or 'help.start()' for an HTML browser interface to help. Type 'q()' to quit R. > # This file is part of the standard setup for testthat. > # It is recommended that you do not modify it. > # > # Where should you do additional test configuration? > # Learn more about the roles of various files in: > # * https://r-pkgs.org/testing-design.html#sec-tests-files-overview > # * https://testthat.r-lib.org/articles/special-files.html > > library(testthat) > library(tidyprompt) > > test_check("tidyprompt") --- Sending request to LLM provider (llama3.1:8b): --- Hi! --- Receiving response from LLM provider: --- I'm a fake LLM! This is my default response. --- Sending request to LLM provider (llama3.1:8b): --- Hi --- Receiving response from LLM provider: --- I'm a fake LLM! This is my default response. --- Sending request to LLM provider (llama3.1:8b): --- Hi How are you? --- Receiving response from LLM provider: --- I'm a fake LLM! This is my default response. --- Sending request to LLM provider (llama3.1:8b): --- Hi What is 2 + 2? You must answer with only an integer (use no other characters). --- Receiving response from LLM provider: --- 4 --- Sending request to LLM provider (llama3.1:8b): --- You are given a user's prompt. To answer the user's prompt, you need to think step by step to arrive at a final answer. ----- START OF USER'S PROMPT ----- What is 2 + 2? You must answer with only an integer (use no other characters). ----- END OF USER'S PROMPT ----- What are the steps you would take to answer the user's prompt? Describe your thought process in the following format: >> step 1: >> step 2: (etc.) When you are done, you must type: FINISH[] Make sure your final answer follows the logical conclusion of your thought process. --- Receiving response from LLM provider: --- >> step 1: Identify the mathematical operation in the prompt, which is a simple addition problem. >> step 2: Recall the basic arithmetic fact that 2 + 2 equals a specific numerical value. >> step 3: Apply this knowledge to determine the result of the addition problem, using the known facts about numbers and their operations. >> step 4: Conclude that based on this mathematical understanding, the solution to the prompt "What is 2 + 2?" is a fixed numerical quantity. FINISH[4] --- Sending request to LLM provider (no model specified): --- Hello NA Hello! --- Sending request to LLM provider (llama3.1:8b): --- Hi --- Receiving response from LLM provider: --- beepido boop ba --- Sending request to LLM provider (llama3.1:8b): --- Hi --- Receiving response from LLM provider: --- I'm a fake LLM! This is my default response. --- Sending request to LLM provider (llama3.1:8b): --- You are given a user's prompt. To answer the user's prompt, you need to think step by step to arrive at a final answer. ----- START OF USER'S PROMPT ----- What is 2 + 2? You must answer with only an integer (use no other characters). ----- END OF USER'S PROMPT ----- What are the steps you would take to answer the user's prompt? Describe your thought process in the following format: >> step 1: >> step 2: (etc.) When you are done, you must type: FINISH[] Make sure your final answer follows the logical conclusion of your thought process. --- Receiving response from LLM provider: --- >> step 1: Identify the mathematical operation in the prompt, which is a simple addition problem. >> step 2: Recall the basic arithmetic fact that 2 + 2 equals a specific numerical value. >> step 3: Apply this knowledge to determine the result of the addition problem, using the known facts about numbers and their operations. >> step 4: Conclude that based on this mathematical understanding, the solution to the prompt "What is 2 + 2?" is a fixed numerical quantity. FINISH[4] --- Sending request to LLM provider (llama3.1:8b): --- hi --- Receiving response from LLM provider: --- I'm a fake LLM! This is my default response. [ FAIL 0 | WARN 0 | SKIP 15 | PASS 75 ] ══ Skipped tests (15) ══════════════════════════════════════════════════════════ • empty test (1): 'test-prompt_wrap.R:42:1' • skip test: Ollama not available (12): 'test-answer-as-boolean.R:2:3', 'test-answer-as-json.R:2:3', 'test-answer-as-json.R:12:3', 'test-answer-as-json.R:145:3', 'test-answer_as_integer.R:2:3', 'test-answer_as_key_value.R:25:3', 'test-answer_as_list.R:23:3', 'test-answer_using_r.R:2:3', 'test-answer_using_tools.R:2:3', 'test-answer_using_tools.R:14:3', 'test-answer_using_tools.R:57:3', 'test-quit-if.R:2:3' • skip test: OpenAI API key not found (2): 'test-answer-as-json.R:107:3', 'test-answer_using_tools.R:69:3' [ FAIL 0 | WARN 0 | SKIP 15 | PASS 75 ] > > proc.time() user system elapsed 2.5 0.5 29.9