R Under development (unstable) (2024-03-01 r86033 ucrt) -- "Unsuffered Consequences" Copyright (C) 2024 The R Foundation for Statistical Computing Platform: x86_64-w64-mingw32/x64 R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome to redistribute it under certain conditions. Type 'license()' or 'licence()' for distribution details. R is a collaborative project with many contributors. Type 'contributors()' for more information and 'citation()' on how to cite R or R packages in publications. Type 'demo()' for some demos, 'help()' for on-line help, or 'help.start()' for an HTML browser interface to help. Type 'q()' to quit R. > ################################################################ > # Example 1 # > # The GDI method to validate Q-matrix # > ################################################################ > set.seed(123) > > library(Qval) Qval R Package (version 0.1.5; 2024-03-02) > > ## generate Q-matrix and data > K <- 5 > I <- 20 > example.Q <- sim.Q(K, I) > IQ <- list( + P0 = runif(I, 0.0, 0.2), + P1 = runif(I, 0.8, 1.0) + ) > example.data <- sim.data(Q = example.Q, N = 500, IQ = IQ, model = "GDINA", distribute = "horder") distribute = horder model = GDINA number of attributes: 5 number of items: 20 num of examinees: 500 average of P0 = 0.085 average of P1 = 0.898 theta_mean = -0.06 , theta_sd = 0.996 a = 1.5 1.5 1.5 1.5 1.5 b = 0 1.5 0.75 -1.5 -0.75 > > ## simulate random mis-specifications > example.MQ <- sim.MQ(example.Q, 0.1) rate of mis-specifications = 0.1 rate of over-specifications = 0.01 rate of under-specifications = 0.09 > > ## using MMLE/EM to fit CDM model first > example.CDM.obj <- CDM(example.data$dat, example.MQ) Iter = 1 Max. abs. change = 0.41736 Deviance = 12444.23 Iter = 2 Max. abs. change = 0.19047 Deviance = 10193.15 Iter = 3 Max. abs. change = 0.11840 Deviance = 10043.16 Iter = 4 Max. abs. change = 0.02526 Deviance = 10006.03 Iter = 5 Max. abs. change = 0.02243 Deviance = 9993.68 Iter = 6 Max. abs. change = 0.02642 Deviance = 9987.01 Iter = 7 Max. abs. change = 0.02822 Deviance = 9982.47 Iter = 8 Max. abs. change = 0.02835 Deviance = 9979.05 Iter = 9 Max. abs. change = 0.02724 Deviance = 9976.29 Iter = 10 Max. abs. change = 0.02521 Deviance = 9973.93 Iter = 11 Max. abs. change = 0.02249 Deviance = 9971.76 Iter = 12 Max. abs. change = 0.01939 Deviance = 9969.60 Iter = 13 Max. abs. change = 0.01626 Deviance = 9967.26 Iter = 14 Max. abs. change = 0.01346 Deviance = 9964.57 Iter = 15 Max. abs. change = 0.01277 Deviance = 9961.55 Iter = 16 Max. abs. change = 0.01427 Deviance = 9958.46 Iter = 17 Max. abs. change = 0.01708 Deviance = 9955.65 Iter = 18 Max. abs. change = 0.01834 Deviance = 9953.28 Iter = 19 Max. abs. change = 0.01722 Deviance = 9951.32 Iter = 20 Max. abs. change = 0.01355 Deviance = 9949.76 Iter = 21 Max. abs. change = 0.00879 Deviance = 9948.66 Iter = 22 Max. abs. change = 0.00508 Deviance = 9947.97 Iter = 23 Max. abs. change = 0.00287 Deviance = 9947.56 Iter = 24 Max. abs. change = 0.00168 Deviance = 9947.31 Iter = 25 Max. abs. change = 0.00136 Deviance = 9947.15 Iter = 26 Max. abs. change = 0.00118 Deviance = 9947.05 Iter = 27 Max. abs. change = 0.00133 Deviance = 9946.99 Iter = 28 Max. abs. change = 0.00068 Deviance = 9946.95 Iter = 29 Max. abs. change = 0.00073 Deviance = 9946.92 Iter = 30 Max. abs. change = 0.00066 Deviance = 9946.90 Iter = 31 Max. abs. change = 0.00059 Deviance = 9946.89 Iter = 32 Max. abs. change = 0.00052 Deviance = 9946.88 Iter = 33 Max. abs. change = 0.00025 Deviance = 9946.88 Iter = 34 Max. abs. change = 0.00056 Deviance = 9946.87 Iter = 35 Max. abs. change = 0.00040 Deviance = 9946.87 Iter = 36 Max. abs. change = 0.00018 Deviance = 9946.86 Iter = 37 Max. abs. change = 0.00041 Deviance = 9946.86 Iter = 38 Max. abs. change = 0.00029 Deviance = 9946.86 Iter = 39 Max. abs. change = 0.00025 Deviance = 9946.86 Iter = 40 Max. abs. change = 0.00022 Deviance = 9946.86 Iter = 41 Max. abs. change = 0.00006 Deviance = 9946.86 > > ## using the fitted CDM.obj to avoid extra parameter estimation. > Q.GDI.obj <- validation(example.data$dat, example.MQ, example.CDM.obj, method = "GDI") GDI method with PAA in test level iteration ... Iter=1/1, 11 items have changed, delta PVAF=2.26839 Warning message: from glmnet C++ code (error code -18); Convergence for 18th lambda value not reached after maxit=100000 iterations; solutions for larger lambdas returned > > > ## also can validate the Q-matrix directly > Q.GDI.obj <- validation(example.data$dat, example.MQ) GDI method with PAA in test level iteration ... Iter = 1 Max. abs. change = 0.41736 Deviance = 12444.23 Iter = 2 Max. abs. change = 0.19047 Deviance = 10193.15 Iter = 3 Max. abs. change = 0.11840 Deviance = 10043.16 Iter = 4 Max. abs. change = 0.02526 Deviance = 10006.03 Iter = 5 Max. abs. change = 0.02243 Deviance = 9993.68 Iter = 6 Max. abs. change = 0.02642 Deviance = 9987.01 Iter = 7 Max. abs. change = 0.02822 Deviance = 9982.47 Iter = 8 Max. abs. change = 0.02835 Deviance = 9979.05 Iter = 9 Max. abs. change = 0.02724 Deviance = 9976.29 Iter = 10 Max. abs. change = 0.02521 Deviance = 9973.93 Iter = 11 Max. abs. change = 0.02249 Deviance = 9971.76 Iter = 12 Max. abs. change = 0.01939 Deviance = 9969.60 Iter = 13 Max. abs. change = 0.01626 Deviance = 9967.26 Iter = 14 Max. abs. change = 0.01346 Deviance = 9964.57 Iter = 15 Max. abs. change = 0.01277 Deviance = 9961.55 Iter = 16 Max. abs. change = 0.01427 Deviance = 9958.46 Iter = 17 Max. abs. change = 0.01708 Deviance = 9955.65 Iter = 18 Max. abs. change = 0.01834 Deviance = 9953.28 Iter = 19 Max. abs. change = 0.01722 Deviance = 9951.32 Iter = 20 Max. abs. change = 0.01355 Deviance = 9949.76 Iter = 21 Max. abs. change = 0.00879 Deviance = 9948.66 Iter = 22 Max. abs. change = 0.00508 Deviance = 9947.97 Iter = 23 Max. abs. change = 0.00287 Deviance = 9947.56 Iter = 24 Max. abs. change = 0.00168 Deviance = 9947.31 Iter = 25 Max. abs. change = 0.00136 Deviance = 9947.15 Iter = 26 Max. abs. change = 0.00118 Deviance = 9947.05 Iter = 27 Max. abs. change = 0.00133 Deviance = 9946.99 Iter = 28 Max. abs. change = 0.00068 Deviance = 9946.95 Iter = 29 Max. abs. change = 0.00073 Deviance = 9946.92 Iter = 30 Max. abs. change = 0.00066 Deviance = 9946.90 Iter = 31 Max. abs. change = 0.00059 Deviance = 9946.89 Iter = 32 Max. abs. change = 0.00052 Deviance = 9946.88 Iter = 33 Max. abs. change = 0.00025 Deviance = 9946.88 Iter = 34 Max. abs. change = 0.00056 Deviance = 9946.87 Iter = 35 Max. abs. change = 0.00040 Deviance = 9946.87 Iter = 36 Max. abs. change = 0.00018 Deviance = 9946.86 Iter = 37 Max. abs. change = 0.00041 Deviance = 9946.86 Iter = 38 Max. abs. change = 0.00029 Deviance = 9946.86 Iter = 39 Max. abs. change = 0.00025 Deviance = 9946.86 Iter = 40 Max. abs. change = 0.00022 Deviance = 9946.86 Iter = 41 Max. abs. change = 0.00006 Deviance = 9946.86 Iter=1/1, 11 items have changed, delta PVAF=2.26839 Warning message: from glmnet C++ code (error code -18); Convergence for 18th lambda value not reached after maxit=100000 iterations; solutions for larger lambdas returned > > ## item level iteration > Q.GDI.obj <- validation(example.data$dat, example.MQ, method = "GDI", iter.level = "item", maxitr = 150) GDI method with PAA in item level iteration ... Iter = 1 Max. abs. change = 0.41736 Deviance = 12444.23 Iter = 2 Max. abs. change = 0.19047 Deviance = 10193.15 Iter = 3 Max. abs. change = 0.11840 Deviance = 10043.16 Iter = 4 Max. abs. change = 0.02526 Deviance = 10006.03 Iter = 5 Max. abs. change = 0.02243 Deviance = 9993.68 Iter = 6 Max. abs. change = 0.02642 Deviance = 9987.01 Iter = 7 Max. abs. change = 0.02822 Deviance = 9982.47 Iter = 8 Max. abs. change = 0.02835 Deviance = 9979.05 Iter = 9 Max. abs. change = 0.02724 Deviance = 9976.29 Iter = 10 Max. abs. change = 0.02521 Deviance = 9973.93 Iter = 11 Max. abs. change = 0.02249 Deviance = 9971.76 Iter = 12 Max. abs. change = 0.01939 Deviance = 9969.60 Iter = 13 Max. abs. change = 0.01626 Deviance = 9967.26 Iter = 14 Max. abs. change = 0.01346 Deviance = 9964.57 Iter = 15 Max. abs. change = 0.01277 Deviance = 9961.55 Iter = 16 Max. abs. change = 0.01427 Deviance = 9958.46 Iter = 17 Max. abs. change = 0.01708 Deviance = 9955.65 Iter = 18 Max. abs. change = 0.01834 Deviance = 9953.28 Iter = 19 Max. abs. change = 0.01722 Deviance = 9951.32 Iter = 20 Max. abs. change = 0.01355 Deviance = 9949.76 Iter = 21 Max. abs. change = 0.00879 Deviance = 9948.66 Iter = 22 Max. abs. change = 0.00508 Deviance = 9947.97 Iter = 23 Max. abs. change = 0.00287 Deviance = 9947.56 Iter = 24 Max. abs. change = 0.00168 Deviance = 9947.31 Iter = 25 Max. abs. change = 0.00136 Deviance = 9947.15 Iter = 26 Max. abs. change = 0.00118 Deviance = 9947.05 Iter = 27 Max. abs. change = 0.00133 Deviance = 9946.99 Iter = 28 Max. abs. change = 0.00068 Deviance = 9946.95 Iter = 29 Max. abs. change = 0.00073 Deviance = 9946.92 Iter = 30 Max. abs. change = 0.00066 Deviance = 9946.90 Iter = 31 Max. abs. change = 0.00059 Deviance = 9946.89 Iter = 32 Max. abs. change = 0.00052 Deviance = 9946.88 Iter = 33 Max. abs. change = 0.00025 Deviance = 9946.88 Iter = 34 Max. abs. change = 0.00056 Deviance = 9946.87 Iter = 35 Max. abs. change = 0.00040 Deviance = 9946.87 Iter = 36 Max. abs. change = 0.00018 Deviance = 9946.86 Iter = 37 Max. abs. change = 0.00041 Deviance = 9946.86 Iter = 38 Max. abs. change = 0.00029 Deviance = 9946.86 Iter = 39 Max. abs. change = 0.00025 Deviance = 9946.86 Iter = 40 Max. abs. change = 0.00022 Deviance = 9946.86 Iter = 41 Max. abs. change = 0.00006 Deviance = 9946.86 Iter=1/150, 1 items have changed, delta PVAF=2.26839 Iter = 1 Max. abs. change = 0.38888 Deviance = 11747.66 Iter = 2 Max. abs. change = 0.20256 Deviance = 9910.73 Iter = 3 Max. abs. change = 0.03574 Deviance = 9793.01 Iter = 4 Max. abs. change = 0.02378 Deviance = 9774.80 Iter = 5 Max. abs. change = 0.02361 Deviance = 9767.51 Iter = 6 Max. abs. change = 0.02787 Deviance = 9762.82 Iter = 7 Max. abs. change = 0.02978 Deviance = 9759.22 Iter = 8 Max. abs. change = 0.02959 Deviance = 9756.26 Iter = 9 Max. abs. change = 0.02789 Deviance = 9753.76 Iter = 10 Max. abs. change = 0.02527 Deviance = 9751.58 Iter = 11 Max. abs. change = 0.02210 Deviance = 9749.59 Iter = 12 Max. abs. change = 0.01874 Deviance = 9747.62 Iter = 13 Max. abs. change = 0.01553 Deviance = 9745.53 Iter = 14 Max. abs. change = 0.01272 Deviance = 9743.22 Iter = 15 Max. abs. change = 0.01160 Deviance = 9740.76 Iter = 16 Max. abs. change = 0.01001 Deviance = 9738.40 Iter = 17 Max. abs. change = 0.01108 Deviance = 9736.36 Iter = 18 Max. abs. change = 0.01289 Deviance = 9734.69 Iter = 19 Max. abs. change = 0.01446 Deviance = 9733.28 Iter = 20 Max. abs. change = 0.01569 Deviance = 9732.01 Iter = 21 Max. abs. change = 0.01584 Deviance = 9730.84 Iter = 22 Max. abs. change = 0.01415 Deviance = 9729.80 Iter = 23 Max. abs. change = 0.01104 Deviance = 9728.96 Iter = 24 Max. abs. change = 0.00807 Deviance = 9728.28 Iter = 25 Max. abs. change = 0.00609 Deviance = 9727.62 Iter = 26 Max. abs. change = 0.00329 Deviance = 9727.06 Iter = 27 Max. abs. change = 0.00392 Deviance = 9726.76 Iter = 28 Max. abs. change = 0.00202 Deviance = 9726.64 Iter = 29 Max. abs. change = 0.00112 Deviance = 9726.59 Iter = 30 Max. abs. change = 0.00103 Deviance = 9726.56 Iter = 31 Max. abs. change = 0.00053 Deviance = 9726.54 Iter = 32 Max. abs. change = 0.00056 Deviance = 9726.53 Iter = 33 Max. abs. change = 0.00051 Deviance = 9726.52 Iter = 34 Max. abs. change = 0.00024 Deviance = 9726.51 Iter = 35 Max. abs. change = 0.00055 Deviance = 9726.51 Iter = 36 Max. abs. change = 0.00037 Deviance = 9726.51 Iter = 37 Max. abs. change = 0.00031 Deviance = 9726.51 Iter = 38 Max. abs. change = 0.00028 Deviance = 9726.50 Iter = 39 Max. abs. change = 0.00025 Deviance = 9726.50 Iter = 40 Max. abs. change = 0.00022 Deviance = 9726.50 Iter = 41 Max. abs. change = 0.00006 Deviance = 9726.50 Iter=2/150, 1 items have changed, delta PVAF=1.49403 Iter = 1 Max. abs. change = 0.39923 Deviance = 11351.24 Iter = 2 Max. abs. change = 0.17800 Deviance = 9766.49 Iter = 3 Max. abs. change = 0.03696 Deviance = 9677.57 Iter = 4 Max. abs. change = 0.02587 Deviance = 9667.08 Iter = 5 Max. abs. change = 0.01881 Deviance = 9664.03 Iter = 6 Max. abs. change = 0.01327 Deviance = 9662.66 Iter = 7 Max. abs. change = 0.00942 Deviance = 9661.83 Iter = 8 Max. abs. change = 0.01064 Deviance = 9661.22 Iter = 9 Max. abs. change = 0.01198 Deviance = 9660.67 Iter = 10 Max. abs. change = 0.01367 Deviance = 9660.11 Iter = 11 Max. abs. change = 0.01585 Deviance = 9659.46 Iter = 12 Max. abs. change = 0.01856 Deviance = 9658.66 Iter = 13 Max. abs. change = 0.02177 Deviance = 9657.60 Iter = 14 Max. abs. change = 0.02518 Deviance = 9656.18 Iter = 15 Max. abs. change = 0.02790 Deviance = 9654.27 Iter = 16 Max. abs. change = 0.02864 Deviance = 9651.81 Iter = 17 Max. abs. change = 0.02668 Deviance = 9648.92 Iter = 18 Max. abs. change = 0.02245 Deviance = 9645.94 Iter = 19 Max. abs. change = 0.01742 Deviance = 9643.31 Iter = 20 Max. abs. change = 0.01310 Deviance = 9641.25 Iter = 21 Max. abs. change = 0.00974 Deviance = 9639.73 Iter = 22 Max. abs. change = 0.00734 Deviance = 9638.61 Iter = 23 Max. abs. change = 0.00563 Deviance = 9637.75 Iter = 24 Max. abs. change = 0.00440 Deviance = 9637.09 Iter = 25 Max. abs. change = 0.00378 Deviance = 9636.58 Iter = 26 Max. abs. change = 0.00377 Deviance = 9636.19 Iter = 27 Max. abs. change = 0.00377 Deviance = 9635.89 Iter = 28 Max. abs. change = 0.00368 Deviance = 9635.66 Iter = 29 Max. abs. change = 0.00367 Deviance = 9635.49 Iter = 30 Max. abs. change = 0.00368 Deviance = 9635.36 Iter = 31 Max. abs. change = 0.00371 Deviance = 9635.25 Iter = 32 Max. abs. change = 0.00380 Deviance = 9635.17 Iter = 33 Max. abs. change = 0.00391 Deviance = 9635.09 Iter = 34 Max. abs. change = 0.00412 Deviance = 9635.02 Iter = 35 Max. abs. change = 0.00515 Deviance = 9634.95 Iter = 36 Max. abs. change = 0.00629 Deviance = 9634.87 Iter = 37 Max. abs. change = 0.00736 Deviance = 9634.79 Iter = 38 Max. abs. change = 0.00821 Deviance = 9634.70 Iter = 39 Max. abs. change = 0.01182 Deviance = 9634.61 Iter = 40 Max. abs. change = 0.00851 Deviance = 9634.52 Iter = 41 Max. abs. change = 0.00767 Deviance = 9634.44 Iter = 42 Max. abs. change = 0.00713 Deviance = 9634.38 Iter = 43 Max. abs. change = 0.00621 Deviance = 9634.33 Iter = 44 Max. abs. change = 0.00529 Deviance = 9634.29 Iter = 45 Max. abs. change = 0.00455 Deviance = 9634.25 Iter = 46 Max. abs. change = 0.00415 Deviance = 9634.18 Iter = 47 Max. abs. change = 0.00425 Deviance = 9634.05 Iter = 48 Max. abs. change = 0.00505 Deviance = 9633.79 Iter = 49 Max. abs. change = 0.00605 Deviance = 9633.41 Iter = 50 Max. abs. change = 0.01111 Deviance = 9633.09 Iter = 51 Max. abs. change = 0.03822 Deviance = 9632.91 Iter = 52 Max. abs. change = 0.05870 Deviance = 9632.74 Iter = 53 Max. abs. change = 0.06523 Deviance = 9632.49 Iter = 54 Max. abs. change = 0.04812 Deviance = 9632.20 Iter = 55 Max. abs. change = 0.02418 Deviance = 9631.98 Iter = 56 Max. abs. change = 0.00997 Deviance = 9631.86 Iter = 57 Max. abs. change = 0.00472 Deviance = 9631.78 Iter = 58 Max. abs. change = 0.00363 Deviance = 9631.72 Iter = 59 Max. abs. change = 0.00277 Deviance = 9631.68 Iter = 60 Max. abs. change = 0.00225 Deviance = 9631.66 Iter = 61 Max. abs. change = 0.00165 Deviance = 9631.64 Iter = 62 Max. abs. change = 0.00114 Deviance = 9631.62 Iter = 63 Max. abs. change = 0.00168 Deviance = 9631.61 Iter = 64 Max. abs. change = 0.00079 Deviance = 9631.60 Iter = 65 Max. abs. change = 0.00014 Deviance = 9631.59 Iter = 66 Max. abs. change = 0.00014 Deviance = 9631.59 Iter = 67 Max. abs. change = 0.00016 Deviance = 9631.58 Iter = 68 Max. abs. change = 0.00097 Deviance = 9631.58 Iter = 69 Max. abs. change = 0.00109 Deviance = 9631.58 Iter = 70 Max. abs. change = 0.00016 Deviance = 9631.58 Iter = 71 Max. abs. change = 0.00004 Deviance = 9631.58 Iter=3/150, 1 items have changed, delta PVAF=0.87358 Iter = 1 Max. abs. change = 0.40162 Deviance = 11257.27 Iter = 2 Max. abs. change = 0.16917 Deviance = 9631.27 Iter = 3 Max. abs. change = 0.09522 Deviance = 9538.07 Iter = 4 Max. abs. change = 0.02659 Deviance = 9526.03 Iter = 5 Max. abs. change = 0.04807 Deviance = 9522.29 Iter = 6 Max. abs. change = 0.03525 Deviance = 9520.49 Iter = 7 Max. abs. change = 0.01847 Deviance = 9519.23 Iter = 8 Max. abs. change = 0.01945 Deviance = 9518.15 Iter = 9 Max. abs. change = 0.01997 Deviance = 9517.05 Iter = 10 Max. abs. change = 0.02380 Deviance = 9515.79 Iter = 11 Max. abs. change = 0.03307 Deviance = 9514.18 Iter = 12 Max. abs. change = 0.03273 Deviance = 9512.03 Iter = 13 Max. abs. change = 0.06347 Deviance = 9509.14 Iter = 14 Max. abs. change = 0.09577 Deviance = 9505.50 Iter = 15 Max. abs. change = 0.12271 Deviance = 9501.49 Iter = 16 Max. abs. change = 0.11197 Deviance = 9497.77 Iter = 17 Max. abs. change = 0.02137 Deviance = 9494.89 Iter = 18 Max. abs. change = 0.01287 Deviance = 9493.00 Iter = 19 Max. abs. change = 0.00730 Deviance = 9491.75 Iter = 20 Max. abs. change = 0.00629 Deviance = 9490.88 Iter = 21 Max. abs. change = 0.00528 Deviance = 9490.26 Iter = 22 Max. abs. change = 0.00550 Deviance = 9489.80 Iter = 23 Max. abs. change = 0.00687 Deviance = 9489.45 Iter = 24 Max. abs. change = 0.00857 Deviance = 9489.18 Iter = 25 Max. abs. change = 0.01033 Deviance = 9488.94 Iter = 26 Max. abs. change = 0.01200 Deviance = 9488.73 Iter = 27 Max. abs. change = 0.01332 Deviance = 9488.51 Iter = 28 Max. abs. change = 0.01423 Deviance = 9488.28 Iter = 29 Max. abs. change = 0.01483 Deviance = 9488.03 Iter = 30 Max. abs. change = 0.01532 Deviance = 9487.73 Iter = 31 Max. abs. change = 0.01587 Deviance = 9487.32 Iter = 32 Max. abs. change = 0.01644 Deviance = 9486.74 Iter = 33 Max. abs. change = 0.01592 Deviance = 9486.01 Iter = 34 Max. abs. change = 0.01332 Deviance = 9485.40 Iter = 35 Max. abs. change = 0.00964 Deviance = 9485.08 Iter = 36 Max. abs. change = 0.00643 Deviance = 9484.93 Iter = 37 Max. abs. change = 0.00422 Deviance = 9484.86 Iter = 38 Max. abs. change = 0.00276 Deviance = 9484.83 Iter = 39 Max. abs. change = 0.00162 Deviance = 9484.81 Iter = 40 Max. abs. change = 0.00220 Deviance = 9484.80 Iter = 41 Max. abs. change = 0.00130 Deviance = 9484.80 Iter = 42 Max. abs. change = 0.00024 Deviance = 9484.79 Iter = 43 Max. abs. change = 0.00008 Deviance = 9484.79 Iter=4/150, 1 items have changed, delta PVAF=0.28340 Iter = 1 Max. abs. change = 0.40468 Deviance = 11116.11 Iter = 2 Max. abs. change = 0.15650 Deviance = 9581.11 Iter = 3 Max. abs. change = 0.09746 Deviance = 9488.22 Iter = 4 Max. abs. change = 0.04649 Deviance = 9475.75 Iter = 5 Max. abs. change = 0.04100 Deviance = 9472.09 Iter = 6 Max. abs. change = 0.04769 Deviance = 9470.67 Iter = 7 Max. abs. change = 0.01893 Deviance = 9469.89 Iter = 8 Max. abs. change = 0.01887 Deviance = 9469.40 Iter = 9 Max. abs. change = 0.02231 Deviance = 9469.06 Iter = 10 Max. abs. change = 0.03365 Deviance = 9468.78 Iter = 11 Max. abs. change = 0.02162 Deviance = 9468.51 Iter = 12 Max. abs. change = 0.01835 Deviance = 9468.28 Iter = 13 Max. abs. change = 0.01258 Deviance = 9468.10 Iter = 14 Max. abs. change = 0.00956 Deviance = 9467.94 Iter = 15 Max. abs. change = 0.00787 Deviance = 9467.78 Iter = 16 Max. abs. change = 0.00681 Deviance = 9467.63 Iter = 17 Max. abs. change = 0.00645 Deviance = 9467.48 Iter = 18 Max. abs. change = 0.00629 Deviance = 9467.33 Iter = 19 Max. abs. change = 0.00605 Deviance = 9467.19 Iter = 20 Max. abs. change = 0.00588 Deviance = 9467.05 Iter = 21 Max. abs. change = 0.00571 Deviance = 9466.92 Iter = 22 Max. abs. change = 0.00557 Deviance = 9466.79 Iter = 23 Max. abs. change = 0.00546 Deviance = 9466.67 Iter = 24 Max. abs. change = 0.00539 Deviance = 9466.55 Iter = 25 Max. abs. change = 0.00536 Deviance = 9466.42 Iter = 26 Max. abs. change = 0.00536 Deviance = 9466.30 Iter = 27 Max. abs. change = 0.00540 Deviance = 9466.17 Iter = 28 Max. abs. change = 0.00547 Deviance = 9466.03 Iter = 29 Max. abs. change = 0.00558 Deviance = 9465.89 Iter = 30 Max. abs. change = 0.00573 Deviance = 9465.74 Iter = 31 Max. abs. change = 0.00592 Deviance = 9465.58 Iter = 32 Max. abs. change = 0.00615 Deviance = 9465.40 Iter = 33 Max. abs. change = 0.00644 Deviance = 9465.21 Iter = 34 Max. abs. change = 0.00678 Deviance = 9465.00 Iter = 35 Max. abs. change = 0.00726 Deviance = 9464.76 Iter = 36 Max. abs. change = 0.00788 Deviance = 9464.49 Iter = 37 Max. abs. change = 0.00854 Deviance = 9464.17 Iter = 38 Max. abs. change = 0.00962 Deviance = 9463.80 Iter = 39 Max. abs. change = 0.01107 Deviance = 9463.38 Iter = 40 Max. abs. change = 0.01238 Deviance = 9462.90 Iter = 41 Max. abs. change = 0.01332 Deviance = 9462.38 Iter = 42 Max. abs. change = 0.01365 Deviance = 9461.85 Iter = 43 Max. abs. change = 0.01318 Deviance = 9461.35 Iter = 44 Max. abs. change = 0.01189 Deviance = 9460.88 Iter = 45 Max. abs. change = 0.00991 Deviance = 9460.46 Iter = 46 Max. abs. change = 0.00775 Deviance = 9460.08 Iter = 47 Max. abs. change = 0.00915 Deviance = 9459.74 Iter = 48 Max. abs. change = 0.01166 Deviance = 9459.42 Iter = 49 Max. abs. change = 0.01386 Deviance = 9459.13 Iter = 50 Max. abs. change = 0.01552 Deviance = 9458.85 Iter = 51 Max. abs. change = 0.01641 Deviance = 9458.59 Iter = 52 Max. abs. change = 0.02223 Deviance = 9458.37 Iter = 53 Max. abs. change = 0.02873 Deviance = 9458.17 Iter = 54 Max. abs. change = 0.03455 Deviance = 9458.01 Iter = 55 Max. abs. change = 0.01392 Deviance = 9457.89 Iter = 56 Max. abs. change = 0.00985 Deviance = 9457.80 Iter = 57 Max. abs. change = 0.00597 Deviance = 9457.74 Iter = 58 Max. abs. change = 0.00346 Deviance = 9457.70 Iter = 59 Max. abs. change = 0.00359 Deviance = 9457.67 Iter = 60 Max. abs. change = 0.00203 Deviance = 9457.65 Iter = 61 Max. abs. change = 0.00286 Deviance = 9457.63 Iter = 62 Max. abs. change = 0.00162 Deviance = 9457.62 Iter = 63 Max. abs. change = 0.00214 Deviance = 9457.61 Iter = 64 Max. abs. change = 0.00264 Deviance = 9457.60 Iter = 65 Max. abs. change = 0.00309 Deviance = 9457.59 Iter = 66 Max. abs. change = 0.00338 Deviance = 9457.58 Iter = 67 Max. abs. change = 0.00374 Deviance = 9457.58 Iter = 68 Max. abs. change = 0.00390 Deviance = 9457.57 Iter = 69 Max. abs. change = 0.00422 Deviance = 9457.56 Iter = 70 Max. abs. change = 0.00427 Deviance = 9457.55 Iter = 71 Max. abs. change = 0.00432 Deviance = 9457.54 Iter = 72 Max. abs. change = 0.00456 Deviance = 9457.54 Iter = 73 Max. abs. change = 0.00475 Deviance = 9457.53 Iter = 74 Max. abs. change = 0.00471 Deviance = 9457.52 Iter = 75 Max. abs. change = 0.00490 Deviance = 9457.51 Iter = 76 Max. abs. change = 0.00483 Deviance = 9457.50 Iter = 77 Max. abs. change = 0.00497 Deviance = 9457.50 Iter = 78 Max. abs. change = 0.00490 Deviance = 9457.49 Iter = 79 Max. abs. change = 0.00503 Deviance = 9457.48 Iter = 80 Max. abs. change = 0.00500 Deviance = 9457.47 Iter = 81 Max. abs. change = 0.00512 Deviance = 9457.46 Iter = 82 Max. abs. change = 0.00507 Deviance = 9457.45 Iter = 83 Max. abs. change = 0.00510 Deviance = 9457.44 Iter = 84 Max. abs. change = 0.00518 Deviance = 9457.41 Iter = 85 Max. abs. change = 0.00537 Deviance = 9457.36 Iter = 86 Max. abs. change = 0.00551 Deviance = 9457.27 Iter = 87 Max. abs. change = 0.00913 Deviance = 9457.12 Iter = 88 Max. abs. change = 0.01391 Deviance = 9456.90 Iter = 89 Max. abs. change = 0.01945 Deviance = 9456.68 Iter = 90 Max. abs. change = 0.02598 Deviance = 9456.54 Iter = 91 Max. abs. change = 0.03396 Deviance = 9456.46 Iter = 92 Max. abs. change = 0.04339 Deviance = 9456.42 Iter = 93 Max. abs. change = 0.05375 Deviance = 9456.39 Iter = 94 Max. abs. change = 0.06420 Deviance = 9456.37 Iter = 95 Max. abs. change = 0.07238 Deviance = 9456.35 Iter = 96 Max. abs. change = 0.07714 Deviance = 9456.33 Iter = 97 Max. abs. change = 0.01321 Deviance = 9456.31 Iter = 98 Max. abs. change = 0.02181 Deviance = 9456.29 Iter = 99 Max. abs. change = 0.01322 Deviance = 9456.27 Iter = 100 Max. abs. change = 0.01311 Deviance = 9456.25 Iter = 101 Max. abs. change = 0.01296 Deviance = 9456.23 Iter = 102 Max. abs. change = 0.01257 Deviance = 9456.21 Iter = 103 Max. abs. change = 0.01225 Deviance = 9456.19 Iter = 104 Max. abs. change = 0.01201 Deviance = 9456.17 Iter = 105 Max. abs. change = 0.01195 Deviance = 9456.16 Iter = 106 Max. abs. change = 0.01203 Deviance = 9456.14 Iter = 107 Max. abs. change = 0.01238 Deviance = 9456.13 Iter = 108 Max. abs. change = 0.01313 Deviance = 9456.11 Iter = 109 Max. abs. change = 0.01447 Deviance = 9456.10 Iter = 110 Max. abs. change = 0.01666 Deviance = 9456.09 Iter = 111 Max. abs. change = 0.02020 Deviance = 9456.07 Iter = 112 Max. abs. change = 0.02587 Deviance = 9456.04 Iter = 113 Max. abs. change = 0.03533 Deviance = 9456.00 Iter = 114 Max. abs. change = 0.04961 Deviance = 9455.93 Iter = 115 Max. abs. change = 0.04474 Deviance = 9455.80 Iter = 116 Max. abs. change = 0.00771 Deviance = 9455.58 Iter = 117 Max. abs. change = 0.00579 Deviance = 9455.43 Iter = 118 Max. abs. change = 0.00402 Deviance = 9455.35 Iter = 119 Max. abs. change = 0.00270 Deviance = 9455.31 Iter = 120 Max. abs. change = 0.00182 Deviance = 9455.30 Iter = 121 Max. abs. change = 0.00104 Deviance = 9455.30 Iter = 122 Max. abs. change = 0.00170 Deviance = 9455.29 Iter = 123 Max. abs. change = 0.00077 Deviance = 9455.29 Iter = 124 Max. abs. change = 0.00086 Deviance = 9455.29 Iter = 125 Max. abs. change = 0.00053 Deviance = 9455.29 Iter = 126 Max. abs. change = 0.00007 Deviance = 9455.29 Warning messages: 1: from glmnet C++ code (error code -18); Convergence for 18th lambda value not reached after maxit=100000 iterations; solutions for larger lambdas returned 2: from glmnet C++ code (error code -19); Convergence for 19th lambda value not reached after maxit=100000 iterations; solutions for larger lambdas returned > > ## search method > Q.GDI.obj <- validation(example.data$dat, example.MQ, method = "GDI", search.method = "ESA") GDI method with ESA in test level iteration ... Iter = 1 Max. abs. change = 0.41736 Deviance = 12444.23 Iter = 2 Max. abs. change = 0.19047 Deviance = 10193.15 Iter = 3 Max. abs. change = 0.11840 Deviance = 10043.16 Iter = 4 Max. abs. change = 0.02526 Deviance = 10006.03 Iter = 5 Max. abs. change = 0.02243 Deviance = 9993.68 Iter = 6 Max. abs. change = 0.02642 Deviance = 9987.01 Iter = 7 Max. abs. change = 0.02822 Deviance = 9982.47 Iter = 8 Max. abs. change = 0.02835 Deviance = 9979.05 Iter = 9 Max. abs. change = 0.02724 Deviance = 9976.29 Iter = 10 Max. abs. change = 0.02521 Deviance = 9973.93 Iter = 11 Max. abs. change = 0.02249 Deviance = 9971.76 Iter = 12 Max. abs. change = 0.01939 Deviance = 9969.60 Iter = 13 Max. abs. change = 0.01626 Deviance = 9967.26 Iter = 14 Max. abs. change = 0.01346 Deviance = 9964.57 Iter = 15 Max. abs. change = 0.01277 Deviance = 9961.55 Iter = 16 Max. abs. change = 0.01427 Deviance = 9958.46 Iter = 17 Max. abs. change = 0.01708 Deviance = 9955.65 Iter = 18 Max. abs. change = 0.01834 Deviance = 9953.28 Iter = 19 Max. abs. change = 0.01722 Deviance = 9951.32 Iter = 20 Max. abs. change = 0.01355 Deviance = 9949.76 Iter = 21 Max. abs. change = 0.00879 Deviance = 9948.66 Iter = 22 Max. abs. change = 0.00508 Deviance = 9947.97 Iter = 23 Max. abs. change = 0.00287 Deviance = 9947.56 Iter = 24 Max. abs. change = 0.00168 Deviance = 9947.31 Iter = 25 Max. abs. change = 0.00136 Deviance = 9947.15 Iter = 26 Max. abs. change = 0.00118 Deviance = 9947.05 Iter = 27 Max. abs. change = 0.00133 Deviance = 9946.99 Iter = 28 Max. abs. change = 0.00068 Deviance = 9946.95 Iter = 29 Max. abs. change = 0.00073 Deviance = 9946.92 Iter = 30 Max. abs. change = 0.00066 Deviance = 9946.90 Iter = 31 Max. abs. change = 0.00059 Deviance = 9946.89 Iter = 32 Max. abs. change = 0.00052 Deviance = 9946.88 Iter = 33 Max. abs. change = 0.00025 Deviance = 9946.88 Iter = 34 Max. abs. change = 0.00056 Deviance = 9946.87 Iter = 35 Max. abs. change = 0.00040 Deviance = 9946.87 Iter = 36 Max. abs. change = 0.00018 Deviance = 9946.86 Iter = 37 Max. abs. change = 0.00041 Deviance = 9946.86 Iter = 38 Max. abs. change = 0.00029 Deviance = 9946.86 Iter = 39 Max. abs. change = 0.00025 Deviance = 9946.86 Iter = 40 Max. abs. change = 0.00022 Deviance = 9946.86 Iter = 41 Max. abs. change = 0.00006 Deviance = 9946.86 Iter=1/1, 11 items have changed, delta PVAF=2.31289 > > ## cut-off point > Q.GDI.obj <- validation(example.data$dat, example.MQ, method = "GDI", eps = 0.90) GDI method with PAA in test level iteration ... Iter = 1 Max. abs. change = 0.41736 Deviance = 12444.23 Iter = 2 Max. abs. change = 0.19047 Deviance = 10193.15 Iter = 3 Max. abs. change = 0.11840 Deviance = 10043.16 Iter = 4 Max. abs. change = 0.02526 Deviance = 10006.03 Iter = 5 Max. abs. change = 0.02243 Deviance = 9993.68 Iter = 6 Max. abs. change = 0.02642 Deviance = 9987.01 Iter = 7 Max. abs. change = 0.02822 Deviance = 9982.47 Iter = 8 Max. abs. change = 0.02835 Deviance = 9979.05 Iter = 9 Max. abs. change = 0.02724 Deviance = 9976.29 Iter = 10 Max. abs. change = 0.02521 Deviance = 9973.93 Iter = 11 Max. abs. change = 0.02249 Deviance = 9971.76 Iter = 12 Max. abs. change = 0.01939 Deviance = 9969.60 Iter = 13 Max. abs. change = 0.01626 Deviance = 9967.26 Iter = 14 Max. abs. change = 0.01346 Deviance = 9964.57 Iter = 15 Max. abs. change = 0.01277 Deviance = 9961.55 Iter = 16 Max. abs. change = 0.01427 Deviance = 9958.46 Iter = 17 Max. abs. change = 0.01708 Deviance = 9955.65 Iter = 18 Max. abs. change = 0.01834 Deviance = 9953.28 Iter = 19 Max. abs. change = 0.01722 Deviance = 9951.32 Iter = 20 Max. abs. change = 0.01355 Deviance = 9949.76 Iter = 21 Max. abs. change = 0.00879 Deviance = 9948.66 Iter = 22 Max. abs. change = 0.00508 Deviance = 9947.97 Iter = 23 Max. abs. change = 0.00287 Deviance = 9947.56 Iter = 24 Max. abs. change = 0.00168 Deviance = 9947.31 Iter = 25 Max. abs. change = 0.00136 Deviance = 9947.15 Iter = 26 Max. abs. change = 0.00118 Deviance = 9947.05 Iter = 27 Max. abs. change = 0.00133 Deviance = 9946.99 Iter = 28 Max. abs. change = 0.00068 Deviance = 9946.95 Iter = 29 Max. abs. change = 0.00073 Deviance = 9946.92 Iter = 30 Max. abs. change = 0.00066 Deviance = 9946.90 Iter = 31 Max. abs. change = 0.00059 Deviance = 9946.89 Iter = 32 Max. abs. change = 0.00052 Deviance = 9946.88 Iter = 33 Max. abs. change = 0.00025 Deviance = 9946.88 Iter = 34 Max. abs. change = 0.00056 Deviance = 9946.87 Iter = 35 Max. abs. change = 0.00040 Deviance = 9946.87 Iter = 36 Max. abs. change = 0.00018 Deviance = 9946.86 Iter = 37 Max. abs. change = 0.00041 Deviance = 9946.86 Iter = 38 Max. abs. change = 0.00029 Deviance = 9946.86 Iter = 39 Max. abs. change = 0.00025 Deviance = 9946.86 Iter = 40 Max. abs. change = 0.00022 Deviance = 9946.86 Iter = 41 Max. abs. change = 0.00006 Deviance = 9946.86 Iter=1/1, 7 items have changed, delta PVAF=2.08404 Warning message: from glmnet C++ code (error code -18); Convergence for 18th lambda value not reached after maxit=100000 iterations; solutions for larger lambdas returned > > ## check QRR > print(getQRR(example.Q, Q.GDI.obj$Q.sug)) [1] 0.93 > > proc.time() user system elapsed 24.04 0.45 24.46