DI Models

Deep Dive

Welcome to the Diversity-Interactions (DI) models deep dive. Here you will find some more complex examples of how to fit Generalised DI models to data with repeated measures, multiple community level responses, multiple sites, and more, including details of the models, code to fit the models, and how to interpret the results.

The DI Models Deep Dive

Topics discussed in this section include how to fit a DI model to longitudinal data, i.e. data where an ecosystem function was measured from the same unit at multiple different time points, (repeated measures DI models) and how to fit a DI model to multivariate data, i.e. data where responses from multiple different ecosystem functions are measured from the same unit at the same time point (multivariate DI models). The complexities of these models lies in how to account for the inherant correlations that exist between multiple measurements from the same subject.



Installing and Loading the DImodelsMulti R Package

Before you look at more complex DI models, we recommend you install and load the DImodelsMulti R package.

This package enables the fitting of DI models to correlated responses (such as multivariate or repeated measures responses). As the DImodelsMulti package is available on CRAN, installing it is simple. We use the install.packages() function, specifying DImodelsMulti (with the quotes), to install the latest version of the package.

install.packages("DImodelsMulti")

Next, in order to have the functions in the package available to our current R session, we load the installed package using the library() function, specifying DImodelsMulti (this time without the quotes).

library(DImodelsMulti)

And now the package is ready for use!

You should only have to install the package once (and again if an updated version is available on CRAN) but will have to load the package each time you start a new R session. It is good coding practice to load all required libraries/packages at the start of any R file that you make.

Repeated Measures DI Model

When data has a single ecosystem function response read from a set of experimental units (e.g. plots) at multiple time points, we say that data contains a repeated measure or is longitudinal. The repeated measures DI model (Frankow-Lindberg et al., 2009); Finn et al., 2013) enables the simultaneous prediction of an ecosystem function response over multiple time points, while accounting for any existing covariance between readings from the same experimental unit.



What will I learn from looking at this example?

In this example, we describe how to implement repeated measures DI models using R (version ≥ 4.1.2) for a four species system using a simulated dataset consisting of recording from some ecosystem function taken at three separate time points. The models described could be used to answer research questions like whether species diversity has an impact on the ecosystem function across time and if yes, is it affected by only the species identities or also their interaction.

Note that in all models fitted to this dataset, it is assumed that \(\theta\) (the non-linear interaction parameter) is equal to 1. Find out more about this non-linear parameter in the Theta section of the Starter Pack training.
Summary of Data
image description image description
training-deepDive-repeated-summary.knit

In this example, we use the ‘simRM’ (simulated repeated measures) dataset, available in the DImodelsMulti R package. It contains 116 plots comprising of four species that vary in proportions (p1 - p4). Some ecosystem function Y was recorded from each plot at three separate time points, resulting in a total of 384 rows of data). This data was recorded in a stacked format (one row per recording).

data("simRM")
head(simRM)
##   plot p1 p2 p3 p4        Y time
## 1    1  1  0  0  0 4.763873    1
## 2    2  1  0  0  0 4.762302    1
## 3    3  0  1  0  0 2.413846    1
## 4    4  0  1  0  0 1.929837    1
## 5    5  0  0  1  0 2.750093    1
## 6    6  0  0  1  0 5.071534    1

The data was simulated assuming that there were existing covariances between the responses and both species identity and interaction effects were present. Information on the true underlying ID, interaction, and treatments effects, along with the structure and true values of the error term, can be found using the ?simRM command.

Model Fitting using DImodels Package
image description image description
Here we fit a range of DI models to the four species repeated measures dataset.

training-deepDive-repeated-fitting_id.knit

For this model structure, just like for the univariate version seen in the Starter Pack, we assume that species do not interact with one another. This implies that species interactions don’t affect the ecosystem function responses leaving only the species proportions as fixed effects, along with any experimental structures. An example of this model is as follows:


\[\large y_{mt}=\sum_{i=1}^{S=4} \beta_{it} p_{im} + \epsilon_{mt}\]


Where \(y_{mt}\) represents the recorded value, \(y\), of the ecosystem function at the time point \(t\) (where \(t\) goes from \(1\) to \(T=3\)) from the \(m^{th}\) experimental/observational study unit (where \(m\) goes from \(1\) to \(M=384\)). The coefficient \(\beta_{it}\) scaled by the initial proportion \(p\) of species \(i\) forms the ID effect of said species for the ecosystem function response at time \(t\). The error of this model, \(\epsilon\) is assumed to follow a multivariate Normal distribution with mean 0 and variance \(\Sigma^{*}\), where \(\Sigma^{*}\) is an \(MT \times MT\) block-diagonal matrix.


\[\Sigma^{*} = \begin{bmatrix} \Sigma_1 & & 0\\ & \ddots & \\ 0 & & \Sigma_M \end{bmatrix}\]


Each matrix along the main diagonal, \(\Sigma_{m}\) represents the variance-covariance matrix of the time points. There are a few different forms that this may take (these are called auto-correlation structures). The first of which is the unstructured or general structure (UN), where each element is allowed to differ from one another.

\[\Sigma_m = \begin{bmatrix} \sigma_1^2 & \sigma_{1,2} & ... & \sigma_{1,T}\\ \sigma_{1,2} & \sigma_{2}^2 & ... & \sigma_{2,T}\\ \vdots & \vdots & \ddots & \vdots \\ \sigma_{1,T} & \sigma_{2, T} & ... & \sigma_T^2 \end{bmatrix}\]
IDModel_UN <- DImulti(y = "Y", time = c("time", "UN"), unit_IDs = "plot", 
                   prop = 2:5, data = simRM, DImodel = "ID", method = "REML")

Another of which is the compound symmetry (CS) structure, which assumes that all variances are equal and all covariances are equal in the matrix. So for our three time points, it would take the form below.

\[\Sigma_m = \sigma^2 \begin{bmatrix} 1 & \rho & \rho\\ \rho & 1 & \rho\\ \rho & \rho & 1 \end{bmatrix} \]
IDModel_CS <- DImulti(y = "Y", time = c("time", "CS"), unit_IDs = "plot", 
                   prop = 2:5, data = simRM, DImodel = "ID", method = "REML")

The final structure available for use in the R package is an autoregressive model of order one (AR(1)), which assumes that all variances are equal in the matrix and all covariances vary by a degree () for ech measure of distance between readings, i.e. time point 1 and 2 will share a covariance with points 2 and 3, but time points 1 and 3 will have the same covariance times \(\rho\). Therefore, for our three time points, it would take the form below.

\[\Sigma_m = \sigma^2 \begin{bmatrix} 1 & \rho & \rho^2\\ \rho & 1 & \rho\\ \rho^2 & \rho & 1 \end{bmatrix} \]
IDModel_AR1 <- DImulti(y = "Y", time = c("time", "AR1"), unit_IDs = "plot", 
                   prop = 2:5, data = simRM, DImodel = "ID", method = "REML")


As no fixed effects vary between these models, we can fit them using the REML estimation method, however, when comparing this model with another which has different fixed effects, we would use ML, as below.

IDModel <- DImulti(y = "Y", time = c("time", "UN"), unit_IDs = "plot", 
                   prop = 2:5, data = simRM, DImodel = "ID", method = "ML")


And just like with the univariate models, we can use summary() to look at our model output.

summary(IDModel)
## Generalized least squares fit by maximum likelihood
##   Model: Y ~ 0 + time:((p1_ID + p2_ID + p3_ID + p4_ID)) 
##   Data: data 
##        AIC      BIC    logLik
##   1296.106 1365.445 -630.0529
## 
## Correlation Structure: General
##  Formula: ~0 | plot 
##  Parameter estimate(s):
##  Correlation: 
##   1     2    
## 2 0.143      
## 3 0.273 0.376
## Variance function:
##  Structure: Different standard deviations per stratum
##  Formula: ~0 | time 
##  Parameter estimates:
##         1         2         3 
## 1.0000000 1.2525790 0.8717619 
## 
## Coefficients:
##                 Value Std.Error   t-value p-value
## time1:p1_ID  6.150533 0.4589786 13.400479       0
## time2:p1_ID  5.320499 0.5749069  9.254540       0
## time3:p1_ID  3.442754 0.4001200  8.604302       0
## time1:p2_ID  4.793913 0.4800486  9.986307       0
## time2:p2_ID  6.381084 0.6012988 10.612168       0
## time3:p2_ID  5.136560 0.4184881 12.274089       0
## time1:p3_ID  4.791368 0.4102820 11.678232       0
## time2:p3_ID  7.441564 0.5139106 14.480271       0
## time3:p3_ID  7.227109 0.3576682 20.206183       0
## time1:p4_ID  7.098678 0.4374651 16.226842       0
## time2:p4_ID 10.484815 0.5479596 19.134283       0
## time3:p4_ID  9.099688 0.3813654 23.860808       0
## 
## Theta values: 1
## 
## 
##  Correlation: 
##             t1:1_I t2:1_I t3:1_I t1:2_I t2:2_I t3:2_I t1:3_I t2:3_I t3:3_I
## time2:p1_ID  0.143                                                        
## time3:p1_ID  0.273  0.376                                                 
## time1:p2_ID -0.133 -0.019 -0.036                                          
## time2:p2_ID -0.019 -0.133 -0.050  0.143                                   
## time3:p2_ID -0.036 -0.050 -0.133  0.273  0.376                            
## time1:p3_ID -0.188 -0.027 -0.051 -0.194 -0.028 -0.053                     
## time2:p3_ID -0.027 -0.188 -0.071 -0.028 -0.194 -0.073  0.143              
## time3:p3_ID -0.051 -0.071 -0.188 -0.053 -0.073 -0.194  0.273  0.376       
## time1:p4_ID -0.301 -0.043 -0.082 -0.283 -0.040 -0.077 -0.090 -0.013 -0.024
## time2:p4_ID -0.043 -0.301 -0.113 -0.040 -0.283 -0.106 -0.013 -0.090 -0.034
## time3:p4_ID -0.082 -0.113 -0.301 -0.077 -0.106 -0.283 -0.024 -0.034 -0.090
##             t1:4_I t2:4_I
## time2:p1_ID              
## time3:p1_ID              
## time1:p2_ID              
## time2:p2_ID              
## time3:p2_ID              
## time1:p3_ID              
## time2:p3_ID              
## time3:p3_ID              
## time1:p4_ID              
## time2:p4_ID  0.143       
## time3:p4_ID  0.273  0.376
## 
## Standardized residuals:
##         Min          Q1         Med          Q3         Max 
## -3.20807103 -0.63836145  0.04442358  0.65743274  2.35308203 
## 
## Residual standard error: 1.493056 
## Degrees of freedom: 348 total; 336 residual
training-deepDive-repeated-fitting_av.knit

For this model structure, just like for the univariate version seen in the Starter Pack, we assume that species interact with one another, the strength of which is determined by their average presence, i.e. via a single interaction term. An example of this model is as follows:


\[\large y_{mt}=\sum_{i=1}^{S=4} \beta_{it} p_{im} + \delta_{AVt} \sum_{i,j=1 \\ i<j}^{S=4} p_{im}p_{jm} + \epsilon_{mt}\]


Where \(y_{mt}\) represents the recorded value, \(y\), of the ecosystem function response at time point \(t\) (where \(t\) goes from \(1\) to \(T=3\)) from the \(m^{th}\) experimental/observational study unit (where \(m\) goes from \(1\) to \(M=384\)). The coefficient \(\beta_{it}\) scaled by the initial proportion \(p\) of species \(i\) forms the ID effect of said species for the ecosystem function response at time \(t\). The interaction term \(\delta_{AV}\) represents the interactions between any pair of species. The error of this model, \(\epsilon\) is assumed to follow a multivariate Normal distribution with mean 0 and variance \(\Sigma^{*}\), where \(\Sigma^{*}\) is an \(MT \times MT\) block-diagonal matrix.


\[\Sigma^{*} = \begin{bmatrix} \Sigma_1 & & 0\\ & \ddots & \\ 0 & & \Sigma_M \end{bmatrix}\]


Each matrix along the main diagonal, \(\Sigma_{m}\) represents the variance-covariance matrix of the time points. There are a few different forms that this may take (these are called auto-correlation structures). The unstructured or general structure (UN), where each element is allowed to differ from one another, can be seen below.

\[\Sigma_m = \begin{bmatrix} \sigma_1^2 & \sigma_{1,2} & ... & \sigma_{1,T}\\ \sigma_{1,2} & \sigma_{2}^2 & ... & \sigma_{2,T}\\ \vdots & \vdots & \ddots & \vdots \\ \sigma_{1,T} & \sigma_{2, T} & ... & \sigma_T^2 \end{bmatrix}\]
AVModel <- DImulti(y = "Y", time = c("time", "UN"), unit_IDs = "plot", 
                   prop = 2:5, data = simRM, DImodel = "AV", method = "ML")


And just like with the univariate models, we can use summary() to look at our model output.

summary(AVModel)
## Generalized least squares fit by maximum likelihood
##   Model: Y ~ 0 + time:((p1_ID + p2_ID + p3_ID + p4_ID + AV)) 
##   Data: data 
##        AIC      BIC    logLik
##   1224.423 1305.319 -591.2113
## 
## Correlation Structure: General
##  Formula: ~0 | plot 
##  Parameter estimate(s):
##  Correlation: 
##   1      2     
## 2 -0.009       
## 3 -0.014  0.225
## Variance function:
##  Structure: Different standard deviations per stratum
##  Formula: ~0 | time 
##  Parameter estimates:
##         1         2         3 
## 1.0000000 1.3197053 0.7567874 
## 
## Coefficients:
##                Value Std.Error   t-value p-value
## time1:p1_ID 4.363343 0.5336384  8.176592  0.0000
## time2:p1_ID 3.644483 0.7042454  5.175019  0.0000
## time3:p1_ID 1.249646 0.4038508  3.094325  0.0021
## time1:p2_ID 2.810034 0.5721811  4.911092  0.0000
## time2:p2_ID 4.520614 0.7551105  5.986692  0.0000
## time3:p2_ID 2.702089 0.4330195  6.240110  0.0000
## time1:p3_ID 3.439627 0.4488783  7.662716  0.0000
## time2:p3_ID 6.173910 0.5923871 10.422086  0.0000
## time3:p3_ID 5.568352 0.3397055 16.391704  0.0000
## time1:p4_ID 5.268783 0.5241756 10.051561  0.0000
## time2:p4_ID 8.768751 0.6917573 12.676051  0.0000
## time3:p4_ID 6.854175 0.3966895 17.278439  0.0000
## time1:AV    7.041350 1.3348658  5.274950  0.0000
## time2:AV    6.603336 1.7616295  3.748425  0.0002
## time3:AV    8.640629 1.0102097  8.553302  0.0000
## 
## Theta values: 1
## 
## 
##  Correlation: 
##             t1:1_I t2:1_I t3:1_I t1:2_I t2:2_I t3:2_I t1:3_I t2:3_I t3:3_I
## time2:p1_ID -0.009                                                        
## time3:p1_ID -0.014  0.225                                                 
## time1:p2_ID  0.340 -0.003 -0.005                                          
## time2:p2_ID -0.003  0.340  0.076 -0.009                                   
## time3:p2_ID -0.005  0.076  0.340 -0.014  0.225                            
## time1:p3_ID  0.243 -0.002 -0.003  0.255 -0.002 -0.003                     
## time2:p3_ID -0.002  0.243  0.055 -0.002  0.255  0.057 -0.009              
## time3:p3_ID -0.003  0.055  0.243 -0.003  0.057  0.255 -0.014  0.225       
## time1:p4_ID  0.246 -0.002 -0.003  0.275 -0.002 -0.004  0.323 -0.003 -0.004
## time2:p4_ID -0.002  0.246  0.055 -0.002  0.275  0.062 -0.003  0.323  0.073
## time3:p4_ID -0.003  0.055  0.246 -0.004  0.062  0.275 -0.004  0.073  0.323
## time1:AV    -0.635  0.005  0.009 -0.657  0.006  0.009 -0.571  0.005  0.008
## time2:AV     0.005 -0.635 -0.143  0.006 -0.657 -0.148  0.005 -0.571 -0.128
## time3:AV     0.009 -0.143 -0.635  0.009 -0.148 -0.657  0.008 -0.128 -0.571
##             t1:4_I t2:4_I t3:4_I tm1:AV tm2:AV
## time2:p1_ID                                   
## time3:p1_ID                                   
## time1:p2_ID                                   
## time2:p2_ID                                   
## time3:p2_ID                                   
## time1:p3_ID                                   
## time2:p3_ID                                   
## time3:p3_ID                                   
## time1:p4_ID                                   
## time2:p4_ID -0.009                            
## time3:p4_ID -0.014  0.225                     
## time1:AV    -0.662  0.006  0.009              
## time2:AV     0.006 -0.662 -0.149 -0.009       
## time3:AV     0.009 -0.149 -0.662 -0.014  0.225
## 
## Standardized residuals:
##           Min            Q1           Med            Q3           Max 
## -3.3303139880 -0.6619940410 -0.0002891727  0.6412829214  2.3331061226 
## 
## Residual standard error: 1.335164 
## Degrees of freedom: 348 total; 333 residual
training-deepDive-repeated-fitting_fg.knit

For this model structure, just like for the univariate version seen in the Starter Pack, we assume that species within the same functional group interact with one another in one way and with species from a different functional group in another way. As this data was simulated, any groupings that we apply are arbitrary. For the sake of this example, we assume that there are two functional groups (\(G=2\)). An example of this model is as follows:


\[\large y_{mt}=\sum_{i=1}^{S=4} \beta_{it} p_{im} + \sum_{q=1}^{G=2} \omega_{qqt} \sum_{\substack{i,j \in FG_q \\ i \lt j}} p_{im} p_{jm} + \sum_{\substack{q,r = 1 \\ q \lt r}}^{G=2} \omega_{qrt} \sum_{i \in FG_q} \sum_{j \in FG_r} p_{im} p_{jm} + \epsilon_{mt}\]


Where \(y_{mt}\) represents the recorded value, \(y\), of the ecosystem function response at time point \(t\) (where \(t\) goes from \(1\) to \(T=3\)) from the \(m^{th}\) experimental/observational study unit (where \(m\) goes from \(1\) to \(M=384\)). The coefficient \(\beta_{it}\) scaled by the initial proportion \(p\) of species \(i\) forms the ID effect of said species for the ecosystem function response at time \(t\). The interactions are split into two sums: the within group interactions \(\omega_{qq}\) and the between group interactions \(\omega_{qr}\), where \(q\) and \(r\) index the set of functional groups, which is of size \(G\). The error of this model, \(\epsilon\) is assumed to follow a multivariate Normal distribution with mean 0 and variance \(\Sigma^{*}\), where \(\Sigma^{*}\) is an \(MT \times MT\) block-diagonal matrix.


\[\Sigma^{*} = \begin{bmatrix} \Sigma_1 & & 0\\ & \ddots & \\ 0 & & \Sigma_M \end{bmatrix}\]


Each matrix along the main diagonal, \(\Sigma_{m}\) represents the variance-covariance matrix of the time points. There are a few different forms that this may take (these are called auto-correlation structures). The unstructured or general structure (UN), where each element is allowed to differ from one another, can be seen below.

\[\Sigma_m = \begin{bmatrix} \sigma_1^2 & \sigma_{1,2} & ... & \sigma_{1,T}\\ \sigma_{1,2} & \sigma_{2}^2 & ... & \sigma_{2,T}\\ \vdots & \vdots & \ddots & \vdots \\ \sigma_{1,T} & \sigma_{2, T} & ... & \sigma_T^2 \end{bmatrix}\]
FGModel <- DImulti(y = "Y", time = c("time", "UN"), unit_IDs = "plot", 
                   prop = 2:5, FG = c("Group1", "Group1", "Group2", "Group2"), 
                   data = simRM, DImodel = "FG", method = "ML")


And just like with the univariate models, we can use summary() to look at our model output.

summary(FGModel)
## Generalized least squares fit by maximum likelihood
##   Model: Y ~ 0 + time:((p1_ID + p2_ID + p3_ID + p4_ID + FG.bfg_Group1_Group2 +      FG.wfg_Group1 + FG.wfg_Group2)) 
##   Data: data 
##       AIC      BIC  logLik
##   1225.94 1329.949 -585.97
## 
## Correlation Structure: General
##  Formula: ~0 | plot 
##  Parameter estimate(s):
##  Correlation: 
##   1      2     
## 2  0.009       
## 3 -0.001  0.228
## Variance function:
##  Structure: Different standard deviations per stratum
##  Formula: ~0 | time 
##  Parameter estimates:
##         1         2         3 
## 1.0000000 1.3641105 0.7798774 
## 
## Coefficients:
##                                Value Std.Error   t-value p-value
## time1:p1_ID                 4.072742  0.622664  6.540834  0.0000
## time2:p1_ID                 3.920803  0.849383  4.616062  0.0000
## time3:p1_ID                 1.025449  0.485602  2.111707  0.0355
## time1:p2_ID                 2.742884  0.642079  4.271880  0.0000
## time2:p2_ID                 4.719913  0.875867  5.388849  0.0000
## time3:p2_ID                 2.455180  0.500743  4.903075  0.0000
## time1:p3_ID                 3.546004  0.471572  7.519541  0.0000
## time2:p3_ID                 6.043025  0.643276  9.394139  0.0000
## time3:p3_ID                 5.693253  0.367768 15.480546  0.0000
## time1:p4_ID                 5.039551  0.561064  8.982128  0.0000
## time2:p4_ID                 8.720371  0.765354 11.393911  0.0000
## time3:p4_ID                 7.060974  0.437561 16.137107  0.0000
## time1:FG.bfg_Group1_Group2  8.935869  1.467620  6.088681  0.0000
## time2:FG.bfg_Group1_Group2  5.912043  2.001996  2.953075  0.0034
## time3:FG.bfg_Group1_Group2  8.503200  1.144564  7.429207  0.0000
## time1:FG.wfg_Group1         4.760729  2.620998  1.816380  0.0702
## time2:FG.wfg_Group1         6.148174  3.575331  1.719610  0.0864
## time3:FG.wfg_Group1        10.660376  2.044057  5.215302  0.0000
## time1:FG.wfg_Group2         3.371729  2.317661  1.454798  0.1467
## time2:FG.wfg_Group2         8.576460  3.161545  2.712743  0.0070
## time3:FG.wfg_Group2         7.993435  1.807491  4.422392  0.0000
## 
## Theta values: 1
## 
## 
##  Correlation: 
##                            t1:1_I t2:1_I t3:1_I t1:2_I t2:2_I t3:2_I t1:3_I
## time2:p1_ID                 0.009                                          
## time3:p1_ID                -0.001  0.228                                   
## time1:p2_ID                 0.513  0.004 -0.001                            
## time2:p2_ID                 0.004  0.513  0.117  0.009                     
## time3:p2_ID                -0.001  0.117  0.513 -0.001  0.228              
## time1:p3_ID                -0.018  0.000  0.000  0.020  0.000  0.000       
## time2:p3_ID                 0.000 -0.018 -0.004  0.000  0.020  0.005  0.009
## time3:p3_ID                 0.000 -0.004 -0.018  0.000  0.005  0.020 -0.001
## time1:p4_ID                 0.005  0.000  0.000  0.029  0.000  0.000  0.404
## time2:p4_ID                 0.000  0.005  0.001  0.000  0.029  0.007  0.003
## time3:p4_ID                 0.000  0.001  0.005  0.000  0.007  0.029 -0.001
## time1:FG.bfg_Group1_Group2 -0.596 -0.005  0.001 -0.571 -0.005  0.001 -0.396
## time2:FG.bfg_Group1_Group2 -0.005 -0.596 -0.136 -0.005 -0.571 -0.130 -0.003
## time3:FG.bfg_Group1_Group2  0.001 -0.136 -0.596  0.001 -0.130 -0.571  0.001
## time1:FG.wfg_Group1        -0.640 -0.006  0.001 -0.675 -0.006  0.001  0.012
## time2:FG.wfg_Group1        -0.006 -0.640 -0.146 -0.006 -0.675 -0.154  0.000
## time3:FG.wfg_Group1         0.001 -0.146 -0.640  0.001 -0.154 -0.675  0.000
## time1:FG.wfg_Group2         0.117  0.001  0.000  0.005  0.000  0.000 -0.566
## time2:FG.wfg_Group2         0.001  0.117  0.027  0.000  0.005  0.001 -0.005
## time3:FG.wfg_Group2         0.000  0.027  0.117  0.000  0.001  0.005  0.001
##                            t2:3_I t3:3_I t1:4_I t2:4_I t3:4_I t1:FG._G1_
## time2:p1_ID                                                             
## time3:p1_ID                                                             
## time1:p2_ID                                                             
## time2:p2_ID                                                             
## time3:p2_ID                                                             
## time1:p3_ID                                                             
## time2:p3_ID                                                             
## time3:p3_ID                 0.228                                       
## time1:p4_ID                 0.003 -0.001                                
## time2:p4_ID                 0.404  0.092  0.009                         
## time3:p4_ID                 0.092  0.404 -0.001  0.228                  
## time1:FG.bfg_Group1_Group2 -0.003  0.001 -0.559 -0.005  0.001           
## time2:FG.bfg_Group1_Group2 -0.396 -0.090 -0.005 -0.559 -0.127  0.009    
## time3:FG.bfg_Group1_Group2 -0.090 -0.396  0.001 -0.127 -0.559 -0.001    
## time1:FG.wfg_Group1         0.000  0.000  0.062  0.001  0.000  0.382    
## time2:FG.wfg_Group1         0.012  0.003  0.001  0.062  0.014  0.003    
## time3:FG.wfg_Group1         0.003  0.012  0.000  0.014  0.062 -0.001    
## time1:FG.wfg_Group2        -0.005  0.001 -0.497 -0.004  0.001  0.183    
## time2:FG.wfg_Group2        -0.566 -0.129 -0.004 -0.497 -0.113  0.002    
## time3:FG.wfg_Group2        -0.129 -0.566  0.001 -0.113 -0.497  0.000    
##                            t2:FG._G1_ t3:FG._G1_ tm1:FG._G1 tm2:FG._G1
## time2:p1_ID                                                           
## time3:p1_ID                                                           
## time1:p2_ID                                                           
## time2:p2_ID                                                           
## time3:p2_ID                                                           
## time1:p3_ID                                                           
## time2:p3_ID                                                           
## time3:p3_ID                                                           
## time1:p4_ID                                                           
## time2:p4_ID                                                           
## time3:p4_ID                                                           
## time1:FG.bfg_Group1_Group2                                            
## time2:FG.bfg_Group1_Group2                                            
## time3:FG.bfg_Group1_Group2  0.228                                     
## time1:FG.wfg_Group1         0.003     -0.001                          
## time2:FG.wfg_Group1         0.382      0.087      0.009               
## time3:FG.wfg_Group1         0.087      0.382     -0.001      0.228    
## time1:FG.wfg_Group2         0.002      0.000     -0.050      0.000    
## time2:FG.wfg_Group2         0.183      0.042      0.000     -0.050    
## time3:FG.wfg_Group2         0.042      0.183      0.000     -0.011    
##                            tm3:FG._G1 t1:FG._G2 t2:FG._G2
## time2:p1_ID                                              
## time3:p1_ID                                              
## time1:p2_ID                                              
## time2:p2_ID                                              
## time3:p2_ID                                              
## time1:p3_ID                                              
## time2:p3_ID                                              
## time3:p3_ID                                              
## time1:p4_ID                                              
## time2:p4_ID                                              
## time3:p4_ID                                              
## time1:FG.bfg_Group1_Group2                               
## time2:FG.bfg_Group1_Group2                               
## time3:FG.bfg_Group1_Group2                               
## time1:FG.wfg_Group1                                      
## time2:FG.wfg_Group1                                      
## time3:FG.wfg_Group1                                      
## time1:FG.wfg_Group2         0.000                        
## time2:FG.wfg_Group2        -0.011      0.009             
## time3:FG.wfg_Group2        -0.050     -0.001     0.228   
## 
## Standardized residuals:
##          Min           Q1          Med           Q3          Max 
## -2.814715291 -0.640564263  0.003004396  0.611225631  2.472448371 
## 
## Residual standard error: 1.28807 
## Degrees of freedom: 348 total; 327 residual
training-deepDive-repeated-fitting_add.knit

For this model structure, just like for the univariate version seen in the Starter Pack, we assume that each species has a unique interaction which applies additively regardless of what other species are present. An example of this model is as follows:


\[\large y_{mt}=\sum_{i=1}^{S=4} \beta_{it} p_{im} + \sum_{\substack{i,j=1 \\ i < j}}^{S=4} (\lambda_{it} + \lambda_{jt}) (p_{im} p_{jm}) + \epsilon_{mt}\]


Where \(y_{mt}\) represents the recorded value, \(y\), of the ecosystem function at a time point \(t\) (where \(t\) goes from \(1\) to \(T=3\)) from the \(m^{th}\) experimental/observational study unit (where \(m\) goes from \(1\) to \(M=384\)). The coefficient \(\beta_{it}\) scaled by the initial proportion \(p\) of species \(i\) forms the ID effect of said species for the ecosystem function response at time \(t\). For a species pool of size \(S\), there are \(S\) unique interaction strengths, \(\lambda\), which are added together and scaled by the pairwise product of the species. The error of this model, \(\epsilon\) is assumed to follow a multivariate Normal distribution with mean 0 and variance \(\Sigma^{*}\), where \(\Sigma^{*}\) is an \(MT \times MT\) block-diagonal matrix.


\[\Sigma^{*} = \begin{bmatrix} \Sigma_1 & & 0\\ & \ddots & \\ 0 & & \Sigma_M \end{bmatrix}\]


Each matrix along the main diagonal, \(\Sigma_{m}\) represents the variance-covariance matrix of the time points. There are a few different forms that this may take (these are called auto-correlation structures). The unstructured or general structure (UN), where each element is allowed to differ from one another, can be seen below.

\[\Sigma_m = \begin{bmatrix} \sigma_1^2 & \sigma_{1,2} & ... & \sigma_{1,T}\\ \sigma_{1,2} & \sigma_{2}^2 & ... & \sigma_{2,T}\\ \vdots & \vdots & \ddots & \vdots \\ \sigma_{1,T} & \sigma_{2, T} & ... & \sigma_T^2 \end{bmatrix}\]
ADDModel <- DImulti(y = "Y", time = c("time", "UN"), unit_IDs = "plot", 
                   prop = 2:5, data = simRM, DImodel = "ADD", method = "ML")


And just like with the univariate models, we can use summary() to look at our model output.

summary(ADDModel)
## Generalized least squares fit by maximum likelihood
##   Model: Y ~ 0 + time:((p1_ID + p2_ID + p3_ID + p4_ID + p1_add + p2_add +      p3_add + p4_add)) 
##   Data: data 
##        AIC      BIC    logLik
##   1202.933 1318.499 -571.4663
## 
## Correlation Structure: General
##  Formula: ~0 | plot 
##  Parameter estimate(s):
##  Correlation: 
##   1      2     
## 2 -0.039       
## 3 -0.059  0.092
## Variance function:
##  Structure: Different standard deviations per stratum
##  Formula: ~0 | time 
##  Parameter estimates:
##         1         2         3 
## 1.0000000 1.2506475 0.6804683 
## 
## Coefficients:
##                  Value Std.Error   t-value p-value
## time1:p1_ID   4.881024 0.8136197  5.999147  0.0000
## time2:p1_ID   4.291220 1.0175515  4.217202  0.0000
## time3:p1_ID   1.229958 0.5536424  2.221575  0.0270
## time1:p2_ID   2.118401 0.8116894  2.609867  0.0095
## time2:p2_ID   4.396505 1.0151373  4.330946  0.0000
## time3:p2_ID   2.287663 0.5523289  4.141849  0.0000
## time1:p3_ID   3.657282 0.5291305  6.911871  0.0000
## time2:p3_ID   7.043487 0.6617558 10.643636  0.0000
## time3:p3_ID   6.441577 0.3600565 17.890460  0.0000
## time1:p4_ID   4.987017 0.8150532  6.118640  0.0000
## time2:p4_ID   5.931661 1.0193443  5.819095  0.0000
## time3:p4_ID   4.973201 0.5546178  8.966897  0.0000
## time1:p1_add  2.250823 1.8293405  1.230401  0.2194
## time2:p1_add  2.009421 2.2878602  0.878297  0.3804
## time3:p1_add  4.834283 1.2448082  3.883557  0.0001
## time1:p2_add  5.527422 1.8607132  2.970593  0.0032
## time2:p2_add  3.236363 2.3270964  1.390730  0.1653
## time3:p2_add  5.303502 1.2661563  4.188663  0.0000
## time1:p3_add  2.359505 1.4400568  1.638481  0.1023
## time2:p3_add -0.857144 1.8010035 -0.475926  0.6344
## time3:p3_add  0.242042 0.9799129  0.247003  0.8051
## time1:p4_add  4.264986 1.8864935  2.260801  0.0244
## time2:p4_add 11.114090 2.3593384  4.710681  0.0000
## time3:p4_add  9.226171 1.2836990  7.187176  0.0000
## 
## Theta values: 1
## 
## 
##  Correlation: 
##              t1:1_I t2:1_I t3:1_I t1:2_I t2:2_I t3:2_I t1:3_I t2:3_I t3:3_I
## time2:p1_ID  -0.039                                                        
## time3:p1_ID  -0.059  0.092                                                 
## time1:p2_ID  -0.027  0.001  0.002                                          
## time2:p2_ID   0.001 -0.027 -0.002 -0.039                                   
## time3:p2_ID   0.002 -0.002 -0.027 -0.059  0.092                            
## time1:p3_ID   0.005  0.000  0.000  0.006  0.000  0.000                     
## time2:p3_ID   0.000  0.005  0.000  0.000  0.006  0.001 -0.039              
## time3:p3_ID   0.000  0.000  0.005  0.000  0.001  0.006 -0.059  0.092       
## time1:p4_ID   0.016 -0.001 -0.001 -0.014  0.001  0.001 -0.014  0.001  0.001
## time2:p4_ID  -0.001  0.016  0.001  0.001 -0.014 -0.001  0.001 -0.014 -0.001
## time3:p4_ID  -0.001  0.001  0.016  0.001 -0.001 -0.014  0.001 -0.001 -0.014
## time1:p1_add -0.851  0.033  0.050  0.025 -0.001 -0.001  0.022 -0.001 -0.001
## time2:p1_add  0.033 -0.851 -0.078 -0.001  0.025  0.002 -0.001  0.022  0.002
## time3:p1_add  0.050 -0.078 -0.851 -0.001  0.002  0.025 -0.001  0.002  0.022
## time1:p2_add  0.071 -0.003 -0.004 -0.826  0.032  0.049  0.011  0.000 -0.001
## time2:p2_add -0.003  0.071  0.007  0.032 -0.826 -0.076  0.000  0.011  0.001
## time3:p2_add -0.004  0.007  0.071  0.049 -0.076 -0.826 -0.001  0.001  0.011
## time1:p3_add -0.038  0.001  0.002  0.078 -0.003 -0.005 -0.688  0.027  0.041
## time2:p3_add  0.001 -0.038 -0.003 -0.003  0.078  0.007  0.027 -0.688 -0.063
## time3:p3_add  0.002 -0.003 -0.038 -0.005  0.007  0.078  0.041 -0.063 -0.688
## time1:p4_add  0.024 -0.001 -0.001  0.031 -0.001 -0.002  0.008  0.000  0.000
## time2:p4_add -0.001  0.024  0.002 -0.001  0.031  0.003  0.000  0.008  0.001
## time3:p4_add -0.001  0.002  0.024 -0.002  0.003  0.031  0.000  0.001  0.008
##              t1:4_I t2:4_I t3:4_I tm1:1_ tm2:1_ tm3:1_ tm1:2_ tm2:2_ tm3:2_
## time2:p1_ID                                                                
## time3:p1_ID                                                                
## time1:p2_ID                                                                
## time2:p2_ID                                                                
## time3:p2_ID                                                                
## time1:p3_ID                                                                
## time2:p3_ID                                                                
## time3:p3_ID                                                                
## time1:p4_ID                                                                
## time2:p4_ID  -0.039                                                        
## time3:p4_ID  -0.059  0.092                                                 
## time1:p1_add -0.078  0.003  0.005                                          
## time2:p1_add  0.003 -0.078 -0.007 -0.039                                   
## time3:p1_add  0.005 -0.007 -0.078 -0.059  0.092                            
## time1:p2_add  0.067 -0.003 -0.004 -0.100  0.004  0.006                     
## time2:p2_add -0.003  0.067  0.006  0.004 -0.100 -0.009 -0.039              
## time3:p2_add -0.004  0.006  0.067  0.006 -0.009 -0.100 -0.059  0.092       
## time1:p3_add  0.130 -0.005 -0.008 -0.090  0.003  0.005 -0.203  0.008  0.012
## time2:p3_add -0.005  0.130  0.012  0.003 -0.090 -0.008  0.008 -0.203 -0.019
## time3:p3_add -0.008  0.012  0.130  0.005 -0.008 -0.090  0.012 -0.019 -0.203
## time1:p4_add -0.860  0.033  0.051 -0.052  0.002  0.003 -0.177  0.007  0.010
## time2:p4_add  0.033 -0.860 -0.079  0.002 -0.052 -0.005  0.007 -0.177 -0.016
## time3:p4_add  0.051 -0.079 -0.860  0.003 -0.005 -0.052  0.010 -0.016 -0.177
##              tm1:3_ tm2:3_ tm3:3_ tm1:4_ tm2:4_
## time2:p1_ID                                    
## time3:p1_ID                                    
## time1:p2_ID                                    
## time2:p2_ID                                    
## time3:p2_ID                                    
## time1:p3_ID                                    
## time2:p3_ID                                    
## time3:p3_ID                                    
## time1:p4_ID                                    
## time2:p4_ID                                    
## time3:p4_ID                                    
## time1:p1_add                                   
## time2:p1_add                                   
## time3:p1_add                                   
## time1:p2_add                                   
## time2:p2_add                                   
## time3:p2_add                                   
## time1:p3_add                                   
## time2:p3_add -0.039                            
## time3:p3_add -0.059  0.092                     
## time1:p4_add -0.151  0.006  0.009              
## time2:p4_add  0.006 -0.151 -0.014 -0.039       
## time3:p4_add  0.009 -0.014 -0.151 -0.059  0.092
## 
## Standardized residuals:
##         Min          Q1         Med          Q3         Max 
## -3.33210448 -0.67921287  0.03841375  0.67556301  3.00716249 
## 
## Residual standard error: 1.322006 
## Degrees of freedom: 348 total; 324 residual
training-deepDive-repeated-fitting_full.knit

For this model structure, just like for the univariate version seen in the Starter Pack, we assume that each pair of species interact with one another in a unique way. An example of this model is as follows:


\[\large y_{mt}=\sum_{i=1}^{S=4} \beta_{it} p_{im} + \sum_{\substack{i,j=1 \\ i < j}}^{S=4} \delta_{ijt} (p_{im} p_{jm}) + \epsilon_{mt}\]


Where \(y_{mt}\) represents the recorded value, \(y\), of the ecosystem function response at time point \(t\) (where \(t\) goes from \(1\) to \(T=3\)) from the \(m^{th}\) experimental/observational study unit (where \(m\) goes from \(1\) to \(M=384\)). The coefficient \(\beta_{it}\) scaled by the initial proportion \(p\) of species \(i\) forms the ID effect of said species for the ecosystem function response at time \(t\). The interaction term \(\delta_{ijt}\) represents the unique strength of the interaction between species \(i\) and \(j\) for the time \(t\). The error of this model, \(\epsilon\) is assumed to follow a multivariate Normal distribution with mean 0 and variance \(\Sigma^{*}\), where \(\Sigma^{*}\) is an \(MT \times MT\) block-diagonal matrix.


\[\Sigma^{*} = \begin{bmatrix} \Sigma_1 & & 0\\ & \ddots & \\ 0 & & \Sigma_M \end{bmatrix}\]


Each matrix along the main diagonal, \(\Sigma_{m}\) represents the variance-covariance matrix of the time points. There are a few different forms that this may take (these are called auto-correlation structures). The unstructured or general structure (UN), where each element is allowed to differ from one another, can be seen below.

\[\Sigma_m = \begin{bmatrix} \sigma_1^2 & \sigma_{1,2} & ... & \sigma_{1,T}\\ \sigma_{1,2} & \sigma_{2}^2 & ... & \sigma_{2,T}\\ \vdots & \vdots & \ddots & \vdots \\ \sigma_{1,T} & \sigma_{2, T} & ... & \sigma_T^2 \end{bmatrix}\]
FULLModel <- DImulti(y = "Y", time = c("time", "UN"), unit_IDs = "plot", 
                   prop = 2:5, data = simRM, DImodel = "FULL", method = "ML")


And just like with the univariate models, we can use summary() to look at our model output.

summary(FULLModel)
## Generalized least squares fit by maximum likelihood
##   Model: Y ~ 0 + time:((p1_ID + p2_ID + p3_ID + p4_ID + FULL.p1.p2 + FULL.p1.p3 +      FULL.p1.p4 + FULL.p2.p3 + FULL.p2.p4 + FULL.p3.p4)) 
##   Data: data 
##        AIC      BIC   logLik
##   1203.588 1342.267 -565.794
## 
## Correlation Structure: General
##  Formula: ~0 | plot 
##  Parameter estimate(s):
##  Correlation: 
##   1      2     
## 2 -0.025       
## 3 -0.037  0.088
## Variance function:
##  Structure: Different standard deviations per stratum
##  Formula: ~0 | time 
##  Parameter estimates:
##        1        2        3 
## 1.000000 1.304209 0.709242 
## 
## Coefficients:
##                      Value Std.Error   t-value p-value
## time1:p1_ID       4.919773  0.792520  6.207762  0.0000
## time2:p1_ID       4.357829  1.033611  4.216121  0.0000
## time3:p1_ID       1.220520  0.562088  2.171404  0.0306
## time1:p2_ID       2.079456  0.783771  2.653141  0.0084
## time2:p2_ID       4.415415  1.022201  4.319515  0.0000
## time3:p2_ID       2.294604  0.555884  4.127850  0.0000
## time1:p3_ID       3.668815  0.511339  7.174916  0.0000
## time2:p3_ID       7.024104  0.666893 10.532580  0.0000
## time3:p3_ID       6.439930  0.362663 17.757328  0.0000
## time1:p4_ID       4.672357  0.793137  5.890984  0.0000
## time2:p4_ID       5.996002  1.034416  5.796508  0.0000
## time3:p4_ID       5.031902  0.562526  8.945190  0.0000
## time1:FULL.p1.p2  4.446305  2.619400  1.697452  0.0906
## time2:FULL.p1.p2  6.097640  3.416245  1.784896  0.0752
## time3:FULL.p1.p2 10.754322  1.857789  5.788776  0.0000
## time1:FULL.p1.p3  4.946756  2.477049  1.997036  0.0467
## time2:FULL.p1.p3  0.201429  3.230589  0.062350  0.9503
## time3:FULL.p1.p3  5.039705  1.756827  2.868640  0.0044
## time1:FULL.p1.p4  8.535298  2.562164  3.331285  0.0010
## time2:FULL.p1.p4 12.844277  3.341597  3.843754  0.0001
## time3:FULL.p1.p4 13.679744  1.817194  7.527947  0.0000
## time1:FULL.p2.p3 11.666446  2.559699  4.557741  0.0000
## time2:FULL.p2.p3  2.254206  3.338383  0.675239  0.5000
## time3:FULL.p2.p3  4.821253  1.815446  2.655684  0.0083
## time1:FULL.p2.p4 11.044361  2.514566  4.392155  0.0000
## time2:FULL.p2.p4 13.446779  3.279519  4.100229  0.0001
## time3:FULL.p2.p4 14.315310  1.783436  8.026816  0.0000
## time1:FULL.p3.p4  3.270135  2.403580  1.360527  0.1746
## time2:FULL.p3.p4 11.270199  3.134771  3.595223  0.0004
## time3:FULL.p3.p4 10.084285  1.704720  5.915507  0.0000
## 
## Theta values: 1
## 
## 
##  Correlation: 
##                  t1:1_I t2:1_I t3:1_I t1:2_I t2:2_I t3:2_I t1:3_I t2:3_I t3:3_I
## time2:p1_ID      -0.025                                                        
## time3:p1_ID      -0.037  0.088                                                 
## time1:p2_ID      -0.024  0.001  0.001                                          
## time2:p2_ID       0.001 -0.024 -0.002 -0.025                                   
## time3:p2_ID       0.001 -0.002 -0.024 -0.037  0.088                            
## time1:p3_ID      -0.001  0.000  0.000  0.005  0.000  0.000                     
## time2:p3_ID       0.000 -0.001  0.000  0.000  0.005  0.000 -0.025              
## time3:p3_ID       0.000  0.000 -0.001  0.000  0.000  0.005 -0.037  0.088       
## time1:p4_ID       0.013  0.000  0.000 -0.012  0.000  0.000 -0.015  0.000  0.001
## time2:p4_ID       0.000  0.013  0.001  0.000 -0.012 -0.001  0.000 -0.015 -0.001
## time3:p4_ID       0.000  0.001  0.013  0.000 -0.001 -0.012  0.001 -0.001 -0.015
## time1:FULL.p1.p2 -0.518  0.013  0.019 -0.542  0.013  0.020  0.016  0.000 -0.001
## time2:FULL.p1.p2  0.013 -0.518 -0.046  0.013 -0.542 -0.048  0.000  0.016  0.001
## time3:FULL.p1.p2  0.019 -0.046 -0.518  0.020 -0.048 -0.542 -0.001  0.001  0.016
## time1:FULL.p1.p3 -0.687  0.017  0.026  0.052 -0.001 -0.002 -0.346  0.009  0.013
## time2:FULL.p1.p3  0.017 -0.687 -0.061 -0.001  0.052  0.005  0.009 -0.346 -0.031
## time3:FULL.p1.p3  0.026 -0.061 -0.687 -0.002  0.005  0.052  0.013 -0.031 -0.346
## time1:FULL.p1.p4 -0.549  0.014  0.020  0.037 -0.001 -0.001  0.019  0.000 -0.001
## time2:FULL.p1.p4  0.014 -0.549 -0.048 -0.001  0.037  0.003  0.000  0.019  0.002
## time3:FULL.p1.p4  0.020 -0.048 -0.549 -0.001  0.003  0.037 -0.001  0.002  0.019
## time1:FULL.p2.p3  0.087 -0.002 -0.003 -0.537  0.013  0.020 -0.380  0.009  0.014
## time2:FULL.p2.p3 -0.002  0.087  0.008  0.013 -0.537 -0.047  0.009 -0.380 -0.033
## time3:FULL.p2.p3 -0.003  0.008  0.087  0.020 -0.047 -0.537  0.014 -0.033 -0.380
## time1:FULL.p2.p4  0.023 -0.001 -0.001 -0.576  0.014  0.022  0.031 -0.001 -0.001
## time2:FULL.p2.p4 -0.001  0.023  0.002  0.014 -0.576 -0.051 -0.001  0.031  0.003
## time3:FULL.p2.p4 -0.001  0.002  0.023  0.022 -0.051 -0.576 -0.001  0.003  0.031
## time1:FULL.p3.p4  0.011  0.000  0.000  0.078 -0.002 -0.003 -0.402  0.010  0.015
## time2:FULL.p3.p4  0.000  0.011  0.001 -0.002  0.078  0.007  0.010 -0.402 -0.035
## time3:FULL.p3.p4  0.000  0.001  0.011 -0.003  0.007  0.078  0.015 -0.035 -0.402
##                  t1:4_I t2:4_I t3:4_I t1:FULL.1.2 t2:FULL.1.2 t3:FULL.1.2
## time2:p1_ID                                                              
## time3:p1_ID                                                              
## time1:p2_ID                                                              
## time2:p2_ID                                                              
## time3:p2_ID                                                              
## time1:p3_ID                                                              
## time2:p3_ID                                                              
## time3:p3_ID                                                              
## time1:p4_ID                                                              
## time2:p4_ID      -0.025                                                  
## time3:p4_ID      -0.037  0.088                                           
## time1:FULL.p1.p2  0.044 -0.001 -0.002                                    
## time2:FULL.p1.p2 -0.001  0.044  0.004 -0.025                             
## time3:FULL.p1.p2 -0.002  0.004  0.044 -0.037       0.088                 
## time1:FULL.p1.p3  0.016  0.000 -0.001  0.269      -0.007      -0.010     
## time2:FULL.p1.p3  0.000  0.016  0.001 -0.007       0.269       0.024     
## time3:FULL.p1.p3 -0.001  0.001  0.016 -0.010       0.024       0.269     
## time1:FULL.p1.p4 -0.691  0.017  0.026  0.211      -0.005      -0.008     
## time2:FULL.p1.p4  0.017 -0.691 -0.061 -0.005       0.211       0.019     
## time3:FULL.p1.p4  0.026 -0.061 -0.691 -0.008       0.019       0.211     
## time1:FULL.p2.p3  0.055 -0.001 -0.002  0.161      -0.004      -0.006     
## time2:FULL.p2.p3 -0.001  0.055  0.005 -0.004       0.161       0.014     
## time3:FULL.p2.p3 -0.002  0.005  0.055 -0.006       0.014       0.161     
## time1:FULL.p2.p4 -0.587  0.015  0.022  0.241      -0.006      -0.009     
## time2:FULL.p2.p4  0.015 -0.587 -0.052 -0.006       0.241       0.021     
## time3:FULL.p2.p4  0.022 -0.052 -0.587 -0.009       0.021       0.241     
## time1:FULL.p3.p4 -0.517  0.013  0.019 -0.044       0.001       0.002     
## time2:FULL.p3.p4  0.013 -0.517 -0.046  0.001      -0.044      -0.004     
## time3:FULL.p3.p4  0.019 -0.046 -0.517  0.002      -0.004      -0.044     
##                  t1:FULL.1.3 t2:FULL.1.3 t3:FULL.1.3 t1:FULL.1.4 t2:FULL.1.4
## time2:p1_ID                                                                 
## time3:p1_ID                                                                 
## time1:p2_ID                                                                 
## time2:p2_ID                                                                 
## time3:p2_ID                                                                 
## time1:p3_ID                                                                 
## time2:p3_ID                                                                 
## time3:p3_ID                                                                 
## time1:p4_ID                                                                 
## time2:p4_ID                                                                 
## time3:p4_ID                                                                 
## time1:FULL.p1.p2                                                            
## time2:FULL.p1.p2                                                            
## time3:FULL.p1.p2                                                            
## time1:FULL.p1.p3                                                            
## time2:FULL.p1.p3 -0.025                                                     
## time3:FULL.p1.p3 -0.037       0.088                                         
## time1:FULL.p1.p4  0.337      -0.008      -0.013                             
## time2:FULL.p1.p4 -0.008       0.337       0.030      -0.025                 
## time3:FULL.p1.p4 -0.013       0.030       0.337      -0.037       0.088     
## time1:FULL.p2.p3 -0.030       0.001       0.001      -0.077       0.002     
## time2:FULL.p2.p3  0.001      -0.030      -0.003       0.002      -0.077     
## time3:FULL.p2.p3  0.001      -0.003      -0.030       0.003      -0.007     
## time1:FULL.p2.p4 -0.039       0.001       0.001       0.358      -0.009     
## time2:FULL.p2.p4  0.001      -0.039      -0.003      -0.009       0.358     
## time3:FULL.p2.p4  0.001      -0.003      -0.039      -0.013       0.032     
## time1:FULL.p3.p4  0.095      -0.002      -0.004       0.317      -0.008     
## time2:FULL.p3.p4 -0.002       0.095       0.008      -0.008       0.317     
## time3:FULL.p3.p4 -0.004       0.008       0.095      -0.012       0.028     
##                  t3:FULL.1.4 t1:FULL.2.3 t2:FULL.2.3 t3:FULL.2.3 t1:FULL.2.4
## time2:p1_ID                                                                 
## time3:p1_ID                                                                 
## time1:p2_ID                                                                 
## time2:p2_ID                                                                 
## time3:p2_ID                                                                 
## time1:p3_ID                                                                 
## time2:p3_ID                                                                 
## time3:p3_ID                                                                 
## time1:p4_ID                                                                 
## time2:p4_ID                                                                 
## time3:p4_ID                                                                 
## time1:FULL.p1.p2                                                            
## time2:FULL.p1.p2                                                            
## time3:FULL.p1.p2                                                            
## time1:FULL.p1.p3                                                            
## time2:FULL.p1.p3                                                            
## time3:FULL.p1.p3                                                            
## time1:FULL.p1.p4                                                            
## time2:FULL.p1.p4                                                            
## time3:FULL.p1.p4                                                            
## time1:FULL.p2.p3  0.003                                                     
## time2:FULL.p2.p3 -0.007      -0.025                                         
## time3:FULL.p2.p3 -0.077      -0.037       0.088                             
## time1:FULL.p2.p4 -0.013       0.213      -0.005      -0.008                 
## time2:FULL.p2.p4  0.032      -0.005       0.213       0.019      -0.025     
## time3:FULL.p2.p4  0.358      -0.008       0.019       0.213      -0.037     
## time1:FULL.p3.p4 -0.012      -0.070       0.002       0.003       0.178     
## time2:FULL.p3.p4  0.028       0.002      -0.070      -0.006      -0.004     
## time3:FULL.p3.p4  0.317       0.003      -0.006      -0.070      -0.007     
##                  t2:FULL.2.4 t3:FULL.2.4 t1:FULL.3 t2:FULL.3
## time2:p1_ID                                                 
## time3:p1_ID                                                 
## time1:p2_ID                                                 
## time2:p2_ID                                                 
## time3:p2_ID                                                 
## time1:p3_ID                                                 
## time2:p3_ID                                                 
## time3:p3_ID                                                 
## time1:p4_ID                                                 
## time2:p4_ID                                                 
## time3:p4_ID                                                 
## time1:FULL.p1.p2                                            
## time2:FULL.p1.p2                                            
## time3:FULL.p1.p2                                            
## time1:FULL.p1.p3                                            
## time2:FULL.p1.p3                                            
## time3:FULL.p1.p3                                            
## time1:FULL.p1.p4                                            
## time2:FULL.p1.p4                                            
## time3:FULL.p1.p4                                            
## time1:FULL.p2.p3                                            
## time2:FULL.p2.p3                                            
## time3:FULL.p2.p3                                            
## time1:FULL.p2.p4                                            
## time2:FULL.p2.p4                                            
## time3:FULL.p2.p4  0.088                                     
## time1:FULL.p3.p4 -0.004      -0.007                         
## time2:FULL.p3.p4  0.178       0.016      -0.025             
## time3:FULL.p3.p4  0.016       0.178      -0.037     0.088   
## 
## Standardized residuals:
##          Min           Q1          Med           Q3          Max 
## -2.817763847 -0.683393949 -0.003062112  0.682850874  3.036318964 
## 
## Residual standard error: 1.264283 
## Degrees of freedom: 348 total; 318 residual
Model Selection
image description image description
training-deepDive-repeated-selection.knit

As with the univariate DI models found in the Starter Pack, we can formally compare across the models fit in the previous step. We suggest to follow the workflow set out below.


We begin by selecting the most suitable structure for the variance covariance matrix of our time points (\(\Sigma_m\)). We use AICc (the corrected AIC) as the models are not nested.

AICc(IDModel_UN); AICc(IDModel_CS); AICc(IDModel_AR1)
## [1] 1299.13
## [1] 1312.704
## [1] 1318.019

In this case, the UN structure has a significantly lower AICc value so we assume this structure to be the true one underlying our responses for the rest of our selection workflow.


Next, we compare our ID model (which we refit using ML and our chosen variance structure) to the next most complex model, the AV DI model. As they are nested models, we can use a likelihood ratio test to test the hypothesis that the additional term (the AV interaction term) is equal to zero.

anova(IDModel, AVModel)
##         Model df      AIC      BIC    logLik   Test L.Ratio p-value
## IDModel     1 18 1296.106 1365.445 -630.0529                       
## AVModel     2 21 1224.423 1305.319 -591.2113 1 vs 2 77.6831  <.0001

As the p-value is <0.05, we reject the null hypothesis and select the AV model over the ID model.

As we can group our species by functional traits (arbitrarily in this case as they are simulated), we next pit our current model (AV) against the functional group (FG) model.

anova(AVModel, FGModel)
##         Model df      AIC      BIC    logLik   Test  L.Ratio p-value
## AVModel     1 21 1224.423 1305.319 -591.2113                        
## FGModel     2 27 1225.940 1329.949 -585.9700 1 vs 2 10.48258  0.1057

As the p-value this time is >0.05, we fail to reject the null hypothesis and continue our selection with the AV model.

Next, we compare the AV model to the ADD model.

anova(AVModel, ADDModel)
##          Model df      AIC      BIC    logLik   Test L.Ratio p-value
## AVModel      1 21 1224.423 1305.319 -591.2113                       
## ADDModel     2 30 1202.932 1318.499 -571.4663 1 vs 2 39.4901  <.0001

This time the p-value is less than 0.05, so we once again reject the null hypothesis and continue with the ADD model instead of the AV model.

Finally, we compare the ADD model to the most complex structure, the FULL model.

anova(ADDModel, FULLModel)
##           Model df      AIC      BIC    logLik   Test  L.Ratio p-value
## ADDModel      1 30 1202.932 1318.499 -571.4663                        
## FULLModel     2 36 1203.588 1342.267 -565.7940 1 vs 2 11.34459  0.0783

The p-value is >0.05 so therefore our selected DI model structure is the ADD model. There are no additional terms (e.g. treatments or weather effects) in this dataset, so our model selection stops here.

We refit our final model using the ‘REML’ estimation method as it provides us with unbiased variance estimates and we will no longer be comparing models which vary in fixed effects.

FinalModel <- DImulti(y = "Y", time = c("time", "UN"), unit_IDs = "plot", 
                      prop = 2:5, data = simRM, DImodel = "ADD", method = "REML")
Interpretation of the Selected Model
image description image description
training-deepDive-repeated-interpret.knit

From the ‘Model Selection’ section of this page, we found that our best fitting model used the ADD interaction structure. The algebraic formulation of this model is as follows:

\[\large y_{mt}=\sum_{i=1}^{S=4} \beta_{it} p_{im} + \sum_{\substack{i,j=1 \\ i < j}}^{S=4} (\lambda_{it} + \lambda_{jt}) (p_{im} p_{jm}) + \epsilon_{mt}\]

Where \(y_{mt}\) represents the recorded value, \(y\), of the ecosystem function at a time point \(t\) (where \(t\) goes from \(1\) to \(T=3\)) from the \(m^{th}\) experimental/observational study unit (where \(m\) goes from \(1\) to \(M=384\)). The coefficient \(\beta_{it}\) scaled by the initial proportion \(p\) of species \(i\) forms the ID effect of said species for the ecosystem function response at time \(t\). For a species pool of size \(S\), there are \(S\) unique interaction strengths, \(\lambda\), which are added together and scaled by the pairwise product of the species. The error of this model, \(\epsilon\) is assumed to follow a multivariate Normal distribution with mean 0 and variance \(\Sigma^{*}\), where \(\Sigma^{*}\) is an \(MT \times MT\) block-diagonal matrix. The variance-covariance matrix is unstructured, i.e. each element is allowed to vary from one another, see below.


\[\Sigma^{*} = \begin{bmatrix} \Sigma_1 & & 0\\ & \ddots & \\ 0 & & \Sigma_M \end{bmatrix}\]
\[\Sigma_m = \begin{bmatrix} \sigma_1^2 & \sigma_{1,2} & ... & \sigma_{1,T}\\ \sigma_{1,2} & \sigma_{2}^2 & ... & \sigma_{2,T}\\ \vdots & \vdots & \ddots & \vdots \\ \sigma_{1,T} & \sigma_{2, T} & ... & \sigma_T^2 \end{bmatrix}\]

We can use summary() or print() to view our model in R.

print(FinalModel)
## Note: 
## Method Used = REML 
## Correlation Structure Used = UN
##  Additive Interactions Model
## Theta value(s) = 1
## 
## Generalized least squares fit by REML
##   Model: Y ~ 0 + time:((p1_ID + p2_ID + p3_ID + p4_ID + p1_add + p2_add +      p3_add + p4_add)) 
##       AIC       BIC    logLik 
## 1172.5061 1285.9284 -556.2531 
## 
##  Repeated Measure Correlation Structure: General
##  Formula: ~0 | plot 
##  Parameter estimate(s):
##  Correlation: 
##   1      2     
## 2 -0.039       
## 3 -0.059  0.092
## 
## 
## Table: Fixed Effect Coefficients
## 
##                Beta      Std. Error   t-value   p-value     Signif 
## -------------  --------  -----------  --------  ----------  -------
## time1:p1_ID    +4.881    0.814        5.999     5.293e-09   ***    
## time2:p1_ID    +4.291    1.018        4.217     3.216e-05   ***    
## time3:p1_ID    +1.230    0.554        2.222     0.027       *      
## time1:p2_ID    +2.118    0.812        2.610     0.009475    **     
## time2:p2_ID    +4.397    1.015        4.331     1.984e-05   ***    
## time3:p2_ID    +2.288    0.552        4.142     4.399e-05   ***    
## time1:p3_ID    +3.657    0.529        6.912     2.544e-11   ***    
## time2:p3_ID    +7.043    0.662        10.643    6.947e-23   ***    
## time3:p3_ID    +6.442    0.360        17.891    2.864e-50   ***    
## time1:p4_ID    +4.987    0.815        6.119     2.716e-09   ***    
## time2:p4_ID    +5.932    1.019        5.819     1.424e-08   ***    
## time3:p4_ID    +4.973    0.555        8.967     2.485e-17   ***    
## time1:p1_add   +2.251    1.829        1.230     0.2194             
## time2:p1_add   +2.009    2.288        0.878     0.3805             
## time3:p1_add   +4.834    1.245        3.884     0.0001248   ***    
## time1:p2_add   +5.527    1.861        2.971     0.003193    **     
## time2:p2_add   +3.236    2.327        1.391     0.1653             
## time3:p2_add   +5.304    1.266        4.189     3.62e-05    ***    
## time1:p3_add   +2.360    1.440        1.639     0.1023             
## time2:p3_add   -0.857    1.801        -0.476    0.6345             
## time3:p3_add   +0.242    0.980        0.247     0.8051             
## time1:p4_add   +4.265    1.886        2.261     0.02443     *      
## time2:p4_add   +11.114   2.359        4.710     3.672e-06   ***    
## time3:p4_add   +9.226    1.284        7.187     4.584e-12   ***    
## 
## Signif codes: 0-0.001 '***', 0.001-0.01 '**', 0.01-0.05 '*', 0.05-0.1 '+', 0.1-1.0 ' '
## 
## Degrees of freedom: 348 total; 324 residual
## Residual standard error: 1.37003 
## 
## Marginal variance covariance matrix
##           1         2         3
## 1  1.877000 -0.090773 -0.075149
## 2 -0.090773  2.936400  0.146290
## 3 -0.075149  0.146290  0.869170
##   Standard Deviations: 1.37 1.7136 0.93229

The fixed effects of our model can be interpreted the same way as the univariate models, we just need to distinguish which predictor corresponds to which time point!

For example, we can see that the species p1 performs with coefficients between 4-5 at time points 1 and 2, however it drops down to roughly 1 for time point 3. We can also note that each of these effects are statistically significant at an \(\alpha\) value of 0.05.

It is often easier to instead select a few communities of interest and plot their responses for comparison. For example, the monoculture of each species and the equi-proportional four-species mixture seen below.

library(ggplot2)

simRM_plot <- simRM[which(simRM$plot %in% c(1, 3, 5, 7, 21)), ]

simRM_plot$community <- c(paste0("p", 1:4), "Mixture")

ggplot(simRM_plot, aes(fill=time, y=Y, x=community)) + 
    geom_bar(position="dodge", stat="identity")

Assuming that maximising positive response values is desirable for the ecosystem function at each time point, we can see that there are numerous trade offs occurring when we select one community over another, particularly for the performance of time 1 versus time 3, where if, for instance, the p1 monoculture is selected over the p3 monoculture the ecosystem function’s performance is maximised at time 1 and minimised at time 3, as opposed to the opposite performance found in p3’s monoculture.

We can also interpret the variance covariance matrix of the time points to note these trade offs.

\[\Sigma_m = \begin{bmatrix} \ & time1 & time2 & time3\\ \ time1 & 1.877 & -0.091 & -0.075\\ \ time2 & -0.091 & 2.936 & 0.146\\ \ time3 & -0.075 & 0.146 & 0.869 \end{bmatrix}\]

Here, we can see that time point 2 is the most variable, while time 3 is the least variable. We can also note relations between time points, such as the negative relationship between times 1 and 2, i.e. that increases in time 1 will correlate to decreases in time 2 and vice versa, and the positive relationship between time 2 and 3, i.e. that as time 2 increases, we expect to see an increase in time 3, albeit at a slower rate (as the covariance is <1) and vice versa. In a real world dataset, this relationship may be indicative of communities being either ‘long lasting’ or ‘short lived’ in their ecosystem functioning.

Using Contrasts
image description image description
training-deepDive-repeated-interpret_contrast.knit

Contrasts allow us to formally test the difference between predictions (and therefore between individual effects). The DImodelsMulti R package currently does not support the contrast R package nor its corresponding function (contrast()), however, it is very easy to refit our model using gls() from the nlme package (which does have this support) by copying the call from our DImulti object.

FinalModel$call
## nlme::gls(model = Y ~ 0 + time:((p1_ID + p2_ID + p3_ID + p4_ID + 
##     p1_add + p2_add + p3_add + p4_add)), data = data, correlation = numeric(0), 
##     weights = numeric(0), method = "REML", control = nlme::glsControl(msMaxIter = 50000, 
##         opt = "optim"))
summary(FinalModel$corr$`Repeated Measure`)
## Correlation Structure: General
##  Formula: ~0 | plot 
##  Parameter estimate(s):
##  Correlation: 
##   1      2     
## 2 -0.039       
## 3 -0.059  0.092


First, we need to add our ADD interaction columns to our dataset.

library(DImodels)

simRM_gls <- cbind(simRM, 
                   DI_data(prop = 2:5, data = simRM, theta = 1, what = "ADD"))

As the contrast() function expects each fixed effect to appear independently of interactions, we must reparameterise our model (swap the : interaction with a *) and drop a species (in this case, p4) to avoid overparameterisation.

library(nlme)

FinalModel_gls <- gls(Y ~ 0 + time*((p1 + p2 + p3 + p1_add + p2_add + p3_add + p4_add)),
                      data = simRM_gls, method="REML", correlation = corSymm(form = ~ 0 | plot), 
                      weights = varIdent(form = ~ 0 | time))

Now we’re ready to test! For this example, we can check if the predicted response values of the response at time points 2 and 3 significantly vary for a p3 monoculture (as from our previous plot, they looked quite similar).

library(contrast)

contrast(FinalModel_gls,
         list(time="2", p1=0, p2=0, p3=1, p1_add=0, p2_add=0, p3_add=0, p4_add=0),
         list(time="3", p1=0, p2=0, p3=1, p1_add=0, p2_add=0, p3_add=0, p4_add=0))
## gls model parameter contrast
## 
##   Contrast      S.E.      Lower    Upper    t  df Pr(>|t|)
##  0.6019107 0.7238331 -0.8220955 2.025917 0.83 324   0.4063

As the p-value of this test is greater than 0.05, we can’t say that these responses significantly differ. On the other hand, we can see that Y1 and Y2 (for the same community) do significantly differ:

contrast(FinalModel_gls,
         list(time="1", p1=0, p2=0, p3=1, p1_add=0, p2_add=0, p3_add=0, p4_add=0),
         list(time="2", p1=0, p2=0, p3=1, p1_add=0, p2_add=0, p3_add=0, p4_add=0))
## gls model parameter contrast
## 
##   Contrast      S.E.     Lower     Upper     t  df Pr(>|t|)
##  -3.386206 0.8631165 -5.084226 -1.688185 -3.92 324    1e-04
Video: Coding Walkthrough
image description image description

Multivariate DI Model

Multifunctionality refers to the simultaneous provision of goods/services from an ecosystem. Data containing readings for multiple ecosystem function responses from a set of experimental units (e.g. plots) can be used to study multifunctionality. The multivariate DI model (Dooley et al., 2015) enables the simultaneous prediction of multiple ecosystem function responses, while accounting for any existing covariance between the functions. This enables formal testing between coefficients (diversity effects) across ecosystem functions and the ability to note trade-offs which may occur when one ecosystem function is optimised over another.



What will I learn from looking at this example?

In this example, we describe how to implement multivariate DI models using R (version ≥ 4.1.2) for a six-species system using a simulated dataset consisting of six unique species and a treatment factor with two levels. The models described could be used to answer research questions like whether species diversity has an impact on the ecosystem multifunctionality and if yes, is it affected by only the species identities or also their interaction.

Note that in all models fitted to this dataset, it is assumed that \(\theta\) (the non-linear interaction parameter) is equal to 1. Find out more about this non-linear parameter in the Theta section of the Starter Pack training.
Summary of Data
image description image description
training-deepDive-multivariate-summary.knit

In this example, we use the ‘simMV’ (simulated multivariate) dataset, available in the DImodelsMulti R package. It contains 192 plots comprising of six species that vary in proportions (p1 - p6). Each plot was replicated once for testing a two-level factor treat, included at levels 0 and 1, resulting in a total of 384 plots (therefore 384 rows of data). There are four simulated responses (Y1 - Y4) recorded in a wide data format (one column per response).

data("simMV")
head(simMV)
##   plot p1 p2 p3 p4 p5 p6 treat        Y1       Y2         Y3         Y4
## 1    1  1  0  0  0  0  0     0  1.880817 5.108158 -1.9712356  4.8247704
## 2    2  1  0  0  0  0  0     0  7.103477 5.183822 -4.0598298  3.1094539
## 3    3  0  1  0  0  0  0     0 -1.444736 6.900983  6.3342200  4.9055054
## 4    4  0  1  0  0  0  0     0 -1.756776 4.784160  5.2155726  5.3583856
## 5    5  0  0  1  0  0  0     0  5.311257 4.258924 -0.4694982 -2.3078377
## 6    6  0  0  1  0  0  0     0  5.975319 3.148215  1.9509040 -0.6064387

The data was simulated assuming that there were existing covariances between the responses, an additive treatment effect, and both species identity and interaction effects were present. Information on the true underlying ID, interaction, and treatments effects, along with the structure and true values of the error term, can be found using the ?simMV command.

Model Fitting using DImodelsMulti Package
image description image description
Here we fit a range of DI models to the six-species multivariate dataset.

training-deepDive-multivariate-fitting_id.knit

For this model structure, just like for the univariate version seen in the Starter Pack, we assume that species do not interact with one another. This implies that species interactions don’t affect the ecosystem function responses leaving only the species proportions as fixed effects, along with any experimental structures. An example of this model is as follows:


\[\large y_{km}=\sum_{i=1}^{S=6} \beta_{ik} p_{im} + \epsilon_{km}\]


Where \(y_{km}\) represents the recorded value, \(y\), of the \(k^{th}\) ecosystem function (where \(k\) goes from \(1\) to \(K=4\)) from the \(m^{th}\) experimental/observational study unit (where \(m\) goes from \(1\) to \(M=384\)). The coefficient \(\beta_{ik}\) scaled by the initial proportion \(p\) of species \(i\) forms the ID effect of said species for the ecosystem function response \(k\). The error of this model, \(\epsilon\) is assumed to follow a multivariate Normal distribution with mean 0 and variance \(\Sigma^{*}\), where \(\Sigma^{*}\) is a \(KM \times KM\) block-diagonal matrix.


\[\Sigma^{*} = \begin{bmatrix} \Sigma_1 & & 0\\ & \ddots & \\ 0 & & \Sigma_M \end{bmatrix}\]


Each matrix along the main diagonal, \(\Sigma_{m}\) represents the variance-covariance matrix of the ecosystem functions. There are a few different forms that this may take (these are called auto-correlation structures). The first of which is the unstructured or general structure (UN), where each element is allowed to differ from one another.

\[\Sigma_m = \begin{bmatrix} \sigma_1^2 & \sigma_{1,2} & ... & \sigma_{1,K}\\ \sigma_{1,2} & \sigma_{2}^2 & ... & \sigma_{2,K}\\ \vdots & \vdots & \ddots & \vdots \\ \sigma_{1,K} & \sigma_{2, K} & ... & \sigma_K^2 \end{bmatrix}\]
IDModel_UN <- DImulti(y = c("Y1", "Y2", "Y3", "Y4"), eco_func = c("NA", "UN"), unit_IDs = "plot", 
                   prop = 2:7, data = simMV, DImodel = "ID", method = "ML")

Another of which is the compound symmetry (CS) structure, which assumes that all variances are equal and all covariances are equal in the matrix. So for our four ecosystem function, it would take the form below.

\[\Sigma_m = \sigma^2 \begin{bmatrix} 1 & \rho & \rho & \rho\\ \rho & 1 & \rho & \rho\\ \rho & \rho & 1 & \rho \\ \rho & \rho & \rho & 1 \end{bmatrix} \]
IDModel_CS <- DImulti(y = c("Y1", "Y2", "Y3", "Y4"), eco_func = c("NA", "CS"), unit_IDs = "plot", 
                   prop = 2:7, data = simMV, DImodel = "ID", method = "ML")


And just like with the univariate models, we can use summary() to look at our model output.

summary(IDModel_UN)
## Generalized least squares fit by maximum likelihood
##   Model: value ~ 0 + func:((p1_ID + p2_ID + p3_ID + p4_ID + p5_ID + p6_ID)) 
##   Data: data 
##        AIC     BIC    logLik
##   6338.414 6519.87 -3135.207
## 
## Correlation Structure: General
##  Formula: ~0 | plot 
##  Parameter estimate(s):
##  Correlation: 
##   1      2      3     
## 2 -0.128              
## 3  0.539 -0.114       
## 4 -0.205  0.247 -0.371
## Variance function:
##  Structure: Different standard deviations per stratum
##  Formula: ~0 | func 
##  Parameter estimates:
##        Y1        Y2        Y3        Y4 
## 1.0000000 0.5084411 1.2105343 0.4989388 
## 
## Coefficients:
##                  Value Std.Error  t-value p-value
## funcY1:p1_ID  8.989781 0.5680708 15.82511  0.0000
## funcY2:p1_ID  6.990201 0.2888306 24.20173  0.0000
## funcY3:p1_ID  2.413064 0.6876692  3.50905  0.0005
## funcY4:p1_ID  4.146376 0.2834326 14.62914  0.0000
## funcY1:p2_ID  2.213061 0.6178964  3.58161  0.0004
## funcY2:p2_ID  5.879887 0.3141639 18.71598  0.0000
## funcY3:p2_ID  7.804883 0.7479848 10.43455  0.0000
## funcY4:p2_ID  4.860977 0.3082925 15.76742  0.0000
## funcY1:p3_ID  9.348911 0.6057502 15.43361  0.0000
## funcY2:p3_ID  6.599457 0.3079883 21.42762  0.0000
## funcY3:p3_ID  4.925538 0.7332814  6.71712  0.0000
## funcY4:p3_ID -1.102924 0.3022323 -3.64926  0.0003
## funcY1:p4_ID  4.937143 0.5419305  9.11029  0.0000
## funcY2:p4_ID  4.046866 0.2755397 14.68705  0.0000
## funcY3:p4_ID  9.424762 0.6560254 14.36646  0.0000
## funcY4:p4_ID  4.910240 0.2703901 18.15984  0.0000
## funcY1:p5_ID  1.321601 0.6012128  2.19822  0.0281
## funcY2:p5_ID  6.782371 0.3056813 22.18772  0.0000
## funcY3:p5_ID  4.997989 0.7277887  6.86736  0.0000
## funcY4:p5_ID  6.735194 0.2999684 22.45302  0.0000
## funcY1:p6_ID  6.647073 0.5607441 11.85402  0.0000
## funcY2:p6_ID  9.102231 0.2851054 31.92585  0.0000
## funcY3:p6_ID  9.965457 0.6788000 14.68099  0.0000
## funcY4:p6_ID -0.637079 0.2797770 -2.27710  0.0229
## 
## Theta values: 1
## 
## 
##  Correlation: 
##              fY1:1_ fY2:1_ fY3:1_ fY4:1_ fY1:2_ fY2:2_ fY3:2_ fY4:2_ fY1:3_
## funcY2:p1_ID -0.128                                                        
## funcY3:p1_ID  0.539 -0.114                                                 
## funcY4:p1_ID -0.205  0.247 -0.371                                          
## funcY1:p2_ID -0.144  0.018 -0.078  0.030                                   
## funcY2:p2_ID  0.018 -0.144  0.017 -0.036 -0.128                            
## funcY3:p2_ID -0.078  0.017 -0.144  0.054  0.539 -0.114                     
## funcY4:p2_ID  0.030 -0.036  0.054 -0.144 -0.205  0.247 -0.371              
## funcY1:p3_ID -0.141  0.018 -0.076  0.029 -0.211  0.027 -0.114  0.043       
## funcY2:p3_ID  0.018 -0.141  0.016 -0.035  0.027 -0.211  0.024 -0.052 -0.128
## funcY3:p3_ID -0.076  0.016 -0.141  0.052 -0.114  0.024 -0.211  0.078  0.539
## funcY4:p3_ID  0.029 -0.035  0.052 -0.141  0.043 -0.052  0.078 -0.211 -0.205
## funcY1:p4_ID -0.026  0.003 -0.014  0.005 -0.137  0.017 -0.074  0.028 -0.096
## funcY2:p4_ID  0.003 -0.026  0.003 -0.006  0.017 -0.137  0.016 -0.034  0.012
## funcY3:p4_ID -0.014  0.003 -0.026  0.010 -0.074  0.016 -0.137  0.051 -0.052
## funcY4:p4_ID  0.005 -0.006  0.010 -0.026  0.028 -0.034  0.051 -0.137  0.020
## funcY1:p5_ID -0.265  0.034 -0.143  0.054 -0.063  0.008 -0.034  0.013 -0.018
## funcY2:p5_ID  0.034 -0.265  0.030 -0.066  0.008 -0.063  0.007 -0.016  0.002
## funcY3:p5_ID -0.143  0.030 -0.265  0.098 -0.034  0.007 -0.063  0.023 -0.010
## funcY4:p5_ID  0.054 -0.066  0.098 -0.265  0.013 -0.016  0.023 -0.063  0.004
## funcY1:p6_ID -0.157  0.020 -0.085  0.032 -0.097  0.012 -0.052  0.020 -0.138
## funcY2:p6_ID  0.020 -0.157  0.018 -0.039  0.012 -0.097  0.011 -0.024  0.018
## funcY3:p6_ID -0.085  0.018 -0.157  0.058 -0.052  0.011 -0.097  0.036 -0.074
## funcY4:p6_ID  0.032 -0.039  0.058 -0.157  0.020 -0.024  0.036 -0.097  0.028
##              fY2:3_ fY3:3_ fY4:3_ fY1:4_ fY2:4_ fY3:4_ fY4:4_ fY1:5_ fY2:5_
## funcY2:p1_ID                                                               
## funcY3:p1_ID                                                               
## funcY4:p1_ID                                                               
## funcY1:p2_ID                                                               
## funcY2:p2_ID                                                               
## funcY3:p2_ID                                                               
## funcY4:p2_ID                                                               
## funcY1:p3_ID                                                               
## funcY2:p3_ID                                                               
## funcY3:p3_ID -0.114                                                        
## funcY4:p3_ID  0.247 -0.371                                                 
## funcY1:p4_ID  0.012 -0.052  0.020                                          
## funcY2:p4_ID -0.096  0.011 -0.024 -0.128                                   
## funcY3:p4_ID  0.011 -0.096  0.036  0.539 -0.114                            
## funcY4:p4_ID -0.024  0.036 -0.096 -0.205  0.247 -0.371                     
## funcY1:p5_ID  0.002 -0.010  0.004 -0.245  0.031 -0.132  0.050              
## funcY2:p5_ID -0.018  0.002 -0.004  0.031 -0.245  0.028 -0.060 -0.128       
## funcY3:p5_ID  0.002 -0.018  0.007 -0.132  0.028 -0.245  0.091  0.539 -0.114
## funcY4:p5_ID -0.004  0.007 -0.018  0.050 -0.060  0.091 -0.245 -0.205  0.247
## funcY1:p6_ID  0.018 -0.074  0.028 -0.170  0.022 -0.091  0.035 -0.070  0.009
## funcY2:p6_ID -0.138  0.016 -0.034  0.022 -0.170  0.019 -0.042  0.009 -0.070
## funcY3:p6_ID  0.016 -0.138  0.051 -0.091  0.019 -0.170  0.063 -0.038  0.008
## funcY4:p6_ID -0.034  0.051 -0.138  0.035 -0.042  0.063 -0.170  0.014 -0.017
##              fY3:5_ fY4:5_ fY1:6_ fY2:6_ fY3:6_
## funcY2:p1_ID                                   
## funcY3:p1_ID                                   
## funcY4:p1_ID                                   
## funcY1:p2_ID                                   
## funcY2:p2_ID                                   
## funcY3:p2_ID                                   
## funcY4:p2_ID                                   
## funcY1:p3_ID                                   
## funcY2:p3_ID                                   
## funcY3:p3_ID                                   
## funcY4:p3_ID                                   
## funcY1:p4_ID                                   
## funcY2:p4_ID                                   
## funcY3:p4_ID                                   
## funcY4:p4_ID                                   
## funcY1:p5_ID                                   
## funcY2:p5_ID                                   
## funcY3:p5_ID                                   
## funcY4:p5_ID -0.371                            
## funcY1:p6_ID -0.038  0.014                     
## funcY2:p6_ID  0.008 -0.017 -0.128              
## funcY3:p6_ID -0.070  0.026  0.539 -0.114       
## funcY4:p6_ID  0.026 -0.070 -0.205  0.247 -0.371
## 
## Standardized residuals:
##         Min          Q1         Med          Q3         Max 
## -2.96340888 -0.76433533  0.01814839  0.69328139  3.44973070 
## 
## Residual standard error: 2.684619 
## Degrees of freedom: 1536 total; 1512 residual
training-deepDive-multivariate-fitting_av.knit

For this model structure, just like for the univariate version seen in the Starter Pack, we assume that species interact with one another, the strength of which is determined by their average presence, i.e. via a single interaction term. An example of this model is as follows:


\[\large y_{km}=\sum_{i=1}^{S=6} \beta_{ik} p_{im} + \delta_{AVk} \sum_{i,j=1 \\ i<j}^{S=6} p_{im}p_{jm} + \epsilon_{km}\]


Where \(y_{km}\) represents the recorded value, \(y\), of the \(k^{th}\) ecosystem function (where \(k\) goes from \(1\) to \(K=4\)) from the \(m^{th}\) experimental/observational study unit (where \(m\) goes from \(1\) to \(M=384\)). The coefficient \(\beta_{ik}\) scaled by the initial proportion \(p\) of species \(i\) forms the ID effect of said species for the ecosystem function response \(k\). The interaction term \(\delta_{AV}\) represents the interactions between any pair of species. The error of this model, \(\epsilon\) is assumed to follow a multivariate Normal distribution with mean 0 and variance \(\Sigma^{*}\), where \(\Sigma^{*}\) is a \(KM \times KM\) block-diagonal matrix.


\[\Sigma^{*} = \begin{bmatrix} \Sigma_1 & & 0\\ & \ddots & \\ 0 & & \Sigma_M \end{bmatrix}\]


Each matrix along the main diagonal, \(\Sigma_{m}\) represents the variance-covariance matrix of the ecosystem functions. There are a few different forms that this may take (these are called auto-correlation structures). The unstructured or general structure (UN), where each element is allowed to differ from one another, can be seen below.

\[\Sigma_m = \begin{bmatrix} \sigma_1^2 & \sigma_{1,2} & ... & \sigma_{1,K}\\ \sigma_{1,2} & \sigma_{2}^2 & ... & \sigma_{2,K}\\ \vdots & \vdots & \ddots & \vdots \\ \sigma_{1,K} & \sigma_{2, K} & ... & \sigma_K^2 \end{bmatrix}\]
AVModel <- DImulti(y = c("Y1", "Y2", "Y3", "Y4"), eco_func = c("NA", "UN"), unit_IDs = "plot", 
                   prop = 2:7, data = simMV, DImodel = "AV", method = "ML")


And just like with the univariate models, we can use summary() to look at our model output.

summary(AVModel)
## Generalized least squares fit by maximum likelihood
##   Model: value ~ 0 + func:((p1_ID + p2_ID + p3_ID + p4_ID + p5_ID + p6_ID +      AV)) 
##   Data: data 
##       AIC      BIC    logLik
##   6191.77 6394.573 -3057.885
## 
## Correlation Structure: General
##  Formula: ~0 | plot 
##  Parameter estimate(s):
##  Correlation: 
##   1      2      3     
## 2 -0.206              
## 3  0.537 -0.185       
## 4 -0.206  0.293 -0.372
## Variance function:
##  Structure: Different standard deviations per stratum
##  Formula: ~0 | func 
##  Parameter estimates:
##        Y1        Y2        Y3        Y4 
## 1.0000000 0.4283314 1.2111244 0.5006316 
## 
## Coefficients:
##                  Value Std.Error   t-value p-value
## funcY1:p1_ID  8.342765 0.6981396 11.949995  0.0000
## funcY2:p1_ID  4.798571 0.2990351 16.046846  0.0000
## funcY3:p1_ID  1.691327 0.8455340  2.000307  0.0456
## funcY4:p1_ID  4.135473 0.3495108 11.832177  0.0000
## funcY1:p2_ID  1.676665 0.7031041  2.384662  0.0172
## funcY2:p2_ID  4.062958 0.3011616 13.490959  0.0000
## funcY3:p2_ID  7.206542 0.8515465  8.462886  0.0000
## funcY4:p2_ID  4.851939 0.3519961 13.784069  0.0000
## funcY1:p3_ID  8.631799 0.7545615 11.439490  0.0000
## funcY2:p3_ID  4.170390 0.3232024 12.903339  0.0000
## funcY3:p3_ID  4.125610 0.9138679  4.514449  0.0000
## funcY4:p3_ID -1.115008 0.3777573 -2.951651  0.0032
## funcY1:p4_ID  4.264460 0.6869699  6.207637  0.0000
## funcY2:p4_ID  1.768293 0.2942508  6.009475  0.0000
## funcY3:p4_ID  8.674394 0.8320060 10.425878  0.0000
## funcY4:p4_ID  4.898905 0.3439188 14.244364  0.0000
## funcY1:p5_ID  0.650316 0.7339497  0.886050  0.3757
## funcY2:p5_ID  4.508536 0.3143737 14.341328  0.0000
## funcY3:p5_ID  4.249181 0.8889043  4.780245  0.0000
## funcY4:p5_ID  6.723883 0.3674384 18.299348  0.0000
## funcY1:p6_ID  6.058291 0.6712896  9.024854  0.0000
## funcY2:p6_ID  7.107853 0.2875344 24.720007  0.0000
## funcY3:p6_ID  9.308679 0.8130152 11.449574  0.0000
## funcY4:p6_ID -0.647000 0.3360688 -1.925202  0.0544
## funcY1:AV     2.214620 1.3944497  1.588168  0.1125
## funcY2:AV     7.501562 0.5972866 12.559402  0.0000
## funcY3:AV     2.470377 1.6888520  1.462755  0.1437
## funcY4:AV     0.037318 0.6981056  0.053456  0.9574
## 
## Theta values: 1
## 
## 
##  Correlation: 
##              fY1:1_ fY2:1_ fY3:1_ fY4:1_ fY1:2_ fY2:2_ fY3:2_ fY4:2_ fY1:3_
## funcY2:p1_ID -0.206                                                        
## funcY3:p1_ID  0.537 -0.185                                                 
## funcY4:p1_ID -0.206  0.293 -0.372                                          
## funcY1:p2_ID  0.177 -0.037  0.095 -0.036                                   
## funcY2:p2_ID -0.037  0.177 -0.033  0.052 -0.206                            
## funcY3:p2_ID  0.095 -0.033  0.177 -0.066  0.537 -0.185                     
## funcY4:p2_ID -0.036  0.052 -0.066  0.177 -0.206  0.293 -0.372              
## funcY1:p3_ID  0.257 -0.053  0.138 -0.053  0.139 -0.029  0.075 -0.029       
## funcY2:p3_ID -0.053  0.257 -0.048  0.075 -0.029  0.139 -0.026  0.041 -0.206
## funcY3:p3_ID  0.138 -0.048  0.257 -0.096  0.075 -0.026  0.139 -0.052  0.537
## funcY4:p3_ID -0.053  0.075 -0.096  0.257 -0.029  0.041 -0.052  0.139 -0.206
## funcY1:p4_ID  0.343 -0.071  0.184 -0.071  0.202 -0.042  0.108 -0.042  0.308
## funcY2:p4_ID -0.071  0.343 -0.064  0.100 -0.042  0.202 -0.037  0.059 -0.063
## funcY3:p4_ID  0.184 -0.064  0.343 -0.128  0.108 -0.037  0.202 -0.075  0.165
## funcY4:p4_ID -0.071  0.100 -0.128  0.343 -0.042  0.059 -0.075  0.202 -0.063
## funcY1:p5_ID  0.160 -0.033  0.086 -0.033  0.232 -0.048  0.124 -0.048  0.333
## funcY2:p5_ID -0.033  0.160 -0.030  0.047 -0.048  0.232 -0.043  0.068 -0.069
## funcY3:p5_ID  0.086 -0.030  0.160 -0.060  0.124 -0.043  0.232 -0.086  0.179
## funcY4:p5_ID -0.033  0.047 -0.060  0.160 -0.048  0.068 -0.086  0.232 -0.068
## funcY1:p6_ID  0.216 -0.044  0.116 -0.044  0.195 -0.040  0.104 -0.040  0.238
## funcY2:p6_ID -0.044  0.216 -0.040  0.063 -0.040  0.195 -0.036  0.057 -0.049
## funcY3:p6_ID  0.116 -0.040  0.216 -0.080  0.104 -0.036  0.195 -0.072  0.128
## funcY4:p6_ID -0.044  0.063 -0.080  0.216 -0.040  0.057 -0.072  0.195 -0.049
## funcY1:AV    -0.584  0.120 -0.313  0.120 -0.480  0.099 -0.258  0.099 -0.598
## funcY2:AV     0.120 -0.584  0.108 -0.171  0.099 -0.480  0.089 -0.141  0.123
## funcY3:AV    -0.313  0.108 -0.584  0.217 -0.258  0.089 -0.480  0.179 -0.321
## funcY4:AV     0.120 -0.171  0.217 -0.584  0.099 -0.141  0.179 -0.480  0.123
##              fY2:3_ fY3:3_ fY4:3_ fY1:4_ fY2:4_ fY3:4_ fY4:4_ fY1:5_ fY2:5_
## funcY2:p1_ID                                                               
## funcY3:p1_ID                                                               
## funcY4:p1_ID                                                               
## funcY1:p2_ID                                                               
## funcY2:p2_ID                                                               
## funcY3:p2_ID                                                               
## funcY4:p2_ID                                                               
## funcY1:p3_ID                                                               
## funcY2:p3_ID                                                               
## funcY3:p3_ID -0.185                                                        
## funcY4:p3_ID  0.293 -0.372                                                 
## funcY1:p4_ID -0.063  0.165 -0.063                                          
## funcY2:p4_ID  0.308 -0.057  0.090 -0.206                                   
## funcY3:p4_ID -0.057  0.308 -0.115  0.537 -0.185                            
## funcY4:p4_ID  0.090 -0.115  0.308 -0.206  0.293 -0.372                     
## funcY1:p5_ID -0.069  0.179 -0.068  0.198 -0.041  0.106 -0.041              
## funcY2:p5_ID  0.333 -0.062  0.097 -0.041  0.198 -0.037  0.058 -0.206       
## funcY3:p5_ID -0.062  0.333 -0.124  0.106 -0.037  0.198 -0.073  0.537 -0.185
## funcY4:p5_ID  0.097 -0.124  0.333 -0.041  0.058 -0.073  0.198 -0.206  0.293
## funcY1:p6_ID -0.049  0.128 -0.049  0.229 -0.047  0.123 -0.047  0.270 -0.056
## funcY2:p6_ID  0.238 -0.044  0.070 -0.047  0.229 -0.042  0.067 -0.056  0.270
## funcY3:p6_ID -0.044  0.238 -0.089  0.123 -0.042  0.229 -0.085  0.145 -0.050
## funcY4:p6_ID  0.070 -0.089  0.238 -0.047  0.067 -0.085  0.229 -0.056  0.079
## funcY1:AV     0.123 -0.321  0.123 -0.617  0.127 -0.331  0.127 -0.576  0.119
## funcY2:AV    -0.598  0.111 -0.175  0.127 -0.617  0.114 -0.180  0.119 -0.576
## funcY3:AV     0.111 -0.598  0.223 -0.331  0.114 -0.617  0.229 -0.309  0.107
## funcY4:AV    -0.175  0.223 -0.598  0.127 -0.180  0.229 -0.617  0.118 -0.168
##              fY3:5_ fY4:5_ fY1:6_ fY2:6_ fY3:6_ fY4:6_ fY1:AV fY2:AV fY3:AV
## funcY2:p1_ID                                                               
## funcY3:p1_ID                                                               
## funcY4:p1_ID                                                               
## funcY1:p2_ID                                                               
## funcY2:p2_ID                                                               
## funcY3:p2_ID                                                               
## funcY4:p2_ID                                                               
## funcY1:p3_ID                                                               
## funcY2:p3_ID                                                               
## funcY3:p3_ID                                                               
## funcY4:p3_ID                                                               
## funcY1:p4_ID                                                               
## funcY2:p4_ID                                                               
## funcY3:p4_ID                                                               
## funcY4:p4_ID                                                               
## funcY1:p5_ID                                                               
## funcY2:p5_ID                                                               
## funcY3:p5_ID                                                               
## funcY4:p5_ID -0.372                                                        
## funcY1:p6_ID  0.145 -0.056                                                 
## funcY2:p6_ID -0.050  0.079 -0.206                                          
## funcY3:p6_ID  0.270 -0.101  0.537 -0.185                                   
## funcY4:p6_ID -0.101  0.270 -0.206  0.293 -0.372                            
## funcY1:AV    -0.309  0.118 -0.552  0.114 -0.296  0.114                     
## funcY2:AV     0.107 -0.168  0.114 -0.552  0.102 -0.162 -0.206              
## funcY3:AV    -0.576  0.214 -0.296  0.102 -0.552  0.205  0.537 -0.185       
## funcY4:AV     0.214 -0.576  0.114 -0.162  0.205 -0.552 -0.206  0.293 -0.372
## 
## Standardized residuals:
##         Min          Q1         Med          Q3         Max 
## -2.96674822 -0.74949345  0.01228048  0.71184577  3.93332670 
## 
## Residual standard error: 2.67575 
## Degrees of freedom: 1536 total; 1508 residual
training-deepDive-multivariate-fitting_fg.knit

For this model structure, just like for the univariate version seen in the Starter Pack, we assume that species within the same functional group interact with one another in one way and with species from a different functional group in another way. As this data was simulated, any groupings that we apply are arbitrary. For the sake of this example, we assume that there are three functional groups (\(G=3\)). An example of this model is as follows:


\[\large y_{km}=\sum_{i=1}^{S=6} \beta_{ik} p_{im} + \sum_{q=1}^{G=3} \omega_{qqk} \sum_{\substack{i,j \in FG_q \\ i \lt j}} p_{im} p_{jm} + \sum_{\substack{q,r = 1 \\ q \lt r}}^{G=3} \omega_{qrk} \sum_{i \in FG_q} \sum_{j \in FG_r} p_{im} p_{jm} + \epsilon_{km}\]


Where \(y_{km}\) represents the recorded value, \(y\), of the \(k^{th}\) ecosystem function (where \(k\) goes from \(1\) to \(K=4\)) from the \(m^{th}\) experimental/observational study unit (where \(m\) goes from \(1\) to \(M=384\)). The coefficient \(\beta_{ik}\) scaled by the initial proportion \(p\) of species \(i\) forms the ID effect of said species for the ecosystem function response \(k\). The interactions are split into two sums: the within group interactions \(\omega_{qq}\) and the between group interactions \(\omega_{qr}\), where \(q\) and \(r\) index the set of functional groups, which is of size \(G\). The error of this model, \(\epsilon\) is assumed to follow a multivariate Normal distribution with mean 0 and variance \(\Sigma^{*}\), where \(\Sigma^{*}\) is a \(KM \times KM\) block-diagonal matrix.


\[\Sigma^{*} = \begin{bmatrix} \Sigma_1 & & 0\\ & \ddots & \\ 0 & & \Sigma_M \end{bmatrix}\]


Each matrix along the main diagonal, \(\Sigma_{m}\) represents the variance-covariance matrix of the ecosystem functions. There are a few different forms that this may take (these are called auto-correlation structures). The unstructured or general structure (UN), where each element is allowed to differ from one another, can be seen below.

\[\Sigma_m = \begin{bmatrix} \sigma_1^2 & \sigma_{1,2} & ... & \sigma_{1,K}\\ \sigma_{1,2} & \sigma_{2}^2 & ... & \sigma_{2,K}\\ \vdots & \vdots & \ddots & \vdots \\ \sigma_{1,K} & \sigma_{2, K} & ... & \sigma_K^2 \end{bmatrix}\]
FGModel <- DImulti(y = c("Y1", "Y2", "Y3", "Y4"), eco_func = c("NA", "UN"), unit_IDs = "plot", 
                   prop = 2:7, FG = c("Group1", "Group1", "Group2", "Group2", "Group3", "Group3"), 
                   data = simMV, DImodel = "FG", method = "ML")


And just like with the univariate models, we can use summary() to look at our model output.

summary(FGModel)
## Generalized least squares fit by maximum likelihood
##   Model: value ~ 0 + func:((p1_ID + p2_ID + p3_ID + p4_ID + p5_ID + p6_ID +      FG.bfg_Group1_Group2 + FG.bfg_Group1_Group3 + FG.bfg_Group2_Group3 +      FG.wfg_Group1 + FG.wfg_Group2 + FG.wfg_Group3)) 
##   Data: data 
##        AIC     BIC    logLik
##   6222.267 6531.81 -3053.134
## 
## Correlation Structure: General
##  Formula: ~0 | plot 
##  Parameter estimate(s):
##  Correlation: 
##   1      2      3     
## 2 -0.202              
## 3  0.536 -0.183       
## 4 -0.206  0.296 -0.372
## Variance function:
##  Structure: Different standard deviations per stratum
##  Formula: ~0 | func 
##  Parameter estimates:
##        Y1        Y2        Y3        Y4 
## 1.0000000 0.4266866 1.2116048 0.4991521 
## 
## Coefficients:
##                                 Value Std.Error   t-value p-value
## funcY1:p1_ID                 7.992819  0.890204  8.978641  0.0000
## funcY2:p1_ID                 5.085346  0.379838 13.388197  0.0000
## funcY3:p1_ID                 1.363545  1.078575  1.264210  0.2064
## funcY4:p1_ID                 4.053753  0.444347  9.122944  0.0000
## funcY1:p2_ID                 1.545941  0.821527  1.881789  0.0601
## funcY2:p2_ID                 4.168618  0.350535 11.892168  0.0000
## funcY3:p2_ID                 7.060572  0.995367  7.093439  0.0000
## funcY4:p2_ID                 4.762916  0.410067 11.614965  0.0000
## funcY1:p3_ID                 9.031734  0.965424  9.355196  0.0000
## funcY2:p3_ID                 3.947654  0.411934  9.583227  0.0000
## funcY3:p3_ID                 4.479136  1.169713  3.829262  0.0001
## funcY4:p3_ID                -1.406982  0.481894 -2.919695  0.0036
## funcY1:p4_ID                 4.584075  0.902911  5.076994  0.0000
## funcY2:p4_ID                 1.589117  0.385260  4.124790  0.0000
## funcY3:p4_ID                 8.958681  1.093972  8.189135  0.0000
## funcY4:p4_ID                 4.643141  0.450690 10.302295  0.0000
## funcY1:p5_ID                 0.634622  0.927548  0.684193  0.4940
## funcY2:p5_ID                 4.476741  0.395772 11.311401  0.0000
## funcY3:p5_ID                 4.389107  1.123822  3.905518  0.0001
## funcY4:p5_ID                 6.906495  0.462988 14.917230  0.0000
## funcY1:p6_ID                 5.988960  0.884628  6.770035  0.0000
## funcY2:p6_ID                 7.081841  0.377459 18.761894  0.0000
## funcY3:p6_ID                 9.367027  1.071819  8.739373  0.0000
## funcY4:p6_ID                -0.437929  0.441564 -0.991769  0.3215
## funcY1:FG.bfg_Group1_Group2  1.032893  2.427914  0.425424  0.6706
## funcY2:FG.bfg_Group1_Group2  7.923528  1.035958  7.648499  0.0000
## funcY3:FG.bfg_Group1_Group2  1.157819  2.941673  0.393592  0.6939
## funcY4:FG.bfg_Group1_Group2  1.276266  1.211899  1.053113  0.2925
## funcY1:FG.bfg_Group1_Group3  3.762233  2.302195  1.634194  0.1024
## funcY2:FG.bfg_Group1_Group3  6.255091  0.982316  6.367699  0.0000
## funcY3:FG.bfg_Group1_Group3  3.347273  2.789350  1.200019  0.2303
## funcY4:FG.bfg_Group1_Group3 -0.243009  1.149145 -0.211469  0.8325
## funcY1:FG.bfg_Group2_Group3  1.427127  2.380346  0.599546  0.5489
## funcY2:FG.bfg_Group2_Group3  8.144461  1.015662  8.018873  0.0000
## funcY3:FG.bfg_Group2_Group3  1.279361  2.884038  0.443601  0.6574
## funcY4:FG.bfg_Group2_Group3  0.685328  1.188155  0.576800  0.5642
## funcY1:FG.wfg_Group1         3.089278  4.010567  0.770284  0.4413
## funcY2:FG.wfg_Group1         7.496579  1.711255  4.380748  0.0000
## funcY3:FG.wfg_Group1         4.322584  4.859223  0.889563  0.3738
## funcY4:FG.wfg_Group1         0.181384  2.001883  0.090606  0.9278
## funcY1:FG.wfg_Group2         3.412384  4.682283  0.728786  0.4662
## funcY2:FG.wfg_Group2         6.935258  1.997867  3.471330  0.0005
## funcY3:FG.wfg_Group2         5.292150  5.673077  0.932853  0.3510
## funcY4:FG.wfg_Group2        -1.604856  2.337172 -0.686666  0.4924
## funcY1:FG.wfg_Group3         0.467632  4.314054  0.108397  0.9137
## funcY2:FG.wfg_Group3         9.522764  1.840749  5.173309  0.0000
## funcY3:FG.wfg_Group3         1.505676  5.226929  0.288061  0.7733
## funcY4:FG.wfg_Group3        -2.638599  2.153369 -1.225335  0.2206
## 
## Theta values: 1
## 
## 
##  Correlation: 
##                             fY1:1_ fY2:1_ fY3:1_ fY4:1_ fY1:2_ fY2:2_ fY3:2_
## funcY2:p1_ID                -0.202                                          
## funcY3:p1_ID                 0.536 -0.183                                   
## funcY4:p1_ID                -0.206  0.296 -0.372                            
## funcY1:p2_ID                 0.414 -0.084  0.222 -0.085                     
## funcY2:p2_ID                -0.084  0.414 -0.076  0.123 -0.202              
## funcY3:p2_ID                 0.222 -0.076  0.414 -0.154  0.536 -0.183       
## funcY4:p2_ID                -0.085  0.123 -0.154  0.414 -0.206  0.296 -0.372
## funcY1:p3_ID                -0.023  0.005 -0.012  0.005 -0.022  0.004 -0.012
## funcY2:p3_ID                 0.005 -0.023  0.004 -0.007  0.004 -0.022  0.004
## funcY3:p3_ID                -0.012  0.004 -0.023  0.009 -0.012  0.004 -0.022
## funcY4:p3_ID                 0.005 -0.007  0.009 -0.023  0.005 -0.007  0.008
## funcY1:p4_ID                -0.015  0.003 -0.008  0.003 -0.032  0.006 -0.017
## funcY2:p4_ID                 0.003 -0.015  0.003 -0.004  0.006 -0.032  0.006
## funcY3:p4_ID                -0.008  0.003 -0.015  0.006 -0.017  0.006 -0.032
## funcY4:p4_ID                 0.003 -0.004  0.006 -0.015  0.007 -0.010  0.012
## funcY1:p5_ID                -0.076  0.015 -0.041  0.016 -0.008  0.002 -0.004
## funcY2:p5_ID                 0.015 -0.076  0.014 -0.023  0.002 -0.008  0.001
## funcY3:p5_ID                -0.041  0.014 -0.076  0.028 -0.004  0.001 -0.008
## funcY4:p5_ID                 0.016 -0.023  0.028 -0.076  0.002 -0.002  0.003
## funcY1:p6_ID                -0.019  0.004 -0.010  0.004 -0.013  0.003 -0.007
## funcY2:p6_ID                 0.004 -0.019  0.003 -0.006  0.003 -0.013  0.002
## funcY3:p6_ID                -0.010  0.003 -0.019  0.007 -0.007  0.002 -0.013
## funcY4:p6_ID                 0.004 -0.006  0.007 -0.019  0.003 -0.004  0.005
## funcY1:FG.bfg_Group1_Group2 -0.322  0.065 -0.173  0.066 -0.353  0.071 -0.189
## funcY2:FG.bfg_Group1_Group2  0.065 -0.322  0.059 -0.095  0.071 -0.353  0.065
## funcY3:FG.bfg_Group1_Group2 -0.173  0.059 -0.322  0.120 -0.189  0.065 -0.353
## funcY4:FG.bfg_Group1_Group2  0.066 -0.095  0.120 -0.322  0.073 -0.105  0.131
## funcY1:FG.bfg_Group1_Group3 -0.517  0.104 -0.277  0.106 -0.349  0.070 -0.187
## funcY2:FG.bfg_Group1_Group3  0.104 -0.517  0.095 -0.153  0.070 -0.349  0.064
## funcY3:FG.bfg_Group1_Group3 -0.277  0.095 -0.517  0.192 -0.187  0.064 -0.349
## funcY4:FG.bfg_Group1_Group3  0.106 -0.153  0.192 -0.517  0.072 -0.103  0.130
## funcY1:FG.bfg_Group2_Group3  0.092 -0.019  0.049 -0.019  0.039 -0.008  0.021
## funcY2:FG.bfg_Group2_Group3 -0.019  0.092 -0.017  0.027 -0.008  0.039 -0.007
## funcY3:FG.bfg_Group2_Group3  0.049 -0.017  0.092 -0.034  0.021 -0.007  0.039
## funcY4:FG.bfg_Group2_Group3 -0.019  0.027 -0.034  0.092 -0.008  0.012 -0.015
## funcY1:FG.wfg_Group1        -0.532  0.107 -0.285  0.109 -0.506  0.102 -0.271
## funcY2:FG.wfg_Group1         0.107 -0.532  0.097 -0.157  0.102 -0.506  0.093
## funcY3:FG.wfg_Group1        -0.285  0.097 -0.532  0.198 -0.271  0.093 -0.506
## funcY4:FG.wfg_Group1         0.109 -0.157  0.198 -0.532  0.104 -0.150  0.188
## funcY1:FG.wfg_Group2        -0.001  0.000  0.000  0.000  0.061 -0.012  0.033
## funcY2:FG.wfg_Group2         0.000 -0.001  0.000  0.000 -0.012  0.061 -0.011
## funcY3:FG.wfg_Group2         0.000  0.000 -0.001  0.000  0.033 -0.011  0.061
## funcY4:FG.wfg_Group2         0.000  0.000  0.000 -0.001 -0.013  0.018 -0.023
## funcY1:FG.wfg_Group3         0.114 -0.023  0.061 -0.024  0.018 -0.004  0.009
## funcY2:FG.wfg_Group3        -0.023  0.114 -0.021  0.034 -0.004  0.018 -0.003
## funcY3:FG.wfg_Group3         0.061 -0.021  0.114 -0.042  0.009 -0.003  0.018
## funcY4:FG.wfg_Group3        -0.024  0.034 -0.042  0.114 -0.004  0.005 -0.007
##                             fY4:2_ fY1:3_ fY2:3_ fY3:3_ fY4:3_ fY1:4_ fY2:4_
## funcY2:p1_ID                                                                
## funcY3:p1_ID                                                                
## funcY4:p1_ID                                                                
## funcY1:p2_ID                                                                
## funcY2:p2_ID                                                                
## funcY3:p2_ID                                                                
## funcY4:p2_ID                                                                
## funcY1:p3_ID                 0.005                                          
## funcY2:p3_ID                -0.007 -0.202                                   
## funcY3:p3_ID                 0.008  0.536 -0.183                            
## funcY4:p3_ID                -0.022 -0.206  0.296 -0.372                     
## funcY1:p4_ID                 0.007  0.574 -0.116  0.307 -0.118              
## funcY2:p4_ID                -0.010 -0.116  0.574 -0.105  0.170 -0.202       
## funcY3:p4_ID                 0.012  0.307 -0.105  0.574 -0.213  0.536 -0.183
## funcY4:p4_ID                -0.032 -0.118  0.170 -0.213  0.574 -0.206  0.296
## funcY1:p5_ID                 0.002  0.036 -0.007  0.019 -0.007 -0.020  0.004
## funcY2:p5_ID                -0.002 -0.007  0.036 -0.007  0.011  0.004 -0.020
## funcY3:p5_ID                 0.003  0.019 -0.007  0.036 -0.014 -0.011  0.004
## funcY4:p5_ID                -0.008 -0.007  0.011 -0.014  0.036  0.004 -0.006
## funcY1:p6_ID                 0.003 -0.086  0.017 -0.046  0.018 -0.059  0.012
## funcY2:p6_ID                -0.004  0.017 -0.086  0.016 -0.025  0.012 -0.059
## funcY3:p6_ID                 0.005 -0.046  0.016 -0.086  0.032 -0.032  0.011
## funcY4:p6_ID                -0.013  0.018 -0.025  0.032 -0.086  0.012 -0.018
## funcY1:FG.bfg_Group1_Group2  0.073 -0.602  0.122 -0.323  0.124 -0.527  0.106
## funcY2:FG.bfg_Group1_Group2 -0.105  0.122 -0.602  0.110 -0.178  0.106 -0.527
## funcY3:FG.bfg_Group1_Group2  0.131 -0.323  0.110 -0.602  0.224 -0.282  0.097
## funcY4:FG.bfg_Group1_Group2 -0.353  0.124 -0.178  0.224 -0.602  0.109 -0.156
## funcY1:FG.bfg_Group1_Group3  0.072  0.103 -0.021  0.055 -0.021  0.090 -0.018
## funcY2:FG.bfg_Group1_Group3 -0.103 -0.021  0.103 -0.019  0.031 -0.018  0.090
## funcY3:FG.bfg_Group1_Group3  0.130  0.055 -0.019  0.103 -0.038  0.048 -0.017
## funcY4:FG.bfg_Group1_Group3 -0.349 -0.021  0.031 -0.038  0.103 -0.019  0.027
## funcY1:FG.bfg_Group2_Group3 -0.008 -0.495  0.100 -0.265  0.102 -0.564  0.114
## funcY2:FG.bfg_Group2_Group3  0.012  0.100 -0.495  0.091 -0.146  0.114 -0.564
## funcY3:FG.bfg_Group2_Group3 -0.015 -0.265  0.091 -0.495  0.184 -0.302  0.103
## funcY4:FG.bfg_Group2_Group3  0.039  0.102 -0.146  0.184 -0.495  0.116 -0.167
## funcY1:FG.wfg_Group1         0.104  0.015 -0.003  0.008 -0.003  0.050 -0.010
## funcY2:FG.wfg_Group1        -0.150 -0.003  0.015 -0.003  0.005 -0.010  0.050
## funcY3:FG.wfg_Group1         0.188  0.008 -0.003  0.015 -0.006  0.027 -0.009
## funcY4:FG.wfg_Group1        -0.506 -0.003  0.005 -0.006  0.015 -0.010  0.015
## funcY1:FG.wfg_Group2        -0.013 -0.313  0.063 -0.168  0.064 -0.393  0.079
## funcY2:FG.wfg_Group2         0.018  0.063 -0.313  0.057 -0.093  0.079 -0.393
## funcY3:FG.wfg_Group2        -0.023 -0.168  0.057 -0.313  0.116 -0.211  0.072
## funcY4:FG.wfg_Group2         0.061  0.064 -0.093  0.116 -0.313  0.081 -0.116
## funcY1:FG.wfg_Group3        -0.004  0.053 -0.011  0.028 -0.011  0.075 -0.015
## funcY2:FG.wfg_Group3         0.005 -0.011  0.053 -0.010  0.016 -0.015  0.075
## funcY3:FG.wfg_Group3        -0.007  0.028 -0.010  0.053 -0.020  0.040 -0.014
## funcY4:FG.wfg_Group3         0.018 -0.011  0.016 -0.020  0.053 -0.015  0.022
##                             fY3:4_ fY4:4_ fY1:5_ fY2:5_ fY3:5_ fY4:5_ fY1:6_
## funcY2:p1_ID                                                                
## funcY3:p1_ID                                                                
## funcY4:p1_ID                                                                
## funcY1:p2_ID                                                                
## funcY2:p2_ID                                                                
## funcY3:p2_ID                                                                
## funcY4:p2_ID                                                                
## funcY1:p3_ID                                                                
## funcY2:p3_ID                                                                
## funcY3:p3_ID                                                                
## funcY4:p3_ID                                                                
## funcY1:p4_ID                                                                
## funcY2:p4_ID                                                                
## funcY3:p4_ID                                                                
## funcY4:p4_ID                -0.372                                          
## funcY1:p5_ID                -0.011  0.004                                   
## funcY2:p5_ID                 0.004 -0.006 -0.202                            
## funcY3:p5_ID                -0.020  0.008  0.536 -0.183                     
## funcY4:p5_ID                 0.008 -0.020 -0.206  0.296 -0.372              
## funcY1:p6_ID                -0.032  0.012  0.546 -0.110  0.292 -0.112       
## funcY2:p6_ID                 0.011 -0.018 -0.110  0.546 -0.100  0.161 -0.202
## funcY3:p6_ID                -0.059  0.022  0.292 -0.100  0.546 -0.203  0.536
## funcY4:p6_ID                 0.022 -0.059 -0.112  0.161 -0.203  0.546 -0.206
## funcY1:FG.bfg_Group1_Group2 -0.282  0.109  0.027 -0.005  0.015 -0.006  0.131
## funcY2:FG.bfg_Group1_Group2  0.097 -0.156 -0.005  0.027 -0.005  0.008 -0.027
## funcY3:FG.bfg_Group1_Group2 -0.527  0.196  0.015 -0.005  0.027 -0.010  0.070
## funcY4:FG.bfg_Group1_Group2  0.196 -0.527 -0.006  0.008 -0.010  0.027 -0.027
## funcY1:FG.bfg_Group1_Group3  0.048 -0.019 -0.494  0.100 -0.265  0.102 -0.496
## funcY2:FG.bfg_Group1_Group3 -0.017  0.027  0.100 -0.494  0.091 -0.146  0.100
## funcY3:FG.bfg_Group1_Group3  0.090 -0.034 -0.265  0.091 -0.494  0.184 -0.266
## funcY4:FG.bfg_Group1_Group3 -0.034  0.090  0.102 -0.146  0.184 -0.494  0.102
## funcY1:FG.bfg_Group2_Group3 -0.302  0.116 -0.489  0.099 -0.262  0.101 -0.465
## funcY2:FG.bfg_Group2_Group3  0.103 -0.167  0.099 -0.489  0.090 -0.145  0.094
## funcY3:FG.bfg_Group2_Group3 -0.564  0.210 -0.262  0.090 -0.489  0.182 -0.249
## funcY4:FG.bfg_Group2_Group3  0.210 -0.564  0.101 -0.145  0.182 -0.489  0.096
## funcY1:FG.wfg_Group1         0.027 -0.010  0.102 -0.021  0.055 -0.021  0.007
## funcY2:FG.wfg_Group1        -0.009  0.015 -0.021  0.102 -0.019  0.030 -0.001
## funcY3:FG.wfg_Group1         0.050 -0.019  0.055 -0.019  0.102 -0.038  0.004
## funcY4:FG.wfg_Group1        -0.019  0.050 -0.021  0.030 -0.038  0.102 -0.001
## funcY1:FG.wfg_Group2        -0.211  0.081  0.052 -0.010  0.028 -0.011  0.068
## funcY2:FG.wfg_Group2         0.072 -0.116 -0.010  0.052 -0.010  0.015 -0.014
## funcY3:FG.wfg_Group2        -0.393  0.146  0.028 -0.010  0.052 -0.019  0.037
## funcY4:FG.wfg_Group2         0.146 -0.393 -0.011  0.015 -0.019  0.052 -0.014
## funcY1:FG.wfg_Group3         0.040 -0.015 -0.492  0.099 -0.263  0.101 -0.505
## funcY2:FG.wfg_Group3        -0.014  0.022  0.099 -0.492  0.090 -0.146  0.102
## funcY3:FG.wfg_Group3         0.075 -0.028 -0.263  0.090 -0.492  0.183 -0.271
## funcY4:FG.wfg_Group3        -0.028  0.075  0.101 -0.146  0.183 -0.492  0.104
##                             fY2:6_ fY3:6_ fY4:6_ fY1:FG._G1_G2 fY2:FG._G1_G2
## funcY2:p1_ID                                                                
## funcY3:p1_ID                                                                
## funcY4:p1_ID                                                                
## funcY1:p2_ID                                                                
## funcY2:p2_ID                                                                
## funcY3:p2_ID                                                                
## funcY4:p2_ID                                                                
## funcY1:p3_ID                                                                
## funcY2:p3_ID                                                                
## funcY3:p3_ID                                                                
## funcY4:p3_ID                                                                
## funcY1:p4_ID                                                                
## funcY2:p4_ID                                                                
## funcY3:p4_ID                                                                
## funcY4:p4_ID                                                                
## funcY1:p5_ID                                                                
## funcY2:p5_ID                                                                
## funcY3:p5_ID                                                                
## funcY4:p5_ID                                                                
## funcY1:p6_ID                                                                
## funcY2:p6_ID                                                                
## funcY3:p6_ID                -0.183                                          
## funcY4:p6_ID                 0.296 -0.372                                   
## funcY1:FG.bfg_Group1_Group2 -0.027  0.070 -0.027                            
## funcY2:FG.bfg_Group1_Group2  0.131 -0.024  0.039 -0.202                     
## funcY3:FG.bfg_Group1_Group2 -0.024  0.131 -0.049  0.536        -0.183       
## funcY4:FG.bfg_Group1_Group2  0.039 -0.049  0.131 -0.206         0.296       
## funcY1:FG.bfg_Group1_Group3  0.100 -0.266  0.102  0.064        -0.013       
## funcY2:FG.bfg_Group1_Group3 -0.496  0.091 -0.147 -0.013         0.064       
## funcY3:FG.bfg_Group1_Group3  0.091 -0.496  0.185  0.034        -0.012       
## funcY4:FG.bfg_Group1_Group3 -0.147  0.185 -0.496 -0.013         0.019       
## funcY1:FG.bfg_Group2_Group3  0.094 -0.249  0.096  0.273        -0.055       
## funcY2:FG.bfg_Group2_Group3 -0.465  0.085 -0.138 -0.055         0.273       
## funcY3:FG.bfg_Group2_Group3  0.085 -0.465  0.173  0.146        -0.050       
## funcY4:FG.bfg_Group2_Group3 -0.138  0.173 -0.465 -0.056         0.081       
## funcY1:FG.wfg_Group1        -0.001  0.004 -0.001  0.119        -0.024       
## funcY2:FG.wfg_Group1         0.007 -0.001  0.002 -0.024         0.119       
## funcY3:FG.wfg_Group1        -0.001  0.007 -0.003  0.064        -0.022       
## funcY4:FG.wfg_Group1         0.002 -0.003  0.007 -0.024         0.035       
## funcY1:FG.wfg_Group2        -0.014  0.037 -0.014 -0.054         0.011       
## funcY2:FG.wfg_Group2         0.068 -0.013  0.020  0.011        -0.054       
## funcY3:FG.wfg_Group2        -0.013  0.068 -0.025 -0.029         0.010       
## funcY4:FG.wfg_Group2         0.020 -0.025  0.068  0.011        -0.016       
## funcY1:FG.wfg_Group3         0.102 -0.271  0.104 -0.101         0.020       
## funcY2:FG.wfg_Group3        -0.505  0.093 -0.150  0.020        -0.101       
## funcY3:FG.wfg_Group3         0.093 -0.505  0.188 -0.054         0.019       
## funcY4:FG.wfg_Group3        -0.150  0.188 -0.505  0.021        -0.030       
##                             fY3:FG._G1_G2 fY4:FG._G1_G2 fY1:FG._G1_G3
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FG.bfg_Group1_Group2                                          
## funcY2:FG.bfg_Group1_Group2                                          
## funcY3:FG.bfg_Group1_Group2                                          
## funcY4:FG.bfg_Group1_Group2 -0.372                                   
## funcY1:FG.bfg_Group1_Group3  0.034        -0.013                     
## funcY2:FG.bfg_Group1_Group3 -0.012         0.019        -0.202       
## funcY3:FG.bfg_Group1_Group3  0.064        -0.024         0.536       
## funcY4:FG.bfg_Group1_Group3 -0.024         0.064        -0.206       
## funcY1:FG.bfg_Group2_Group3  0.146        -0.056         0.171       
## funcY2:FG.bfg_Group2_Group3 -0.050         0.081        -0.034       
## funcY3:FG.bfg_Group2_Group3  0.273        -0.102         0.091       
## funcY4:FG.bfg_Group2_Group3 -0.102         0.273        -0.035       
## funcY1:FG.wfg_Group1         0.064        -0.024         0.163       
## funcY2:FG.wfg_Group1        -0.022         0.035        -0.033       
## funcY3:FG.wfg_Group1         0.119        -0.044         0.087       
## funcY4:FG.wfg_Group1        -0.044         0.119        -0.033       
## funcY1:FG.wfg_Group2        -0.029         0.011        -0.047       
## funcY2:FG.wfg_Group2         0.010        -0.016         0.009       
## funcY3:FG.wfg_Group2        -0.054         0.020        -0.025       
## funcY4:FG.wfg_Group2         0.020        -0.054         0.010       
## funcY1:FG.wfg_Group3        -0.054         0.021         0.135       
## funcY2:FG.wfg_Group3         0.019        -0.030        -0.027       
## funcY3:FG.wfg_Group3        -0.101         0.038         0.072       
## funcY4:FG.wfg_Group3         0.038        -0.101        -0.028       
##                             fY2:FG._G1_G3 fY3:FG._G1_G3 fY4:FG._G1_G3
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FG.bfg_Group1_Group2                                          
## funcY2:FG.bfg_Group1_Group2                                          
## funcY3:FG.bfg_Group1_Group2                                          
## funcY4:FG.bfg_Group1_Group2                                          
## funcY1:FG.bfg_Group1_Group3                                          
## funcY2:FG.bfg_Group1_Group3                                          
## funcY3:FG.bfg_Group1_Group3 -0.183                                   
## funcY4:FG.bfg_Group1_Group3  0.296        -0.372                     
## funcY1:FG.bfg_Group2_Group3 -0.034         0.091        -0.035       
## funcY2:FG.bfg_Group2_Group3  0.171        -0.031         0.050       
## funcY3:FG.bfg_Group2_Group3 -0.031         0.171        -0.063       
## funcY4:FG.bfg_Group2_Group3  0.050        -0.063         0.171       
## funcY1:FG.wfg_Group1        -0.033         0.087        -0.033       
## funcY2:FG.wfg_Group1         0.163        -0.030         0.048       
## funcY3:FG.wfg_Group1        -0.030         0.163        -0.060       
## funcY4:FG.wfg_Group1         0.048        -0.060         0.163       
## funcY1:FG.wfg_Group2         0.009        -0.025         0.010       
## funcY2:FG.wfg_Group2        -0.047         0.009        -0.014       
## funcY3:FG.wfg_Group2         0.009        -0.047         0.017       
## funcY4:FG.wfg_Group2        -0.014         0.017        -0.047       
## funcY1:FG.wfg_Group3        -0.027         0.072        -0.028       
## funcY2:FG.wfg_Group3         0.135        -0.025         0.040       
## funcY3:FG.wfg_Group3        -0.025         0.135        -0.050       
## funcY4:FG.wfg_Group3         0.040        -0.050         0.135       
##                             fY1:FG._G2_ fY2:FG._G2_ fY3:FG._G2_ fY4:FG._G2_
## funcY2:p1_ID                                                               
## funcY3:p1_ID                                                               
## funcY4:p1_ID                                                               
## funcY1:p2_ID                                                               
## funcY2:p2_ID                                                               
## funcY3:p2_ID                                                               
## funcY4:p2_ID                                                               
## funcY1:p3_ID                                                               
## funcY2:p3_ID                                                               
## funcY3:p3_ID                                                               
## funcY4:p3_ID                                                               
## funcY1:p4_ID                                                               
## funcY2:p4_ID                                                               
## funcY3:p4_ID                                                               
## funcY4:p4_ID                                                               
## funcY1:p5_ID                                                               
## funcY2:p5_ID                                                               
## funcY3:p5_ID                                                               
## funcY4:p5_ID                                                               
## funcY1:p6_ID                                                               
## funcY2:p6_ID                                                               
## funcY3:p6_ID                                                               
## funcY4:p6_ID                                                               
## funcY1:FG.bfg_Group1_Group2                                                
## funcY2:FG.bfg_Group1_Group2                                                
## funcY3:FG.bfg_Group1_Group2                                                
## funcY4:FG.bfg_Group1_Group2                                                
## funcY1:FG.bfg_Group1_Group3                                                
## funcY2:FG.bfg_Group1_Group3                                                
## funcY3:FG.bfg_Group1_Group3                                                
## funcY4:FG.bfg_Group1_Group3                                                
## funcY1:FG.bfg_Group2_Group3                                                
## funcY2:FG.bfg_Group2_Group3 -0.202                                         
## funcY3:FG.bfg_Group2_Group3  0.536      -0.183                             
## funcY4:FG.bfg_Group2_Group3 -0.206       0.296      -0.372                 
## funcY1:FG.wfg_Group1        -0.062       0.013      -0.033       0.013     
## funcY2:FG.wfg_Group1         0.013      -0.062       0.011      -0.018     
## funcY3:FG.wfg_Group1        -0.033       0.011      -0.062       0.023     
## funcY4:FG.wfg_Group1         0.013      -0.018       0.023      -0.062     
## funcY1:FG.wfg_Group2         0.132      -0.027       0.070      -0.027     
## funcY2:FG.wfg_Group2        -0.027       0.132      -0.024       0.039     
## funcY3:FG.wfg_Group2         0.070      -0.024       0.132      -0.049     
## funcY4:FG.wfg_Group2        -0.027       0.039      -0.049       0.132     
## funcY1:FG.wfg_Group3         0.196      -0.040       0.105      -0.040     
## funcY2:FG.wfg_Group3        -0.040       0.196      -0.036       0.058     
## funcY3:FG.wfg_Group3         0.105      -0.036       0.196      -0.073     
## funcY4:FG.wfg_Group3        -0.040       0.058      -0.073       0.196     
##                             fnY1:FG._G1 fnY2:FG._G1 fnY3:FG._G1 fnY4:FG._G1
## funcY2:p1_ID                                                               
## funcY3:p1_ID                                                               
## funcY4:p1_ID                                                               
## funcY1:p2_ID                                                               
## funcY2:p2_ID                                                               
## funcY3:p2_ID                                                               
## funcY4:p2_ID                                                               
## funcY1:p3_ID                                                               
## funcY2:p3_ID                                                               
## funcY3:p3_ID                                                               
## funcY4:p3_ID                                                               
## funcY1:p4_ID                                                               
## funcY2:p4_ID                                                               
## funcY3:p4_ID                                                               
## funcY4:p4_ID                                                               
## funcY1:p5_ID                                                               
## funcY2:p5_ID                                                               
## funcY3:p5_ID                                                               
## funcY4:p5_ID                                                               
## funcY1:p6_ID                                                               
## funcY2:p6_ID                                                               
## funcY3:p6_ID                                                               
## funcY4:p6_ID                                                               
## funcY1:FG.bfg_Group1_Group2                                                
## funcY2:FG.bfg_Group1_Group2                                                
## funcY3:FG.bfg_Group1_Group2                                                
## funcY4:FG.bfg_Group1_Group2                                                
## funcY1:FG.bfg_Group1_Group3                                                
## funcY2:FG.bfg_Group1_Group3                                                
## funcY3:FG.bfg_Group1_Group3                                                
## funcY4:FG.bfg_Group1_Group3                                                
## funcY1:FG.bfg_Group2_Group3                                                
## funcY2:FG.bfg_Group2_Group3                                                
## funcY3:FG.bfg_Group2_Group3                                                
## funcY4:FG.bfg_Group2_Group3                                                
## funcY1:FG.wfg_Group1                                                       
## funcY2:FG.wfg_Group1        -0.202                                         
## funcY3:FG.wfg_Group1         0.536      -0.183                             
## funcY4:FG.wfg_Group1        -0.206       0.296      -0.372                 
## funcY1:FG.wfg_Group2         0.044      -0.009       0.023      -0.009     
## funcY2:FG.wfg_Group2        -0.009       0.044      -0.008       0.013     
## funcY3:FG.wfg_Group2         0.023      -0.008       0.044      -0.016     
## funcY4:FG.wfg_Group2        -0.009       0.013      -0.016       0.044     
## funcY1:FG.wfg_Group3        -0.017       0.003      -0.009       0.003     
## funcY2:FG.wfg_Group3         0.003      -0.017       0.003      -0.005     
## funcY3:FG.wfg_Group3        -0.009       0.003      -0.017       0.006     
## funcY4:FG.wfg_Group3         0.003      -0.005       0.006      -0.017     
##                             fnY1:FG._G2 fnY2:FG._G2 fnY3:FG._G2 fnY4:FG._G2
## funcY2:p1_ID                                                               
## funcY3:p1_ID                                                               
## funcY4:p1_ID                                                               
## funcY1:p2_ID                                                               
## funcY2:p2_ID                                                               
## funcY3:p2_ID                                                               
## funcY4:p2_ID                                                               
## funcY1:p3_ID                                                               
## funcY2:p3_ID                                                               
## funcY3:p3_ID                                                               
## funcY4:p3_ID                                                               
## funcY1:p4_ID                                                               
## funcY2:p4_ID                                                               
## funcY3:p4_ID                                                               
## funcY4:p4_ID                                                               
## funcY1:p5_ID                                                               
## funcY2:p5_ID                                                               
## funcY3:p5_ID                                                               
## funcY4:p5_ID                                                               
## funcY1:p6_ID                                                               
## funcY2:p6_ID                                                               
## funcY3:p6_ID                                                               
## funcY4:p6_ID                                                               
## funcY1:FG.bfg_Group1_Group2                                                
## funcY2:FG.bfg_Group1_Group2                                                
## funcY3:FG.bfg_Group1_Group2                                                
## funcY4:FG.bfg_Group1_Group2                                                
## funcY1:FG.bfg_Group1_Group3                                                
## funcY2:FG.bfg_Group1_Group3                                                
## funcY3:FG.bfg_Group1_Group3                                                
## funcY4:FG.bfg_Group1_Group3                                                
## funcY1:FG.bfg_Group2_Group3                                                
## funcY2:FG.bfg_Group2_Group3                                                
## funcY3:FG.bfg_Group2_Group3                                                
## funcY4:FG.bfg_Group2_Group3                                                
## funcY1:FG.wfg_Group1                                                       
## funcY2:FG.wfg_Group1                                                       
## funcY3:FG.wfg_Group1                                                       
## funcY4:FG.wfg_Group1                                                       
## funcY1:FG.wfg_Group2                                                       
## funcY2:FG.wfg_Group2        -0.202                                         
## funcY3:FG.wfg_Group2         0.536      -0.183                             
## funcY4:FG.wfg_Group2        -0.206       0.296      -0.372                 
## funcY1:FG.wfg_Group3        -0.051       0.010      -0.028       0.011     
## funcY2:FG.wfg_Group3         0.010      -0.051       0.009      -0.015     
## funcY3:FG.wfg_Group3        -0.028       0.009      -0.051       0.019     
## funcY4:FG.wfg_Group3         0.011      -0.015       0.019      -0.051     
##                             fY1:FG._G3 fY2:FG._G3 fY3:FG._G3
## funcY2:p1_ID                                                
## funcY3:p1_ID                                                
## funcY4:p1_ID                                                
## funcY1:p2_ID                                                
## funcY2:p2_ID                                                
## funcY3:p2_ID                                                
## funcY4:p2_ID                                                
## funcY1:p3_ID                                                
## funcY2:p3_ID                                                
## funcY3:p3_ID                                                
## funcY4:p3_ID                                                
## funcY1:p4_ID                                                
## funcY2:p4_ID                                                
## funcY3:p4_ID                                                
## funcY4:p4_ID                                                
## funcY1:p5_ID                                                
## funcY2:p5_ID                                                
## funcY3:p5_ID                                                
## funcY4:p5_ID                                                
## funcY1:p6_ID                                                
## funcY2:p6_ID                                                
## funcY3:p6_ID                                                
## funcY4:p6_ID                                                
## funcY1:FG.bfg_Group1_Group2                                 
## funcY2:FG.bfg_Group1_Group2                                 
## funcY3:FG.bfg_Group1_Group2                                 
## funcY4:FG.bfg_Group1_Group2                                 
## funcY1:FG.bfg_Group1_Group3                                 
## funcY2:FG.bfg_Group1_Group3                                 
## funcY3:FG.bfg_Group1_Group3                                 
## funcY4:FG.bfg_Group1_Group3                                 
## funcY1:FG.bfg_Group2_Group3                                 
## funcY2:FG.bfg_Group2_Group3                                 
## funcY3:FG.bfg_Group2_Group3                                 
## funcY4:FG.bfg_Group2_Group3                                 
## funcY1:FG.wfg_Group1                                        
## funcY2:FG.wfg_Group1                                        
## funcY3:FG.wfg_Group1                                        
## funcY4:FG.wfg_Group1                                        
## funcY1:FG.wfg_Group2                                        
## funcY2:FG.wfg_Group2                                        
## funcY3:FG.wfg_Group2                                        
## funcY4:FG.wfg_Group2                                        
## funcY1:FG.wfg_Group3                                        
## funcY2:FG.wfg_Group3        -0.202                          
## funcY3:FG.wfg_Group3         0.536     -0.183               
## funcY4:FG.wfg_Group3        -0.206      0.296     -0.372    
## 
## Standardized residuals:
##          Min           Q1          Med           Q3          Max 
## -2.986415133 -0.733477885  0.001137625  0.715272950  3.961462016 
## 
## Residual standard error: 2.671443 
## Degrees of freedom: 1536 total; 1488 residual
training-deepDive-multivariate-fitting_add.knit

For this model structure, just like for the univariate version seen in the Starter Pack, we assume that each species has a unique interaction which applies additively regardless of what other species are present. An example of this model is as follows:


\[\large y_{km}=\sum_{i=1}^{S=6} \beta_{ik} p_{im} + \sum_{\substack{i,j=1 \\ i < j}}^{S=6} (\lambda_{ik} + \lambda_{jk}) (p_{im} p_{jm}) + \epsilon_{km}\]


Where \(y_{km}\) represents the recorded value, \(y\), of the \(k^{th}\) ecosystem function (where \(k\) goes from \(1\) to \(K=4\)) from the \(m^{th}\) experimental/observational study unit (where \(m\) goes from \(1\) to \(M=384\)). The coefficient \(\beta_{ik}\) scaled by the initial proportion \(p\) of species \(i\) forms the ID effect of said species for the ecosystem function response \(k\). For a species pool of size \(S\), there are \(S\) unique interaction strengths, \(\lambda\), which are added together and scaled by the pairwise product of the species. The error of this model, \(\epsilon\) is assumed to follow a multivariate Normal distribution with mean 0 and variance \(\Sigma^{*}\), where \(\Sigma^{*}\) is a \(KM \times KM\) block-diagonal matrix.


\[\Sigma^{*} = \begin{bmatrix} \Sigma_1 & & 0\\ & \ddots & \\ 0 & & \Sigma_M \end{bmatrix}\]


Each matrix along the main diagonal, \(\Sigma_{m}\) represents the variance-covariance matrix of the ecosystem functions. There are a few different forms that this may take (these are called auto-correlation structures). The unstructured or general structure (UN), where each element is allowed to differ from one another, can be seen below.

\[\Sigma_m = \begin{bmatrix} \sigma_1^2 & \sigma_{1,2} & ... & \sigma_{1,K}\\ \sigma_{1,2} & \sigma_{2}^2 & ... & \sigma_{2,K}\\ \vdots & \vdots & \ddots & \vdots \\ \sigma_{1,K} & \sigma_{2, K} & ... & \sigma_K^2 \end{bmatrix}\]
ADDModel <- DImulti(y = c("Y1", "Y2", "Y3", "Y4"), eco_func = c("NA", "UN"), unit_IDs = "plot", 
                   prop = 2:7, data = simMV, DImodel = "ADD", method = "ML")


And just like with the univariate models, we can use summary() to look at our model output.

summary(ADDModel)
## Generalized least squares fit by maximum likelihood
##   Model: value ~ 0 + func:((p1_ID + p2_ID + p3_ID + p4_ID + p5_ID + p6_ID +      p1_add + p2_add + p3_add + p4_add + p5_add + p6_add)) 
##   Data: data 
##        AIC      BIC    logLik
##   6222.885 6532.427 -3053.442
## 
## Correlation Structure: General
##  Formula: ~0 | plot 
##  Parameter estimate(s):
##  Correlation: 
##   1      2      3     
## 2 -0.205              
## 3  0.537 -0.187       
## 4 -0.209  0.294 -0.374
## Variance function:
##  Structure: Different standard deviations per stratum
##  Formula: ~0 | func 
##  Parameter estimates:
##        Y1        Y2        Y3        Y4 
## 1.0000000 0.4284229 1.2141869 0.5016455 
## 
## Coefficients:
##                   Value Std.Error   t-value p-value
## funcY1:p1_ID   7.504042 1.1714987  6.405507  0.0000
## funcY2:p1_ID   4.785411 0.5018969  9.534651  0.0000
## funcY3:p1_ID   0.705916 1.4224184  0.496279  0.6198
## funcY4:p1_ID   3.796017 0.5876771  6.459358  0.0000
## funcY1:p2_ID   1.820126 0.9190709  1.980398  0.0478
## funcY2:p2_ID   4.326139 0.3937510 10.986993  0.0000
## funcY3:p2_ID   7.454771 1.1159239  6.680358  0.0000
## funcY4:p2_ID   4.915056 0.4610478 10.660621  0.0000
## funcY1:p3_ID   7.820294 1.2223158  6.397932  0.0000
## funcY2:p3_ID   4.272454 0.5236681  8.158706  0.0000
## funcY3:p3_ID   4.342562 1.4841199  2.926018  0.0035
## funcY4:p3_ID  -1.344506 0.6131693 -2.192716  0.0285
## funcY1:p4_ID   5.472921 1.1165211  4.901762  0.0000
## funcY2:p4_ID   1.397791 0.4783432  2.922151  0.0035
## funcY3:p4_ID   8.781677 1.3556653  6.477762  0.0000
## funcY4:p4_ID   4.862936 0.5600978  8.682298  0.0000
## funcY1:p5_ID   0.574370 1.2037836  0.477137  0.6333
## funcY2:p5_ID   4.738782 0.5157285  9.188521  0.0000
## funcY3:p5_ID   4.445736 1.4616184  3.041653  0.0024
## funcY4:p5_ID   6.937515 0.6038727 11.488374  0.0000
## funcY1:p6_ID   6.208577 1.0964889  5.662234  0.0000
## funcY2:p6_ID   6.778827 0.4697609 14.430376  0.0000
## funcY3:p6_ID   9.302407 1.3313425  6.987238  0.0000
## funcY4:p6_ID  -0.380177 0.5500488 -0.691169  0.4896
## funcY1:p1_add  3.068029 2.4203501  1.267597  0.2051
## funcY2:p1_add  3.815608 1.0369334  3.679704  0.0002
## funcY3:p1_add  3.674453 2.9387575  1.250342  0.2114
## funcY4:p1_add  0.874740 1.2141578  0.720450  0.4714
## funcY1:p2_add  0.522408 1.9646863  0.265899  0.7904
## funcY2:p2_add  2.984761 0.8417166  3.546040  0.0004
## funcY3:p2_add  0.471379 2.3854965  0.197602  0.8434
## funcY4:p2_add -0.184168 0.9855761 -0.186863  0.8518
## funcY1:p3_add  3.145243 2.4971567  1.259530  0.2080
## funcY2:p3_add  3.536152 1.0698391  3.305312  0.0010
## funcY3:p3_add  0.701410 3.0320151  0.231335  0.8171
## funcY4:p3_add  0.571434 1.2526875  0.456166  0.6483
## funcY1:p4_add -2.075806 2.3961138 -0.866322  0.3865
## funcY2:p4_add  4.707448 1.0265500  4.585698  0.0000
## funcY3:p4_add  0.970642 2.9093301  0.333631  0.7387
## funcY4:p4_add  0.105007 1.2019998  0.087360  0.9304
## funcY1:p5_add  1.616335 2.4645455  0.655835  0.5120
## funcY2:p5_add  3.039657 1.0558677  2.878824  0.0040
## funcY3:p5_add  0.603248 2.9924190  0.201592  0.8403
## funcY4:p5_add -0.541711 1.2363283 -0.438161  0.6613
## funcY1:p6_add  0.736363 2.2953890  0.320801  0.7484
## funcY2:p6_add  4.625120 0.9833972  4.703207  0.0000
## funcY3:p6_add  1.271286 2.7870314  0.456143  0.6484
## funcY4:p6_add -0.627349 1.1514717 -0.544823  0.5860
## 
## Theta values: 1
## 
## 
##  Correlation: 
##               fY1:1_I fY2:1_I fY3:1_I fY4:1_I fY1:2_I fY2:2_I fY3:2_I fY4:2_I
## funcY2:p1_ID  -0.205                                                         
## funcY3:p1_ID   0.537  -0.187                                                 
## funcY4:p1_ID  -0.209   0.294  -0.374                                         
## funcY1:p2_ID  -0.017   0.004  -0.009   0.004                                 
## funcY2:p2_ID   0.004  -0.017   0.003  -0.005  -0.205                         
## funcY3:p2_ID  -0.009   0.003  -0.017   0.007   0.537  -0.187                 
## funcY4:p2_ID   0.004  -0.005   0.007  -0.017  -0.209   0.294  -0.374         
## funcY1:p3_ID  -0.006   0.001  -0.003   0.001  -0.006   0.001  -0.003   0.001 
## funcY2:p3_ID   0.001  -0.006   0.001  -0.002   0.001  -0.006   0.001  -0.002 
## funcY3:p3_ID  -0.003   0.001  -0.006   0.002  -0.003   0.001  -0.006   0.002 
## funcY4:p3_ID   0.001  -0.002   0.002  -0.006   0.001  -0.002   0.002  -0.006 
## funcY1:p4_ID  -0.041   0.008  -0.022   0.009  -0.017   0.003  -0.009   0.003 
## funcY2:p4_ID   0.008  -0.041   0.008  -0.012   0.003  -0.017   0.003  -0.005 
## funcY3:p4_ID  -0.022   0.008  -0.041   0.015  -0.009   0.003  -0.017   0.006 
## funcY4:p4_ID   0.009  -0.012   0.015  -0.041   0.003  -0.005   0.006  -0.017 
## funcY1:p5_ID  -0.015   0.003  -0.008   0.003  -0.009   0.002  -0.005   0.002 
## funcY2:p5_ID   0.003  -0.015   0.003  -0.004   0.002  -0.009   0.002  -0.003 
## funcY3:p5_ID  -0.008   0.003  -0.015   0.005  -0.005   0.002  -0.009   0.003 
## funcY4:p5_ID   0.003  -0.004   0.005  -0.015   0.002  -0.003   0.003  -0.009 
## funcY1:p6_ID  -0.047   0.010  -0.025   0.010  -0.008   0.002  -0.004   0.002 
## funcY2:p6_ID   0.010  -0.047   0.009  -0.014   0.002  -0.008   0.001  -0.002 
## funcY3:p6_ID  -0.025   0.009  -0.047   0.018  -0.004   0.001  -0.008   0.003 
## funcY4:p6_ID   0.010  -0.014   0.018  -0.047   0.002  -0.002   0.003  -0.008 
## funcY1:p1_add -0.868   0.178  -0.466   0.181   0.018  -0.004   0.010  -0.004 
## funcY2:p1_add  0.178  -0.868   0.163  -0.255  -0.004   0.018  -0.003   0.005 
## funcY3:p1_add -0.466   0.163  -0.868   0.325   0.010  -0.003   0.018  -0.007 
## funcY4:p1_add  0.181  -0.255   0.325  -0.868  -0.004   0.005  -0.007   0.018 
## funcY1:p2_add  0.025  -0.005   0.013  -0.005  -0.729   0.149  -0.392   0.152 
## funcY2:p2_add -0.005   0.025  -0.005   0.007   0.149  -0.729   0.137  -0.214 
## funcY3:p2_add  0.013  -0.005   0.025  -0.009  -0.392   0.137  -0.729   0.273 
## funcY4:p2_add -0.005   0.007  -0.009   0.025   0.152  -0.214   0.273  -0.729 
## funcY1:p3_add  0.031  -0.006   0.017  -0.006   0.029  -0.006   0.016  -0.006 
## funcY2:p3_add -0.006   0.031  -0.006   0.009  -0.006   0.029  -0.005   0.009 
## funcY3:p3_add  0.017  -0.006   0.031  -0.012   0.016  -0.005   0.029  -0.011 
## funcY4:p3_add -0.006   0.009  -0.012   0.031  -0.006   0.009  -0.011   0.029 
## funcY1:p4_add  0.096  -0.020   0.051  -0.020   0.018  -0.004   0.010  -0.004 
## funcY2:p4_add -0.020   0.096  -0.018   0.028  -0.004   0.018  -0.003   0.005 
## funcY3:p4_add  0.051  -0.018   0.096  -0.036   0.010  -0.003   0.018  -0.007 
## funcY4:p4_add -0.020   0.028  -0.036   0.096  -0.004   0.005  -0.007   0.018 
## funcY1:p5_add  0.017  -0.003   0.009  -0.004   0.002   0.000   0.001   0.000 
## funcY2:p5_add -0.003   0.017  -0.003   0.005   0.000   0.002   0.000   0.001 
## funcY3:p5_add  0.009  -0.003   0.017  -0.006   0.001   0.000   0.002  -0.001 
## funcY4:p5_add -0.004   0.005  -0.006   0.017   0.000   0.001  -0.001   0.002 
## funcY1:p6_add  0.045  -0.009   0.024  -0.009   0.029  -0.006   0.016  -0.006 
## funcY2:p6_add -0.009   0.045  -0.008   0.013  -0.006   0.029  -0.005   0.009 
## funcY3:p6_add  0.024  -0.008   0.045  -0.017   0.016  -0.005   0.029  -0.011 
## funcY4:p6_add -0.009   0.013  -0.017   0.045  -0.006   0.009  -0.011   0.029 
##               fY1:3_I fY2:3_I fY3:3_I fY4:3_I fY1:4_I fY2:4_I fY3:4_I fY4:4_I
## funcY2:p1_ID                                                                 
## funcY3:p1_ID                                                                 
## funcY4:p1_ID                                                                 
## funcY1:p2_ID                                                                 
## funcY2:p2_ID                                                                 
## funcY3:p2_ID                                                                 
## funcY4:p2_ID                                                                 
## funcY1:p3_ID                                                                 
## funcY2:p3_ID  -0.205                                                         
## funcY3:p3_ID   0.537  -0.187                                                 
## funcY4:p3_ID  -0.209   0.294  -0.374                                         
## funcY1:p4_ID  -0.039   0.008  -0.021   0.008                                 
## funcY2:p4_ID   0.008  -0.039   0.007  -0.011  -0.205                         
## funcY3:p4_ID  -0.021   0.007  -0.039   0.014   0.537  -0.187                 
## funcY4:p4_ID   0.008  -0.011   0.014  -0.039  -0.209   0.294  -0.374         
## funcY1:p5_ID  -0.048   0.010  -0.026   0.010  -0.042   0.009  -0.023   0.009 
## funcY2:p5_ID   0.010  -0.048   0.009  -0.014   0.009  -0.042   0.008  -0.012 
## funcY3:p5_ID  -0.026   0.009  -0.048   0.018  -0.023   0.008  -0.042   0.016 
## funcY4:p5_ID   0.010  -0.014   0.018  -0.048   0.009  -0.012   0.016  -0.042 
## funcY1:p6_ID  -0.043   0.009  -0.023   0.009   0.027  -0.006   0.015  -0.006 
## funcY2:p6_ID   0.009  -0.043   0.008  -0.013  -0.006   0.027  -0.005   0.008 
## funcY3:p6_ID  -0.023   0.008  -0.043   0.016   0.015  -0.005   0.027  -0.010 
## funcY4:p6_ID   0.009  -0.013   0.016  -0.043  -0.006   0.008  -0.010   0.027 
## funcY1:p1_add  0.021  -0.004   0.011  -0.004   0.060  -0.012   0.032  -0.013 
## funcY2:p1_add -0.004   0.021  -0.004   0.006  -0.012   0.060  -0.011   0.018 
## funcY3:p1_add  0.011  -0.004   0.021  -0.008   0.032  -0.011   0.060  -0.022 
## funcY4:p1_add -0.004   0.006  -0.008   0.021  -0.013   0.018  -0.022   0.060 
## funcY1:p2_add -0.005   0.001  -0.003   0.001  -0.006   0.001  -0.003   0.001 
## funcY2:p2_add  0.001  -0.005   0.001  -0.002   0.001  -0.006   0.001  -0.002 
## funcY3:p2_add -0.003   0.001  -0.005   0.002  -0.003   0.001  -0.006   0.002 
## funcY4:p2_add  0.001  -0.002   0.002  -0.005   0.001  -0.002   0.002  -0.006 
## funcY1:p3_add -0.855   0.175  -0.459   0.178   0.077  -0.016   0.041  -0.016 
## funcY2:p3_add  0.175  -0.855   0.160  -0.251  -0.016   0.077  -0.014   0.023 
## funcY3:p3_add -0.459   0.160  -0.855   0.320   0.041  -0.014   0.077  -0.029 
## funcY4:p3_add  0.178  -0.251   0.320  -0.855  -0.016   0.023  -0.029   0.077 
## funcY1:p4_add  0.099  -0.020   0.053  -0.021  -0.863   0.177  -0.464   0.180 
## funcY2:p4_add -0.020   0.099  -0.019   0.029   0.177  -0.863   0.162  -0.254 
## funcY3:p4_add  0.053  -0.019   0.099  -0.037  -0.464   0.162  -0.863   0.323 
## funcY4:p4_add -0.021   0.029  -0.037   0.099   0.180  -0.254   0.323  -0.863 
## funcY1:p5_add  0.043  -0.009   0.023  -0.009   0.117  -0.024   0.063  -0.025 
## funcY2:p5_add -0.009   0.043  -0.008   0.013  -0.024   0.117  -0.022   0.035 
## funcY3:p5_add  0.023  -0.008   0.043  -0.016   0.063  -0.022   0.117  -0.044 
## funcY4:p5_add -0.009   0.013  -0.016   0.043  -0.025   0.035  -0.044   0.117 
## funcY1:p6_add  0.029  -0.006   0.016  -0.006  -0.059   0.012  -0.032   0.012 
## funcY2:p6_add -0.006   0.029  -0.005   0.009   0.012  -0.059   0.011  -0.017 
## funcY3:p6_add  0.016  -0.005   0.029  -0.011  -0.032   0.011  -0.059   0.022 
## funcY4:p6_add -0.006   0.009  -0.011   0.029   0.012  -0.017   0.022  -0.059 
##               fY1:5_I fY2:5_I fY3:5_I fY4:5_I fY1:6_I fY2:6_I fY3:6_I fY4:6_I
## funcY2:p1_ID                                                                 
## funcY3:p1_ID                                                                 
## funcY4:p1_ID                                                                 
## funcY1:p2_ID                                                                 
## funcY2:p2_ID                                                                 
## funcY3:p2_ID                                                                 
## funcY4:p2_ID                                                                 
## funcY1:p3_ID                                                                 
## funcY2:p3_ID                                                                 
## funcY3:p3_ID                                                                 
## funcY4:p3_ID                                                                 
## funcY1:p4_ID                                                                 
## funcY2:p4_ID                                                                 
## funcY3:p4_ID                                                                 
## funcY4:p4_ID                                                                 
## funcY1:p5_ID                                                                 
## funcY2:p5_ID  -0.205                                                         
## funcY3:p5_ID   0.537  -0.187                                                 
## funcY4:p5_ID  -0.209   0.294  -0.374                                         
## funcY1:p6_ID  -0.044   0.009  -0.024   0.009                                 
## funcY2:p6_ID   0.009  -0.044   0.008  -0.013  -0.205                         
## funcY3:p6_ID  -0.024   0.008  -0.044   0.017   0.537  -0.187                 
## funcY4:p6_ID   0.009  -0.013   0.017  -0.044  -0.209   0.294  -0.374         
## funcY1:p1_add -0.011   0.002  -0.006   0.002   0.065  -0.013   0.035  -0.014 
## funcY2:p1_add  0.002  -0.011   0.002  -0.003  -0.013   0.065  -0.012   0.019 
## funcY3:p1_add -0.006   0.002  -0.011   0.004   0.035  -0.012   0.065  -0.024 
## funcY4:p1_add  0.002  -0.003   0.004  -0.011  -0.014   0.019  -0.024   0.065 
## funcY1:p2_add  0.067  -0.014   0.036  -0.014   0.008  -0.002   0.004  -0.002 
## funcY2:p2_add -0.014   0.067  -0.012   0.020  -0.002   0.008  -0.001   0.002 
## funcY3:p2_add  0.036  -0.012   0.067  -0.025   0.004  -0.001   0.008  -0.003 
## funcY4:p2_add -0.014   0.020  -0.025   0.067  -0.002   0.002  -0.003   0.008 
## funcY1:p3_add  0.066  -0.014   0.036  -0.014   0.066  -0.013   0.035  -0.014 
## funcY2:p3_add -0.014   0.066  -0.012   0.019  -0.013   0.066  -0.012   0.019 
## funcY3:p3_add  0.036  -0.012   0.066  -0.025   0.035  -0.012   0.066  -0.025 
## funcY4:p3_add -0.014   0.019  -0.025   0.066  -0.014   0.019  -0.025   0.066 
## funcY1:p4_add  0.039  -0.008   0.021  -0.008  -0.027   0.005  -0.014   0.006 
## funcY2:p4_add -0.008   0.039  -0.007   0.011   0.005  -0.027   0.005  -0.008 
## funcY3:p4_add  0.021  -0.007   0.039  -0.015  -0.014   0.005  -0.027   0.010 
## funcY4:p4_add -0.008   0.011  -0.015   0.039   0.006  -0.008   0.010  -0.027 
## funcY1:p5_add -0.851   0.174  -0.457   0.178   0.071  -0.014   0.038  -0.015 
## funcY2:p5_add  0.174  -0.851   0.160  -0.250  -0.014   0.071  -0.013   0.021 
## funcY3:p5_add -0.457   0.160  -0.851   0.319   0.038  -0.013   0.071  -0.026 
## funcY4:p5_add  0.178  -0.250   0.319  -0.851  -0.015   0.021  -0.026   0.071 
## funcY1:p6_add  0.078  -0.016   0.042  -0.016  -0.854   0.175  -0.459   0.178 
## funcY2:p6_add -0.016   0.078  -0.015   0.023   0.175  -0.854   0.160  -0.251 
## funcY3:p6_add  0.042  -0.015   0.078  -0.029  -0.459   0.160  -0.854   0.320 
## funcY4:p6_add -0.016   0.023  -0.029   0.078   0.178  -0.251   0.320  -0.854 
##               fnY1:1_ fnY2:1_ fnY3:1_ fnY4:1_ fnY1:2_ fnY2:2_ fnY3:2_ fnY4:2_
## funcY2:p1_ID                                                                 
## funcY3:p1_ID                                                                 
## funcY4:p1_ID                                                                 
## funcY1:p2_ID                                                                 
## funcY2:p2_ID                                                                 
## funcY3:p2_ID                                                                 
## funcY4:p2_ID                                                                 
## funcY1:p3_ID                                                                 
## funcY2:p3_ID                                                                 
## funcY3:p3_ID                                                                 
## funcY4:p3_ID                                                                 
## funcY1:p4_ID                                                                 
## funcY2:p4_ID                                                                 
## funcY3:p4_ID                                                                 
## funcY4:p4_ID                                                                 
## funcY1:p5_ID                                                                 
## funcY2:p5_ID                                                                 
## funcY3:p5_ID                                                                 
## funcY4:p5_ID                                                                 
## funcY1:p6_ID                                                                 
## funcY2:p6_ID                                                                 
## funcY3:p6_ID                                                                 
## funcY4:p6_ID                                                                 
## funcY1:p1_add                                                                
## funcY2:p1_add -0.205                                                         
## funcY3:p1_add  0.537  -0.187                                                 
## funcY4:p1_add -0.209   0.294  -0.374                                         
## funcY1:p2_add -0.084   0.017  -0.045   0.017                                 
## funcY2:p2_add  0.017  -0.084   0.016  -0.025  -0.205                         
## funcY3:p2_add -0.045   0.016  -0.084   0.031   0.537  -0.187                 
## funcY4:p2_add  0.017  -0.025   0.031  -0.084  -0.209   0.294  -0.374         
## funcY1:p3_add -0.080   0.016  -0.043   0.017  -0.120   0.025  -0.064   0.025 
## funcY2:p3_add  0.016  -0.080   0.015  -0.024   0.025  -0.120   0.022  -0.035 
## funcY3:p3_add -0.043   0.015  -0.080   0.030  -0.064   0.022  -0.120   0.045 
## funcY4:p3_add  0.017  -0.024   0.030  -0.080   0.025  -0.035   0.045  -0.120 
## funcY1:p4_add -0.115   0.023  -0.062   0.024  -0.038   0.008  -0.020   0.008 
## funcY2:p4_add  0.023  -0.115   0.021  -0.034   0.008  -0.038   0.007  -0.011 
## funcY3:p4_add -0.062   0.021  -0.115   0.043  -0.020   0.007  -0.038   0.014 
## funcY4:p4_add  0.024  -0.034   0.043  -0.115   0.008  -0.011   0.014  -0.038 
## funcY1:p5_add -0.065   0.013  -0.035   0.014  -0.084   0.017  -0.045   0.018 
## funcY2:p5_add  0.013  -0.065   0.012  -0.019   0.017  -0.084   0.016  -0.025 
## funcY3:p5_add -0.035   0.012  -0.065   0.024  -0.045   0.016  -0.084   0.032 
## funcY4:p5_add  0.014  -0.019   0.024  -0.065   0.018  -0.025   0.032  -0.084 
## funcY1:p6_add -0.107   0.022  -0.057   0.022  -0.077   0.016  -0.042   0.016 
## funcY2:p6_add  0.022  -0.107   0.020  -0.031   0.016  -0.077   0.015  -0.023 
## funcY3:p6_add -0.057   0.020  -0.107   0.040  -0.042   0.015  -0.077   0.029 
## funcY4:p6_add  0.022  -0.031   0.040  -0.107   0.016  -0.023   0.029  -0.077 
##               fnY1:3_ fnY2:3_ fnY3:3_ fnY4:3_ fnY1:4_ fnY2:4_ fnY3:4_ fnY4:4_
## funcY2:p1_ID                                                                 
## funcY3:p1_ID                                                                 
## funcY4:p1_ID                                                                 
## funcY1:p2_ID                                                                 
## funcY2:p2_ID                                                                 
## funcY3:p2_ID                                                                 
## funcY4:p2_ID                                                                 
## funcY1:p3_ID                                                                 
## funcY2:p3_ID                                                                 
## funcY3:p3_ID                                                                 
## funcY4:p3_ID                                                                 
## funcY1:p4_ID                                                                 
## funcY2:p4_ID                                                                 
## funcY3:p4_ID                                                                 
## funcY4:p4_ID                                                                 
## funcY1:p5_ID                                                                 
## funcY2:p5_ID                                                                 
## funcY3:p5_ID                                                                 
## funcY4:p5_ID                                                                 
## funcY1:p6_ID                                                                 
## funcY2:p6_ID                                                                 
## funcY3:p6_ID                                                                 
## funcY4:p6_ID                                                                 
## funcY1:p1_add                                                                
## funcY2:p1_add                                                                
## funcY3:p1_add                                                                
## funcY4:p1_add                                                                
## funcY1:p2_add                                                                
## funcY2:p2_add                                                                
## funcY3:p2_add                                                                
## funcY4:p2_add                                                                
## funcY1:p3_add                                                                
## funcY2:p3_add -0.205                                                         
## funcY3:p3_add  0.537  -0.187                                                 
## funcY4:p3_add -0.209   0.294  -0.374                                         
## funcY1:p4_add -0.163   0.033  -0.088   0.034                                 
## funcY2:p4_add  0.033  -0.163   0.031  -0.048  -0.205                         
## funcY3:p4_add -0.088   0.031  -0.163   0.061   0.537  -0.187                 
## funcY4:p4_add  0.034  -0.048   0.061  -0.163  -0.209   0.294  -0.374         
## funcY1:p5_add -0.047   0.010  -0.025   0.010  -0.192   0.039  -0.103   0.040 
## funcY2:p5_add  0.010  -0.047   0.009  -0.014   0.039  -0.192   0.036  -0.057 
## funcY3:p5_add -0.025   0.009  -0.047   0.018  -0.103   0.036  -0.192   0.072 
## funcY4:p5_add  0.010  -0.014   0.018  -0.047   0.040  -0.057   0.072  -0.192 
## funcY1:p6_add -0.084   0.017  -0.045   0.018   0.019  -0.004   0.010  -0.004 
## funcY2:p6_add  0.017  -0.084   0.016  -0.025  -0.004   0.019  -0.004   0.006 
## funcY3:p6_add -0.045   0.016  -0.084   0.031   0.010  -0.004   0.019  -0.007 
## funcY4:p6_add  0.018  -0.025   0.031  -0.084  -0.004   0.006  -0.007   0.019 
##               fnY1:5_ fnY2:5_ fnY3:5_ fnY4:5_ fnY1:6_ fnY2:6_ fnY3:6_
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:p1_add                                                        
## funcY2:p1_add                                                        
## funcY3:p1_add                                                        
## funcY4:p1_add                                                        
## funcY1:p2_add                                                        
## funcY2:p2_add                                                        
## funcY3:p2_add                                                        
## funcY4:p2_add                                                        
## funcY1:p3_add                                                        
## funcY2:p3_add                                                        
## funcY3:p3_add                                                        
## funcY4:p3_add                                                        
## funcY1:p4_add                                                        
## funcY2:p4_add                                                        
## funcY3:p4_add                                                        
## funcY4:p4_add                                                        
## funcY1:p5_add                                                        
## funcY2:p5_add -0.205                                                 
## funcY3:p5_add  0.537  -0.187                                         
## funcY4:p5_add -0.209   0.294  -0.374                                 
## funcY1:p6_add -0.127   0.026  -0.068   0.027                         
## funcY2:p6_add  0.026  -0.127   0.024  -0.037  -0.205                 
## funcY3:p6_add -0.068   0.024  -0.127   0.048   0.537  -0.187         
## funcY4:p6_add  0.027  -0.037   0.048  -0.127  -0.209   0.294  -0.374 
## 
## Standardized residuals:
##          Min           Q1          Med           Q3          Max 
## -2.972790868 -0.738695731 -0.006022573  0.712835005  3.871969316 
## 
## Residual standard error: 2.666067 
## Degrees of freedom: 1536 total; 1488 residual
training-deepDive-multivariate-fitting_full.knit

For this model structure, just like for the univariate version seen in the Starter Pack, we assume that each pair of species interact with one another in a unique way. An example of this model is as follows:


\[\large y_{km}=\sum_{i=1}^{S=6} \beta_{ik} p_{im} + \sum_{\substack{i,j=1 \\ i < j}}^{S=6} \delta_{ijk} (p_{im} p_{jm}) + \epsilon_{km}\]


Where \(y_{km}\) represents the recorded value, \(y\), of the \(k^{th}\) ecosystem function (where \(k\) goes from \(1\) to \(K=4\)) from the \(m^{th}\) experimental/observational study unit (where \(m\) goes from \(1\) to \(M=384\)). The coefficient \(\beta_{ik}\) scaled by the initial proportion \(p\) of species \(i\) forms the ID effect of said species for the ecosystem function response \(k\). The interaction term \(\delta_{ijk}\) represents the unique strength of the interaction between species \(i\) and \(j\) for the ecosystem function \(k\). The error of this model, \(\epsilon\) is assumed to follow a multivariate Normal distribution with mean 0 and variance \(\Sigma^{*}\), where \(\Sigma^{*}\) is a \(KM \times KM\) block-diagonal matrix.


\[\Sigma^{*} = \begin{bmatrix} \Sigma_1 & & 0\\ & \ddots & \\ 0 & & \Sigma_M \end{bmatrix}\]


Each matrix along the main diagonal, \(\Sigma_{m}\) represents the variance-covariance matrix of the ecosystem functions. There are a few different forms that this may take (these are called auto-correlation structures). The unstructured or general structure (UN), where each element is allowed to differ from one another, can be seen below.

\[\Sigma_m = \begin{bmatrix} \sigma_1^2 & \sigma_{1,2} & ... & \sigma_{1,K}\\ \sigma_{1,2} & \sigma_{2}^2 & ... & \sigma_{2,K}\\ \vdots & \vdots & \ddots & \vdots \\ \sigma_{1,K} & \sigma_{2, K} & ... & \sigma_K^2 \end{bmatrix}\]
FULLModel <- DImulti(y = c("Y1", "Y2", "Y3", "Y4"), eco_func = c("NA", "UN"), unit_IDs = "plot", 
                   prop = 2:7, data = simMV, DImodel = "FULL", method = "ML")


And just like with the univariate models, we can use summary() to look at our model output.

summary(FULLModel)
## Generalized least squares fit by maximum likelihood
##   Model: value ~ 0 + func:((p1_ID + p2_ID + p3_ID + p4_ID + p5_ID + p6_ID +      FULL.p1.p2 + FULL.p1.p3 + FULL.p1.p4 + FULL.p1.p5 + FULL.p1.p6 +      FULL.p2.p3 + FULL.p2.p4 + FULL.p2.p5 + FULL.p2.p6 + FULL.p3.p4 +      FULL.p3.p5 + FULL.p3.p6 + FULL.p4.p5 + FULL.p4.p6 + FULL.p5.p6)) 
##   Data: data 
##        AIC      BIC    logLik
##   6254.586 6756.259 -3033.293
## 
## Correlation Structure: General
##  Formula: ~0 | plot 
##  Parameter estimate(s):
##  Correlation: 
##   1      2      3     
## 2 -0.197              
## 3  0.547 -0.186       
## 4 -0.214  0.299 -0.381
## Variance function:
##  Structure: Different standard deviations per stratum
##  Formula: ~0 | func 
##  Parameter estimates:
##        Y1        Y2        Y3        Y4 
## 1.0000000 0.4258171 1.2186827 0.4973806 
## 
## Coefficients:
##                       Value Std.Error   t-value p-value
## funcY1:p1_ID       7.118973  1.203533  5.915063  0.0000
## funcY2:p1_ID       4.865501  0.512485  9.493939  0.0000
## funcY3:p1_ID       0.809028  1.466725  0.551588  0.5813
## funcY4:p1_ID       3.816499  0.598614  6.375561  0.0000
## funcY1:p2_ID       1.794483  0.932717  1.923931  0.0546
## funcY2:p2_ID       4.272586  0.397167 10.757661  0.0000
## funcY3:p2_ID       7.408430  1.136686  6.517570  0.0000
## funcY4:p2_ID       4.845654  0.463915 10.445127  0.0000
## funcY1:p3_ID       8.094361  1.261297  6.417489  0.0000
## funcY2:p3_ID       4.109849  0.537082  7.652183  0.0000
## funcY3:p3_ID       4.592871  1.537121  2.987969  0.0029
## funcY4:p3_ID      -1.594603  0.627345 -2.541829  0.0111
## funcY1:p4_ID       5.504212  1.147548  4.796498  0.0000
## funcY2:p4_ID       1.364145  0.488646  2.791686  0.0053
## funcY3:p4_ID       8.853249  1.398497  6.330545  0.0000
## funcY4:p4_ID       4.897799  0.570768  8.581067  0.0000
## funcY1:p5_ID       0.268595  1.235624  0.217376  0.8279
## funcY2:p5_ID       4.812915  0.526150  9.147422  0.0000
## funcY3:p5_ID       4.693432  1.505834  3.116833  0.0019
## funcY4:p5_ID       6.838805  0.614575 11.127691  0.0000
## funcY1:p6_ID       6.119608  1.112703  5.499768  0.0000
## funcY2:p6_ID       6.894212  0.473808 14.550646  0.0000
## funcY3:p6_ID       9.290185  1.356032  6.851008  0.0000
## funcY4:p6_ID      -0.309442  0.553437 -0.559129  0.5762
## funcY1:FULL.p1.p2  3.987901  4.285103  0.930643  0.3522
## funcY2:FULL.p1.p2  7.717361  1.824670  4.229455  0.0000
## funcY3:FULL.p1.p2  5.571298  5.222182  1.066853  0.2862
## funcY4:FULL.p1.p2  0.821239  2.131327  0.385318  0.7001
## funcY1:FULL.p1.p3  9.982033  4.559783  2.189146  0.0287
## funcY2:FULL.p1.p3  7.063284  1.941634  3.637804  0.0003
## funcY3:FULL.p1.p3  0.653042  5.556929  0.117519  0.9065
## funcY4:FULL.p1.p3  1.157364  2.267948  0.510313  0.6099
## funcY1:FULL.p1.p4 -6.604288  4.977610 -1.326799  0.1848
## funcY2:FULL.p1.p4 10.320889  2.119552  4.869374  0.0000
## funcY3:FULL.p1.p4  7.580371  6.066127  1.249623  0.2116
## funcY4:FULL.p1.p4  2.080596  2.475767  0.840385  0.4008
## funcY1:FULL.p1.p5  6.596543  4.072851  1.619638  0.1055
## funcY2:FULL.p1.p5  5.388822  1.734290  3.107221  0.0019
## funcY3:FULL.p1.p5  4.541220  4.963513  0.914920  0.3604
## funcY4:FULL.p1.p5 -0.227181  2.025757 -0.112146  0.9107
## funcY1:FULL.p1.p6  5.618217  3.825964  1.468445  0.1422
## funcY2:FULL.p1.p6  8.214216  1.629161  5.041991  0.0000
## funcY3:FULL.p1.p6  3.322232  4.662637  0.712522  0.4763
## funcY4:FULL.p1.p6  1.100694  1.902960  0.578412  0.5631
## funcY1:FULL.p2.p3 -1.055946  4.703222 -0.224516  0.8224
## funcY2:FULL.p2.p3  9.431612  2.002712  4.709419  0.0000
## funcY3:FULL.p2.p3 -1.554950  5.731735 -0.271288  0.7862
## funcY4:FULL.p2.p3  1.722618  2.339291  0.736385  0.4616
## funcY1:FULL.p2.p4 -1.026854  4.186504 -0.245277  0.8063
## funcY2:FULL.p2.p4  6.801180  1.782685  3.815132  0.0001
## funcY3:FULL.p2.p4  1.499420  5.102020  0.293887  0.7689
## funcY4:FULL.p2.p4  0.667005  2.082286  0.320324  0.7488
## funcY1:FULL.p2.p5  3.717785  4.874747  0.762662  0.4458
## funcY2:FULL.p2.p5  6.841749  2.075750  3.296036  0.0010
## funcY3:FULL.p2.p5  2.017300  5.940769  0.339569  0.7342
## funcY4:FULL.p2.p5  0.827616  2.424604  0.341340  0.7329
## funcY1:FULL.p2.p6  3.358504  4.890134  0.686792  0.4923
## funcY2:FULL.p2.p6  4.236775  2.082303  2.034659  0.0421
## funcY3:FULL.p2.p6  2.115955  5.959522  0.355054  0.7226
## funcY4:FULL.p2.p6 -3.142967  2.432258 -1.292202  0.1965
## funcY1:FULL.p3.p4  5.185815  4.897412  1.058889  0.2898
## funcY2:FULL.p3.p4  6.606613  2.085402  3.168029  0.0016
## funcY3:FULL.p3.p4  3.639613  5.968392  0.609815  0.5421
## funcY4:FULL.p3.p4 -1.628665  2.435878 -0.668615  0.5038
## funcY1:FULL.p3.p5  2.670499  5.201760  0.513384  0.6078
## funcY2:FULL.p3.p5  5.834472  2.214998  2.634075  0.0085
## funcY3:FULL.p3.p5  1.442169  6.339295  0.227497  0.8201
## funcY4:FULL.p3.p5 -2.159138  2.587254 -0.834529  0.4041
## funcY1:FULL.p3.p6  3.822663  4.047854  0.944368  0.3451
## funcY2:FULL.p3.p6  7.543324  1.723646  4.376378  0.0000
## funcY3:FULL.p3.p6  3.628837  4.933050  0.735617  0.4621
## funcY4:FULL.p3.p6  3.217629  2.013324  1.598168  0.1102
## funcY1:FULL.p4.p5  2.938689  4.060514  0.723724  0.4694
## funcY2:FULL.p4.p5  7.527606  1.729036  4.353643  0.0000
## funcY3:FULL.p4.p5 -1.984081  4.948478 -0.400948  0.6885
## funcY4:FULL.p4.p5  1.475707  2.019621  0.730685  0.4651
## funcY1:FULL.p4.p6 -2.034747  4.091357 -0.497328  0.6190
## funcY2:FULL.p4.p6 10.121776  1.742170  5.809867  0.0000
## funcY3:FULL.p4.p6  1.429810  4.986066  0.286761  0.7743
## funcY4:FULL.p4.p6 -1.802996  2.034962 -0.886010  0.3758
## funcY1:FULL.p5.p6  0.651960  4.366660  0.149304  0.8813
## funcY2:FULL.p5.p6  9.465484  1.859399  5.090616  0.0000
## funcY3:FULL.p5.p6  1.606259  5.321574  0.301839  0.7628
## funcY4:FULL.p5.p6 -2.218507  2.171892 -1.021463  0.3072
## 
## Theta values: 1
## 
## 
##  Correlation: 
##                   fY1:1_ fY2:1_ fY3:1_ fY4:1_ fY1:2_ fY2:2_ fY3:2_ fY4:2_
## funcY2:p1_ID      -0.197                                                 
## funcY3:p1_ID       0.547 -0.186                                          
## funcY4:p1_ID      -0.214  0.299 -0.381                                   
## funcY1:p2_ID      -0.010  0.002 -0.006  0.002                            
## funcY2:p2_ID       0.002 -0.010  0.002 -0.003 -0.197                     
## funcY3:p2_ID      -0.006  0.002 -0.010  0.004  0.547 -0.186              
## funcY4:p2_ID       0.002 -0.003  0.004 -0.010 -0.214  0.299 -0.381       
## funcY1:p3_ID      -0.015  0.003 -0.008  0.003 -0.014  0.003 -0.007  0.003
## funcY2:p3_ID       0.003 -0.015  0.003 -0.005  0.003 -0.014  0.003 -0.004
## funcY3:p3_ID      -0.008  0.003 -0.015  0.006 -0.007  0.003 -0.014  0.005
## funcY4:p3_ID       0.003 -0.005  0.006 -0.015  0.003 -0.004  0.005 -0.014
## funcY1:p4_ID      -0.013  0.003 -0.007  0.003 -0.011  0.002 -0.006  0.002
## funcY2:p4_ID       0.003 -0.013  0.002 -0.004  0.002 -0.011  0.002 -0.003
## funcY3:p4_ID      -0.007  0.002 -0.013  0.005 -0.006  0.002 -0.011  0.004
## funcY4:p4_ID       0.003 -0.004  0.005 -0.013  0.002 -0.003  0.004 -0.011
## funcY1:p5_ID       0.007 -0.001  0.004 -0.001 -0.022  0.004 -0.012  0.005
## funcY2:p5_ID      -0.001  0.007 -0.001  0.002  0.004 -0.022  0.004 -0.007
## funcY3:p5_ID       0.004 -0.001  0.007 -0.003 -0.012  0.004 -0.022  0.008
## funcY4:p5_ID      -0.001  0.002 -0.003  0.007  0.005 -0.007  0.008 -0.022
## funcY1:p6_ID      -0.050  0.010 -0.028  0.011 -0.012  0.002 -0.006  0.003
## funcY2:p6_ID       0.010 -0.050  0.009 -0.015  0.002 -0.012  0.002 -0.003
## funcY3:p6_ID      -0.028  0.009 -0.050  0.019 -0.006  0.002 -0.012  0.004
## funcY4:p6_ID       0.011 -0.015  0.019 -0.050  0.003 -0.003  0.004 -0.012
## funcY1:FULL.p1.p2 -0.544  0.107 -0.298  0.117 -0.345  0.068 -0.189  0.074
## funcY2:FULL.p1.p2  0.107 -0.544  0.101 -0.163  0.068 -0.345  0.064 -0.103
## funcY3:FULL.p1.p2 -0.298  0.101 -0.544  0.208 -0.189  0.064 -0.345  0.132
## funcY4:FULL.p1.p2  0.117 -0.163  0.208 -0.544  0.074 -0.103  0.132 -0.345
## funcY1:FULL.p1.p3 -0.500  0.099 -0.274  0.107  0.017 -0.003  0.009 -0.004
## funcY2:FULL.p1.p3  0.099 -0.500  0.093 -0.150 -0.003  0.017 -0.003  0.005
## funcY3:FULL.p1.p3 -0.274  0.093 -0.500  0.191  0.009 -0.003  0.017 -0.007
## funcY4:FULL.p1.p3  0.107 -0.150  0.191 -0.500 -0.004  0.005 -0.007  0.017
## funcY1:FULL.p1.p4 -0.246  0.049 -0.135  0.053  0.012 -0.002  0.006 -0.003
## funcY2:FULL.p1.p4  0.049 -0.246  0.046 -0.074 -0.002  0.012 -0.002  0.004
## funcY3:FULL.p1.p4 -0.135  0.046 -0.246  0.094  0.006 -0.002  0.012 -0.005
## funcY4:FULL.p1.p4  0.053 -0.074  0.094 -0.246 -0.003  0.004 -0.005  0.012
## funcY1:FULL.p1.p5 -0.565  0.112 -0.309  0.121  0.032 -0.006  0.018 -0.007
## funcY2:FULL.p1.p5  0.112 -0.565  0.105 -0.169 -0.006  0.032 -0.006  0.010
## funcY3:FULL.p1.p5 -0.309  0.105 -0.565  0.215  0.018 -0.006  0.032 -0.012
## funcY4:FULL.p1.p5  0.121 -0.169  0.215 -0.565 -0.007  0.010 -0.012  0.032
## funcY1:FULL.p1.p6 -0.543  0.107 -0.297  0.116  0.005 -0.001  0.003 -0.001
## funcY2:FULL.p1.p6  0.107 -0.543  0.101 -0.163 -0.001  0.005 -0.001  0.001
## funcY3:FULL.p1.p6 -0.297  0.101 -0.543  0.207  0.003 -0.001  0.005 -0.002
## funcY4:FULL.p1.p6  0.116 -0.163  0.207 -0.543 -0.001  0.001 -0.002  0.005
## funcY1:FULL.p2.p3  0.098 -0.019  0.054 -0.021 -0.264  0.052 -0.145  0.057
## funcY2:FULL.p2.p3 -0.019  0.098 -0.018  0.029  0.052 -0.264  0.049 -0.079
## funcY3:FULL.p2.p3  0.054 -0.018  0.098 -0.037 -0.145  0.049 -0.264  0.101
## funcY4:FULL.p2.p3 -0.021  0.029 -0.037  0.098  0.057 -0.079  0.101 -0.264
## funcY1:FULL.p2.p4  0.003 -0.001  0.002 -0.001 -0.333  0.066 -0.182  0.071
## funcY2:FULL.p2.p4 -0.001  0.003 -0.001  0.001  0.066 -0.333  0.062 -0.099
## funcY3:FULL.p2.p4  0.002 -0.001  0.003 -0.001 -0.182  0.062 -0.333  0.127
## funcY4:FULL.p2.p4 -0.001  0.001 -0.001  0.003  0.071 -0.099  0.127 -0.333
## funcY1:FULL.p2.p5  0.011 -0.002  0.006 -0.002 -0.394  0.078 -0.216  0.084
## funcY2:FULL.p2.p5 -0.002  0.011 -0.002  0.003  0.078 -0.394  0.073 -0.118
## funcY3:FULL.p2.p5  0.006 -0.002  0.011 -0.004 -0.216  0.073 -0.394  0.150
## funcY4:FULL.p2.p5 -0.002  0.003 -0.004  0.011  0.084 -0.118  0.150 -0.394
## funcY1:FULL.p2.p6  0.088 -0.017  0.048 -0.019 -0.217  0.043 -0.119  0.046
## funcY2:FULL.p2.p6 -0.017  0.088 -0.016  0.026  0.043 -0.217  0.040 -0.065
## funcY3:FULL.p2.p6  0.048 -0.016  0.088 -0.033 -0.119  0.040 -0.217  0.083
## funcY4:FULL.p2.p6 -0.019  0.026 -0.033  0.088  0.046 -0.065  0.083 -0.217
## funcY1:FULL.p3.p4  0.015 -0.003  0.008 -0.003  0.019 -0.004  0.010 -0.004
## funcY2:FULL.p3.p4 -0.003  0.015 -0.003  0.004 -0.004  0.019 -0.003  0.006
## funcY3:FULL.p3.p4  0.008 -0.003  0.015 -0.006  0.010 -0.003  0.019 -0.007
## funcY4:FULL.p3.p4 -0.003  0.004 -0.006  0.015 -0.004  0.006 -0.007  0.019
## funcY1:FULL.p3.p5  0.007 -0.001  0.004 -0.002  0.049 -0.010  0.027 -0.011
## funcY2:FULL.p3.p5 -0.001  0.007 -0.001  0.002 -0.010  0.049 -0.009  0.015
## funcY3:FULL.p3.p5  0.004 -0.001  0.007 -0.003  0.027 -0.009  0.049 -0.019
## funcY4:FULL.p3.p5 -0.002  0.002 -0.003  0.007 -0.011  0.015 -0.019  0.049
## funcY1:FULL.p3.p6  0.036 -0.007  0.020 -0.008  0.020 -0.004  0.011 -0.004
## funcY2:FULL.p3.p6 -0.007  0.036 -0.007  0.011 -0.004  0.020 -0.004  0.006
## funcY3:FULL.p3.p6  0.020 -0.007  0.036 -0.014  0.011 -0.004  0.020 -0.008
## funcY4:FULL.p3.p6 -0.008  0.011 -0.014  0.036 -0.004  0.006 -0.008  0.020
## funcY1:FULL.p4.p5  0.022 -0.004  0.012 -0.005  0.036 -0.007  0.020 -0.008
## funcY2:FULL.p4.p5 -0.004  0.022 -0.004  0.007 -0.007  0.036 -0.007  0.011
## funcY3:FULL.p4.p5  0.012 -0.004  0.022 -0.008  0.020 -0.007  0.036 -0.014
## funcY4:FULL.p4.p5 -0.005  0.007 -0.008  0.022 -0.008  0.011 -0.014  0.036
## funcY1:FULL.p4.p6  0.034 -0.007  0.019 -0.007  0.010 -0.002  0.006 -0.002
## funcY2:FULL.p4.p6 -0.007  0.034 -0.006  0.010 -0.002  0.010 -0.002  0.003
## funcY3:FULL.p4.p6  0.019 -0.006  0.034 -0.013  0.006 -0.002  0.010 -0.004
## funcY4:FULL.p4.p6 -0.007  0.010 -0.013  0.034 -0.002  0.003 -0.004  0.010
## funcY1:FULL.p5.p6  0.051 -0.010  0.028 -0.011  0.033 -0.007  0.018 -0.007
## funcY2:FULL.p5.p6 -0.010  0.051 -0.010  0.015 -0.007  0.033 -0.006  0.010
## funcY3:FULL.p5.p6  0.028 -0.010  0.051 -0.020  0.018 -0.006  0.033 -0.013
## funcY4:FULL.p5.p6 -0.011  0.015 -0.020  0.051 -0.007  0.010 -0.013  0.033
##                   fY1:3_ fY2:3_ fY3:3_ fY4:3_ fY1:4_ fY2:4_ fY3:4_ fY4:4_
## funcY2:p1_ID                                                             
## funcY3:p1_ID                                                             
## funcY4:p1_ID                                                             
## funcY1:p2_ID                                                             
## funcY2:p2_ID                                                             
## funcY3:p2_ID                                                             
## funcY4:p2_ID                                                             
## funcY1:p3_ID                                                             
## funcY2:p3_ID      -0.197                                                 
## funcY3:p3_ID       0.547 -0.186                                          
## funcY4:p3_ID      -0.214  0.299 -0.381                                   
## funcY1:p4_ID      -0.020  0.004 -0.011  0.004                            
## funcY2:p4_ID       0.004 -0.020  0.004 -0.006 -0.197                     
## funcY3:p4_ID      -0.011  0.004 -0.020  0.008  0.547 -0.186              
## funcY4:p4_ID       0.004 -0.006  0.008 -0.020 -0.214  0.299 -0.381       
## funcY1:p5_ID      -0.031  0.006 -0.017  0.007 -0.037  0.007 -0.020  0.008
## funcY2:p5_ID       0.006 -0.031  0.006 -0.009  0.007 -0.037  0.007 -0.011
## funcY3:p5_ID      -0.017  0.006 -0.031  0.012 -0.020  0.007 -0.037  0.014
## funcY4:p5_ID       0.007 -0.009  0.012 -0.031  0.008 -0.011  0.014 -0.037
## funcY1:p6_ID      -0.042  0.008 -0.023  0.009  0.026 -0.005  0.014 -0.005
## funcY2:p6_ID       0.008 -0.042  0.008 -0.013 -0.005  0.026 -0.005  0.008
## funcY3:p6_ID      -0.023  0.008 -0.042  0.016  0.014 -0.005  0.026 -0.010
## funcY4:p6_ID       0.009 -0.013  0.016 -0.042 -0.005  0.008 -0.010  0.026
## funcY1:FULL.p1.p2  0.043 -0.009  0.024 -0.009  0.006 -0.001  0.003 -0.001
## funcY2:FULL.p1.p2 -0.009  0.043 -0.008  0.013 -0.001  0.006 -0.001  0.002
## funcY3:FULL.p1.p2  0.024 -0.008  0.043 -0.017  0.003 -0.001  0.006 -0.002
## funcY4:FULL.p1.p2 -0.009  0.013 -0.017  0.043 -0.001  0.002 -0.002  0.006
## funcY1:FULL.p1.p3 -0.468  0.092 -0.256  0.100  0.002  0.000  0.001  0.000
## funcY2:FULL.p1.p3  0.092 -0.468  0.087 -0.140  0.000  0.002  0.000  0.001
## funcY3:FULL.p1.p3 -0.256  0.087 -0.468  0.178  0.001  0.000  0.002 -0.001
## funcY4:FULL.p1.p3  0.100 -0.140  0.178 -0.468  0.000  0.001 -0.001  0.002
## funcY1:FULL.p1.p4 -0.004  0.001 -0.002  0.001 -0.367  0.072 -0.201  0.079
## funcY2:FULL.p1.p4  0.001 -0.004  0.001 -0.001  0.072 -0.367  0.068 -0.110
## funcY3:FULL.p1.p4 -0.002  0.001 -0.004  0.001 -0.201  0.068 -0.367  0.140
## funcY4:FULL.p1.p4  0.001 -0.001  0.001 -0.004  0.079 -0.110  0.140 -0.367
## funcY1:FULL.p1.p5  0.030 -0.006  0.017 -0.007  0.052 -0.010  0.029 -0.011
## funcY2:FULL.p1.p5 -0.006  0.030 -0.006  0.009 -0.010  0.052 -0.010  0.016
## funcY3:FULL.p1.p5  0.017 -0.006  0.030 -0.012  0.029 -0.010  0.052 -0.020
## funcY4:FULL.p1.p5 -0.007  0.009 -0.012  0.030 -0.011  0.016 -0.020  0.052
## funcY1:FULL.p1.p6  0.046 -0.009  0.025 -0.010  0.006 -0.001  0.003 -0.001
## funcY2:FULL.p1.p6 -0.009  0.046 -0.008  0.014 -0.001  0.006 -0.001  0.002
## funcY3:FULL.p1.p6  0.025 -0.008  0.046 -0.017  0.003 -0.001  0.006 -0.002
## funcY4:FULL.p1.p6 -0.010  0.014 -0.017  0.046 -0.001  0.002 -0.002  0.006
## funcY1:FULL.p2.p3 -0.575  0.114 -0.315  0.123  0.041 -0.008  0.022 -0.009
## funcY2:FULL.p2.p3  0.114 -0.575  0.107 -0.172 -0.008  0.041 -0.008  0.012
## funcY3:FULL.p2.p3 -0.315  0.107 -0.575  0.219  0.022 -0.008  0.041 -0.016
## funcY4:FULL.p2.p3  0.123 -0.172  0.219 -0.575 -0.009  0.012 -0.016  0.041
## funcY1:FULL.p2.p4  0.029 -0.006  0.016 -0.006 -0.583  0.115 -0.319  0.125
## funcY2:FULL.p2.p4 -0.006  0.029 -0.005  0.009  0.115 -0.583  0.109 -0.174
## funcY3:FULL.p2.p4  0.016 -0.005  0.029 -0.011 -0.319  0.109 -0.583  0.222
## funcY4:FULL.p2.p4 -0.006  0.009 -0.011  0.029  0.125 -0.174  0.222 -0.583
## funcY1:FULL.p2.p5  0.069 -0.014  0.038 -0.015  0.062 -0.012  0.034 -0.013
## funcY2:FULL.p2.p5 -0.014  0.069 -0.013  0.021 -0.012  0.062 -0.012  0.019
## funcY3:FULL.p2.p5  0.038 -0.013  0.069 -0.026  0.034 -0.012  0.062 -0.024
## funcY4:FULL.p2.p5 -0.015  0.021 -0.026  0.069 -0.013  0.019 -0.024  0.062
## funcY1:FULL.p2.p6  0.039 -0.008  0.021 -0.008  0.032 -0.006  0.018 -0.007
## funcY2:FULL.p2.p6 -0.008  0.039 -0.007  0.012 -0.006  0.032 -0.006  0.010
## funcY3:FULL.p2.p6  0.021 -0.007  0.039 -0.015  0.018 -0.006  0.032 -0.012
## funcY4:FULL.p2.p6 -0.008  0.012 -0.015  0.039 -0.007  0.010 -0.012  0.032
## funcY1:FULL.p3.p4 -0.249  0.049 -0.136  0.053 -0.313  0.062 -0.171  0.067
## funcY2:FULL.p3.p4  0.049 -0.249  0.046 -0.075  0.062 -0.313  0.058 -0.094
## funcY3:FULL.p3.p4 -0.136  0.046 -0.249  0.095 -0.171  0.058 -0.313  0.119
## funcY4:FULL.p3.p4  0.053 -0.075  0.095 -0.249  0.067 -0.094  0.119 -0.313
## funcY1:FULL.p3.p5 -0.380  0.075 -0.208  0.081  0.041 -0.008  0.023 -0.009
## funcY2:FULL.p3.p5  0.075 -0.380  0.071 -0.114 -0.008  0.041 -0.008  0.012
## funcY3:FULL.p3.p5 -0.208  0.071 -0.380  0.145  0.023 -0.008  0.041 -0.016
## funcY4:FULL.p3.p5  0.081 -0.114  0.145 -0.380 -0.009  0.012 -0.016  0.041
## funcY1:FULL.p3.p6 -0.555  0.110 -0.304  0.119 -0.004  0.001 -0.002  0.001
## funcY2:FULL.p3.p6  0.110 -0.555  0.103 -0.166  0.001 -0.004  0.001 -0.001
## funcY3:FULL.p3.p6 -0.304  0.103 -0.555  0.212 -0.002  0.001 -0.004  0.001
## funcY4:FULL.p3.p6  0.119 -0.166  0.212 -0.555  0.001 -0.001  0.001 -0.004
## funcY1:FULL.p4.p5  0.033 -0.007  0.018 -0.007 -0.415  0.082 -0.227  0.089
## funcY2:FULL.p4.p5 -0.007  0.033 -0.006  0.010  0.082 -0.415  0.077 -0.124
## funcY3:FULL.p4.p5  0.018 -0.006  0.033 -0.013 -0.227  0.077 -0.415  0.158
## funcY4:FULL.p4.p5 -0.007  0.010 -0.013  0.033  0.089 -0.124  0.158 -0.415
## funcY1:FULL.p4.p6  0.039 -0.008  0.021 -0.008 -0.622  0.123 -0.340  0.133
## funcY2:FULL.p4.p6 -0.008  0.039 -0.007  0.012  0.123 -0.622  0.116 -0.186
## funcY3:FULL.p4.p6  0.021 -0.007  0.039 -0.015 -0.340  0.116 -0.622  0.237
## funcY4:FULL.p4.p6 -0.008  0.012 -0.015  0.039  0.133 -0.186  0.237 -0.622
## funcY1:FULL.p5.p6  0.046 -0.009  0.025 -0.010  0.049 -0.010  0.027 -0.010
## funcY2:FULL.p5.p6 -0.009  0.046 -0.009  0.014 -0.010  0.049 -0.009  0.015
## funcY3:FULL.p5.p6  0.025 -0.009  0.046 -0.018  0.027 -0.009  0.049 -0.019
## funcY4:FULL.p5.p6 -0.010  0.014 -0.018  0.046 -0.010  0.015 -0.019  0.049
##                   fY1:5_ fY2:5_ fY3:5_ fY4:5_ fY1:6_ fY2:6_ fY3:6_ fY4:6_
## funcY2:p1_ID                                                             
## funcY3:p1_ID                                                             
## funcY4:p1_ID                                                             
## funcY1:p2_ID                                                             
## funcY2:p2_ID                                                             
## funcY3:p2_ID                                                             
## funcY4:p2_ID                                                             
## funcY1:p3_ID                                                             
## funcY2:p3_ID                                                             
## funcY3:p3_ID                                                             
## funcY4:p3_ID                                                             
## funcY1:p4_ID                                                             
## funcY2:p4_ID                                                             
## funcY3:p4_ID                                                             
## funcY4:p4_ID                                                             
## funcY1:p5_ID                                                             
## funcY2:p5_ID      -0.197                                                 
## funcY3:p5_ID       0.547 -0.186                                          
## funcY4:p5_ID      -0.214  0.299 -0.381                                   
## funcY1:p6_ID      -0.043  0.009 -0.024  0.009                            
## funcY2:p6_ID       0.009 -0.043  0.008 -0.013 -0.197                     
## funcY3:p6_ID      -0.024  0.008 -0.043  0.017  0.547 -0.186              
## funcY4:p6_ID       0.009 -0.013  0.017 -0.043 -0.214  0.299 -0.381       
## funcY1:FULL.p1.p2 -0.007  0.001 -0.004  0.002  0.097 -0.019  0.053 -0.021
## funcY2:FULL.p1.p2  0.001 -0.007  0.001 -0.002 -0.019  0.097 -0.018  0.029
## funcY3:FULL.p1.p2 -0.004  0.001 -0.007  0.003  0.053 -0.018  0.097 -0.037
## funcY4:FULL.p1.p2  0.002 -0.002  0.003 -0.007 -0.021  0.029 -0.037  0.097
## funcY1:FULL.p1.p3  0.004 -0.001  0.002 -0.001  0.044 -0.009  0.024 -0.009
## funcY2:FULL.p1.p3 -0.001  0.004 -0.001  0.001 -0.009  0.044 -0.008  0.013
## funcY3:FULL.p1.p3  0.002 -0.001  0.004 -0.002  0.024 -0.008  0.044 -0.017
## funcY4:FULL.p1.p3 -0.001  0.001 -0.002  0.004 -0.009  0.013 -0.017  0.044
## funcY1:FULL.p1.p4  0.117 -0.023  0.064 -0.025  0.017 -0.003  0.009 -0.004
## funcY2:FULL.p1.p4 -0.023  0.117 -0.022  0.035 -0.003  0.017 -0.003  0.005
## funcY3:FULL.p1.p4  0.064 -0.022  0.117 -0.045  0.009 -0.003  0.017 -0.006
## funcY4:FULL.p1.p4 -0.025  0.035 -0.045  0.117 -0.004  0.005 -0.006  0.017
## funcY1:FULL.p1.p5 -0.579  0.114 -0.317  0.124  0.057 -0.011  0.031 -0.012
## funcY2:FULL.p1.p5  0.114 -0.579  0.108 -0.173 -0.011  0.057 -0.011  0.017
## funcY3:FULL.p1.p5 -0.317  0.108 -0.579  0.221  0.031 -0.011  0.057 -0.022
## funcY4:FULL.p1.p5  0.124 -0.173  0.221 -0.579 -0.012  0.017 -0.022  0.057
## funcY1:FULL.p1.p6  0.033 -0.007  0.018 -0.007 -0.447  0.088 -0.245  0.096
## funcY2:FULL.p1.p6 -0.007  0.033 -0.006  0.010  0.088 -0.447  0.083 -0.134
## funcY3:FULL.p1.p6  0.018 -0.006  0.033 -0.013 -0.245  0.083 -0.447  0.171
## funcY4:FULL.p1.p6 -0.007  0.010 -0.013  0.033  0.096 -0.134  0.171 -0.447
## funcY1:FULL.p2.p3  0.041 -0.008  0.022 -0.009  0.050 -0.010  0.027 -0.011
## funcY2:FULL.p2.p3 -0.008  0.041 -0.008  0.012 -0.010  0.050 -0.009  0.015
## funcY3:FULL.p2.p3  0.022 -0.008  0.041 -0.016  0.027 -0.009  0.050 -0.019
## funcY4:FULL.p2.p3 -0.009  0.012 -0.016  0.041 -0.011  0.015 -0.019  0.050
## funcY1:FULL.p2.p4  0.052 -0.010  0.029 -0.011  0.007 -0.001  0.004 -0.002
## funcY2:FULL.p2.p4 -0.010  0.052 -0.010  0.016 -0.001  0.007 -0.001  0.002
## funcY3:FULL.p2.p4  0.029 -0.010  0.052 -0.020  0.004 -0.001  0.007 -0.003
## funcY4:FULL.p2.p4 -0.011  0.016 -0.020  0.052 -0.002  0.002 -0.003  0.007
## funcY1:FULL.p2.p5 -0.318  0.063 -0.174  0.068  0.024 -0.005  0.013 -0.005
## funcY2:FULL.p2.p5  0.063 -0.318  0.059 -0.095 -0.005  0.024 -0.004  0.007
## funcY3:FULL.p2.p5 -0.174  0.059 -0.318  0.121  0.013 -0.004  0.024 -0.009
## funcY4:FULL.p2.p5  0.068 -0.095  0.121 -0.318 -0.005  0.007 -0.009  0.024
## funcY1:FULL.p2.p6  0.050 -0.010  0.027 -0.011 -0.494  0.097 -0.270  0.106
## funcY2:FULL.p2.p6 -0.010  0.050 -0.009  0.015  0.097 -0.494  0.092 -0.148
## funcY3:FULL.p2.p6  0.027 -0.009  0.050 -0.019 -0.270  0.092 -0.494  0.188
## funcY4:FULL.p2.p6 -0.011  0.015 -0.019  0.050  0.106 -0.148  0.188 -0.494
## funcY1:FULL.p3.p4  0.027 -0.005  0.015 -0.006  0.023 -0.005  0.013 -0.005
## funcY2:FULL.p3.p4 -0.005  0.027 -0.005  0.008 -0.005  0.023 -0.004  0.007
## funcY3:FULL.p3.p4  0.015 -0.005  0.027 -0.010  0.013 -0.004  0.023 -0.009
## funcY4:FULL.p3.p4 -0.006  0.008 -0.010  0.027 -0.005  0.007 -0.009  0.023
## funcY1:FULL.p3.p5 -0.354  0.070 -0.194  0.076  0.080 -0.016  0.044 -0.017
## funcY2:FULL.p3.p5  0.070 -0.354  0.066 -0.106 -0.016  0.080 -0.015  0.024
## funcY3:FULL.p3.p5 -0.194  0.066 -0.354  0.135  0.044 -0.015  0.080 -0.031
## funcY4:FULL.p3.p5  0.076 -0.106  0.135 -0.354 -0.017  0.024 -0.031  0.080
## funcY1:FULL.p3.p6  0.057 -0.011  0.031 -0.012 -0.445  0.088 -0.243  0.095
## funcY2:FULL.p3.p6 -0.011  0.057 -0.011  0.017  0.088 -0.445  0.083 -0.133
## funcY3:FULL.p3.p6  0.031 -0.011  0.057 -0.022 -0.243  0.083 -0.445  0.169
## funcY4:FULL.p3.p6 -0.012  0.017 -0.022  0.057  0.095 -0.133  0.169 -0.445
## funcY1:FULL.p4.p5 -0.596  0.118 -0.326  0.128  0.034 -0.007  0.019 -0.007
## funcY2:FULL.p4.p5  0.118 -0.596  0.111 -0.178 -0.007  0.034 -0.006  0.010
## funcY3:FULL.p4.p5 -0.326  0.111 -0.596  0.227  0.019 -0.006  0.034 -0.013
## funcY4:FULL.p4.p5  0.128 -0.178  0.227 -0.596 -0.007  0.010 -0.013  0.034
## funcY1:FULL.p4.p6  0.065 -0.013  0.036 -0.014 -0.512  0.101 -0.280  0.110
## funcY2:FULL.p4.p6 -0.013  0.065 -0.012  0.020  0.101 -0.512  0.095 -0.153
## funcY3:FULL.p4.p6  0.036 -0.012  0.065 -0.025 -0.280  0.095 -0.512  0.195
## funcY4:FULL.p4.p6 -0.014  0.020 -0.025  0.065  0.110 -0.153  0.195 -0.512
## funcY1:FULL.p5.p6 -0.419  0.083 -0.230  0.090 -0.360  0.071 -0.197  0.077
## funcY2:FULL.p5.p6  0.083 -0.419  0.078 -0.125  0.071 -0.360  0.067 -0.108
## funcY3:FULL.p5.p6 -0.230  0.078 -0.419  0.160 -0.197  0.067 -0.360  0.137
## funcY4:FULL.p5.p6  0.090 -0.125  0.160 -0.419  0.077 -0.108  0.137 -0.360
##                   fY1:FULL.1.2 fY2:FULL.1.2 fY3:FULL.1.2 fY4:FULL.1.2
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FULL.p1.p2                                                    
## funcY2:FULL.p1.p2 -0.197                                             
## funcY3:FULL.p1.p2  0.547       -0.186                                
## funcY4:FULL.p1.p2 -0.214        0.299       -0.381                   
## funcY1:FULL.p1.p3  0.174       -0.034        0.095       -0.037      
## funcY2:FULL.p1.p3 -0.034        0.174       -0.032        0.052      
## funcY3:FULL.p1.p3  0.095       -0.032        0.174       -0.066      
## funcY4:FULL.p1.p3 -0.037        0.052       -0.066        0.174      
## funcY1:FULL.p1.p4  0.096       -0.019        0.053       -0.021      
## funcY2:FULL.p1.p4 -0.019        0.096       -0.018        0.029      
## funcY3:FULL.p1.p4  0.053       -0.018        0.096       -0.037      
## funcY4:FULL.p1.p4 -0.021        0.029       -0.037        0.096      
## funcY1:FULL.p1.p5  0.279       -0.055        0.153       -0.060      
## funcY2:FULL.p1.p5 -0.055        0.279       -0.052        0.083      
## funcY3:FULL.p1.p5  0.153       -0.052        0.279       -0.106      
## funcY4:FULL.p1.p5 -0.060        0.083       -0.106        0.279      
## funcY1:FULL.p1.p6  0.172       -0.034        0.094       -0.037      
## funcY2:FULL.p1.p6 -0.034        0.172       -0.032        0.051      
## funcY3:FULL.p1.p6  0.094       -0.032        0.172       -0.065      
## funcY4:FULL.p1.p6 -0.037        0.051       -0.065        0.172      
## funcY1:FULL.p2.p3 -0.075        0.015       -0.041        0.016      
## funcY2:FULL.p2.p3  0.015       -0.075        0.014       -0.022      
## funcY3:FULL.p2.p3 -0.041        0.014       -0.075        0.029      
## funcY4:FULL.p2.p3  0.016       -0.022        0.029       -0.075      
## funcY1:FULL.p2.p4  0.105       -0.021        0.058       -0.023      
## funcY2:FULL.p2.p4 -0.021        0.105       -0.020        0.031      
## funcY3:FULL.p2.p4  0.058       -0.020        0.105       -0.040      
## funcY4:FULL.p2.p4 -0.023        0.031       -0.040        0.105      
## funcY1:FULL.p2.p5  0.110       -0.022        0.060       -0.024      
## funcY2:FULL.p2.p5 -0.022        0.110       -0.020        0.033      
## funcY3:FULL.p2.p5  0.060       -0.020        0.110       -0.042      
## funcY4:FULL.p2.p5 -0.024        0.033       -0.042        0.110      
## funcY1:FULL.p2.p6 -0.175        0.034       -0.096        0.037      
## funcY2:FULL.p2.p6  0.034       -0.175        0.033       -0.052      
## funcY3:FULL.p2.p6 -0.096        0.033       -0.175        0.067      
## funcY4:FULL.p2.p6  0.037       -0.052        0.067       -0.175      
## funcY1:FULL.p3.p4  0.036       -0.007        0.020       -0.008      
## funcY2:FULL.p3.p4 -0.007        0.036       -0.007        0.011      
## funcY3:FULL.p3.p4  0.020       -0.007        0.036       -0.014      
## funcY4:FULL.p3.p4 -0.008        0.011       -0.014        0.036      
## funcY1:FULL.p3.p5 -0.002        0.000       -0.001        0.000      
## funcY2:FULL.p3.p5  0.000       -0.002        0.000       -0.001      
## funcY3:FULL.p3.p5 -0.001        0.000       -0.002        0.001      
## funcY4:FULL.p3.p5  0.000       -0.001        0.001       -0.002      
## funcY1:FULL.p3.p6 -0.056        0.011       -0.031        0.012      
## funcY2:FULL.p3.p6  0.011       -0.056        0.010       -0.017      
## funcY3:FULL.p3.p6 -0.031        0.010       -0.056        0.021      
## funcY4:FULL.p3.p6  0.012       -0.017        0.021       -0.056      
## funcY1:FULL.p4.p5 -0.014        0.003       -0.008        0.003      
## funcY2:FULL.p4.p5  0.003       -0.014        0.003       -0.004      
## funcY3:FULL.p4.p5 -0.008        0.003       -0.014        0.005      
## funcY4:FULL.p4.p5  0.003       -0.004        0.005       -0.014      
## funcY1:FULL.p4.p6 -0.048        0.009       -0.026        0.010      
## funcY2:FULL.p4.p6  0.009       -0.048        0.009       -0.014      
## funcY3:FULL.p4.p6 -0.026        0.009       -0.048        0.018      
## funcY4:FULL.p4.p6  0.010       -0.014        0.018       -0.048      
## funcY1:FULL.p5.p6  0.010       -0.002        0.006       -0.002      
## funcY2:FULL.p5.p6 -0.002        0.010       -0.002        0.003      
## funcY3:FULL.p5.p6  0.006       -0.002        0.010       -0.004      
## funcY4:FULL.p5.p6 -0.002        0.003       -0.004        0.010      
##                   fY1:FULL.1.3 fY2:FULL.1.3 fY3:FULL.1.3 fY4:FULL.1.3
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FULL.p1.p2                                                    
## funcY2:FULL.p1.p2                                                    
## funcY3:FULL.p1.p2                                                    
## funcY4:FULL.p1.p2                                                    
## funcY1:FULL.p1.p3                                                    
## funcY2:FULL.p1.p3 -0.197                                             
## funcY3:FULL.p1.p3  0.547       -0.186                                
## funcY4:FULL.p1.p3 -0.214        0.299       -0.381                   
## funcY1:FULL.p1.p4  0.007       -0.001        0.004       -0.002      
## funcY2:FULL.p1.p4 -0.001        0.007       -0.001        0.002      
## funcY3:FULL.p1.p4  0.004       -0.001        0.007       -0.003      
## funcY4:FULL.p1.p4 -0.002        0.002       -0.003        0.007      
## funcY1:FULL.p1.p5  0.285       -0.056        0.156       -0.061      
## funcY2:FULL.p1.p5 -0.056        0.285       -0.053        0.085      
## funcY3:FULL.p1.p5  0.156       -0.053        0.285       -0.109      
## funcY4:FULL.p1.p5 -0.061        0.085       -0.109        0.285      
## funcY1:FULL.p1.p6  0.246       -0.048        0.134       -0.053      
## funcY2:FULL.p1.p6 -0.048        0.246       -0.046        0.073      
## funcY3:FULL.p1.p6  0.134       -0.046        0.246       -0.094      
## funcY4:FULL.p1.p6 -0.053        0.073       -0.094        0.246      
## funcY1:FULL.p2.p3  0.067       -0.013        0.037       -0.014      
## funcY2:FULL.p2.p3 -0.013        0.067       -0.012        0.020      
## funcY3:FULL.p2.p3  0.037       -0.012        0.067       -0.025      
## funcY4:FULL.p2.p3 -0.014        0.020       -0.025        0.067      
## funcY1:FULL.p2.p4  0.046       -0.009        0.025       -0.010      
## funcY2:FULL.p2.p4 -0.009        0.046       -0.009        0.014      
## funcY3:FULL.p2.p4  0.025       -0.009        0.046       -0.017      
## funcY4:FULL.p2.p4 -0.010        0.014       -0.017        0.046      
## funcY1:FULL.p2.p5 -0.015        0.003       -0.008        0.003      
## funcY2:FULL.p2.p5  0.003       -0.015        0.003       -0.005      
## funcY3:FULL.p2.p5 -0.008        0.003       -0.015        0.006      
## funcY4:FULL.p2.p5  0.003       -0.005        0.006       -0.015      
## funcY1:FULL.p2.p6 -0.045        0.009       -0.025        0.010      
## funcY2:FULL.p2.p6  0.009       -0.045        0.008       -0.014      
## funcY3:FULL.p2.p6 -0.025        0.008       -0.045        0.017      
## funcY4:FULL.p2.p6  0.010       -0.014        0.017       -0.045      
## funcY1:FULL.p3.p4  0.022       -0.004        0.012       -0.005      
## funcY2:FULL.p3.p4 -0.004        0.022       -0.004        0.007      
## funcY3:FULL.p3.p4  0.012       -0.004        0.022       -0.008      
## funcY4:FULL.p3.p4 -0.005        0.007       -0.008        0.022      
## funcY1:FULL.p3.p5  0.184       -0.036        0.100       -0.039      
## funcY2:FULL.p3.p5 -0.036        0.184       -0.034        0.055      
## funcY3:FULL.p3.p5  0.100       -0.034        0.184       -0.070      
## funcY4:FULL.p3.p5 -0.039        0.055       -0.070        0.184      
## funcY1:FULL.p3.p6  0.244       -0.048        0.134       -0.052      
## funcY2:FULL.p3.p6 -0.048        0.244       -0.045        0.073      
## funcY3:FULL.p3.p6  0.134       -0.045        0.244       -0.093      
## funcY4:FULL.p3.p6 -0.052        0.073       -0.093        0.244      
## funcY1:FULL.p4.p5  0.010       -0.002        0.005       -0.002      
## funcY2:FULL.p4.p5 -0.002        0.010       -0.002        0.003      
## funcY3:FULL.p4.p5  0.005       -0.002        0.010       -0.004      
## funcY4:FULL.p4.p5 -0.002        0.003       -0.004        0.010      
## funcY1:FULL.p4.p6 -0.021        0.004       -0.011        0.004      
## funcY2:FULL.p4.p6  0.004       -0.021        0.004       -0.006      
## funcY3:FULL.p4.p6 -0.011        0.004       -0.021        0.008      
## funcY4:FULL.p4.p6  0.004       -0.006        0.008       -0.021      
## funcY1:FULL.p5.p6 -0.060        0.012       -0.033        0.013      
## funcY2:FULL.p5.p6  0.012       -0.060        0.011       -0.018      
## funcY3:FULL.p5.p6 -0.033        0.011       -0.060        0.023      
## funcY4:FULL.p5.p6  0.013       -0.018        0.023       -0.060      
##                   fY1:FULL.1.4 fY2:FULL.1.4 fY3:FULL.1.4 fY4:FULL.1.4
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FULL.p1.p2                                                    
## funcY2:FULL.p1.p2                                                    
## funcY3:FULL.p1.p2                                                    
## funcY4:FULL.p1.p2                                                    
## funcY1:FULL.p1.p3                                                    
## funcY2:FULL.p1.p3                                                    
## funcY3:FULL.p1.p3                                                    
## funcY4:FULL.p1.p3                                                    
## funcY1:FULL.p1.p4                                                    
## funcY2:FULL.p1.p4 -0.197                                             
## funcY3:FULL.p1.p4  0.547       -0.186                                
## funcY4:FULL.p1.p4 -0.214        0.299       -0.381                   
## funcY1:FULL.p1.p5 -0.069        0.014       -0.038        0.015      
## funcY2:FULL.p1.p5  0.014       -0.069        0.013       -0.021      
## funcY3:FULL.p1.p5 -0.038        0.013       -0.069        0.026      
## funcY4:FULL.p1.p5  0.015       -0.021        0.026       -0.069      
## funcY1:FULL.p1.p6  0.091       -0.018        0.050       -0.020      
## funcY2:FULL.p1.p6 -0.018        0.091       -0.017        0.027      
## funcY3:FULL.p1.p6  0.050       -0.017        0.091       -0.035      
## funcY4:FULL.p1.p6 -0.020        0.027       -0.035        0.091      
## funcY1:FULL.p2.p3  0.085       -0.017        0.046       -0.018      
## funcY2:FULL.p2.p3 -0.017        0.085       -0.016        0.025      
## funcY3:FULL.p2.p3  0.046       -0.016        0.085       -0.032      
## funcY4:FULL.p2.p3 -0.018        0.025       -0.032        0.085      
## funcY1:FULL.p2.p4  0.184       -0.036        0.101       -0.040      
## funcY2:FULL.p2.p4 -0.036        0.184       -0.034        0.055      
## funcY3:FULL.p2.p4  0.101       -0.034        0.184       -0.070      
## funcY4:FULL.p2.p4 -0.040        0.055       -0.070        0.184      
## funcY1:FULL.p2.p5 -0.049        0.010       -0.027        0.011      
## funcY2:FULL.p2.p5  0.010       -0.049        0.009       -0.015      
## funcY3:FULL.p2.p5 -0.027        0.009       -0.049        0.019      
## funcY4:FULL.p2.p5  0.011       -0.015        0.019       -0.049      
## funcY1:FULL.p2.p6 -0.036        0.007       -0.020        0.008      
## funcY2:FULL.p2.p6  0.007       -0.036        0.007       -0.011      
## funcY3:FULL.p2.p6 -0.020        0.007       -0.036        0.014      
## funcY4:FULL.p2.p6  0.008       -0.011        0.014       -0.036      
## funcY1:FULL.p3.p4 -0.231        0.046       -0.126        0.049      
## funcY2:FULL.p3.p4  0.046       -0.231        0.043       -0.069      
## funcY3:FULL.p3.p4 -0.126        0.043       -0.231        0.088      
## funcY4:FULL.p3.p4  0.049       -0.069        0.088       -0.231      
## funcY1:FULL.p3.p5 -0.018        0.004       -0.010        0.004      
## funcY2:FULL.p3.p5  0.004       -0.018        0.003       -0.005      
## funcY3:FULL.p3.p5 -0.010        0.003       -0.018        0.007      
## funcY4:FULL.p3.p5  0.004       -0.005        0.007       -0.018      
## funcY1:FULL.p3.p6 -0.001        0.000        0.000        0.000      
## funcY2:FULL.p3.p6  0.000       -0.001        0.000        0.000      
## funcY3:FULL.p3.p6  0.000        0.000       -0.001        0.000      
## funcY4:FULL.p3.p6  0.000        0.000        0.000       -0.001      
## funcY1:FULL.p4.p5 -0.067        0.013       -0.037        0.014      
## funcY2:FULL.p4.p5  0.013       -0.067        0.013       -0.020      
## funcY3:FULL.p4.p5 -0.037        0.013       -0.067        0.026      
## funcY4:FULL.p4.p5  0.014       -0.020        0.026       -0.067      
## funcY1:FULL.p4.p6  0.211       -0.042        0.116       -0.045      
## funcY2:FULL.p4.p6 -0.042        0.211       -0.039        0.063      
## funcY3:FULL.p4.p6  0.116       -0.039        0.211       -0.081      
## funcY4:FULL.p4.p6 -0.045        0.063       -0.081        0.211      
## funcY1:FULL.p5.p6 -0.068        0.014       -0.037        0.015      
## funcY2:FULL.p5.p6  0.014       -0.068        0.013       -0.020      
## funcY3:FULL.p5.p6 -0.037        0.013       -0.068        0.026      
## funcY4:FULL.p5.p6  0.015       -0.020        0.026       -0.068      
##                   fY1:FULL.1.5 fY2:FULL.1.5 fY3:FULL.1.5 fY4:FULL.1.5
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FULL.p1.p2                                                    
## funcY2:FULL.p1.p2                                                    
## funcY3:FULL.p1.p2                                                    
## funcY4:FULL.p1.p2                                                    
## funcY1:FULL.p1.p3                                                    
## funcY2:FULL.p1.p3                                                    
## funcY3:FULL.p1.p3                                                    
## funcY4:FULL.p1.p3                                                    
## funcY1:FULL.p1.p4                                                    
## funcY2:FULL.p1.p4                                                    
## funcY3:FULL.p1.p4                                                    
## funcY4:FULL.p1.p4                                                    
## funcY1:FULL.p1.p5                                                    
## funcY2:FULL.p1.p5 -0.197                                             
## funcY3:FULL.p1.p5  0.547       -0.186                                
## funcY4:FULL.p1.p5 -0.214        0.299       -0.381                   
## funcY1:FULL.p1.p6  0.259       -0.051        0.142       -0.055      
## funcY2:FULL.p1.p6 -0.051        0.259       -0.048        0.077      
## funcY3:FULL.p1.p6  0.142       -0.048        0.259       -0.099      
## funcY4:FULL.p1.p6 -0.055        0.077       -0.099        0.259      
## funcY1:FULL.p2.p3 -0.087        0.017       -0.048        0.019      
## funcY2:FULL.p2.p3  0.017       -0.087        0.016       -0.026      
## funcY3:FULL.p2.p3 -0.048        0.016       -0.087        0.033      
## funcY4:FULL.p2.p3  0.019       -0.026        0.033       -0.087      
## funcY1:FULL.p2.p4 -0.041        0.008       -0.022        0.009      
## funcY2:FULL.p2.p4  0.008       -0.041        0.008       -0.012      
## funcY3:FULL.p2.p4 -0.022        0.008       -0.041        0.016      
## funcY4:FULL.p2.p4  0.009       -0.012        0.016       -0.041      
## funcY1:FULL.p2.p5  0.128       -0.025        0.070       -0.027      
## funcY2:FULL.p2.p5 -0.025        0.128       -0.024        0.038      
## funcY3:FULL.p2.p5  0.070       -0.024        0.128       -0.049      
## funcY4:FULL.p2.p5 -0.027        0.038       -0.049        0.128      
## funcY1:FULL.p2.p6 -0.045        0.009       -0.025        0.010      
## funcY2:FULL.p2.p6  0.009       -0.045        0.008       -0.014      
## funcY3:FULL.p2.p6 -0.025        0.008       -0.045        0.017      
## funcY4:FULL.p2.p6  0.010       -0.014        0.017       -0.045      
## funcY1:FULL.p3.p4  0.027       -0.005        0.015       -0.006      
## funcY2:FULL.p3.p4 -0.005        0.027       -0.005        0.008      
## funcY3:FULL.p3.p4  0.015       -0.005        0.027       -0.010      
## funcY4:FULL.p3.p4 -0.006        0.008       -0.010        0.027      
## funcY1:FULL.p3.p5  0.187       -0.037        0.103       -0.040      
## funcY2:FULL.p3.p5 -0.037        0.187       -0.035        0.056      
## funcY3:FULL.p3.p5  0.103       -0.035        0.187       -0.071      
## funcY4:FULL.p3.p5 -0.040        0.056       -0.071        0.187      
## funcY1:FULL.p3.p6 -0.061        0.012       -0.034        0.013      
## funcY2:FULL.p3.p6  0.012       -0.061        0.011       -0.018      
## funcY3:FULL.p3.p6 -0.034        0.011       -0.061        0.023      
## funcY4:FULL.p3.p6  0.013       -0.018        0.023       -0.061      
## funcY1:FULL.p4.p5  0.272       -0.054        0.149       -0.058      
## funcY2:FULL.p4.p5 -0.054        0.272       -0.051        0.081      
## funcY3:FULL.p4.p5  0.149       -0.051        0.272       -0.104      
## funcY4:FULL.p4.p5 -0.058        0.081       -0.104        0.272      
## funcY1:FULL.p4.p6 -0.069        0.014       -0.038        0.015      
## funcY2:FULL.p4.p6  0.014       -0.069        0.013       -0.021      
## funcY3:FULL.p4.p6 -0.038        0.013       -0.069        0.026      
## funcY4:FULL.p4.p6  0.015       -0.021        0.026       -0.069      
## funcY1:FULL.p5.p6  0.161       -0.032        0.088       -0.034      
## funcY2:FULL.p5.p6 -0.032        0.161       -0.030        0.048      
## funcY3:FULL.p5.p6  0.088       -0.030        0.161       -0.061      
## funcY4:FULL.p5.p6 -0.034        0.048       -0.061        0.161      
##                   fY1:FULL.1.6 fY2:FULL.1.6 fY3:FULL.1.6 fY4:FULL.1.6
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FULL.p1.p2                                                    
## funcY2:FULL.p1.p2                                                    
## funcY3:FULL.p1.p2                                                    
## funcY4:FULL.p1.p2                                                    
## funcY1:FULL.p1.p3                                                    
## funcY2:FULL.p1.p3                                                    
## funcY3:FULL.p1.p3                                                    
## funcY4:FULL.p1.p3                                                    
## funcY1:FULL.p1.p4                                                    
## funcY2:FULL.p1.p4                                                    
## funcY3:FULL.p1.p4                                                    
## funcY4:FULL.p1.p4                                                    
## funcY1:FULL.p1.p5                                                    
## funcY2:FULL.p1.p5                                                    
## funcY3:FULL.p1.p5                                                    
## funcY4:FULL.p1.p5                                                    
## funcY1:FULL.p1.p6                                                    
## funcY2:FULL.p1.p6 -0.197                                             
## funcY3:FULL.p1.p6  0.547       -0.186                                
## funcY4:FULL.p1.p6 -0.214        0.299       -0.381                   
## funcY1:FULL.p2.p3 -0.068        0.013       -0.037        0.015      
## funcY2:FULL.p2.p3  0.013       -0.068        0.013       -0.020      
## funcY3:FULL.p2.p3 -0.037        0.013       -0.068        0.026      
## funcY4:FULL.p2.p3  0.015       -0.020        0.026       -0.068      
## funcY1:FULL.p2.p4  0.002        0.000        0.001        0.000      
## funcY2:FULL.p2.p4  0.000        0.002        0.000        0.001      
## funcY3:FULL.p2.p4  0.001        0.000        0.002       -0.001      
## funcY4:FULL.p2.p4  0.000        0.001       -0.001        0.002      
## funcY1:FULL.p2.p5  0.019       -0.004        0.010       -0.004      
## funcY2:FULL.p2.p5 -0.004        0.019       -0.004        0.006      
## funcY3:FULL.p2.p5  0.010       -0.004        0.019       -0.007      
## funcY4:FULL.p2.p5 -0.004        0.006       -0.007        0.019      
## funcY1:FULL.p2.p6  0.079       -0.016        0.043       -0.017      
## funcY2:FULL.p2.p6 -0.016        0.079       -0.015        0.024      
## funcY3:FULL.p2.p6  0.043       -0.015        0.079       -0.030      
## funcY4:FULL.p2.p6 -0.017        0.024       -0.030        0.079      
## funcY1:FULL.p3.p4 -0.020        0.004       -0.011        0.004      
## funcY2:FULL.p3.p4  0.004       -0.020        0.004       -0.006      
## funcY3:FULL.p3.p4 -0.011        0.004       -0.020        0.008      
## funcY4:FULL.p3.p4  0.004       -0.006        0.008       -0.020      
## funcY1:FULL.p3.p5 -0.066        0.013       -0.036        0.014      
## funcY2:FULL.p3.p5  0.013       -0.066        0.012       -0.020      
## funcY3:FULL.p3.p5 -0.036        0.012       -0.066        0.025      
## funcY4:FULL.p3.p5  0.014       -0.020        0.025       -0.066      
## funcY1:FULL.p3.p6  0.170       -0.034        0.093       -0.036      
## funcY2:FULL.p3.p6 -0.034        0.170       -0.032        0.051      
## funcY3:FULL.p3.p6  0.093       -0.032        0.170       -0.065      
## funcY4:FULL.p3.p6 -0.036        0.051       -0.065        0.170      
## funcY1:FULL.p4.p5 -0.035        0.007       -0.019        0.007      
## funcY2:FULL.p4.p5  0.007       -0.035        0.006       -0.010      
## funcY3:FULL.p4.p5 -0.019        0.006       -0.035        0.013      
## funcY4:FULL.p4.p5  0.007       -0.010        0.013       -0.035      
## funcY1:FULL.p4.p6  0.209       -0.041        0.115       -0.045      
## funcY2:FULL.p4.p6 -0.041        0.209       -0.039        0.063      
## funcY3:FULL.p4.p6  0.115       -0.039        0.209       -0.080      
## funcY4:FULL.p4.p6 -0.045        0.063       -0.080        0.209      
## funcY1:FULL.p5.p6  0.080       -0.016        0.044       -0.017      
## funcY2:FULL.p5.p6 -0.016        0.080       -0.015        0.024      
## funcY3:FULL.p5.p6  0.044       -0.015        0.080       -0.030      
## funcY4:FULL.p5.p6 -0.017        0.024       -0.030        0.080      
##                   fY1:FULL.2.3 fY2:FULL.2.3 fY3:FULL.2.3 fY4:FULL.2.3
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FULL.p1.p2                                                    
## funcY2:FULL.p1.p2                                                    
## funcY3:FULL.p1.p2                                                    
## funcY4:FULL.p1.p2                                                    
## funcY1:FULL.p1.p3                                                    
## funcY2:FULL.p1.p3                                                    
## funcY3:FULL.p1.p3                                                    
## funcY4:FULL.p1.p3                                                    
## funcY1:FULL.p1.p4                                                    
## funcY2:FULL.p1.p4                                                    
## funcY3:FULL.p1.p4                                                    
## funcY4:FULL.p1.p4                                                    
## funcY1:FULL.p1.p5                                                    
## funcY2:FULL.p1.p5                                                    
## funcY3:FULL.p1.p5                                                    
## funcY4:FULL.p1.p5                                                    
## funcY1:FULL.p1.p6                                                    
## funcY2:FULL.p1.p6                                                    
## funcY3:FULL.p1.p6                                                    
## funcY4:FULL.p1.p6                                                    
## funcY1:FULL.p2.p3                                                    
## funcY2:FULL.p2.p3 -0.197                                             
## funcY3:FULL.p2.p3  0.547       -0.186                                
## funcY4:FULL.p2.p3 -0.214        0.299       -0.381                   
## funcY1:FULL.p2.p4 -0.014        0.003       -0.008        0.003      
## funcY2:FULL.p2.p4  0.003       -0.014        0.003       -0.004      
## funcY3:FULL.p2.p4 -0.008        0.003       -0.014        0.005      
## funcY4:FULL.p2.p4  0.003       -0.004        0.005       -0.014      
## funcY1:FULL.p2.p5  0.001        0.000        0.000        0.000      
## funcY2:FULL.p2.p5  0.000        0.001        0.000        0.000      
## funcY3:FULL.p2.p5  0.000        0.000        0.001        0.000      
## funcY4:FULL.p2.p5  0.000        0.000        0.000        0.001      
## funcY1:FULL.p2.p6  0.009       -0.002        0.005       -0.002      
## funcY2:FULL.p2.p6 -0.002        0.009       -0.002        0.003      
## funcY3:FULL.p2.p6  0.005       -0.002        0.009       -0.003      
## funcY4:FULL.p2.p6 -0.002        0.003       -0.003        0.009      
## funcY1:FULL.p3.p4  0.010       -0.002        0.005       -0.002      
## funcY2:FULL.p3.p4 -0.002        0.010       -0.002        0.003      
## funcY3:FULL.p3.p4  0.005       -0.002        0.010       -0.004      
## funcY4:FULL.p3.p4 -0.002        0.003       -0.004        0.010      
## funcY1:FULL.p3.p5  0.110       -0.022        0.060       -0.024      
## funcY2:FULL.p3.p5 -0.022        0.110       -0.021        0.033      
## funcY3:FULL.p3.p5  0.060       -0.021        0.110       -0.042      
## funcY4:FULL.p3.p5 -0.024        0.033       -0.042        0.110      
## funcY1:FULL.p3.p6  0.233       -0.046        0.128       -0.050      
## funcY2:FULL.p3.p6 -0.046        0.233       -0.043        0.070      
## funcY3:FULL.p3.p6  0.128       -0.043        0.233       -0.089      
## funcY4:FULL.p3.p6 -0.050        0.070       -0.089        0.233      
## funcY1:FULL.p4.p5 -0.058        0.011       -0.032        0.012      
## funcY2:FULL.p4.p5  0.011       -0.058        0.011       -0.017      
## funcY3:FULL.p4.p5 -0.032        0.011       -0.058        0.022      
## funcY4:FULL.p4.p5  0.012       -0.017        0.022       -0.058      
## funcY1:FULL.p4.p6 -0.034        0.007       -0.018        0.007      
## funcY2:FULL.p4.p6  0.007       -0.034        0.006       -0.010      
## funcY3:FULL.p4.p6 -0.018        0.006       -0.034        0.013      
## funcY4:FULL.p4.p6  0.007       -0.010        0.013       -0.034      
## funcY1:FULL.p5.p6 -0.045        0.009       -0.025        0.010      
## funcY2:FULL.p5.p6  0.009       -0.045        0.008       -0.014      
## funcY3:FULL.p5.p6 -0.025        0.008       -0.045        0.017      
## funcY4:FULL.p5.p6  0.010       -0.014        0.017       -0.045      
##                   fY1:FULL.2.4 fY2:FULL.2.4 fY3:FULL.2.4 fY4:FULL.2.4
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FULL.p1.p2                                                    
## funcY2:FULL.p1.p2                                                    
## funcY3:FULL.p1.p2                                                    
## funcY4:FULL.p1.p2                                                    
## funcY1:FULL.p1.p3                                                    
## funcY2:FULL.p1.p3                                                    
## funcY3:FULL.p1.p3                                                    
## funcY4:FULL.p1.p3                                                    
## funcY1:FULL.p1.p4                                                    
## funcY2:FULL.p1.p4                                                    
## funcY3:FULL.p1.p4                                                    
## funcY4:FULL.p1.p4                                                    
## funcY1:FULL.p1.p5                                                    
## funcY2:FULL.p1.p5                                                    
## funcY3:FULL.p1.p5                                                    
## funcY4:FULL.p1.p5                                                    
## funcY1:FULL.p1.p6                                                    
## funcY2:FULL.p1.p6                                                    
## funcY3:FULL.p1.p6                                                    
## funcY4:FULL.p1.p6                                                    
## funcY1:FULL.p2.p3                                                    
## funcY2:FULL.p2.p3                                                    
## funcY3:FULL.p2.p3                                                    
## funcY4:FULL.p2.p3                                                    
## funcY1:FULL.p2.p4                                                    
## funcY2:FULL.p2.p4 -0.197                                             
## funcY3:FULL.p2.p4  0.547       -0.186                                
## funcY4:FULL.p2.p4 -0.214        0.299       -0.381                   
## funcY1:FULL.p2.p5  0.003       -0.001        0.002       -0.001      
## funcY2:FULL.p2.p5 -0.001        0.003       -0.001        0.001      
## funcY3:FULL.p2.p5  0.002       -0.001        0.003       -0.001      
## funcY4:FULL.p2.p5 -0.001        0.001       -0.001        0.003      
## funcY1:FULL.p2.p6 -0.009        0.002       -0.005        0.002      
## funcY2:FULL.p2.p6  0.002       -0.009        0.002       -0.003      
## funcY3:FULL.p2.p6 -0.005        0.002       -0.009        0.003      
## funcY4:FULL.p2.p6  0.002       -0.003        0.003       -0.009      
## funcY1:FULL.p3.p4  0.041       -0.008        0.022       -0.009      
## funcY2:FULL.p3.p4 -0.008        0.041       -0.008        0.012      
## funcY3:FULL.p3.p4  0.022       -0.008        0.041       -0.015      
## funcY4:FULL.p3.p4 -0.009        0.012       -0.015        0.041      
## funcY1:FULL.p3.p5 -0.033        0.006       -0.018        0.007      
## funcY2:FULL.p3.p5  0.006       -0.033        0.006       -0.010      
## funcY3:FULL.p3.p5 -0.018        0.006       -0.033        0.012      
## funcY4:FULL.p3.p5  0.007       -0.010        0.012       -0.033      
## funcY1:FULL.p3.p6  0.003       -0.001        0.002       -0.001      
## funcY2:FULL.p3.p6 -0.001        0.003       -0.001        0.001      
## funcY3:FULL.p3.p6  0.002       -0.001        0.003       -0.001      
## funcY4:FULL.p3.p6 -0.001        0.001       -0.001        0.003      
## funcY1:FULL.p4.p5  0.175       -0.034        0.096       -0.037      
## funcY2:FULL.p4.p5 -0.034        0.175       -0.033        0.052      
## funcY3:FULL.p4.p5  0.096       -0.033        0.175       -0.067      
## funcY4:FULL.p4.p5 -0.037        0.052       -0.067        0.175      
## funcY1:FULL.p4.p6  0.332       -0.066        0.182       -0.071      
## funcY2:FULL.p4.p6 -0.066        0.332       -0.062        0.099      
## funcY3:FULL.p4.p6  0.182       -0.062        0.332       -0.127      
## funcY4:FULL.p4.p6 -0.071        0.099       -0.127        0.332      
## funcY1:FULL.p5.p6 -0.037        0.007       -0.020        0.008      
## funcY2:FULL.p5.p6  0.007       -0.037        0.007       -0.011      
## funcY3:FULL.p5.p6 -0.020        0.007       -0.037        0.014      
## funcY4:FULL.p5.p6  0.008       -0.011        0.014       -0.037      
##                   fY1:FULL.2.5 fY2:FULL.2.5 fY3:FULL.2.5 fY4:FULL.2.5
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FULL.p1.p2                                                    
## funcY2:FULL.p1.p2                                                    
## funcY3:FULL.p1.p2                                                    
## funcY4:FULL.p1.p2                                                    
## funcY1:FULL.p1.p3                                                    
## funcY2:FULL.p1.p3                                                    
## funcY3:FULL.p1.p3                                                    
## funcY4:FULL.p1.p3                                                    
## funcY1:FULL.p1.p4                                                    
## funcY2:FULL.p1.p4                                                    
## funcY3:FULL.p1.p4                                                    
## funcY4:FULL.p1.p4                                                    
## funcY1:FULL.p1.p5                                                    
## funcY2:FULL.p1.p5                                                    
## funcY3:FULL.p1.p5                                                    
## funcY4:FULL.p1.p5                                                    
## funcY1:FULL.p1.p6                                                    
## funcY2:FULL.p1.p6                                                    
## funcY3:FULL.p1.p6                                                    
## funcY4:FULL.p1.p6                                                    
## funcY1:FULL.p2.p3                                                    
## funcY2:FULL.p2.p3                                                    
## funcY3:FULL.p2.p3                                                    
## funcY4:FULL.p2.p3                                                    
## funcY1:FULL.p2.p4                                                    
## funcY2:FULL.p2.p4                                                    
## funcY3:FULL.p2.p4                                                    
## funcY4:FULL.p2.p4                                                    
## funcY1:FULL.p2.p5                                                    
## funcY2:FULL.p2.p5 -0.197                                             
## funcY3:FULL.p2.p5  0.547       -0.186                                
## funcY4:FULL.p2.p5 -0.214        0.299       -0.381                   
## funcY1:FULL.p2.p6 -0.023        0.004       -0.012        0.005      
## funcY2:FULL.p2.p6  0.004       -0.023        0.004       -0.007      
## funcY3:FULL.p2.p6 -0.012        0.004       -0.023        0.009      
## funcY4:FULL.p2.p6  0.005       -0.007        0.009       -0.023      
## funcY1:FULL.p3.p4 -0.041        0.008       -0.022        0.009      
## funcY2:FULL.p3.p4  0.008       -0.041        0.008       -0.012      
## funcY3:FULL.p3.p4 -0.022        0.008       -0.041        0.016      
## funcY4:FULL.p3.p4  0.009       -0.012        0.016       -0.041      
## funcY1:FULL.p3.p5 -0.065        0.013       -0.036        0.014      
## funcY2:FULL.p3.p5  0.013       -0.065        0.012       -0.020      
## funcY3:FULL.p3.p5 -0.036        0.012       -0.065        0.025      
## funcY4:FULL.p3.p5  0.014       -0.020        0.025       -0.065      
## funcY1:FULL.p3.p6 -0.052        0.010       -0.028        0.011      
## funcY2:FULL.p3.p6  0.010       -0.052        0.010       -0.016      
## funcY3:FULL.p3.p6 -0.028        0.010       -0.052        0.020      
## funcY4:FULL.p3.p6  0.011       -0.016        0.020       -0.052      
## funcY1:FULL.p4.p5  0.104       -0.021        0.057       -0.022      
## funcY2:FULL.p4.p5 -0.021        0.104       -0.019        0.031      
## funcY3:FULL.p4.p5  0.057       -0.019        0.104       -0.040      
## funcY4:FULL.p4.p5 -0.022        0.031       -0.040        0.104      
## funcY1:FULL.p4.p6 -0.048        0.009       -0.026        0.010      
## funcY2:FULL.p4.p6  0.009       -0.048        0.009       -0.014      
## funcY3:FULL.p4.p6 -0.026        0.009       -0.048        0.018      
## funcY4:FULL.p4.p6  0.010       -0.014        0.018       -0.048      
## funcY1:FULL.p5.p6  0.040       -0.008        0.022       -0.009      
## funcY2:FULL.p5.p6 -0.008        0.040       -0.008        0.012      
## funcY3:FULL.p5.p6  0.022       -0.008        0.040       -0.015      
## funcY4:FULL.p5.p6 -0.009        0.012       -0.015        0.040      
##                   fY1:FULL.2.6 fY2:FULL.2.6 fY3:FULL.2.6 fY4:FULL.2.6
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FULL.p1.p2                                                    
## funcY2:FULL.p1.p2                                                    
## funcY3:FULL.p1.p2                                                    
## funcY4:FULL.p1.p2                                                    
## funcY1:FULL.p1.p3                                                    
## funcY2:FULL.p1.p3                                                    
## funcY3:FULL.p1.p3                                                    
## funcY4:FULL.p1.p3                                                    
## funcY1:FULL.p1.p4                                                    
## funcY2:FULL.p1.p4                                                    
## funcY3:FULL.p1.p4                                                    
## funcY4:FULL.p1.p4                                                    
## funcY1:FULL.p1.p5                                                    
## funcY2:FULL.p1.p5                                                    
## funcY3:FULL.p1.p5                                                    
## funcY4:FULL.p1.p5                                                    
## funcY1:FULL.p1.p6                                                    
## funcY2:FULL.p1.p6                                                    
## funcY3:FULL.p1.p6                                                    
## funcY4:FULL.p1.p6                                                    
## funcY1:FULL.p2.p3                                                    
## funcY2:FULL.p2.p3                                                    
## funcY3:FULL.p2.p3                                                    
## funcY4:FULL.p2.p3                                                    
## funcY1:FULL.p2.p4                                                    
## funcY2:FULL.p2.p4                                                    
## funcY3:FULL.p2.p4                                                    
## funcY4:FULL.p2.p4                                                    
## funcY1:FULL.p2.p5                                                    
## funcY2:FULL.p2.p5                                                    
## funcY3:FULL.p2.p5                                                    
## funcY4:FULL.p2.p5                                                    
## funcY1:FULL.p2.p6                                                    
## funcY2:FULL.p2.p6 -0.197                                             
## funcY3:FULL.p2.p6  0.547       -0.186                                
## funcY4:FULL.p2.p6 -0.214        0.299       -0.381                   
## funcY1:FULL.p3.p4 -0.005        0.001       -0.002        0.001      
## funcY2:FULL.p3.p4  0.001       -0.005        0.001       -0.001      
## funcY3:FULL.p3.p4 -0.002        0.001       -0.005        0.002      
## funcY4:FULL.p3.p4  0.001       -0.001        0.002       -0.005      
## funcY1:FULL.p3.p5 -0.068        0.013       -0.037        0.015      
## funcY2:FULL.p3.p5  0.013       -0.068        0.013       -0.020      
## funcY3:FULL.p3.p5 -0.037        0.013       -0.068        0.026      
## funcY4:FULL.p3.p5  0.015       -0.020        0.026       -0.068      
## funcY1:FULL.p3.p6  0.146       -0.029        0.080       -0.031      
## funcY2:FULL.p3.p6 -0.029        0.146       -0.027        0.044      
## funcY3:FULL.p3.p6  0.080       -0.027        0.146       -0.056      
## funcY4:FULL.p3.p6 -0.031        0.044       -0.056        0.146      
## funcY1:FULL.p4.p5 -0.036        0.007       -0.019        0.008      
## funcY2:FULL.p4.p5  0.007       -0.036        0.007       -0.011      
## funcY3:FULL.p4.p5 -0.019        0.007       -0.036        0.014      
## funcY4:FULL.p4.p5  0.008       -0.011        0.014       -0.036      
## funcY1:FULL.p4.p6  0.194       -0.038        0.106       -0.041      
## funcY2:FULL.p4.p6 -0.038        0.194       -0.036        0.058      
## funcY3:FULL.p4.p6  0.106       -0.036        0.194       -0.074      
## funcY4:FULL.p4.p6 -0.041        0.058       -0.074        0.194      
## funcY1:FULL.p5.p6 -0.003        0.001       -0.002        0.001      
## funcY2:FULL.p5.p6  0.001       -0.003        0.001       -0.001      
## funcY3:FULL.p5.p6 -0.002        0.001       -0.003        0.001      
## funcY4:FULL.p5.p6  0.001       -0.001        0.001       -0.003      
##                   fY1:FULL.3.4 fY2:FULL.3.4 fY3:FULL.3.4 fY4:FULL.3.4
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FULL.p1.p2                                                    
## funcY2:FULL.p1.p2                                                    
## funcY3:FULL.p1.p2                                                    
## funcY4:FULL.p1.p2                                                    
## funcY1:FULL.p1.p3                                                    
## funcY2:FULL.p1.p3                                                    
## funcY3:FULL.p1.p3                                                    
## funcY4:FULL.p1.p3                                                    
## funcY1:FULL.p1.p4                                                    
## funcY2:FULL.p1.p4                                                    
## funcY3:FULL.p1.p4                                                    
## funcY4:FULL.p1.p4                                                    
## funcY1:FULL.p1.p5                                                    
## funcY2:FULL.p1.p5                                                    
## funcY3:FULL.p1.p5                                                    
## funcY4:FULL.p1.p5                                                    
## funcY1:FULL.p1.p6                                                    
## funcY2:FULL.p1.p6                                                    
## funcY3:FULL.p1.p6                                                    
## funcY4:FULL.p1.p6                                                    
## funcY1:FULL.p2.p3                                                    
## funcY2:FULL.p2.p3                                                    
## funcY3:FULL.p2.p3                                                    
## funcY4:FULL.p2.p3                                                    
## funcY1:FULL.p2.p4                                                    
## funcY2:FULL.p2.p4                                                    
## funcY3:FULL.p2.p4                                                    
## funcY4:FULL.p2.p4                                                    
## funcY1:FULL.p2.p5                                                    
## funcY2:FULL.p2.p5                                                    
## funcY3:FULL.p2.p5                                                    
## funcY4:FULL.p2.p5                                                    
## funcY1:FULL.p2.p6                                                    
## funcY2:FULL.p2.p6                                                    
## funcY3:FULL.p2.p6                                                    
## funcY4:FULL.p2.p6                                                    
## funcY1:FULL.p3.p4                                                    
## funcY2:FULL.p3.p4 -0.197                                             
## funcY3:FULL.p3.p4  0.547       -0.186                                
## funcY4:FULL.p3.p4 -0.214        0.299       -0.381                   
## funcY1:FULL.p3.p5 -0.036        0.007       -0.020        0.008      
## funcY2:FULL.p3.p5  0.007       -0.036        0.007       -0.011      
## funcY3:FULL.p3.p5 -0.020        0.007       -0.036        0.014      
## funcY4:FULL.p3.p5  0.008       -0.011        0.014       -0.036      
## funcY1:FULL.p3.p6  0.107       -0.021        0.058       -0.023      
## funcY2:FULL.p3.p6 -0.021        0.107       -0.020        0.032      
## funcY3:FULL.p3.p6  0.058       -0.020        0.107       -0.041      
## funcY4:FULL.p3.p6 -0.023        0.032       -0.041        0.107      
## funcY1:FULL.p4.p5  0.137       -0.027        0.075       -0.029      
## funcY2:FULL.p4.p5 -0.027        0.137       -0.026        0.041      
## funcY3:FULL.p4.p5  0.075       -0.026        0.137       -0.052      
## funcY4:FULL.p4.p5 -0.029        0.041       -0.052        0.137      
## funcY1:FULL.p4.p6  0.117       -0.023        0.064       -0.025      
## funcY2:FULL.p4.p6 -0.023        0.117       -0.022        0.035      
## funcY3:FULL.p4.p6  0.064       -0.022        0.117       -0.045      
## funcY4:FULL.p4.p6 -0.025        0.035       -0.045        0.117      
## funcY1:FULL.p5.p6 -0.033        0.007       -0.018        0.007      
## funcY2:FULL.p5.p6  0.007       -0.033        0.006       -0.010      
## funcY3:FULL.p5.p6 -0.018        0.006       -0.033        0.013      
## funcY4:FULL.p5.p6  0.007       -0.010        0.013       -0.033      
##                   fY1:FULL.3.5 fY2:FULL.3.5 fY3:FULL.3.5 fY4:FULL.3.5
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FULL.p1.p2                                                    
## funcY2:FULL.p1.p2                                                    
## funcY3:FULL.p1.p2                                                    
## funcY4:FULL.p1.p2                                                    
## funcY1:FULL.p1.p3                                                    
## funcY2:FULL.p1.p3                                                    
## funcY3:FULL.p1.p3                                                    
## funcY4:FULL.p1.p3                                                    
## funcY1:FULL.p1.p4                                                    
## funcY2:FULL.p1.p4                                                    
## funcY3:FULL.p1.p4                                                    
## funcY4:FULL.p1.p4                                                    
## funcY1:FULL.p1.p5                                                    
## funcY2:FULL.p1.p5                                                    
## funcY3:FULL.p1.p5                                                    
## funcY4:FULL.p1.p5                                                    
## funcY1:FULL.p1.p6                                                    
## funcY2:FULL.p1.p6                                                    
## funcY3:FULL.p1.p6                                                    
## funcY4:FULL.p1.p6                                                    
## funcY1:FULL.p2.p3                                                    
## funcY2:FULL.p2.p3                                                    
## funcY3:FULL.p2.p3                                                    
## funcY4:FULL.p2.p3                                                    
## funcY1:FULL.p2.p4                                                    
## funcY2:FULL.p2.p4                                                    
## funcY3:FULL.p2.p4                                                    
## funcY4:FULL.p2.p4                                                    
## funcY1:FULL.p2.p5                                                    
## funcY2:FULL.p2.p5                                                    
## funcY3:FULL.p2.p5                                                    
## funcY4:FULL.p2.p5                                                    
## funcY1:FULL.p2.p6                                                    
## funcY2:FULL.p2.p6                                                    
## funcY3:FULL.p2.p6                                                    
## funcY4:FULL.p2.p6                                                    
## funcY1:FULL.p3.p4                                                    
## funcY2:FULL.p3.p4                                                    
## funcY3:FULL.p3.p4                                                    
## funcY4:FULL.p3.p4                                                    
## funcY1:FULL.p3.p5                                                    
## funcY2:FULL.p3.p5 -0.197                                             
## funcY3:FULL.p3.p5  0.547       -0.186                                
## funcY4:FULL.p3.p5 -0.214        0.299       -0.381                   
## funcY1:FULL.p3.p6  0.113       -0.022        0.062       -0.024      
## funcY2:FULL.p3.p6 -0.022        0.113       -0.021        0.034      
## funcY3:FULL.p3.p6  0.062       -0.021        0.113       -0.043      
## funcY4:FULL.p3.p6 -0.024        0.034       -0.043        0.113      
## funcY1:FULL.p4.p5  0.160       -0.032        0.088       -0.034      
## funcY2:FULL.p4.p5 -0.032        0.160       -0.030        0.048      
## funcY3:FULL.p4.p5  0.088       -0.030        0.160       -0.061      
## funcY4:FULL.p4.p5 -0.034        0.048       -0.061        0.160      
## funcY1:FULL.p4.p6 -0.069        0.014       -0.038        0.015      
## funcY2:FULL.p4.p6  0.014       -0.069        0.013       -0.021      
## funcY3:FULL.p4.p6 -0.038        0.013       -0.069        0.026      
## funcY4:FULL.p4.p6  0.015       -0.021        0.026       -0.069      
## funcY1:FULL.p5.p6  0.073       -0.014        0.040       -0.016      
## funcY2:FULL.p5.p6 -0.014        0.073       -0.014        0.022      
## funcY3:FULL.p5.p6  0.040       -0.014        0.073       -0.028      
## funcY4:FULL.p5.p6 -0.016        0.022       -0.028        0.073      
##                   fY1:FULL.3.6 fY2:FULL.3.6 fY3:FULL.3.6 fY4:FULL.3.6
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FULL.p1.p2                                                    
## funcY2:FULL.p1.p2                                                    
## funcY3:FULL.p1.p2                                                    
## funcY4:FULL.p1.p2                                                    
## funcY1:FULL.p1.p3                                                    
## funcY2:FULL.p1.p3                                                    
## funcY3:FULL.p1.p3                                                    
## funcY4:FULL.p1.p3                                                    
## funcY1:FULL.p1.p4                                                    
## funcY2:FULL.p1.p4                                                    
## funcY3:FULL.p1.p4                                                    
## funcY4:FULL.p1.p4                                                    
## funcY1:FULL.p1.p5                                                    
## funcY2:FULL.p1.p5                                                    
## funcY3:FULL.p1.p5                                                    
## funcY4:FULL.p1.p5                                                    
## funcY1:FULL.p1.p6                                                    
## funcY2:FULL.p1.p6                                                    
## funcY3:FULL.p1.p6                                                    
## funcY4:FULL.p1.p6                                                    
## funcY1:FULL.p2.p3                                                    
## funcY2:FULL.p2.p3                                                    
## funcY3:FULL.p2.p3                                                    
## funcY4:FULL.p2.p3                                                    
## funcY1:FULL.p2.p4                                                    
## funcY2:FULL.p2.p4                                                    
## funcY3:FULL.p2.p4                                                    
## funcY4:FULL.p2.p4                                                    
## funcY1:FULL.p2.p5                                                    
## funcY2:FULL.p2.p5                                                    
## funcY3:FULL.p2.p5                                                    
## funcY4:FULL.p2.p5                                                    
## funcY1:FULL.p2.p6                                                    
## funcY2:FULL.p2.p6                                                    
## funcY3:FULL.p2.p6                                                    
## funcY4:FULL.p2.p6                                                    
## funcY1:FULL.p3.p4                                                    
## funcY2:FULL.p3.p4                                                    
## funcY3:FULL.p3.p4                                                    
## funcY4:FULL.p3.p4                                                    
## funcY1:FULL.p3.p5                                                    
## funcY2:FULL.p3.p5                                                    
## funcY3:FULL.p3.p5                                                    
## funcY4:FULL.p3.p5                                                    
## funcY1:FULL.p3.p6                                                    
## funcY2:FULL.p3.p6 -0.197                                             
## funcY3:FULL.p3.p6  0.547       -0.186                                
## funcY4:FULL.p3.p6 -0.214        0.299       -0.381                   
## funcY1:FULL.p4.p5 -0.042        0.008       -0.023        0.009      
## funcY2:FULL.p4.p5  0.008       -0.042        0.008       -0.013      
## funcY3:FULL.p4.p5 -0.023        0.008       -0.042        0.016      
## funcY4:FULL.p4.p5  0.009       -0.013        0.016       -0.042      
## funcY1:FULL.p4.p6  0.201       -0.040        0.110       -0.043      
## funcY2:FULL.p4.p6 -0.040        0.201       -0.037        0.060      
## funcY3:FULL.p4.p6  0.110       -0.037        0.201       -0.077      
## funcY4:FULL.p4.p6 -0.043        0.060       -0.077        0.201      
## funcY1:FULL.p5.p6  0.114       -0.023        0.063       -0.024      
## funcY2:FULL.p5.p6 -0.023        0.114       -0.021        0.034      
## funcY3:FULL.p5.p6  0.063       -0.021        0.114       -0.044      
## funcY4:FULL.p5.p6 -0.024        0.034       -0.044        0.114      
##                   fY1:FULL.4.5 fY2:FULL.4.5 fY3:FULL.4.5 fY4:FULL.4.5
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FULL.p1.p2                                                    
## funcY2:FULL.p1.p2                                                    
## funcY3:FULL.p1.p2                                                    
## funcY4:FULL.p1.p2                                                    
## funcY1:FULL.p1.p3                                                    
## funcY2:FULL.p1.p3                                                    
## funcY3:FULL.p1.p3                                                    
## funcY4:FULL.p1.p3                                                    
## funcY1:FULL.p1.p4                                                    
## funcY2:FULL.p1.p4                                                    
## funcY3:FULL.p1.p4                                                    
## funcY4:FULL.p1.p4                                                    
## funcY1:FULL.p1.p5                                                    
## funcY2:FULL.p1.p5                                                    
## funcY3:FULL.p1.p5                                                    
## funcY4:FULL.p1.p5                                                    
## funcY1:FULL.p1.p6                                                    
## funcY2:FULL.p1.p6                                                    
## funcY3:FULL.p1.p6                                                    
## funcY4:FULL.p1.p6                                                    
## funcY1:FULL.p2.p3                                                    
## funcY2:FULL.p2.p3                                                    
## funcY3:FULL.p2.p3                                                    
## funcY4:FULL.p2.p3                                                    
## funcY1:FULL.p2.p4                                                    
## funcY2:FULL.p2.p4                                                    
## funcY3:FULL.p2.p4                                                    
## funcY4:FULL.p2.p4                                                    
## funcY1:FULL.p2.p5                                                    
## funcY2:FULL.p2.p5                                                    
## funcY3:FULL.p2.p5                                                    
## funcY4:FULL.p2.p5                                                    
## funcY1:FULL.p2.p6                                                    
## funcY2:FULL.p2.p6                                                    
## funcY3:FULL.p2.p6                                                    
## funcY4:FULL.p2.p6                                                    
## funcY1:FULL.p3.p4                                                    
## funcY2:FULL.p3.p4                                                    
## funcY3:FULL.p3.p4                                                    
## funcY4:FULL.p3.p4                                                    
## funcY1:FULL.p3.p5                                                    
## funcY2:FULL.p3.p5                                                    
## funcY3:FULL.p3.p5                                                    
## funcY4:FULL.p3.p5                                                    
## funcY1:FULL.p3.p6                                                    
## funcY2:FULL.p3.p6                                                    
## funcY3:FULL.p3.p6                                                    
## funcY4:FULL.p3.p6                                                    
## funcY1:FULL.p4.p5                                                    
## funcY2:FULL.p4.p5 -0.197                                             
## funcY3:FULL.p4.p5  0.547       -0.186                                
## funcY4:FULL.p4.p5 -0.214        0.299       -0.381                   
## funcY1:FULL.p4.p6  0.190       -0.037        0.104       -0.041      
## funcY2:FULL.p4.p6 -0.037        0.190       -0.035        0.057      
## funcY3:FULL.p4.p6  0.104       -0.035        0.190       -0.072      
## funcY4:FULL.p4.p6 -0.041        0.057       -0.072        0.190      
## funcY1:FULL.p5.p6  0.167       -0.033        0.091       -0.036      
## funcY2:FULL.p5.p6 -0.033        0.167       -0.031        0.050      
## funcY3:FULL.p5.p6  0.091       -0.031        0.167       -0.064      
## funcY4:FULL.p5.p6 -0.036        0.050       -0.064        0.167      
##                   fY1:FULL.4.6 fY2:FULL.4.6 fY3:FULL.4.6 fY4:FULL.4.6
## funcY2:p1_ID                                                         
## funcY3:p1_ID                                                         
## funcY4:p1_ID                                                         
## funcY1:p2_ID                                                         
## funcY2:p2_ID                                                         
## funcY3:p2_ID                                                         
## funcY4:p2_ID                                                         
## funcY1:p3_ID                                                         
## funcY2:p3_ID                                                         
## funcY3:p3_ID                                                         
## funcY4:p3_ID                                                         
## funcY1:p4_ID                                                         
## funcY2:p4_ID                                                         
## funcY3:p4_ID                                                         
## funcY4:p4_ID                                                         
## funcY1:p5_ID                                                         
## funcY2:p5_ID                                                         
## funcY3:p5_ID                                                         
## funcY4:p5_ID                                                         
## funcY1:p6_ID                                                         
## funcY2:p6_ID                                                         
## funcY3:p6_ID                                                         
## funcY4:p6_ID                                                         
## funcY1:FULL.p1.p2                                                    
## funcY2:FULL.p1.p2                                                    
## funcY3:FULL.p1.p2                                                    
## funcY4:FULL.p1.p2                                                    
## funcY1:FULL.p1.p3                                                    
## funcY2:FULL.p1.p3                                                    
## funcY3:FULL.p1.p3                                                    
## funcY4:FULL.p1.p3                                                    
## funcY1:FULL.p1.p4                                                    
## funcY2:FULL.p1.p4                                                    
## funcY3:FULL.p1.p4                                                    
## funcY4:FULL.p1.p4                                                    
## funcY1:FULL.p1.p5                                                    
## funcY2:FULL.p1.p5                                                    
## funcY3:FULL.p1.p5                                                    
## funcY4:FULL.p1.p5                                                    
## funcY1:FULL.p1.p6                                                    
## funcY2:FULL.p1.p6                                                    
## funcY3:FULL.p1.p6                                                    
## funcY4:FULL.p1.p6                                                    
## funcY1:FULL.p2.p3                                                    
## funcY2:FULL.p2.p3                                                    
## funcY3:FULL.p2.p3                                                    
## funcY4:FULL.p2.p3                                                    
## funcY1:FULL.p2.p4                                                    
## funcY2:FULL.p2.p4                                                    
## funcY3:FULL.p2.p4                                                    
## funcY4:FULL.p2.p4                                                    
## funcY1:FULL.p2.p5                                                    
## funcY2:FULL.p2.p5                                                    
## funcY3:FULL.p2.p5                                                    
## funcY4:FULL.p2.p5                                                    
## funcY1:FULL.p2.p6                                                    
## funcY2:FULL.p2.p6                                                    
## funcY3:FULL.p2.p6                                                    
## funcY4:FULL.p2.p6                                                    
## funcY1:FULL.p3.p4                                                    
## funcY2:FULL.p3.p4                                                    
## funcY3:FULL.p3.p4                                                    
## funcY4:FULL.p3.p4                                                    
## funcY1:FULL.p3.p5                                                    
## funcY2:FULL.p3.p5                                                    
## funcY3:FULL.p3.p5                                                    
## funcY4:FULL.p3.p5                                                    
## funcY1:FULL.p3.p6                                                    
## funcY2:FULL.p3.p6                                                    
## funcY3:FULL.p3.p6                                                    
## funcY4:FULL.p3.p6                                                    
## funcY1:FULL.p4.p5                                                    
## funcY2:FULL.p4.p5                                                    
## funcY3:FULL.p4.p5                                                    
## funcY4:FULL.p4.p5                                                    
## funcY1:FULL.p4.p6                                                    
## funcY2:FULL.p4.p6 -0.197                                             
## funcY3:FULL.p4.p6  0.547       -0.186                                
## funcY4:FULL.p4.p6 -0.214        0.299       -0.381                   
## funcY1:FULL.p5.p6  0.086       -0.017        0.047       -0.018      
## funcY2:FULL.p5.p6 -0.017        0.086       -0.016        0.026      
## funcY3:FULL.p5.p6  0.047       -0.016        0.086       -0.033      
## funcY4:FULL.p5.p6 -0.018        0.026       -0.033        0.086      
##                   fY1:FULL.5 fY2:FULL.5 fY3:FULL.5
## funcY2:p1_ID                                      
## funcY3:p1_ID                                      
## funcY4:p1_ID                                      
## funcY1:p2_ID                                      
## funcY2:p2_ID                                      
## funcY3:p2_ID                                      
## funcY4:p2_ID                                      
## funcY1:p3_ID                                      
## funcY2:p3_ID                                      
## funcY3:p3_ID                                      
## funcY4:p3_ID                                      
## funcY1:p4_ID                                      
## funcY2:p4_ID                                      
## funcY3:p4_ID                                      
## funcY4:p4_ID                                      
## funcY1:p5_ID                                      
## funcY2:p5_ID                                      
## funcY3:p5_ID                                      
## funcY4:p5_ID                                      
## funcY1:p6_ID                                      
## funcY2:p6_ID                                      
## funcY3:p6_ID                                      
## funcY4:p6_ID                                      
## funcY1:FULL.p1.p2                                 
## funcY2:FULL.p1.p2                                 
## funcY3:FULL.p1.p2                                 
## funcY4:FULL.p1.p2                                 
## funcY1:FULL.p1.p3                                 
## funcY2:FULL.p1.p3                                 
## funcY3:FULL.p1.p3                                 
## funcY4:FULL.p1.p3                                 
## funcY1:FULL.p1.p4                                 
## funcY2:FULL.p1.p4                                 
## funcY3:FULL.p1.p4                                 
## funcY4:FULL.p1.p4                                 
## funcY1:FULL.p1.p5                                 
## funcY2:FULL.p1.p5                                 
## funcY3:FULL.p1.p5                                 
## funcY4:FULL.p1.p5                                 
## funcY1:FULL.p1.p6                                 
## funcY2:FULL.p1.p6                                 
## funcY3:FULL.p1.p6                                 
## funcY4:FULL.p1.p6                                 
## funcY1:FULL.p2.p3                                 
## funcY2:FULL.p2.p3                                 
## funcY3:FULL.p2.p3                                 
## funcY4:FULL.p2.p3                                 
## funcY1:FULL.p2.p4                                 
## funcY2:FULL.p2.p4                                 
## funcY3:FULL.p2.p4                                 
## funcY4:FULL.p2.p4                                 
## funcY1:FULL.p2.p5                                 
## funcY2:FULL.p2.p5                                 
## funcY3:FULL.p2.p5                                 
## funcY4:FULL.p2.p5                                 
## funcY1:FULL.p2.p6                                 
## funcY2:FULL.p2.p6                                 
## funcY3:FULL.p2.p6                                 
## funcY4:FULL.p2.p6                                 
## funcY1:FULL.p3.p4                                 
## funcY2:FULL.p3.p4                                 
## funcY3:FULL.p3.p4                                 
## funcY4:FULL.p3.p4                                 
## funcY1:FULL.p3.p5                                 
## funcY2:FULL.p3.p5                                 
## funcY3:FULL.p3.p5                                 
## funcY4:FULL.p3.p5                                 
## funcY1:FULL.p3.p6                                 
## funcY2:FULL.p3.p6                                 
## funcY3:FULL.p3.p6                                 
## funcY4:FULL.p3.p6                                 
## funcY1:FULL.p4.p5                                 
## funcY2:FULL.p4.p5                                 
## funcY3:FULL.p4.p5                                 
## funcY4:FULL.p4.p5                                 
## funcY1:FULL.p4.p6                                 
## funcY2:FULL.p4.p6                                 
## funcY3:FULL.p4.p6                                 
## funcY4:FULL.p4.p6                                 
## funcY1:FULL.p5.p6                                 
## funcY2:FULL.p5.p6 -0.197                          
## funcY3:FULL.p5.p6  0.547     -0.186               
## funcY4:FULL.p5.p6 -0.214      0.299     -0.381    
## 
## Standardized residuals:
##         Min          Q1         Med          Q3         Max 
## -3.00348467 -0.72722889  0.01028241  0.72908572  3.97273801 
## 
## Residual standard error: 2.645615 
## Degrees of freedom: 1536 total; 1452 residual
Model Selection
image description image description
training-deepDive-multivariate-selection.knit

As with the univariate DI models found in the Starter Pack, we can formally compare across the models fit in the previous step. We suggest to follow the workflow set out below.


We begin by selecting the most suitable structure for the variance covariance matrix of our ecosystem functions (\(\Sigma_m\)). We use AICc (the corrected AIC) as the models are not nested.

AICc(IDModel_UN); AICc(IDModel_CS)
## [1] 6343.674
## [1] 6976.237

In this case, the UN structure has a significantly lower AICc value so we assume this structure to be the true one underlying our responses for the rest of our selection workflow.


Next, we compare our ID model (which we refit using ML and our chosen variance structure) to the next most complex model, the AV DI model. As they are nested models, we can use a likelihood ratio test to test the hypothesis that the additional term (the AV interaction term) is equal to zero.

anova(IDModel, AVModel)
##         Model df      AIC      BIC    logLik   Test  L.Ratio p-value
## IDModel     1 34 6338.414 6519.870 -3135.207                        
## AVModel     2 38 6191.770 6394.573 -3057.885 1 vs 2 154.6447  <.0001

As the p-value is <0.05, we reject the null hypothesis and select the AV model over the ID model.

As we can group our species by functional traits (arbitrarily in this case as they are simulated), we next pit our current model (AV) against the functional group (FG) model.

anova(AVModel, FGModel)
##         Model df      AIC      BIC    logLik   Test  L.Ratio p-value
## AVModel     1 38 6191.770 6394.573 -3057.885                        
## FGModel     2 58 6222.267 6531.810 -3053.134 1 vs 2 9.502605  0.9763

As the p-value this time is >0.05, we fail to reject the null hypothesis and continue our selection with the AV model.

Next, we compare the AV model to the ADD model.

anova(AVModel, ADDModel)
##          Model df      AIC      BIC    logLik   Test  L.Ratio p-value
## AVModel      1 38 6191.770 6394.573 -3057.885                        
## ADDModel     2 58 6222.885 6532.427 -3053.442 1 vs 2 8.884909  0.9842

Once again, the AV model is selected over the more complex ADD model.

Finally, we compare the AV model to the most complex structure, the FULL model.

anova(AVModel, FULLModel)
##           Model df      AIC      BIC    logLik   Test  L.Ratio p-value
## AVModel       1 38 6191.770 6394.573 -3057.885                        
## FULLModel     2 94 6254.586 6756.259 -3033.293 1 vs 2 49.18332  0.7286

Once again, the p-value is >0.05 so therefore our selected DI model structure is the AV model.

Now, we include the additional treatment term, ‘treat’ and compare this model to our original AV model.

AVModel_treat <- DImulti(y = c("Y1", "Y2", "Y3", "Y4"), eco_func = c("NA", "UN"), unit_IDs = "plot", 
                   prop = 2:7, data = simMV, DImodel = "AV", method = "ML",
                   extra_fixed = ~ treat)

anova(AVModel, AVModel_treat)
##               Model df      AIC      BIC    logLik   Test  L.Ratio p-value
## AVModel           1 38 6191.770 6394.573 -3057.885                        
## AVModel_treat     2 42 5602.953 5827.104 -2759.476 1 vs 2 596.8172  <.0001

As the p-value is <0.005, we reject the null hypothesis that the coefficient of the additional term, ‘treat’, is equal to zero. Therefore we opt to include it in our final model, which we refit using the ‘REML’ estimation method as it provides us with unbiased variance estimates and we will no longer be comparing models which vary in fixed effects.

FinalModel <- DImulti(y = c("Y1", "Y2", "Y3", "Y4"), eco_func = c("NA", "UN"), unit_IDs = "plot", 
                   prop = 2:7, data = simMV, DImodel = "AV", method = "REML",
                   extra_fixed = ~ treat)
Interpretation of the Selected Model
image description image description
training-deepDive-multivariate-interpret.knit

From the ‘Model Selection’ section of this page, we found that our best fitting model used the AV interaction structure and included the additional treatment term. The algebraic formulation of this model is as follows:

\[\large y_{km}=\sum_{i=1}^{S=6} \beta_{ik} p_{im} + \delta_{AVk} \sum_{i,j=1 \\ i<j}^{S=6} p_{im}p_{jm} + \alpha_{k} A_{m} + \epsilon_{km}\]

Where \(y_{km}\) represents the recorded value, \(y\), of the \(k^{th}\) ecosystem function (where \(k\) goes from \(1\) to \(K=4\)) from the \(m^{th}\) experimental/observational study unit (where \(m\) goes from \(1\) to \(M=384\)). The coefficient \(\beta_{ik}\) scaled by the initial proportion \(p\) of species \(i\) forms the ID effect of said species for the ecosystem function response \(k\). The interaction term \(\delta_{AV}\) is maximised when all species in the pool are equally represented. The coefficient \(\alpha\) represents the ‘boost’ provided to the \(k^{th}\) ecosystem function when the plot \(m\) has a ‘treat’ of level 1 (as opposed to 0). The error of this model, \(\epsilon\) is assumed to follow a multivariate Normal distribution with mean 0 and variance \(\Sigma^{*}\), where \(\Sigma^{*}\) is a \(KM \times KM\) block-diagonal matrix. The variance-covariance matrix is unstructured, i.e. each element is allowed to vary from one another, see below.


\[\Sigma^{*} = \begin{bmatrix} \Sigma_1 & & 0\\ & \ddots & \\ 0 & & \Sigma_M \end{bmatrix}\]
\[\Sigma_m = \begin{bmatrix} \sigma_1^2 & \sigma_{1,2} & ... & \sigma_{1,K}\\ \sigma_{1,2} & \sigma_{2}^2 & ... & \sigma_{2,K}\\ \vdots & \vdots & \ddots & \vdots \\ \sigma_{1,K} & \sigma_{2, K} & ... & \sigma_K^2 \end{bmatrix}\]

We can use summary() or print() to view our model in R.

print(FinalModel)
## Note: 
## Method Used = REML 
## Correlation Structure Used = UN
##  Average Term Model
## Theta value(s) = 1
## 
## Generalized least squares fit by REML
##   Model: value ~ 0 + func:((p1_ID + p2_ID + p3_ID + p4_ID + p5_ID + p6_ID +      AV) + treat) 
##       AIC       BIC    logLik 
##  5619.020  5842.287 -2767.510 
## 
##  Multivariate Correlation Structure: General
##  Formula: ~0 | plot 
##  Parameter estimate(s):
##  Correlation: 
##   1      2      3     
## 2 -0.108              
## 3 -0.019 -0.032       
## 4  0.041  0.241 -0.104
## 
## 
## Table: Fixed Effect Coefficients
## 
##                 Beta     Std. Error   t-value   p-value      Signif 
## --------------  -------  -----------  --------  -----------  -------
## funcY1:p1_ID    +6.659   0.554        12.024    7.318e-32    ***    
## funcY2:p1_ID    +5.023   0.299        16.784    4.368e-58    ***    
## funcY3:p1_ID    -1.110   0.434        -2.557    0.01065      *      
## funcY4:p1_ID    +4.637   0.331        14.016    4.858e-42    ***    
## funcY1:p2_ID    -0.007   0.558        -0.013    0.9897              
## funcY2:p2_ID    +4.288   0.301        14.229    3.367e-43    ***    
## funcY3:p2_ID    +4.405   0.437        10.082    3.536e-23    ***    
## funcY4:p2_ID    +5.353   0.333        16.072    9.257e-54    ***    
## funcY1:p3_ID    +6.948   0.597        11.639    4.849e-30    ***    
## funcY2:p3_ID    +4.395   0.323        13.624    6.085e-40    ***    
## funcY3:p3_ID    +1.325   0.468        2.831     0.004695     **     
## funcY4:p3_ID    -0.614   0.357        -1.722    0.08533      +      
## funcY1:p4_ID    +2.581   0.545        4.733     2.426e-06    ***    
## funcY2:p4_ID    +1.993   0.295        6.763     1.928e-11    ***    
## funcY3:p4_ID    +5.873   0.427        13.745    1.382e-40    ***    
## funcY4:p4_ID    +5.400   0.326        16.579    7.949e-57    ***    
## funcY1:p5_ID    -1.034   0.581        -1.778    0.07554      +      
## funcY2:p5_ID    +4.733   0.314        15.071    6.615e-48    ***    
## funcY3:p5_ID    +1.448   0.455        3.180     0.001505     **     
## funcY4:p5_ID    +7.225   0.347        20.812    9.598e-85    ***    
## funcY1:p6_ID    +4.374   0.533        8.202     5.012e-16    ***    
## funcY2:p6_ID    +7.332   0.288        25.442    4.739e-119   ***    
## funcY3:p6_ID    +6.508   0.418        15.571    8.448e-51    ***    
## funcY4:p6_ID    -0.146   0.319        -0.458    0.647               
## funcY1:AV       +2.215   1.085        2.041     0.04146      *      
## funcY2:AV       +7.502   0.586        12.791    1.224e-35    ***    
## funcY3:AV       +2.470   0.850        2.905     0.003727     **     
## funcY4:AV       +0.037   0.648        0.058     0.9541              
## funcY1:treat1   +3.368   0.214        15.701    1.468e-51    ***    
## funcY2:treat1   -0.449   0.116        -3.875    0.0001113    ***    
## funcY3:treat1   +5.602   0.168        33.330    7.382e-183   ***    
## funcY4:treat1   -1.002   0.128        -7.822    9.721e-15    ***    
## 
## Signif codes: 0-0.001 '***', 0.001-0.01 '**', 0.01-0.05 '*', 0.05-0.1 '+', 0.1-1.0 ' '
## 
## Degrees of freedom: 1536 total; 1504 residual
## Residual standard error: 2.101643 
## 
## Marginal variance covariance matrix
##           Y1        Y2        Y3       Y4
## Y1  4.416900 -0.258640 -0.065506  0.10894
## Y2 -0.258640  1.289800 -0.060728  0.34331
## Y3 -0.065506 -0.060728  2.712200 -0.21501
## Y4  0.108940  0.343310 -0.215010  1.57600
##   Standard Deviations: 2.1016 1.1357 1.6469 1.2554

The fixed effects of our model can be interpreted the same way as the univariate models, we just need to distinguish which predictor corresponds to which ecosystem function response!

For example, we can see that the ID effect of our species p1 is significant (at \(\alpha = 0.05\)) for each of our responses (Y1 - Y4), however, while it has a positive effect on Y1, Y2, and Y4, it has negatively affects the Y3 response.

It is often easier to instead select a few communities of interest and plot their responses for comparison. For example, the monoculture of each species and the equi-proportional six-species mixture (all at a treat level of 0) seen below.

library(ggplot2)
library(reshape2)

simMV_plot <- simMV[c(1, 3, 5, 7, 9, 11, 37), ]

simMV_plot$community <- c(paste0("p", 1:6), "Mixture")

simMV_plot <- melt(simMV_plot,
                   id.vars = c(paste0("p", 1:6), "treat", "plot", "community"),
                   variable.name = "func",
                   value.name = "value")

ggplot(simMV_plot, aes(fill=func, y=value, x=community)) + 
    geom_bar(position="dodge", stat="identity")

Assuming that maximising positive response values is desirable for each ecosystem function, we can see that there are numerous trade offs occurring when we select one community over another, particularly for the monocultures as a few of these species had negative ID effects. Only the mixture and p4 monoculture have no negative response values.

We can also interpret the variance covariance matrix of the ecosystem functions to note these trade offs.

\[\Sigma_m = \begin{bmatrix} \ & Y1 & Y2 & Y3 & Y4\\ \ Y1 & 4.417 & -0.259 & -0.066 & 0.109\\ \ Y2 & -0.259 & 1.290 & -0.061 & 0.343\\ \ Y3 & -0.066 & -0.061 & 2.712 & -0.215 \\ \ Y4 & 0.109 & 0.343 & -0.215 & 1.576 \end{bmatrix}\]

Here, we can see that ecosystem function Y1 is the most variable, while Y2 is the least variable. We can also note relations between functions, such as the negative relationship between Y1 and Y2, i.e. that increases in Y1 will correlate to decreases in Y2 and vice versa, and the positive relationship between Y2 and Y4, i.e. that as Y2 increases, we expect to see an increase in Y4, albeit at a slower rate (as the covariance is <1) and vice versa.

Using Contrasts
image description image description
training-deepDive-multivariate-interpret_contrast.knit

Contrasts allow us to formally test the difference between predictions (and therefore between individual effects) made from the same model. They allow us to demonstrate the main strength of using a multivariate DI model over a series of univariate models (one for each ecosystem function response).

The DImodelsMulti R package currently does not support the contrast R package nor its corresponding function (contrast()), however, it is very easy to refit our model using gls() from the nlme package (which does have this support) by copying the call from our DImulti object.

FinalModel$call
## nlme::gls(model = value ~ 0 + func:((p1_ID + p2_ID + p3_ID + 
##     p4_ID + p5_ID + p6_ID + AV) + treat), data = data, correlation = numeric(0), 
##     weights = numeric(0), method = "REML", control = nlme::glsControl(msMaxIter = 50000, 
##         opt = "optim"))
summary(FinalModel$corr$`Multivariate`)
## Correlation Structure: General
##  Formula: ~0 | plot 
##  Parameter estimate(s):
##  Correlation: 
##   1      2      3     
## 2 -0.108              
## 3 -0.019 -0.032       
## 4  0.041  0.241 -0.104


First, we need to change our data from a wide to a stacked format and add our AV interaction column.

library(reshape2)
library(DImodels)

simMV_gls <- melt(simMV,
                  id.vars = c(paste0("p", 1:6), "treat", "plot"),
                  variable.name = "func",
                  value.name = "value")

simMV_gls <- cbind(simMV_gls, 
                   "AV" = DI_data(prop = 2:7, data = simMV_gls, theta = 1, what = "AV"))

As the contrast() function expects each fixed effect to appear independently of interactions, we must reparameterise our model (swap the : interaction with a *) and drop a species (in this case, p6) to avoid overparameterisation.

library(nlme)

FinalModel_gls <- gls(value ~ 0 + func*((p1 + p2 + p3 + p4 + p5 + AV) + treat),
                      data = simMV_gls, method="REML", correlation = corSymm(form = ~ 0 | plot), 
                      weights = varIdent(form = ~ 0 | func))

Now we’re ready to test! For this example, we can check if the predicted response values of the functions Y2 and Y3 significantly vary for a p2 monoculture (as from our previous plot, they looked quite similar).

library(contrast)

contrast(FinalModel_gls,
         list(func="Y2", p1=0, p2=1, p3=0, p4=0, p5=0, AV=0, treat="0"),
         list(func="Y3", p1=0, p2=1, p3=0, p4=0, p5=0, AV=0, treat="0"))
## gls model parameter contrast
## 
##   Contrast      S.E.      Lower    Upper    t   df Pr(>|t|)
##  0.4641491 0.5422518 -0.5995008 1.527799 0.86 1504   0.3922

As the p-value of this test is greater than 0.05, we can’t say that these responses significantly differ. On the other hand, we can see that Y1 and Y2 (for the same community) do significantly differ:

contrast(FinalModel_gls,
         list(func="Y1", p1=0, p2=1, p3=0, p4=0, p5=0, AV=0, treat="0"),
         list(func="Y2", p1=0, p2=1, p3=0, p4=0, p5=0, AV=0, treat="0"))
## gls model parameter contrast
## 
##   Contrast      S.E.     Lower     Upper     t   df Pr(>|t|)
##  -4.686552 0.6590515 -5.979309 -3.393794 -7.11 1504        0