Skip to contents

Ensemble partial least squares regression.

Usage

enpls.fit(
  x,
  y,
  maxcomp = NULL,
  cvfolds = 5L,
  reptimes = 500L,
  method = c("mc", "boot"),
  ratio = 0.8,
  parallel = 1L
)

Arguments

x

Predictor matrix.

y

Response vector.

maxcomp

Maximum number of components included within each model. If not specified, will use the maximum number possible (considering cross-validation and special cases where n is smaller than p).

cvfolds

Number of cross-validation folds used in each model for automatic parameter selection, default is 5.

reptimes

Number of models to build with Monte-Carlo resampling or bootstrapping.

method

Resampling method. "mc" (Monte-Carlo resampling) or "boot" (bootstrapping). Default is "mc".

ratio

Sampling ratio used when method = "mc".

parallel

Integer. Number of CPU cores to use. Default is 1 (not parallelized).

Value

A list containing all partial least squares model objects.

See also

See enpls.fs for measuring feature importance with ensemble partial least squares regressions. See enpls.od for outlier detection with ensemble partial least squares regressions.

Author

Nan Xiao <https://nanx.me>

Examples

data("alkanes")
x <- alkanes$x
y <- alkanes$y

set.seed(42)
fit <- enpls.fit(x, y, reptimes = 50)
print(fit)
#> Coefficients of the Models by Ensemble Partial Least Squares
#> ---
#>                      [,1]          [,2]          [,3]          [,4]
#> (Intercept)  1.246444e-02 -7.838445e-02     0.1316595  6.878848e-02
#> Chi.P.0     -3.970674e+02 -4.357396e+02  -691.3940195 -3.602751e+02
#> Chi.P.1     -7.593150e+02 -1.141336e+03 -1140.1003915 -5.130676e+02
#> Chi.P.2      2.687687e+03  3.807994e+03  3748.6881240  2.059388e+03
#> Chi.P.3      1.882890e+03  2.207855e+03  2008.2990357  1.437531e+03
#> Chi.P.4     -3.388155e+00 -3.027612e+00    -4.6614957 -8.653080e+00
#> Chi.P.5      3.772035e+02  3.544087e+02   375.2991534  2.652187e+02
#> Chi.C.3      4.953426e+01  2.936776e+01    44.3520782  2.936431e+01
#> Chi.PC.4    -1.931512e+02 -3.072224e+02  -216.6789119 -1.957108e+02
#> Kappa.1      3.178545e+03  3.646449e+03  2756.1404443  2.864882e+03
#> Kappa.2     -7.661953e+02 -1.368677e+03 -1127.1193547 -6.358414e+02
#> Kappa.3     -2.763624e+03 -3.341173e+03 -2675.6013255 -2.393720e+03
#> Kappa.4     -3.849355e+02 -6.247577e+02  -654.2501987 -3.045489e+02
#> Estate.1    -3.552818e+01  9.023558e+00   -67.7284861 -4.394761e+01
#> Estate.2    -3.318723e+01 -5.575609e+01     1.3683861  1.323503e+01
#> Estate.3     1.750400e+01  1.316610e+01     9.9482915  5.877328e+00
#> MEDV.11     -4.823338e+02 -5.157654e+02  -431.1275335 -4.194952e+02
#> MEDV.12     -1.574018e+03 -1.804298e+03 -1422.9805048 -1.351944e+03
#> MEDV.13      1.242545e+01  6.964565e+01    68.4026267  3.179590e+01
#> MEDV.22     -1.242084e+03 -1.144172e+03 -1013.8763021 -8.034431e+02
#> MEDV.23     -4.261937e+01 -7.907592e+01   -56.3412139 -4.544440e+01
#> MEDV.33     -8.265327e+00 -1.169523e+01   -10.3438058 -8.778274e+00
#>                     [,5]          [,6]          [,7]          [,8]         [,9]
#> (Intercept)    0.1192686    0.03344926    0.21944264     0.1314681   -0.1235074
#> Chi.P.0      114.9443922  151.39081547   76.27238019  -240.2842370  136.2259522
#> Chi.P.1      125.5702331  156.49497768   74.10594136  -314.3791562  153.6673011
#> Chi.P.2       73.0142577  165.13287439   89.85345352  1754.4396814   98.3187971
#> Chi.P.3      405.5696834  316.55109345   98.35577626  1053.9047114  400.8124703
#> Chi.P.4       -6.1806747   -7.43198675   -9.88013951    -1.7153048   -1.0490295
#> Chi.P.5      151.3050887   53.18949975   33.64550622   205.3901684  185.5666573
#> Chi.C.3       31.8669841    5.61534624    6.88438491    24.6064764   44.8021383
#> Chi.PC.4      -3.4242247  -62.62347203  -18.92282780  -108.2810689   35.9479444
#> Kappa.1     -124.3226002  -92.83424253   35.49558819  1677.7447439 -165.4503200
#> Kappa.2      167.8271220  189.40945302   68.05805101  -347.2420950  210.0609736
#> Kappa.3       72.4517388  159.74215145  129.96585135 -1448.4760767   28.7696114
#> Kappa.4      119.2458271  152.85626389   75.89113737  -140.4589742  143.9957352
#> Estate.1    -133.7334943 -103.70780084   28.53493470     8.6757449 -169.5197610
#> Estate.2     104.8269219   99.62912201   -0.06672675   -27.9466777   85.3056800
#> Estate.3       3.9226254    6.12943382  -11.67554659    11.4841152    6.6412900
#> MEDV.11      -32.4282415  -54.73502499  -45.37809784  -284.6735242  -28.8282140
#> MEDV.12     -226.5718202 -263.52637925 -141.68720462  -977.5534500 -227.0272720
#> MEDV.13       -0.3000575   42.75351366   26.80771649    35.9614527  -10.6572758
#> MEDV.22     -407.6313928 -448.38276750   41.32777313  -854.6368553 -490.4915757
#> MEDV.23      -16.7949702  -73.40319374  -48.94258919   -72.7726511  -13.0687115
#> MEDV.33       -2.4328116   -6.40314188   -3.77969804    -7.6718770   -2.0709181
#>                     [,10]         [,11]         [,12]         [,13]
#> (Intercept)     0.0952299 -7.533035e-02  2.726087e-02  3.802585e-02
#> Chi.P.0      -186.2134302 -4.633889e+02 -3.538618e+02 -3.063640e+02
#> Chi.P.1      -620.0046220 -8.072891e+02 -8.154466e+02 -7.408477e+02
#> Chi.P.2      2269.7060178  2.802732e+03  2.949372e+03  2.782580e+03
#> Chi.P.3      1305.5290186  1.949994e+03  1.812270e+03  1.874588e+03
#> Chi.P.4        -1.4658141 -4.224059e+00 -3.994658e+00 -5.215591e+00
#> Chi.P.5       263.4342742  3.533711e+02  3.357021e+02  3.627524e+02
#> Chi.C.3        34.5482525  4.004019e+01  3.298974e+01  4.285496e+01
#> Chi.PC.4     -133.6619962 -2.522639e+02 -2.046604e+02 -2.107894e+02
#> Kappa.1      1871.6456449  3.165754e+03  2.673910e+03  3.342556e+03
#> Kappa.2      -569.2174595 -8.790804e+02 -9.191529e+02 -9.822002e+02
#> Kappa.3     -1787.3837963 -2.755595e+03 -2.488446e+03 -2.972810e+03
#> Kappa.4      -414.7121909 -4.316163e+02 -4.448586e+02 -3.725222e+02
#> Estate.1      -91.9704597 -1.060894e+02  3.486721e+01 -6.444907e+01
#> Estate.2        2.2557378  2.546077e+01 -4.559803e+01 -4.233085e+00
#> Estate.3        8.2750120  1.305269e+01  1.802437e+01  1.595633e+01
#> MEDV.11      -308.6363838 -4.593386e+02 -4.073214e+02 -4.795827e+02
#> MEDV.12     -1050.7151125 -1.585065e+03 -1.466473e+03 -1.682701e+03
#> MEDV.13        47.7989661  4.542462e+01  3.386146e+01  2.952771e+01
#> MEDV.22      -811.3878203 -1.095467e+03 -1.120130e+03 -1.173663e+03
#> MEDV.23       -62.0031799 -6.104439e+01 -5.158575e+01 -5.283413e+01
#> MEDV.33        -8.3058078 -1.059688e+01 -8.342981e+00 -8.667960e+00
#>                     [,14]         [,15]         [,16]         [,17]
#> (Intercept)    0.08805267     0.1311924 -5.291843e-02  2.467607e-02
#> Chi.P.0      128.73416209  -498.4958246 -5.298792e+02 -3.478092e+02
#> Chi.P.1      139.31472219  -648.5146975 -7.734374e+02 -3.136307e+02
#> Chi.P.2      138.46255953  2687.6633031  2.963036e+03  1.805095e+03
#> Chi.P.3      284.51738524  1665.2279359  1.738952e+03  1.103782e+03
#> Chi.P.4       -5.32622809    -4.7605938 -4.851129e+00 -2.242400e+00
#> Chi.P.5      132.97884367   298.5242595  3.454661e+02  2.507446e+02
#> Chi.C.3       33.69798165    31.2926561  4.387881e+01  3.861590e+01
#> Chi.PC.4      29.46008523  -200.2172196 -1.700069e+02 -8.397451e+01
#> Kappa.1     -106.56188705  2500.3540664  2.647402e+03  1.236983e+03
#> Kappa.2      185.71691987  -773.0577857 -8.043688e+02 -3.659646e+02
#> Kappa.3       36.56160928 -2230.8755424 -2.449748e+03 -1.219634e+03
#> Kappa.4      135.80436449  -426.4317101 -4.897427e+02 -2.624760e+02
#> Estate.1    -136.00640946   -92.6959258 -5.725439e+01 -8.777946e+01
#> Estate.2      79.44125554     6.8494772 -1.904631e+01  2.660165e+01
#> Estate.3       2.03106212     7.5234657  1.162960e+01  9.359179e+00
#> MEDV.11      -32.48020250  -382.6310569 -3.999401e+02 -2.271922e+02
#> MEDV.12     -213.23097763 -1276.0660551 -1.383241e+03 -8.036686e+02
#> MEDV.13        6.29646290    51.4445673  4.052299e+01  3.286213e+01
#> MEDV.22     -374.17098451  -914.2702081 -9.958034e+02 -7.587489e+02
#> MEDV.23      -23.12017855   -57.6622910 -4.784982e+01 -4.832512e+01
#> MEDV.33       -2.68142917    -8.9018915 -8.411920e+00 -6.506073e+00
#>                     [,18]         [,19]         [,20]         [,21]
#> (Intercept)   -0.09040048  4.156524e-02  6.395476e-02     0.1223034
#> Chi.P.0       81.14481680 -2.854488e+02 -3.653410e+02  -290.7849931
#> Chi.P.1       83.60685082 -3.618192e+02 -4.956725e+02  -437.2478134
#> Chi.P.2       78.54002179  1.875427e+03  2.202052e+03  2115.3888038
#> Chi.P.3      112.03020721  1.235178e+03  1.391329e+03  1445.7062184
#> Chi.P.4       -9.36274629 -5.713304e+00 -3.787116e+00    -5.8948787
#> Chi.P.5       76.07556024  2.649673e+02  2.772492e+02   246.4588772
#> Chi.C.3       23.01333385  3.464507e+01  3.545692e+01    21.8569469
#> Chi.PC.4      24.29276082 -1.209906e+02 -1.421121e+02  -203.9326299
#> Kappa.1       -6.40462929  1.754698e+03  2.024447e+03  3171.2612444
#> Kappa.2       93.87070912 -4.676859e+02 -5.910617e+02  -731.2439522
#> Kappa.3       58.51252928 -1.619529e+03 -1.853187e+03 -2550.7430077
#> Kappa.4       82.73408489 -2.578726e+02 -2.795108e+02  -319.4767922
#> Estate.1    -136.67827755 -6.285670e+01 -8.258845e+01    42.6330798
#> Estate.2      82.16359717  2.580002e+01  1.406891e+01   -72.8386840
#> Estate.3     -16.42761494  1.114580e+01  9.022463e+00     2.9006126
#> MEDV.11      -22.02376396 -2.801039e+02 -3.212965e+02  -442.6971372
#> MEDV.12     -106.22127940 -1.018394e+03 -1.128810e+03 -1494.8166802
#> MEDV.13       24.73580106  2.768341e+01  3.704400e+01    30.0241274
#> MEDV.22       55.18581116 -8.105922e+02 -8.660804e+02  -783.7200263
#> MEDV.23      -19.48365509 -4.620548e+01 -4.819595e+01   -67.1022418
#> MEDV.33       -3.44968017 -6.847212e+00 -7.600378e+00    -8.7449426
#>                    [,22]         [,23]        [,24]         [,25]         [,26]
#> (Intercept)    0.2193084 -2.348773e-02    0.1151192 -5.632583e-02   -0.04497163
#> Chi.P.0       67.7965837 -6.297741e+02   91.8073514 -2.093525e+02  146.52635231
#> Chi.P.1       68.2614215 -7.493253e+02   94.7512390 -5.360753e+02  158.54749398
#> Chi.P.2       64.2857629  3.144416e+03   84.4490981  1.989834e+03  147.99367308
#> Chi.P.3      107.7409256  1.651824e+03  146.8778113  1.381773e+03  267.65775917
#> Chi.P.4       -9.2261412 -1.582243e+00   -8.1860462 -5.933891e+00   -4.14951272
#> Chi.P.5       89.5724744  2.743289e+02   76.4454591  2.559710e+02  119.03126531
#> Chi.C.3       28.2276078  2.679225e+01   21.6817403  2.555790e+01   33.00245787
#> Chi.PC.4      29.2196878 -2.137538e+02    9.8249597 -1.704542e+02   25.32410475
#> Kappa.1        6.5303632  2.651939e+03  -13.2005713  2.187942e+03 -124.69942602
#> Kappa.2       71.2128622 -9.453564e+02  106.4176679 -4.282600e+02  208.07832694
#> Kappa.3       82.9266422 -2.391648e+03   72.3295896 -1.888850e+03   57.42340455
#> Kappa.4       68.2861453 -4.580112e+02   93.5596495 -3.018673e+02  153.57106033
#> Estate.1     -87.1144737 -5.273535e+01 -163.2770902 -8.004661e+01 -135.30099275
#> Estate.2      96.1113145 -3.972464e+00   86.6142855  1.636663e+01   88.64498788
#> Estate.3     -16.8460972  5.575601e+00  -15.1373430  1.185360e+01    3.69014729
#> MEDV.11      -34.4868838 -4.154152e+02  -27.1789639 -3.365432e+02  -33.03368303
#> MEDV.12     -114.1375195 -1.352071e+03 -114.2637591 -1.169266e+03 -220.81125268
#> MEDV.13       28.0609361  8.332264e+01   26.6114839  3.278048e+01   14.31650471
#> MEDV.22       66.4576815 -8.674400e+02   25.9998593 -9.352758e+02 -412.27077533
#> MEDV.23      -37.2330913 -9.178154e+01  -27.6302943 -5.457739e+01  -32.31941360
#> MEDV.33       -4.5712266 -1.192587e+01   -3.7583478 -7.849656e+00   -3.31414543
#>                     [,27]         [,28]        [,29]         [,30]
#> (Intercept)    0.04374562  2.912022e-03   -0.1993842   -0.02620609
#> Chi.P.0      120.99257748  1.486671e+02  109.2323355   88.91734140
#> Chi.P.1      126.59878191  1.605912e+02  128.3081845   91.46501548
#> Chi.P.2      182.33245864  1.531265e+02   25.0674224   87.68118906
#> Chi.P.3       88.57933599  3.682129e+02  457.8455729  120.11536340
#> Chi.P.4      -11.66968878 -6.457610e+00   -4.9815825   -9.98542179
#> Chi.P.5       46.06718203  1.007879e+02  211.2596252   66.87397549
#> Chi.C.3       10.63040098  1.733023e+01   46.7806100   22.14778274
#> Chi.PC.4      18.13267882 -2.679118e+01   36.6356509   13.24319209
#> Kappa.1      -13.61746075 -1.103985e+02 -178.6294590   -8.12914013
#> Kappa.2      154.84130646  2.059184e+02  175.8167778  102.14731202
#> Kappa.3       59.91772298  9.101820e+01   39.6172467   66.64755179
#> Kappa.4      128.49952344  1.564359e+02  116.0767308   90.62843095
#> Estate.1     -80.78795059 -1.362215e+02 -165.7939866 -164.10211910
#> Estate.2      53.50338296  1.081021e+02  111.6772345  103.95835390
#> Estate.3      -3.50380851  7.307871e+00    4.9688522  -15.56017605
#> MEDV.11      -38.09382970 -3.738746e+01  -17.9420371  -23.31073532
#> MEDV.12     -186.75086737 -2.524439e+02 -202.7379850 -109.44608726
#> MEDV.13       29.37254346  2.071394e+01  -25.5943339   31.42631050
#> MEDV.22     -173.75933157 -4.784486e+02 -435.5795908   35.92312147
#> MEDV.23      -36.84290509 -3.755483e+01   10.9301518  -23.97873597
#> MEDV.33       -3.84610436 -3.909744e+00   -0.7342638   -3.87731991
#>                     [,31]         [,32]         [,33]        [,34]        [,35]
#> (Intercept)  5.285207e-02 -4.087657e-02  8.235517e-02    0.0207164   -0.3892758
#> Chi.P.0     -1.121228e+03 -6.029116e+01 -3.664867e+02  119.0605638  143.1113050
#> Chi.P.1     -1.446561e+03 -6.249427e+02 -9.892404e+02  127.8788269  157.2042594
#> Chi.P.2      5.095428e+03  2.066337e+03  3.572337e+03  195.6664038  128.3042790
#> Chi.P.3      2.068007e+03  1.366312e+03  2.345598e+03  331.4797088  369.8712960
#> Chi.P.4     -4.374757e+00 -7.838732e+00 -4.255981e+00   -6.6379382    2.5003578
#> Chi.P.5      3.811741e+02  2.780290e+02  4.409144e+02   76.3535055   97.4749519
#> Chi.C.3      4.532302e+01  3.604576e+01  5.111362e+01   13.9988966   16.7430154
#> Chi.PC.4    -1.762346e+02 -1.472494e+02 -2.827972e+02  -46.2926540  -39.5671078
#> Kappa.1      1.184811e+03  1.960505e+03  4.103426e+03  -28.7161438 -113.1404551
#> Kappa.2     -1.303199e+03 -5.843606e+02 -1.386131e+03  150.5706625  197.0039194
#> Kappa.3     -1.741210e+03 -1.828659e+03 -3.738645e+03   84.4559573   97.6262886
#> Kappa.4     -1.358525e+03 -3.485870e+02 -4.966196e+02  127.6017851  150.9941559
#> Estate.1    -2.722104e+00 -8.363172e+01 -4.681820e+00 -110.8426938 -219.1124706
#> Estate.2    -2.209334e+01  3.189150e+01 -7.154599e+01   91.8425026  155.8298603
#> Estate.3     7.629877e+00  1.423729e+01  2.295319e+01    2.9908851    5.1810807
#> MEDV.11     -2.419671e+02 -3.284120e+02 -6.000753e+02  -56.0342439  -45.7786176
#> MEDV.12     -8.986966e+02 -1.125750e+03 -2.026022e+03 -255.4171078 -245.4227736
#> MEDV.13      1.116011e+02  3.573229e+01  2.700536e+01   33.1704841   41.5642317
#> MEDV.22     -7.894123e+02 -8.918826e+02 -1.410820e+03 -393.8915983 -460.4394660
#> MEDV.23     -5.399647e+01 -5.297287e+01 -5.992552e+01  -58.7414481  -64.4120936
#> MEDV.33     -9.563163e+00 -8.050611e+00 -1.008338e+01   -5.1038917   -6.5282383
#>                    [,36]         [,37]         [,38]         [,39]
#> (Intercept)     0.180130     0.1747782  3.223681e-02 -9.686307e-02
#> Chi.P.0      -454.757890  -575.4021338 -4.960514e+02 -2.702114e+02
#> Chi.P.1     -1002.008056  -782.2569890 -8.580990e+02 -4.156535e+02
#> Chi.P.2      3317.996049  2898.9118310  2.984437e+03  1.833811e+03
#> Chi.P.3      1428.183150  1887.0164603  1.839520e+03  1.162487e+03
#> Chi.P.4        -4.218798    -8.1714570 -3.623802e+00 -6.131265e+00
#> Chi.P.5       238.546092   362.5424797  3.506188e+02  2.284663e+02
#> Chi.C.3        23.417402    41.4856285  4.103791e+01  2.709905e+01
#> Chi.PC.4     -160.330305  -218.5644523 -2.047444e+02 -1.219355e+02
#> Kappa.1      1378.420491  3626.1226005  3.126343e+03  1.493795e+03
#> Kappa.2      -871.074550  -910.0871115 -8.407136e+02 -4.039880e+02
#> Kappa.3     -1605.807174 -3125.8585552 -2.798602e+03 -1.370172e+03
#> Kappa.4      -699.194412  -439.0422331 -4.532499e+02 -2.605861e+02
#> Estate.1      -75.188117     8.1454541 -9.130401e+01 -1.091252e+02
#> Estate.2       26.948293   -55.7209225  1.896848e+01  5.426602e+01
#> Estate.3        5.025732    11.2471358  1.289005e+01  7.215722e+00
#> MEDV.11      -265.018981  -509.3785158 -4.581410e+02 -2.360206e+02
#> MEDV.12      -906.926503 -1729.9087986 -1.562400e+03 -8.787567e+02
#> MEDV.13       107.281786    21.7718813  4.681130e+01  3.949740e+01
#> MEDV.22      -666.599985 -1027.6895768 -1.095979e+03 -7.322395e+02
#> MEDV.23       -74.982737   -42.6892002 -5.413007e+01 -4.485792e+01
#> MEDV.33       -10.487102    -8.9081547 -1.022301e+01 -7.149544e+00
#>                     [,40]         [,41]         [,42]        [,43]
#> (Intercept)  8.230512e-02  4.801751e-02     0.1191981    0.1317047
#> Chi.P.0     -2.360277e+02 -5.201022e+02  -520.8814465   83.5326356
#> Chi.P.1     -4.317225e+02 -9.403190e+02 -1173.5491430   85.6547918
#> Chi.P.2      2.017850e+03  3.196718e+03  3623.4482082   80.7620107
#> Chi.P.3      1.452862e+03  1.939346e+03  2335.9135471  119.4739387
#> Chi.P.4     -4.913138e+00 -5.820418e+00    -6.0823712   -9.4373810
#> Chi.P.5      3.040830e+02  3.739852e+02   460.0400652   70.5019007
#> Chi.C.3      4.159134e+01  4.234345e+01    54.9779923   23.1205059
#> Chi.PC.4    -1.397978e+02 -2.091701e+02  -247.0420518   13.2936593
#> Kappa.1      2.512855e+03  2.835215e+03  3906.5217998   -3.9170264
#> Kappa.2     -5.679603e+02 -8.192789e+02 -1187.1982216   93.1275808
#> Kappa.3     -2.178895e+03 -2.567306e+03 -3511.1222236   74.7151564
#> Kappa.4     -2.746432e+02 -7.606963e+02  -640.2636763   85.0586715
#> Estate.1    -8.738426e+01 -6.214043e+00    53.0199628 -166.5871045
#> Estate.2     2.087682e+01 -3.604692e+01   -59.1987760  112.7558623
#> Estate.3     1.260388e+01  1.267503e+01    19.4082327  -16.4353026
#> MEDV.11     -3.731358e+02 -4.224191e+02  -548.6770470  -28.9246852
#> MEDV.12     -1.271655e+03 -1.440250e+03 -1932.9171940 -113.2827815
#> MEDV.13      1.711199e+01  3.464231e+01    18.9475056   34.7176976
#> MEDV.22     -1.018641e+03 -1.088777e+03 -1358.1823678   41.5437637
#> MEDV.23     -4.175767e+01 -4.452709e+01   -41.4762992  -32.1378996
#> MEDV.33     -6.924897e+00 -8.623157e+00    -9.3478123   -4.3010588
#>                     [,44]        [,45]         [,46]        [,47]        [,48]
#> (Intercept)   -0.03908469   -0.2069478   -0.04211695    0.1175324    0.2551903
#> Chi.P.0      132.21311716  142.4009335   97.51169123   74.9575665   60.0170126
#> Chi.P.1      144.36051640  159.4238786   99.76574836   74.8023321   60.5047190
#> Chi.P.2      103.66701406   90.1843563   92.53607763   74.6339771   60.0919640
#> Chi.P.3      440.88280955  418.5968720  155.35012786  106.9724734   66.3098689
#> Chi.P.4       -8.10464618   -4.9818489   -7.02302825  -12.2173056   -8.0551176
#> Chi.P.5      114.80375273  129.1254892   53.67733664   45.9639923  101.8651486
#> Chi.C.3       16.43237591   22.8122938   12.44823446   13.6443754   31.3235903
#> Chi.PC.4     -57.72797804  -21.6599247  -16.84616606   -6.0832435   59.4204346
#> Kappa.1     -112.16912361 -147.3979927   -5.03886120   22.7216847    1.3029410
#> Kappa.2      179.61674470  202.8993556  108.43006643   74.6542267   65.5196440
#> Kappa.3      132.89179056  101.8846312   94.33425016   96.9358951   57.1306256
#> Kappa.4      138.80759830  149.1680679   99.01208108   75.1370811   60.6115682
#> Estate.1    -134.18779605 -155.7463835 -216.47287784  -96.2872156  -11.7556172
#> Estate.2     119.05757044  131.6185575  155.21017579   69.4014499   29.4842088
#> Estate.3       7.56165528    7.0887313  -13.97436636  -14.1398658  -17.7400162
#> MEDV.11      -46.70643883  -29.4044529  -29.56991555  -28.1388076  -30.6636088
#> MEDV.12     -268.01018090 -224.2267230 -124.18656476 -111.3402733 -102.2685725
#> MEDV.13       24.51688015   12.2829935   53.18273863   31.5214270    7.3296599
#> MEDV.22     -481.61777979 -483.9581247    1.42251665   91.1984925   92.4487723
#> MEDV.23      -54.03483153  -25.8707433  -47.62213452  -27.6452118  -22.0167765
#> MEDV.33       -4.93339249   -3.4370831   -5.95585528   -3.9031651   -2.3022137
#>                     [,49]        [,50]
#> (Intercept)   -0.04866931    0.1748453
#> Chi.P.0      122.23201797  149.1362350
#> Chi.P.1      133.26691772  161.6037046
#> Chi.P.2       95.74635679  155.4433908
#> Chi.P.3      367.97914127  264.2710091
#> Chi.P.4      -10.34265722   -4.5266769
#> Chi.P.5      152.61239902   80.6744925
#> Chi.C.3       35.74740421   15.1505543
#> Chi.PC.4      19.83267238  -10.5888549
#> Kappa.1     -118.54603237  -98.1216228
#> Kappa.2      176.00128264  201.9980903
#> Kappa.3       44.78004489   83.1922641
#> Kappa.4      128.52665001  157.6049414
#> Estate.1    -157.57778557 -131.4061131
#> Estate.2     109.53639031   88.3252086
#> Estate.3       4.35857625    2.8050891
#> MEDV.11      -28.13157019  -35.1417473
#> MEDV.12     -222.30441671 -218.2617326
#> MEDV.13       -3.25534843   24.7291947
#> MEDV.22     -399.46058127 -398.6099385
#> MEDV.23       -8.14815971  -40.4229932
#> MEDV.33       -1.93983979   -4.9163992
predict(fit, newx = x)
#>   [1] -2126.5424637 -2113.1316535 -1927.1159663 -1916.4118552 -1727.0954869
#>   [6] -1717.3859578 -1526.7365219 -1517.4991466 -1326.2729932 -1317.1922731
#>  [11] -1125.9916444 -1117.0188237 -1152.4859796  -925.8305075  -916.9656046
#>  [16]  -954.2027001  -725.7541886  -716.8961642  -755.6904118  -525.7568515
#>  [21]  -517.1133985  -556.8564611  -326.0510245  -317.1912678  -358.1003483
#>  [26]  -126.4007729  -117.5883783  -159.3398758    73.1862073    81.9764338
#>  [31]    68.2255392    58.7370509    52.5281312    48.9649619    40.1640259
#>  [36]    39.5155551   272.7243653   281.5233863   267.8290571   258.2477372
#>  [41]   251.9960294   239.4218404   238.3652915   472.1839610   481.0727049
#>  [46]   437.1813431  -682.4731331  -608.1531798  -484.6527354  -484.3152701
#>  [51]  -508.2830175  -505.3782727  -520.2723892  -385.6011988  -397.4682663
#>  [56]  -408.4405514  -416.1634701  -420.5046382  -281.4472969  -286.1036627
#>  [61]  -309.1719035  -308.3258100  -301.3372726  -320.1455059  -185.9987853
#>  [66]  -195.0895657  -198.7871111  -209.8644571  -219.9352127   -81.8757748
#>  [71]   -87.1823094  -110.5544722  -108.9801678  -119.8860764    13.5678893
#>  [76]     4.2999722     2.5946410    18.1076070     0.5957538   -17.6331922
#>  [81]   117.6325675   111.9628723   111.4571577    88.5841785    88.2446989
#>  [86]    77.1460657    73.1898065   207.1250993   201.0204403   181.7058431
#>  [91]   173.2994833   174.8481236   165.2118275   314.5679183   310.5051424
#>  [96]   287.0318681   287.3513371   277.3089017   272.4041454   403.1396133
#> [101]   396.3801815   381.0425593   372.5135806   369.5850552   364.0800204
#> [106]   516.5409052   509.6177250   488.2687906   486.0152270   476.2109049
#> [111]   471.7996408   600.5300592   585.6928763   567.3818549   708.7940329
#> [116]   687.7525946   685.0571150   667.1248480   784.7797337  -567.7581837
#> [121]  -479.6524144  -369.2562017  -253.1563337  -170.8091896   -54.8402401
#> [126]   -84.1775270     8.9431829   145.1130763   114.2562731   104.2628129
#> [131]    94.4552747   229.1104996   223.3191253   206.9210486   192.5024503
#> [136]   345.1616154   312.6413419   302.1954111   292.0839517   428.0725079
#> [141]   427.0081185   405.2283699   397.4144268   389.9857746   544.2849371
#> [146]   514.4928255   501.0601274   488.4509161   491.8463931   627.1573917
#> [151]   596.2561742   586.9280555   743.3619444   710.1849920   702.3765896
#> [156]   685.7704108   784.4901177   908.9179151   883.6265872   983.0856852
#> [161]   -28.4412551   169.0360858   152.6081239   368.6119435   351.6404771
#> [166]   567.6060383   525.1752113   518.3009813   518.0082657   632.8614122
#> [171]   620.4549369   615.5204421   766.5732304   723.4769269   716.2774456
#> [176]   714.9542999   813.2899949  -340.6142132  -150.7982816  -917.2432532
#> [181]  -683.6192019  -481.0319804  -508.8039543  -398.1222301  -414.8950682
#> [186]  -309.3696189  -321.2663409  -328.2483597  -197.9334864  -109.9902790
#> [191]    79.2914952    74.3880160   203.7262434   401.2221482   380.9927437
#> [196]  -251.5301847  -166.0569665  -100.6841884   116.2975828   103.4238284
#> [201]    97.1327845   319.9619496   302.6078458   295.3860343   406.6215311
#> [206]   406.1479439   392.4032669