Dummies

A binary variable capturing a qualitative state in the data; e.g. female where we set the variable to 1 for women

  wage1 <-  read.csv("https://www.dropbox.com/s/9agc2vmamfztlel/WAGE1.csv?dl=1")


  r1 <- lm(wage ~ female, wage1)
  r1 %>% summary()
## 
## Call:
## lm(formula = wage ~ female, data = wage1)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -5.5995 -1.8495 -0.9877  1.4260 17.8805 
## 
## Coefficients:
##             Estimate Std. Error t value Pr(>|t|)    
## (Intercept)   7.0995     0.2100  33.806  < 2e-16 ***
## female       -2.5118     0.3034  -8.279 1.04e-15 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.476 on 524 degrees of freedom
## Multiple R-squared:  0.1157, Adjusted R-squared:  0.114 
## F-statistic: 68.54 on 1 and 524 DF,  p-value: 1.042e-15

How can we interpret the coefficients?

\[Wage=\beta_0+\beta_1\times FEMALE+\epsilon\]

As before: by how much we can expect the dependent variable to change if we move one unit in the explanatory variable. Here this means if we go from a man to a women (or from a women to a man). In this case: women earn on average $2.51 less.

Note that

wage1 %>% group_by(female) %>% summarize(mean(wage))
## # A tibble: 2 x 2
##   female `mean(wage)`
##    <int>        <dbl>
## 1      0         7.10
## 2      1         4.59

Notice, that the intercept (\(\beta_0\)) is the average wage for men. To get the average wage for women we need to add the coefficient: \[ E\{wage| Women\}=\beta_0+\beta_1=4.587...\] where \(E\{wage| Women\}\) is a mathematical way of saying the average (or expected) wage for women.

  summary(r1)
## 
## Call:
## lm(formula = wage ~ female, data = wage1)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -5.5995 -1.8495 -0.9877  1.4260 17.8805 
## 
## Coefficients:
##             Estimate Std. Error t value Pr(>|t|)    
## (Intercept)   7.0995     0.2100  33.806  < 2e-16 ***
## female       -2.5118     0.3034  -8.279 1.04e-15 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.476 on 524 degrees of freedom
## Multiple R-squared:  0.1157, Adjusted R-squared:  0.114 
## F-statistic: 68.54 on 1 and 524 DF,  p-value: 1.042e-15
  summary(lm(wage ~ 0+educ, wage1))
## 
## Call:
## lm(formula = wage ~ 0 + educ, data = wage1)
## 
## Residuals:
##    Min     1Q Median     3Q    Max 
## -5.142 -2.246 -1.066  1.154 16.528 
## 
## Coefficients:
##      Estimate Std. Error t value Pr(>|t|)    
## educ  0.47266    0.01146   41.25   <2e-16 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.381 on 525 degrees of freedom
## Multiple R-squared:  0.7642, Adjusted R-squared:  0.7637 
## F-statistic:  1701 on 1 and 525 DF,  p-value: < 2.2e-16
  rows=nrow(wage1)
  wage1["one"]<-rep(1,rows)
  head(wage1) 
##   X wage educ exper tenure nonwhite female married numdep smsa northcen south
## 1 1 3.10   11     2      0        0      1       0      2    1        0     0
## 2 2 3.24   12    22      2        0      1       1      3    1        0     0
## 3 3 3.00   11     2      0        0      0       0      2    0        0     0
## 4 4 6.00    8    44     28        0      0       1      0    1        0     0
## 5 5 5.30   12     7      2        0      0       1      1    0        0     0
## 6 6 8.75   16     9      8        0      0       1      0    1        0     0
##   west construc ndurman trcommpu trade services profserv profocc clerocc
## 1    1        0       0        0     0        0        0       0       0
## 2    1        0       0        0     0        1        0       0       0
## 3    1        0       0        0     1        0        0       0       0
## 4    1        0       0        0     0        0        0       0       1
## 5    1        0       0        0     0        0        0       0       0
## 6    1        0       0        0     0        0        1       1       0
##   servocc    lwage expersq tenursq one
## 1       0 1.131402       4       0   1
## 2       1 1.175573     484       4   1
## 3       0 1.098612       4       0   1
## 4       0 1.791759    1936     784   1
## 5       0 1.667707      49       4   1
## 6       0 2.169054      81      64   1
  summary(lm(wage ~ 0+educ+one, wage1))
## 
## Call:
## lm(formula = wage ~ 0 + educ + one, data = wage1)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -5.3396 -2.1501 -0.9674  1.1921 16.6085 
## 
## Coefficients:
##      Estimate Std. Error t value Pr(>|t|)    
## educ  0.54136    0.05325  10.167   <2e-16 ***
## one  -0.90485    0.68497  -1.321    0.187    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.378 on 524 degrees of freedom
## Multiple R-squared:  0.765,  Adjusted R-squared:  0.7641 
## F-statistic: 852.7 on 2 and 524 DF,  p-value: < 2.2e-16
  summary(lm(wage ~ educ+one, wage1))
## 
## Call:
## lm(formula = wage ~ educ + one, data = wage1)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -5.3396 -2.1501 -0.9674  1.1921 16.6085 
## 
## Coefficients: (1 not defined because of singularities)
##             Estimate Std. Error t value Pr(>|t|)    
## (Intercept) -0.90485    0.68497  -1.321    0.187    
## educ         0.54136    0.05325  10.167   <2e-16 ***
## one               NA         NA      NA       NA    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.378 on 524 degrees of freedom
## Multiple R-squared:  0.1648, Adjusted R-squared:  0.1632 
## F-statistic: 103.4 on 1 and 524 DF,  p-value: < 2.2e-16
  summary(lm(wage ~one, wage1))
## 
## Call:
## lm(formula = wage ~ one, data = wage1)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -5.3661 -2.5661 -1.2461  0.9839 19.0839 
## 
## Coefficients: (1 not defined because of singularities)
##             Estimate Std. Error t value Pr(>|t|)    
## (Intercept)    5.896      0.161   36.62   <2e-16 ***
## one               NA         NA      NA       NA    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.693 on 525 degrees of freedom
  summary(wage1$wage)
##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   0.530   3.330   4.650   5.896   6.880  24.980
  summary(lm(wage ~ female, wage1))
## 
## Call:
## lm(formula = wage ~ female, data = wage1)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -5.5995 -1.8495 -0.9877  1.4260 17.8805 
## 
## Coefficients:
##             Estimate Std. Error t value Pr(>|t|)    
## (Intercept)   7.0995     0.2100  33.806  < 2e-16 ***
## female       -2.5118     0.3034  -8.279 1.04e-15 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.476 on 524 degrees of freedom
## Multiple R-squared:  0.1157, Adjusted R-squared:  0.114 
## F-statistic: 68.54 on 1 and 524 DF,  p-value: 1.042e-15
  aggregate(wage1$wage, list(wage1$female), mean)
##   Group.1        x
## 1       0 7.099489
## 2       1 4.587659
  aggregate(wage1$wage, list(wage1$female), mean)
##   Group.1        x
## 1       0 7.099489
## 2       1 4.587659
  wage1["male"]<-1-wage1$female
  
  summary(lm(wage ~ male +female, wage1))
## 
## Call:
## lm(formula = wage ~ male + female, data = wage1)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -5.5995 -1.8495 -0.9877  1.4260 17.8805 
## 
## Coefficients: (1 not defined because of singularities)
##             Estimate Std. Error t value Pr(>|t|)    
## (Intercept)   4.5877     0.2190  20.950  < 2e-16 ***
## male          2.5118     0.3034   8.279 1.04e-15 ***
## female            NA         NA      NA       NA    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.476 on 524 degrees of freedom
## Multiple R-squared:  0.1157, Adjusted R-squared:  0.114 
## F-statistic: 68.54 on 1 and 524 DF,  p-value: 1.042e-15
  summary(lm(wage ~ female+male , wage1))  
## 
## Call:
## lm(formula = wage ~ female + male, data = wage1)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -5.5995 -1.8495 -0.9877  1.4260 17.8805 
## 
## Coefficients: (1 not defined because of singularities)
##             Estimate Std. Error t value Pr(>|t|)    
## (Intercept)   7.0995     0.2100  33.806  < 2e-16 ***
## female       -2.5118     0.3034  -8.279 1.04e-15 ***
## male              NA         NA      NA       NA    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.476 on 524 degrees of freedom
## Multiple R-squared:  0.1157, Adjusted R-squared:  0.114 
## F-statistic: 68.54 on 1 and 524 DF,  p-value: 1.042e-15
  summary(lm(wage ~ 0+male +female, wage1))  
## 
## Call:
## lm(formula = wage ~ 0 + male + female, data = wage1)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -5.5995 -1.8495 -0.9877  1.4260 17.8805 
## 
## Coefficients:
##        Estimate Std. Error t value Pr(>|t|)    
## male      7.099      0.210   33.81   <2e-16 ***
## female    4.588      0.219   20.95   <2e-16 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.476 on 524 degrees of freedom
## Multiple R-squared:  0.7512, Adjusted R-squared:  0.7502 
## F-statistic: 790.9 on 2 and 524 DF,  p-value: < 2.2e-16

Dummies and categorical variables

wage1= wage1 %>% mutate(educats=0,
                        educats=ifelse(educ==12,1,educats),
                        educats=ifelse(educ>12,2,educats))

wage1 %>% group_by(educats) %>% summarize(n())
## # A tibble: 3 x 2
##   educats `n()`
##     <dbl> <int>
## 1       0   116
## 2       1   198
## 3       2   212
summary(lm(wage~educats,wage1))
## 
## Call:
## lm(formula = wage ~ educats, data = wage1)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -5.2933 -2.2542 -0.9292  1.2301 17.6867 
## 
## Coefficients:
##             Estimate Std. Error t value Pr(>|t|)    
## (Intercept)   3.8751     0.2765  14.016   <2e-16 ***
## educats       1.7091     0.1961   8.717   <2e-16 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.455 on 524 degrees of freedom
## Multiple R-squared:  0.1267, Adjusted R-squared:  0.125 
## F-statistic: 75.99 on 1 and 524 DF,  p-value: < 2.2e-16

Making a set of dummy variables

wage1=wage1 %>% mutate(edu_low=educats==0,
                       edu_normal=educats==1,
                       edu_high=educats==2)

reg=lm(wage~edu_low+edu_normal+edu_high,wage1)

reg %>% summary()
## 
## Call:
## lm(formula = wage ~ edu_low + edu_normal + edu_high, data = wage1)
## 
## Residuals:
##    Min     1Q Median     3Q    Max 
## -5.393 -2.119 -1.033  1.245 17.587 
## 
## Coefficients: (1 not defined because of singularities)
##                Estimate Std. Error t value Pr(>|t|)    
## (Intercept)      7.3926     0.2372  31.165  < 2e-16 ***
## edu_lowTRUE     -3.3359     0.3989  -8.363 5.56e-16 ***
## edu_normalTRUE  -2.0213     0.3413  -5.922 5.78e-09 ***
## edu_highTRUE         NA         NA      NA       NA    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.454 on 523 degrees of freedom
## Multiple R-squared:  0.1287, Adjusted R-squared:  0.1254 
## F-statistic: 38.64 on 2 and 523 DF,  p-value: 2.236e-16

Testing for a linear relationship

  library(car)
  
  summary(lm(wage ~ edu_low+edu_normal+edu_high, wage1))
## 
## Call:
## lm(formula = wage ~ edu_low + edu_normal + edu_high, data = wage1)
## 
## Residuals:
##    Min     1Q Median     3Q    Max 
## -5.393 -2.119 -1.033  1.245 17.587 
## 
## Coefficients: (1 not defined because of singularities)
##                Estimate Std. Error t value Pr(>|t|)    
## (Intercept)      7.3926     0.2372  31.165  < 2e-16 ***
## edu_lowTRUE     -3.3359     0.3989  -8.363 5.56e-16 ***
## edu_normalTRUE  -2.0213     0.3413  -5.922 5.78e-09 ***
## edu_highTRUE         NA         NA      NA       NA    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.454 on 523 degrees of freedom
## Multiple R-squared:  0.1287, Adjusted R-squared:  0.1254 
## F-statistic: 38.64 on 2 and 523 DF,  p-value: 2.236e-16
  reg=lm(wage ~ edu_low+edu_high, wage1)
  
  linearHypothesis(reg,c("edu_lowTRUE=-edu_highTRUE"))
## Linear hypothesis test
## 
## Hypothesis:
## edu_lowTRUE  + edu_highTRUE = 0
## 
## Model 1: restricted model
## Model 2: wage ~ edu_low + edu_high
## 
##   Res.Df    RSS Df Sum of Sq      F Pr(>F)
## 1    524 6253.5                           
## 2    523 6238.6  1    14.888 1.2481 0.2644

Factor variables

wage1 =wage1 %>% mutate(educatsf=factor(educats,label=c("low","normal","high")))

Compare:

wage1 %>% group_by(educatsf) %>% summarise(n())
## # A tibble: 3 x 2
##   educatsf `n()`
##   <fct>    <int>
## 1 low        116
## 2 normal     198
## 3 high       212
wage1 %>% group_by(educats) %>% summarise(n())
## # A tibble: 3 x 2
##   educats `n()`
##     <dbl> <int>
## 1       0   116
## 2       1   198
## 3       2   212

Running the same regression again:

reg2=lm(wage ~ educatsf, wage1)
reg2 %>% summary()
## 
## Call:
## lm(formula = wage ~ educatsf, data = wage1)
## 
## Residuals:
##    Min     1Q Median     3Q    Max 
## -5.393 -2.119 -1.033  1.245 17.587 
## 
## Coefficients:
##                Estimate Std. Error t value Pr(>|t|)    
## (Intercept)      4.0567     0.3207  12.651  < 2e-16 ***
## educatsfnormal   1.3146     0.4038   3.255  0.00121 ** 
## educatsfhigh     3.3359     0.3989   8.363 5.56e-16 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.454 on 523 degrees of freedom
## Multiple R-squared:  0.1287, Adjusted R-squared:  0.1254 
## F-statistic: 38.64 on 2 and 523 DF,  p-value: 2.236e-16

Dummies as dependent variable

  bm=read.csv("https://www.dropbox.com/s/e4w6pjm6b4wz9do/bm.csv?dl=1")
  

  summary(lm(call~ofjobs+computerskills+education,bm))
## 
## Call:
## lm(formula = call ~ ofjobs + computerskills + education, data = bm)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -0.10351 -0.07902 -0.07626 -0.07607  0.92788 
## 
## Coefficients:
##                 Estimate Std. Error t value Pr(>|t|)    
## (Intercept)     0.101742   0.022776   4.467 8.11e-06 ***
## ofjobs          0.001381   0.003287   0.420    0.674    
## computerskills -0.020734   0.010194  -2.034    0.042 *  
## education      -0.002569   0.005586  -0.460    0.646    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.272 on 4866 degrees of freedom
## Multiple R-squared:  0.0008958,  Adjusted R-squared:  0.0002798 
## F-statistic: 1.454 on 3 and 4866 DF,  p-value: 0.225
  summary(lm(call~education,bm))
## 
## Call:
## lm(formula = call ~ education, data = bm)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -0.08841 -0.08185 -0.07966 -0.07966  0.92034 
## 
## Coefficients:
##              Estimate Std. Error t value Pr(>|t|)    
## (Intercept)  0.088407   0.020117   4.395 1.13e-05 ***
## education   -0.002187   0.005454  -0.401    0.688    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.2721 on 4868 degrees of freedom
## Multiple R-squared:  3.304e-05,  Adjusted R-squared:  -0.0001724 
## F-statistic: 0.1608 on 1 and 4868 DF,  p-value: 0.6884
summary(lm(call~black,bm))
## 
## Call:
## lm(formula = call ~ black, data = bm)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -0.09651 -0.09651 -0.06448 -0.06448  0.93552 
## 
## Coefficients:
##              Estimate Std. Error t value Pr(>|t|)    
## (Intercept)  0.096509   0.005505  17.532  < 2e-16 ***
## black       -0.032033   0.007785  -4.115 3.94e-05 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.2716 on 4868 degrees of freedom
## Multiple R-squared:  0.003466,   Adjusted R-squared:  0.003261 
## F-statistic: 16.93 on 1 and 4868 DF,  p-value: 3.941e-05
library(ggplot2)
agg=bm %>% group_by(black) %>% summarise(call=mean(call))
ggplot(agg,aes(x=black,y=call))+geom_bar(stat="identity")+theme_minimal()

What about continous explanatory variables?

(linear0 <- lm(call ~ yearsexp        , data = bm)) %>% summary()
## 
## Call:
## lm(formula = call ~ yearsexp, data = bm)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -0.20030 -0.08101 -0.07439 -0.06776  0.94218 
## 
## Coefficients:
##              Estimate Std. Error t value Pr(>|t|)    
## (Intercept) 0.0545046  0.0071949   7.575 4.26e-14 ***
## yearsexp    0.0033136  0.0007716   4.295 1.78e-05 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.2716 on 4868 degrees of freedom
## Multiple R-squared:  0.003774,   Adjusted R-squared:  0.00357 
## F-statistic: 18.44 on 1 and 4868 DF,  p-value: 1.784e-05
(linear1 <- lm(call ~ factor(yearsexp), data = bm)) %>% summary()
## 
## Call:
## lm(formula = call ~ factor(yearsexp), data = bm)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -0.25000 -0.08194 -0.07246 -0.05998  0.97059 
## 
## Coefficients:
##                      Estimate Std. Error t value Pr(>|t|)  
## (Intercept)         0.0666667  0.0404239   1.649   0.0992 .
## factor(yearsexp)2  -0.0041667  0.0429301  -0.097   0.9227  
## factor(yearsexp)3  -0.0202749  0.0448679  -0.452   0.6514  
## factor(yearsexp)4   0.0152700  0.0420835   0.363   0.7167  
## factor(yearsexp)5   0.0043393  0.0421797   0.103   0.9181  
## factor(yearsexp)6  -0.0066911  0.0415222  -0.161   0.8720  
## factor(yearsexp)7   0.0109673  0.0420715   0.261   0.7943  
## factor(yearsexp)8   0.0059977  0.0419680   0.143   0.8864  
## factor(yearsexp)9   0.0276730  0.0457883   0.604   0.5456  
## factor(yearsexp)10  0.0487179  0.0469013   1.039   0.2990  
## factor(yearsexp)11  0.0373796  0.0453778   0.824   0.4101  
## factor(yearsexp)12  0.0057971  0.0519596   0.112   0.9112  
## factor(yearsexp)13  0.1021645  0.0459520   2.223   0.0262 *
## factor(yearsexp)14  0.0004474  0.0461260   0.010   0.9923  
## factor(yearsexp)15 -0.0372549  0.0616186  -0.605   0.5455  
## factor(yearsexp)16  0.0929078  0.0491566   1.890   0.0588 .
## factor(yearsexp)17 -0.0666667  0.1616955  -0.412   0.6801  
## factor(yearsexp)18  0.0242424  0.0508830   0.476   0.6338  
## factor(yearsexp)19  0.0855072  0.0568565   1.504   0.1327  
## factor(yearsexp)20  0.1333333  0.0611152   2.182   0.0292 *
## factor(yearsexp)21  0.0609929  0.0565566   1.078   0.2809  
## factor(yearsexp)22  0.1833333  0.1040473   1.762   0.0781 .
## factor(yearsexp)23 -0.0666667  0.0990179  -0.673   0.5008  
## factor(yearsexp)25 -0.0666667  0.1101769  -0.605   0.5451  
## factor(yearsexp)26  0.0391026  0.0483854   0.808   0.4190  
## factor(yearsexp)44 -0.0666667  0.2741681  -0.243   0.8079  
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.2712 on 4844 degrees of freedom
## Multiple R-squared:  0.01179,    Adjusted R-squared:  0.006685 
## F-statistic: 2.311 on 25 and 4844 DF,  p-value: 0.0002247

Student Question: A stepwise linear model?

bm= bm %>% mutate(moret10=yearsexp>10,
                  
                  moret10Xyearsexp=moret10*yearsexp,
                  
                  
                  dev=ifelse(moret10==T, yearsexp-10,yearsexp))


lm(call ~ yearsexp        , data = bm) %>% summary()
## 
## Call:
## lm(formula = call ~ yearsexp, data = bm)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -0.20030 -0.08101 -0.07439 -0.06776  0.94218 
## 
## Coefficients:
##              Estimate Std. Error t value Pr(>|t|)    
## (Intercept) 0.0545046  0.0071949   7.575 4.26e-14 ***
## yearsexp    0.0033136  0.0007716   4.295 1.78e-05 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.2716 on 4868 degrees of freedom
## Multiple R-squared:  0.003774,   Adjusted R-squared:  0.00357 
## F-statistic: 18.44 on 1 and 4868 DF,  p-value: 1.784e-05
lm(call ~ yearsexp+moret10        , data = bm) %>% summary()
## 
## Call:
## lm(formula = call ~ yearsexp + moret10, data = bm)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -0.15966 -0.07550 -0.07223 -0.06896  0.93594 
## 
## Coefficients:
##             Estimate Std. Error t value Pr(>|t|)    
## (Intercept) 0.062423   0.008940   6.982  3.3e-12 ***
## yearsexp    0.001634   0.001365   1.197    0.231    
## moret10TRUE 0.025329   0.016979   1.492    0.136    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.2716 on 4867 degrees of freedom
## Multiple R-squared:  0.00423,    Adjusted R-squared:  0.003821 
## F-statistic: 10.34 on 2 and 4867 DF,  p-value: 3.314e-05
res=lm(call ~ yearsexp+moret10+moret10Xyearsexp        , data = bm) 
res %>% summary()
## 
## Call:
## lm(formula = call ~ yearsexp + moret10 + moret10Xyearsexp, data = bm)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -0.12465 -0.07921 -0.07269 -0.06617  0.94360 
## 
## Coefficients:
##                   Estimate Std. Error t value Pr(>|t|)    
## (Intercept)       0.053137   0.012612   4.213 2.56e-05 ***
## yearsexp          0.003259   0.002070   1.574   0.1155    
## moret10TRUE       0.054572   0.032757   1.666   0.0958 .  
## moret10Xyearsexp -0.002874   0.002753  -1.044   0.2966    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.2716 on 4866 degrees of freedom
## Multiple R-squared:  0.004453,   Adjusted R-squared:  0.003839 
## F-statistic: 7.255 on 3 and 4866 DF,  p-value: 7.469e-05
lm(call ~ yearsexp+moret10Xyearsexp        , data = bm) %>% summary()
## 
## Call:
## lm(formula = call ~ yearsexp + moret10Xyearsexp, data = bm)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -0.19595 -0.07734 -0.07331 -0.06928  0.93676 
## 
## Coefficients:
##                  Estimate Std. Error t value Pr(>|t|)    
## (Intercept)      0.061226   0.011642   5.259 1.51e-07 ***
## yearsexp         0.002014   0.001931   1.043    0.297    
## moret10Xyearsexp 0.001048   0.001427   0.734    0.463    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.2716 on 4867 degrees of freedom
## Multiple R-squared:  0.003885,   Adjusted R-squared:  0.003476 
## F-statistic: 9.491 on 2 and 4867 DF,  p-value: 7.696e-05

\[ y=\beta_1 + \beta_2 exper + \beta_3 MT10 + \beta_4 MT10 \times exper\]

say we are at 15 years

\[ y=\beta_1+ \beta_3 + (\beta_2 + \beta_4 )exper \]

bm=bm %>% mutate(hat=res$coefficients[[1]] + 
                     res$coefficients[[2]] * yearsexp+
                     res$coefficients[[3]] * moret10 +
                     res$coefficients[[4]] * moret10Xyearsexp )

ggplot(bm, aes(x=yearsexp,y=hat))+geom_point()

agg2=agg=bm %>% group_by(yearsexp) %>% summarise(call=mean(call))
ggplot(bm,aes(x=yearsexp,y=call) ) + geom_jitter()+
           geom_smooth(method="lm")+
           geom_bar(data=agg2,aes(x=yearsexp,y=call),
                    stat="identity",color="orange",
                    fill="orange",alpha=0.3)+
          theme_minimal()

  summary(lm(call~yearsexp,bm))
## 
## Call:
## lm(formula = call ~ yearsexp, data = bm)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -0.20030 -0.08101 -0.07439 -0.06776  0.94218 
## 
## Coefficients:
##              Estimate Std. Error t value Pr(>|t|)    
## (Intercept) 0.0545046  0.0071949   7.575 4.26e-14 ***
## yearsexp    0.0033136  0.0007716   4.295 1.78e-05 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.2716 on 4868 degrees of freedom
## Multiple R-squared:  0.003774,   Adjusted R-squared:  0.00357 
## F-statistic: 18.44 on 1 and 4868 DF,  p-value: 1.784e-05
  summary(linear2 <- lm(call ~ black, data = bm))
## 
## Call:
## lm(formula = call ~ black, data = bm)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -0.09651 -0.09651 -0.06448 -0.06448  0.93552 
## 
## Coefficients:
##              Estimate Std. Error t value Pr(>|t|)    
## (Intercept)  0.096509   0.005505  17.532  < 2e-16 ***
## black       -0.032033   0.007785  -4.115 3.94e-05 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.2716 on 4868 degrees of freedom
## Multiple R-squared:  0.003466,   Adjusted R-squared:  0.003261 
## F-statistic: 16.93 on 1 and 4868 DF,  p-value: 3.941e-05
  summary(linear1 <- lm(call ~ yearsexp, data = bm))
## 
## Call:
## lm(formula = call ~ yearsexp, data = bm)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -0.20030 -0.08101 -0.07439 -0.06776  0.94218 
## 
## Coefficients:
##              Estimate Std. Error t value Pr(>|t|)    
## (Intercept) 0.0545046  0.0071949   7.575 4.26e-14 ***
## yearsexp    0.0033136  0.0007716   4.295 1.78e-05 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.2716 on 4868 degrees of freedom
## Multiple R-squared:  0.003774,   Adjusted R-squared:  0.00357 
## F-statistic: 18.44 on 1 and 4868 DF,  p-value: 1.784e-05
  library(aod)
  library(margins)
  summary(logit1 <- glm(call ~ yearsexp, data = bm, family = "binomial"))
## 
## Call:
## glm(formula = call ~ yearsexp, family = "binomial", data = bm)
## 
## Deviance Residuals: 
##     Min       1Q   Median       3Q      Max  
## -0.7780  -0.4075  -0.3924  -0.3779   2.3598  
## 
## Coefficients:
##             Estimate Std. Error z value Pr(>|z|)    
## (Intercept) -2.75960    0.09620 -28.687  < 2e-16 ***
## yearsexp     0.03908    0.00918   4.257 2.07e-05 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## (Dispersion parameter for binomial family taken to be 1)
## 
##     Null deviance: 2726.9  on 4869  degrees of freedom
## Residual deviance: 2710.2  on 4868  degrees of freedom
## AIC: 2714.2
## 
## Number of Fisher Scoring iterations: 5
  summary(linear1)
## 
## Call:
## lm(formula = call ~ yearsexp, data = bm)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -0.20030 -0.08101 -0.07439 -0.06776  0.94218 
## 
## Coefficients:
##              Estimate Std. Error t value Pr(>|t|)    
## (Intercept) 0.0545046  0.0071949   7.575 4.26e-14 ***
## yearsexp    0.0033136  0.0007716   4.295 1.78e-05 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.2716 on 4868 degrees of freedom
## Multiple R-squared:  0.003774,   Adjusted R-squared:  0.00357 
## F-statistic: 18.44 on 1 and 4868 DF,  p-value: 1.784e-05
  margins(logit1)
## Average marginal effects
## glm(formula = call ~ yearsexp, family = "binomial", data = bm)
##  yearsexp
##  0.002881
  log(100)
## [1] 4.60517

Note that the linear model is fairly close to the average marginal effect

  summary(logit2 <- glm(call ~ black, data = bm, family = "binomial"))
## 
## Call:
## glm(formula = call ~ black, family = "binomial", data = bm)
## 
## Deviance Residuals: 
##     Min       1Q   Median       3Q      Max  
## -0.4505  -0.4505  -0.3651  -0.3651   2.3416  
## 
## Coefficients:
##             Estimate Std. Error z value Pr(>|z|)    
## (Intercept) -2.23663    0.06863 -32.590  < 2e-16 ***
## black       -0.43818    0.10732  -4.083 4.45e-05 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## (Dispersion parameter for binomial family taken to be 1)
## 
##     Null deviance: 2726.9  on 4869  degrees of freedom
## Residual deviance: 2709.9  on 4868  degrees of freedom
## AIC: 2713.9
## 
## Number of Fisher Scoring iterations: 5
  #summary(linear2)
  margins(logit2)
## Average marginal effects
## glm(formula = call ~ black, family = "binomial", data = bm)
##     black
##  -0.03232
  summary(logit3 <- glm(call ~ black+yearsexp, data = bm, family = "binomial"))
## 
## Call:
## glm(formula = call ~ black + yearsexp, family = "binomial", data = bm)
## 
## Deviance Residuals: 
##     Min       1Q   Median       3Q      Max  
## -0.7008  -0.4318  -0.4006  -0.3496   2.4537  
## 
## Coefficients:
##              Estimate Std. Error z value Pr(>|z|)    
## (Intercept) -2.560532   0.105784 -24.205  < 2e-16 ***
## black       -0.438409   0.107523  -4.077 4.56e-05 ***
## yearsexp     0.039089   0.009199   4.249 2.14e-05 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## (Dispersion parameter for binomial family taken to be 1)
## 
##     Null deviance: 2726.9  on 4869  degrees of freedom
## Residual deviance: 2693.2  on 4867  degrees of freedom
## AIC: 2699.2
## 
## Number of Fisher Scoring iterations: 5
  summary(linear3<- lm(call ~ black+ yearsexp, data = bm))
## 
## Call:
## lm(formula = call ~ black + yearsexp, data = bm)
## 
## Residuals:
##      Min       1Q   Median       3Q      Max 
## -0.18403 -0.09148 -0.07715 -0.05843  0.95810 
## 
## Coefficients:
##               Estimate Std. Error t value Pr(>|t|)    
## (Intercept)  0.0705426  0.0081743   8.630  < 2e-16 ***
## black       -0.0319446  0.0077711  -4.111 4.01e-05 ***
## yearsexp     0.0033052  0.0007703   4.291 1.82e-05 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.2712 on 4867 degrees of freedom
## Multiple R-squared:  0.007221,   Adjusted R-squared:  0.006813 
## F-statistic:  17.7 on 2 and 4867 DF,  p-value: 2.19e-08
  margins(logit3)
## Average marginal effects
## glm(formula = call ~ black + yearsexp, family = "binomial", data = bm)
##     black yearsexp
##  -0.03221 0.002872
  margins(linear3)
## Average marginal effects
## lm(formula = call ~ black + yearsexp, data = bm)
##     black yearsexp
##  -0.03194 0.003305
  #test=lm(call~ yearsexp*education,bm)
  
  #mar=margins(test,type="response")
  
  plot(plogis,-5 ,5, )

  plogis(2)
## [1] 0.8807971
  bm["callstar1"] = plogis(-2.7+bm$yearsexp * .3)
  bm["callstar2"] = plogis( -2.7+bm$yearsexp * 0.06)
  bm["callstar3"] = plogis( -5+bm$yearsexp * 0.06)
  
  bm["callstar4"] = plogis(-1 +bm$yearsexp*.8 )
  
  summary(bm$callstar1)
##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
## 0.08317 0.23148 0.28905 0.40104 0.50000 0.99997
  bm=bm[order(bm$yearsexp),]

  bm["yearsexp_rand"]=bm$yearsexp+runif( nrow(bm),min = -0.1, max = .1)
  bm["call_rand"]=bm$call+runif( nrow(bm),min = -0.02, max = .02)
    
  plot(bm$yearsexp_rand, bm$call_rand,  main="", 
       xlab="Experience", ylab="Call", pch=1)
  
  lines(bm$yearsexp, bm$callstar1  ,col=2)
  lines(bm$yearsexp, bm$callstar2  ,col=3)
  lines(bm$yearsexp, bm$callstar3  ,col=4)
  lines(bm$yearsexp, bm$callstar4  ,col=5)

Nonlinear

  wage1=wage1 %>% mutate(educ2 =educ^2) 
  summary(lm(wage ~ educ+educ2, wage1))
## 
## Call:
## lm(formula = wage ~ educ + educ2, data = wage1)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -6.8722 -2.0002 -0.7472  1.2642 17.0159 
## 
## Coefficients:
##             Estimate Std. Error t value Pr(>|t|)    
## (Intercept)  5.40769    1.45886   3.707 0.000232 ***
## educ        -0.60750    0.24149  -2.516 0.012181 *  
## educ2        0.04907    0.01007   4.872 1.46e-06 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 3.307 on 523 degrees of freedom
## Multiple R-squared:  0.201,  Adjusted R-squared:  0.198 
## F-statistic: 65.79 on 2 and 523 DF,  p-value: < 2.2e-16
  library(ggplot2)
  
  ggplot(wage1, aes(x=educ, y=wage))+geom_point()+theme_minimal()+
    geom_smooth(method=lm,se=FALSE,formula=y ~ poly(x, 2))

`

log linear

  library(ggplot2)
  z=seq(-.1,.1,.001)
  ln1Pz=log(1+z)
  df=data.frame(z,ln1Pz)
  ggplot(df,aes(x=z))+geom_line(aes(y=ln1Pz),color="green")+
            geom_line(aes(y=z),color="red") + theme_minimal() + ylab("ln(1+z)")

Many dummies as control

library(dplyr)
prod=read.csv("https://www.dropbox.com/s/v1j4xzkaado8zlz/prod_balanced.csv?dl=1")
prod=prod %>% mutate(lnl=log(l),lnva=log(va))
prod=prod %>% arrange(id,year) %>% select(id,year,va,l,k,lnk,lnl,lnva)


reg1<-lm(lnva~lnl+lnk,prod) 
reg1 %>% summary()
## 
## Call:
## lm(formula = lnva ~ lnl + lnk, data = prod)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -3.8415 -0.4453  0.0326  0.4820  3.0979 
## 
## Coefficients:
##             Estimate Std. Error t value Pr(>|t|)    
## (Intercept) 3.423770   0.034256   99.95   <2e-16 ***
## lnl         0.950352   0.010352   91.81   <2e-16 ***
## lnk         0.304229   0.005801   52.45   <2e-16 ***
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.7568 on 14501 degrees of freedom
## Multiple R-squared:  0.7483, Adjusted R-squared:  0.7482 
## F-statistic: 2.155e+04 on 2 and 14501 DF,  p-value: < 2.2e-16
reg2<-lm(lnva~lnl+lnk+factor(year),prod) 
reg2 %>% summary()
## 
## Call:
## lm(formula = lnva ~ lnl + lnk + factor(year), data = prod)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -3.9437 -0.4423  0.0321  0.4801  3.0727 
## 
## Coefficients:
##                 Estimate Std. Error t value Pr(>|t|)    
## (Intercept)     3.400842   0.038004  89.486  < 2e-16 ***
## lnl             0.949582   0.010386  91.428  < 2e-16 ***
## lnk             0.303976   0.005813  52.296  < 2e-16 ***
## factor(year)80  0.057615   0.025075   2.298   0.0216 *  
## factor(year)81  0.130706   0.025077   5.212 1.89e-07 ***
## factor(year)82  0.049363   0.025085   1.968   0.0491 *  
## factor(year)83 -0.031615   0.025081  -1.260   0.2075    
## factor(year)84  0.010665   0.025076   0.425   0.6706    
## factor(year)85 -0.055827   0.025090  -2.225   0.0261 *  
## factor(year)86  0.062352   0.025121   2.482   0.0131 *  
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.7549 on 14494 degrees of freedom
## Multiple R-squared:  0.7496, Adjusted R-squared:  0.7495 
## F-statistic:  4821 on 9 and 14494 DF,  p-value: < 2.2e-16
reg2<-lm(lnva~lnl+lnk+factor(year)+factor(id),prod) 
reg2 %>% summary()
## 
## Call:
## lm(formula = lnva ~ lnl + lnk + factor(year) + factor(id), data = prod)
## 
## Residuals:
##     Min      1Q  Median      3Q     Max 
## -3.5554 -0.2349  0.0323  0.2767  3.2121 
## 
## Coefficients:
##                   Estimate Std. Error t value Pr(>|t|)    
## (Intercept)      5.6053565  0.2142689  26.160  < 2e-16 ***
## lnl              0.7302864  0.0191514  38.132  < 2e-16 ***
## lnk              0.0832028  0.0144970   5.739 9.72e-09 ***
## factor(year)80   0.0775959  0.0171329   4.529 5.98e-06 ***
## factor(year)81   0.1594889  0.0171602   9.294  < 2e-16 ***
## factor(year)82   0.0471271  0.0171524   2.748 0.006013 ** 
## factor(year)83  -0.0429621  0.0171425  -2.506 0.012217 *  
## factor(year)84   0.0061375  0.0171152   0.359 0.719903    
## factor(year)85  -0.0543233  0.0171777  -3.162 0.001568 ** 
## factor(year)86   0.0725690  0.0173079   4.193 2.77e-05 ***
## factor(id)81     1.4392760  0.2608948   5.517 3.52e-08 ***
## factor(id)99    -0.1671771  0.2580364  -0.648 0.517073    
## factor(id)117    0.8002776  0.2582686   3.099 0.001948 ** 
## factor(id)135   -0.0069199  0.2578253  -0.027 0.978588    
## factor(id)162    1.5912130  0.2632387   6.045 1.54e-09 ***
## factor(id)171    1.0838099  0.2594566   4.177 2.97e-05 ***
## factor(id)198   -0.6712341  0.2578931  -2.603 0.009258 ** 
## factor(id)342    0.5866663  0.2610479   2.247 0.024635 *  
## factor(id)396    0.1227912  0.2579268   0.476 0.634033    
## factor(id)414    1.5716587  0.2578788   6.095 1.13e-09 ***
## factor(id)558   -0.6740037  0.2575815  -2.617 0.008890 ** 
## factor(id)648    0.5636927  0.2583559   2.182 0.029139 *  
## factor(id)729   -0.3576507  0.2576500  -1.388 0.165123    
## factor(id)819    1.5474498  0.2731501   5.665 1.50e-08 ***
## factor(id)891   -0.1705523  0.2577757  -0.662 0.508220    
## factor(id)981    1.2012318  0.2612698   4.598 4.31e-06 ***
## factor(id)1152   2.5132660  0.2755971   9.119  < 2e-16 ***
## factor(id)1224   1.5204115  0.2601218   5.845 5.19e-09 ***
## factor(id)1278   1.4528151  0.2577798   5.636 1.78e-08 ***
## factor(id)1287   0.0813430  0.2576937   0.316 0.752268    
## factor(id)1314   1.3744719  0.2578788   5.330 9.99e-08 ***
## factor(id)1341  -0.3129771  0.2577263  -1.214 0.224626    
## factor(id)1458  -0.2892183  0.2582628  -1.120 0.262794    
## factor(id)1485   1.5617484  0.2712359   5.758 8.71e-09 ***
## factor(id)1548  -0.1528757  0.2581165  -0.592 0.553678    
## factor(id)1584  -0.1817287  0.2575900  -0.705 0.480515    
## factor(id)1656  -0.6440409  0.2576363  -2.500 0.012439 *  
## factor(id)1665  -0.3132619  0.2577664  -1.215 0.224277    
## factor(id)1728   0.3898441  0.2582572   1.510 0.131191    
## factor(id)1755  -0.1757968  0.2580292  -0.681 0.495691    
## factor(id)1764   0.2506937  0.2576516   0.973 0.330574    
## factor(id)1773  -0.6745368  0.2577635  -2.617 0.008884 ** 
## factor(id)1854   0.2580016  0.2594085   0.995 0.319961    
## factor(id)1872  -0.3059760  0.2576493  -1.188 0.235026    
## factor(id)2052   2.1571661  0.2612985   8.256  < 2e-16 ***
## factor(id)2061  -0.4319763  0.2575558  -1.677 0.093525 .  
## factor(id)2169  -0.1298966  0.2580013  -0.503 0.614641    
## factor(id)2223   1.2859217  0.2629495   4.890 1.02e-06 ***
## factor(id)2241  -0.1630382  0.2580493  -0.632 0.527522    
## factor(id)2286   0.4990979  0.2603165   1.917 0.055226 .  
## factor(id)2295   0.9852219  0.2611796   3.772 0.000163 ***
## factor(id)2331   0.8541909  0.2580046   3.311 0.000933 ***
## factor(id)2349   0.1338416  0.2580956   0.519 0.604067    
## factor(id)2403   0.5777349  0.2591303   2.230 0.025797 *  
## factor(id)2421  -0.0061601  0.2575429  -0.024 0.980918    
## factor(id)2448   0.0964410  0.2580097   0.374 0.708568    
## factor(id)2475   1.4355043  0.2631320   5.455 4.98e-08 ***
## factor(id)2673   0.0144194  0.2583855   0.056 0.955498    
## factor(id)2709  -0.1662128  0.2577322  -0.645 0.519000    
## factor(id)2727  -0.0147164  0.2627237  -0.056 0.955331    
## factor(id)2889  -0.3866347  0.2576176  -1.501 0.133430    
## factor(id)2907   0.1298096  0.2578423   0.503 0.614660    
## factor(id)3033   0.2009196  0.2576569   0.780 0.435526    
## factor(id)3069   0.2682161  0.2585572   1.037 0.299589    
## factor(id)3105   1.0558392  0.2617694   4.033 5.53e-05 ***
## factor(id)3114  -0.2437408  0.2595274  -0.939 0.347660    
## factor(id)3123  -0.6826611  0.2579146  -2.647 0.008135 ** 
## factor(id)3159  -0.3801967  0.2576666  -1.476 0.140093    
## factor(id)3402  -0.3274581  0.2576417  -1.271 0.203758    
## factor(id)3429  -0.1124442  0.2587536  -0.435 0.663889    
## factor(id)3492  -0.5328434  0.2576081  -2.068 0.038620 *  
## factor(id)3501   0.4488308  0.2612827   1.718 0.085858 .  
## factor(id)3609   0.5740498  0.2579775   2.225 0.026086 *  
## factor(id)3636   1.9612776  0.2706823   7.246 4.55e-13 ***
## factor(id)3987  -0.2724541  0.2577776  -1.057 0.290561    
## factor(id)4023  -0.0332804  0.2579733  -0.129 0.897354    
## factor(id)4509  -0.1502970  0.2578681  -0.583 0.560008    
## factor(id)4599   0.2285003  0.2577492   0.887 0.375353    
## factor(id)4653   0.1672693  0.2580586   0.648 0.516878    
## factor(id)4842  -0.1946538  0.2575439  -0.756 0.449778    
## factor(id)4896  -0.5156019  0.2575777  -2.002 0.045335 *  
## factor(id)4923   2.5063944  0.2670160   9.387  < 2e-16 ***
## factor(id)4968  -0.0867783  0.2576741  -0.337 0.736292    
## factor(id)4986   0.5715317  0.2584749   2.211 0.027042 *  
## factor(id)5094   0.1015499  0.2585121   0.393 0.694456    
## factor(id)5112  -0.0020624  0.2579723  -0.008 0.993621    
## factor(id)5211   0.2337764  0.2578588   0.907 0.364632    
## factor(id)5265  -0.0748174  0.2577130  -0.290 0.771582    
## factor(id)5301  -0.1092679  0.2579184  -0.424 0.671826    
## factor(id)5346  -0.1151677  0.2575644  -0.447 0.654781    
## factor(id)5589   1.0769387  0.2594258   4.151 3.33e-05 ***
## factor(id)5607  -0.6144993  0.2580085  -2.382 0.017248 *  
## factor(id)5661   1.4233706  0.2625286   5.422 6.01e-08 ***
## factor(id)5724  -0.4413269  0.2575495  -1.714 0.086634 .  
## factor(id)5733   1.0410181  0.2577489   4.039 5.40e-05 ***
## factor(id)5832  -0.0733566  0.2578258  -0.285 0.776016    
## factor(id)5868  -0.2832355  0.2580221  -1.098 0.272349    
## factor(id)5931  -0.4533294  0.2583037  -1.755 0.079279 .  
## factor(id)5985   1.3574239  0.2724058   4.983 6.34e-07 ***
## factor(id)6012   1.8193159  0.2621635   6.940 4.12e-12 ***
## factor(id)6426   0.5433908  0.2580906   2.105 0.035274 *  
## factor(id)6444   0.2173953  0.2576237   0.844 0.398770    
## factor(id)6471  -0.2688491  0.2578886  -1.043 0.297199    
## factor(id)6624  -0.2062838  0.2575507  -0.801 0.423179    
## factor(id)6741   0.0877309  0.2576211   0.341 0.733454    
## factor(id)6795   0.1731511  0.2577135   0.672 0.501676    
## factor(id)6858  -0.0806132  0.2577533  -0.313 0.754473    
## factor(id)6885   0.3467357  0.2576001   1.346 0.178319    
## factor(id)6894  -0.0435249  0.2578973  -0.169 0.865981    
## factor(id)6903   0.2720593  0.2577978   1.055 0.291299    
## factor(id)6975   0.6526391  0.2584905   2.525 0.011588 *  
## factor(id)7011  -0.0396861  0.2576959  -0.154 0.877609    
## factor(id)7083   0.6094403  0.2578111   2.364 0.018099 *  
## factor(id)7164   0.4656035  0.2583857   1.802 0.071574 .  
## factor(id)7209  -0.3607335  0.2583908  -1.396 0.162716    
## factor(id)7299  -0.1095113  0.2577886  -0.425 0.670982    
## factor(id)7326   0.7544807  0.2579063   2.925 0.003446 ** 
## factor(id)7353   0.1679271  0.2578725   0.651 0.514928    
## factor(id)7398  -0.1480079  0.2577431  -0.574 0.565812    
## factor(id)7443   0.2106772  0.2627258   0.802 0.422631    
## factor(id)7515  -0.3178395  0.2577160  -1.233 0.217489    
## factor(id)7596  -0.3197714  0.2577780  -1.240 0.214817    
## factor(id)7623   0.1998341  0.2578562   0.775 0.438364    
## factor(id)7668   1.5057880  0.2664464   5.651 1.63e-08 ***
## factor(id)7677   1.5146228  0.2653159   5.709 1.16e-08 ***
## factor(id)7785   1.5518669  0.2618405   5.927 3.17e-09 ***
## factor(id)7803  -0.0323204  0.2576949  -0.125 0.900192    
## factor(id)7812   1.0298748  0.2594626   3.969 7.25e-05 ***
## factor(id)7866   0.8684375  0.2576089   3.371 0.000751 ***
## factor(id)7938   0.4941167  0.2582497   1.913 0.055728 .  
## factor(id)7965   0.7199156  0.2579250   2.791 0.005259 ** 
## factor(id)7974   0.2785320  0.2577409   1.081 0.279866    
## factor(id)7983   2.2302877  0.2689122   8.294  < 2e-16 ***
## factor(id)8046   1.1633360  0.2576175   4.516 6.37e-06 ***
## factor(id)8082   0.5704329  0.2584518   2.207 0.027324 *  
## factor(id)8208  -0.1953042  0.2576472  -0.758 0.448447    
## factor(id)8505  -0.3717024  0.2579770  -1.441 0.149656    
## factor(id)8532   1.2849754  0.2701073   4.757 1.98e-06 ***
## factor(id)8541  -0.4923612  0.2577859  -1.910 0.056161 .  
## factor(id)8559   1.9683455  0.2655348   7.413 1.32e-13 ***
## factor(id)8721   0.8004612  0.2575595   3.108 0.001889 ** 
## factor(id)8775  -0.1094935  0.2588459  -0.423 0.672298    
## factor(id)8865   0.5771952  0.2578436   2.239 0.025203 *  
## factor(id)8874  -0.4455492  0.2585102  -1.724 0.084818 .  
## factor(id)8883  -0.0036825  0.2577781  -0.014 0.988603    
## factor(id)9036   0.8151417  0.2583119   3.156 0.001605 ** 
## factor(id)9117   1.7223527  0.2678553   6.430 1.32e-10 ***
## factor(id)9171  -0.0544743  0.2575532  -0.212 0.832495    
## factor(id)9252   0.7591785  0.2581005   2.941 0.003273 ** 
## factor(id)9288  -0.4592225  0.2576772  -1.782 0.074747 .  
## factor(id)9351  -0.1982058  0.2575619  -0.770 0.441583    
## factor(id)9405  -0.0281443  0.2575801  -0.109 0.912994    
## factor(id)9432  -0.2304837  0.2596242  -0.888 0.374687    
## factor(id)9504   1.2247391  0.2585568   4.737 2.19e-06 ***
## factor(id)9531  -0.2061907  0.2578039  -0.800 0.423843    
## factor(id)9585   0.3078889  0.2578178   1.194 0.232418    
## factor(id)9621   0.9858477  0.2578601   3.823 0.000132 ***
## factor(id)9738   0.6817862  0.2588591   2.634 0.008453 ** 
## factor(id)9864  -0.2836752  0.2577787  -1.100 0.271153    
## factor(id)9882   0.3524980  0.2575957   1.368 0.171206    
## factor(id)9999   1.0649418  0.2576996   4.132 3.61e-05 ***
## factor(id)10152 -0.3592823  0.2575784  -1.395 0.163087    
## factor(id)10161  0.0333903  0.2575605   0.130 0.896853    
## factor(id)10197  0.1351917  0.2576507   0.525 0.599794    
## factor(id)10215  0.6423963  0.2593039   2.477 0.013248 *  
## factor(id)10305  1.2811954  0.2584768   4.957 7.26e-07 ***
## factor(id)10314 -0.5480554  0.2578306  -2.126 0.033552 *  
## factor(id)10332  0.3690367  0.2598475   1.420 0.155573    
## factor(id)10404  0.8984023  0.2591895   3.466 0.000530 ***
## factor(id)10512  2.0005032  0.2686775   7.446 1.03e-13 ***
## factor(id)10539  0.9030891  0.2585842   3.492 0.000480 ***
## factor(id)10566 -0.0746629  0.2577217  -0.290 0.772048    
## factor(id)10629  0.3198972  0.2575452   1.242 0.214222    
## factor(id)10656  0.8133736  0.2607226   3.120 0.001814 ** 
## factor(id)10665  0.6248251  0.2577117   2.425 0.015343 *  
## factor(id)10755 -0.1440702  0.2576591  -0.559 0.576069    
## factor(id)10764 -1.1909359  0.2575751  -4.624 3.81e-06 ***
## factor(id)10791 -0.2819472  0.2576068  -1.094 0.273762    
## factor(id)10827  0.7433302  0.2603923   2.855 0.004315 ** 
## factor(id)10836  0.6532242  0.2576348   2.535 0.011242 *  
## factor(id)10872  1.7957256  0.2615440   6.866 6.92e-12 ***
## factor(id)10944  2.2976751  0.2642698   8.694  < 2e-16 ***
## factor(id)10989  0.3891728  0.2575570   1.511 0.130809    
## factor(id)11097 -0.4532417  0.2576940  -1.759 0.078629 .  
## factor(id)11106  1.0274656  0.2585665   3.974 7.12e-05 ***
## factor(id)11151  0.1316017  0.2579707   0.510 0.609961    
## factor(id)11169 -0.0089520  0.2575732  -0.035 0.972276    
## factor(id)11223 -0.0963749  0.2575874  -0.374 0.708303    
## factor(id)11313  1.4683060  0.2603314   5.640 1.74e-08 ***
## factor(id)11349  0.9015788  0.2579561   3.495 0.000476 ***
## factor(id)11412 -0.0410223  0.2580201  -0.159 0.873680    
## factor(id)11439  1.1250945  0.2581947   4.358 1.33e-05 ***
## factor(id)11511  0.5734882  0.2581415   2.222 0.026328 *  
## factor(id)11529  0.8827832  0.2584312   3.416 0.000638 ***
## factor(id)11565  1.0232313  0.2580534   3.965 7.37e-05 ***
## factor(id)11574  1.2813843  0.2666843   4.805 1.57e-06 ***
## factor(id)11592  2.4459877  0.2708603   9.030  < 2e-16 ***
## factor(id)11646  0.1419746  0.2575680   0.551 0.581498    
## factor(id)11664 -0.3277676  0.2579636  -1.271 0.203896    
## factor(id)11682  1.9284909  0.2610381   7.388 1.59e-13 ***
## factor(id)11709  1.8917601  0.2637312   7.173 7.74e-13 ***
## factor(id)11754 -0.1092171  0.2576583  -0.424 0.671658    
## factor(id)11781  0.2799615  0.2577426   1.086 0.277409    
## factor(id)11808 -0.5246385  0.2575668  -2.037 0.041680 *  
## factor(id)11862  1.3132752  0.2771551   4.738 2.18e-06 ***
## factor(id)11889 -0.2809217  0.2575998  -1.091 0.275498    
## factor(id)11898  0.4961815  0.2579381   1.924 0.054421 .  
## factor(id)11952  0.5456608  0.2599818   2.099 0.035851 *  
## factor(id)11961 -0.2316740  0.2579114  -0.898 0.369059    
## factor(id)12222 -0.3318210  0.2577440  -1.287 0.197977    
## factor(id)12276  1.7337017  0.2618918   6.620 3.74e-11 ***
## factor(id)12312  0.5525012  0.2590632   2.133 0.032969 *  
## factor(id)12357 -0.5907283  0.2579194  -2.290 0.022017 *  
## factor(id)12393 -0.3237789  0.2578732  -1.256 0.209294    
## factor(id)12438 -0.5496043  0.2575811  -2.134 0.032885 *  
## factor(id)12492 -0.1587471  0.2576953  -0.616 0.537888    
## factor(id)12546  0.3718939  0.2575499   1.444 0.148773    
## factor(id)12654  0.7648132  0.2595071   2.947 0.003213 ** 
## factor(id)12744 -0.0993578  0.2576121  -0.386 0.699735    
## factor(id)12771  0.5183026  0.2583211   2.006 0.044832 *  
## factor(id)12807  1.9314573  0.2610901   7.398 1.47e-13 ***
## factor(id)12816  0.5872067  0.2581343   2.275 0.022934 *  
## factor(id)12924  1.4518064  0.2619644   5.542 3.05e-08 ***
## factor(id)12951  0.9011965  0.2646234   3.406 0.000662 ***
## factor(id)13032  0.7437886  0.2576185   2.887 0.003894 ** 
## factor(id)13059  2.4327336  0.2656587   9.157  < 2e-16 ***
## factor(id)13095  2.0556395  0.2619100   7.849 4.54e-15 ***
## factor(id)13284 -0.4516646  0.2577102  -1.753 0.079694 .  
## factor(id)13383 -0.6719139  0.2576672  -2.608 0.009126 ** 
## factor(id)13536 -0.3637040  0.2575412  -1.412 0.157911    
## factor(id)13626 -0.8372739  0.2576794  -3.249 0.001160 ** 
## factor(id)13653  0.0148108  0.2576761   0.057 0.954165    
## factor(id)13698 -0.2492932  0.2594680  -0.961 0.336678    
## factor(id)13797  0.0002636  0.2576224   0.001 0.999184    
## factor(id)13842 -0.8180049  0.2585721  -3.164 0.001562 ** 
## factor(id)13878  0.1961771  0.2580029   0.760 0.447049    
## factor(id)13887  0.9043588  0.2717908   3.327 0.000879 ***
## factor(id)14022  0.1340688  0.2584010   0.519 0.603881    
## factor(id)14058  0.8083849  0.2584442   3.128 0.001765 ** 
## factor(id)14112  0.6965662  0.2621771   2.657 0.007897 ** 
## factor(id)14238  0.3827988  0.2580129   1.484 0.137929    
## factor(id)14265  0.1411750  0.2577914   0.548 0.583954    
## factor(id)14355  0.6755351  0.2577402   2.621 0.008778 ** 
## factor(id)14445  1.6134039  0.2619588   6.159 7.54e-10 ***
## factor(id)14454  0.6974905  0.2576412   2.707 0.006794 ** 
## factor(id)14463  0.3134467  0.2576145   1.217 0.223731    
## factor(id)14472 -0.1413459  0.2580317  -0.548 0.583849    
## factor(id)14652 -0.1270662  0.2577694  -0.493 0.622060    
## factor(id)14661  0.0066410  0.2578362   0.026 0.979452    
## factor(id)14688  0.0530282  0.2576254   0.206 0.836923    
## factor(id)14796  0.2811379  0.2583457   1.088 0.276517    
## factor(id)14841  0.1657306  0.2587850   0.640 0.521912    
## factor(id)14913  0.6332614  0.2576875   2.457 0.014005 *  
## factor(id)14994  0.4002107  0.2575754   1.554 0.120266    
## factor(id)15066 -0.3233889  0.2595791  -1.246 0.212853    
## factor(id)15579 -0.9695540  0.2578007  -3.761 0.000170 ***
## factor(id)15831 -0.0804378  0.2585369  -0.311 0.755709    
## factor(id)15885  0.3901905  0.2579912   1.512 0.130453    
## factor(id)15921  0.9751771  0.2657034   3.670 0.000243 ***
## factor(id)15957  0.5899285  0.2575575   2.290 0.022010 *  
## factor(id)15984  0.8378102  0.2578133   3.250 0.001158 ** 
## factor(id)16065  0.1693749  0.2581344   0.656 0.511740    
## factor(id)16074  0.6093603  0.2586236   2.356 0.018480 *  
## factor(id)16092 -0.0337487  0.2577631  -0.131 0.895833    
## factor(id)16443  2.5837194  0.2669742   9.678  < 2e-16 ***
## factor(id)16578  1.0400232  0.2579903   4.031 5.58e-05 ***
## factor(id)16605  0.7649085  0.2686183   2.848 0.004413 ** 
## factor(id)16641  0.3830582  0.2576228   1.487 0.137067    
## factor(id)16713  0.8089646  0.2583159   3.132 0.001742 ** 
## factor(id)16722  0.6304875  0.2580211   2.444 0.014557 *  
## factor(id)17118 -0.4642023  0.2575469  -1.802 0.071506 .  
## factor(id)17145  0.6438859  0.2582412   2.493 0.012667 *  
## factor(id)17181 -0.1603023  0.2575695  -0.622 0.533713    
## factor(id)17316 -0.3295143  0.2576286  -1.279 0.200910    
## factor(id)17388 -0.1144119  0.2576336  -0.444 0.656987    
## factor(id)17415 -0.7501510  0.2576144  -2.912 0.003598 ** 
## factor(id)17451  0.9839120  0.2594958   3.792 0.000150 ***
## factor(id)17595 -0.0868266  0.2579693  -0.337 0.736441    
## factor(id)17613  0.0203150  0.2576125   0.079 0.937146    
## factor(id)17775  0.4121475  0.2575941   1.600 0.109626    
## factor(id)17784 -0.0357509  0.2579877  -0.139 0.889787    
## factor(id)17865  1.3705608  0.2612926   5.245 1.59e-07 ***
## factor(id)17874  1.0864165  0.2626706   4.136 3.56e-05 ***
## factor(id)17991 -0.2200028  0.2579671  -0.853 0.393768    
## factor(id)18054 -0.2688313  0.2576476  -1.043 0.296780    
## factor(id)18117 -0.1913289  0.2578086  -0.742 0.458019    
## factor(id)18189 -0.9035946  0.2576507  -3.507 0.000455 ***
## factor(id)18315  0.8801205  0.2604813   3.379 0.000730 ***
## factor(id)18801 -0.5706167  0.2577169  -2.214 0.026838 *  
## factor(id)18873  0.3197902  0.2577628   1.241 0.214763    
## factor(id)19125  0.5088652  0.2630598   1.934 0.053085 .  
## factor(id)19161  1.5693947  0.2623568   5.982 2.26e-09 ***
## factor(id)19179  0.3131688  0.2576691   1.215 0.224239    
## factor(id)19188 -0.2063933  0.2575720  -0.801 0.422971    
## factor(id)19197  1.3171778  0.2642076   4.985 6.27e-07 ***
## factor(id)19224 -0.1267737  0.2576575  -0.492 0.622711    
## factor(id)19233 -1.0682424  0.2577272  -4.145 3.42e-05 ***
## factor(id)19287 -0.3333679  0.2579802  -1.292 0.196304    
## factor(id)19485  0.8719993  0.2737073   3.186 0.001447 ** 
## factor(id)19539  2.1003306  0.2665189   7.881 3.52e-15 ***
## factor(id)19638 -0.4462799  0.2582937  -1.728 0.084048 .  
## factor(id)19692  0.3725877  0.2581246   1.443 0.148921    
## factor(id)19998 -0.5642270  0.2593443  -2.176 0.029604 *  
## factor(id)20133 -0.9301696  0.2576065  -3.611 0.000306 ***
## factor(id)20205 -0.3507145  0.2576062  -1.361 0.173400    
## factor(id)20241 -0.3017667  0.2579432  -1.170 0.242065    
## factor(id)20331 -0.2593870  0.2575719  -1.007 0.313931    
## factor(id)20412 -0.4826655  0.2576367  -1.873 0.061031 .  
## factor(id)20727  0.6311036  0.2599453   2.428 0.015203 *  
## factor(id)20925 -0.8503157  0.2577204  -3.299 0.000972 ***
## factor(id)21015  0.2859019  0.2576741   1.110 0.267215    
## factor(id)21024 -0.9127918  0.2583260  -3.533 0.000412 ***
## factor(id)21033 -0.5028677  0.2575978  -1.952 0.050943 .  
## factor(id)21132  0.3429480  0.2580545   1.329 0.183880    
## factor(id)21177 -0.7160283  0.2575740  -2.780 0.005446 ** 
## factor(id)21195  0.0117806  0.2575579   0.046 0.963518    
## factor(id)21258 -1.2825719  0.2579635  -4.972 6.72e-07 ***
## factor(id)21303 -0.3104342  0.2576334  -1.205 0.228247    
## factor(id)21312  0.9528134  0.2586733   3.683 0.000231 ***
## factor(id)21456 -0.5073668  0.2576205  -1.969 0.048925 *  
## factor(id)21474  0.0153714  0.2576147   0.060 0.952421    
## factor(id)21492 -0.1977519  0.2578201  -0.767 0.443087    
## factor(id)21555  0.6467858  0.2629772   2.459 0.013927 *  
## factor(id)21573  1.1119144  0.2584060   4.303 1.70e-05 ***
## factor(id)21609 -0.3881621  0.2577258  -1.506 0.132065    
## factor(id)21816 -0.0863480  0.2577633  -0.335 0.737638    
## factor(id)21951  0.9331782  0.2698532   3.458 0.000546 ***
## factor(id)22014 -1.4081031  0.2577256  -5.464 4.75e-08 ***
## factor(id)22059 -1.0245526  0.2577389  -3.975 7.07e-05 ***
## factor(id)22176  1.2686991  0.2705425   4.689 2.77e-06 ***
## factor(id)22185  0.3875184  0.2596488   1.492 0.135601    
## factor(id)22203  1.2011934  0.2655569   4.523 6.14e-06 ***
## factor(id)22212  0.4211678  0.2593617   1.624 0.104430    
## factor(id)22338  0.4416127  0.2588334   1.706 0.088002 .  
## factor(id)22383  1.7843131  0.2692898   6.626 3.59e-11 ***
## factor(id)22437 -0.6445127  0.2576074  -2.502 0.012365 *  
## factor(id)22482  2.0480367  0.2668890   7.674 1.79e-14 ***
## factor(id)22608 -0.1741308  0.2576059  -0.676 0.499080    
## factor(id)22626  0.0695088  0.2580999   0.269 0.787696    
## factor(id)22644  1.6452723  0.2647710   6.214 5.33e-10 ***
## factor(id)22734 -0.2448785  0.2576259  -0.951 0.341866    
## factor(id)22833 -1.2270543  0.2576761  -4.762 1.94e-06 ***
## factor(id)22914  0.5613263  0.2578938   2.177 0.029530 *  
## factor(id)22923 -0.1325888  0.2576076  -0.515 0.606777    
## factor(id)23022  0.5391880  0.2592080   2.080 0.037533 *  
## factor(id)23031  1.6011915  0.2638893   6.068 1.33e-09 ***
## factor(id)23067  1.6169708  0.2639575   6.126 9.29e-10 ***
## factor(id)23076  2.3402666  0.2646765   8.842  < 2e-16 ***
## factor(id)23382 -0.2527433  0.2576288  -0.981 0.326593    
## factor(id)23463  0.2621448  0.2582900   1.015 0.310161    
## factor(id)23472  1.2978177  0.2612715   4.967 6.88e-07 ***
## factor(id)23499 -0.5055371  0.2577404  -1.961 0.049852 *  
## factor(id)23526  0.0061493  0.2575897   0.024 0.980955    
## factor(id)23715 -0.6691501  0.2580913  -2.593 0.009534 ** 
## factor(id)23823 -0.0922413  0.2597841  -0.355 0.722544    
## factor(id)24048  1.1004108  0.2595257   4.240 2.25e-05 ***
## factor(id)24066  0.3019804  0.2585390   1.168 0.242818    
## factor(id)24282  1.0906119  0.2612856   4.174 3.01e-05 ***
## factor(id)24309 -0.3670548  0.2578845  -1.423 0.154665    
## factor(id)24318 -0.5239155  0.2575834  -2.034 0.041976 *  
## factor(id)24327 -0.2763803  0.2586594  -1.069 0.285311    
## factor(id)24336 -0.2109157  0.2576553  -0.819 0.413032    
## factor(id)24399 -0.4430262  0.2577705  -1.719 0.085696 .  
## factor(id)24471 -0.6819903  0.2576699  -2.647 0.008137 ** 
## factor(id)24516  1.1821517  0.2595524   4.555 5.30e-06 ***
## factor(id)24687 -0.0581499  0.2576985  -0.226 0.821477    
## factor(id)24768 -0.4048089  0.2675844  -1.513 0.130348    
## factor(id)24822  1.2116513  0.2592017   4.675 2.98e-06 ***
## factor(id)24993  1.5655982  0.2606046   6.008 1.93e-09 ***
## factor(id)25155  0.1156813  0.2578530   0.449 0.653704    
## factor(id)25173 -0.0540205  0.2575441  -0.210 0.833864    
## factor(id)25209  0.6244677  0.2641237   2.364 0.018079 *  
## factor(id)25335 -0.8655040  0.2608185  -3.318 0.000908 ***
## factor(id)25569  0.1054949  0.2577918   0.409 0.682381    
## factor(id)25659 -0.5678164  0.2580295  -2.201 0.027783 *  
## factor(id)25686  2.0833433  0.2759497   7.550 4.66e-14 ***
## factor(id)25713  0.9562302  0.2607645   3.667 0.000246 ***
## factor(id)25758 -0.8538002  0.2576486  -3.314 0.000923 ***
## factor(id)25866 -1.9513067  0.2581080  -7.560 4.31e-14 ***
## factor(id)25974 -0.0157964  0.2588658  -0.061 0.951343    
## factor(id)25983  0.1801421  0.2596571   0.694 0.487840    
## factor(id)25992  1.5245019  0.2590973   5.884 4.11e-09 ***
## factor(id)26091 -0.4905536  0.2582036  -1.900 0.057473 .  
## factor(id)26118 -0.2777341  0.2587713  -1.073 0.283166    
## factor(id)26172  0.1896268  0.2575795   0.736 0.461630    
## factor(id)26181  0.3330246  0.2586881   1.287 0.197992    
## factor(id)26298  1.0476401  0.2636478   3.974 7.12e-05 ***
## factor(id)26496  1.3146203  0.2589610   5.077 3.90e-07 ***
## factor(id)26514  0.5347234  0.2606822   2.051 0.040263 *  
## factor(id)26523 -0.0679271  0.2585432  -0.263 0.792763    
## factor(id)26541 -0.5480269  0.2579258  -2.125 0.033627 *  
## factor(id)26622  1.7920728  0.2638918   6.791 1.16e-11 ***
## factor(id)26838  1.3832409  0.2590909   5.339 9.52e-08 ***
## factor(id)26847  1.5127536  0.2578338   5.867 4.54e-09 ***
## factor(id)26883  1.4641839  0.2592596   5.648 1.66e-08 ***
## factor(id)26892  0.3819475  0.2590555   1.474 0.140403    
## factor(id)26937  1.4952419  0.2644602   5.654 1.60e-08 ***
## factor(id)26955  1.8984155  0.2731245   6.951 3.81e-12 ***
## factor(id)27009 -0.0468491  0.2592239  -0.181 0.856584    
## factor(id)27072 -0.1659920  0.2577226  -0.644 0.519540    
## factor(id)27198 -0.6916939  0.2576410  -2.685 0.007269 ** 
## factor(id)27225  0.7787553  0.2717167   2.866 0.004163 ** 
## factor(id)27297  0.7257653  0.2677720   2.710 0.006730 ** 
## factor(id)27315 -0.5460366  0.2591973  -2.107 0.035168 *  
## factor(id)27612  0.7329366  0.2603126   2.816 0.004876 ** 
## factor(id)27621  0.4201855  0.2599936   1.616 0.106089    
## factor(id)27801  0.1025013  0.2575833   0.398 0.690685    
## factor(id)27846  1.2491419  0.2610075   4.786 1.72e-06 ***
## factor(id)27909  2.1702882  0.2659826   8.160 3.68e-16 ***
## factor(id)27945 -0.5412188  0.2576750  -2.100 0.035714 *  
## factor(id)27999  1.6182890  0.2605888   6.210 5.46e-10 ***
## factor(id)28026  2.0092397  0.2697164   7.449 9.98e-14 ***
## factor(id)28044  1.9566377  0.2641019   7.409 1.36e-13 ***
## factor(id)28062  2.5918165  0.2684409   9.655  < 2e-16 ***
## factor(id)28071  2.5211520  0.2701383   9.333  < 2e-16 ***
## factor(id)28116 -0.5539076  0.2575558  -2.151 0.031524 *  
## factor(id)28134  3.1451207  0.2694825  11.671  < 2e-16 ***
## factor(id)28143  2.2634645  0.2675876   8.459  < 2e-16 ***
## factor(id)28206  1.6676491  0.2624305   6.355 2.16e-10 ***
## factor(id)28215  1.4872533  0.2646364   5.620 1.95e-08 ***
## factor(id)28224 -0.4704206  0.2575803  -1.826 0.067828 .  
## factor(id)28332  0.2005441  0.2575670   0.779 0.436224    
## factor(id)28341 -0.4469531  0.2575464  -1.735 0.082689 .  
## factor(id)28377  1.4265112  0.2596294   5.494 4.00e-08 ***
## factor(id)28404  0.0016018  0.2576269   0.006 0.995039    
## factor(id)28449 -0.5412380  0.2575727  -2.101 0.035634 *  
## factor(id)28458 -0.6599781  0.2576644  -2.561 0.010437 *  
## factor(id)28467  0.2625801  0.2588660   1.014 0.310436    
## factor(id)28476  0.4746832  0.2580794   1.839 0.065896 .  
## factor(id)28575  1.4773194  0.2577762   5.731 1.02e-08 ***
## factor(id)28593  0.6089267  0.2578860   2.361 0.018230 *  
## factor(id)28629  1.5404160  0.2624332   5.870 4.47e-09 ***
## factor(id)28656  0.1791616  0.2575494   0.696 0.486667    
## factor(id)28665  1.3313363  0.2629109   5.064 4.17e-07 ***
## factor(id)28728  1.9132325  0.2655336   7.205 6.12e-13 ***
## factor(id)28737  1.2258375  0.2643994   4.636 3.58e-06 ***
## factor(id)28746  0.7794545  0.2584299   3.016 0.002565 ** 
## factor(id)28791  0.2243106  0.2579289   0.870 0.384502    
## factor(id)28836 -0.4936476  0.2575907  -1.916 0.055336 .  
## factor(id)28872  0.3317635  0.2576026   1.288 0.197808    
## factor(id)28881  0.8826463  0.2626987   3.360 0.000782 ***
## factor(id)28944  0.8123693  0.2576924   3.152 0.001623 ** 
## factor(id)28989  0.4641734  0.2584786   1.796 0.072552 .  
## factor(id)29061  0.3231899  0.2576084   1.255 0.209655    
## factor(id)29187  0.7636773  0.2580066   2.960 0.003083 ** 
## factor(id)29232  0.7297283  0.2595733   2.811 0.004942 ** 
## factor(id)29259  0.5191407  0.2616724   1.984 0.047285 *  
## factor(id)29268  1.3283316  0.2581147   5.146 2.70e-07 ***
## factor(id)29421  0.8927956  0.2582883   3.457 0.000549 ***
## factor(id)29439  0.3202260  0.2575752   1.243 0.213805    
## factor(id)29511  1.1109376  0.2601429   4.270 1.96e-05 ***
## factor(id)29529 -0.5315430  0.2575897  -2.064 0.039083 *  
## factor(id)29664  0.4769275  0.2582524   1.847 0.064807 .  
## factor(id)29709 -0.3090601  0.2578926  -1.198 0.230781    
## factor(id)29718  0.2063820  0.2580347   0.800 0.423828    
## factor(id)29727  1.6759249  0.2667150   6.284 3.42e-10 ***
## factor(id)29817  0.4709249  0.2576583   1.828 0.067616 .  
## factor(id)29835 -0.0650495  0.2577576  -0.252 0.800761    
## factor(id)29862  0.5614407  0.2608835   2.152 0.031410 *  
## factor(id)29889  2.5817558  0.2617362   9.864  < 2e-16 ***
## factor(id)29916 -0.5901006  0.2576977  -2.290 0.022044 *  
## factor(id)29943 -0.6484854  0.2579362  -2.514 0.011945 *  
## factor(id)29952 -0.4458935  0.2577190  -1.730 0.083627 .  
## factor(id)29997  0.0416733  0.2580081   0.162 0.871687    
## factor(id)30051  0.0059487  0.2575860   0.023 0.981576    
## factor(id)30132  1.5408335  0.2592898   5.943 2.88e-09 ***
## factor(id)30159  0.8734597  0.2580158   3.385 0.000713 ***
## factor(id)30177 -0.8918596  0.2582029  -3.454 0.000554 ***
## factor(id)30186  0.2607054  0.2588850   1.007 0.313939    
## factor(id)30339  0.4233276  0.2584991   1.638 0.101522    
## factor(id)30348 -0.0227951  0.2575609  -0.089 0.929478    
## factor(id)30384 -0.8237605  0.2578572  -3.195 0.001403 ** 
## factor(id)30393 -0.3747438  0.2578597  -1.453 0.146169    
## factor(id)30582 -0.6344657  0.2577273  -2.462 0.013838 *  
## factor(id)30636  0.1834845  0.2583264   0.710 0.477543    
## factor(id)30699 -0.4015458  0.2576187  -1.559 0.119097    
## factor(id)30708 -0.0713807  0.2583134  -0.276 0.782296    
## factor(id)30762 -0.0871317  0.2582308  -0.337 0.735808    
## factor(id)30789  0.3753050  0.2576731   1.457 0.145275    
## factor(id)30798  0.4102243  0.2583266   1.588 0.112310    
## factor(id)30825  0.6283399  0.2577476   2.438 0.014790 *  
## factor(id)30879 -0.3113837  0.2583111  -1.205 0.228048    
## factor(id)30933 -0.8303056  0.2576690  -3.222 0.001275 ** 
## factor(id)31122  1.7781796  0.2582362   6.886 6.01e-12 ***
## factor(id)31131  0.9541705  0.2590870   3.683 0.000232 ***
## factor(id)31266 -1.8923607  0.2575855  -7.347 2.16e-13 ***
## factor(id)31284  2.5498423  0.2707787   9.417  < 2e-16 ***
## factor(id)31635  0.2149141  0.2578547   0.833 0.404596    
## factor(id)31644 -0.3470226  0.2575746  -1.347 0.177917    
## factor(id)31662 -0.2964508  0.2575592  -1.151 0.249754    
## factor(id)31788  2.5252470  0.2716414   9.296  < 2e-16 ***
## factor(id)31842 -0.1666570  0.2575550  -0.647 0.517596    
## factor(id)31878 -0.7023561  0.2577118  -2.725 0.006432 ** 
## factor(id)31923  0.4444673  0.2690858   1.652 0.098607 .  
## factor(id)32004 -0.6397239  0.2580509  -2.479 0.013186 *  
## factor(id)32067  0.4976729  0.2749673   1.810 0.070330 .  
## factor(id)32292 -0.4573269  0.2581171  -1.772 0.076455 .  
## factor(id)32418  0.2654348  0.2577850   1.030 0.303182    
## factor(id)32517 -0.2820066  0.2581240  -1.093 0.274624    
## factor(id)32544  0.4127249  0.2575647   1.602 0.109089    
## factor(id)32607 -0.1630949  0.2575604  -0.633 0.526595    
## factor(id)32778  0.1296345  0.2576153   0.503 0.614826    
## factor(id)32859  0.1771754  0.2578209   0.687 0.491967    
## factor(id)32904 -0.4304572  0.2586981  -1.664 0.096150 .  
## factor(id)32994 -0.2962360  0.2588341  -1.145 0.252437    
## factor(id)33012 -0.2806735  0.2579771  -1.088 0.276625    
## factor(id)33048  0.5421540  0.2600592   2.085 0.037113 *  
## factor(id)33084  0.2559328  0.2589050   0.989 0.322917    
## factor(id)33111  0.4018255  0.2583072   1.556 0.119826    
## factor(id)33201  0.5328823  0.2575640   2.069 0.038573 *  
## factor(id)33381  1.0960613  0.2587109   4.237 2.29e-05 ***
## factor(id)33534  0.0414656  0.2579957   0.161 0.872315    
## factor(id)33597  2.6810222  0.2832871   9.464  < 2e-16 ***
## factor(id)33678 -0.5761736  0.2576591  -2.236 0.025357 *  
## factor(id)33741 -0.1038076  0.2597857  -0.400 0.689466    
## factor(id)33795 -0.9895610  0.2576552  -3.841 0.000123 ***
## factor(id)33894 -0.2095580  0.2578805  -0.813 0.416453    
## factor(id)33948 -0.9661796  0.2588700  -3.732 0.000191 ***
## factor(id)33957  1.3439495  0.2581546   5.206 1.96e-07 ***
## factor(id)34632  0.7027278  0.2620662   2.681 0.007339 ** 
## factor(id)34695 -0.4222696  0.2575897  -1.639 0.101173    
## factor(id)35046 -0.1658857  0.2577979  -0.643 0.519930    
## factor(id)35253 -0.2438013  0.2581890  -0.944 0.345047    
## factor(id)35505  0.1588982  0.2581929   0.615 0.538286    
## factor(id)35523  0.0430513  0.2578832   0.167 0.867419    
## factor(id)35559 -0.1145618  0.2576832  -0.445 0.656628    
## factor(id)35856  1.5662659  0.2620102   5.978 2.32e-09 ***
## factor(id)35937  0.8807083  0.2576644   3.418 0.000633 ***
## factor(id)35973  0.2057556  0.2582968   0.797 0.425706    
## factor(id)36027 -0.9351768  0.2578162  -3.627 0.000288 ***
## factor(id)36126  1.8606033  0.2629643   7.075 1.57e-12 ***
## factor(id)36135  1.3790538  0.2581225   5.343 9.32e-08 ***
## factor(id)36189  0.2641343  0.2576907   1.025 0.305380    
## factor(id)36198 -0.2134645  0.2580421  -0.827 0.408113    
## factor(id)36207  0.3135518  0.2583642   1.214 0.224922    
## factor(id)36324  0.2496007  0.2576438   0.969 0.332672    
## factor(id)36432 -0.1633060  0.2576348  -0.634 0.526180    
## factor(id)36441  1.1482190  0.2632048   4.362 1.30e-05 ***
## factor(id)36468  0.5641109  0.2576385   2.190 0.028575 *  
## factor(id)36477 -0.0016981  0.2578363  -0.007 0.994745    
## factor(id)36486 -0.4329324  0.2579656  -1.678 0.093322 .  
## factor(id)36522 -0.0072759  0.2575830  -0.028 0.977466    
## factor(id)36567  0.5100596  0.2589978   1.969 0.048934 *  
## factor(id)36711  0.2040656  0.2585846   0.789 0.430031    
## factor(id)36747  0.0954039  0.2577163   0.370 0.711247    
## factor(id)36837 -0.0695386  0.2597505  -0.268 0.788925    
## factor(id)36927  0.3750055  0.2578173   1.455 0.145822    
## factor(id)37341  0.2964093  0.2577952   1.150 0.250254    
## factor(id)37629  1.0289411  0.2594041   3.967 7.33e-05 ***
## factor(id)37656 -0.7055060  0.2582118  -2.732 0.006299 ** 
## factor(id)37845  0.2571064  0.2577538   0.997 0.318547    
## factor(id)38043  0.2563383  0.2582614   0.993 0.320947    
## factor(id)38088  0.3979051  0.2577014   1.544 0.122600    
## factor(id)38115  0.8039709  0.2596570   3.096 0.001964 ** 
## factor(id)38187  0.1930055  0.2582571   0.747 0.454873    
## factor(id)38277 -0.0546870  0.2585597  -0.212 0.832495    
## factor(id)38304  1.2951297  0.2657035   4.874 1.10e-06 ***
## factor(id)38439 -0.1989536  0.2594740  -0.767 0.443240    
## factor(id)38448  0.2782079  0.2587867   1.075 0.282374    
## factor(id)38466  0.6299786  0.2672680   2.357 0.018433 *  
## factor(id)38484  0.3586111  0.2644983   1.356 0.175182    
## factor(id)38547  2.1300184  0.2606790   8.171 3.35e-16 ***
## factor(id)38556  1.6263090  0.2610831   6.229 4.84e-10 ***
## factor(id)38583  0.4659502  0.2633894   1.769 0.076909 .  
## factor(id)38592  1.9084388  0.2654335   7.190 6.85e-13 ***
## factor(id)38601  1.2424929  0.2687652   4.623 3.82e-06 ***
## factor(id)38628  1.0429208  0.2648855   3.937 8.29e-05 ***
## factor(id)38745  0.6465533  0.2579754   2.506 0.012214 *  
## factor(id)39222 -1.6579590  0.2576252  -6.436 1.27e-10 ***
## factor(id)39294  1.9483874  0.2630508   7.407 1.37e-13 ***
## factor(id)39303  2.1802192  0.2707215   8.053 8.77e-16 ***
## factor(id)39357  0.4341530  0.2631526   1.650 0.099006 .  
## factor(id)39573 -0.2279550  0.2576005  -0.885 0.376218    
## factor(id)39582  0.0335288  0.2575538   0.130 0.896425    
## factor(id)39609  0.6098589  0.2587108   2.357 0.018424 *  
## factor(id)39618 -0.6612244  0.2577402  -2.565 0.010315 *  
## factor(id)39627 -0.7172612  0.2579279  -2.781 0.005430 ** 
## factor(id)39681  1.9251821  0.2595963   7.416 1.28e-13 ***
## factor(id)39708  0.5680328  0.2581580   2.200 0.027801 *  
## factor(id)39807  1.2730527  0.2626233   4.847 1.27e-06 ***
## factor(id)39834  0.2500230  0.2576905   0.970 0.331943    
## factor(id)39906  1.9917482  0.2632588   7.566 4.12e-14 ***
## factor(id)39933  1.2940456  0.2585196   5.006 5.64e-07 ***
## factor(id)39951  1.4607277  0.2625334   5.564 2.69e-08 ***
## factor(id)39969 -0.1773476  0.2580535  -0.687 0.491937    
## factor(id)40068 -0.0906916  0.2583809  -0.351 0.725595    
## factor(id)40104  1.0942493  0.2625898   4.167 3.10e-05 ***
## factor(id)40248  0.9734322  0.2708548   3.594 0.000327 ***
## factor(id)40347  1.5180515  0.2580761   5.882 4.15e-09 ***
## factor(id)40446 -0.9361104  0.2578221  -3.631 0.000284 ***
## factor(id)40536 -0.2008838  0.2575611  -0.780 0.435437    
## factor(id)40626  1.0485909  0.2575561   4.071 4.70e-05 ***
## factor(id)40689  1.2171728  0.2605566   4.671 3.02e-06 ***
## factor(id)40842  0.2149567  0.2580336   0.833 0.404828    
## factor(id)41013  0.3419218  0.2582432   1.324 0.185517    
## factor(id)41121 -0.7922503  0.2575774  -3.076 0.002104 ** 
## factor(id)41148 -1.0193241  0.2577663  -3.954 7.71e-05 ***
## factor(id)41229 -1.1166706  0.2585773  -4.319 1.58e-05 ***
## factor(id)41274  0.3131467  0.2665587   1.175 0.240106    
## factor(id)41301 -0.7166021  0.2593627  -2.763 0.005737 ** 
## factor(id)41364  0.0272471  0.2579795   0.106 0.915888    
## factor(id)41382 -0.2697777  0.2584869  -1.044 0.296653    
## factor(id)41409 -0.5882721  0.2577659  -2.282 0.022494 *  
## factor(id)41427 -0.0237696  0.2592868  -0.092 0.926959    
## factor(id)41481  1.2139169  0.2603973   4.662 3.17e-06 ***
## factor(id)41859 -0.6107318  0.2588449  -2.359 0.018317 *  
## factor(id)41958  0.0681757  0.2640161   0.258 0.796237    
## factor(id)42066 -1.0648970  0.2586503  -4.117 3.86e-05 ***
## factor(id)42093  0.3877455  0.2576417   1.505 0.132354    
## factor(id)42129 -0.0795879  0.2575628  -0.309 0.757324    
## factor(id)42237 -0.4545688  0.2578914  -1.763 0.077986 .  
## factor(id)42363 -0.5915867  0.2605758  -2.270 0.023206 *  
## factor(id)42489 -0.1827384  0.2602681  -0.702 0.482620    
## factor(id)42498  0.1932462  0.2575777   0.750 0.453121    
## factor(id)42561  1.6980546  0.2621413   6.478 9.66e-11 ***
## factor(id)42615  0.3062209  0.2575434   1.189 0.234459    
## factor(id)42651  0.5357561  0.2587937   2.070 0.038453 *  
## factor(id)42813  0.2929148  0.2582906   1.134 0.256794    
## factor(id)43038  0.6526018  0.2576602   2.533 0.011327 *  
## factor(id)43128  0.3715163  0.2576943   1.442 0.149413    
## factor(id)43173  0.4666799  0.2591224   1.801 0.071726 .  
## factor(id)43227  0.6418753  0.2592166   2.476 0.013291 *  
## factor(id)43245  0.3267092  0.2588808   1.262 0.206970    
## factor(id)43272 -0.6798580  0.2576873  -2.638 0.008342 ** 
## factor(id)43308  0.8237981  0.2618233   3.146 0.001657 ** 
## factor(id)43335  0.3911571  0.2596177   1.507 0.131921    
## factor(id)43569  0.5599565  0.2584278   2.167 0.030270 *  
## factor(id)43596 -0.1344595  0.2576573  -0.522 0.601781    
## factor(id)43614  1.4237315  0.2580123   5.518 3.49e-08 ***
## factor(id)43623  0.9822981  0.2578610   3.809 0.000140 ***
## factor(id)43767 -0.1517940  0.2579000  -0.589 0.556156    
## factor(id)43794  0.8958582  0.2582953   3.468 0.000525 ***
## factor(id)43839  0.2919563  0.2576957   1.133 0.257257    
## factor(id)43902 -0.1220036  0.2575744  -0.474 0.635748    
## factor(id)43956  0.4440723  0.2578297   1.722 0.085031 .  
## factor(id)44019  0.6028201  0.2596091   2.322 0.020247 *  
## factor(id)44046  1.0500628  0.2588546   4.057 5.01e-05 ***
## factor(id)44064  1.4989816  0.2580065   5.810 6.40e-09 ***
## factor(id)44082  0.6873976  0.2585077   2.659 0.007845 ** 
## factor(id)44199  1.0992962  0.2639994   4.164 3.15e-05 ***
## factor(id)44235 -0.0911969  0.2577914  -0.354 0.723523    
## factor(id)44244 -0.1510870  0.2583359  -0.585 0.558661    
## factor(id)44298 -0.4890652  0.2578378  -1.897 0.057878 .  
## factor(id)44361  0.5589544  0.2592177   2.156 0.031078 *  
## factor(id)44451  0.7130367  0.2585558   2.758 0.005828 ** 
## factor(id)44496  1.3298112  0.2612561   5.090 3.63e-07 ***
## factor(id)44577  0.7298886  0.2576141   2.833 0.004615 ** 
## factor(id)44676 -0.0388315  0.2576792  -0.151 0.880217    
## factor(id)44694  1.2601854  0.2593776   4.858 1.20e-06 ***
## factor(id)44739  1.1649773  0.2672565   4.359 1.32e-05 ***
## factor(id)44757  2.6999139  0.2808376   9.614  < 2e-16 ***
## factor(id)44847  0.8466735  0.2589679   3.269 0.001081 ** 
## factor(id)44901  0.3827152  0.2578443   1.484 0.137757    
## factor(id)44928  0.2941480  0.2578680   1.141 0.254020    
## factor(id)44973  1.0289159  0.2608696   3.944 8.05e-05 ***
## factor(id)44982  0.8389606  0.2590597   3.238 0.001205 ** 
## factor(id)44991  0.3709185  0.2577956   1.439 0.150230    
## factor(id)45018  0.6906561  0.2599141   2.657 0.007888 ** 
## factor(id)45027  1.9295303  0.2589332   7.452 9.80e-14 ***
## factor(id)45081  0.5431840  0.2577178   2.108 0.035079 *  
## factor(id)45108  0.5238727  0.2587315   2.025 0.042912 *  
## factor(id)45117  1.4408952  0.2621291   5.497 3.94e-08 ***
## factor(id)45198  0.1015913  0.2577761   0.394 0.693509    
## factor(id)45207  1.1620503  0.2612657   4.448 8.75e-06 ***
## factor(id)45243  0.4447209  0.2576005   1.726 0.084300 .  
## factor(id)45261  0.3298353  0.2587020   1.275 0.202346    
## factor(id)45306 -0.7938283  0.2577182  -3.080 0.002073 ** 
## factor(id)45387  1.3058383  0.2609569   5.004 5.69e-07 ***
## factor(id)45405  0.4548116  0.2576662   1.765 0.077568 .  
## factor(id)45531  1.8367968  0.2649822   6.932 4.36e-12 ***
## factor(id)45621  0.6216151  0.2575790   2.413 0.015823 *  
## factor(id)45684  0.3396790  0.2586211   1.313 0.189064    
## factor(id)45873  0.6665925  0.2577080   2.587 0.009703 ** 
## factor(id)45882  0.7604205  0.2575702   2.952 0.003160 ** 
## factor(id)45945 -0.6562820  0.2575575  -2.548 0.010843 *  
## factor(id)45999  0.7856270  0.2612546   3.007 0.002642 ** 
## factor(id)46008  0.2038527  0.2575473   0.792 0.428658    
## factor(id)46026  0.7088752  0.2577588   2.750 0.005965 ** 
## factor(id)46188  0.4119220  0.2575683   1.599 0.109785    
## factor(id)46197  2.1067842  0.2607097   8.081 7.01e-16 ***
## factor(id)46296 -0.6495426  0.2578523  -2.519 0.011779 *  
## factor(id)46395 -0.2866755  0.2575851  -1.113 0.265757    
## factor(id)46449  1.7453817  0.2616903   6.670 2.67e-11 ***
## factor(id)46602 -0.3377654  0.2577872  -1.310 0.190135    
## factor(id)46647  0.2070255  0.2601671   0.796 0.426198    
## factor(id)46656  1.0914943  0.2626194   4.156 3.26e-05 ***
## factor(id)46674  0.6486854  0.2596611   2.498 0.012495 *  
## factor(id)46683  0.1508778  0.2578318   0.585 0.558438    
## factor(id)46755 -0.0774091  0.2577780  -0.300 0.763958    
## factor(id)46773  1.2038290  0.2607012   4.618 3.92e-06 ***
## factor(id)46908 -0.3685291  0.2575451  -1.431 0.152475    
## factor(id)46953  0.4138859  0.2576138   1.607 0.108164    
## factor(id)46962  1.1191462  0.2630053   4.255 2.10e-05 ***
## factor(id)46989 -0.1417755  0.2575876  -0.550 0.582057    
## factor(id)47016  0.3332683  0.2577597   1.293 0.196055    
## factor(id)47025 -0.0213471  0.2575651  -0.083 0.933948    
## factor(id)47106  0.9628876  0.2620048   3.675 0.000239 ***
## factor(id)47151 -0.2118129  0.2580354  -0.821 0.411737    
## factor(id)47223  1.2670486  0.2581089   4.909 9.27e-07 ***
## factor(id)47277  0.2758137  0.2576789   1.070 0.284470    
## factor(id)47322  1.4419772  0.2706856   5.327 1.01e-07 ***
## factor(id)47349  0.2894857  0.2576621   1.124 0.261243    
## factor(id)47358  1.5209954  0.2596895   5.857 4.83e-09 ***
## factor(id)47367  0.3851369  0.2602769   1.480 0.138973    
## factor(id)47394  1.3194532  0.2579533   5.115 3.18e-07 ***
## factor(id)47412  1.1166647  0.2576365   4.334 1.47e-05 ***
## factor(id)47421  1.3886607  0.2578616   5.385 7.36e-08 ***
## factor(id)47484  0.2264450  0.2576127   0.879 0.379411    
## factor(id)47601 -0.0651349  0.2590284  -0.251 0.801464    
## factor(id)47619  1.3603498  0.2580740   5.271 1.38e-07 ***
## factor(id)47655  1.5488997  0.2580322   6.003 1.99e-09 ***
## factor(id)47754  0.7709253  0.2580667   2.987 0.002820 ** 
## factor(id)47799  0.9028116  0.2605236   3.465 0.000531 ***
## factor(id)47826 -0.3145588  0.2577473  -1.220 0.222330    
## factor(id)47835  0.3399961  0.2576091   1.320 0.186921    
## factor(id)47907  0.5651599  0.2577578   2.193 0.028354 *  
## factor(id)48033  1.0164384  0.2613534   3.889 0.000101 ***
## factor(id)48042  0.1487539  0.2579426   0.577 0.564157    
## factor(id)48069  1.7851134  0.2590530   6.891 5.81e-12 ***
## factor(id)48096  0.2837080  0.2577584   1.101 0.271059    
## factor(id)48159  0.2214074  0.2577774   0.859 0.390407    
## factor(id)48195  0.0325562  0.2579053   0.126 0.899549    
## factor(id)48204  1.6191279  0.2642610   6.127 9.22e-10 ***
## factor(id)48231  0.0182492  0.2581722   0.071 0.943649    
## factor(id)48249  0.9281242  0.2597111   3.574 0.000353 ***
## factor(id)48267 -0.4286691  0.2576895  -1.664 0.096235 .  
## factor(id)48366  0.7433726  0.2579304   2.882 0.003957 ** 
## factor(id)48411  0.6974791  0.2622747   2.659 0.007839 ** 
## factor(id)48456  0.9762785  0.2580529   3.783 0.000156 ***
## factor(id)48474  1.1139837  0.2589430   4.302 1.70e-05 ***
## factor(id)48519 -0.0592985  0.2584893  -0.229 0.818559    
## factor(id)48528  1.5750387  0.2654640   5.933 3.05e-09 ***
## factor(id)48537  1.6765716  0.2688788   6.235 4.65e-10 ***
## factor(id)48555  1.4843224  0.2686771   5.525 3.37e-08 ***
## factor(id)48609  0.7473812  0.2581208   2.895 0.003792 ** 
## factor(id)48636  0.6548499  0.2582043   2.536 0.011219 *  
## factor(id)48663  1.0739048  0.2581450   4.160 3.20e-05 ***
## factor(id)48672  1.3878931  0.2577893   5.384 7.42e-08 ***
## factor(id)48699  1.3317969  0.2579755   5.162 2.47e-07 ***
## factor(id)48726  0.6994084  0.2583475   2.707 0.006794 ** 
## factor(id)48753  0.1290697  0.2576434   0.501 0.616406    
## factor(id)48771 -0.1232146  0.2575554  -0.478 0.632374    
## factor(id)48825 -0.5014003  0.2575938  -1.946 0.051620 .  
## factor(id)48888  0.9469702  0.2592193   3.653 0.000260 ***
## factor(id)48897  1.6481448  0.2627627   6.272 3.67e-10 ***
## factor(id)48951  0.2506050  0.2577407   0.972 0.330913    
## factor(id)48987 -0.1062426  0.2577428  -0.412 0.680197    
## factor(id)49005  1.1737455  0.2600260   4.514 6.42e-06 ***
## factor(id)49059  0.3442321  0.2576070   1.336 0.181486    
## factor(id)49095  1.4300340  0.2594568   5.512 3.62e-08 ***
## factor(id)49113  0.7183900  0.2627293   2.734 0.006259 ** 
## factor(id)49131  0.0228059  0.2576999   0.088 0.929482    
## factor(id)49284  0.9085285  0.2603938   3.489 0.000486 ***
## factor(id)49329  0.3282642  0.2576388   1.274 0.202642    
## factor(id)49347 -0.2101953  0.2578006  -0.815 0.414893    
## factor(id)49446  0.9869576  0.2586732   3.815 0.000137 ***
## factor(id)49464  1.3139329  0.2599636   5.054 4.38e-07 ***
## factor(id)49491  0.5949711  0.2597460   2.291 0.022004 *  
## factor(id)49563 -0.1235283  0.2575867  -0.480 0.631549    
## factor(id)49617  1.2554964  0.2640218   4.755 2.00e-06 ***
## factor(id)49734  1.6956569  0.2586451   6.556 5.74e-11 ***
## factor(id)49743  0.9041953  0.2587366   3.495 0.000476 ***
## factor(id)49779  0.3333052  0.2579538   1.292 0.196342    
## factor(id)49815 -0.0231028  0.2577426  -0.090 0.928579    
## factor(id)49869  1.7818409  0.2635864   6.760 1.44e-11 ***
## factor(id)49896  0.0472743  0.2575983   0.184 0.854393    
## factor(id)49995  0.3839653  0.2576626   1.490 0.136200    
## factor(id)50004  0.8815090  0.2583732   3.412 0.000647 ***
## factor(id)50031  0.2564302  0.2580263   0.994 0.320332    
## factor(id)50085  0.7652641  0.2580956   2.965 0.003032 ** 
## factor(id)50139  1.9115026  0.2624936   7.282 3.48e-13 ***
## factor(id)50166 -0.1109137  0.2578838  -0.430 0.667136    
## factor(id)50229  0.4061844  0.2577493   1.576 0.115076    
## factor(id)50247  1.8721810  0.2650288   7.064 1.70e-12 ***
## factor(id)50283  1.6263149  0.2633872   6.175 6.84e-10 ***
## factor(id)50292  0.5094102  0.2579106   1.975 0.048274 *  
## factor(id)50418  1.0518030  0.2576899   4.082 4.50e-05 ***
## factor(id)50427  0.2302577  0.2704003   0.852 0.394483    
## factor(id)50436 -0.4864255  0.2575801  -1.888 0.058989 .  
## factor(id)50454  0.2657764  0.2584223   1.028 0.303754    
## factor(id)50463 -0.8453108  0.2576006  -3.281 0.001035 ** 
## factor(id)50553  0.1246959  0.2575738   0.484 0.628311    
## factor(id)50562 -0.2910757  0.2576305  -1.130 0.258574    
## factor(id)50571  1.9394489  0.2582168   7.511 6.26e-14 ***
## factor(id)50643  0.3142847  0.2584731   1.216 0.224035    
## factor(id)50661  0.0020839  0.2575888   0.008 0.993545    
## factor(id)50715  1.3899920  0.2575985   5.396 6.94e-08 ***
## factor(id)50814 -0.1325958  0.2577130  -0.515 0.606905    
## factor(id)50922  0.7413013  0.2577727   2.876 0.004037 ** 
## factor(id)50949  1.2856029  0.2670714   4.814 1.50e-06 ***
## factor(id)50958  0.7008177  0.2577304   2.719 0.006553 ** 
## factor(id)50967  1.0810703  0.2576107   4.197 2.73e-05 ***
## factor(id)51021  0.3203620  0.2575866   1.244 0.213631    
## factor(id)51066  0.5982264  0.2592376   2.308 0.021035 *  
## factor(id)51093  1.7799059  0.2583783   6.889 5.89e-12 ***
## factor(id)51237 -0.0830490  0.2597329  -0.320 0.749165    
## factor(id)51417 -0.3965914  0.2586675  -1.533 0.125249    
## factor(id)51453 -0.1653593  0.2598923  -0.636 0.524618    
## factor(id)51498  0.6371319  0.2576351   2.473 0.013411 *  
## factor(id)51525  0.9117802  0.2613068   3.489 0.000486 ***
## factor(id)51597 -0.2497217  0.2609974  -0.957 0.338688    
## factor(id)51633  1.9669199  0.2613369   7.526 5.57e-14 ***
## factor(id)51642  0.6701228  0.2585910   2.591 0.009568 ** 
## factor(id)51705 -0.3574579  0.2584457  -1.383 0.166657    
## factor(id)51876  0.8332799  0.2578950   3.231 0.001236 ** 
## factor(id)51903  1.2906948  0.2623500   4.920 8.77e-07 ***
## factor(id)52002  0.3325256  0.2581698   1.288 0.197766    
## factor(id)52038  0.0703511  0.2576291   0.273 0.784803    
## factor(id)52083 -0.0228992  0.2584957  -0.089 0.929412    
## factor(id)52128  0.3294139  0.2610012   1.262 0.206930    
## factor(id)52164 -0.1136642  0.2575913  -0.441 0.659034    
## factor(id)52326  1.3420077  0.2603668   5.154 2.58e-07 ***
## factor(id)52335  0.3461270  0.2575490   1.344 0.178996    
## factor(id)52344  0.5896506  0.2585887   2.280 0.022609 *  
## factor(id)52398  0.1432531  0.2576070   0.556 0.578158    
## factor(id)52416 -0.4731461  0.2575620  -1.837 0.066231 .  
## factor(id)52479  1.2834573  0.2601690   4.933 8.19e-07 ***
## factor(id)52533  0.7262560  0.2580413   2.814 0.004893 ** 
## factor(id)52551 -0.0203730  0.2608341  -0.078 0.937744    
## factor(id)52587  0.1720671  0.2576037   0.668 0.504176    
## factor(id)52605  0.5363580  0.2584473   2.075 0.037978 *  
## factor(id)52722  1.4716367  0.2604995   5.649 1.65e-08 ***
## factor(id)52785 -0.4498791  0.2577802  -1.745 0.080974 .  
## factor(id)52812 -0.8118205  0.2584322  -3.141 0.001686 ** 
## factor(id)52857  0.3109346  0.2601737   1.195 0.232069    
## factor(id)52875  0.5426390  0.2576405   2.106 0.035208 *  
## factor(id)53037  0.1912574  0.2582428   0.741 0.458943    
## factor(id)53046  0.7802532  0.2576488   3.028 0.002464 ** 
## factor(id)53163  0.6402550  0.2591083   2.471 0.013487 *  
## factor(id)53226  1.0612970  0.2577449   4.118 3.85e-05 ***
## factor(id)53334  0.7896227  0.2593228   3.045 0.002332 ** 
## factor(id)53406  0.1931646  0.2575507   0.750 0.453265    
## factor(id)53415 -0.1737913  0.2576739  -0.674 0.500030    
## factor(id)53541  0.1571874  0.2578462   0.610 0.542126    
## factor(id)53739  0.0797448  0.2576903   0.309 0.756977    
## factor(id)53793  0.3217116  0.2581922   1.246 0.212782    
## factor(id)53874 -0.0811309  0.2607648  -0.311 0.755709    
## factor(id)53946  0.5567612  0.2585538   2.153 0.031309 *  
## factor(id)53982  0.4817149  0.2576133   1.870 0.061519 .  
## factor(id)54045  0.3995218  0.2606359   1.533 0.125332    
## factor(id)54054  1.4635977  0.2604759   5.619 1.96e-08 ***
## factor(id)54162  0.3483628  0.2575537   1.353 0.176213    
## factor(id)54189  0.2843326  0.2578560   1.103 0.270187    
## factor(id)54198 -0.5641753  0.2576408  -2.190 0.028559 *  
## factor(id)54207 -0.5114961  0.2575860  -1.986 0.047085 *  
## factor(id)54288  0.8899512  0.2587906   3.439 0.000586 ***
## factor(id)54297 -0.2148221  0.2575859  -0.834 0.404307    
## factor(id)54342 -0.1863984  0.2585895  -0.721 0.471029    
## factor(id)54387  0.1311303  0.2575868   0.509 0.610710    
## factor(id)54405  0.5750355  0.2719829   2.114 0.034515 *  
## factor(id)54567 -0.0609960  0.2576866  -0.237 0.812889    
## factor(id)54576 -0.0460290  0.2584360  -0.178 0.858643    
## factor(id)54621  0.0144580  0.2578756   0.056 0.955290    
## factor(id)54639  0.5812648  0.2575834   2.257 0.024050 *  
## factor(id)54675  1.2476470  0.2638924   4.728 2.29e-06 ***
## factor(id)54684  0.9808631  0.2584761   3.795 0.000148 ***
## factor(id)54711  1.2302075  0.2584967   4.759 1.97e-06 ***
## factor(id)54729  0.3624484  0.2585775   1.402 0.161029    
## factor(id)54765  0.1034718  0.2582056   0.401 0.688623    
## factor(id)54855  0.0081334  0.2578850   0.032 0.974840    
## factor(id)54864  0.7080810  0.2629300   2.693 0.007090 ** 
## factor(id)54882 -0.0308444  0.2575941  -0.120 0.904691    
## factor(id)54927 -0.1789058  0.2579537  -0.694 0.487972    
## factor(id)54954  0.3849302  0.2577309   1.494 0.135322    
## factor(id)54963  0.1296438  0.2578541   0.503 0.615128    
## factor(id)55008  0.0975534  0.2586631   0.377 0.706072    
## factor(id)55188 -0.4903823  0.2575569  -1.904 0.056936 .  
## factor(id)55278  1.2259805  0.2589695   4.734 2.22e-06 ***
## factor(id)55287  1.4776548  0.2633449   5.611 2.05e-08 ***
## factor(id)55296  2.7545264  0.2580846  10.673  < 2e-16 ***
## factor(id)55305  1.1271213  0.2589379   4.353 1.35e-05 ***
## factor(id)55323 -0.7347486  0.2575928  -2.852 0.004347 ** 
## factor(id)55359 -0.2585793  0.2575458  -1.004 0.315392    
## factor(id)55422  1.4740723  0.2635142   5.594 2.27e-08 ***
## factor(id)55449  0.1871154  0.2613177   0.716 0.473976    
## factor(id)55467  1.5290640  0.2687929   5.689 1.31e-08 ***
## factor(id)55494  0.8564594  0.2577981   3.322 0.000896 ***
## factor(id)55521  1.7066938  0.2722291   6.269 3.74e-10 ***
## factor(id)55593 -0.4502121  0.2576561  -1.747 0.080603 .  
## factor(id)55611  0.0759942  0.2576632   0.295 0.768047    
## factor(id)55629  1.3248181  0.2580722   5.134 2.89e-07 ***
## factor(id)55638  0.7245642  0.2581265   2.807 0.005008 ** 
## factor(id)55674 -0.0425355  0.2582137  -0.165 0.869159    
## factor(id)55683  0.0518852  0.2577804   0.201 0.840485    
## factor(id)55809  0.0100350  0.2576264   0.039 0.968930    
## factor(id)55818 -0.2016939  0.2576142  -0.783 0.433683    
## factor(id)55836  0.0503998  0.2580886   0.195 0.845176    
## factor(id)56025  0.0749433  0.2578892   0.291 0.771360    
## factor(id)56043  1.2949042  0.2597990   4.984 6.30e-07 ***
## factor(id)56088  1.0636713  0.2625543   4.051 5.12e-05 ***
## factor(id)56115  1.6843965  0.2587473   6.510 7.81e-11 ***
## factor(id)56178 -0.8522585  0.2578455  -3.305 0.000951 ***
## factor(id)56187  2.2918894  0.2741226   8.361  < 2e-16 ***
## factor(id)56277  0.3292976  0.2586956   1.273 0.203071    
## factor(id)56295  0.0318428  0.2577432   0.124 0.901678    
## factor(id)56304  0.9191512  0.2596283   3.540 0.000401 ***
## factor(id)56403  0.0037869  0.2580926   0.015 0.988294    
## factor(id)56439  0.0555902  0.2576535   0.216 0.829182    
## factor(id)56457  0.6522839  0.2581960   2.526 0.011539 *  
## factor(id)56556  0.6569414  0.2585851   2.541 0.011080 *  
## factor(id)56574  0.0224612  0.2580307   0.087 0.930634    
## factor(id)56628  0.7169975  0.2575608   2.784 0.005381 ** 
## factor(id)56637 -0.5694925  0.2576667  -2.210 0.027110 *  
## factor(id)56664  0.1477899  0.2577530   0.573 0.566399    
## factor(id)56745  0.9627626  0.2575960   3.737 0.000187 ***
## factor(id)56754  0.5841828  0.2576124   2.268 0.023365 *  
## factor(id)56763  0.8700135  0.2607056   3.337 0.000849 ***
## factor(id)56844  1.0175911  0.2650650   3.839 0.000124 ***
## factor(id)57024  0.0402578  0.2576851   0.156 0.875855    
## factor(id)57186 -0.6160683  0.2577385  -2.390 0.016850 *  
## factor(id)57339  0.8974573  0.2577412   3.482 0.000499 ***
## factor(id)57375 -0.3199774  0.2580268  -1.240 0.214964    
## factor(id)57411 -0.1793725  0.2576064  -0.696 0.486251    
## factor(id)57474  0.2657309  0.2581640   1.029 0.303353    
## factor(id)57681  0.5188816  0.2592682   2.001 0.045378 *  
## factor(id)57771  0.4972527  0.2589598   1.920 0.054856 .  
## factor(id)57816  0.1299351  0.2580128   0.504 0.614552    
## factor(id)57843  1.0020048  0.2576933   3.888 0.000101 ***
## factor(id)57879  1.2076626  0.2583248   4.675 2.97e-06 ***
## factor(id)57996 -0.3015859  0.2576319  -1.171 0.241778    
## factor(id)58023  0.6944008  0.2577534   2.694 0.007068 ** 
## factor(id)58032  0.4288747  0.2579624   1.663 0.096428 .  
## factor(id)58059  1.8302663  0.2644237   6.922 4.68e-12 ***
## factor(id)58077  1.0126651  0.2579426   3.926 8.69e-05 ***
## factor(id)58104  0.8177685  0.2594491   3.152 0.001626 ** 
## factor(id)58113  1.4025473  0.2607903   5.378 7.66e-08 ***
## factor(id)58122  2.2296508  0.2685636   8.302  < 2e-16 ***
## factor(id)58149  0.7735197  0.2594624   2.981 0.002876 ** 
## factor(id)58176 -0.8917128  0.2595928  -3.435 0.000594 ***
## factor(id)58194  0.0950607  0.2581404   0.368 0.712692    
## factor(id)58203  0.5084590  0.2579694   1.971 0.048745 *  
## factor(id)58284  0.7616270  0.2594502   2.936 0.003336 ** 
## factor(id)58293  1.2464433  0.2582808   4.826 1.41e-06 ***
## factor(id)58329  1.4707749  0.2581779   5.697 1.25e-08 ***
## factor(id)58509 -0.4280072  0.2576845  -1.661 0.096743 .  
## factor(id)58626  0.5155436  0.2578329   2.000 0.045573 *  
## factor(id)58653  0.2559075  0.2578544   0.992 0.320997    
## factor(id)58671  0.5181827  0.2580724   2.008 0.044675 *  
## factor(id)58698  0.5621662  0.2586287   2.174 0.029750 *  
## factor(id)58752 -0.0406154  0.2577900  -0.158 0.874812    
## factor(id)58779  0.4056761  0.2576071   1.575 0.115331    
## factor(id)58815  0.7903816  0.2581170   3.062 0.002202 ** 
## factor(id)58869  0.2842343  0.2576388   1.103 0.269949    
## factor(id)58878  0.1801368  0.2591961   0.695 0.487079    
## factor(id)58905  0.3821566  0.2588056   1.477 0.139803    
## factor(id)58914  0.7487427  0.2581696   2.900 0.003736 ** 
## factor(id)59103 -0.5076419  0.2576665  -1.970 0.048843 *  
## factor(id)59265  0.2135263  0.2580645   0.827 0.408018    
## factor(id)59427  1.0460343  0.2588790   4.041 5.36e-05 ***
## factor(id)59445  0.6861899  0.2587939   2.651 0.008024 ** 
## factor(id)59499  0.1482198  0.2579820   0.575 0.565616    
## factor(id)59508  0.4115796  0.2575447   1.598 0.110048    
## factor(id)59526 -0.0984565  0.2576844  -0.382 0.702407    
## factor(id)59724  0.0574338  0.2577246   0.223 0.823656    
## factor(id)59841  0.3211712  0.2576534   1.247 0.212595    
## factor(id)59868  0.2122857  0.2600942   0.816 0.414408    
## factor(id)59949  0.8660499  0.2583343   3.352 0.000803 ***
## factor(id)59994  1.2650013  0.2587001   4.890 1.02e-06 ***
## factor(id)60012  0.1647501  0.2585794   0.637 0.524048    
## factor(id)60147 -0.1125182  0.2586869  -0.435 0.663600    
## factor(id)60156  0.7666446  0.2583143   2.968 0.003004 ** 
## factor(id)60228  0.2771966  0.2586948   1.072 0.283956    
## factor(id)60282  0.0367031  0.2590524   0.142 0.887333    
## factor(id)60318  0.1890389  0.2579902   0.733 0.463733    
## factor(id)60327  1.1062985  0.2590075   4.271 1.96e-05 ***
## factor(id)60381 -0.6248249  0.2612914  -2.391 0.016804 *  
## factor(id)60399  1.9219676  0.2634368   7.296 3.15e-13 ***
## factor(id)60543  0.4603017  0.2582941   1.782 0.074760 .  
## factor(id)60588  0.9341909  0.2594542   3.601 0.000319 ***
## factor(id)60678  0.2760245  0.2576321   1.071 0.284015    
## factor(id)60696 -0.0292643  0.2578362  -0.113 0.909636    
## factor(id)60714  0.4172065  0.2602420   1.603 0.108927    
## factor(id)60732 -0.4323077  0.2577281  -1.677 0.093493 .  
## factor(id)60786  2.1216933  0.2664250   7.964 1.81e-15 ***
## factor(id)60813  0.7329708  0.2591430   2.828 0.004685 ** 
## factor(id)60822  0.2634646  0.2575582   1.023 0.306359    
## factor(id)60831  0.1182919  0.2575554   0.459 0.646036    
## factor(id)60867  0.6060324  0.2581124   2.348 0.018893 *  
## factor(id)60876 -0.5686112  0.2576190  -2.207 0.027319 *  
## factor(id)60885  0.5910536  0.2576498   2.294 0.021806 *  
## factor(id)60939 -0.0720589  0.2576427  -0.280 0.779724    
## factor(id)61029  0.9087977  0.2583221   3.518 0.000436 ***
## factor(id)61092  1.9615098  0.2610285   7.515 6.09e-14 ***
## factor(id)61119  0.7799092  0.2642926   2.951 0.003174 ** 
## factor(id)61236  0.7310358  0.2576402   2.837 0.004555 ** 
## factor(id)61317  0.2918176  0.2580236   1.131 0.258088    
## factor(id)61344  0.4614889  0.2577510   1.790 0.073406 .  
## factor(id)61398  1.4429929  0.2685839   5.373 7.90e-08 ***
## factor(id)61407  1.0535134  0.2594322   4.061 4.92e-05 ***
## factor(id)61416  0.9852598  0.2576378   3.824 0.000132 ***
## factor(id)61443  1.0642754  0.2666806   3.991 6.62e-05 ***
## factor(id)61533  0.0961527  0.2577987   0.373 0.709172    
## factor(id)61578  0.6839875  0.2576478   2.655 0.007947 ** 
## factor(id)61767  1.4111469  0.2586218   5.456 4.95e-08 ***
## factor(id)61776 -0.5557139  0.2581440  -2.153 0.031359 *  
## factor(id)61938  0.4136100  0.2577655   1.605 0.108607    
## factor(id)61983  0.5207184  0.2577192   2.020 0.043354 *  
## factor(id)61992  0.3320914  0.2579124   1.288 0.197904    
## factor(id)62001  0.5418675  0.2576899   2.103 0.035504 *  
## factor(id)62046  0.1802156  0.2575723   0.700 0.484146    
## factor(id)62064  0.2868645  0.2589490   1.108 0.267968    
## factor(id)62118  0.3226992  0.2575843   1.253 0.210305    
## factor(id)62145  0.3608204  0.2575681   1.401 0.161276    
## factor(id)62505  0.5122989  0.2581489   1.985 0.047221 *  
## factor(id)62532  0.2914204  0.2584830   1.127 0.259584    
## factor(id)62604 -0.7162816  0.2576889  -2.780 0.005450 ** 
## factor(id)62649  0.0929138  0.2646303   0.351 0.725513    
## factor(id)62676 -0.1368024  0.2577056  -0.531 0.595534    
## factor(id)62694 -0.7863364  0.2576511  -3.052 0.002278 ** 
## factor(id)62721 -0.1669386  0.2575924  -0.648 0.516950    
## factor(id)62793  0.5115917  0.2576790   1.985 0.047123 *  
## factor(id)62811  0.9841311  0.2582675   3.811 0.000139 ***
## factor(id)62856  0.4457924  0.2579877   1.728 0.084020 .  
## factor(id)62865  0.4513242  0.2654733   1.700 0.089142 .  
## factor(id)62991 -0.4773337  0.2582516  -1.848 0.064578 .  
## factor(id)63018  0.8741637  0.2576063   3.393 0.000692 ***
## factor(id)63036  0.1778848  0.2576340   0.690 0.489920    
## factor(id)63063  1.6061721  0.2639975   6.084 1.21e-09 ***
## factor(id)63072 -0.9897911  0.2577576  -3.840 0.000124 ***
## factor(id)63099  1.7137076  0.2617293   6.548 6.07e-11 ***
## factor(id)63252  0.7033612  0.2592918   2.713 0.006684 ** 
## factor(id)63261  1.2866885  0.2583155   4.981 6.41e-07 ***
## factor(id)63279  1.2508182  0.2575808   4.856 1.21e-06 ***
## factor(id)63306  0.0405906  0.2576351   0.158 0.874813    
## factor(id)63315  0.8185638  0.2577956   3.175 0.001501 ** 
## factor(id)63333  0.5054769  0.2582687   1.957 0.050349 .  
## factor(id)63423  1.5980736  0.2656628   6.015 1.84e-09 ***
## factor(id)63432 -0.0952997  0.2577814  -0.370 0.711618    
## factor(id)63567  0.6600910  0.2579499   2.559 0.010509 *  
## factor(id)63639  0.8987561  0.2593914   3.465 0.000532 ***
## factor(id)63675 -0.4844862  0.2575931  -1.881 0.060019 .  
## factor(id)63765  1.1793070  0.2613205   4.513 6.45e-06 ***
## factor(id)63783  1.0525768  0.2586341   4.070 4.73e-05 ***
## factor(id)63855  0.4242231  0.2576753   1.646 0.099717 .  
## factor(id)63882 -0.1680496  0.2576525  -0.652 0.514262    
## factor(id)63918 -0.1481490  0.2578715  -0.575 0.565635    
## factor(id)63963  1.4050481  0.2623849   5.355 8.71e-08 ***
## factor(id)63999  0.1453662  0.2580048   0.563 0.573156    
## factor(id)64008  0.3863937  0.2586573   1.494 0.135241    
## factor(id)64017  0.3827997  0.2576391   1.486 0.137357    
## factor(id)64044 -0.0108847  0.2580542  -0.042 0.966356    
## factor(id)64062  0.7986369  0.2584436   3.090 0.002005 ** 
## factor(id)64107  0.7057800  0.2587336   2.728 0.006384 ** 
## factor(id)64116  0.2108915  0.2585432   0.816 0.414692    
## factor(id)64134  0.5162699  0.2582702   1.999 0.045635 *  
## factor(id)64143  1.2726300  0.2585101   4.923 8.63e-07 ***
## factor(id)64152  0.2339132  0.2591780   0.903 0.366798    
## factor(id)64233  1.9809458  0.2600571   7.617 2.77e-14 ***
## factor(id)64341  0.7789707  0.2588822   3.009 0.002626 ** 
## factor(id)64359 -0.1391446  0.2576791  -0.540 0.589212    
## factor(id)64386  0.0614693  0.2576684   0.239 0.811451    
## factor(id)64395 -0.0089400  0.2577034  -0.035 0.972327    
## factor(id)64449  0.3982188  0.2577564   1.545 0.122385    
## factor(id)64512 -0.1901539  0.2575696  -0.738 0.460369    
## factor(id)64557 -0.1948425  0.2580165  -0.755 0.450170    
## factor(id)64602 -0.4861067  0.2576530  -1.887 0.059227 .  
## factor(id)64647  1.2695554  0.2608633   4.867 1.15e-06 ***
## factor(id)64728 -0.3502249  0.2575710  -1.360 0.173942    
## factor(id)64764  0.4092441  0.2585928   1.583 0.113542    
## factor(id)64782 -0.5846754  0.2580375  -2.266 0.023477 *  
## factor(id)64827 -0.8437903  0.2577080  -3.274 0.001062 ** 
## factor(id)64881 -0.4341276  0.2580579  -1.682 0.092538 .  
## factor(id)64917  1.2778601  0.2601798   4.911 9.15e-07 ***
## factor(id)64944 -0.2308403  0.2577998  -0.895 0.370577    
## factor(id)64962  0.7099649  0.2580584   2.751 0.005947 ** 
## factor(id)64989  0.2367110  0.2591546   0.913 0.361051    
## factor(id)65079  0.1058510  0.2576691   0.411 0.681225    
## factor(id)65097  1.1004644  0.2598082   4.236 2.29e-05 ***
## factor(id)65106  0.1414766  0.2600465   0.544 0.586421    
## factor(id)65151 -0.5108273  0.2576605  -1.983 0.047438 *  
## factor(id)65196  0.5460161  0.2575655   2.120 0.034033 *  
## factor(id)65223 -0.0042201  0.2605078  -0.016 0.987076    
## factor(id)65322 -0.4761846  0.2575478  -1.849 0.064493 .  
## factor(id)65538 -0.0501632  0.2575674  -0.195 0.845586    
## factor(id)65565  0.0559400  0.2575917   0.217 0.828083    
## factor(id)65655  0.3355990  0.2593057   1.294 0.195613    
## factor(id)65691  0.3756103  0.2598173   1.446 0.148294    
## factor(id)65709  1.0492371  0.2577664   4.070 4.72e-05 ***
## factor(id)65718 -0.0240171  0.2577968  -0.093 0.925776    
## factor(id)65781  0.6085748  0.2592589   2.347 0.018922 *  
## factor(id)65799  0.0526209  0.2581204   0.204 0.838465    
## factor(id)65817  1.0990312  0.2587845   4.247 2.18e-05 ***
## factor(id)65853  1.0102689  0.2583234   3.911 9.24e-05 ***
## factor(id)65862  0.1187967  0.2575508   0.461 0.644623    
## factor(id)65889 -0.1043038  0.2575598  -0.405 0.685507    
## factor(id)66024 -0.0938287  0.2575538  -0.364 0.715635    
## factor(id)66087  0.2665436  0.2583446   1.032 0.302215    
## factor(id)66168 -0.8312068  0.2575515  -3.227 0.001253 ** 
## factor(id)66186  1.4307548  0.2580121   5.545 2.99e-08 ***
## factor(id)66357  0.8893560  0.2595806   3.426 0.000614 ***
## factor(id)66366  0.5166514  0.2575846   2.006 0.044904 *  
## factor(id)66402  0.8110463  0.2598625   3.121 0.001806 ** 
## factor(id)66447  0.0353409  0.2579537   0.137 0.891029    
## factor(id)66645  1.3591789  0.2595313   5.237 1.66e-07 ***
## factor(id)66672  0.4170389  0.2585027   1.613 0.106707    
## factor(id)66699  1.1142717  0.2590160   4.302 1.71e-05 ***
## factor(id)66708 -0.0295747  0.2575705  -0.115 0.908588    
## factor(id)66753  0.0067348  0.2610216   0.026 0.979416    
## factor(id)66771  1.2504894  0.2589673   4.829 1.39e-06 ***
## factor(id)66843  0.7460145  0.2600990   2.868 0.004135 ** 
## factor(id)66906  0.9739496  0.2586545   3.765 0.000167 ***
## factor(id)66942 -0.4804829  0.2575496  -1.866 0.062121 .  
## factor(id)67014  0.7765911  0.2575906   3.015 0.002576 ** 
## factor(id)67086  0.2411693  0.2581816   0.934 0.350266    
## factor(id)67131  0.5795392  0.2577944   2.248 0.024589 *  
## factor(id)67194  0.6718097  0.2576650   2.607 0.009137 ** 
## factor(id)67275 -0.4025155  0.2578829  -1.561 0.118585    
## factor(id)67284  1.1390155  0.2596419   4.387 1.16e-05 ***
## factor(id)67293  0.6342843  0.2594745   2.444 0.014519 *  
## factor(id)67329  0.6411287  0.2577065   2.488 0.012865 *  
## factor(id)67419  0.7013405  0.2576008   2.723 0.006486 ** 
## factor(id)67437  0.2231398  0.2576434   0.866 0.386463    
## factor(id)67491 -0.9312350  0.2575511  -3.616 0.000301 ***
## factor(id)67527  0.9478964  0.2576001   3.680 0.000234 ***
## factor(id)67581  0.7964299  0.2592501   3.072 0.002130 ** 
## factor(id)67608  2.2979931  0.2647809   8.679  < 2e-16 ***
## factor(id)67617  1.1209489  0.2592288   4.324 1.54e-05 ***
## factor(id)67635  0.8140799  0.2590082   3.143 0.001676 ** 
## factor(id)67653  0.1418177  0.2575503   0.551 0.581890    
## factor(id)67698 -0.3787426  0.2576350  -1.470 0.141566    
## factor(id)67725  2.0981924  0.2602707   8.062 8.20e-16 ***
## factor(id)67743 -0.3939358  0.2576405  -1.529 0.126286    
## factor(id)67779  0.0406152  0.2575894   0.158 0.874716    
## factor(id)67887 -0.6691622  0.2575818  -2.598 0.009391 ** 
## factor(id)67968  0.3322423  0.2580171   1.288 0.197882    
## factor(id)67995 -0.1691502  0.2578502  -0.656 0.511835    
## factor(id)68049 -0.2411684  0.2577336  -0.936 0.349431    
## factor(id)68085  0.2919902  0.2575661   1.134 0.256962    
## factor(id)68103  0.1707432  0.2578169   0.662 0.507813    
## factor(id)68256  0.2039249  0.2576483   0.791 0.428675    
## factor(id)68274 -0.4500317  0.2576106  -1.747 0.080671 .  
## factor(id)68427  0.1230746  0.2582881   0.477 0.633725    
## factor(id)68445 -0.1601205  0.2575651  -0.622 0.534170    
## factor(id)68508 -0.0608812  0.2579213  -0.236 0.813401    
## factor(id)68589  0.4298343  0.2581135   1.665 0.095879 .  
## factor(id)68733  1.0994872  0.2610191   4.212 2.55e-05 ***
## factor(id)68823  0.4891866  0.2588391   1.890 0.058791 .  
## factor(id)68958  1.4698242  0.2643347   5.560 2.74e-08 ***
## factor(id)69057  0.8936194  0.2592450   3.447 0.000569 ***
## factor(id)69282  1.2060543  0.2602196   4.635 3.61e-06 ***
## factor(id)69318  2.0474181  0.2647181   7.734 1.12e-14 ***
## factor(id)69336  0.4452410  0.2576107   1.728 0.083950 .  
## factor(id)69354  1.4665197  0.2588486   5.666 1.50e-08 ***
## factor(id)69417  0.2502804  0.2577590   0.971 0.331574    
## factor(id)69426 -0.5082306  0.2575894  -1.973 0.048514 *  
## factor(id)69444  0.9276968  0.2585670   3.588 0.000335 ***
## factor(id)69516  0.6086189  0.2576838   2.362 0.018197 *  
## factor(id)69534  0.1746158  0.2581614   0.676 0.498810    
## factor(id)69606  0.3570182  0.2594214   1.376 0.168781    
## factor(id)69714  1.4062098  0.2625353   5.356 8.64e-08 ***
## factor(id)69723 -0.4571102  0.2581257  -1.771 0.076604 .  
## factor(id)69768  0.0809316  0.2575825   0.314 0.753377    
## factor(id)69777  0.7138769  0.2578239   2.769 0.005634 ** 
## factor(id)69822  0.1483094  0.2577983   0.575 0.565104    
## factor(id)69849 -1.1909774  0.2576372  -4.623 3.83e-06 ***
## factor(id)69867  1.0540892  0.2602481   4.050 5.15e-05 ***
## factor(id)69885  0.2169355  0.2576461   0.842 0.399809    
## factor(id)69921 -0.0401030  0.2576910  -0.156 0.876332    
## factor(id)69993  0.1009535  0.2586780   0.390 0.696346    
## factor(id)70137  0.6243295  0.2577963   2.422 0.015458 *  
## factor(id)70146  0.6020261  0.2576641   2.336 0.019482 *  
## factor(id)70209  0.8112300  0.2599029   3.121 0.001805 ** 
## factor(id)70236  1.8973667  0.2583944   7.343 2.22e-13 ***
## factor(id)70245  0.3317681  0.2577400   1.287 0.198041    
## factor(id)70263  0.4923010  0.2598436   1.895 0.058167 .  
## factor(id)70272 -0.4967916  0.2579652  -1.926 0.054151 .  
## factor(id)70308  0.1267391  0.2579900   0.491 0.623254    
## factor(id)70398 -0.2954818  0.2580377  -1.145 0.252185    
## factor(id)70434  0.4022244  0.2575761   1.562 0.118413    
## factor(id)70506  1.0600010  0.2588627   4.095 4.25e-05 ***
## factor(id)70533  0.2902456  0.2578473   1.126 0.260335    
## factor(id)70623  0.8368788  0.2606264   3.211 0.001326 ** 
## factor(id)70632  0.7968394  0.2575455   3.094 0.001979 ** 
## factor(id)70668 -1.1189643  0.2591387  -4.318 1.59e-05 ***
## factor(id)70704  0.1156213  0.2576823   0.449 0.653658    
## factor(id)70722  0.7163996  0.2576953   2.780 0.005443 ** 
## factor(id)70794  1.3064003  0.2622379   4.982 6.38e-07 ***
## factor(id)70884 -0.1894548  0.2583067  -0.733 0.463298    
## factor(id)70902  0.5137255  0.2590244   1.983 0.047354 *  
## factor(id)71028 -0.8382736  0.2596937  -3.228 0.001250 ** 
## factor(id)71154 -0.0686859  0.2575582  -0.267 0.789719    
## factor(id)71163  1.9135035  0.2706809   7.069 1.64e-12 ***
## factor(id)71298  0.2095030  0.2575446   0.813 0.415968    
## factor(id)71334  1.8737761  0.2606609   7.189 6.91e-13 ***
## factor(id)71361  2.3329168  0.2716727   8.587  < 2e-16 ***
## factor(id)71388  0.0024678  0.2576825   0.010 0.992359    
## factor(id)71406  1.1398051  0.2673290   4.264 2.03e-05 ***
## factor(id)71442 -0.0937204  0.2579633  -0.363 0.716380    
## factor(id)71469  0.8350117  0.2582740   3.233 0.001228 ** 
## factor(id)71478  0.9190123  0.2577770   3.565 0.000365 ***
## factor(id)71496  0.7890331  0.2606251   3.027 0.002471 ** 
## factor(id)71514  0.5401315  0.2625955   2.057 0.039717 *  
## factor(id)71559  1.4818200  0.2648652   5.595 2.26e-08 ***
## factor(id)71586  0.5159262  0.2578046   2.001 0.045389 *  
## factor(id)71631  1.7134882  0.2666696   6.426 1.36e-10 ***
## factor(id)71649  0.6789709  0.2580451   2.631 0.008518 ** 
## factor(id)71658  0.3693946  0.2589036   1.427 0.153672    
## factor(id)71685  0.0585778  0.2582652   0.227 0.820573    
## factor(id)71694  0.7455011  0.2578474   2.891 0.003844 ** 
## factor(id)71739 -0.1895740  0.2576634  -0.736 0.461901    
## factor(id)71766 -0.0258670  0.2579013  -0.100 0.920109    
## factor(id)71847 -0.3219964  0.2579640  -1.248 0.211973    
## factor(id)71865  0.2322843  0.2576036   0.902 0.367227    
## factor(id)72009  0.2343221  0.2589115   0.905 0.365468    
## factor(id)72027  0.3244906  0.2575819   1.260 0.207780    
## factor(id)72045  0.3146747  0.2576248   1.221 0.221940    
## factor(id)72072  0.1575809  0.2576719   0.612 0.540842    
## factor(id)72108  1.3134440  0.2592673   5.066 4.12e-07 ***
## factor(id)72126  0.5035473  0.2580576   1.951 0.051044 .  
## factor(id)72207  0.8701035  0.2594922   3.353 0.000801 ***
## factor(id)72252  1.1358256  0.2582181   4.399 1.10e-05 ***
## factor(id)72261  2.0763640  0.2589089   8.020 1.15e-15 ***
## factor(id)72288  1.1975348  0.2600679   4.605 4.17e-06 ***
## factor(id)72297  0.4368097  0.2577832   1.694 0.090198 .  
## factor(id)72333  0.3378712  0.2578083   1.311 0.190033    
## factor(id)72405  1.0793289  0.2598142   4.154 3.29e-05 ***
## factor(id)72414  0.9801992  0.2588602   3.787 0.000153 ***
## factor(id)72477  2.2813405  0.2638223   8.647  < 2e-16 ***
## factor(id)72486  3.3104764  0.2647765  12.503  < 2e-16 ***
## factor(id)72495  1.4299898  0.2606562   5.486 4.19e-08 ***
## factor(id)72504  0.3769831  0.2578378   1.462 0.143740    
## factor(id)72531  0.3105873  0.2657095   1.169 0.242467    
## factor(id)72585  0.7830127  0.2598281   3.014 0.002587 ** 
## factor(id)72666  1.3139175  0.2681564   4.900 9.71e-07 ***
## factor(id)72675  0.2399426  0.2587153   0.927 0.353717    
## factor(id)72738  1.1592787  0.2604597   4.451 8.62e-06 ***
## factor(id)72756  0.6100922  0.2604936   2.342 0.019193 *  
## factor(id)72783  1.8096904  0.2597731   6.966 3.41e-12 ***
## factor(id)72792  0.6422858  0.2587558   2.482 0.013070 *  
## factor(id)72837  1.8440805  0.2656579   6.942 4.07e-12 ***
## factor(id)72909  1.0792631  0.2615431   4.127 3.71e-05 ***
## factor(id)72927  0.7279165  0.2583652   2.817 0.004849 ** 
## factor(id)72945  1.5714490  0.2606195   6.030 1.69e-09 ***
## factor(id)72963  1.0768411  0.2586872   4.163 3.17e-05 ***
## factor(id)72981  1.9038398  0.2632049   7.233 4.98e-13 ***
## factor(id)72999  2.4761985  0.2647257   9.354  < 2e-16 ***
## factor(id)73044  2.1210101  0.2630679   8.063 8.14e-16 ***
## factor(id)73116  0.7547172  0.2577662   2.928 0.003419 ** 
## factor(id)73125  1.5849414  0.2576400   6.152 7.89e-10 ***
## factor(id)73134  0.7908777  0.2575639   3.071 0.002141 ** 
## factor(id)73143  0.9472351  0.2631912   3.599 0.000321 ***
## factor(id)73197  0.7911640  0.2635024   3.002 0.002683 ** 
## factor(id)73206  0.9616565  0.2607281   3.688 0.000227 ***
## factor(id)73242  0.8813293  0.2604307   3.384 0.000716 ***
## factor(id)73305  0.7707932  0.2597150   2.968 0.003005 ** 
## factor(id)73377  0.5283829  0.2600515   2.032 0.042191 *  
## factor(id)73422 -0.1655066  0.2577055  -0.642 0.520735    
## factor(id)73476  1.7925945  0.2728106   6.571 5.20e-11 ***
## factor(id)73485  0.8707273  0.2583478   3.370 0.000753 ***
## factor(id)73494  0.7043481  0.2578357   2.732 0.006308 ** 
## factor(id)73503  0.5133035  0.2580124   1.989 0.046673 *  
## factor(id)73512  0.2472337  0.2578356   0.959 0.337637    
## factor(id)73521  0.5568646  0.2618928   2.126 0.033497 *  
## factor(id)73602  0.6613895  0.2576140   2.567 0.010259 *  
## factor(id)73611  1.9083276  0.2610324   7.311 2.82e-13 ***
## factor(id)73656  0.5789673  0.2583346   2.241 0.025033 *  
## factor(id)73746  0.5673862  0.2577732   2.201 0.027746 *  
## factor(id)73755  0.2743017  0.2575464   1.065 0.286870    
## factor(id)73773 -0.4857620  0.2576725  -1.885 0.059427 .  
## factor(id)73782 -0.9197431  0.2586840  -3.555 0.000379 ***
## factor(id)73791  0.3521282  0.2583818   1.363 0.172963    
## factor(id)73836  0.7290462  0.2701530   2.699 0.006972 ** 
## factor(id)73899 -0.2227499  0.2583405  -0.862 0.388575    
## factor(id)73953  0.3681742  0.2577541   1.428 0.153203    
## factor(id)73998  1.0047684  0.2590041   3.879 0.000105 ***
## factor(id)74007  0.2416054  0.2576735   0.938 0.348446    
## factor(id)74025  1.4812781  0.2702394   5.481 4.30e-08 ***
## factor(id)74052  1.0554983  0.2601807   4.057 5.00e-05 ***
## factor(id)74151  0.1945732  0.2577799   0.755 0.450381    
## factor(id)74169 -0.5120478  0.2577074  -1.987 0.046951 *  
## factor(id)74187  0.4511743  0.2588939   1.743 0.081410 .  
## factor(id)74196  1.2193348  0.2654046   4.594 4.38e-06 ***
## factor(id)74214  1.2348066  0.2589024   4.769 1.87e-06 ***
## factor(id)74259  1.3563214  0.2599874   5.217 1.85e-07 ***
## factor(id)74313  1.3964452  0.2596778   5.378 7.68e-08 ***
## factor(id)74322  0.4368249  0.2591119   1.686 0.091848 .  
## factor(id)74367  0.9193871  0.2582565   3.560 0.000372 ***
## factor(id)74403  0.3242602  0.2577804   1.258 0.208453    
## factor(id)74421  1.6662203  0.2593154   6.425 1.36e-10 ***
## factor(id)74457  0.4610123  0.2576090   1.790 0.073545 .  
## factor(id)74466  1.1161728  0.2582595   4.322 1.56e-05 ***
## factor(id)74484  0.9007829  0.2576115   3.497 0.000473 ***
## factor(id)74493  0.8432151  0.2576119   3.273 0.001066 ** 
## factor(id)74502  0.7532687  0.2608770   2.887 0.003890 ** 
## factor(id)74511  2.1952609  0.2589932   8.476  < 2e-16 ***
## factor(id)74547  1.2911356  0.2629443   4.910 9.21e-07 ***
## factor(id)74574  0.3805697  0.2578864   1.476 0.140042    
## factor(id)74628  1.1298956  0.2638266   4.283 1.86e-05 ***
## factor(id)74655  0.3848547  0.2579531   1.492 0.135736    
## factor(id)74682  0.9327575  0.2587196   3.605 0.000313 ***
## factor(id)74718  0.2566555  0.2578608   0.995 0.319597    
## factor(id)74745 -0.7063244  0.2576497  -2.741 0.006126 ** 
## factor(id)74754  0.9091767  0.2585388   3.517 0.000439 ***
## factor(id)74817 -0.3151148  0.2582126  -1.220 0.222347    
## factor(id)74835  0.4389241  0.2588879   1.695 0.090020 .  
## factor(id)74889  0.1044465  0.2582311   0.404 0.685875    
## factor(id)74916  0.8464907  0.2591686   3.266 0.001093 ** 
## factor(id)74961  0.2063784  0.2579592   0.800 0.423701    
## factor(id)75015  1.1687721  0.2595888   4.502 6.78e-06 ***
## factor(id)75078  0.4647673  0.2581535   1.800 0.071829 .  
## factor(id)75105  2.4056544  0.2642126   9.105  < 2e-16 ***
## factor(id)75123  0.4044953  0.2587730   1.563 0.118047    
## factor(id)75132 -1.2049222  0.2575440  -4.679 2.92e-06 ***
## factor(id)75204  0.9387961  0.2585789   3.631 0.000284 ***
## factor(id)75258  0.1145758  0.2620208   0.437 0.661918    
## factor(id)75303  1.5722374  0.2693688   5.837 5.45e-09 ***
## factor(id)75357 -0.3859941  0.2576426  -1.498 0.134112    
## factor(id)75366 -0.2318355  0.2577821  -0.899 0.368485    
## factor(id)75393 -0.7848787  0.2577938  -3.045 0.002335 ** 
## factor(id)75447  0.3422231  0.2582112   1.325 0.185075    
## factor(id)75555  0.5809648  0.2578728   2.253 0.024282 *  
## factor(id)75573  0.6775367  0.2576962   2.629 0.008569 ** 
## factor(id)75582  0.0919368  0.2577869   0.357 0.721368    
## factor(id)75672  0.5301595  0.2578754   2.056 0.039815 *  
## factor(id)75735  0.4456029  0.2590740   1.720 0.085460 .  
## factor(id)75762  0.7362889  0.2586429   2.847 0.004424 ** 
## factor(id)75906  1.1871164  0.2599012   4.568 4.98e-06 ***
## factor(id)75915 -0.3914931  0.2577811  -1.519 0.128862    
## factor(id)75996  0.4637217  0.2575628   1.800 0.071818 .  
## factor(id)76077  0.8861237  0.2600614   3.407 0.000658 ***
## factor(id)76176  0.1525408  0.2578822   0.592 0.554187    
## factor(id)76212  0.2967239  0.2577207   1.151 0.249614    
## factor(id)76239  0.4852471  0.2580516   1.880 0.060073 .  
## factor(id)76248  0.1698719  0.2578274   0.659 0.509998    
## factor(id)76311 -0.3955766  0.2575939  -1.536 0.124647    
## factor(id)76365  0.1217690  0.2576471   0.473 0.636493    
## factor(id)76392  1.1982551  0.2581902   4.641 3.50e-06 ***
## factor(id)76419  0.5776567  0.2578813   2.240 0.025108 *  
## factor(id)76464  0.5256891  0.2579794   2.038 0.041599 *  
## factor(id)76473  0.6261954  0.2601031   2.407 0.016077 *  
## factor(id)76482  0.6478800  0.2577893   2.513 0.011976 *  
## factor(id)76572  0.7005666  0.2576886   2.719 0.006564 ** 
## factor(id)76581  0.0524925  0.2576642   0.204 0.838572    
## factor(id)76644 -0.2979221  0.2584948  -1.153 0.249127    
## factor(id)76671  1.7565515  0.2703235   6.498 8.45e-11 ***
## factor(id)76689  1.7792917  0.2636211   6.749 1.55e-11 ***
## factor(id)76734  2.1889177  0.2671494   8.194 2.78e-16 ***
## factor(id)76743  2.3289788  0.2746364   8.480  < 2e-16 ***
## factor(id)76797  1.5642929  0.2603386   6.009 1.92e-09 ***
## factor(id)76815  1.3807380  0.2657363   5.196 2.07e-07 ***
## factor(id)76842  2.4033798  0.2635379   9.120  < 2e-16 ***
## factor(id)76869  2.0449330  0.2629746   7.776 8.05e-15 ***
## factor(id)76914  1.2713987  0.2639722   4.816 1.48e-06 ***
## factor(id)76923  1.2739430  0.2599598   4.901 9.68e-07 ***
## factor(id)76941  1.9305879  0.2658664   7.261 4.05e-13 ***
## factor(id)76959  0.6564739  0.2577609   2.547 0.010882 *  
## factor(id)76986  1.4811630  0.2612935   5.669 1.47e-08 ***
## factor(id)77013 -0.1685737  0.2582259  -0.653 0.513887    
## factor(id)77031  1.3737307  0.2610429   5.262 1.44e-07 ***
## factor(id)77049  2.6976766  0.2630297  10.256  < 2e-16 ***
## factor(id)77094  0.1553347  0.2588172   0.600 0.548403    
## factor(id)77121  2.4744534  0.2654175   9.323  < 2e-16 ***
## factor(id)77148  1.7638445  0.2700754   6.531 6.79e-11 ***
## factor(id)77157  2.4778615  0.2759124   8.981  < 2e-16 ***
## factor(id)77166  1.3468811  0.2625963   5.129 2.95e-07 ***
## factor(id)77292  1.9376136  0.2699564   7.178 7.49e-13 ***
## factor(id)77301  2.2172722  0.2768053   8.010 1.24e-15 ***
## factor(id)77328 -0.0811923  0.2576705  -0.315 0.752690    
## factor(id)77382  0.3055412  0.2578149   1.185 0.235993    
## factor(id)77445  0.8859915  0.2580893   3.433 0.000599 ***
## factor(id)77454  1.1894903  0.2665164   4.463 8.15e-06 ***
## factor(id)77463  0.5092151  0.2576947   1.976 0.048172 *  
## factor(id)77472  0.3291626  0.2576888   1.277 0.201497    
## factor(id)77508  2.0663507  0.2632010   7.851 4.46e-15 ***
## factor(id)77571  1.4448542  0.2670434   5.411 6.40e-08 ***
## factor(id)77589  1.4261452  0.2575456   5.537 3.13e-08 ***
## factor(id)77634  1.1231790  0.2640317   4.254 2.12e-05 ***
## factor(id)77661  1.3300550  0.2669093   4.983 6.34e-07 ***
## factor(id)77742  2.1254963  0.2609528   8.145 4.14e-16 ***
## factor(id)77778 -0.7658377  0.2577773  -2.971 0.002975 ** 
## factor(id)77805  2.3592005  0.2619111   9.008  < 2e-16 ***
## factor(id)77814  1.1868867  0.2594670   4.574 4.82e-06 ***
## factor(id)77823  0.2679412  0.2581851   1.038 0.299389    
## factor(id)77832  0.4872017  0.2606097   1.869 0.061581 .  
## factor(id)77868  1.2565743  0.2585377   4.860 1.19e-06 ***
## factor(id)77877  1.1113862  0.2654292   4.187 2.84e-05 ***
## factor(id)77886  1.9452737  0.2714090   7.167 8.07e-13 ***
## factor(id)77913  1.9383222  0.2628471   7.374 1.75e-13 ***
## factor(id)77931  0.4827703  0.2579293   1.872 0.061269 .  
## factor(id)77949  1.3277012  0.2615762   5.076 3.91e-07 ***
## factor(id)77958  1.1957945  0.2655976   4.502 6.78e-06 ***
## factor(id)77985  0.7029418  0.2623670   2.679 0.007389 ** 
## factor(id)77994  0.6991399  0.2578972   2.711 0.006719 ** 
## factor(id)78003  2.3269191  0.2624171   8.867  < 2e-16 ***
## factor(id)78048  0.5911908  0.2608268   2.267 0.023431 *  
## factor(id)78066  0.8137895  0.2582976   3.151 0.001633 ** 
## factor(id)78156  0.1531772  0.2577121   0.594 0.552273    
## factor(id)78174  0.9294288  0.2575608   3.609 0.000309 ***
## factor(id)78219  2.0310136  0.2621274   7.748 1.00e-14 ***
## factor(id)78228  1.2311794  0.2598933   4.737 2.19e-06 ***
## factor(id)78237  1.5954582  0.2583677   6.175 6.81e-10 ***
## factor(id)78246  1.3915106  0.2600057   5.352 8.86e-08 ***
## factor(id)78282  1.0844927  0.2597066   4.176 2.99e-05 ***
## factor(id)78318  1.7951950  0.2618589   6.856 7.43e-12 ***
## factor(id)78327  1.1900400  0.2592761   4.590 4.48e-06 ***
## factor(id)78336  2.5404724  0.2658889   9.555  < 2e-16 ***
## factor(id)78345  2.0346737  0.2611307   7.792 7.12e-15 ***
## factor(id)78363  0.1401841  0.2576213   0.544 0.586349    
## factor(id)78399  1.6000950  0.2625662   6.094 1.13e-09 ***
## factor(id)78462  0.9111050  0.2578337   3.534 0.000411 ***
## factor(id)78489  0.8972179  0.2609694   3.438 0.000588 ***
## factor(id)78525  1.7375998  0.2625979   6.617 3.81e-11 ***
## factor(id)78534  1.8198859  0.2681864   6.786 1.20e-11 ***
## factor(id)78543  1.7378755  0.2641008   6.580 4.88e-11 ***
## factor(id)78552 -0.1116318  0.2589333  -0.431 0.666387    
## factor(id)78588  0.7302597  0.2663378   2.742 0.006118 ** 
## factor(id)78615  2.0966004  0.2696968   7.774 8.20e-15 ***
## factor(id)78642  0.8098224  0.2627546   3.082 0.002060 ** 
## factor(id)78669  0.4344519  0.2577843   1.685 0.091949 .  
## factor(id)78678  0.2861016  0.2582412   1.108 0.267932    
## factor(id)78687  2.4742579  0.2700474   9.162  < 2e-16 ***
## factor(id)78714  0.9194252  0.2592802   3.546 0.000392 ***
## factor(id)78732  0.3612414  0.2582575   1.399 0.161908    
## factor(id)78804  1.8740330  0.2649796   7.072 1.60e-12 ***
## factor(id)78822  0.1682754  0.2575718   0.653 0.513565    
## factor(id)78858  0.9412910  0.2580098   3.648 0.000265 ***
## factor(id)78939  2.6679652  0.2780735   9.594  < 2e-16 ***
## factor(id)78948  2.4237640  0.2606481   9.299  < 2e-16 ***
## factor(id)78957  0.8967684  0.2608120   3.438 0.000587 ***
## factor(id)78975  1.3131606  0.2640888   4.972 6.70e-07 ***
## factor(id)79038  0.7246530  0.2578939   2.810 0.004963 ** 
## factor(id)79083  0.6680882  0.2581364   2.588 0.009661 ** 
## factor(id)79092  2.7589243  0.2644202  10.434  < 2e-16 ***
## factor(id)79119  0.9541547  0.2608434   3.658 0.000255 ***
## factor(id)79146  0.1239921  0.2586053   0.479 0.631616    
## factor(id)79155  1.4751126  0.2681961   5.500 3.87e-08 ***
## factor(id)79272  2.8554647  0.2668232  10.702  < 2e-16 ***
## factor(id)79308  0.5811128  0.2586489   2.247 0.024675 *  
## factor(id)79317  0.9090501  0.2585103   3.516 0.000439 ***
## factor(id)79551 -0.0726729  0.2581929  -0.281 0.778357    
## factor(id)79623  1.8476197  0.2590808   7.131 1.05e-12 ***
## factor(id)79659  0.1414287  0.2578759   0.548 0.583401    
## factor(id)79695 -0.4646787  0.2576119  -1.804 0.071287 .  
## factor(id)79794  0.6821562  0.2695391   2.531 0.011391 *  
## factor(id)79803  0.6057280  0.2577051   2.350 0.018765 *  
## factor(id)79884  0.3726417  0.2580243   1.444 0.148704    
## factor(id)79902 -0.7715251  0.2578807  -2.992 0.002779 ** 
## factor(id)79983  0.5448972  0.2580532   2.112 0.034743 *  
## factor(id)80136  1.2243646  0.2584713   4.737 2.19e-06 ***
## factor(id)80154  0.1380345  0.2587979   0.533 0.593788    
## factor(id)80289  0.4971199  0.2577200   1.929 0.053764 .  
## factor(id)80307 -0.2433518  0.2575773  -0.945 0.344793    
## factor(id)80343 -0.3287207  0.2577645  -1.275 0.202235    
## factor(id)80442  0.0940589  0.2576092   0.365 0.715026    
## factor(id)80514  0.0491445  0.2583171   0.190 0.849117    
## factor(id)80604 -1.0127860  0.2577067  -3.930 8.54e-05 ***
## factor(id)80838  0.3245117  0.2576310   1.260 0.207837    
## factor(id)80892 -0.3273592  0.2581097  -1.268 0.204716    
## factor(id)81009  0.7878425  0.2581566   3.052 0.002279 ** 
## factor(id)81027  0.2906293  0.2577296   1.128 0.259488    
## factor(id)81171  0.6779019  0.2581751   2.626 0.008656 ** 
## factor(id)81198 -0.0300793  0.2577185  -0.117 0.907089    
## factor(id)81243  0.8020606  0.2578861   3.110 0.001874 ** 
## factor(id)81306  1.2435950  0.2591596   4.799 1.62e-06 ***
## factor(id)81387 -0.0805862  0.2576735  -0.313 0.754479    
## factor(id)81396  1.0482509  0.2584319   4.056 5.02e-05 ***
## factor(id)81414  1.2489048  0.2610973   4.783 1.74e-06 ***
## factor(id)81423  0.0590104  0.2576414   0.229 0.818841    
## factor(id)81486  1.0053397  0.2586050   3.888 0.000102 ***
## factor(id)81495 -0.0547734  0.2588863  -0.212 0.832444    
## factor(id)81522  0.0523798  0.2594445   0.202 0.840004    
## factor(id)81549  0.4041310  0.2575651   1.569 0.116663    
## factor(id)81558  0.2692338  0.2576370   1.045 0.296037    
## factor(id)81576  0.6409909  0.2607414   2.458 0.013971 *  
## factor(id)81612  0.1954093  0.2580650   0.757 0.448938    
## factor(id)81657  0.2746684  0.2589219   1.061 0.288794    
## factor(id)81666  0.4161012  0.2581972   1.612 0.107082    
## factor(id)81792  1.0895705  0.2595466   4.198 2.71e-05 ***
## factor(id)81873  1.1538187  0.2589644   4.456 8.44e-06 ***
## factor(id)81954  0.6239233  0.2576090   2.422 0.015450 *  
## factor(id)81972  0.3927691  0.2577007   1.524 0.127501    
## factor(id)82026  0.5829010  0.2579039   2.260 0.023829 *  
## factor(id)82044  3.0775354  0.2638386  11.664  < 2e-16 ***
## factor(id)82053  1.6627518  0.2599653   6.396 1.65e-10 ***
## factor(id)82152 -0.0869433  0.2576162  -0.337 0.735752    
## factor(id)82188  1.3599532  0.2588658   5.254 1.52e-07 ***
## factor(id)82206  0.5909489  0.2651501   2.229 0.025849 *  
## factor(id)82224  0.5849503  0.2584100   2.264 0.023612 *  
## factor(id)82323  1.2800086  0.2608992   4.906 9.40e-07 ***
## factor(id)82395  0.2562497  0.2594132   0.988 0.323267    
## factor(id)82422  2.2894309  0.2607869   8.779  < 2e-16 ***
## factor(id)82503  1.6924133  0.2597293   6.516 7.49e-11 ***
## factor(id)82548  0.8871974  0.2578121   3.441 0.000581 ***
## factor(id)82629  0.5061074  0.2579990   1.962 0.049823 *  
## factor(id)82692  1.2675943  0.2654935   4.774 1.82e-06 ***
## factor(id)82701 -0.6215215  0.2584048  -2.405 0.016177 *  
## factor(id)82719  0.5442519  0.2652709   2.052 0.040221 *  
## factor(id)82737  0.0251156  0.2576206   0.097 0.922338    
## factor(id)82872  1.5936373  0.2633514   6.051 1.48e-09 ***
## factor(id)82881  0.7993574  0.2604648   3.069 0.002153 ** 
## factor(id)82944  1.7296899  0.2672782   6.471 1.01e-10 ***
## factor(id)82953 -0.4383747  0.2576973  -1.701 0.088945 .  
## factor(id)82962 -0.6687989  0.2575634  -2.597 0.009425 ** 
## factor(id)83034  0.7948524  0.2594044   3.064 0.002188 ** 
## factor(id)83061  1.5803431  0.2588246   6.106 1.05e-09 ***
## factor(id)83079  0.5997745  0.2582398   2.323 0.020219 *  
## factor(id)83106  0.6020237  0.2580689   2.333 0.019674 *  
## factor(id)83133  0.6094482  0.2584703   2.358 0.018394 *  
## factor(id)83142  0.9075561  0.2587030   3.508 0.000453 ***
## factor(id)83169  0.7539703  0.2584954   2.917 0.003543 ** 
## factor(id)83178  0.0512904  0.2581525   0.199 0.842514    
## factor(id)83205  2.3699192  0.2626124   9.024  < 2e-16 ***
## factor(id)83214  0.3242372  0.2577197   1.258 0.208379    
## factor(id)83277  1.6569964  0.2672540   6.200 5.82e-10 ***
## factor(id)83286  1.4232115  0.2674003   5.322 1.04e-07 ***
## factor(id)83349  0.0845571  0.2604506   0.325 0.745446    
## factor(id)83394 -0.5388285  0.2575492  -2.092 0.036446 *  
## factor(id)83439 -0.8459307  0.2576349  -3.283 0.001028 ** 
## factor(id)83448 -0.0308074  0.2576566  -0.120 0.904828    
## factor(id)83484  0.6653751  0.2579867   2.579 0.009917 ** 
## factor(id)83493  1.0053182  0.2584457   3.890 0.000101 ***
## factor(id)83547 -0.1236218  0.2577665  -0.480 0.631528    
## factor(id)83619  0.2739052  0.2575750   1.063 0.287621    
## factor(id)83628 -0.4867259  0.2575679  -1.890 0.058821 .  
## factor(id)83655 -0.8206651  0.2575829  -3.186 0.001446 ** 
## factor(id)83727 -0.0934915  0.2576864  -0.363 0.716752    
## factor(id)83745 -0.6980379  0.2578386  -2.707 0.006793 ** 
## factor(id)83871  0.0728443  0.2576065   0.283 0.777355    
## factor(id)83889 -0.1477669  0.2575524  -0.574 0.566157    
## factor(id)83934  1.0339111  0.2590017   3.992 6.59e-05 ***
## factor(id)83943  0.9792721  0.2581854   3.793 0.000150 ***
## factor(id)83979 -0.4139047  0.2579317  -1.605 0.108583    
## factor(id)84258  0.5878441  0.2576287   2.282 0.022521 *  
## factor(id)84429  0.0953140  0.2575906   0.370 0.711373    
## factor(id)84501 -0.1395376  0.2589242  -0.539 0.589956    
## factor(id)84546 -0.7035166  0.2576769  -2.730 0.006338 ** 
## factor(id)84573  0.7366003  0.2580160   2.855 0.004313 ** 
## factor(id)84645 -0.6401119  0.2576328  -2.485 0.012983 *  
## factor(id)84762  0.3392257  0.2576023   1.317 0.187910    
## factor(id)84798  1.7033277  0.2724745   6.251 4.20e-10 ***
## factor(id)84807 -0.3636201  0.2575685  -1.412 0.158051    
## factor(id)84816  0.4794699  0.2577222   1.860 0.062850 .  
## factor(id)84942  0.4207016  0.2576500   1.633 0.102527    
## factor(id)84978 -0.8155101  0.2578565  -3.163 0.001567 ** 
## factor(id)85032  0.5295638  0.2575767   2.056 0.039808 *  
## factor(id)85059  0.4701586  0.2581579   1.821 0.068599 .  
## factor(id)85086  0.5329817  0.2588599   2.059 0.039519 *  
## factor(id)85167  0.0087186  0.2576077   0.034 0.973002    
## factor(id)85248 -0.4954272  0.2576447  -1.923 0.054514 .  
## factor(id)85311  1.0124612  0.2595683   3.901 9.65e-05 ***
## factor(id)85374 -0.2110539  0.2576777  -0.819 0.412767    
## factor(id)85392  0.5671706  0.2577145   2.201 0.027770 *  
## factor(id)85428  0.3394587  0.2579377   1.316 0.188181    
## factor(id)85491 -0.9142074  0.2575521  -3.550 0.000387 ***
## factor(id)85527  0.4473084  0.2575814   1.737 0.082487 .  
## factor(id)85572 -0.0098638  0.2577020  -0.038 0.969468    
## factor(id)85734  0.1289049  0.2583928   0.499 0.617878    
## factor(id)85779  1.2672725  0.2622917   4.832 1.37e-06 ***
## factor(id)85914  0.5537526  0.2603077   2.127 0.033414 *  
## factor(id)85941  0.3168445  0.2583766   1.226 0.220113    
## factor(id)86103 -0.0609887  0.2599647  -0.235 0.814520    
## factor(id)86211  0.5838600  0.2587494   2.256 0.024058 *  
## factor(id)86229  0.4346935  0.2607854   1.667 0.095566 .  
## factor(id)86247  1.0191228  0.2591790   3.932 8.46e-05 ***
## factor(id)86274  0.2576502  0.2578240   0.999 0.317656    
## factor(id)86292 -0.4864104  0.2583340  -1.883 0.059740 .  
## factor(id)86346 -0.6825321  0.2577348  -2.648 0.008102 ** 
## factor(id)86517  0.4809988  0.2579632   1.865 0.062260 .  
## factor(id)86571  1.3730966  0.2605078   5.271 1.38e-07 ***
## factor(id)86751  1.9925903  0.2656214   7.502 6.72e-14 ***
## factor(id)86796  1.9076046  0.2610110   7.309 2.86e-13 ***
## factor(id)86859  0.2897880  0.2575855   1.125 0.260603    
## factor(id)86868 -0.0544135  0.2577192  -0.211 0.832785    
## factor(id)86913  0.6028199  0.2577115   2.339 0.019344 *  
## factor(id)86985  1.0401270  0.2577881   4.035 5.50e-05 ***
## factor(id)87003  0.9371051  0.2592758   3.614 0.000302 ***
## factor(id)87147  0.4107676  0.2583315   1.590 0.111842    
## factor(id)87156 -0.2449959  0.2575914  -0.951 0.341570    
## factor(id)87192  0.3959167  0.2581175   1.534 0.125088    
## factor(id)87201  1.4971049  0.2608792   5.739 9.76e-09 ***
## factor(id)87237  0.9439780  0.2606902   3.621 0.000295 ***
## factor(id)87264  0.6647741  0.2583848   2.573 0.010099 *  
## factor(id)87273  1.2038403  0.2585323   4.656 3.25e-06 ***
## factor(id)87282  0.9251270  0.2594118   3.566 0.000363 ***
## factor(id)87336  0.1620678  0.2576368   0.629 0.529324    
## factor(id)87408  1.0639271  0.2604046   4.086 4.42e-05 ***
## factor(id)87453  1.2631399  0.2631397   4.800 1.60e-06 ***
## factor(id)87516 -0.7290798  0.2575779  -2.831 0.004655 ** 
## factor(id)87579  1.2580659  0.2623371   4.796 1.64e-06 ***
## factor(id)87606  1.0699510  0.2615765   4.090 4.33e-05 ***
## factor(id)87642  1.9657801  0.2593897   7.578 3.74e-14 ***
## factor(id)87651  0.6933751  0.2582223   2.685 0.007258 ** 
## factor(id)87687  1.2158985  0.2628485   4.626 3.77e-06 ***
## factor(id)87714  1.4565534  0.2614974   5.570 2.60e-08 ***
## factor(id)87723  1.6791396  0.2671529   6.285 3.38e-10 ***
## factor(id)87741  2.5742576  0.2731234   9.425  < 2e-16 ***
## factor(id)87759  0.8860105  0.2583886   3.429 0.000608 ***
## factor(id)87777  2.7160916  0.2689668  10.098  < 2e-16 ***
## factor(id)87804  1.2363999  0.2621093   4.717 2.42e-06 ***
## factor(id)87813  0.5087874  0.2580244   1.972 0.048648 *  
## factor(id)87849  1.2257644  0.2582878   4.746 2.10e-06 ***
## factor(id)87858  0.7626522  0.2656985   2.870 0.004107 ** 
## factor(id)87876  1.3796153  0.2597685   5.311 1.11e-07 ***
## factor(id)87921  2.5827759  0.2630396   9.819  < 2e-16 ***
## factor(id)87939  1.4937030  0.2584467   5.780 7.67e-09 ***
## factor(id)87984  0.3168918  0.2616032   1.211 0.225786    
## factor(id)88002  1.3163010  0.2586850   5.088 3.66e-07 ***
## factor(id)88047  1.6301019  0.2607455   6.252 4.19e-10 ***
## factor(id)88083  0.7853075  0.2615200   3.003 0.002680 ** 
## factor(id)88155  0.5155198  0.2578237   2.000 0.045575 *  
## factor(id)88164 -0.3689001  0.2577429  -1.431 0.152377    
## factor(id)88173  1.0498293  0.2576881   4.074 4.65e-05 ***
## factor(id)88209  0.1473896  0.2576697   0.572 0.567325    
## factor(id)88218  1.2408499  0.2609672   4.755 2.01e-06 ***
## factor(id)88227  1.4558196  0.2578186   5.647 1.67e-08 ***
## factor(id)88236  2.9191316  0.2760976  10.573  < 2e-16 ***
## factor(id)88245  0.3384258  0.2599562   1.302 0.192989    
## factor(id)88254  1.2392870  0.2718956   4.558 5.21e-06 ***
## factor(id)88317  1.8794386  0.2685510   6.998 2.72e-12 ***
## factor(id)88407  0.8936550  0.2613275   3.420 0.000629 ***
## factor(id)88434  0.6963526  0.2584940   2.694 0.007072 ** 
## factor(id)88497  0.3398834  0.2576338   1.319 0.187109    
## factor(id)88533 -0.0806552  0.2576142  -0.313 0.754221    
## factor(id)88587  0.0317383  0.2575788   0.123 0.901936    
## factor(id)88605  1.4250879  0.2604684   5.471 4.55e-08 ***
## factor(id)88641  1.9423935  0.2588474   7.504 6.60e-14 ***
## factor(id)88659  1.9224117  0.2618282   7.342 2.23e-13 ***
## factor(id)88668  0.5168427  0.2610885   1.980 0.047774 *  
## factor(id)88695 -0.2327780  0.2576802  -0.903 0.366352    
## factor(id)88722  1.0569594  0.2675614   3.950 7.85e-05 ***
## factor(id)88785  0.9959510  0.2595202   3.838 0.000125 ***
## factor(id)88794 -0.9443197  0.2590011  -3.646 0.000267 ***
## factor(id)88821  0.5058040  0.2576279   1.963 0.049632 *  
## factor(id)88866  1.0823482  0.2599553   4.164 3.15e-05 ***
## factor(id)88938  0.1023710  0.2575585   0.397 0.691030    
## factor(id)88983  0.2046648  0.2600879   0.787 0.431351    
## factor(id)89019  1.3619894  0.2766755   4.923 8.64e-07 ***
## factor(id)89055  0.8691553  0.2643976   3.287 0.001014 ** 
## factor(id)89082  1.1145866  0.2621791   4.251 2.14e-05 ***
## factor(id)89181  0.7669371  0.2579706   2.973 0.002955 ** 
## factor(id)89199  2.1833951  0.2622375   8.326  < 2e-16 ***
## factor(id)89244  0.9105354  0.2575476   3.535 0.000409 ***
## factor(id)89253  0.8028419  0.2586714   3.104 0.001915 ** 
## factor(id)89271  1.4223329  0.2647958   5.371 7.95e-08 ***
## factor(id)89379  0.7403087  0.2577119   2.873 0.004078 ** 
## factor(id)89406 -0.1465898  0.2578965  -0.568 0.569770    
## factor(id)89424  1.7462470  0.2591762   6.738 1.68e-11 ***
## factor(id)89433  1.2315512  0.2642539   4.660 3.19e-06 ***
## factor(id)89514 -0.4660893  0.2592468  -1.798 0.072223 .  
## factor(id)89532  0.1564811  0.2577444   0.607 0.543784    
## factor(id)89577  0.2083435  0.2576205   0.809 0.418690    
## factor(id)89586  0.0210524  0.2576814   0.082 0.934887    
## factor(id)89649  0.3554937  0.2601297   1.367 0.171774    
## factor(id)89676  0.2667485  0.2582490   1.033 0.301665    
## factor(id)89721  0.8341158  0.2596039   3.213 0.001317 ** 
## factor(id)89865 -0.1008379  0.2587885  -0.390 0.696799    
## factor(id)89892 -0.0792915  0.2575989  -0.308 0.758232    
## factor(id)89937  0.1814181  0.2577648   0.704 0.481562    
## factor(id)89946 -0.6063731  0.2575450  -2.354 0.018566 *  
## factor(id)90045  2.6802991  0.2608880  10.274  < 2e-16 ***
## factor(id)90063  0.4821381  0.2593599   1.859 0.063057 .  
## factor(id)90198  0.7229879  0.2604004   2.776 0.005504 ** 
## factor(id)90225  1.3136963  0.2585253   5.081 3.80e-07 ***
## factor(id)90243  0.2002066  0.2576638   0.777 0.437169    
## factor(id)90279 -0.2209290  0.2577541  -0.857 0.391389    
## factor(id)90306  0.6992883  0.2613107   2.676 0.007458 ** 
## factor(id)90315  0.6832602  0.2589915   2.638 0.008346 ** 
## factor(id)90351  1.0263208  0.2682317   3.826 0.000131 ***
## factor(id)90369  1.7827878  0.2678655   6.656 2.94e-11 ***
## factor(id)90432  0.1892960  0.2585348   0.732 0.464068    
## factor(id)90441  0.5085938  0.2576695   1.974 0.048424 *  
## factor(id)90504  0.5445689  0.2587908   2.104 0.035373 *  
## factor(id)90522  1.0348931  0.2592396   3.992 6.59e-05 ***
## factor(id)90531  1.2768330  0.2601525   4.908 9.31e-07 ***
## factor(id)90558  0.5703615  0.2604390   2.190 0.028542 *  
## factor(id)90585  0.2509196  0.2576633   0.974 0.330161    
## factor(id)90612  1.5908099  0.2697708   5.897 3.80e-09 ***
## factor(id)90639  1.0505318  0.2607759   4.028 5.65e-05 ***
## factor(id)90684  1.3942808  0.2613865   5.334 9.76e-08 ***
## factor(id)90711  0.7816866  0.2582008   3.027 0.002471 ** 
## factor(id)90819  0.4041932  0.2581114   1.566 0.117382    
## factor(id)90864  0.0509994  0.2577137   0.198 0.843133    
## factor(id)90882  0.2747534  0.2576110   1.067 0.286198    
## factor(id)90891  1.0132094  0.2593597   3.907 9.41e-05 ***
## factor(id)90927  0.9138812  0.2613558   3.497 0.000473 ***
## factor(id)91062  0.7320529  0.2584589   2.832 0.004628 ** 
## factor(id)91071 -0.2027616  0.2577185  -0.787 0.431439    
## factor(id)91143 -0.0026153  0.2577047  -0.010 0.991903    
## factor(id)91197  0.0498879  0.2577294   0.194 0.846518    
## factor(id)91278  0.1427736  0.2576178   0.554 0.579447    
## factor(id)91287  1.4155342  0.2600290   5.444 5.31e-08 ***
## factor(id)91296  0.3460384  0.2614609   1.323 0.185699    
## factor(id)91368  0.4525841  0.2577221   1.756 0.079097 .  
## factor(id)91404  0.0499710  0.2576110   0.194 0.846196    
## factor(id)91629 -0.5770886  0.2584308  -2.233 0.025563 *  
## factor(id)91674  0.7227741  0.2588541   2.792 0.005243 ** 
## factor(id)91728 -0.0669176  0.2577032  -0.260 0.795123    
## factor(id)91782  2.1215044  0.2582984   8.213 2.36e-16 ***
## factor(id)91854  0.4445050  0.2580085   1.723 0.084943 .  
## factor(id)91908  0.0453901  0.2582662   0.176 0.860494    
## factor(id)91926  0.5528037  0.2579142   2.143 0.032103 *  
## factor(id)92088  0.8863254  0.2620216   3.383 0.000720 ***
## factor(id)92106  0.0959411  0.2587140   0.371 0.710764    
## factor(id)92169  0.8281973  0.2577404   3.213 0.001315 ** 
## factor(id)92223 -0.0808388  0.2577115  -0.314 0.753770    
## factor(id)92232  0.1457932  0.2577854   0.566 0.571703    
## factor(id)92538 -0.6547045  0.2589332  -2.528 0.011468 *  
## factor(id)92565 -0.4708960  0.2576677  -1.828 0.067643 .  
## factor(id)92592 -0.2753193  0.2586138  -1.065 0.287079    
## factor(id)92646  0.9280656  0.2620215   3.542 0.000399 ***
## factor(id)92655 -0.2507903  0.2577685  -0.973 0.330607    
## factor(id)92736 -0.0577293  0.2578697  -0.224 0.822862    
## factor(id)92979  0.2105130  0.2579502   0.816 0.414459    
## factor(id)93015  0.0641361  0.2576282   0.249 0.803405    
## factor(id)93087  0.9366642  0.2578407   3.633 0.000282 ***
## factor(id)93105 -1.3691998  0.2576439  -5.314 1.09e-07 ***
## factor(id)93186  0.0839955  0.2601716   0.323 0.746817    
## factor(id)93195  0.8412455  0.2586597   3.252 0.001148 ** 
## factor(id)93276  1.7997708  0.2590794   6.947 3.92e-12 ***
## factor(id)93303  0.8591375  0.2576610   3.334 0.000857 ***
## factor(id)93438  0.6637936  0.2576042   2.577 0.009983 ** 
## factor(id)93447  0.6543407  0.2584532   2.532 0.011361 *  
## factor(id)93519 -0.0259064  0.2576213  -0.101 0.919901    
## factor(id)93627 -0.0024528  0.2580711  -0.010 0.992417    
## factor(id)93636  0.3768219  0.2609351   1.444 0.148730    
## factor(id)93645  0.0018211  0.2598049   0.007 0.994407    
## factor(id)93726  0.2431416  0.2585700   0.940 0.347065    
## factor(id)93861 -0.6948281  0.2577207  -2.696 0.007026 ** 
## factor(id)93897  0.5816273  0.2588073   2.247 0.024636 *  
## factor(id)93933 -0.8315932  0.2576702  -3.227 0.001253 ** 
## factor(id)93942  0.3911868  0.2575781   1.519 0.128860    
## factor(id)94059  1.1990810  0.2577838   4.651 3.33e-06 ***
## factor(id)94158 -0.5645742  0.2576336  -2.191 0.028442 *  
## factor(id)94275  0.4994221  0.2578174   1.937 0.052753 .  
## factor(id)94392  0.9876897  0.2589362   3.814 0.000137 ***
## factor(id)94518 -0.8581159  0.2575465  -3.332 0.000865 ***
## factor(id)94572  1.3283396  0.2602127   5.105 3.36e-07 ***
## factor(id)94626 -0.3540091  0.2581048  -1.372 0.170221    
## factor(id)94662  1.6298265  0.2594459   6.282 3.45e-10 ***
## factor(id)94707 -0.5376160  0.2590865  -2.075 0.038003 *  
## factor(id)94752  0.0032215  0.2576878   0.013 0.990026    
## factor(id)94761  0.5210282  0.2575745   2.023 0.043112 *  
## factor(id)94932 -0.8350614  0.2576210  -3.241 0.001192 ** 
## factor(id)94986  0.3450263  0.2579127   1.338 0.180997    
## factor(id)95148  0.1211833  0.2575577   0.471 0.637999    
## factor(id)95175 -0.2195476  0.2576301  -0.852 0.394129    
## factor(id)95274  0.5730695  0.2588867   2.214 0.026875 *  
## factor(id)95283  0.5154619  0.2577602   2.000 0.045546 *  
## factor(id)95355  0.6967064  0.2591407   2.689 0.007186 ** 
## factor(id)95616  0.0456025  0.2576069   0.177 0.859493    
## factor(id)95625 -0.3553529  0.2579903  -1.377 0.168416    
## factor(id)95706 -0.7711806  0.2580982  -2.988 0.002814 ** 
## factor(id)95751 -0.6885778  0.2575969  -2.673 0.007525 ** 
## factor(id)95787  1.3470695  0.2599817   5.181 2.24e-07 ***
## factor(id)95796  0.3204207  0.2577282   1.243 0.213798    
## factor(id)95805  0.1735194  0.2577934   0.673 0.500899    
## factor(id)95877 -0.3667293  0.2576273  -1.423 0.154619    
## factor(id)95922  0.6963033  0.2579633   2.699 0.006959 ** 
## factor(id)95994  0.2514171  0.2576262   0.976 0.329133    
## factor(id)96012  3.0021487  0.2829598  10.610  < 2e-16 ***
## factor(id)96102  2.2048199  0.2665329   8.272  < 2e-16 ***
## factor(id)96183  0.9872760  0.2577854   3.830 0.000129 ***
## factor(id)96201  1.8590222  0.2675665   6.948 3.89e-12 ***
## factor(id)96273  0.7863726  0.2598452   3.026 0.002481 ** 
## factor(id)96282  0.9117549  0.2640392   3.453 0.000556 ***
## factor(id)96309 -0.0151066  0.2582038  -0.059 0.953346    
## factor(id)96336  0.8390718  0.2576002   3.257 0.001128 ** 
## factor(id)96381  0.2948155  0.2576293   1.144 0.252504    
## factor(id)96399  1.2232669  0.2609031   4.689 2.78e-06 ***
## factor(id)96426  1.8606575  0.2694878   6.904 5.28e-12 ***
## factor(id)96444 -1.2586193  0.2575959  -4.886 1.04e-06 ***
## factor(id)96507 -0.3365902  0.2575890  -1.307 0.191340    
## factor(id)96552  0.1711091  0.2576216   0.664 0.506582    
## factor(id)96561  1.4833057  0.2578796   5.752 9.03e-09 ***
## factor(id)96606  1.7079845  0.2667450   6.403 1.58e-10 ***
## factor(id)96615  0.7991558  0.2658791   3.006 0.002655 ** 
## factor(id)96678  0.1278236  0.2577334   0.496 0.619936    
## factor(id)96858 -0.2541745  0.2575639  -0.987 0.323740    
## factor(id)96885  2.4036185  0.2737264   8.781  < 2e-16 ***
## factor(id)97011  2.6209944  0.2784125   9.414  < 2e-16 ***
## factor(id)97047  1.1776985  0.2592819   4.542 5.62e-06 ***
## factor(id)97119 -0.1755319  0.2577475  -0.681 0.495870    
## factor(id)97128  0.0648066  0.2585439   0.251 0.802081    
## factor(id)97146  2.6923408  0.2648287  10.166  < 2e-16 ***
## factor(id)97182  0.0116636  0.2576030   0.045 0.963887    
## factor(id)97254 -0.1336066  0.2575728  -0.519 0.603969    
## factor(id)97353  1.0168029  0.2577442   3.945 8.02e-05 ***
## factor(id)97407  0.1706421  0.2576863   0.662 0.507850    
## factor(id)97533 -1.0092892  0.2582781  -3.908 9.36e-05 ***
## factor(id)97884  1.6438909  0.2617162   6.281 3.47e-10 ***
## factor(id)98037 -0.5930641  0.2576007  -2.302 0.021337 *  
## factor(id)98064  0.2633950  0.2577385   1.022 0.306826    
## factor(id)98082 -0.0609252  0.2575782  -0.237 0.813024    
## factor(id)98154  0.5986119  0.2587960   2.313 0.020735 *  
## factor(id)98172 -1.4181527  0.2577495  -5.502 3.83e-08 ***
## factor(id)98199 -0.0374161  0.2575439  -0.145 0.884492    
## factor(id)98235  0.6721102  0.2601298   2.584 0.009784 ** 
## factor(id)98253  0.4059026  0.2579295   1.574 0.115583    
## factor(id)98262 -0.1860572  0.2576201  -0.722 0.470175    
## factor(id)98271  0.6199254  0.2579593   2.403 0.016267 *  
## factor(id)98298 -0.0001219  0.2578764   0.000 0.999623    
## factor(id)98379  0.2130492  0.2575812   0.827 0.408188    
## factor(id)98406 -0.0873709  0.2576008  -0.339 0.734486    
## factor(id)98415  1.6953215  0.2576117   6.581 4.86e-11 ***
## factor(id)98424  0.3421246  0.2575852   1.328 0.184136    
## factor(id)98433 -0.1014787  0.2577082  -0.394 0.693755    
## factor(id)98451 -0.3724707  0.2579693  -1.444 0.148804    
## factor(id)98577  0.1744732  0.2577333   0.677 0.498449    
## factor(id)98595 -0.5561313  0.2575473  -2.159 0.030843 *  
## factor(id)98712  1.2366744  0.2618530   4.723 2.35e-06 ***
## factor(id)98721  0.6819706  0.2607496   2.615 0.008922 ** 
## factor(id)98739  0.3526775  0.2580664   1.367 0.171770    
## factor(id)98748  0.2156309  0.2592094   0.832 0.405493    
## factor(id)98802 -0.4555266  0.2578125  -1.767 0.077270 .  
## factor(id)98829  0.6663334  0.2605136   2.558 0.010546 *  
## factor(id)98838  0.2911006  0.2578358   1.129 0.258913    
## factor(id)98847  0.9481148  0.2632603   3.601 0.000318 ***
## factor(id)98865  0.3777183  0.2591205   1.458 0.144950    
## factor(id)98901 -0.1841137  0.2610630  -0.705 0.480670    
## factor(id)98928  0.4126263  0.2575670   1.602 0.109177    
## factor(id)98991  1.9005065  0.2600551   7.308 2.87e-13 ***
## factor(id)99009  1.7272211  0.2661302   6.490 8.90e-11 ***
## factor(id)99045  1.2097829  0.2585447   4.679 2.91e-06 ***
## factor(id)99054  0.8253133  0.2615657   3.155 0.001607 ** 
## factor(id)99234  1.0294638  0.2646706   3.890 0.000101 ***
## factor(id)99288  0.0336045  0.2576687   0.130 0.896238    
## factor(id)99297  0.7089696  0.2595976   2.731 0.006322 ** 
## factor(id)99306  0.1508402  0.2579751   0.585 0.558754    
## factor(id)99396  0.6682148  0.2631717   2.539 0.011126 *  
## factor(id)99423 -0.3184972  0.2577820  -1.236 0.216657    
## factor(id)99477 -0.3349972  0.2576502  -1.300 0.193556    
## factor(id)99513 -0.1729115  0.2576466  -0.671 0.502157    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## 
## Residual standard error: 0.5151 on 12682 degrees of freedom
## Multiple R-squared:  0.898,  Adjusted R-squared:  0.8834 
## F-statistic: 61.32 on 1821 and 12682 DF,  p-value: < 2.2e-16

Heteroskedasticity

  # load necessary packages for importing the function
  library(RCurl)
  
  # import the function from repository
  url_robust <- "https://raw.githubusercontent.com/IsidoreBeautrelet/economictheoryblog/master/robust_summary.R"
  eval(parse(text = getURL(url_robust, ssl.verifypeer = FALSE)),
       envir=.GlobalEnv)
  
  r_hetero<-lm(wage ~ educatsf*exper, wage1)
  summary(r_hetero)  
  r_hetero<-lm(wage ~ educatsf*exper, wage1)
  summary(r_hetero, robust=T)