Example L7 Binary response (survival) model (filled and lapsed)

Example L7 Binary response (survival) model (filled and lapsed)

These examples are from a study that provides the first estimates of the determinants of employer search in the UK using duration modelling techniques. It involves modelling a job vacancy duration until either it is successfully filled or withdrawn from the market. For further detail see http://www.lancs.ac.uk/staff/ecasb/papers/vacdur_economica.pdf.

We treat the 'filled' and 'lapsed' datasets as if they were independent, both data sets have 390,432 binary observations (at the weekly level) on 12,840 vacancies. For the first risk ('filled') the final response for each vacancy is 1 at the point where the vacancy fills, and similarly for the ('lapsed') risk. At all other weeks the responses are zero. There are 7,234 filled vacancies and 5,606 lapsed vacancies.

For each type of risk we used a 26-piece non-parametric baseline hazard with 55 covariates.

Filled durations

The first few lines and columns of vac4-filled.dat look like

Sabre commands (filled analysis)

out filled.log

trace filled.trace

data ij provider vacnum dayrel appren inhouse sic0 sic1 sic2 sic3 sic4 &

sic5 sic6 sic7 sic8 sic9 censored td centre grade2 grade3 grade4 &

written noemps1 noemps2 noemps3 noemps4 year d n dn n1_d lnwd1_n &

lnwdn lnpopden lnrelstaff nonman skilled english maths eng_maths &

science othersub olderapp year2 year3 year4 year5 year6 year7 year8 &

month1 month2 month3 month4 month5 month6 month7 month8 month9 &

month10 month11 month12 j lnu18 lnvj y d_1 d_2 d_3 d_4 d_5 d_6 d_7 &

d_8 d_9 d_10 d_11 d_12 d_13 d_14 d_15 d_16 d_17 d_18 d_19 d_20 d_21 &

d_22 d_23 d_24 d_25 d_26 type

read /scratch/hpc/22/stott/vac4-filled.dat

case vacnum

yvar y

fit d_1 d_2 d_3 d_4 d_5 d_6 d_7 d_8 d_9 d_10 d_11 d_12 d_13 d_14 d_15 d_16 &

d_17 d_18 d_19 d_20 d_21 d_22 d_23 d_24 d_25 d_26 noemps2 noemps3 &

noemps4 sic0 sic1 sic2 sic3 sic4 sic5 sic7 sic8 sic9 centre provider &

lnwd1_n dn lnwdn n1_d nonman skilled inhouse dayrel appren grade2 &

grade3 grade4 english maths eng_maths science othersub olderapp &

written lnu18 lnvj lnpopden lnrelstaff year2 year3 year4 year5 year6 &

year7 year8 month1 month2 month3 month4 month6 month7 month8 month9 &

month10 month11 month12

dis m

dis e

stop

Sabre log file

<S> trace filled.trace

<S> data ij provider vacnum dayrel appren inhouse sic0 sic1 sic2 sic3 sic4 &

<S> sic5 sic6 sic7 sic8 sic9 censored td centre grade2 grade3 grade4 &

<S> written noemps1 noemps2 noemps3 noemps4 year d n dn n1_d lnwd1_n &

<S> lnwdn lnpopden lnrelstaff nonman skilled english maths eng_maths &

<S> science othersub olderapp year2 year3 year4 year5 year6 year7 year8 &

<S> month1 month2 month3 month4 month5 month6 month7 month8 month9 &

<S> month10 month11 month12 j lnu18 lnvj y d_1 d_2 d_3 d_4 d_5 d_6 d_7 &

<S> d_8 d_9 d_10 d_11 d_12 d_13 d_14 d_15 d_16 d_17 d_18 d_19 d_20 d_21 &

<S> d_22 d_23 d_24 d_25 d_26 type

<S> read /scratch/hpc/22/stott/vac4-filled.dat

390432 observations in dataset

<S> case vacnum

<S> yvar y

<S> link c

<S> fit d_1 d_2 d_3 d_4 d_5 d_6 d_7 d_8 d_9 d_10 d_11 d_12 d_13 d_14 d_15 d_16 &

<S> d_17 d_18 d_19 d_20 d_21 d_22 d_23 d_24 d_25 d_26 noemps2 noemps3 &

<S> noemps4 sic0 sic1 sic2 sic3 sic4 sic5 sic7 sic8 sic9 centre provider &

<S> lnwd1_n dn lnwdn n1_d nonman skilled inhouse dayrel appren grade2 &

<S> grade3 grade4 english maths eng_maths science othersub olderapp &

<S> written lnu18 lnvj lnpopden lnrelstaff year2 year3 year4 year5 year6 &

<S> year7 year8 month1 month2 month3 month4 month6 month7 month8 month9 &

<S> month10 month11 month12

Initial Homogeneous Fit:

Iteration Log. lik. Difference

__________________________________________

1 -386516.06

2 -84780.650 0.3017E+06

3 -45785.228 0.3900E+05

4 -35969.984 9815.

5 -33826.874 2143.

6 -33489.729 337.1

7 -33465.995 23.73

8 -33465.694 0.3004

9 -33465.694 0.1636E-03

10 -33465.694 0.1433E-08

Iteration Log. lik. Step End-points Orthogonality

length 0 1 criterion

________________________________________________________________________

1 -33757.916 1.0000 fixed fixed 67.679

2 -33711.882 0.5000 fixed fixed 15.600

3 -33495.120 1.0000 fixed fixed 6.5731

4 -33481.845 1.0000 fixed fixed 4.8202

5 -33469.033 0.5000 fixed fixed 1130.8

6 -33430.503 1.0000 fixed fixed 7.3092

7 -33424.272 1.0000 fixed fixed 2.7345

8 -33424.160 1.0000 fixed fixed 1.9924

9 -33424.160 1.0000 fixed fixed 2.1109

10 -33424.160 1.0000 fixed fixed

<S> dis m

X-vars Y-var Case-var

________________________________________________

d_1 y vacnum

d_2

d_3

d_4

d_5

d_6

d_7

d_8

d_9

d_10

d_11

d_12

d_13

d_14

d_15

d_16

d_17

d_18

d_19

d_20

d_21

d_22

d_23

d_24

d_25

d_26

noemps2

noemps3

noemps4

sic0

sic1

sic2

sic3

sic4

sic5

sic7

sic8

sic9

centre

provider

lnwd1_n

lnwdn

n1_d

nonman

skilled

inhouse

dayrel

appren

grade2

grade3

grade4

english

maths

eng_maths

science

othersub

olderapp

written

lnu18

lnvj

lnpopden

lnrelstaff

year2

year3

year4

year5

year6

year7

year8

month1

month2

month3

month4

month6

month7

month8

month9

month10

month11

month12

Univariate model

Standard complementary log-log

Gaussian random effects

Number of observations = 390432

Number of cases = 12840

X-var df = 81

Scale df = 1

Log likelihood = -33424.160 on 390350 residual degrees of freedom

<S> dis e

Parameter Estimate Std. Err.

___________________________________________________

d_1 -6.4338 0.51637

d_2 -7.0011 0.50937

d_3 -7.7040 0.50843

d_4 -7.6598 0.50658

d_5 -7.5495 0.50456

d_6 -7.4617 0.50267

d_7 -7.1142 0.49965

d_8 -6.8503 0.49690

d_9 -7.1359 0.49626

d_10 -7.3896 0.49655

d_11 -7.2214 0.49481

d_12 -7.1999 0.49399

d_13 -7.1767 0.49322

d_14 -7.0299 0.49177

d_15 -7.0685 0.48377

d_16 -7.0656 0.48028

d_17 -7.1705 0.47878

d_18 -7.2494 0.47836

d_19 -7.4207 0.47943

d_20 -7.5001 0.48069

d_21 -7.5973 0.47503

d_22 -7.6094 0.47796

d_23 -7.6917 0.48535

d_24 -7.8672 0.50320

d_25 -7.7771 0.51840

d_26 -7.3596 0.49844

noemps2 0.70217E-01 0.41816E-01

noemps3 0.15315 0.50666E-01

noemps4 0.18331 0.59021E-01

sic0 -0.34010 0.14881

sic1 -0.27980 0.31320

sic2 0.11162 0.14420

sic3 0.10681 0.55326E-01

sic4 -0.37340E-01 0.48817E-01

sic5 0.17095 0.68950E-01

sic7 0.10590 0.13050

sic8 0.15159 0.62793E-01

sic9 -0.85747E-02 0.56799E-01

centre 0.27273 0.37251E-01

provider -0.14480 0.36248E-01

lnwd1_n 0.36398E-01 0.73249E-01

dn -0.28776 0.98936E-01

lnwdn 0.60535E-01 0.24654

n1_d 0.34671E-01 0.45849E-01

nonman -0.38460 0.58816E-01

skilled 0.14399 0.59189E-01

inhouse 0.89923E-02 0.69330E-01

dayrel -0.33592 0.59014E-01

appren -0.46354 0.78031E-01

grade2 -0.21159 0.44140E-01

grade3 -0.39894 0.62896E-01

grade4 -0.55862 0.84984E-01

english -0.11540E-01 0.79475E-01

maths 0.20110 0.10759

eng_maths -0.10601E-01 0.10886

science -0.27547E-01 0.83063E-01

othersub 0.21354E-01 0.10592

olderapp -0.36379 0.46444E-01

written -1.0805 0.68038E-01

lnu18 0.28837 0.32527E-01

lnvj 0.49958E-01 0.24144E-01

lnpopden 0.10854E-01 0.25346E-01

lnrelstaff -0.18725 0.44184E-01

year2 0.15567E-01 0.99046E-01

year3 -0.49198E-02 0.99675E-01

year4 0.97943E-01 0.10327

year5 0.24163 0.11629

year6 0.37347 0.11839

year7 0.63728 0.11703

year8 0.54556 0.13589

month1 0.38008 0.78627E-01

month2 -0.25102E-01 0.78237E-01

month3 -0.62243E-01 0.74242E-01

month4 -0.44664E-01 0.73326E-01

month6 0.40476 0.72406E-01

month7 0.35940 0.79140E-01

month8 0.30456 0.74459E-01

month9 0.25623 0.73212E-01

month10 0.43678 0.76507E-01

month11 0.35861 0.82962E-01

month12 0.23984 0.99498E-01

scale 0.94838 0.95319E-01

<S> stop

Lapsed durations

The first few lines and columns of vac4-lapsed.dat look like

Sabre commands (lapsed)

out lapsed.log

trace lapsed.trace