Stem estimates hierarchical spatio-temporal models of
the form
\[ z_t = X_t \beta + A y_t + e_t, \qquad e_t \sim N(0, \Sigma_e), \] \[ y_t = G y_{t-1} + \eta_t, \qquad \eta_t \sim N(0, \Sigma_\eta), \qquad y_0 \sim N(m_0, C_0), \]
for \(t = 1, \dots, T\). The observation vector \(z_t\) collects the measurements at \(d\) spatial locations; \(y_t\) is a \(p\)-dimensional latent temporal process shared by the network and loaded on the locations through the \(d \times p\) matrix \(A\); \(X_t\) holds \(r\) known covariates. The spatial covariance is
\[ \Sigma_e = \sigma^2_\varepsilon I + \sigma^2_\omega C(h; \theta), \qquad C(h; \theta) = \exp(-\theta h), \]
so that \(\sigma^2_\varepsilon\) is a nugget and \(\sigma^2_\omega\) the variance of the spatially correlated component. The parameter vector is \(\phi = (\beta, \sigma^2_\varepsilon, \sigma^2_\omega, \theta, G, \Sigma_\eta, m_0)\), estimated by maximum likelihood through Kalman filtering and smoothing inside an EM algorithm, with \(C_0\) held fixed.
The package ships two datasets. pm10 is the small
example of Fasso and Cameletti: 22 stations and 366 days of log PM10,
with emissions and altitude as covariates. povalley is a
larger, real network of 36 background stations in the Po Valley observed
daily over 2019–2023.
data(pm10)
str(pm10, max.level = 1)
#> List of 3
#> $ coords : num [1:22, 1:2] 423 470 437 395 444 ...
#> ..- attr(*, "dimnames")=List of 2
#> $ covariates: num [1:8052, 1:3] 1 1 1 1 1 1 1 1 1 1 ...
#> ..- attr(*, "dimnames")=List of 2
#> $ z : num [1:366, 1:22] 3.33 2.94 3.4 3.58 3.74 ...
#> ..- attr(*, "dimnames")=List of 2
coordinates <- pm10$coords * 1000 # from km to meters
covariates <- pm10$covariates
z <- pm10$z
dim(z) # T x d
#> [1] 366 22
dim(covariates) # (T * d) x r
#> [1] 8052 3The covariate matrix stacks the \(T \times r\) block of each station on top of the next: rows \(1, \dots, T\) belong to the first station, rows \(T+1, \dots, 2T\) to the second, and so on. Keeping this convention is essential, because every routine of the package relies on it to slice the data by location.
STEM_Model() assembles the data and the starting values
into an object of class STEM_Model. The starting values are
supplied through the list phi, which must have exactly the
components of the parameter vector.
phi <- list(
beta = matrix(c(3.65, 0.046, -0.904), 3, 1),
sigma2eps = 0.1,
sigma2omega = 0.2,
theta = 0.01,
G = matrix(0.77, 1, 1),
Sigmaeta = matrix(0.3, 1, 1),
m0 = as.matrix(0),
C0 = as.matrix(1)
)
A <- matrix(1, ncol(z), 1) # a single latent process, loaded on every station
mod <- STEM_Model(
z = z,
covariates = covariates,
coordinates = coordinates,
phi = phi,
A = A
)
class(mod)
#> [1] "STEM_Model"STEM_Estimation() runs the EM algorithm on the
state-space form of the model (the Kalman filter and smoother make the
E-step), accelerated by default by SQUAREM;
STEM_control(algorithm = ) chooses among EM, ECME, SQUAREM
and SQUAREM on ECME, which reach the same maximum. The iterations stop
when the largest relative change of a parameter or the absolute change
of the log-likelihood falls below its tolerance, 1e-3 by
default; precision, used below to keep the example short,
replaces the first. Progress messages are off by default and can be
turned on with verbose = TRUE.
fit <- STEM_Estimation(mod, precision = 0.01, distance = "euclidean")
round(unlist(fit$estimates$phi.hat), 5)
#> sigma2omega beta1 beta2 beta3 G Sigmaeta
#> 0.08451 5.22138 0.00273 -0.92158 0.98609 0.06749
#> m0 C0 theta sigma2eps
#> -1.59211 1.00000 0.00002 0.08090
fit$estimates$loglik
#> [1] -3829.113
fit$estimates$convergence.par[c("conv.log", "conv.par", "iterEM")]
#> $conv.log
#> [1] FALSE
#>
#> $conv.par
#> [1] TRUE
#>
#> $iterEM
#> [1] 21Use distance = "geo" when the coordinates are longitude
and latitude, as in povalley; the geodesic distance is then
computed with geodist.
The smoothed latent process is returned as a ts
object:
The EM algorithm returns point estimates but no standard errors.
STEM_Bootstrap() simulates B datasets from the
fitted model and re-estimates the parameters on each of them.
boot <- STEM_Bootstrap(fit, B = 100, distance = "euclidean")
npar <- 9
boot.estimates <- t(vapply(boot$boot.output, function(b) {
p <- b$estimates$phi.hat
c(p$beta, p$sigma2eps, p$sigma2omega, p$theta, p$G, p$Sigmaeta, p$m0)
}, numeric(npar)))
se <- sqrt(diag(stats::var(stats::na.omit(boot.estimates))))
round(se, 5)STEM_Kriging() predicts the process at unobserved
locations, given their coordinates, covariates and loading matrix.
The second vignette, Spatially-clustered STEM models, shows what to do when a single global regression is not plausible over the whole network, and the coefficients themselves should be allowed to vary across spatial regimes:
A conceptual map of how the functions call one another is the third vignette:
Fasso, A., Cameletti, M. and Nicolis, O. (2007). Air quality monitoring using heterogeneous networks. Environmetrics, 18, 245–264.
Fasso, A. and Cameletti, M. (2010). A unified statistical approach for simulation, modeling, analysis and mapping of environmental data. Simulation, 86, 139–153.