How to deal with crossed and nested factors at the same time in a linear mixed model?

Question

I've recently started analysing the data for a project using linear mixed models but am not sure how to deal with crossed and nested factors at the same time.

In my study, each participant reported two events (Event A: a negative personal experience they had & Event B: a negative news story they learnt from the media). In other words, each participant reported two negative events that had happened already, so there won't be cases wherein a participant shared an event that did not happen. Also, these events were independent of each other.

After 24 hours, we asked participants whether they discussed each event with someone else (Status: shared or not shared). A participant can have discussed Event A but not Event B (or vice versa), both events, or neither of the events.

EDIT 1: Then, we asked them to rate how much they thought their feelings about each event had changed during the 24 hours. In other words, each participant provided 2 ratings, one per event.

The dependent variable (DV) is perceived emotional change. I want to test:

1. whether there's a main effect of Event on the DV
2. whether there's a main effect of Status on the DV
3. whether there's an interaction between Event and Status on the DV (e.g., let's say sharing leads to greater emotional change than not sharing, but this difference may be significant only in the case of Event A but not B)

I initially structured the model in this way in Python:

smf.mixedlm("affect_change ~ Event*Status", data, groups=data["participant"]).fit()

Or, in the R version: affect change ~ Event * Status + (1 | participant)

However, I realised that my study design is probably crossed and nested: Each level of Event (A, B) occurs with each level of Participant (that is, every participant reported both events), hence crossed. However, each level of Status (Shared, Not Shared) occurs with only either level of Event (that is, Event A was either shared or not shared, and same was Event B), hence nested.

Is my model structured correctly such that it reflects my study design and is able to test my predictions?

---

EDIT 2: I have another variable, happiness, that I measured before the 24-hour period and after it for each event. To be more specific, we asked participants to rate how happy they were about each event right after they reported it and asked again after they indicated whether they shared each event.

How should I account for the additional effect of Time? That is, besides the effects of Event and Status (and possibly their interaction), I also want to check for the effect of Time (and if it interacts with the other two predictors) on happiness.

Thank you for reading my question.

Answer 1

If I understand correctly, Event represents the type of event identified to the investigator (personal versus news story, independent of the particular nature of the event beyond that) and Status is whether an Event was shared by discussing with someone else during a 24-hour period. The outcome is a self-assessment of emotional change in the 24 hours after the initial reporting of the events to the investigator.

You want to model this with fixed effects for Event, Status, and an Event:Status interaction, and a random effect for Participant.

First, there only seems to be a single outcome value for each participant. If that's the case, I don't see what the Participant random effect provides (or if it's even identifiable). That might be different if you had recorded some measure of emotional status prior to and after the study and included both measures for each participant somehow, but that doesn't seem to be what you did if all you have is a change in emotional status.

Second, what you have is simply 4 mutually exclusive sharing situations: neither event shared, only event type A shared, only event type B shared, both event types shared. A way to capture that more directly than your proposed model is to use A-shared and B-shared as two binary predictors, plus an interaction term between them. That will accomplish what you want, as you have a 0/1 no/yes result for each of those individual predictors for all participants.

If "no sharing" is the reference level for each of A-shared and B-shared, the intercept in regression would be the outcome when there was no sharing. The coefficient for A-shared would be the difference from no sharing when A is shared and B isn't; the coefficient for B-shared is similarly the difference from no sharing when B is shared and A isn't. The coefficient for the interaction is the extra difference when both are shared versus what you would predict when each was shared in the absence of the other being shared.

You can then use those coefficient estimates to evaluate your hypotheses. The interaction coefficient directly evaluates whether the effect of A-shared depends on whether there was also B-shared (and vice-versa). The individual coefficients for A-shared and B-shared determine whether either affects outcome (over no sharing) if the other wasn't shared. You can evaluate whether sharing matters at all by testing whether any of the regression coefficients involving sharing differs from 0.

Remember, however: when there is an interaction between two predictors there might no longer be a well-defined "main effect" for either of them. If the effect of one depends on the value of the other, what do you then mean by an individual "main effect"?

One further warning: this study might not be interpretable in the way that you hope, regardless of statistical modeling. Might the choice of sharing either type of event have been driven by an underlying change in emotional status, rather than the reporting changing the emotional status? I don't see a way around that problem.

In response to updated question:

With one outcome for each event type, you can still use a standard linear model, but with a 2-valued multivariate outcome. Each outcome is modeled against the same set of covariates, but the correlations among outcomes can be taken into account. So again you wouldn't have to specify random effects.

If you have measurements of pre-experiment emotional measures for both events, then it would be best to use the actual post-experiment measures as the outcomes, rather than the changes in measures, and to use the pre-experiment measures as predictors. That will still fit into the multivariate regression framework. This page and others inked from there discuss the dangers in using change scores as outcomes. As there are only 2 time points, one at the start and one at the end of the 24-hour experiment, there is no way to distinguish the effect of time from the effect of sharing/not, so there's nothing else you can model.