We read with interest the recent study by Kwon et al. (1) examining the long-term effects of metformin use on mortality and incident end-stage kidney disease among 10,426 patients with type 2 diabetic kidney disease. The authors report that metformin use decreased the risk of all-cause mortality by 35% and end-stage renal disease progression by 33% after applying propensity score matching to adjust for a number of measured confounders.

We are concerned by the possible influence of immortal time bias on the study results. Immortal time arises when patients are classified into treatment groups at baseline based on treatment information that is only available after baseline (2). Since the treatment group is based on future information, by definition no deaths can occur in the treatment group between baseline and this future point in time. After all, individuals who have an event prior to taking up treatment would be classified into the untreated group. In this study, follow-up started on the date of the first creatinine measurement, but patients were classified as metformin users if they were prescribed metformin for longer than 90 days during the follow-up period (1). Such exposure classification may lead to an unfair survival advantage for the metformin users. For example, if all individuals in the metformin group started metformin treatment only after 5 years of follow-up, no deaths would occur in the metformin group during the first 5 years. The metformin group would thus be “immortal” for this time period. Due to the long-term follow-up of this study (maximum follow-up was 16 years), immortal time may have substantially biased the study results.

Immortal time bias could have been prevented by correctly assigning the person-time between start of follow-up and treatment initiation to the untreated group, e.g., by using a Cox model with a time-varying exposure (2). Individuals will then contribute person-time to the unexposed group before metformin initiation and to the exposed group after metformin initiation. When using a time-dependent exposure, time-dependent confounding will also be present. If these time-dependent confounders play the role of both confounder and mediator, simply adjusting for them in a regression model will produce biased results. For example, HbA1c is influenced by prior metformin treatment status but also influences future metformin treatment status. Therefore, HbA1c will both confound and mediate the effect of metformin on mortality and a straightforward time-dependent Cox analysis may not suffice in this case (3). Instead, methods such as marginal structural models based on inverse probability weighting should be applied (3). Other methods that could have been used to avoid immortal time bias include landmarking (4) or the use of grace periods (5).

In conclusion, we feel the possibility of immortal time bias casts serious doubt on the validity of the results. Observational pharmacoepidemiologic studies must be designed and analyzed properly. Only then can the results of these studies meaningfully inform clinical practice.

Duality of Interest. No potential conflicts of interest relevant to this article were reported.

1.
Kwon
S
,
Kim
YC
,
Park
JY
, et al
.
The long-term effects of metformin on patients with type 2 diabetic kidney disease
.
Diabetes Care
2020
;
43
:
948
955
2.
Suissa
S
.
Immortal time bias in pharmaco-epidemiology
.
Am J Epidemiol
2008
;
167
:
492
499
3.
Mansournia
MA
,
Etminan
M
,
Danaei
G
,
Kaufman
JS
,
Collins
G
.
Handling time varying confounding in observational research
.
BMJ
2017
;
359
:
j4587
4.
Dafni
U
.
Landmark analysis at the 25-year landmark point
.
Circ Cardiovasc Qual Outcomes
2011
;
4
:
363
371
5.
Maringe
C
,
Benitez Majano
S
,
Exarchakou
A
, et al
.
Reflections on modern methods: trial emulation in the presence of immortal-time bias. Assessing the benefit of major surgery for elderly lung cancer patients using observational data
.
Int J Epidemiol
,
Readers may use this article as long as the work is properly cited, the use is educational and not for profit, and the work is not altered. More information is available at https://www.diabetesjournals.org/content/license.