Comparative effectiveness research methods are used to compare the effect of four distinct glucose-control strategies on subsequent myocardial infarction and nephropathy in type 2 diabetes.
A total of 58,000 adults with type 2 diabetes and A1C <7% (53 mmol/mol) while taking two or more oral agents or basal insulin had subsequent A1C ≥7% (53 mmol/mol) to 8.5% (69 mmol/mol). Follow-up started on date of first A1C ≥7% and ended on date of a specific clinical event, death, disenrollment, or study end. Glucose-control strategies were defined as first intensification of glucose-lowering therapy at A1C ≥7, ≥7.5, ≥8, or ≥8.5% with subsequent control for treatment adherence. Logistic marginal structural models were fitted to assess the discrete-time hazards for each dynamic glucose-control strategy, adjusting for baseline and time-dependent confounding and selection bias through inverse probability weighting.
After adjustment for age, sex, race/ethnicity, comorbidities, blood pressure, lipids, BMI, and other covariates, progressively more aggressive glucose-control strategies were associated with reduced onset or progression of albuminuria but not associated with significant reduction in occurrence of myocardial infarction or preserved renal function based on estimated glomerular filtration rate over 4 years of follow-up.
In a large representative cohort of adults with type 2 diabetes, more aggressive glucose-control strategies have mixed short-term effects on microvascular complications and do not reduce the myocardial infarction rate over 4 years of follow-up. These findings are consistent with the results of recent clinical trials, but confirmation over longer periods of observation is needed.
Adequate glucose control in patients with type 2 diabetes reduces the occurrence of common, devastating microvascular and macrovascular complications (1,2). However, results of recent randomized trials suggest that more aggressive treatment to achieve and maintain near-normal A1C levels may reduce microvascular complications (3–7) but not adverse cardiovascular events (3,8). The generalizability of these clinical trial results to the general population of adults with type 2 diabetes is uncertain. Enrollees in clinical trials differ from other patients with type 2 diabetes because they provide written informed consent and must meet stringent eligibility criteria related to age, comorbidity, disease severity, and other factors. Stringent criteria for trial participation increase confidence in the validity of research results while reducing the generalizability of results to “average” patients with type 2 diabetes receiving care in community-based practices.
In ACCORD (Action to Control Cardiovascular Risk in Diabetes) and ADVANCE (Action in Diabetes and Vascular disease: PreterAx and DiamicroN Controlled Evaluation), intensive treatment strategies using multiple classes of glucose-lowering agents reduced A1C to near-normal levels (3–5,8). However, neither trial significantly reduced rates of acute myocardial infarction (AMI) and, in ACCORD, those achieving near-normal glucose control (median achieved A1C 6.4% or 46 mmol/mol) had a significant 22% increase in total mortality relative to patients who achieved a median A1C of 7.5% or 58 mmol/mol (3,4,8). In the same studies, near-normal A1C control had mixed but generally positive effects on microvascular complications (6). Progression of retinopathy improved in ACCORD but not in ADVANCE. At 3.4 years of follow-up in ACCORD, intensive treatment reduced progression to microalbuminuria and macroalbuminuria but significantly increased doubling of serum creatinine and the proportion of subjects with ≥20 mL/min/1.72 m2 decrease in estimated glomerular filtration rate (eGFR)—although these undesired effects became nonsignificant by 5 years after randomization. In ADVANCE, both eGFR and progression of albuminuria were improved at 5 years. Our objective was to assess whether the findings of ACCORD and ADVANCE apply to average patients with type 2 diabetes in community-based primary care practices.
RESEARCH DESIGN AND METHODS
We designed this cohort study to assess how different glucose-control strategies affect key microvascular and macrovascular complications of type 2 diabetes in typical patients in community-based practices. We assessed the impact of four progressively more aggressive glucose-control strategies on AMI and two measures of renal status in type 2 diabetes to ascertain whether the results of ACCORD and ADVANCE apply to a broader patient population and assure patients and providers that efforts to achieve near-normal glucose control are safe and do not increase risks of adverse cardiovascular outcomes.
Study sites and subjects
This study was conducted in a cohort of adults with type 2 diabetes receiving care from one of seven HMO Research Network (HMORN) sites that developed a standard set of variables in a virtual data warehouse (VDW). VDW data were used to classify diabetes status based on diagnosis codes, diabetes-specific medications, and laboratory values consistent with a diabetes diagnosis (Table 1). We searched the entire adult membership of participating HMORN health plans for enrollees who met criteria for a diabetes diagnosis and had ≥2 years of enrollment and pharmacy coverage before cohort entry (with a ≤2 month coverage gap). Eligible subjects were enrolled on the earliest date between 1 January 2001 and 30 June 2009 on which criteria for cohort entry were met.
Patients were classified as having diabetes if, in a 12-month period, they had 1) one or more inpatient or two or more outpatient diabetes-related ICD-9 diagnostic codes (250.xx), 2) one or more filled prescriptions for a glucose-lowering medication listed in Table 1 (except metformin or a thiazolidinedione [TZD]), or 3) a filled prescription for metformin or a TZD plus one or more outpatient or inpatient diabetes code. Those with one or more codes for gestational diabetes mellitus were excluded from analysis. To be included, a person classified as having diabetes had to have one or more A1C values <7% (53 mmol/mol) while taking two or more oral agents or basal insulin followed by one or more A1C values 7–8.5% (69 mmol/mol). The requirement for oral agent or basal insulin therapy in the initial period ensured that most study subjects had type 2 diabetes because either drug alone is unsustainable therapy for type 1 diabetes. Pregnant women and those with active cancers other than nonmelanoma skin cancer, end-stage renal disease, hepatic failure, or pregnancy in the 15 months before cohort entry were excluded.
Data extraction and management
Once patients with diabetes were identified, more extensive data were extracted for each subject and consolidated in an analytic database at a single site. These data were carefully evaluated for plausibility, outlier values, and missing data by a team of programmers, statisticians, and clinicians with expertise in diabetes care. The unit of time chosen for the analysis was 90 days, and the VDW data were thus mapped into an analytic dataset in which not only the time-dependent covariates and the outcomes but also the pharmacotherapy exposures could change every 90 days during follow-up. Follow-up started on the date of the first A1C ≥7% (after one or more A1C <7% on requisite therapy) and ended on the date of a specific clinical event, death, disenrollment, or study end. Outcomes were assigned based on the date of the specific clinical event being analyzed, and separate analyses were done for AMI and the two renal outcomes.
Defining glucose treatment strategies
The principal focus of the analysis was the A1C level at which glucose-lowering therapy was intensified—not the specific medication used to intensify therapy (usually a TZD or prandial insulin). This project carefully assesses the impact of each of these strategies on subsequent occurrence of AMI and change in renal status to identify which strategy minimizes AMI or deterioration of renal status. These dynamic glucose-control strategies were each defined as follows: “Initiate an intensified treatment (a diabetes drug not used at study entry) the first time A1C reaches or drifts above X% and continue an intensified treatment (drug switching or additions were permitted) for four or more periods (~1 year), after which the intensified treatment may be interrupted.” Treatment strategies were defined by substituting one of four values (7% [53 mmol/mol], 7.5% [59 mmol/mol], 8% [64 mmol/mol], or 8.5% [69 mmol/mol]) for X in the previous definition.
Macrovascular and microvascular end points
We defined three major study end points: 1) The principal macrovascular end point was AMI, ascertained through a validated set of hospital discharge diagnoses, not including coronary revascularization (9–13). 2) The first principal microvascular end point was onset or progression of albuminuria based on urine albumin-to-creatinine ratio (UACR). Onset of albuminuria was defined as moving from a baseline UACR measurement <30 to a single follow-up UACR ≥30. Progression of albuminuria was defined as moving from a baseline UACR measurement of 30 to 300 to a single follow-up UACR measurement >300 (3). The second principal microvascular end point was defined as progressing or not progressing to a worse stage of renal function based on eGFR. For this end point, eGFR was calculated using the Modification of Diet in Renal Disease equation, which computes eGFR (in mL/min/1.72 m2) based on measured serum creatinine value and the subject’s age, sex, weight, and race at measurement. Following conventional definitions, renal function was classified as stage 1 chronic kidney disease when eGFR was ≥90 mL/min/1.72 m2, stage 2 for 60–89 mL/min/1.72 m2, stage 3a for 45–59 mL/min/1.72 m2, stage 3b for 30–44 mL/min/1.72 m2, stage 4 for 15–29 mL/min/1.72 m2, and stage 5 for <15 mL/min/1.72 m2. A change in stage was defined as movement from any lower-numbered stage at baseline to any higher-numbered stage based on a single follow-up eGFR measurement.
Analytic approach
Details of the motivation for and implementation of the marginal structural models (MSM) approach in this study have previously been published (14–18). In essence, MSM seeks to emulate an ideal randomized trial with perfect compliance with exposure interventions of interest and no loss to follow-up. MSM methodologies are well suited to investigate dynamic interventions such as changes in treatment made by physicians as a patient’s disease stage changes over time. Unlike standard analytic methods (e.g., propensity score matching and regression models), which aim to contrast the health effects of static treatment decisions, dynamic MSM permits comparison of competing clinical strategies—a feature especially relevant to diabetes care, which typically involves changes in treatment related to the patient’s evolving clinical course (19,20).
In this work, inverse probability weighting (IPW) estimation (21–23) was used to fit logistic dynamic MSM for the discrete-time hazards under the previously mentioned four dynamic therapy interventions. IPW estimates of these hazards were subsequently mapped into IPW estimates of the corresponding four survival curves. The effects of interest (i.e., comparison of the effectiveness of any two dynamic glucose-control strategies) were then based on contrasting (through risk differences and risk ratios) a cross-section of the IPW estimates of the survival curves at 4 years (i.e., based on contrasting estimates of the cumulative risks of failure within 4 years of study entry). Here, we report only risk differences. The Supplementary Data provide more detailed statistical descriptions of the specific modeling strategies (23).
RESULTS
Impact of treatment-intensification strategies on AMI
Of the 58,671 patients with type 2 diabetes in this analysis, 1,655 (2.82%) experienced an AMI during follow-up. Median follow-up was ~3.25 years, and median time to treatment intensification (TI) for the 24,127 patients (41.12%) who had ever initiated intensified treatment was ~1.5 years. Of the 859,077 observation units (patient-specific 3-month units), 64.35% were characterized by a history of TI concordant with treatment administered through one or more TI strategy of interest, and thus, 35.65% of all available person-time observations were excluded from analysis. An observation is said to be concordant with treatment administered through a TI strategy if the observation is from a patient whose TI history (before that observation) happens to match the treatment regimen he or she would have experienced had treatment decisions for this patient been made directly based on that TI strategy. The estimated cumulative risk differences at 4 years derived from the logistic MSM are given in Table 2. Table 3 shows that results did not change significantly when treatment strategies were defined to require continuous exposure after treatment initiation. Table 4 shows that results did not change significantly when using a more aggressive right-censoring strategy to minimize missing A1C data.
The entire AMI analysis was then repeated with stratification of subjects by age <65 or ≥65 years at entry to the cohort. While <3% of all subjects experienced an AMI during the median 3.25-year follow-up, many AMIs were included in the analysis: 1,100 AMIs in 22,633 adults age ≥65 years, with another 555 AMIs in 36,038 adults <65 years in the AMI analysis. The pattern of results did not change in either of these age strata.
These results demonstrate no statistically significant differences in AMI among the four TI strategies. However, there was a trend toward fewer AMIs when intensifying treatment at A1C ≥7% compared with ≥8.5% (P = 0.08) or A1C ≥8% compared with ≥8.5% (P = 0.05). Overall, though, no strong evidence suggests an effect, whether protective or deleterious, of more or less aggressive TI strategies on AMI.
Impact of TI strategies on eGFR
Of the 58,671 subjects with type 2 diabetes, 738 with missing baseline eGFR and 6 with baseline eGFR <15 mL/min/1.72 m2 were excluded. Of 57,927 subjects analyzed, 25,930 (44.76%) experienced decreased eGFR (based on movement to a lower stage of renal function). Median follow-up time was ~1.75 years, and median time to TI for the 16,405 patients (28.32%) who had ever initiated TI was ~1 year. Of the 556,594 observation units (patient-specific 3-month units), 71.2% had a history of TI concordant with treatment administered according to one or more TI strategy of interest, and thus, 28.8% of all available person-time observations were excluded from analysis. The estimated cumulative risk differences at 4 years derived from the logistic MSM are given in Table 2. Results did not change significantly when interventions were defined to require continuous exposure after treatment initiation (Table 3). Table 4 shows that results did not change significantly when a more aggressive right-censoring strategy was used to minimize missing eGFR and A1C data.
These results demonstrate that those who received more intensive glucose-lowering therapy when A1C was ≥7% had a significantly higher likelihood of decline in renal function than those treated when A1C was ≥8% (P = 0.04) or ≥8.5% (P = 0.03) but not compared with those treated when A1C was ≥7.5% (P = 0.18). These results suggest that more aggressive TI strategies may contribute to eGFR worsening over 4 years.
Impact of TI strategies on onset or progression of albuminuria
Of 58,671 subjects with type 2 diabetes, 5,884 patients with missing baseline UACR and 1,608 patients with baseline macroalbuminuria were excluded. Of 51,179 subjects with type 2 diabetes analyzed, 12,085 (23.61%) experienced onset or progression of albuminuria. The median follow-up time was ~2.5 years, and the median time to TI for the 17,581 patients (34.35%) who had ever initiated TI was ~1.25 years. Of the 623,063 observation units (patient-specific 3-month units), 67.88% had a history of TI concordant with treatment administered according to one or more of the four TI strategies of interest, and thus, 32.12% of all available person-time observations were excluded from analysis. The estimated cumulative risk differences at 4 years derived from the logistic MSM are given in Table 2. Table 3 shows that results did not change significantly when interventions were defined to require continuous exposure after treatment initiation. Table 4 shows that results did not change significantly when using a more aggressive right-censoring strategy to minimize missing UACR and A1C data.
These results demonstrate that those treated when A1C was ≥7% (P = 0.02), ≥7.5% (P = 0.04), or ≥8% (P = 0.01) all had significantly lower likelihood of onset or progression of albuminuria than those treated when A1C was ≥8.5%. However, there were no significant advantages related to 1) treatment at A1C ≥7% compared with A1C ≥7.5% (P = 0.35), 2) treating at A1C ≥7.5% vs. ≥8% (P = 0.73), or 3) treatment at A1C ≥7% compared with ≥8% (P = 0.27). Overall, though, the results suggest a protective effect of more versus less aggressive TI strategies on onset or progression of albuminuria over 4 years.
CONCLUSIONS
Our AMI analysis showed that more intensive glucose-control strategies did not significantly reduce or increase rates of AMI. These results are quite consistent with the macrovascular results of ACCORD and ADVANCE, neither of which showed a significant decrease or increase in AMI during their 3.1- and 5.0-year respective studies (3,4,8). While <3% of all subjects in our study experienced an AMI, a stratified analysis of the 22,633 adults ≥65 years of age who had 1,100 AMIs showed the same results as the overall AMI analysis. However, studies that include larger numbers and longer follow-up periods may help answer this important clinical question.
With regard to microvascular complications, our data show that more aggressive treatment strategies were associated with reduced onset and progression of albuminuria but also with accelerated deterioration of eGFR. Substantial data from the UK Prospective Diabetes Study (UKPDS), ADVANCE, and ACCORD support the hypothesis that, in general, those with type 2 diabetes who receive treatment to lower A1C levels may have lower rates of onset and progression of albuminuria—a result that our data support (6,7,24). The negative association of more intensive glucose-control strategies with eGFR was also noted in ACCORD at 3.1 years but diminished in magnitude over a longer follow-up, which was also suggested by the survival curves in this study (data not shown) (6). This association may be due to renal hyperfiltration and may not reflect deterioration in renal function. Moreover, we included progression from stage 1 to stage 2 chronic kidney disease as deterioration, and serial eGFR measures may vary considerably in this range. Overall, the effect of more intensive glucose-control strategies on measures of renal status obtained in this comparative effectiveness research analysis is consistent with the results of ACCORD and ADVANCE, supporting the notion that the microvascular results of those studies may apply to a broad group of adults with diabetes.
An innovative aspect of this analysis is our use of dynamic MSM, an analytic approach that permits, under explicit assumptions, proper adjustment for time-dependent confounders on the causal pathway between early exposures and the outcome and enables proper adjustment for selection bias due to informative censoring. Both time-dependent confounding and selection bias raise significant concerns about the validity of traditional assessments of the effectiveness and safety of multiple treatment strategies for clinical domains such as glucose control based on standard analytic approaches with observational data (15,21–23).
Other strengths and limitations of our approach should be considered. First, although subjects were selected from a limited number of medical groups, they are likely more representative of the overall U.S. population of patients with type 2 diabetes than are the smaller number of very highly selected patients in ACCORD or ADVANCE. Second, although observational study designs preclude causal inference, our use of sophisticated analytic approaches to adjust for confounding and right-censoring improves confidence in the results over standard analytic methods that deal less directly with time-dependent confounding or selection bias (23,25). Third, because the effect of glucose control on diabetes complications may be related to length of follow-up, longer follow-up could change the results. Fourth, we used standard, clinically plausible methods to impute missing data but found similar results in analyses that censored patients at the time of missing data (Table 4). Finally, we could not model mortality because of the time lag in obtaining state and national mortality data.
In summary, these results confirm those of recent trials, including ACCORD and ADVANCE, and suggest that they may apply to a wider range of type 2 diabetic patients than those who met relatively narrow ACCORD or ADVANCE eligibility criteria. Moreover, the results support the potential for MSM analytic approaches to emulate (with observational data) inferences obtained through large, lengthy, and expensive randomized trials. This is an important observation because many questions that could be addressed using similar analytic methods in large databases are difficult to address in randomized trials because of cost constraints or design complexity. Additional gaps in knowledge that could be addressed using such comparative effectiveness research methods include 1) the relative safety of various classes of diabetes-related medications, 2) the safety of particular medications in the same class, and 3) identification of optimal targets for A1C, blood pressure, or lipid control in subgroups of patients with diabetes.
Acknowledgments
This project was funded under contract no. HHSA290-2005-0033I from the Agency for Healthcare Research and Quality, U.S. Department of Health and Human Services, as part of the Developing Evidence to Inform Decisions about Effectiveness (DEcIDE) program.
The authors of this report are responsible for its content. Statements in the report should not be construed as endorsement by the Agency for Healthcare Research and Quality or the U.S. Department of Health and Human Services.
No potential conflicts of interest relevant to this article were reported.
R.N. did the analysis, interpreted data, and wrote the draft of the manuscript. B.F. and J.A.R. provided statistical analytic support and interpreted data. P.J.O. obtained funding, interpreted data, and wrote and edited the manuscript. R.N. and P.J.O. are the guarantors of this work and, as such, had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.