OBJECTIVE

Meals are a major hurdle to glycemic control in type 1 diabetes (T1D). Our objective was to test a fully automated closed-loop control (CLC) system in the absence of announcement of carbohydrate ingestion among adolescents with T1D, who are known to commonly omit meal announcement.

RESEARCH DESIGN AND METHODS

Eighteen adolescents with T1D (age 15.6 ± 1.7 years; HbA1c 7.4 ± 1.5%; 9 females/9 males) participated in a randomized crossover clinical trial comparing our legacy hybrid CLC system (Unified Safety System Virginia [USS]-Virginia) with a novel fully automated CLC system (RocketAP) during two 46-h supervised admissions (each with one announced and one unannounced dinner), following 2 weeks of data collection. Primary outcome was the percentage time-in-range 70–180 mg/dL (TIR) following the unannounced meal, with secondary outcomes related to additional continuous glucose monitoring-based metrics.

RESULTS

Both TIR and time-in-tight-range 70–140 mg/dL (TTR) were significantly higher using RocketAP than using USS-Virginia during the 6 h following the unannounced meal (83% [interquartile range 64–93] vs. 53% [40–71]; P = 0.004 and 49% [41–59] vs. 27% [22–36]; P = 0.002, respectively), primarily driven by reduced time-above-range (TAR >180 mg/dL: 17% [1.3–34] vs. 47% [28–60]), with no increase in time-below-range (TBR <70 mg/dL: 0% median for both). RocketAP also improved control following the announced meal (mean difference TBR: −0.7%, TIR: +7%, TTR: +6%), overall (TIR: +5%, TAR: −5%, TTR: +8%), and overnight (TIR: +7%, TTR: +19%, TAR: −5%). RocketAP delivered less insulin overall (78 ± 23 units vs. 85 ± 20 units, P = 0.01).

CONCLUSIONS

A new fully automated CLC system with automatic prandial dosing was proven to be safe and feasible and outperformed our legacy USS-Virginia in an adolescent population with and without meal announcement.

Closed-loop control (CLC) systems for insulin management in individuals with type 1 diabetes (T1D) have provided improved time-in-target-range (TIR) and lower HbA1c (15). These “artificial pancreas” (AP) systems use data from continuous glucose monitoring (CGM) devices and the user’s insulin sensitivity to inform complex algorithms that determine the on-going need for insulin, which is then delivered by continuous subcutaneous insulin infusion pumps. These systems thus achieve automated insulin delivery, with a goal to maintain blood glucose (BG) in a desirable range. However, while CLC systems perform very well at managing glycemia in the absence of prandial glucose excursions (such as overnight), it has been difficult to prevent prolonged hyperglycemia following consumption of carbohydrates that are not announced to the system (and bolused for) (6). This is partly because CLC systems experience inherent delays in CGM sensing of rising prandial glucose levels and in the initiation of insulin action following its infusion, while closed-loop algorithms must also avoid hypoglycemia from overaggressive insulin administration. Because of these considerations, all current commercially available CLC systems (1,2,79) are actually hybrid closed-loop (HCL) systems that require the user to enter the quantity of carbohydrate ingested, receiving a prandial insulin-to-carbohydrate ratio to avoid significant hyperglycemia.

Unfortunately, it is common for individuals with T1D to omit bolusing for carbohydrates. This affects 65% of adolescents at least once weekly (10), with 38% missing at least 15% of their boluses (11). Adolescents who miss four boluses weekly experience an increase of 1% in their HbA1c (10), which may contribute to the large number of adolescents who fail to meet recommendations for HbA1c levels (12).

A key obstacle for developing fully closed-loop (FCL) systems that can automate adequate insulin delivery in response to unannounced carbohydrate is the need to detect BG excursions that identify that a meal ingestion has occurred. For the current study, we developed a bolus priming system (BPS) that is tuned to changes in CGM glucose patterns corresponding to theoretical probabilities that an unannounced meal has been consumed. The system is designed to respond to these probable meals by providing a priming dose of insulin intended to prevent significant BG elevation before the CLC system can provide additional corrective insulin. This system is embedded in a model-predictive control (MPC) system called RocketAP (RCKT) that continually predicts future glycemia and calculates optimal insulin doses to maintain the user in a desired glucose target.

The primary objective of this study was to assess the safety and efficacy of the automatic BPS in RCKT and compare the glycemic performance, with and without meal announcement in RCKT, with our legacy AP control system, the Unified Safety System Virginia (USS) system (1,2,13). We hypothesized that RCKT with the BPS would be safe and would increase glucose TIR compared with USS in the absence of carbohydrate announcement. We tested these hypotheses among adolescents, the age-group of individuals with T1D who arguably stand to benefit the most from this type of improvement in diabetes care (12).

The University of Virginia Institutional Review Board and the U.S. Food and Drug Administration (IDE#G200206) approved this randomized controlled clinical trial (ClinicalTrials.gov NCT04545567). Written informed consent was obtained from at least one parent and written assent was obtained from each adolescent participant. Twenty-one subjects aged 12–20 years were recruited to participate in a 5-night hotel-based study, described further below. Inclusion criteria consisted of a documented diagnosis of T1D and insulin pump therapy for ≥6 months. Exclusion criteria included diabetic ketoacidosis or a severe hypoglycemic event (defined as seizure or loss of consciousness) in the past 6 months, use of an oral glucose-lowering agent, including metformin, any medical condition deemed high-risk by the investigator, or recent exposure to someone known to be infected with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2).

The study design is outlined in Fig. 1. Enrollment visits were performed via phone or secure internet video connection, and medical history and insulin use parameters were obtained. Documentation of a physical examination by a medical professional within the prior year were reviewed. For female participants, a urine pregnancy test was sent to the family and documentation of negative result was confirmed. Subjects and their parents received training on the Dexcom G6 CGM (Dexcom, San Diego, CA) as needed. Subjects were randomized 1:1 using a block design to begin on USS or RCKT. A pediatric endocrinologist reviewed each participant’s home insulin pump parameters at the time of enrollment and made adjustments with the family as needed. All participants provided at least 14 days of Dexcom G6 sensor data and insulin records from home use to individualize the RCKT system.

Figure 1

Study design. During the 5-night study, participants were randomly assigned to start the study on either the USS Virginia or RocketAP system, which were then switched on day 4. Four 23-h periods were compared, with each system being tested for glycemic performance following when the dinner carbohydrate (CHO) content was announced (A) or unannounced (UA). On the final day of the study, participants were discharged to home before lunch, thus the carbohydrate announcement was not applicable (NA).

Figure 1

Study design. During the 5-night study, participants were randomly assigned to start the study on either the USS Virginia or RocketAP system, which were then switched on day 4. Four 23-h periods were compared, with each system being tested for glycemic performance following when the dinner carbohydrate (CHO) content was announced (A) or unannounced (UA). On the final day of the study, participants were discharged to home before lunch, thus the carbohydrate announcement was not applicable (NA).

Close modal

Study Devices

At study admission, all participants were started on a Tandem t:ap insulin pump set (Tandem Diabetes Care, San Diego, CA) with their home insulin parameters. Study participants also used the Dexcom G6 CGM. Both devices were connected to study-provided Android cell phones, which both reported back to the University of Virginia (Charlottesville, VA) remote monitoring system (DiAs Web Monitoring) (14) and ran the DiAs system (15) for either of the study AP systems described further below. A study blood glucose meter (ContourNext Link; Ascencia Diabetes Care, Parsippany, NJ) and study blood ketone meter (Precision Xtra; Abbott, Alameda, CA) were provided to all subjects for use as necessary in adherence to the glycemic guidelines listed below. Subjects were also fitted with a physical activity tracker (Fitbit Charge 3), the data from which was not used by either AP system.

Study Systems

This study compared two CLC systems, an investigational version of a commercially available HCL system (USS, control condition) that has been extensively tested in prior clinical trials (1,2,6,1621), and a new, advanced hybrid CLC (RCKT, experimental condition), for their ability to control glycemia following unannounced meals. The USS was used as previously described (19); the “sleep mode” feature was programmed for participants at enrollment from 10:00 p.m. to 7:00 a.m.; the “exercise mode” was not needed in this study. The RCKT system integrates a novel BPS module within an MPC framework. MPC, rather than a single-control strategy, encompasses a general control paradigm. It incorporates an individualized mathematical model of the user’s glucose-related metabolism and finds the optimal insulin sequence that minimizes deviations from predetermined glucose targets and constraints. The user’s model is individualized into a linear time-invariant framework by using the data collection period, a well-established method in the literature (22).

In RCKT, the MPC part commands optimized microbolus doses through the pump every 5 min to react to internal metabolic disturbances while the BPS triggers escalating safe amounts of insulin (fractions of the total daily insulin) as the observed probability of a meal-like disturbance increases. Although RCKT is originally designed to function as a CLC system with the ability to recognize an unannounced meal and act on it, RCKT also has the capacity of functioning as a standard HCL. Once the user announces a meal, the meal bolus is computed as the 50% of the bolus calculated from the subject’s carbohydrate-to-insulin ratio and correction factor, overriding any simultaneous BPS action.

Following the previous ideas, RCKT uses model predictions from a personalized model and CGM measurements to determine the basal insulin dose (microbolus) that minimizes a cost function that includes 1) a term to correct the participant’s glucose concentration to the target, 2) a term penalizing low glucose values, and 3) a regularization term to weight the difference between two consecutive microboluses. In addition to the previous elements, RCKT was integrated with the legacy Safety System (23) and Hyperglycemia Mitigation System (24), enabling safe doses limited by the perceived risk of hypoglycemia and prevailing hyperglycemia, respectively. Due to the short duration of this trial, we did not allow online self-adaptation of the internal model but solely relied on the personalized data collection during the 2 weeks prior to the trial.

The BPS system runs every 5 min by estimating the probability that a meal-like disturbance has occurred in the prior 30 min. A priming bolus will then be requested when the disturbance probability is greater than a specific set of thresholds: for P = 0.3, 0.5, 0.7, and 0.9, the bolus requests will be of 3%, 5%, 6%, and 7% of total daily insulin, respectively. Every new dose will account for the insulin-on-board from preceding BPS doses. Further details of the BPS module are provided in the Supplementary Material.

Timing of Study Treatment Periods

Upon arrival to the study hotel, participants were started on the first AP system to which they had been randomized (Fig. 1). Data collection toward overall glycemic control on either of the systems began the day of arrival at ∼12:00 p.m. Participants were switched between alternate AP systems at ∼11:00 a.m. on hotel day 4, with data collection beginning immediately and continuing until discharge at ∼10:00–11:00 a.m. on hotel day 6. This design resulted in four 22- to 23-h segments to analyze (noon to 10:00–11:00 a.m. the next day), two with RCKT, and two with USS, each segment containing three meals, with dinner being announced (first segment of each algorithm) or not (second segment).

Study Meals and Activity

On hotel days 2–5, participants ate dinner at ∼6:00 p.m. Each participant had chosen a specific meal that was identical between these study days and contained 44–62 g of carbohydrate, 35–42 g of protein, and 27–41 g of fat. On hotel days 2 and 4, the carbohydrate amount of this dinner was entered into the CLC system, and the participant received the corresponding insulin bolus (in USS, this was the full bolus according to the home insulin-to-carbohydrate ratio; in the RocketAP system, this was half of the insulin from the home insulin-to-carbohydrate ratio). On hotel days 3 and 5, no dinner information was entered into the CLC system. Data for the primary outcome were then collected until 6 h after dinner. Additional meals during study days contained approximately 47 ± 9 g of carbohydrate and were always entered into the CLC system, and the corresponding insulin bolus was given. For activity, participants had a supervised light walk of 1–2 miles daily on each of the study days and were otherwise in their hotel rooms or engaging in social activities with the other study subjects.

Remote Monitoring and Glycemic Treatment Guidelines

Members of the study team remotely monitored participants’ real-time CGM data through DiAs Web Monitoring for the entirety of hotel portion of the study and alerted study nurses, physicians, and technicians regarding glycemic concerns and device connection issues. In addition, at least one member of the study team was present at all times during activities and monitored participants via a mobile device. Most treatment decisions were based on CGM data, with self-monitoring of BG performed at the discretion of the medical team. The study team intervened with ∼5–15 g of fast-acting carbohydrate if the CGM reading was <70 mg/dL throughout the study admission.

For hyperglycemia, the study team intervened if the participant was noted to be >300 mg/dL for ≥2 h. At that point, the participant was asked to check the infusion site and check a blood ketone level. If a problem with the pump site was suspected, the pump site was changed, and a correction dose of insulin was given along with oral hydration. Ketones were also checked regardless of BG for vomiting, fever, or significant illness. Blood ketones were treated if elevated per our glycemic treatment guidelines until the participant’s CGM read between 70 and 250 mg/dL and ketones were <0.6 mmol/L. Participants were required to stop the study and transition back to their home pump for ketones ≥1.5 mmol/L.

Additional SARS-Co-V2 Precautions

All participants and study staff interacting personally with participants were required to have negative SARS-CoV-2 testing 2–3 days before the study and again on the day of study arrival. To minimize the chance of viral exposure, individuals not associated with the study were not permitted on the floor of the hotel where participants and study staff stayed.

Outcomes and Statistical Analysis

All glycemic outcomes were computed based on CGM records (25). The primary outcome was percentage time-in-range between 70 and 180 mg/dL (TIR) from dinner until 6 h later. Secondary glycemic outcomes included time-in-tight-range 80–140 mg/dL (TTR), percentage of time in hypoglycemia (<50, <60, <70 mg/dL), percentage of time in hyperglycemia (>180, >250, >300 mg/dL), average CGM number of hypoglycemia events (CGM glucose <70, regardless of symptoms), and total amount of insulin used—all for both dinner time to 6 h later and 6:00 p.m. to 7:00 a.m. Additional outcomes were the percentage of time in closed-loop, coefficient of variation, total daily injected insulin, and number of hypoglycemic treatments (26) All of these were prepared for presentation via standard guidelines (25). Outcomes were further divided into segments of the day: dinner–dinner + 6 h, dinner–dinner + 12 h, and overnight (11:00 p.m.–7:00 a.m.). Paired t tests or nonparametric Wilcoxon signed rank tests were used to compare the control and experimental admissions (both RCKT and USS comparisons and announced and unannounced dinners within each of these) in terms of glycemic outcomes in the case of normally or nonnormally distributed samples, respectively (Shapiro-Wilk test, quantile-quantile plot). The significance level was set at P < 0.05. No correction for multiple analysis was performed. Data are reported as mean ± SD if normally distributed and as median and interquartile range (IQR) if nonnormally distributed. Data formatting and preparation, as well as the statistical analysis, were done with MATLAB R2019b (MathWorks, Natick, MA) and SPSS 27 (IBM, Armonk, NY) software.

In total, 21 adolescents were enrolled in the study, and 18 participants completed the study and were included in the analysis. Excluded participants included one participant who did not respond to ongoing contact for study arrangements, one participant who tested positive for SARS-CoV-2 during the isolation period, and one participant who tested positive for SARS-CoV-2 upon arrival at the hotel. Baseline data for the 18 participants are listed in Supplementary Table 1. The average for age was 15.6 ± 1.6 years (range 13–20) and for HbA1c was 7.4% ± 1.5 (range 5.8–12.6 [57 ± 4.5 mmol/mol; range 40–114]). Sex distribution was 9 females and 9 males.

Unannounced Dinner Glycemic Outcomes

For the following results, statistical comparisons are set as RCKT versus USS unless, stated otherwise. TIR 70–180 mg/dL for the period 6:00 p.m.–12:00 a.m. after the unannounced dinner (primary outcome) was significantly higher in RCKT than with USS (83% [IQR 64–93] vs. 53% [40–71]; P = 0.004) (Table 1). TTR 80–140 mg/dL was also higher in RCKT (49% [IQR 41–59] vs. 27% [22–36]; P = 0.002). Mean CGM and percentage of time >180 mg/dL were significantly lower in RCKT (141 ± 21 mg/dL vs. 166 ± 26 mg/dL; P = 0.001 and 17% [IQR 1.3–34] vs. 47% [28–60]; P = 0.01), respectively (Table 1). The difference in glycemia during this period is further depicted in Fig. 2 (shown for individual participants in Supplementary Fig. 1). Improvements in glycemia for RCKT versus USS extended in the 12-h period after the unannounced dinner (6:00 p.m.–6:00 a.m.) (Supplementary Table 2): TTR (73% [IQR 70–76] vs. 52% [42–64]; P < 0.001), TIR (90% [79–96] vs. 75% [58–83]; P = 0.004), mean CGM (123 ± 11 mg/dL vs. 145 ± 25 mg/dL; P < 0.001), and exposure to hyperglycemia percentage of time >180 mg/dL (8.7% [3–17] vs. 25% [14–37]; P = 0.003).

Figure 2

Glucose levels over time by CLC system. CGM data are shown, centered over the dinner, for both FCL (unannounced carbohydrate) and HCL (announced carbohydrate). The green dotted lines correspond to the 70–180 mg/dL target range. The orange and blue lines and shaded areas represent the mean glucose and 95% CIs for the treatment periods shown in the keys for each graph.

Figure 2

Glucose levels over time by CLC system. CGM data are shown, centered over the dinner, for both FCL (unannounced carbohydrate) and HCL (announced carbohydrate). The green dotted lines correspond to the 70–180 mg/dL target range. The orange and blue lines and shaded areas represent the mean glucose and 95% CIs for the treatment periods shown in the keys for each graph.

Close modal
Table 1

Glycemic outcomes during unannounced and announced dinners, 6:00 p.m.–12:00 a.m.

Unannounced dinner (primary outcome)Announced dinner (secondary outcome)
USSRCKTP valueUSSRCKTP value
Glycemic metrics       
 CGM glucose (mg/dL) 166 ± 26 141 ± 21 0.001a 114 ± 26 114 ± 11 0.45 
 Percentage of CGM time       
  <50 mg/dL (<2.8 mmol/L) 0 (0–0) 0 (0–0) 0 (0–0) 0 (0–0) 
  <60 mg/dL (<3.3 mmol/L) 0 (0–0) 0 (0–0) 0.5 0 (0–0) 0 (0–0) 0.08 
  <70 mg/dL (<3.9 mmol/L) 0 (0–0) 0 (0–1) 0.2 0.7 (0–8) 0 (0–0) 0.04b 
  70–140 mg/dL (3.9–7.8 mmol/L) 27 (22–36) 49 (41–59) 0.002b 82 (57–89) 86 (69–94) 0.13 
  70–180 mg/dL (3.9–10.0 mmol/L) 53 (40–71) 83 (64–93) 0.004b 93 (85–99) 100 (99–100) 0.004b 
  >180 mg/dL (>10.0 mmol/L) 47 (28–60) 17 (1.3–34) 0.01b 0 (0–1) 0 (0–0) 0.10 
  >250 mg/dL (>13.9 mmol/L) 0 (0–0) 0 (0–0) 0 (0–0) 0 (0–0) 
  >300 mg/dL (>16.7 mmol/L) 0 (0–0) 0 (0–0) 0 (0–0) 0 (0–0) 
 CGM SD (mg/dL) 40 ± 13 37 ± 17 0.2 20 ± 8.5 23 ± 7 0.11 
 CGM coefficient of variation (%) 24 ± 9 26 ± 9 0.4 17.5 ± 7.1 20 ± 6 0.10 
Safety metrics       
 Severe hypoglycemia (n events) 0 (0–0) 0 (0–0) 1b 0 (0–0) 0 (0–0) 1b 
 Diabetes ketoacidosis (n events) 0 (0–0) 0 (0–0) 1b 0 (0–0) 0 (0–0) 1b 
Technical performance metrics       
 Time in CLC (%) 95 ± 15 100 ± 1 0.16 92 ± 17 99 ± 2 0.16 
 Total injected insulin (IU) 14 ± 4 15 ± 5 0.21 14 ± 4 15 ± 7 0.22 
Unannounced dinner (primary outcome)Announced dinner (secondary outcome)
USSRCKTP valueUSSRCKTP value
Glycemic metrics       
 CGM glucose (mg/dL) 166 ± 26 141 ± 21 0.001a 114 ± 26 114 ± 11 0.45 
 Percentage of CGM time       
  <50 mg/dL (<2.8 mmol/L) 0 (0–0) 0 (0–0) 0 (0–0) 0 (0–0) 
  <60 mg/dL (<3.3 mmol/L) 0 (0–0) 0 (0–0) 0.5 0 (0–0) 0 (0–0) 0.08 
  <70 mg/dL (<3.9 mmol/L) 0 (0–0) 0 (0–1) 0.2 0.7 (0–8) 0 (0–0) 0.04b 
  70–140 mg/dL (3.9–7.8 mmol/L) 27 (22–36) 49 (41–59) 0.002b 82 (57–89) 86 (69–94) 0.13 
  70–180 mg/dL (3.9–10.0 mmol/L) 53 (40–71) 83 (64–93) 0.004b 93 (85–99) 100 (99–100) 0.004b 
  >180 mg/dL (>10.0 mmol/L) 47 (28–60) 17 (1.3–34) 0.01b 0 (0–1) 0 (0–0) 0.10 
  >250 mg/dL (>13.9 mmol/L) 0 (0–0) 0 (0–0) 0 (0–0) 0 (0–0) 
  >300 mg/dL (>16.7 mmol/L) 0 (0–0) 0 (0–0) 0 (0–0) 0 (0–0) 
 CGM SD (mg/dL) 40 ± 13 37 ± 17 0.2 20 ± 8.5 23 ± 7 0.11 
 CGM coefficient of variation (%) 24 ± 9 26 ± 9 0.4 17.5 ± 7.1 20 ± 6 0.10 
Safety metrics       
 Severe hypoglycemia (n events) 0 (0–0) 0 (0–0) 1b 0 (0–0) 0 (0–0) 1b 
 Diabetes ketoacidosis (n events) 0 (0–0) 0 (0–0) 1b 0 (0–0) 0 (0–0) 1b 
Technical performance metrics       
 Time in CLC (%) 95 ± 15 100 ± 1 0.16 92 ± 17 99 ± 2 0.16 
 Total injected insulin (IU) 14 ± 4 15 ± 5 0.21 14 ± 4 15 ± 7 0.22 

Data are presented as mean ± SD or median (IQR). Significance levels <0.05 are presented in bold.

a

One-sided paired t test.

b

Wilcoxon signed rank test.

Announced Dinner and Overall Glycemic Outcomes

The RCKT system also outperformed USS following the announced dinners, showing a higher TIR and lower percentage of time <70 mg/dL (100% [IQR 99–100] vs. 93% [85–99], P = 0.004; and 0% [0–0] vs. 0.7% [0–0.8], P = 0.04, respectively) (Table 1). Time <70 mg/dL after the announced dinner was lower for RCKT versus USS (1.3 ± 2.8% vs. 4 ± 6%).

Overall control during ∼46 h revealed that RCKT had higher TTR and TIR (72.3 ± 7.9% vs. 63.7 ± 13%, P = 0.01; and 87 ± 6.6% vs. 80 ± 9.6%, P = 0.007, respectively) and lower mean BG and percentage of time >180 mg/dL (122 ± 7.5 mg/dL vs. 128 ± 15.5 mg/dL, P = 0.05; and 9.4 ± 5.6% vs. 13.4 ± 8.7%, P = 0.03, respectively) (Supplementary Table 2). Compared with baseline control, there was an increase in TIR on USS for 15 of 18 participants and on RCKT for 17 of 18 participants (Supplementary Table 4 and Fig. 3). Comparing RCKT to USS, there was an increase in TIR for 13 of 18 participants.

Figure 3

Comparison of TIR at baseline and on each CLC system. Each set of points connected between baseline, USS Virginia, and RocketAP represents an individual participant’s TIR at that point. The size of the circle represents the percentage of time <70 mg/dL during the entire period on that system. TBR, time below range.

Figure 3

Comparison of TIR at baseline and on each CLC system. Each set of points connected between baseline, USS Virginia, and RocketAP represents an individual participant’s TIR at that point. The size of the circle represents the percentage of time <70 mg/dL during the entire period on that system. TBR, time below range.

Close modal

It is worth noting that remarkably tight control was achieved overnight by RCKT versus USS for TTR 70–140 mg/dL (95.3% [IQR 90.4–100] vs. 76.3% [58.5–87.4], P < 0.001) as well as TIR 70–180 mg/dL (99.2% [95.7–100] vs. 92.2% [81.2–96], P < 0.001) and mean BG (106.4 ± 7.3 mg/dL vs. 123 ± 20 mg/dL, P = 0.002) (Supplementary Table 5). With notably higher exposure to hyperglycemia, the percentage of time >180 mg/dL with the legacy controller was 0% (IQR 0–0) vs. 5% (0–9.8, P = 0.002).

Hypoglycemia

During the 6-h (postprandial) and 12-h (postprandial and overnight) periods after dinner, there was almost no time in hypoglycemia for either RCKT or USS, <1% of the time in both systems (Table 1 and Supplementary Table 2), and the controllers did not differ in the number of hypoglycemic events (Supplementary Table 6).

During the overall study period (compared with the 6-h and 12-h periods after study dinners), more time was spent in hypoglycemia, 2.2% for RCKT and 2.9% for USS (P = 0.22) (Supplementary Table 3). Similarly, the overall number of hypoglycemia events per person was greater during the entire study, 3 for RCKT and 4.5 for USS. This was also a greater amount of time spent <70 mg/dL than was seen at baseline care for all participants (Supplementary Table 4 and Fig. 3). The number of these hypoglycemia events that occurred in the time around the light activity (1–2 mile walks daily, from 3:00–6:30 p.m.) was 36 (1 per person per day) for RCKT and 40 (1.1 per person per day) for USS, representing ∼56% of the total number of hypoglycemia events for the study.

Infused Insulin and Priming Doses

The infused insulin amounts following dinners were similar for both systems (Table 1), while overall insulin amounts were lower on RCKT versus USS (78 ± 23 units vs. 85 ± 20 units) (Supplementary Table 3). The BPS in RCKT stimulated the administration of priming insulin doses in response to unannounced meals 83.4% of the time (15 of 18 dinners). This system was never triggered by BG fluctuations at any other portion of the trial. The mean of priming doses delivered was 2.4 units (range 0–6) (Supplementary Table 7).

Adverse Events

There were no device-related adverse events during the study.

While HCL systems in long-term use provide improvements in glycemia (14), there remains a need for FCL systems that can offer adequate BG control in the absence of user meal input. We demonstrated improved TIR following an unannounced meal for RCKT, a novel MPC system with a dedicated BPS to address meal-like disturbances compared with a legacy CLC system. The RCKT system had a TIR of 83% during the 6 h after a dinner of 34–62 g of carbohydrate that was unannounced—supporting the potential for this type of system to improve overall control among individuals who occasionally omit announcement of carbohydrate ingestion. Importantly, this study assessed efficacy in adolescents, an age-group particularly notorious for missing snack and meal announcements, contributing to high HbA1c levels (1012).

The central feature of RCKT in improving glycemia after unannounced carbohydrate was the pairing of the BPS with an advanced control system (MPC), which allowed safe insulin priming that only occurred when glycemic excursions were derived from carbohydrate intake and not during infusion set failures, for example. These priming doses appeared effective at reducing the spike in BG after unannounced meals, with a lower peak BG and more rapid return to BG near target. Furthermore, the priming system appeared safe, with no postprandial lows following the unannounced dinner and no accidental triggers from BG fluctuations (e.g., dawn phenomenon) at other parts of the trial. The priming system is designed to deliver increasingly higher insulin doses depending on the probability the system has determined that a meal took place. The highest cumulative priming dose delivered in this study was 6 units, and the highest amount delivered as a proportion of total daily insulin was 7%. In this way, the system is intended to avoid hypoglycemia if the BPS determines a high probability of a meal having occurred when in fact none has. We did not observe such an erroneous trigger of the meal detection system in this limited trial, although clearly, longer studies are needed to confirm the safety of this systems in common use.

While the priming system did not result in hypoglycemia, we noted a higher-than-expected number of hypoglycemia events for both RCKT and USS systems overall (3 and 4.5 episodes per participant per day, respectively). These did not occur during the 6-h or 12-h after dinner but instead were other portions of the trial and were of unclear cause. Compared with other diabetes camp studies, this study included very little activity, walking a total of 1–2 miles over the course of each day, although this may still have represented more activity than some adolescents were accustomed to during the pandemic. One other possible explanation is that the home insulin parameters for some of the adolescents may have included relatively high basal rates as a response to missing some insulin for carbohydrates during home care. Still, another possibility is that the CLC systems were overly aggressive in their response to higher BG levels. Knowing that this was a possibility, for announced meals the RCKT system was designed to only deliver half of the usual insulin dose calculated from the participant’s insulin-to-carbohydrate ratio; however, even using this lower prandial insulin dose after announcing carbohydrate ingestion, there were occasional episodes of hypoglycemia. Finally, it should be noted that hypoglycemia tends to be underrepresented during supervised studies as CGM is monitored and hypoglycemic treatment rapidly administered. Future iterations of the system may require either further reductions in the insulin-to-carbohydrate dose delivered or a less robust response to hyperglycemia.

This system compares favorably to systems tested in settings of unannounced carbohydrate, acknowledging potential differences in conditions for participants in each trial. Weinzimer et al. (27) assessed adolescents using a Medtronic closed-loop system, reporting mean glucose levels of 141 mg/dL during FCL use compared with 135 mg/dL in HCL; TIR data were not reported. Cameron et al. (28) assessed CLC among adults in hospital and hotel settings with a system that included accelerometry-based exercise detection, finding 73–78% TIR. Dovc et al. (29) assessed adults in FCL using the DreaMed GlucoSitter in a setting that included structured exercise and unannounced meals, reporting TIR 57.9% and 53.3% when using standard aspart and faster aspart, respectively. Blauw et al. (30) assessed FCL in a bihormonal system (with a separate pump delivering glucagon) among adults at home, reporting TIR of 86.6% compared with 53.9% in open loop. Turksoy et al. (31) evaluated an automatic meal bolus algorithm integrated to an integrated multivariable adaptive AP based on the online estimation of the glucose Ra, reporting TIR of 71% compared with 63% for the continuous subcutaneous insulin infusion (control) condition in a small pilot study. Samadi et al. (32) assessed the benefits of a fuzzy-based meal detector system on a retrospective analysis using data collected from 11 subjects with T1D, reporting 93.5% and 68% detection sensitivity for meals and snacks, respectively, with a detection time of 35 ± 23 min. Future side-by-side assessments of systems in similar populations and settings would be helpful for more direct comparison of efficacy.

In this system, we used changes in CGM glucose patterns to trigger the priming meal bolus. This approach allows for sensor glucose disturbances to trigger insulin dosing, which only occur in the absence of carbohydrate announcement. The safety of a late user-initiated meal bolus would depend on whether the BPS has already provided insulin, in which case the system would provide a message regarding the prior BPS dose; in deciding on the need for a further user-initiated bolus, users would then have to be mindful of how much insulin the BPS has already delivered. Alternative means of addressing unannounced carbohydrate in a CLC system include features such as entrained anticipation of meals or activity, where individuals who eat or exercise at predictable times most days cause the system to adjust insulin delivery in the time leading up to that period (33). Other approaches toward meal detection could also be achieved via external sensing of meal-type movement, such as through a wrist-worn accelerometer such as a smart watch.

Even in the absence of the BPS, the MPC algorithm in RCKT achieved better TIR than USS, as seen following the announced dinner. This may relate to this being a more advanced controller including an individualized glucose prediction directly into the decision-making process. Apart from reacting to the difference with respect to the target, RCKT modulates the aggressiveness as a function of the rate of glucose change, providing an opportunity to inject higher microboluses when glucose levels suddenly rise and to back off promptly when glucose levels trend downward. This study benefitted from a randomized crossover design, allowing direct comparison of four CLC dinner approaches in a group of adolescents, the age range likely most affected by unannounced carbohydrate ingestion.

Limitations of early supervised clinical trials, including this study, are that they do not allow extrapolation of the system’s safety and efficacy outside of this restrictive setting; of note, fixed meal schedules, restrained carbohydrate intake, lack of intensive exercise, and absence of daily stressors may affect glycemic control. High-intensity activity may be a particular challenge for fully closed-loop systems (19,33,34), in which preexercise adrenaline could result in elevations in glucose that may trigger inappropriate insulin dose escalation by the BPS. Additionally, while the order of the controller was randomized, there was a fixed order of the announced and unannounced dinners and a lack of a significant wash out period between controller sessions, all of which could have influenced glycemic control, particularly the days after unannounced carbohydrate at dinner. Therefore, further tests will be needed in free-living conditions.

In conclusion, this system, with automatic prandial bolus priming, achieved 83% in the 6-h period around a dinner without carbohydrate announcement among adolescents. While HCL overcomes some of the inherent delays in CLC via calculating insulin needed for carbohydrate and delivering the dose before eating, automated meal detection for prandial glycemic management may help achieve an acceptable degree of control for individuals who miss opportunities to announce carbohydrate ingestion during use of a CLC system.

J.C.-T. and M.D.D. contributed equally to the article.

Clinical trial reg. no. NCT04545567, clinicaltrials.gov

This article contains supplementary material online at https://doi.org/10.2337/figshare.14999709.

Acknowledgments. The authors thank the study volunteers and the research staff at the University of Virginia Center for Diabetes Technology.

Funding. This project was funded by generous grants from the University of Virginia’s LaunchPad Program (to M.D.D. and M.D.B.) and the Strategic Investment Fund project “Precision Individualized Medicine for Diabetes (PriMeD).”

Duality of Interest. M.D.D. reports receiving grant or material support from Tandem, Medtronic, and Dexcom. M.D.B. has received honoraria and travel reimbursement from Dexcom and Tandem, and research support from Dexcom, Novo Nordisk, and Tandem. No other potential conflicts of interest relevant to this article were reported.

Author Contributions. J.G.-T. designed the core of the experimental CLC system, was involved in the study design, provided technical support remotely and on-site in all the admissions, analyzed data, performed statistical analyses, and was involved in writing and editing the manuscript. J.L.D., R.E.-Z., and C.L.B., provided on-site support during screenings and admissions and were involved in writing and editing the manuscript. C.L.K.K. maintained and checked the functionality of the DiAs system, the functionality of the closed-loop systems in the smartphone, conducted the testing of the systems before the study, provided technical support remotely and on-site in all the admissions, and reviewed and edited the manuscript. J.P.C. designed the BPS logic for the experimental controller and reviewed and edited the manuscript. M.D. and C.W. coordinated the study monitoring, processed data, and were involved in writing and editing the manuscript. M.C.O assisted with the development of the protocol, coordinated institutional review board submission and investigational device exemption submission to the U.S. Food and Drug Administration, contributed to the study planning and preparation, and reviewed and edited the manuscript. H.M and K.K. were the research coordinators for the study and responsible for all participant interaction and operations during the trial, and reviewed and edited the manuscript. M.D.B. contributed to the algorithm and study design, supervised its implementation, performed statistical analyses, and was involved in writing and editing the manuscript. M.D.D. was the study physician responsible for all participant activities and was the University of Virginia site principal investigator, contributed to the study design, answered queries from the regulatory boards, including the U.S. Food and Drug Administration, and was involved in writing and editing the manuscript. M.D.D. is the guarantor of this work and, as such, had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Prior Presentation. Parts of this study were presented in abstract form at the 14th International Conference on Advanced Technologies & Treatments for Diabetes (ATTD 2021), 2–5 June 2021.

1.
Brown
SA
,
Kovatchev
BP
,
Raghinaru
D
, et al.;
iDCL Trial Research Group
.
Six-month randomized, multicenter trial of closed-loop control in type 1 diabetes
.
N Engl J Med
2019
;
381
:
1707
1717
2.
Breton
MD
,
Kanapka
LG
,
Beck
RW
, et al.;
iDCL Trial Research Group
.
A randomized trial of closed-loop control in children with type 1 diabetes
.
N Engl J Med
2020
;
383
:
836
845
3.
Thabit
H
,
Elleri
D
,
Leelarathna
L
, et al
.
Unsupervised overnight closed loop insulin delivery during free living: analysis of randomised cross-over home studies in adults and adolescents with type 1 diabetes
.
Lancet
2015
;
385
(
Suppl. 1
):
S96
4.
Russell
SJ
,
Hillard
MA
,
Balliro
C
, et al
.
Day and night glycaemic control with a bionic pancreas versus conventional insulin pump therapy in preadolescent children with type 1 diabetes: a randomised crossover trial
.
Lancet Diabetes Endocrinol
2016
;
4
:
233
243
5.
Tauschmann
M
,
Thabit
H
,
Bally
L
, et al.;
APCam11 Consortium
.
Closed-loop insulin delivery in suboptimally controlled type 1 diabetes: a multicentre, 12-week randomised trial
.
Lancet
2018
; 
392
:
1321
1329
6.
Cherñavvsky
DR
,
DeBoer
MD
,
Keith-Hynes
P
, et al
.
Use of an artificial pancreas among adolescents for a missed snack bolus and an underestimated meal bolus
.
Pediatr Diabetes
2016
;
17
:
28
35
7.
Garg
SK
,
Weinzimer
SA
,
Tamborlane
WV
, et al
.
Glucose outcomes with the in-home use of a hybrid closed-loop insulin delivery system in adolescents and adults with type 1 diabetes
.
Diabetes Technol Ther
2017
;
19
:
155
163
8.
Amadou
C
,
Franc
S
,
Benhamou
PY
, et al.;
Diabeloop Consortium
.
Diabeloop DBLG1 closed-loop system enables patients with type 1 diabetes to significantly improve their glycemic control in real-life situations without serious adverse events: 6-month follow-up
.
Diabetes Care
2021
;
44
:
844
846
9.
Boughton
CK
,
Hartnell
S
,
Thabit
H
, et al
.
Hybrid closed-loop glucose control with faster insulin aspart compared with standard insulin aspart in adults with type 1 diabetes: a double-blind, multicentre, multinational, randomized, crossover study
.
Diabetes Obes Metab
2021
;
23
:
1389
1396
10.
Burdick
J
,
Chase
HP
,
Slover
RH
, et al
.
Missed insulin meal boluses and elevated hemoglobin A1c levels in children receiving insulin pump therapy
.
Pediatrics
2004
;
113
:
e221
e224
11.
Olinder
AL
,
Kernell
A
,
Smide
B
.
Missed bolus doses: devastating for metabolic control in CSII-treated adolescents with type 1 diabetes
.
Pediatr Diabetes
2009
;
10
:
142
148
12.
Foster
NC
,
Beck
RW
,
Miller
KM
, et al
.
State of type 1 diabetes management and outcomes from the T1D Exchange in 2016-2018
.
Diabetes Technol Ther
2019
;
21
:
66
72
13.
Isganaitis
E
,
Raghinaru
D
,
Ambler-Osborn
L
, et al.;
iDCL Trial Research Group
.
Closed-loop insulin therapy improves glycemic control in adolescents and young adults: outcomes from the International Diabetes Closed-Loop Trial
.
Diabetes Technol Ther
2021
;
23
:
342
349
14.
Place
J
,
Robert
A
,
Ben Brahim
N
, et al
.
DiAs web monitoring: a real-time remote monitoring system designed for artificial pancreas outpatient trials
.
J Diabetes Sci Technol
2013
;
7
:
1427
1435
15.
Keith-Hynes
P
,
Guerlain
S
,
Mize
B
, et al
.
DiAs user interface: a patient-centric interface for mobile artificial pancreas systems
.
J Diabetes Sci Technol
2013
;
7
:
1416
1426
16.
Breton
M
,
Farret
A
,
Bruttomesso
D
, et al.;
International Artificial Pancreas Study Group
.
Fully integrated artificial pancreas in type 1 diabetes: modular closed-loop glucose control maintains near normoglycemia
.
Diabetes
2012
;
61
:
2230
2237
17.
Kovatchev
BP
,
Renard
E
,
Cobelli
C
, et al
.
Safety of outpatient closed-loop control: first randomized cross-over trials of wearable artificial pancreas
.
Diabetes Care
2014
;
37
:
1789
1796
18.
DeBoer
MD
,
Breton
MD
,
Wakeman
C
, et al
.
Performance of an artificial pancreas system for young children with type 1 diabetes
.
Diabetes Technol Ther
2017
;
19
:
293
298
19.
Breton
MD
,
Cherñavvsky
DR
,
Forlenza
GP
, et al
.
Closed-loop control during intense prolonged outdoor exercise in adolescents with type 1 diabetes: the Artificial Pancreas Ski Study
.
Diabetes Care
2017
;
40
:
1644
1650
20.
Ly
TT
,
Buckingham
BA
,
DeSalvo
DJ
, et al
.
Day-and-night closed-loop control using the Unified Safety System in adolescents with type 1 diabetes at camp
.
Diabetes Care
2016
;
39
:
e106
e107
21.
Kovatchev
BP
,
Renard
E
,
Cobelli
C
, et al
.
Safety of outpatient closed-loop control: first randomized crossover trials of a wearable artificial pancreas
.
Diabetes Care
2014
;
37
:
1789
1796
22.
Garcia-Tirado
J
,
Zuluaga-Bedoya
C
,
Breton
MD
.
Identifiability analysis of three control-oriented models for use in artificial pancreas systems
.
J Diabetes Sci Technol
2018
;
12
:
937
952
23.
Ly
TT
,
Breton
MD
,
Keith-Hynes
P
, et al
.
Overnight glucose control with an automated, unified safety system in children and adolescents with type 1 diabetes at diabetes camp
.
Diabetes Care
2014
;
37
:
2310
2316
24.
Anderson
SM
,
Buckingham
BA
,
Breton
MD
, et al
.
Hybrid closed-loop control is safe and effective for people with type 1 diabetes who are at moderate to high risk for hypoglycemia
.
Diabetes Technol Ther
2019
;
21
:
356
363
25.
Maahs
DM
,
Buckingham
BA
,
Castle
JR
, et al
.
Outcome measures for artificial pancreas clinical trials: a consensus report
.
Diabetes Care
2016
;
39
:
1175
1179
26.
Kovatchev
B
,
Straume
M
,
Cox
D
,
Farhy
L
.
Risk analysis of blood glucose data: a quantitative approach to optimizing the control of insulin dependent diabetes
.
J Theor Med
2000
;
3
:
1
10
27.
Weinzimer
SA
,
Steil
GM
,
Swan
KL
,
Dziura
J
,
Kurtz
N
,
Tamborlane
WV
.
Fully automated closed-loop insulin delivery versus semiautomated hybrid control in pediatric patients with type 1 diabetes using an artificial pancreas
.
Diabetes Care
2008
;
31
:
934
939
28.
Cameron
FM
,
Ly
TT
,
Buckingham
BA
, et al
.
Closed-loop control without meal announcement in type 1 diabetes
.
Diabetes Technol Ther
2017
;
19
:
527
532
29.
Dovc
K
,
Piona
C
,
Yeşiltepe Mutlu
G
, et al
.
Faster compared with standard insulin aspart during day-and-night fully closed-loop insulin therapy in type 1 diabetes: a double-blind randomized crossover trial
.
Diabetes Care
2020
;
43
:
29
36
30.
Blauw
H
,
Onvlee
AJ
,
Klaassen
M
,
van Bon
AC
,
DeVries
JH
.
Fully closed loop glucose control with a bihormonal artificial pancreas in adults with type 1 diabetes: an outpatient, randomized, crossover trial
.
Diabetes Care
2021
;
44
:
836
838
31.
Turksoy
K
,
Hajizadeh
I
,
Samadi
S
, et al
.
Real-time estimation of glucose concentration and insulin bolusing for unannounced meals with artificial pancreas
.
J Control Eng Pract
2017
;
59
:
159
164
32.
Samadi
S
,
Rashid
M
,
Turksoy
K
, et al
.
Automatic detection and estimation of unannounced meals for multivariable artificial pancreas system
.
Diabetes Technol Ther
2018
;
20
:
235
246
33.
Garcia-Tirado
J
,
Brown
SA
,
Laichuthai
N
, et al
.
Anticipation of historical exercise patterns by a novel artificial pancreas system reduces hypoglycemia during and after moderate-intensity physical activity in people with type 1 diabetes
.
Diabetes Technol Ther
2021
;
23
:
277
285
34.
DeBoer
MD
,
Cherñavvsky
DR
,
Topchyan
K
,
Kovatchev
BP
,
Francis
GL
,
Breton
MD
.
Heart rate informed artificial pancreas system enhances glycemic control during exercise in adolescents with T1D
.
Pediatr Diabetes
2017
; 
18
:
540
546
Readers may use this article as long as the work is properly cited, the use is educational and not for profit, and the work is not altered. More information is available at https://www.diabetesjournals.org/content/license.