OBJECTIVE

To evaluate the feasibility and efficacy of a fully integrated hybrid closed-loop (HCL) system (Medtronic MiniMed Inc., Northridge, CA), in day and night closed-loop control in subjects with type 1 diabetes, both in an inpatient setting and during 6 days at diabetes camp.

RESEARCH DESIGN AND METHODS

The Medtronic MiniMed HCL system consists of a fourth generation (4S) glucose sensor, a sensor transmitter, and an insulin pump using a modified proportional-integral-derivative (PID) insulin feedback algorithm with safety constraints. Eight subjects were studied over 48 h in an inpatient setting. This was followed by a study of 21 subjects for 6 days at diabetes camp, randomized to either the closed-loop control group using the HCL system or to the group using the Medtronic MiniMed 530G with threshold suspend (control group).

RESULTS

The overall mean sensor glucose percent time in range 70–180 mg/dL was similar between the groups (73.1% vs. 69.9%, control vs. HCL, respectively) (P = 0.580). Meter glucose values between 70 and 180 mg/dL were also similar between the groups (73.6% vs. 63.2%, control vs. HCL, respectively) (P = 0.086). The mean absolute relative difference of the 4S sensor was 10.8 ± 10.2%, when compared with plasma glucose values in the inpatient setting, and 12.6 ± 11.0% compared with capillary Bayer CONTOUR NEXT LINK glucose meter values during 6 days at camp.

CONCLUSIONS

In the first clinical study of this fully integrated system using an investigational PID algorithm, the system did not demonstrate improved glucose control compared with sensor-augmented pump therapy alone. The system demonstrated good connectivity and improved sensor performance.

There have been a number of advances in developing automated insulin delivery systems for optimizing glucose control in patients with type 1 diabetes with the ultimate aim of reducing the burden of care for this condition (17). Early studies (810) demonstrated the feasibility of automated insulin modulation using subcutaneous insulin pumps and subcutaneous continuous glucose sensors with the main focus being algorithm development. Further advances in both sensor performance and algorithms incrementally demonstrated improved protection against hypoglycemia, reduced variability, and decreased mean glucose levels in controlled inpatient settings (1113) as well as in outpatient studies (2,4,6). The strategies for different control algorithms are well described in several recent reviews (14,15).

The hybrid closed-loop (HCL) system of Medtronic MiniMed Inc. (Northridge, CA) is the first fully integrated system designed for continuous day and night HCL control with the algorithm incorporated within the insulin pump. The HCL system requires meal announcement with an estimate of carbohydrate intake and a premeal insulin bolus to optimize postprandial glucose excursions (9).

The system consists of a Medtronic fourth generation sensor (4S) and uses a proportional-integral-derivative with insulin feedback (PID-IFB) algorithm with safety constraints to continuously modulate basal insulin delivery based on sensor glucose values. The system configuration places the closed-loop controller on the pump and removes the need for an intermediary device that contains the algorithm, such as a phone or portable computer. This reduces the need for connectivity between a controller and the insulin pump as well as between the controller and sensor, two points of potential interrupted communication in a multi-device system (35).

This report describes the clinical experience with using this HCL system in a supervised environment over multiple days for both day and night closed-loop control. The objective of this study was to test the feasibility and efficacy of a preliminary algorithm in adolescents and adults with type 1 diabetes over 48 h in a research center followed by a 6-day period at a diabetes camp.

Medtronic HCL System

The Medtronic HCL system is a fully integrated continuous glucose sensor and insulin delivery system designed for continuous closed-loop control. The system consists of a 4S glucose sensor, a sensor transmitter, and an insulin pump, as shown in Fig. 1. A PID-IFB algorithm with safety constraints is incorporated in the pump, allowing for continuous closed-loop control of basal insulin delivery. The system also uses a next-generation Bayer CONTOUR NEXT LINK glucose meter, which allows the patient to automatically send meter glucose values to the pump via radiofrequency connection.

Figure 1

Medtronic next-generation HCL system.

Figure 1

Medtronic next-generation HCL system.

Close modal

Specifics of the control algorithm have been previously described (1618). Insulin delivery was modeled on the multiphasic insulin response of the β-cell and consisted of three principal components: proportional, integral, and derivative, with a modification to include feedback of a model-predicted insulin profile (17,19).

The system operates in two modes: manual and closed loop. In the manual mode, the system uses patient-specific settings, including basal rates, carbohydrate/insulin ratio, insulin sensitivity factor, and glucose targets. The pump may function as a stand-alone insulin pump. When used in conjunction with the continuous glucose sensor, there are also features such as automatic insulin suspension or predictive low glucose insulin suspension; however, these functions were not activated during this study.

With continuous glucose sensor input, closed loop may also be activated. The system uses the PID-IFB algorithm to continuously modulate basal insulin delivery. Instead of a preset basal rate, the algorithm determines insulin delivery as sensor glucose inputs arrive and delivers insulin as a small bolus or “microbolus.” The system was set to a target glucose of 120 mg/dL. Users may also inform the system of exercise, during which the target is increased to 160 mg/dL.

The maximum insulin limit constrains the maximum insulin delivered at any time by the algorithm. This value is specific to each patient and is calculated from fasting glucose values and total daily dose of insulin (TDD). The maximum insulin limit adapts over time and, for example, will increase in response to elevated fasting glucose values. At the initialization of closed-loop control, the TDD for each day of the preceding week was manually entered into the system.

A fixed carbohydrate/insulin ratio based upon the TDD rule of 500/TDD, was used for premeal boluses. Correction doses were initiated with meter glucose values >200 mg/dL, with a target glucose of 180 mg/dL. The insulin sensitivity factor was algorithm derived and also based upon the TDD.

Study Design

Participants were eligible to participate if they were between 14 and 40 years of age, had a diagnosis of type 1 diabetes for at least 1 year, and had been using an insulin pump for at least 3 months. Exclusion criteria included diabetes ketoacidosis in the preceding 30 days, hypoglycemic seizure or loss of consciousness in the preceding 3 months, and pregnancy or a medical condition considered to interfere with the completion of the protocol. There was no A1C exclusion criterion. The protocol was approved by Stanford University Institutional Review Board.

Inpatient Phase

An initial inpatient study was conducted to evaluate the feasibility of system use in eight subjects, primarily between 14 and 18 years of age, with type 1 diabetes. The HCL system was evaluated for 48 h for each participant. A description of the inpatient procedures is included in the Supplementary Data.

Camp Phase

For the main camp sessions, 21 subjects were recruited. Randomization occurred after the enrollment visit and was stratified by A1C. Subjects were randomized to use either a sensor-augmented pump with insulin suspension using the commercially available Medtronic MiniMed 530G (Medtronic MiniMed, Inc.) (control group) or closed-loop control with the HCL system.

For the control group, an Enlite sensor was inserted and linked to the 530G pump. The 4S sensor was not compatible with the 530G pump. The suspend threshold was set to 60 mg/dL. In addition, a low alert was set at 70 mg/dL, and a high alert was set at 250 mg/dL. Meter glucose testing was conducted using a Bayer CONTOUR NEXT LINK glucose meter.

For the HCL group, a 4S glucose sensor was inserted. The HCL pump was programmed with the subject’s current pump settings and placed in manual mode. All calibrations were performed using a capillary meter glucose value measured by a Bayer glucose meter. The first calibration was entered between 30 min and 2 h after sensor insertion. Sensors were calibrated at least every 12 h. A low alert was also set at 70 mg/dL, and a high alert at 250 mg/dL. After 5 h of manual operation, closed loop was started.

Both groups used premeal boluses and were advised to enter the carbohydrate amount into the bolus calculator. Research staff did not provide input for carbohydrate counting. Subjects continued in their group for the duration of the 6 days and 6 nights of diabetes camp. All subjects were instructed either to wash their hands with soap or use alcohol to clean fingers, discard the first drop of blood, and use the second drop of blood for meter glucose testing. Capillary glucose testing was supervised in the HCL group. There were no restrictions for subjects in either group, and all subjects participated in the camp program.

Glucose Monitoring and Management in the HCL Group

Meter glucose testing was routinely performed every 3–4 h, including before meals, before exercise, and before bed. Overnight, subjects were tested at 0000, 0300, and 0700 h.

The HCL system does not have the capability for remote monitoring. Given that this was the first clinical experience with the system, a member of the research team accompanied each subject to ensure that all system use was supervised and that alarms were appropriately managed. During the day, research staff was present in close proximity to the subject. During the overnight period, subjects slept in their cabin with fellow campers without research staff present; however, in addition to the glucose testing at 0000 and 0300 h, the system was visually checked at 0100 and 0500 h.

Subjects were advised to obtain a meter glucose value if the sensor glucose was <70 mg/dL and to treat with 15 g of fast-acting carbohydrates. A repeat meter glucose was obtained after 15 min to ensure that glucose values were >70 mg/dL. Subjects were also advised to check for a meter glucose if the sensor was >250 mg/dL >2 h after a meal. If the meter glucose was confirmed to be >250 mg/dL, ketones were also obtained. If ketones were >0.6 mmol/L or meter glucose was >400 mg/dL, a subcutaneous insulin correction dose was given, the infusion set was changed, and closed loop was stopped for 2 h. If ketones were <0.6 mmol/L and the meter glucose was <400 mg/dL, the glucose value would be sent to the HCL pump for an automatic correction.

Closed-loop control would be stopped for the following conditions: meter glucose >400 mg/dL for >2 h, ketones >3 mmol/L, nausea or abdominal discomfort that did not resolve after 2 h in the presence of ketones >0.6 mmol/L, any seizure or loss of consciousness, or malfunction of the system that was imposed upon subject safety.

At the end of the study, subjects completed questionnaires to evaluate their experience.

Glucose Monitoring and Management in the Control Group

In the control group, subjects were under the care of the camp medical staff. This included premeal testing, and routine testing at 0000 and 0700 h, and at 0300 h if clinically indicated.

Subjects were also advised to obtain a meter glucose value if the sensor glucose was <70 mg/dL and to treat with 15 g of fast-acting carbohydrates. A repeat meter glucose was obtained after 15 min to ensure that glucose values were >70 mg/dL. If the sensor glucose was >250 mg/dL, subjects were advised to check for meter glucose and ketones and advise the camp medical staff prior to giving insulin.

Sample Size

The inpatient study was designed to assess the feasibility of system use and was not powered for significance. A cohort of eight subjects was recruited to generate 384 h of 4S sensor use and closed-loop control.

The sample size estimate for the camp study was based upon data from our previous camp studies (5). Power analysis was performed for a repeated-measures ANOVA. The variance-covariance structure was assumed to follow a compound symmetry with a variance of 27 mg/dL and covariance of 14 mg/dL. The mean percent time in range from 70 to 180 mg/dL for the control group was estimated to be 62%, and the mean percent time in range for the treatment group was estimated to be 75%. A sample of 10 patients in each group, for a total of 20 patients, would provide at least 80% power to observe a difference between 62% and 75% in a two-sided test with an α level of 0.05. We aimed to recruit 20 participants to account for subject withdrawal.

Statistics

For the primary outcome of percent time in range, sensor glucose values were compared between the groups using a two-way repeated-measures ANOVA, and results are shown as the least squares mean ± SE. Given the marked difference in sensor performance between the Enlite and 4S, only sensors with a daily median absolute relative difference (ARD) of <15% were used in both groups for analyses of glucose outcomes.

Depending on distribution, other data are expressed as mean ± SD or as median (interquartile range [IQR]). Comparisons for meter glucose levels were made using a Mann-Whitney U test for nonparametric data and a Student t test for data conforming to a normal distribution. Analyses were performed using SigmaStat version 11.0. The sample size calculation was performed in Stata version 13.1.

Inpatient Studies

Data for the inpatient studies are included in the Supplementary Data.

Camp Session

During the camp session, 21 subjects were enrolled and studied for a total of 120 person-days. One subject from the HCL group had to leave camp after 24 h and was replaced. The mean ± SD age was 18.6 ± 3.7 years (range 15.3–31.4), duration of diabetes was 9.1 ± 4.7 years, A1C was 8.6 ± 1.5% (range 5.9–11.6) (70 ± 16 mmol/mol, range 41–103), and insulin dose was 0.8 ± 0.2 units/kg/day. Subjects in the HCL group remained in closed loop for 93 ± 3% of the scheduled time. There was continuous sensor glucose data available for 98.9% of the time. Time off closed loop was attributed to sensor change or temporarily suspending HCL after infusion set failure.

There were no instances of diabetic ketoacidosis or severe hypoglycemia resulting in seizure or coma that resulted in stopping closed loop for subjects in the HCL group. There was an episode of a hypoglycemic generalized tonic-clonic seizure in a control participant, which occurred after a dinner bolus of 8.3 units was delivered with delayed food consumption. The meter glucose obtained at the time of the seizure was 46 mg/dL. The subject made a full recovery with the administration of intramuscular glucagon.

Sensor Performance

The overall mean ARD for the 4S sensor compared with meter glucose values was 12.6 ± 11.0%. The median ARD was 9.7% (IQR 4.7, 17.6) (n = 742). A Bland-Altman plot of 4S sensor glucose compared with meter glucose is shown in Supplementary Fig. 1A. The mean ARD values for the 4S sensor from day 1 through day 6 were 15.9 ± 12.4%, 11.3 ± 8.6%, 11.6 ± 12.1%, 13.3 ± 10.3%, 13.1 ± 11.9%, and 11.3 ± 9.9%, respectively.

The overall mean ARD value for the Enlite sensor, compared with meter glucose values, was 21.7 ± 23.4%. The median ARD was 15.9% (IQR 7.5, 28.2) (n = 383). A Bland-Altman plot for Enlite sensor compared with meter glucose is shown in Supplementary Fig. 1B.

To assess the efficacy of the system, only sensor data with a daily median ARD of <15% were included in the analysis for both the control and HCL groups. This left 32 person-days for the control group and 51 person-days for the HCL group from a total possible of 60 in each group.

Glucose Control

Glucose control, from sensor glucose values, for both groups using days with a daily median ARD of <15% is shown in Table 1. In terms of the primary outcome, the mean percent time in range 70–180 mg/dL during the day and night was similar between the groups (73.1% vs. 69.9%, control vs. HCL, respectively) (P = 0.580). The effect changed over time (days of wear) (P = 0.009), with the HCL group tending to improve from 64.8% on day 1 to 77.7% on day 6, compared with the control group, which deteriorated from 90.3% on day 1 to 56.2% on day 6. Data for median percent time in range 70–180 mg/dL per day are shown in Fig. 2A. Mean glucose values exhibited a similar pattern, with mean glucose improving from 154 mg/dL on day 1 to 147 mg/dL on day 6 for the HCL group, whereas the mean glucose in the control group increased from 130 mg/dL on day 1 to 173 mg/dL on day 6.

Table 1

Glycemic outcomes

Treatment
P value
Sensor-augmented pump with threshold suspend at 60 mg/dL (n = 10)HCL system
(n = 10)TreatmentTimeInteraction between time and treatment
Sensor glucose for day and night (0700–0700 h)      
 Mean glucose value (mg/dL) 147 ± 8 157 ± 6 0.274 0.071 0.006 
 Percent time between 70 and 180 mg/dL 73.1 ± 5.0 69.9 ± 3.3 0.580 0.085 0.009 
 Percent time between 70 and 150 mg/dL 58.0 ± 6.2 51.8 ± 4.1 0.375 0.211 0.064 
 Percent time <70 mg/dL 2.4 ± 0.6 2.1 ± 0.4 0.656 0.683 0.213 
 Percent time <60 mg/dL 0.7 ± 0.4 0.5 ± 0.3 0.699 0.274 0.164 
 Percent time <50 mg/dL 0.1 ± 0.1 0.1 ± 0.1 0.747 0.125 0.062 
 Percent time >180 mg/dL 24.8 ± 5.2 28.4 ± 3.5 0.542 0.058 0.006 
 Percent time >250 mg/dL 6.3 ± 2.8 8.2 ± 1.9 0.53 0.181 0.01 
Sensor glucose at night (2300–0700 h)      
 Mean glucose value (mg/dL) 149 ± 10 146 ± 6 0.75 0.005 0.013 
 Percent time between 70 and 180 mg/dL 68.2 ± 6.1 79.9 ± 4.0 0.111 0.119 0.012 
 Percent time between 70 and 150 mg/dL 51.7 ± 8.8 59.8 ± 5.8 0.421 0.132 0.058 
 Percent time <70 mg/dL 4.2 ± 1.3 1.7 ± 0.9 0.136 0.196 0.236 
 Percent time <60 mg/dL 1.7 ± 1.0 0.5 ± 0.7 0.298 0.076 0.188 
 Percent time <50 mg/dL 0.6 ± 0.9 0.1 ± 0.6 0.627 0.026 0.026 
 Percent time >180 mg/dL 28.0 ± 6.7 19.0 ± 4.4 0.247 0.033 0.011 
 Percent time >250 mg/dL 7.0 ± 2.6 3.1 ± 1.7 0.214 0.014 0.098 
Meter glucose for day and night (0700–0700 h)      
 Average meter glucose value 137 (121, 173) 152 (145, 179) 0.121   
 Percent of meter values <70 mg/dL 6.7 (5.4, 12.4) 4.7 (2.6, 8.3) 0.130   
 Percent of meter values between 70 and 180 mg/dL 73.6 ± 15.4 63.4 ± 10.5 0.101   
 Percent of meter values >180 mg/dL 15.5 (10.1, 43.4) 31.1 (20.3, 45.7) 0.076   
Treatment
P value
Sensor-augmented pump with threshold suspend at 60 mg/dL (n = 10)HCL system
(n = 10)TreatmentTimeInteraction between time and treatment
Sensor glucose for day and night (0700–0700 h)      
 Mean glucose value (mg/dL) 147 ± 8 157 ± 6 0.274 0.071 0.006 
 Percent time between 70 and 180 mg/dL 73.1 ± 5.0 69.9 ± 3.3 0.580 0.085 0.009 
 Percent time between 70 and 150 mg/dL 58.0 ± 6.2 51.8 ± 4.1 0.375 0.211 0.064 
 Percent time <70 mg/dL 2.4 ± 0.6 2.1 ± 0.4 0.656 0.683 0.213 
 Percent time <60 mg/dL 0.7 ± 0.4 0.5 ± 0.3 0.699 0.274 0.164 
 Percent time <50 mg/dL 0.1 ± 0.1 0.1 ± 0.1 0.747 0.125 0.062 
 Percent time >180 mg/dL 24.8 ± 5.2 28.4 ± 3.5 0.542 0.058 0.006 
 Percent time >250 mg/dL 6.3 ± 2.8 8.2 ± 1.9 0.53 0.181 0.01 
Sensor glucose at night (2300–0700 h)      
 Mean glucose value (mg/dL) 149 ± 10 146 ± 6 0.75 0.005 0.013 
 Percent time between 70 and 180 mg/dL 68.2 ± 6.1 79.9 ± 4.0 0.111 0.119 0.012 
 Percent time between 70 and 150 mg/dL 51.7 ± 8.8 59.8 ± 5.8 0.421 0.132 0.058 
 Percent time <70 mg/dL 4.2 ± 1.3 1.7 ± 0.9 0.136 0.196 0.236 
 Percent time <60 mg/dL 1.7 ± 1.0 0.5 ± 0.7 0.298 0.076 0.188 
 Percent time <50 mg/dL 0.6 ± 0.9 0.1 ± 0.6 0.627 0.026 0.026 
 Percent time >180 mg/dL 28.0 ± 6.7 19.0 ± 4.4 0.247 0.033 0.011 
 Percent time >250 mg/dL 7.0 ± 2.6 3.1 ± 1.7 0.214 0.014 0.098 
Meter glucose for day and night (0700–0700 h)      
 Average meter glucose value 137 (121, 173) 152 (145, 179) 0.121   
 Percent of meter values <70 mg/dL 6.7 (5.4, 12.4) 4.7 (2.6, 8.3) 0.130   
 Percent of meter values between 70 and 180 mg/dL 73.6 ± 15.4 63.4 ± 10.5 0.101   
 Percent of meter values >180 mg/dL 15.5 (10.1, 43.4) 31.1 (20.3, 45.7) 0.076   

Data for sensor glucose are reported as least squares mean ± SE and include only sensor data where the daily median ARD <15%. Data for meter glucose are reported as mean ± SD or median (IQR).

Figure 2

A: Percent time between 70 and 180 mg/dL over 6 days (0700–0700 h). Data are reported as median (IQR). B: Percent time between 70 and 180 mg/dL over 6 nights (2300–0700 h). Data are reported as median (IQR).

Figure 2

A: Percent time between 70 and 180 mg/dL over 6 days (0700–0700 h). Data are reported as median (IQR). B: Percent time between 70 and 180 mg/dL over 6 nights (2300–0700 h). Data are reported as median (IQR).

Close modal

During the overnight period, the overall percent time in range 70–180 mg/dL was 68.2% for the control group versus 79.9% for the HCL group (P = 0.111). The HCL group performed more favorably over the course of the study and by day 6 had achieved 80.6% in range compared with 42.8% in the control group. Data for median percent time in range per night (70–180 mg/dL) are shown in Fig. 2B. There was also a trend toward less hypoglycemia as well as a trend for less hyperglycemia, which again were more prominent by day 6.

Overall, the mean ± SD percent time in range 70–180 mg/dL was 70.6 ± 9.8% for the HCL group compared with 70.3 ± 14.9% for the control group. The median (IQR) for the same range was 70.0% (68.3, 74.9) for the HCL group compared with 74.4% (58.5, 82.0) for the control group.

Meter glucose values were also compared, and these data are shown in Table 1. There were more than double the number of meter glucose values obtained in the HCL group (n = 782) compared with the control group (n = 383). This occurred mainly due to the testing procedures in the HCL group, with meter glucose values obtained for all sensor glucose values outside of the 70–250 mg/dL range as well as during the overnight period. For all meter glucose values >250 mg/dL, a repeat test was performed after 1 h in the HCL group. There was an average of 0.4 events/person/day with meter glucose >250 mg/dL in the control group versus 0.7 events/person/day in the HCL group (P = 0.055). There were double the number of tests performed 4 h after a meter glucose level of >250 mg/dL with a median of 4 tests (IQR 3, 4) for the HCL group compared with 2 tests (IQR 1, 3) for the control group (P < 0.001), in part because of the less aggressive correction boluses given in the HCL group compared with the control group.

There was only one meter glucose value <50 mg/dL in the HCL group compared with four values in the control group over the week (P = 0.278). There were two meter glucose values >400 mg/dL in the HCL group, compared with one in the control group.

The median sensor glucose values over the course of 24 h for the control group versus the HCL group are shown in Fig. 3.

Figure 3

Glucose control over 24 h. Results are reported as median (IQR).

Figure 3

Glucose control over 24 h. Results are reported as median (IQR).

Close modal

Total Daily Insulin

The average daily insulin dose tended to decrease during the week of camp for both the control and the intervention groups. In the control group, the average TDD was 63 ± 17 units/day at baseline compared with 57 ± 23 units/day during camp (P = 0.078). In the HCL group, the average TDD was 58 ± 17 units/day at baseline versus 49 ± 17 units/day during camp (P = 0.001).

Carbohydrate Consumption

The average daily amount of carbohydrates consumed in the HCL group was 179 ± 27 g for females (n = 5, mean weight 73 kg) and 259 ± 23 g for male subjects (n = 5, mean weight 77 kg). This was similar to the amount of carbohydrates consumed in the control group (158 ± 56 g for females [n = 6, mean weight 63 kg] and 222 ± 99 g for males [n = 4, mean weight 82 kg]).

Closed-loop control using a fully integrated sensor, algorithm, and pump system is an exciting innovation in this rapidly advancing field, and this report describes the first clinical experience using the Medtronic HCL system with the 4S sensor and an investigational algorithm. In a supervised camp setting, glucose control was comparable to that achieved with automated insulin suspension alone. Over multiple days, however, there was improved performance of the system, achieving between 70% and 77% time in range. The results are promising for the potential impact of reducing the burden of care of type 1 diabetes.

The overall glycemic control was favorable compared with other hybrid, single-hormone systems, such as presented by the AP@home Consortium, where Leelarathna et al. (2) achieved a median of 75% of time between 70 and 180 mg/dL in an at-home, outpatient study over 7 days, compared with a median of 70% for our cohort. Our results are also similar to those of Kovatchev et al. (6), who reported a mean of 66% of time between 70 and 180 mg/dL in a 40-h outpatient study of adults, compared with our mean of 70.6% for the same range. For a dual hormone system using both insulin and glucagon, Russell et al. (4) achieved an impressive 76–80% of time in a similar range over 5 days for both adults and adolescents, in a supervised study with remote monitoring. The systems described, however, are not fully integrated.

The HCL system was simple to navigate and use. Once the pump was operational in manual mode with sensor glucose data available, only the addition of TDD data was required to start closed loop. In future versions, the system would be used in manual mode for 3–5 days, and no data would be required to be entered prior to initializing closed loop.

During closed-loop operation in this study, both the carbohydrate/insulin ratio as well as the insulin sensitivity factor were algorithm derived. There was no ability to dictate predetermined carbohydrate/insulin ratios for specific times of the day. This did not reflect individualized patient-derived settings, which may include, for example, more aggressive carbohydrate/insulin ratios for breakfast. This contributed to the postprandial hyperglycemia seen in the HCL group. In future versions, there will be the option of entering patient-specific carbohydrate/insulin ratios in specific time blocks. With the limitations of current insulin pharmacokinetics, optimizing premeal boluses remains the challenge in an insulin-only delivery system.

Although the system was safe, in that there was not a greater incidence of hypoglycemia, the automatic corrections did not correct glucose values into target as rapidly as patients expected with their own standard therapy. This was particularly problematic for subjects who were accustomed to actively correcting their glucose values to achieve optimal time in range. This certainly contributed to the higher mean glucose values as well as the more prolonged postprandial hyperglycemia seen in the HCL group. Future versions of the algorithm may have a lower threshold to initiate a correction dose as well as a lower correction dose target to allow for increased insulin dosing. In this investigational algorithm, correction boluses were given automatically, and subjects were not able to see the amount to accept, reject, or adjust the bolus. Subjects were only able to see the amount delivered after it was given. Although this involved fewer buttons to push for the subject, many patients complained that they did not feel comfortable not knowing how much insulin was given. These are important user interface considerations for future closed-loop development. The degree of automation will affect patient behaviors and the acceptability of the devices. Automated insulin delivery systems represent a shift in the current concepts of basal/bolus insulin delivery, and it is clear that patients will want some degree of control of insulin delivery as preliminary versions of these devices become commercially available.

As system use extends, there needs to be flexibility and adaptability to individuals with variable insulin sensitivities that may change with exercise, stress, illness, and hormone levels. Although there was a component of adaptability with the maximum insulin limit, this needs to be further investigated with studies testing system use over a longer time period. A system that is able to quickly adapt, such as in the bihormonal approach used by Russell et al. (4), will undoubtedly be important for optimizing individual control.

The Medtronic 4S sensor demonstrated vast improved accuracy over the current commercially available Enlite sensor, with a mean ARD of 12.5%. Sensor accuracy is one of the critical determinants of a successful algorithm and affects how aggressively the algorithm can be set in achieving glucose targets as well as in affecting patient satisfaction and the potential uptake of the technology. The 4S sensor was well accepted by all our participants, among both naive and experienced sensor users.

We have consistently observed a decrease in sensor accuracy when we move from inpatient to outpatient studies. In a recent study (5), the Dexcom G4P sensor error increased from a mean ARD of 10.4% during inpatient studies to 17.5% in the camp setting. In both the inpatient and outpatient settings, sensors were calibrated against meter glucose values. In the inpatient setting, the reference glucose was measured by YSI, and in the camp setting the reference was a meter glucose. The decreased accuracy of sensor glucose values may be attributed to the technique in obtaining the capillary sample. In the current study, subjects were asked to wash their hands or use an alcohol swab, and to discard the first drop of blood and use the second drop for testing. This resulted in only a minimal decrease in 4S performance when moving from the inpatient to the camp setting. When glucose sensors are being used to deliver insulin in a closed-loop control system, we would advocate that meter glucose values be obtained using this technique.

There were a number of limitations to this study. The difference in sensor performance made a direct comparison of glycemic outcomes prohibitive. We chose to use sensor data only where the median ARD per day was <15%, to remove egregious errors in both groups. The degree of supervision was also different between the groups. Our aim was to have a control group that reflected the standard care received at camp using a commercially available pump. This investigational HCL system did not have remote monitoring and required research staff be in close proximity for the supervision of system use, which created a discrepancy in care between the two groups. We did not, however, influence clinical care by assisting in carbohydrate counting in either group. An important objective was to see how the system would work with minimal input from staff.

As a first clinical study of the integrated HCL system, it is reassuring to see that the system performance was comparable to automated insulin suspension alone in a supervised setting. The 4S sensor was a significant improvement over previous Enlite sensors and should allow future versions of the HCL system to be more aggressive with overall glucose control.

Clinical trial reg. no. NCT02366767, clinicaltrials.gov.

Acknowledgments. The authors thank the participants and their families for taking part in this study. The authors also thank the medical staff, directed by Dr. Kevin Kaiserman at Camp Conrad-Chinnock, and the camp staff, directed by Dr. Rocky Wilson at Camp Conrad-Chinnock, for making this study possible.

Funding. This work is supported by a grant from Medtronic Diabetes. T.T.L. is supported by the University of Western Australia F.A. Hadley Overseas Medical Fellowship.

Duality of Interest. T.T.L. has received honoraria from Medtronic. A.R., B.G., J.S., A.C., S.M., and B.L. are employees of Medtronic MiniMed and are Medtronic shareholders. B.A.B. is on medical advisory boards for Sanofi; Novo Nordisk; Becton, Dickinson and Company; Unomedical; and Medtronic. He has received research grant and/or material support from Medtronic, Dexcom, LifeScan, Insulet, Bayer, Unomedical, and Tandem Diabetes Care. No other potential conflicts of interest relevant to this article were reported.

Author Contributions. T.T.L. and B.A.B. designed the study, researched the data, and wrote the manuscript. A.R., B.G., J.S., A.C., S.M., B.L., S.S., and P.C. reviewed the manuscript. R.v.E. provided statistical support. B.A.B. is the guarantor of this work and, as such, had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Prior Presentation. This study was presented at the 75th Scientific Sessions of the American Diabetes Association, Boston, MA, 5–9 June 2015.

1.
Hovorka
R
,
Elleri
D
,
Thabit
H
, et al
.
Overnight closed-loop insulin delivery in young people with type 1 diabetes: a free-living, randomized clinical trial
.
Diabetes Care
2014
;
37
:
1204
1211
[PubMed]
2.
Leelarathna
L
,
Dellweg
S
,
Mader
JK
, et al.;
AP@home Consortium
.
Day and night home closed-loop insulin delivery in adults with type 1 diabetes: three-center randomized crossover study
.
Diabetes Care
2014
;
37
:
1931
1937
[PubMed]
3.
Thabit
H
,
Lubina-Solomon
A
,
Stadler
M
, et al
.
Home use of closed-loop insulin delivery for overnight glucose control in adults with type 1 diabetes: a 4-week, multicentre, randomised crossover study
.
Lancet Diabetes Endocrinol
2014
;
2
:
701
709
4.
Russell
SJ
,
El-Khatib
FH
,
Sinha
M
, et al
.
Outpatient glycemic control with a bionic pancreas in type 1 diabetes
.
N Engl J Med
2014
;
371
:
313
325
[PubMed]
5.
Ly
TT
,
Breton
MD
,
Keith-Hynes
P
, et al
.
Overnight glucose control with an automated, unified safety system in children and adolescents with type 1 diabetes at diabetes camp
.
Diabetes Care
2014
;
37
:
2310
2316
[PubMed]
6.
Kovatchev
BP
,
Renard
E
,
Cobelli
C
, et al
.
Safety of outpatient closed-loop control: first randomized crossover trials of a wearable artificial pancreas
.
Diabetes Care
2014
;
37
:
1789
1796
[PubMed]
7.
Nimri
R
,
Muller
I
,
Atlas
E
, et al
.
MD-Logic overnight control for 6 weeks of home use in patients with type 1 diabetes: randomized crossover trial
.
Diabetes Care
2014
;
37
:
3025
3032
[PubMed]
8.
Hovorka
R
,
Allen
JM
,
Elleri
D
, et al
.
Manual closed-loop insulin delivery in children and adolescents with type 1 diabetes: a phase 2 randomised crossover trial
.
Lancet
2010
;
375
:
743
751
[PubMed]
9.
Weinzimer
SA
,
Steil
GM
,
Swan
KL
,
Dziura
J
,
Kurtz
N
,
Tamborlane
WV
.
Fully automated closed-loop insulin delivery versus semiautomated hybrid control in pediatric patients with type 1 diabetes using an artificial pancreas
.
Diabetes Care
2008
;
31
:
934
939
[PubMed]
10.
Kovatchev
B
,
Cobelli
C
,
Renard
E
, et al
.
Multinational study of subcutaneous model-predictive closed-loop control in type 1 diabetes mellitus: summary of the results
.
J Diabetes Sci Technol
2010
;
4
:
1374
1381
[PubMed]
11.
Hovorka
R
,
Kumareswaran
K
,
Harris
J
, et al
.
Overnight closed loop insulin delivery (artificial pancreas) in adults with type 1 diabetes: crossover randomised controlled studies
.
BMJ
2011
;
342
:
d1855
.
12.
O'Grady
MJ
,
Retterath
AR
,
Keenan
DB
, et al
.
The use of an automated, portable glucose control system for overnight glucose control in adolescents and young adults with type 1 diabetes
.
Diabetes Care
2012
;
35
:
2182
2187
[PubMed]
13.
Kovatchev
BP
,
Renard
E
,
Cobelli
C
, et al
.
Feasibility of outpatient fully integrated closed-loop control: first studies of wearable artificial pancreas
.
Diabetes Care
2013
;
36
:
1851
1858
[PubMed]
14.
Peyser
T
,
Dassau
E
,
Breton
M
,
Skyler
JS
.
The artificial pancreas: current status and future prospects in the management of diabetes
.
Ann N Y Acad Sci
2014
;
1311
:
102
123
[PubMed]
15.
Thabit
H
,
Hovorka
R
.
Bringing closed-loop home: recent advances in closed-loop insulin delivery
.
Curr Opin Endocrinol Diabetes Obes
2014
;
21
:
95
101
[PubMed]
16.
Steil
GM
,
Rebrin
K
,
Janowski
R
,
Darwin
C
,
Saad
MF
.
Modeling beta-cell insulin secretion—implications for closed-loop glucose homeostasis
.
Diabetes Technol Ther
2003
;
5
:
953
964
[PubMed]
17.
Steil
GM
,
Palerm
CC
,
Kurtz
N
, et al
.
The effect of insulin feedback on closed loop glucose control
.
J Clin Endocrinol Metab
2011
;
96
:
1402
1408
[PubMed]
18.
Steil
GM
,
Panteleon
AE
,
Rebrin
K
.
Closed-loop insulin delivery-the path to physiological glucose control
.
Adv Drug Deliv Rev
2004
;
56
:
125
144
[PubMed]
19.
Steil
GM
,
Rebrin
K
,
Darwin
C
,
Hariri
F
,
Saad
MF
.
Feasibility of automating insulin delivery for the treatment of type 1 diabetes
.
Diabetes
2006
;
55
:
3344
3350
[PubMed]

Supplementary data