Accuracy of zero-heat-flux thermometry and bladder temperature measurement in critically ill patients

Core temperature monitoring is one of the essential monitoring modalities in intensive care medicine and temperatures below or above the normal core temperature can be observed frequently. Hypothermia at admission of surgical patients is associated with many adverse outcomes like coagulopathy¹, increased bleeding², and higher transfusion rates³ as well as increased surgical site infections^4,5 and in some studies even with mortality^3,6–9. However, fever is observed much more frequently in critically ill patients and warrants a diagnostic workup to determine the presence of potential infections¹⁰. The ideal temperature measurement method should provide reliable, reproducible values safely and conveniently¹⁰. Additionally, the device should be small, easy to use, comfortable, fast, continuous, noninvasive, low energy consuming and affordable¹¹. In many institutions bladder temperature (T_Bladder) is the standard of care because it is accurate, provides continuous readings, stable measurements regardless of urine flow rate and stays securely in place even during positioning of the patient¹⁰. Normally T_Bladder monitoring adds no additional invasiveness to the standard monitoring, because bladder catheters are nearly always used in critically ill patients.

However, not every patient meets the criteria for a bladder catheter. Patients with acute or chronic renal failure with anuria, after cystectomy or awake patients do not need a bladder catheter. With no indication for using a bladder catheter the use is associated with an unnecessary risk of nosocomial infection. Further on, patients that need irrigation of the bladder because of bleeding will not be appropriate for measurement of T_Bladder. In these situation an alternative approach is needed. Especially in alert patients a non-invasive monitor is helpful. Unfortunately, many of these methods are not very reliable¹². A better alternative might be a zero-heat flux (ZHF) thermometer that has been proven to be reliable in surgical patients^13–16. In general, zero-heat-flux thermometers consist of a thermal insulator adjacent to the skin that is covered by a servo-controlled electric heater. The heater is used to eliminate the flow of heat through the insulator, so that the temperature of the heater and skin temperatures are equal¹³. A validation study in critically ill patients is important because in patients undergoing surgery the most common thermal problem is perioperative hypothermia whereas in critically ill patients it is fever. However, to date no large comparison in critically ill patients has been performed with an accepted gold standard like blood temperature. There is only one study available that has included a small number of patients with blood temperature as a reference method²⁶.

The aim of this study was to compare T_Core measured with a ZHF-thermometer (T_ZHF) and with T_Bladder against a gold standard T_Blood measured in the iliac artery or pulmonary artery to determine if the new ZHF-thermometer is more accurate than T_Bladder.

The current prospective clinical study was conducted in accordance with the declaration of Helsinki at the University Hospital of Göttingen, Germany, after obtaining local ethics committee approval (Ethics committee of the University Medicine Göttingen, Application number: 13/05/18) for the experimental protocol and registration on German Clinical Trials Register (DRKS00015482). According to the approval of the local ethical committee we used deferred (proxy) consent in emergency critical care research¹⁷ as the study was totally non-invasive and observative. If patients were able to give informed written consent this consent was used. If informed proxy consent was necessary, it was given in written form of the proxy. We did not exclude patients who did not recover and died during their hospital stay. The local ethics committee had approved this procedure. The article adheres to the STROBE guidelines¹⁸.

Critically ill adult patients already having a bladder catheter with a temperature probe and an arterial catheter with a temperature probe placed in the iliac artery (Pulsiocath Arterial Thermodilution Catheter 5F; Pulsion Medical Systems AG, Munich, Germany) or a pulmonary artery catheter (Arrow Hands-Off Thermodilution catheter 7F; Arrow International, Athlone, Irland) in place were included in this this study. The only exclusion criteria were pregnancy and refusal to take part in the study.

In all patients, core temperature was measured additionally with a single use, continuous, non-invasive ZHF-thermometer (3 M SpotOn Temperature Monitoring System, 3 M, St. Paul, MN, USA) attached to the lateral forehead of the patients.

Then every 30 min T_Core measured by T_Blood, T_Bladder and the ZHF-thermometer were documented at the same time points until the patient lost the T_Blood sensor or T_Bladder sensor, left the ICU or at least after 5 days. If data of a temperature source were missing the couple of data was not used for comparison. In addition to the temperature data age, weight, height, sex and medical diagnosis at admission to the Intensive Care Unit (ICU) were documented.

As a primary statistical method Bland–Altman statistics were used for interpretation of accuracy (bias = mean difference between methods) and precision (limits of agreement = 1.96 standard deviation) using the Bland and Altman random effects method for repeated measures data adjusted for unequal numbers of measurements per patient¹⁹. Additionally, we calculated the proportion of all differences that were within ± 0.5 °C or ± 1 °C of T_Blood.

For each of the two measurement modalities sensitivity, specificity, positive and negative predictive values for the detection of hypothermia and fever were calculated. Hypothermia was defined as a T_Blood < 36 °C and fever was defined as T_Blood > 38.3 °C¹⁰.

Additionally, we performed an error grid analysis²⁰ to determine if some measurement differences would lead to wrong clinical decisions. The Zones were defined as follows:

Zone A begins with an area of a ± 0.5 °C error on either side of a perfectly accurate measurement between T_Blood and the temperature measured by T_ZHF or T_Bladder. Measurement errors smaller than ± 0.5 °C are considered by most authors as clinically not relevant. In addition, if both measurements indicate hypothermia < 36 °C or fever > 38.3 °C the absolute error is considered to be clinically irrelevant because the same treatment or diagnostic workup will be initiated.

Zone B describes the zone where measurement errors are > 0.5 °C but this will not result in a clinical wrong decision. E.g. if T_Blood is 36.5 °C and T_ZHF shows a temperature of 37.4 °C both temperatures will not lead to active warming therapy or a diagnostic workup for infection.

In contrast Zone C indicates errors larger than 0.5 °C that will lead to wrong clinical decisions and may do harm to the patient. e.g. if T_Blood is 34 °C and T_ZHF shows 37 °C the patient will not receive active warming although this would be indicated.

55 potentially eligible patients were screened. Three patients could not be enrolled because we could not obtain proxy consent and two patients were not included due to technical problems. The remaining 50 patients were enrolled. 36 patients (72%) were male, 14 (28%) were female. Mean age was 61.9 (± 16.8) years, mean height was 1.75 (± 0.07) m, mean weight was 86.4 (± 36.3) kg resulting in a mean body mass index of 28.2 (± 11.3) kg/m². Of these patients 16 were suffering from sepsis, 18 patients had neurologic injury (subarachnoid hemorrhage, intracerebral hemorrhage), 6 patients had trauma, 4 patients had respiratory failure, 2 patients had accidental hypothermia, 3 patients had cardiac surgery, and 1 patient had visceral surgery. Of all 50 patients 49 had an arterial catheter with a temperature probe placed in the iliac artery and one patient had a pulmonary artery catheter with temperature probe. No patient was excluded from the study after enrolment.

Globally 3970.5 h were recorded. 7665 T_Blood values, 7086 values of T_ZHF and 7358 T_bladder values were documented. 276 T_Blood values, 855 values of the ZHF-thermometer and 583 T_Bladder values were missing. The major reason for missing values was a disconnection of the temperature probes for transportation of the patient to the CT, OR, neuroradiology suite, or to the cardiac catheter lab. After these procedures the devices were often not reconnected immediately. Only 17 temperature values of T_Bladder and 16 values of T_ZHF were missing due to technical problems. 12 values below 30 °C could not be recorded by the ZHF-thermometer because the device did not give a reading at these low temperatures.

This resulted in 7018 pairs of measurements for the comparison of T_Blood with T_ZHF and 7265 pairs of measurements for the comparison of T_Blood with T_Bladder.

In 530 measurements T_Blood was < 36 °C, in 6665 measurements T_Blood was 36–38.3 °C and in 470 measurements T_Blood was > 38.3 °C.

In this study with critically ill patients, T_Bladder represented T_Blood more accurate than T_ZHF. In the Bland Altman analyses the bias was smaller and limits of agreement were narrower. The proportion of differences within ± 0.5 °C of T_Blood were higher, and there were less values in Zone B and C of the error grid analysis. In addition, the ZHF thermometer failed to record core temperatures below 30 °C. However, compared to the published results for other non-invasive thermometers like infrared tympanic membrane thermometers, temporal artery thermometers, or axillary thermometers¹² the ZHF-thermometer is more accurate.

In most studies comparing temperature measurement devices there are many data pairs per subject and the number of data pairs per patient are not equal. This can induce random effects because there are independent influences of the different patients and there are influences of time in each individual patient. This influence is not totally independent. To account for this effect, we have used the Bland and Altman random effects method for repeated measures data adjusted for unequal numbers of measurements per patient¹⁹.

A potential limitation of the methods used is the use of error grid analysis. This method has not been used for the comparison of temperature measurement devices before. Error grid analysis is highly dependent on the zones, which can are by definition arbitrarily defined. In this study the zones were defined by the authors a priori using published and well accepted definitions. Zone A was defined as an area of a ± 0.5 °C error on either side of a perfectly accurate measurement between T_Blood and the T_ZHF or T_Bladder because measurement errors smaller than ± 0.5 °C are considered by most authors as clinically not relevant. In addition, if both measurements indicate hypothermia < 36 °C or fever > 38.3 °C the absolute error is considered to be clinically irrelevant because the same treatment or diagnostic workup will be initiated. It can be argued that there is a clinically relevant difference between 35.0 °C and 26 °C. This would still lead to a data point that is in the Zone A. However, it is extremely difficult to define thresholds for this situation. In addition, we did not observe this.

Other potential limitations of our study are that we have studied a relatively small population with only 50 patients. However, in average every patient was monitored more than 3.3 days, resulting in an average of about 140 measurement points per patient.

Another potential limitation is that we have studied a mixed ICU patient collective. This may also be seen as an advantage because we have measured different patients in different critically ill states and with different influences like renal replacement therapy (RRT) or Extracorporeal Membrane Oxygenation (ECMO). Patients undergoing targeted temperature management after cardiopulmonary resuscitation which might be an interesting and challenging patient cohort in which T_Core measurement is of utmost importance are missing in our collective. This may be a limitation to the generalizability of the study results.

In some of our patients the gold standard blood temperature may be distorted by the rapid infusion of unwarmed fluids or extracorporeal devices like RRT or ECMO. It is well known that a rapid infusion of unwarmed or cold fluids can lower blood temperature temporarily. This effect is typically used for the measurement cardiac output with a pulmonary artery catheter. This effect varies depending on the temperature, amount, and rate of the fluid given. Initiation of RRT also temporarily changes blood temperature to a small amount but a stable running RRT does not lead to changes in blood temperature. The same is probably true for ECMO. Infusion of intravenous fluids or RRT are typical measures in ICU and it is not possible to exclude patients that need intravenous fluids. In our patient group 17 patients had RRT and 2 patients had ECMO. This may have contributed to the observed inaccuracy of the ZHF-thermometer and T_Bladder. Another potential problem may be that the analogue data transfer from the ZHF-thermometer to the general ICU monitoring may have introduced an additional error.

We did also not observe many measurements for temperature above 39 °C. Therefore, it is not possible to make any conclusions about the accuracy the devices in these extremely high temperature range.

The use of vasopressor therapy and especially the use of high dose vasopressor therapy may also influence the accuracy of the ZHF-thermometer. Unfortunately, we did not look at this potential source of inaccuracy. This might be investigated in another study.

Also we did not measure the urine output of our patients, therefore a correlation to accuracy of T_Bladder is impossible.

Some studies have used more complex statistical methods²⁹ like population analysis³⁰. However, very often these complex analyses do not add very much new information about the accuracy of the studied devices. We included sensitivity, specificity, positive and negative predictive values for the detection of hypothermia and fever for both methods because this has not been done yet. We also included an error grid analysis because this kind of analysis may be clinically useful although the definition of the three zones in that error grid analysis can be discussed.

In conclusion the results for zero-heat-flux and bladder temperatures were virtually identical within about a tenth of a degree, although T_ZHF tended to underestimate T_Blood. Therefore, either is suitable for clinical use and can be used if bladder temperature is not available.

We would like to thank the nursing staff for supporting the study.

A.B., A.F., T.P., and I.F.B. designed the study. A.B., A.F., D.H. and K.M. managed data and its quality. A.B., A.F., and I.F.B. performed the statistical analysis. All authors participated in the data interpretation. A.B. drafted the manuscript. A.F., D.H., T.P., I.F.B. and K.M. contributed substantially to its revision. All authors read the manuscript carefully and approved the final version.

Open Access funding enabled and organized by Projekt DEAL. The study was conducted with departmental funding only. No equipment was loaned or supplied by a company.

The datasets used for the analysis in the current study are available from the corresponding author on reasonable request.

Prof. Dr. A. Bräuer is a member of the advisory board of 3 M Europe and has received payments from 3 M Germany, 3 M Europe, 3 M Asia Pacific Pte Ltd. for consultancy work. PD Dr. T. Perl T has received consulting honorary from The 37Company the Netherlands and Barkey, Germany. The other authors declare no competing interests.