Skip to main content

Risk prediction models for incident type 2 diabetes in Chinese people with intermediate hyperglycemia: a systematic literature review and external validation study

Abstract

Background

People with intermediate hyperglycemia (IH), including impaired fasting glucose and/or impaired glucose tolerance, are at higher risk of developing type 2 diabetes (T2D) than those with normoglycemia. We aimed to evaluate the performance of published T2D risk prediction models in Chinese people with IH to inform them about the choice of primary diabetes prevention measures.

Methods

A systematic literature search was conducted to identify Asian-derived T2D risk prediction models, which were eligible if they were built on a prospective cohort of Asian adults without diabetes at baseline and utilized routinely-available variables to predict future risk of T2D. These Asian-derived and five prespecified non-Asian derived T2D risk prediction models were divided into BASIC (clinical variables only) and EXTENDED (plus laboratory variables) versions, with validation performed on them in three prospective Chinese IH cohorts: ACE (n = 3241), Luzhou (n = 1333), and TCLSIH (n = 1702). Model performance was assessed in terms of discrimination (C-statistic) and calibration (Hosmer–Lemeshow test).

Results

Forty-four Asian and five non-Asian studies comprising 21 BASIC and 46 EXTENDED T2D risk prediction models for validation were identified. The majority were at high (n = 43, 87.8%) or unclear (n = 3, 6.1%) risk of bias, while only three studies (6.1%) were scored at low risk of bias. BASIC models showed poor-to-moderate discrimination with C-statistics 0.52–0.60, 0.50–0.59, and 0.50–0.64 in the ACE, Luzhou, and TCLSIH cohorts respectively. EXTENDED models showed poor-to-acceptable discrimination with C-statistics 0.54–0.73, 0.52–0.67, and 0.59–0.78 respectively. Fifteen BASIC and 40 EXTENDED models showed poor calibration (P < 0.05), overpredicting or underestimating the observed diabetes risk. Most recalibrated models showed improved calibration but modestly-to-severely overestimated diabetes risk in the three cohorts. The NAVIGATOR model showed the best discrimination in the three cohorts but had poor calibration (P < 0.05).

Conclusions

In Chinese people with IH, previously published BASIC models to predict T2D did not exhibit good discrimination or calibration. Several EXTENDED models performed better, but a robust Chinese T2D risk prediction tool in people with IH remains a major unmet need.

Background

People with intermediate hyperglycemia (IH), including impaired fasting glucose (IFG) and/or impaired glucose tolerance (IGT), are at higher risk of developing type 2 diabetes (T2D) than those with normoglycemia [1, 2]. However, this population comprises a heterogeneous group with differing diabetes incidence rates [2, 3]. Individualized risk estimation for T2D is important to help inform decision-making when considering measures for primary prevention of T2D.

Preventing diabetes is a particular challenge in China, which has the world’s largest population with IH [4]. Although several T2D risk prediction models exist, there is, unfortunately, no validated tool to predict the risk of T2D for Chinese people with IH. The risk stratification policy in China recommended currently to guide primary prevention measures in the IH population is based on a “simple” strategy (referred to as “Chinese IH risk stratification” below) rather than quantifying their absolute risk [5]. High-risk individuals are defined as those with combined IFG and IGT, or individuals with isolated IFG or isolated IGT but having at least one specified risk factor (i.e., overweight or obesity, family history of diabetes, gestational diabetes mellitus, dyslipidemia, hypertension, cardiovascular disease, non-alcoholic fatty liver disease, or polycystic ovarian syndrome), whereas those with isolated IFG or isolated IGT and without these specified risk factors are categorized as low risk.

We sought to identify an effective T2D risk estimation tool for people with IH by conducting an external validation study to evaluate the performance of existing risk prediction models using three independent prospective Chinese IH cohorts. Our primary focus was to examine Asian-derived prediction models, given the differences in Asian and Non-Asian population characteristics, but we also included several well-recognised or/and widely-used non-Asian derived prediction models for comparison.

Methods

Models for validation (Asian and non-Asian derived diabetes risk prediction models)

Literature search for Asian-derived T2D risk prediction models

A systematic literature search was performed in MEDLINE and EMBASE to identify Asian-derived T2D risk prediction models studies published until February 2022 (the literature search strategy is summarized in Additional file 1: Supplementary Text). The review was performed according to the PRISMA guideline by two independent reviewers (SX and QX, checklist in Additional file 1: Table S1) [6]. The process of defining the review question, study eligibility criteria, and data extraction was performed following the applicable guidance from a checklist for critical appraisal and data extraction for systemic review of prediction modelling studies (CHARMS) [7].

The main inclusion criteria for prediction model studies included: (1) Prognostic prediction model to predict future risk of T2D; (2) Model development was based on a prospective cohort; (3) The derivation populations (i.e., the population for model development) were Asian adults without diabetes at baseline; (4) Predictors were routinely-available clinical variables. The detailed inclusion criteria and exclusion criteria are listed in Additional file 1: Table S2.

Prespecified non-Asian derived T2D risk prediction models

The San Antonio model [8], Finnish diabetes risk model (FINDRISC) [9], Atherosclerosis Risk in Communities Model [10] and Framingham diabetes risk model [11] were included for validation because they are currently well-recognised or/and widely-used non-Asian derived diabetes risk prediction models. The STOP-NIDDM model was also included because it was built for people with IH [12]. These prespecified models met all the criteria listed in Additional file 1: Table S2, except for being derived in non-Asian adults.

The Asian and non-Asian derived T2D risk prediction models were divided into BASIC (non-invasive variables only) and EXTENDED models (plus laboratory variables). If there were several BASIC or EXTENDED models in one study, the one with the best reported performance was used for this validation study.

Assessment of risk of bias

We assessed the risk of bias of the included prediction model studies following the short form guidelines of the Prediction study Risk of Bias Assessment tool (PROBAST) [13]. This was done independently by two researchers (SX and QX). Disagreement was resolved through discussions with a third researcher.

Validation populations (ACE, Luzhou, and TCLSIH cohorts)

Cohort profiles

The Acarbose Cardiovascular Evaluation (ACE) was a randomized, double-blind, placebo-controlled, event-driven, Phase IV superiority trial conducted in 176 outpatient clinics in China [14]. Eligible participants were aged 50 years or older with established coronary heart disease and IGT (confirmed by a 75 g oral glucose tolerance test [OGTT]). Between March 2009 and October 2015, 6522 eligible patients were randomized to acarbose 50 mg TID or matching placebo, and were followed until April 2017.

The Luzhou cohort was a prospective community-based cohort study which used a multistage cluster random sampling strategy to enroll residents aged 40 and older from five communities in Luzhou city of China. It was part of the Risk Evaluation of cAncers in Chinese diabeTic Individuals: a lONgitudinal (REACTION) study, a multicentre prospective observational study investigating the association between diabetes and the risk of cancer in mainland China [15]. A total of 10,007 residents were enrolled in 2011, who were revisited in 2014 and/or 2016.

The Tianjin Chronic Low-grade Systemic Inflammation and Health Cohort Study (TCLSIH) was a large prospective dynamic cohort study that randomly recruited participants during routine preventive examinations (annual physical examinations) at the Tianjin Medical University General Hospital-Health Management Centre. The TCLSIH mainly focused on the relationship between chronic low-grade systemic inflammation and the health status of a population living in Tianjin city of China [16]. Between 2007 and 2018, 42,521 participants were enrolled and followed annually.

Assessment and definition of glycemia

In the ACE study, fasting plasma glucose (FPG) was measured every 4 months and a 75 g OGTT was performed annually, with a confirmatory OGTT done if either of these tests suggested diabetes. In the TCLSIH and Luzhou cohorts, FPG, HbA1c and 2-h plasma glucose (2HPG) from OGTT were measured at baseline and during subsequent revisits. Definitions of diabetes and IH in these three validation populations were all based on the 1999 World Health Organization diagnostic criteria [17]. Specifically, progression to diabetes was defined as an elevated FPG (≥ 7.0 mmol/L) and/or 2HPG (≥ 11.1 mmol/L), or a diagnosis of diabetes made by physicians, which in the ACE study would be further confirmed by the independent ACE Diabetes Adjudication Committee.

Inclusion of validation populations

Participants with IH at baseline and had information on diabetes status during follow-up were eligible for this validation study. Additionally, only the placebo group of the ACE study were considered for the validation analysis because acarbose has been shown to reduce the risk of diabetes [14].

Statistical analysis and model validation

Missing data and missing predictors

There were less than 10% of missing values for most variables, except for prior hypertension (15%) and prior cardiovascular disease (17%) in the Luzhou cohort, and current alcohol drinking (15%) in the TCLSIH cohort. Missing values were imputed by multiple imputations (MICE package, R). We repeated the validation analyses among three cohorts using only complete cases of the requisite variables as a sensitivity analysis.

Information for most predictors were available in all three validation cohorts. When no information of predictors was available in the validation datasets, a fixed value for the “missing variables” (i.e., “0” for categorial variables and a fixed number for continuous variables) was used for validation analysis.

Predicted vs. observed risk

Comparing the predicted risk with the observed risk in the validation populations indicates whether the prediction model overestimates or underestimates actual risk. We calculated the predicted to observed risk ratio (P/O) with a 95% confidence interval to quantify this comparison. A P/O value equal to 1.0, or its 95% CI crossing 1.0, indicates that the predicted risk falls within the observed risk range, whereas P/O values less or more than 1.0 suggested that the model underestimates or overestimates the actual risk respectively.

As the prediction horizon of the models examined could differ from the median follow-up duration of the validation cohorts, predictions were standardized by dividing predicted risk was by the prediction horizon (years), multiplied by the actual median follow-up time (years) of the validation cohort. This is based on our assumption that the annual risk of progression to diabetes from IH does not vary over time, as seen in previous diabetes prevention trials [18].

Discrimination and calibration

Discrimination indicates the ability of a prediction model to separate those who develop diabetes from those who do not. We used the C-statistic to classify discrimination, as poor (0.5 to < 0.6), moderate (0.6 to < 0.7), good (0.7 to < 0.8), very good (0.8 to < 0.9) or excellent (≥ 0.9) [19].

Calibration measures how closely predicted outcomes agree with observed outcomes across groups of individuals. The overall calibration feature can be estimated by the Hosmer–Lemeshow test, with a good fit indicated by a P-value > 0.05.

Recalibration

Differences in the incidence rate of diabetes between the derivation populations and the validation populations would lead to significant deviations between the predicted risk (by the prediction models) and observed risk in the validation cohorts. Accordingly, we recalibrated each prediction model by adjusting the intercept (for logistic regression models) or the baseline survival function (for survival regression models). The recalibration process does not affect discrimination, so only P/O values and calibration were re-evaluated after recalibration.

Risk stratification for Chinese IH

The ability of risk stratification for Chinese IH was compared between the validated risk prediction models and the “Chinese IH risk stratification” strategy. The cut-off points for risk stratification using prediction models were based on annual diabetes risk as described previously (modest risk: 0–5%; moderate risk: 5–10%; high risk: > 10%) [20].

This external validation study was reported in compliance with the TRIPOD statement [21]. P < 0.05 was considered to be statistically significant. All statistical analyses were performed using R (version 4.1.2).

Results

Characteristics of the included models

The systematic literature review process is shown in Additional file 1: Figure S1. A total of 5173 records (MEDINLE n = 1810, EMBASE n = 3363) were identified through database searches. After removal of duplicates, 3736 records were assessed for eligibility, of which 44 Asian-derived (41 all-Asian and three part-Asian) T2D risk prediction model studies were selected [20, 22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64]. With the five prespecified non-Asian derived diabetes risk prediction model studies [8,9,10,11,12], 49 T2D risk prediction model studies were included in this validation study. However, majority of these studies were at high (n = 43, 87.8%) or unclear (n = 3, 6.1%) risk of bias, while only three studies (6.1%) were scored at low risk of bias (Table 1 and Additional file 1: Supplementary Text).

Table 1 Characteristics of the included risk prediction models for incident type 2 diabetes

These 49 risk prediction model studies comprised 21 BASIC and 46 EXTENDED models for validation, with prediction horizons varying from 2.5 to 20 years. Model performances reported by the original studies are summarized in Additional file 1: Table S3. Their predictors varied from 4 to 17 items in BASIC models (age, body mass index, and blood pressure were the most commonly used non-invasive predictors), and 3 to 17 items in EXTENDED models (FPG, triglycerides, and HbA1C were most commonly-used laboratory predictors) (Additional file 1: Tables S4, S5).

Characteristics of the validation populations

A total of 3241, 1333, and 1702 IH participants of the ACE, Luzhou, and TCLSIH cohorts, respectively, were eligible for the main validation (Additional file 1: Figure S2). Their baseline characteristics are summarized in Additional file 1: Table S6. Among them, 509 (15.7%), 260 (19.5%), and 396 (23.3%) of the three cohorts, respectively, developed diabetes over a median follow-up of 5.0, 3.0, and 3.0 years.

External validation of the included models

In the ACE, Luzhou, and TCLSIH cohorts, BASIC models showed poor-to-moderate discrimination with C-statistics 0.52–0.60, 0.50–0.59, and 0.50–0.64, respectively. EXTENDED models showed poor-to-acceptable discrimination (C-statistic: 0.54–0.73, 0.52–0.67, and 0.59–0.78, respectively). The EXTENDED model of the Nateglinide and Valsartan in Impaired Glucose Tolerance Outcomes Research (NAVIGATOR) study (study 43) had the best discrimination in the three cohorts with C-statistics of 0.73, 0.67 and 0.78, respectively (Fig. 1 and Additional file 1: Tables S7, S8).

Fig. 1
figure 1

Discrimination of the included models in the A ACE, B Luzhou, and C TCLSIH cohorts. *: The corresponding specific study of each Study No. can be found in Table 1. The Study No. was ordered by the value of C-statistics. The Study No. marked with a square indicated that its prediction model had the best discrimination in the validation cohort, with a label of its C-statistic in the upper left corner of the figure

Fifteen BASIC and 40 EXTENDED models had full information (e.g., intercept or baseline survival function of regression equation, or detailed scoring system) for calculating predicted risk. They all showed poor calibration based on the Hosmer–Lemeshow test (P < 0.05). The majority of the 15 BASIC models underestimated (P/O: 0.11–0.79, 0.03–0.48, and 0.04–0.44) the diabetes risk among the ACE (6/14), Luzhou (14/15), and TCLSIH (14/15) cohorts. Most of the 40 EXTENDED models also underestimated (P/O: 0.08–0.87 and 0.08–0.90) the diabetes risk in the Luzhou (26/40) and TCLSIH cohorts (31/40), while most of them overestimated (P/O: 1.12–5.45) the diabetes risk in the ACE cohorts (27/39) (Additional file 1: Tables S7, S8).

Most of the recalibrated models showed improved calibration but significant deviations between the observed and predicted risk by them still existed. The recalibrated BASIC (P/O: 0.93–1.54, 0.92–1.42, and 0.87–1.43) and EXTENDED models (P/O: 0.92–5.76, 0.88–4.69, and 0.88–3.99) from modestly to severely overpredicted the diabetes risk in the ACE, Luzhou, and TCLSIH cohorts (Additional file 1: Tables S7, S8).

When broadening the validation samples to non-diabetic participants (i.e., including normoglycemia and IH) in the Luzhou and TCLSIH cohorts (Additional file 1: Tables S9, S10), similar tendencies were observed but most of the models showed slightly higher discrimination (C-statistic: 0.51–0.72 and 0.55–0.89 respectively). Sensitivity analyses revealed overall similar results when using complete cases only (Additional file 1: Tables S11, S12).

Risk stratification of IH

The majority (89.6%, 98.0% and 98.2% of IH participants of the ACE, Luzhou, and TCLSIH cohorts) were classified as high risk by the NAVIGATOR model. Obvious deviations between observed risks and predicted risks by the original NAVIGATOR model were seen among three cohorts (Fig. 2A–C). After recalibration, the deviations were significantly improved but overprediction was noted across all risk groups (Fig. 2D–F). Compared with the recalibrated NAVIGATOR model, the “Chinese IH risk stratification” strategy tended to misclassify the individuals of modest or moderate risk into high risk among three cohorts (Fig. 3).

Fig. 2
figure 2

Predicted (vs. observed) diabetes risk of the original NAVIGATOR model in three risk classes of the A ACE, B Luzhou, and C TCLSIH cohorts, and the recalibrated NAVIGATOR model in D ACE, E Luzhou, and F TCLSIH cohorts

Fig. 3
figure 3

Risk stratification for the A ACE, B Luzhou, and C TCLSIH cohorts

Discussion

We conducted an external validation of 21 BASIC and 46 EXTENDED T2D risk prediction models in three independent prospective Chinese cohorts of people with IH. We found that BASIC models to predict T2D did not exhibit good discrimination or calibration while several EXTENDED models had acceptable discrimination but poor calibration. Most of the recalibrated models showed better calibration but still modestly to severely overestimated the diabetes risk in three populations.

People with IH are at high risk of diabetes development. It has been suggested that all people with IH are encouraged to practice appropriate lifestyle modifications while those at higher absolute risk may benefit from more intensive lifestyle modification and evidence-based preventive medications [20]. Therefore, knowledge of the future absolute risk of T2D is critical to inform the choice of intensity of the preventive intervention needed.

Thus, we conducted this validation study among three independent Chinese IH populations of different study settings. The Luzhou cohort is community-based population, while the TCLSIH and ACE cohorts are a health check-up-based population and a randomized intervention trial population, respectively. Compared with the Luzhou and ACE cohorts, the IH participants of the TCLSIH cohort were youngest but had the worst metabolic phenotypes (more likely to smoke, take alcohol, and have highest obese measurements and worst lipid profiles). The TCLSIH cohort had the highest annual diabetes incidence rate (23.3% vs. 19.5% and 15.7% over a median follow-up of 3.0, 3.0, and 5.0 years, respectively). This is consistent with previous findings showing that the age of IH onset is inversely associated with future diabetes progression risk [20, 62].

The majority of the included T2D risk prediction model studies showed an overall high or unclear risk of bias, which indicated that their predictive performance when used in practice is probably lower than that reported. This is consistent with our findings at validation.

The clinical usefulness of a model depends largely on its discrimination. Our results showed that all of the BASIC models did not have good discrimination in three Chinese IH cohorts, whilst several EXTENDED models did. In contrast, our validation results and previous validation studies [65] in non-diabetic participants (i.e., including normoglycemia and IH) showed that BASIC models could help identify individuals at high diabetes risk among non-diabetic population. These findings suggest that incorporating non-invasive information to predict diabetes risk is feasible to assess the risk of diabetes but not sufficient for the people with IH. Among the EXTENDED models, the NAVIGATOR model was one of the few models containing three glycaemic measurements (FPG, 2HPG and HbA1C) and at low risk of bias, which had the best discrimination in three validation cohorts. Previous findings of hyperglycaemia are obviously important predictors among the routinely-available clinical variables for predicting diabetes risk [1], since diabetes is a disease with slow progress from IH to diabetes. Therefore, among the existing models to predict the incident risk of T2D, the NAVIGATOR model is presumed to have the best discriminative ability for Chinese IH populations when FPG, 2HPG and HbA1C values are available.

Calibration is also an essential requirement when the aim of using a prediction model is to inform decision-making in clinical practice. Our results showed that nearly all BASIC models and several EXTENDED models underestimated the actual diabetes risk in three validation populations. After recalibration (adjusting for the differences in the incidence of diabetes between the development populations and our validation populations), all models showed better calibration but were overall overpredicting the actual diabetes risk. It can be seen in the recalibrated NAVIGATOR model that this overestimation occurred in all risk groups. This overestimation may induce an unnecessary burden of overtreatment for individuals at actual low risk.

As for risk stratification, the “Chinese IH risk stratification” seemed an unsuitable strategy for risk stratification to guide primary prevention measures for Chinese IH populations. The fact is that the majority of IH individuals have at least one of the specified risk factors, meaning that they are very likely to be classified into the high-risk group. As seen in this study, many people with IH were misclassified into a higher risk category when using the “Chinese IH risk stratification” than using the recalibrated NAVIGATOR model. That is, many people with IH were up-classified as high risk by the “Chinese IH risk stratification”. The clinical implication of this up-classification was that it also increased the treatment burden for individuals at actual low risk.

In this study, we comprehensively validated the performances of the existing Asian and non-Asian derived models to predict the risk of incident T2D in three independent Chinese IH cohorts. Due to the large sample size, prospective longitudinal cohort design and contemporary nature of three validation cohorts, our findings were stable and generalizable. However, our study has some limitations. Firstly, glycemia was assessed more frequently in the ACE (annual OGTT and a confirmatory OGTT if necessary) and TCLSIH (annual OGTT) cohorts than in the Luzhou (OGTT only once at follow-up end) cohort. This might have led to under ascertainment of diabetes incidence (e.g., false-negative cases) to some extent, which resulted in underestimating the C-statistics in the Luzhou cohort and influencing calibration as we found in our validation results. Secondly, some validation datasets did not involve the collection of some parameters such as physical activity, dietary habits and education, which may have limited the performance of some validated models. However, most of the required variables were available in three datasets. Thus, it is unlikely that this influenced our results to a large extent. Similarly, missing data were only limited for a few participants, and this was handled by multiple imputations. We also conducted complete cases analyses, which yielded similar results to support our findings. Thirdly, while IH participants of the ACE cohort all had previous cardiovascular disease (CVD), IH participants of the Luzhou and TCLSIH cohorts had only a few people with prior CVD (5.6% and 9.8%, respectively). Due to the limited sample size of people with CVD in these two cohorts, we are unable to further explore whether the performance of the prediction models differed by CVD status in these cohorts. Fourthly, for models with different prediction horizons from the median follow-up duration of our validation cohorts, the predicted risks were projected based on the assumption that annual risk of incident T2D is equal, as seen in previous diabetes prevention trials [18]. But this may still to some extent influence our evaluation.

Generally speaking, our systematic review and external validation study indicated that the vast majority of published T2D models were not built with a robust modelling method and had poor external validity in Chinse people with IH. This implies that researchers should direct their efforts to help improve the generalizability of T2D models in the future, such as by applying a robust modelling method (e.g., select the representative derivation populations, handle missing data appropriately, and correct for model overfitting/optimism), and transparently reporting the models following the TRIPOD statement guideline which has been developed to support authors writing reports describing the development, validation or updating of prediction models. Furthermore, we encourage external validation research on the existing T2D models to understand their external validity on independent data, so as to know whether they can be effectively put into practice in a target population.

Conclusions

For Chinese people with IH, BASIC models to predict T2D did not exhibit good discrimination or calibration. Several EXTENDED models performed better, but a robust Chinese diabetes risk prediction tool in people with IH remains an unmet need. To use these models to inform decision-making in clinical practice, in particular calibration needs to be further improved.

Availability of data and materials

Requests for data access and proposals for analyses of ACE can be submitted to the ACE Publications Committee using instructions found at: https://www.dtu.ox.ac.uk/ACE/. The datasets of the Luzhou and TCLSIH cohorts are available from the corresponding author on reasonable request.

Abbreviations

ACE:

Acarbose Cardiovascular Evaluation

CHARMS:

Checklist for critical appraisal and data extraction for systemic review of prediction modelling studies

FPG:

Fasting plasma glucose

2HPG:

2-H plasma glucose

IFG:

Impaired fasting glucose

IGT:

Impaired glucose tolerance

IH:

Intermediate hyperglycemia

NAVIGATOR:

Nateglinide and Valsartan in Impaired Glucose Tolerance Outcomes Research

OGTT:

Oral glucose tolerance test

REACTION:

Risk Evaluation of cAncers in Chinese diabeTic Individuals: a lONgitudinal

T2D:

Type 2 diabetes

PROBAST:

Prediction study Risk of Bias Assessment tool

TCLSIH:

Tianjin Chronic Low-grade Systemic Inflammation and Health Cohort Study

References

  1. Schmidt MI, Bracco PA, Yudkin JS, Bensenor IM, Griep RH, Barreto SM, et al. Intermediate hyperglycaemia to predict progression to type 2 diabetes (ELSA-Brasil): an occupational cohort study in Brazil. Lancet Diabetes Endocrinol. 2019;7:267–77.

    Article  PubMed  Google Scholar 

  2. Richter B, Hemmingsen B, Metzendorf M-I, Takwoingi Y. Development of type 2 diabetes mellitus in people with intermediate hyperglycaemia. In: Cochrane Metabolic and Endocrine Disorders Group, editor. Cochrane Database Syst Rev. 2018.

  3. Wagner R, Heni M, Tabák AG, Machann J, Schick F, Randrianarisoa E, et al. Pathophysiology-based subphenotyping of individuals at elevated risk for type 2 diabetes. Nat Med. 2021;27:49–57.

    Article  CAS  PubMed  Google Scholar 

  4. International Diabetes Federation. IDF diabetes atlas. 10th ed. Brussels: International Diabetes Federation; 2021.

    Google Scholar 

  5. Endocrinology CS of, Society CD, Association CE, Association E and MDB of CRH, Association DB of CRH. Intervention for adults with pre-diabetes: a Chinese expert consensus. Chin J Endocrinol Metab. 2020;36:371–80.

    Google Scholar 

  6. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Moons KGM, de Groot JAH, Bouwmeester W, Vergouwe Y, Mallett S, Altman DG, et al. Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS Checklist. PLoS Med. 2014;11:e1001744.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Stern MP, Williams K, Haffner SM. Identification of persons at high risk for type 2 diabetes mellitus: do we need the oral glucose tolerance test? Ann Intern Med. 2002;136:575–81.

    Article  PubMed  Google Scholar 

  9. Lindstrom J, Tuomilehto J. The Diabetes Risk Score: a practical tool to predict type 2 diabetes risk. Diabetes Care. 2003;26:725–31.

    Article  PubMed  Google Scholar 

  10. Schmidt MI, Duncan BB, Bang H, Pankow JS, Ballantyne CM, Golden SH, et al. Identifying individuals at high risk for diabetes: the Atherosclerosis Risk in Communities study. Diabetes Care. 2005;28:2013–8.

    Article  PubMed  Google Scholar 

  11. Wilson PWF. Prediction of incident diabetes mellitus in middle-aged adults: the Framingham Offspring Study. Arch Intern Med. 2007;167:1068.

    Article  PubMed  Google Scholar 

  12. Tuomilehto J, Lindström J, Hellmich M, Lehmacher W, Westermeier T, Evers T, et al. Development and validation of a risk-score model for subjects with impaired glucose tolerance for the assessment of the risk of type 2 diabetes mellitus—The STOP-NIDDM risk-score. Diabetes Res Clin Pract. 2010;87:267–74.

    Article  CAS  PubMed  Google Scholar 

  13. Venema E, Wessler BS, Paulus JK, Salah R, Raman G, Leung LY, et al. Large-scale validation of the prediction model risk of bias assessment Tool (PROBAST) using a short form: high risk of bias models show poorer discrimination. J Clin Epidemiol. 2021;138:32–9.

    Article  PubMed  Google Scholar 

  14. Holman RR, Coleman RL, Chan JCN, Chiasson J-L, Feng H, Ge J, et al. Effects of acarbose on cardiovascular and diabetes outcomes in patients with coronary heart disease and impaired glucose tolerance (ACE): a randomised, double-blind, placebo-controlled trial. Lancet Diabetes Endocrinol. 2017;5:877–86.

    Article  CAS  PubMed  Google Scholar 

  15. Bi Y, Lu J, Wang W, Mu Y, Zhao J, Liu C, et al. Cohort profile: risk evaluation of cancers in Chinese diabetic individuals: a longitudinal (REACTION) study. J Diabetes. 2014;6:147–57.

    Article  CAS  PubMed  Google Scholar 

  16. Song K, Du H, Zhang Q, Wang C, Guo Y, Wu H, et al. Serum immunoglobulin M concentration is positively related to metabolic syndrome in an adult population: Tianjin Chronic Low-Grade Systemic Inflammation and Health (TCLSIH) Cohort Study. PLoS ONE. 2014;9:e88701.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  17. World Health Organization. Definition, diagnosis and classification of diabetes mellitus and its complications: report of a WHO consultation. Part 1, Diagnosis and classification of diabetes mellitus. Geneva: World Health Organization; 1999.

    Google Scholar 

  18. Tuomilehto J, Peltonen M, Eriksson JG, Ilanne-Parikka P. Improved lifestyle and decreased diabetes risk over 13 years: long-term follow-up of the randomised Finnish Diabetes Prevention Study (DPS). Diabetologia. 2013;56:284–93.

    Article  PubMed  Google Scholar 

  19. Hosmer D, Lemeshow S. Applied logistic regression. Chapter 5. 3rd ed. New York: Wiley; 2013.

    Book  Google Scholar 

  20. Bethel MA, Chacra AR, Deedwania P, Fulcher GR, Holman RR, Jenssen T, et al. A novel risk classification paradigm for patients with impaired glucose tolerance and high cardiovascular risk. Am J Cardiol. 2013;112:231–7.

    Article  PubMed  Google Scholar 

  21. Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ. 2015;350:g7594.

    Article  PubMed  Google Scholar 

  22. Aekplakorn W, Bunnag P, Woodward M, Sritara P, Cheepudomwit S, Yamwong S, et al. A risk score for predicting incident diabetes in the Thai population. Diabetes Care. 2006;29:1872–7.

    Article  PubMed  Google Scholar 

  23. Chien K, Cai T, Hsu H, Su T, Chang W, Chen M, et al. A prediction model for type 2 diabetes risk among Chinese people. Diabetologia. 2009;52:443–50.

    Article  CAS  PubMed  Google Scholar 

  24. Gao WG, Qiao Q, Pitkäniemi J, Wild S, Magliano D, Shaw J, et al. Risk prediction models for the development of diabetes in Mauritian Indians. Diabet Med. 2009;26:996–1002.

    Article  CAS  PubMed  Google Scholar 

  25. Sun F, Tao Q, Zhan S. An accurate risk score for estimation 5-year risk of type 2 diabetes based on a health screening population in Taiwan. Diabetes Res Clin Pract. 2009;85:228–34.

    Article  PubMed  Google Scholar 

  26. Chuang S-Y, Yeh W-T, Wu Y-L, Chang H-Y, Pan W-H, Tsao C-K. Prediction equations and point system derived from large-scale health check-up data for estimating diabetic risk in the Chinese population of Taiwan. Diabetes Res Clin Pract. 2011;92:128–36.

    Article  PubMed  Google Scholar 

  27. Liu M, Pan C, Jin M. A Chinese diabetes risk score for screening of undiagnosed diabetes and abnormal glucose tolerance. Diabetes Technol Ther. 2011;13:501–7.

    Article  PubMed  Google Scholar 

  28. Doi Y, Ninomiya T, Hata J, Hirakawa Y, Mukai N, Iwase M, et al. Two risk score models for predicting incident Type 2 diabetes in Japan: two diabetes risk score models in Japan. Diabet Med. 2012;29:107–14.

    Article  CAS  PubMed  Google Scholar 

  29. Heianza Y, Arase Y, Hsieh SD, Saito K, Tsuji H, Kodama S, et al. Development of a new scoring system for predicting the 5 year incidence of type 2 diabetes in Japan: the Toranomon Hospital Health Management Center Study 6 (TOPICS 6). Diabetologia. 2012;55:3213–23.

    Article  CAS  PubMed  Google Scholar 

  30. Lim N-K, Park S-H, Choi S-J, Lee K-S, Park H-Y. A risk score for predicting the incidence of type 2 diabetes in a middle-aged Korean cohort. Circ J. 2012;76:1904–10.

    Article  CAS  PubMed  Google Scholar 

  31. Xu L, Jiang CQ, Schooling CM, Zhang WS, Cheng KK, Lam TH. Prediction of 4-year incident diabetes in older Chinese: recalibration of the Framingham diabetes score on Guangzhou Biobank Cohort Study. Prev Med. 2014;69:63–8.

    Article  CAS  PubMed  Google Scholar 

  32. Ye X, Zong G, Liu X, Liu G, Gan W, Zhu J, et al. Development of a new risk score for incident type 2 diabetes using updated diagnostic criteria in middle-aged and older Chinese. PLoS ONE. 2014;9:e97042.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  33. Nanri A, Nakagawa T, Kuwahara K, Yamamoto S, Honda T, Okazaki H, et al. Development of risk score for predicting 3-year incidence of type 2 diabetes: Japan Epidemiology Collaboration on Occupational Health Study. PLoS ONE. 2015;10:e0142779.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  34. Liu X, Chen Z, Fine JP, Liu L, Wang A, Guo J, et al. A competing-risk-based score for predicting twenty-year risk of incident diabetes: the Beijing Longitudinal Study of Ageing study. Sci Rep. 2016;6:37248.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. Wang A, Chen G, Su Z, Liu X, Liu X, Li H, et al. Risk scores for predicting incidence of type 2 diabetes in the Chinese population: the Kailuan prospective study. Sci Rep. 2016;6:26548.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Zhang M, Zhang H, Wang C, Ren Y, Wang B, Zhang L, et al. Development and validation of a risk-score model for type 2 diabetes: a cohort study of a rural adult Chinese population. PLoS ONE. 2016;11:e0152054.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  37. Miyakoshi T, Oka R, Nakasone Y, Sato Y, Yamauchi K, Hashikura R, et al. Development of new diabetes risk scores on the basis of the current definition of diabetes in Japanese subjects [Rapid Communication]. Endocr J. 2016;63:857–65.

    Article  PubMed  Google Scholar 

  38. Chen X, Wu Z, Chen Y, Wang X, Zhu J, Wang N, et al. Risk score model of type 2 diabetes prediction for rural Chinese adults: the Rural Deqing Cohort Study. J Endocrinol Invest. 2017;40:1115–23.

    Article  CAS  PubMed  Google Scholar 

  39. Wen J, Hao J, Liang Y, Li S, Cao K, Lu X, et al. A non-invasive risk score for predicting incident diabetes among rural Chinese people: a village-based cohort study. PLoS ONE. 2017;12:e0186172.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  40. Yokota N, Miyakoshi T, Sato Y, Nakasone Y, Yamashita K, Imai T, et al. Predictive models for conversion of prediabetes to diabetes. J Diabetes Complicat. 2017;31:1266–71.

    Article  CAS  Google Scholar 

  41. Zhang H, Wang C, Ren Y, Wang B, Yang X, Zhao Y, et al. A risk-score model for predicting risk of type 2 diabetes mellitus in a rural Chinese adult population: a cohort study with a 6-year follow-up. Diabetes Metab Res Rev. 2017;33:e2911.

    Article  CAS  Google Scholar 

  42. Ha KH, Lee Y, Song SO, Lee J, Kim DW, Cho K, et al. Development and validation of the Korean Diabetes Risk Score: a 10-year national cohort study. Diabetes Metab J. 2018;42:402.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Han X, Wang J, Li Y, Hu H, Li X, Yuan J, et al. Development of a new scoring system to predict 5-year incident diabetes risk in middle-aged and older Chinese. Acta Diabetol. 2018;55:13–9.

    Article  PubMed  Google Scholar 

  44. Hu H, Nakagawa T, Yamamoto S, Honda T, Okazaki H, Uehara A, et al. Development and validation of risk models to predict the 7-year risk of type 2 diabetes: The Japan Epidemiology Collaboration on Occupational Health Study. J Diabetes Investig. 2018;9:1052–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  45. Ustulin M, Rhee SY, Chon S, Ahn KK, Lim JE, Oh B, et al. Importance of family history of diabetes in computing a diabetes risk score in Korean prediabetic population. Sci Rep. 2018;8:15958.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  46. Yatsuya H, Li Y, Hirakawa Y, Ota A, Matsunaga M, Haregot HE, et al. A point system for predicting 10-year risk of developing type 2 diabetes mellitus in Japanese men: Aichi workers’ cohort study. J Epidemiol. 2018;28:347–52.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Wang K, Gong M, Xie S, Zhang M, Zheng H, Zhao X, et al. Nomogram prediction for the 3-year risk of type 2 diabetes in healthy mainland China residents. EPMA J. 2019;10:227–37.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Cai X, Zhu Q, Wu T, Zhu B, Aierken X, Ahmat A, et al. Development and validation of a novel model for predicting the 5-year risk of type 2 diabetes in patients with hypertension: a retrospective cohort study. Biomed Res Int. 2020;2020:9108216.

    PubMed  PubMed Central  Google Scholar 

  49. Hu H, Wang J, Han X, Li Y, Miao X, Yuan J, et al. Prediction of 5-year risk of diabetes mellitus in relatively low risk middle-aged and elderly adults. Acta Diabetol. 2020;57:63–70.

    Article  CAS  PubMed  Google Scholar 

  50. Lin Z, Guo D, Chen J, Zheng B. A nomogram for predicting 5-year incidence of type 2 diabetes in a Chinese population. Endocrine. 2020;67:561–8.

    Article  CAS  PubMed  Google Scholar 

  51. Liu Q, Yuan J, Bakeyi M, Li J, Zhang Z, Yang X, et al. Development and validation of a nomogram to predict type 2 diabetes mellitus in overweight and obese adults: a prospective cohort study from 82938 adults in China. Int J Endocrinol. 2020;2020:8899556.

    PubMed  PubMed Central  Google Scholar 

  52. Liu X, Li Z, Zhang J, Chen S, Tao L, Luo Y, et al. A novel risk score for type 2 diabetes containing sleep duration: a 7-year prospective cohort study among Chinese participants. J Diabetes Res. 2020;2020:2969105.

    PubMed  PubMed Central  Google Scholar 

  53. Ma C-M, Yin F-Z. Glycosylated hemoglobin A1c improves the performance of the nomogram for predicting the 5-year incidence of type 2 diabetes. Diabetes Metab Syndr Obes. 2020;13:1753–62.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  54. Shao X, Wang Y, Huang S, Liu H, Zhou S, Zhang R, et al. Development and validation of a prediction model estimating the 10-year risk for type 2 diabetes in China. PLoS ONE. 2020;15:e0237936.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  55. Wang H, Zheng X, Bai Z-H, Lv J-H, Sun J-L, Shi Y, et al. A retrospective population study to develop a predictive model of prediabetes and incident type 2 diabetes mellitus from a hospital database in Japan between 2004 and 2015. Med Sci Monit. 2020;26:e920880.

    CAS  PubMed  PubMed Central  Google Scholar 

  56. Wu Y, Hu H, Cai J, Chen R, Zuo X, Cheng H, et al. A prediction nomogram for the 3-year risk of incident diabetes among Chinese adults. Sci Rep. 2020;10:21716.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  57. Cai X-T, Ji L-W, Liu S-S, Wang M-R, Heizhati M, Li N-F. Derivation and validation of a prediction model for predicting the 5-year incidence of type 2 diabetes in non-obese adults: a population-based cohort study. Diabetes Metab Syndr Obes. 2021;14:2087–101.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Cai X, Zhu Q, Cao Y, Liu S, Wang M, Wu T, et al. A prediction model based on noninvasive indicators to predict the 8-year incidence of type 2 diabetes in patients with nonalcoholic fatty liver disease: a population-based retrospective cohort study. Biomed Res Int. 2021;2021:5527460.

    PubMed  PubMed Central  Google Scholar 

  59. Li L, Wang Z, Zhang M, Ruan H, Zhou L, Wei X, et al. New risk score model for identifying individuals at risk for diabetes in southwest China. Prev Med Rep. 2021;24:101618.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Liang K, Guo X, Wang C, Yan F, Wang L, Liu J, et al. Nomogram predicting the risk of progression from prediabetes to diabetes after a 3-year follow-up in Chinese adults. Diabetes Metab Syndr Obes. 2021;14:2641–9.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Wu Y, Hu H, Cai J, Chen R, Zuo X, Cheng H, et al. Machine learning for predicting the 3-year risk of incident diabetes in Chinese adults. Front Public Health. 2021;9:626331.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Xu S, Scott CAB, Coleman RL, Tuomilehto J, Holman RR. Predicting the risk of developing type 2 diabetes in Chinese people who have coronary heart disease and impaired glucose tolerance. J Diabetes. 2021;13:817–26.

    Article  CAS  PubMed  Google Scholar 

  63. Chen L, Magliano DJ, Balkau B, Colagiuri S, Zimmet PZ, Tonkin AM, et al. AUSDRISK: an Australian Type 2 Diabetes Risk Assessment Tool based on demographic, lifestyle and simple anthropometric measures. Med J Aust. 2010;192:6.

    Article  Google Scholar 

  64. Hippisley-Cox J, Coupland C. Development and validation of QDiabetes-2018 risk prediction algorithm to estimate future risk of type 2 diabetes: cohort study. BMJ. 2017;359:j5019.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Kengne AP, Beulens JW, Peelen LM, Moons KG, van der Schouw YT, Schulze MB, et al. Non-invasive risk scores for prediction of type 2 diabetes (EPIC-InterAct): a validation of existing models. Lancet Diabetes Endocrinol. 2014;2:19–29.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We gratefully acknowledge all the medical staff, researchers, and participants in the ACE, Luzhou, and TCLSIH cohorts. Parts of this work have been presented in a publication only 2020 Lancet–Chinese Academy of Medical Sciences (CAMS) Health Conference abstract.

Funding

This work was supported by 1.3.5 Project for Disciplines of Excellence, West China Hospital, Sichuan University (Grant no. ZYGD18017 to NT).

Author information

Authors and Affiliations

Authors

Contributions

NT, RRH, JT, RLC, and SX were responsible for the study’s concept and design. RLC, QW, YG, GM, KS, and KN did the data and project management. SX, ZS, QX, and KN did the data cleaning and analysis. SX, RLC, ZS, JT, RRH, and NT interpreted the data and drafted the manuscript. RRH designed the ACE trial and had full access to all the ACE data. QW was the principal investigator of the Luzhou cohort and had full access to all the data of the Luzhou cohort. KN was the principal investigator of the TCLSIH cohort and had full access to all the data of the TCLSIH cohort. NT is the guarantor of this work. All authors read and approved the final manuscript, and agreed to be accountable for all aspects of the work.

Corresponding authors

Correspondence to Kaijun Niu or Nanwei Tong.

Ethics declarations

Ethics approval and consent to participate

The ACE protocol was approved by the University of Oxford Tropical Research Ethics Committee, and by central or local ethics committees (as appropriate) at participating sites. The protocol of the Luzhou and TCLSIH cohorts was approved by the Medical Ethics Committee of Ruijin Hospital, Shanghai Jiao Tong University (Shanghai, China), and Institutional Review Board of Tianjin Medical University (Tianjin, China) respectively. Written informed consent was obtained from all participants.

Consent for publication

Not applicable.

Competing interests

SX, RLC, QW, YG, GM, KS, ZS, QX, KN, and NT have no disclosures. JT reports research grants and fees for consultancy and advisory board membership from Bayer AG (related to the present study) and Eli Lilly, and he owns stocks in Orion Pharma and Aktivolabs. RRH reports research support from AstraZeneca, Bayer and Merck Sharp & Dohme, and personal fees from Bayer, Intarcia, Merck Sharp & Dohme, Novartis and Novo Nordisk.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Supplementary Text. Figure S1. The literature review process of searching Asian-derived type 2 diabetes risk prediction models. Figure S2. Flowchart of the study population selection process of the ACE, Luzhou, and TCLSIH cohorts. Table S1. PRISMA checklist for reporting systematic review. Table S2. Checklist for critical appraisal and data extraction for systemic review of prediction modelling studies (CHARMS). Table S3. The performance of the included BASIC and EXTENDED models reported in their original studies. Table S4. Predictors included in the BASIC models (N = 21). Table S5. Predictors included in the EXTENDED models (N = 46). Table S6. Baseline characteristics of the participants with intermediate hyperglycemia at baseline of the ACE, Luzhou, and TCLSIH cohorts. Table S7. The validation results of the included BASIC models in intermediate hyperglycemia participants of the ACE, Luzhou, and TCLSIH cohorts. Table S8. The validation results of the included EXTENDED models in intermediate hyperglycemia participants of the ACE, Luzhou, and TCLSIH cohorts. Table S9. The validation results of the included BASIC models in non-diabetic participants of the Luzhou and TCLSIH cohorts. Table S10. The validation results of the included EXTENDED models in non-diabetic participants of the Luzhou and TCLSIH cohorts. Table S11. The validation results of the included BASIC models in intermediate hyperglycemia participants of the ACE, Luzhou, and TCLSIH cohorts when using complete cases for analysis. Table S12. The validation results of the included EXTENDED models in intermediate hyperglycemia participants of the ACE, Luzhou, and TCLSIH cohorts when using complete cases for analysis.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, S., Coleman, R.L., Wan, Q. et al. Risk prediction models for incident type 2 diabetes in Chinese people with intermediate hyperglycemia: a systematic literature review and external validation study. Cardiovasc Diabetol 21, 182 (2022). https://doi.org/10.1186/s12933-022-01622-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12933-022-01622-5

Keywords