Differential HbA1c response in the placebo arm of DPP-4 inhibitor clinical trials conducted in China compared to other countries: a systematic review and meta-analysis

Background It has been observed that the efficacy of dipeptidyl peptidase-4 (DPP-4) inhibitors as compared to the placebo groups in some clinical trials conducted in China is weaker than that in trials conducted outside China, leading to the suspicion that this may be caused by differential Glycosylated Hemoglobin (HbA1c) response in the placebo arm of DPP-4 inhibitor clinical trials conducted in China compared to other countries. Methods We searched published articles and other documents related to phase III placebo-control trials of DPP-4 inhibitors in Type 2 diabetes mellitus (T2DM). We included studies from different countries and compared those conducted in China to those conducted in other countries. Meta-regression analysis was used to analyze the HbA1c response in the placebo arms. Results A total of 66 studies met the inclusion criteria and 10 were conducted within China. There were a total of 8303 participants (mean age 56, male 57 %) in placebo groups. The pooled change in HbA1c for the placebo groups of 10 trials conducted in patients with T2DM in China was 0.26 % (95 % CI [-0.36 %, -0.16 %], p-value < 0.001), compared to 0.015 % (95 % CI [-0.05 %, 0.08 %], p-value is 0.637) for 56 trials conducted outside of China. The difference of placebo effect between trials conducted in and outside China is -0.273 % (95 % CI [-0.42 %, -0.13 %], p-value is less than 0.001) while after excluding trials conducted in Japan, the difference is -0.203 % (95 % CI [-0.35 %, -0.06 %], p-value is 0.005). They are both statistically significant. Conclusions The meta-analysis in the article demonstrates that there is statistically significant difference in the HbA1c response in the placebo arm of DPP-4 inhibitor clinical trials conducted in China compared to other countries. This differential HbA1c response in the placebo arm should be taken into consideration by both experimenters and medical decision makers when future DPP-4 studies are conducted in China.


Background
Diabetes has become one of the most threatening noninfectious diseases. The prevention and treatment of diabetes is very important in China because China may have become a country with the largest number of diabetes patients. Most of these patients have type 2 diabetes mellitus (T2DM) [1]. Dipeptidyl peptidase-4 (DPP-4) inhibitors are a class of oral antihyperglycemic agents which has been proved to be better than some traditional treatments in many aspects [2][3][4]. The Guideline of Prevention and Treatment for T2DM in China [5] published by Chinese Diabetes Society places DPP-4 inhibitors second-line with metformin for combination therapy if metformin for monotherapy cannot control glycemic properly. Thus DPP-4 inhibitors are crucial for the treatment of T2DM in China.
However, it has been observed, in some clinical trials conducted in China, the efficacy of DPP-4 inhibitors is weaker than that in trials conducted outside China [6]. It has been suspected that this phenomenon may be caused by a higher placebo effect (i.e., differential HbA1c response in the placebo arm). So far, no one has investigated systematically whether this placebo effect truly exists. If this placebo effect exists, it is problematic for not only the ongoing studies but also further studies. Moreover, this medical information should be considered as an important factor for decision making in conducting DPP-4 trials in China in the future.
Consequently, there is a critical need to investigate the differential HbA1c response in the placebo arm in trials conducted in China. To serve this need, we did a metaanalysis to investigate HbA1c response in the placebo arm in phase III placebo-control clinical trials of DPP-4 inhibitors. We concentrated on the HbA1c response in the placebo arm in trials conducted in China. We also included studies from other countries and compared those conducted in China to those conducted in other countries.

Search strategy and inclusion criteria
We searched EMBASE, PubMed, Google Scholar, ClinicalTrials.gov and PharmaProject for phase III placebo-control clinical trials of DPP-4 inhibitors in T2DM until March 2016. The key words for searching were sitagliptin, saxagliptin, vildagliptin, linagliptin, alogliptin, Dipeptidyl peptidase-4 inhibitor and DPP-4. The publications of these trials came from EMBASE, PubMed, and Google. We also included those being completed with results, but unpublished, trials at ClinicalTrials.gov. We browsed the trial list of every drug in PharmaProject to ensure completeness.
The meta-analysis included randomized placebo controlled phase III clinical trials conducted in patients 18 Trials included in this meta-analysis met the following criteria: (1) Only randomized placebo controlled phase III clinical trials are included, (2) DPP-4 inhibitor as monopoly or combination therapy is compared with placebo, (3) patients should be treated for at least 12 weeks, (4) HbA1c is the primary endpoint, (5) the trials were conducted in China with independent results of Chinese patients or conducted outside China without Chinese patients.

Data extraction and quality evaluation
We extract characteristics and results of trials including the following items: location, experimental drug, combined drug, test duration, the number of patients included, average age, gender, diabetes duration, baseline HbA1c, and the change of HbA1c in control groups.
We used the scoring system developed by Jadad et al. [7] to evaluate the quality of the publications. Randomization, double-blinding, and description of withdraws are considered. Possible scores range from 0 to 5.

Statistical analysis
The package Metafor [8] in R was used to conduct statistical analysis for the HbA1c response in the placebo arm. This package consists of a collection of functions that allow the user to fit fixed-, random-, and mixedeffects models and to carry out meta-regression analysis. Weighted Mean change and 95 % confidence interval for changes from baseline in HbA1c in the placebo control groups were calculated. For studies in China, unless there was heterogeneity, we would use a fixed-effects model. Otherwise a random-effects model would be used. When comparing trials in China with those outside China, a mixed-effects model was performed. We use I 2 to determine heterogeneity [9] and leave-one-out to perform sensitivity analysis. Publication bias was examined by Egger's regression test [10].
The summarized information on the included studies is shown in Tables 1 and 2. Table 1 displays the information of studies conducted on Chinese patients in China. There are 4 trials for Sitagliptin, 3 trials for Vildagliptin, 2 trials for Linagliptin and 1trial for Alogliptin. A total of 1634 patients with T2DM in the placebo groups were included. Their average age is between 50 and 60 while the average durations of diabetes are quite different. Average baselines of HbA1c are above 8 %. The treatment time of most studies is 24 weeks while Mohan [14] has 18 weeks and NCT01289119 [17] has 16 weeks. Besides, NCT01076088 [12] and NCT01289119 [17] both have 3 placebo groups. Table 2 shows the 56 trials conducted on non-Chinese patients outside China. There are 21 trials for Sitagliptin, 13 trials for Vildagliptin, 9 trials for Linagliptin, 8 trials for Alogliptin and 5 trials for Saxagliptin. A total of 6669 patients with T2DM in the placebo groups were included. There is no significant difference in average age between patients in Tables 1 and 2, respectively, whereas the Japanese patients seem a little older than others. As for the duration of diabetes, patients in studies using insulin as the combination therapy suffered longer than others. The baselines of HbA1c range from 7.30 % to 9.30 %, and the variation is greater than those in Table 1. All the trials conducted in Japan treated patients for 12 weeks except Kadowaki 2013, and the treatment duration of most other studies in Table 2 is 24 weeks.

Differential HbA1c response in the placebo arm
We analyzed the placebo effect in all the trials, focusing on HbA1c change from baseline in controlled groups. Generally, placebo should not have a significant effect on HbA1c, even if there was combination therapy. The general HbA1c change from baseline in placebo controlled groups should be close to 0. However, it has been observed that there is a high placebo effect in some trials conducted in China [6]. We focused on HbA1c change Among 10 randomized placebo-controlled phase III clinical trials of DPP-4 inhibitors conducted in patients with T2DM in China, NCT01076088 [12] and NCT01289119 [17] have 3 placebo controlled groups with different combination therapy respectively. Thus totally 14 groups were included in the meta-analysis. Since there was substantial heterogeneity, randomeffects model was performed. The weighted mean change from baseline was calculated and forest plot was drawn. Results are shown in Fig. 2. The results show that HbA1c is declined by 0.42 % with a p-value less than 0.001 in the placebo arm of randomized placebo controlled phase III clinical trials of DPP-4 inhibitors conducted in patients with T2DM in China. The 95 % confidence interval is (-0.66 %, -0.18 %).
We noted that the heterogeneity index I 2 of this model is significantly large. Thus we performed a leave-one-out sensitivity analysis to detect the influence of each study. Each time we left one group out, then fitted the same model. We got the summary estimates and I 2 of 14 models with results shown in Fig. 3. We found that the estimates of models that left out NCT01076088-2 [12] or NCT01076088-3 [12] are significant different from those in the full model that included all the 14 groups. The other groups show less heterogeneity. In addition, from Fig. 2, we see that the placebo effects of NCT01076088-2 [12] and NCT01076088-3 [12] are much higher than others, both larger than 1 %. In these two groups, metformin was used as combination therapy, patients' baseline HbA1c were higher than average, and there were no information about the duration of diabetes. These might cause the significant difference in HbA1c decline between the two studies and others.
To decrease the heterogeneity, we further performed a random-effect model excluding these two groups. The weighted mean change from baseline was calculated and a forest plot was drawn. Results are shown in Fig. 4. In this model, I 2 declines to 71.63 %. We also performed a leave-one-out sensitivity analysis on this model. While leaving out some studies would decrease I 2 , the estimates wouldn't change much. The results based on the model excluding NCT01076088-2 [12] and NCT01076088-3 [12] indicate that, HbA1c in placebo controlled groups declined by 0.26 % with 95 % confidence interval being (-0.36 %, -0.16 %) and p-value less than 0.001 (Fig. 4).
Egger's regression test shows there is no publication bias (p-value is 0.802).
The results based on either of the two models (i.e., the full model and the model excluding two heterogeneous studies) show a significant placebo effect in the placebo arm in the same direction as the DDP-4 inhibitor's effect. These results provide statistically significant evidence that the placebo effect is not 0 in randomized placebo controlled phase III clinical trials of DPP-4 inhibitors conducted in patients with T2DM in China.   Considering minimizing the impact of heterogeneity in the analysis, the analysis based on the model excluding the two heterogeneous studies may be more reliable. Thus, for future reference, we may conclude that placebo decreases HbA1c by 0.26 % (95 % CI [-0.36 %, -0.16 %] and p-value less than 0.001) generally in trials conducted in Chinese patients in China (Fig. 4).
We compared trials conducted in China with those outside China using a mixed-effects model. Table 3 shows the analysis results. The model is fitted with location as a moderator. We treat location as a binary variable, 1 for China and 0 for non-China.
In addition, as trials conducted in Japan have shorter test duration and in some trials placebo significantly increased HbA1c, we performed another model treating Japan as a separate group. Table 4 shows the analysis  [2][3][4]. Until now five DPP-4 inhibitors, sitagliptin, saxagliptin, vildagliptin, linagliptin, alogliptin, have been approved for marketing by CFDA. A large number of trials have been conducted in China determining the efficacy of these drugs in Chinese patients. For example, in a 24-week, randomized, double-blind, placebo-controlled study with 438 Chinese T2DM patients, Pan [6] discovered that the adjusted mean change in HbA1c at endpoint was −1.05 ± 0.08 %, −0.92 ± 0.08 % and −0.54 ± 0.08 % in patients receiving vildagliptin 50 mg bid, 50 mg qd and placebo, respectively. In this study, the 95 % confidence interval for the HbA1c response in the placebo arm is (-0.70, -0.38), indicating an HbA1 decline in the placebo arm. Similar HbA1 decline was discovered in a fair number of other trials in Chinese patients such as NCT01076088 [12] and NCT01289119 [17]. There are a few trials with the 95 % confidence interval of HbA1 in the placebo arm covering 0 such as (-0.28, 0) in Yang [11] and (-0.16, 0.32) in Zeng [16]. However, no trial has shown a significant HbA1c increase in the placebo arm in trials with Chinese patients. Therefore, there is a suspicion that there is an HbA1c decline in the placebo arm of DPP-4 inhibitor clinical trials conducted in China. Is that suspicion true? No one has addressed this question systematically yet. Therefore, in this article, we use a systematic meta-analysis approach to address this question.

DPP-4 inhibitors are an important class of oral antihyperglycemic agents
The meta-analysis shows that, HbA1c in the placebo arm declined by 0.26 % (95 % CI [-0.36 %, -0.16 %] and p-value less than 0.001) in trials of DPP-4 inhibitors conducted in patients with T2DM in China, whereas  There may be various reasons for this high placebo effect. However, what these reasons exactly are is unknown. Although the investigation of these reasons is not the purpose in this article, we have the following two major guesses. First, the practical process of these trials could cause a bias. Most of the trials provided the participants the significant benefit to obtain more resource of medical care, esp. in China. Because of no established PCP system, low awareness of diabetes management, China has most diabetes patients in the world [5] but much lower health workers/patient ratio than Europe, USA and Japan [76]. Clinical trials could have obvious impact on management of diabetes, and thus cause better blood glucose control even in placebo arm. Second, Traditional Chinese Medicine (TCM) could play role. There is evidence that the use of some TCM herbs can reduce hyperglycemia [77]. Among these herbs many are used commonly in diet or drinks. Normally in study protocol, herbs in diet were not clearly inhibited. Other reasons may include life style and culture that are unique in China.
The results on the placebo effect on other countries may also provide values for future trials and medical interpretation. For example, clinical trials conducted in Japan had a statistically significant reverse placebo effect, which may be important information for conducting future DDP-4 trials as well as for interpreting trial results in Japan.

Conclusions
The meta-analysis in the article demonstrates that there are significant differences in response in the placebo group of DPP-4 trials conducted in China compared to those conducted outside of China. This difference may give some clue to why the efficacy of these drugs is less statistically significant in trials conducted in China. More importantly, this difference in response in the placebo group should be taken into account for future DDP-4 trials conducted in China. In addition, the difference in placebo should be carefully considered by medical decision makers when future DPP-4 studies are conducted in China.

None.
Availability of data and materials Data used in this paper were collected from openly published papers and trials listed as references [6,.
Authors' contributions LH conducted the analysis and took a lead in drafting the manuscript; XDZ initiated the idea and supervised the analysis and writing; CS, SL, YT and ZL raised clinical motivation, gave clinical interpretation and revised the manscript. LH and XDZ wrote the final manuscript. All authors read and approved the final manuscript.

Competing interests
Liu, Tu and Li are employees of Merck & Co., Inc.

Consent for publication
Not applicable.
Ethics approval and consent to participate None. We collected data from openly published papers and trials.  The model is fitted with location as moderator. Location was regarded as categorical variable, 1 for China, 2 for Japan and 0 for others