Skip to main content
  • Research article
  • Open access
  • Published:

Translation of evidence into kidney transplant clinical practice: managing drug-lab interactions by a context-aware clinical decision support system

Abstract

Background

Drug-laboratory (lab) interactions (DLIs) are a common source of preventable medication errors. Clinical decision support systems (CDSSs) are promising tools to decrease such errors by improving prescription quality in terms of lab values. However, alert fatigue counteracts their impact. We aimed to develop a novel user-friendly, evidence-based, clinical context-aware CDSS to alert nephrologists about DLIs clinically important lab values in prescriptions of kidney recipients.

Methods

For the most frequently prescribed medications identified by a prospective cross-sectional study in a kidney transplant clinic, DLI-rules were extracted using main pharmacology references and clinical inputs from clinicians. A CDSS was then developed linking a computerized prescription system and lab records. The system performance was tested using data of both fictitious and real patients. The “Questionnaire for User Interface Satisfaction” was used to measure user satisfaction of the human-computer interface.

Results

Among 27 study medications, 17 needed adjustments regarding renal function, 15 required considerations based on hepatic function, 8 had drug-pregnancy interactions, and 13 required baselines or follow-up lab monitoring. Using IF & THEN rules and the contents of associated alert, a DLI-alerting CDSS was designed. To avoid alert fatigue, the alert appearance was considered as interruptive only when medications with serious risks were contraindicated or needed to be discontinued or adjusted. Other alerts appeared in a non-interruptive mode with visual clues on the prescription window for easy, intuitive notice. When the system was used for real 100 patients, it correctly detected 260 DLIs and displayed 249 monitoring, seven hepatic, four pregnancy, and none renal alerts. The system delivered patient-specific recommendations based on individual lab values in real-time. Clinicians were highly satisfied with the usability of the system.

Conclusions

To our knowledge, this is the first study of a comprehensive DLI-CDSS for kidney transplant care. By alerting on considerations in renal and hepatic dysfunctions, maternal and fetal toxicity, or required lab monitoring, this system can potentially improve medication safety in kidney recipients. Our experience provides a strong foundation for designing specialized systems to promote individualized transplant follow-up care.

Peer Review reports

Background

Lack of effective laboratory-pharmacy linkage results in drug errors commonly called drug-lab interactions (DLIs). Schiff et al. in their seminal review defined these interactions as errors related to drug choice, drug dosing, laboratory monitoring, lab result interpretation, and broader quality improvement [1]. DLIs are very common in medical practice, especially because new drugs are increasingly discovered and used for patients causing poly-pharmacy. For example, regarding laboratory monitoring, a systematic review highlighted that inadequate monitoring and/or ignoring lab results when prescribing a medication is one of the most frequent errors of omission associated with preventable adverse drug events (pADE) and related hospital admissions in ambulatory care [2]. In a multicenter study, it became evident that 39% of initial drug dispensing occurred without the recommended laboratory monitoring [3]. This type of error happened at 23–58% of older people receiving cardiovascular medications [4]. For a drug causing potential life-threatening liver failure, such as Troglitazone, the compliance with recommended liver function laboratory monitoring was as low as 5% despite four consecutive food and drug administration warnings [5]. In spite of extensive recommendations to prevent DLIs, low compliance is a major source of pADE and warrants heightened attention [6].

Due to the multiplicity of DLIs per individual drugs, unaided physicians are unable to remember all DLIs and track them while prescribing [1]. This was shown when the performance of a computer program on detecting such interactions was compared with that of clinicians [7]. Therefore, without systematic efforts to translate the emerging evidence into clinical practice, the existing gap between these two would be continued, and even deepened [8]. Clinical decision support systems (CDSSs) are promising tools to improve compliance with evidence-based recommendations and to avoid such omissions in the practice [9]. Studies have shown that CDSSs have improved initial and follow up laboratory monitoring after a drug therapy [3, 10, 11], guided physicians when excessive doses of drugs need adjustment regarding renal or hepatic function [12,13,14], and improved ordering behavior in terms of DLI recommendations [15,16,17]. However, not all CDSSs are smoothly embraced by physicians and alert fatigue is a serious concern counteracting their impact. Systematic reviews found that such interventions succeed more commonly when the decision support is provided to clinicians automatically as a part of the clinicians’ workflow, considered as an integrated component of charting or order entry systems and contain recommendations rather than notifications of the patient condition [18, 19]. Regarding alert presentation, studies have shown that clinicians prefer concise, selective, specialty- and patient-specific alerts, which are delivered in an active, more intrusive mode for alerts with high critical importance (e.g., necessity to acknowledge pop-up interruptions for drug contraindications) [20, 21].

Kidney recipients have fragile kidney and liver organ functions because of their new kidney and the use of drugs that are cleared from the body through the kidney or liver. Drugs with renal clearance, for instance, can cause overdose and toxicity in the case there is a decline in the function of transplanted kidneys. Therefore, the value of detecting DLIs in these patients becomes especially important. Kidney recipients also have poly-pharmacy, with frequent use of complex therapeutic transplant medication regimens, some with a narrow therapeutic index potentially causing nephrotoxicity, hepatotoxicity, electrolyte or metabolic imbalances. They have also some accompanying comorbidities or frequent opportunistic infections, which demand additional medication therapy. All these complexities make managing different kinds of drug interactions a difficult task for unaided physicians while prescribing. Although computerized systems have long been introduced to organ transplantation care [22, 23], the routine application of these systems has yet to be commonplace [24]. As such, there are very few reports of using computerized systems to manage medications in conjunction with laboratory values in transplantation [25,26,27]. Notably, these systems mainly focused on monitoring blood trough levels of immune-suppressive medications [25, 26]. To our knowledge, studies of computerized systems being used to manage DLIs are missing in the transplantation field. As part of a longitudinal project to improve the quality of kidney transplantation care (see for example [28, 29]), we examined the existing complexities in the context of transplantation care, on the one hand, and the current evidence on DLIs, on the other hand, to develop an evidence-based computerized CDSS to support nephrologists in the safe medication prescribing alongside individual patients’ laboratory values. The processes of this CDSS’s development can be used as a proof-of-concept helping other transplant programs to design and apply more specialized, transplant focused CDSSs.

Methods

Study setting

The outpatient transplant clinic of the Urmia Medical Science University (UMSU) has recently implemented a homegrown, renal transplant management system (RTMS). This system has been equipped with a computerized provider order entry (CPOE), a drug-drug interaction CDSS [28] and a glomerular filtration rate prediction CDSS for upcoming follow up visits [29, 30]. Having such a system available in our clinic provided a unique opportunity to develop a DLI-CDSS, alongside others. The implementation of the RTMS was started in a stepwise fashion, primarily involving non-physician care providers in the pre-transplant through post-transplant care processes such as inpatient and outpatient transplant nurses and transplant operating room staff in fall 2018. At the time of this report, we are planning to implement the CPOE and CDSS modules of the RTMS for our nephrologists. The research ethics committee of the UMSU reviewed and approved this project.

Knowledgebase for the CDSS

Selection of medications and the development of algorithms

In this study, the main focus was on the common medications used orally amongst adult outpatients, and not on those largely used in the inpatient setting or via parenteral routes. These medications were previously identified through a prospective cross-sectional study in the clinic during 2 months [28]. Then, the DLIs for the oral administration dosages of these medications were extracted from the main pharmacology textbooks and references, including the “Mosby’s diagnostic and laboratory test reference” [31], the “up-to-date” [32] as well as the “prescriber’s digital reference” [33]. The extracted information was then turned into IF and THEN rules (e.g., IF hepatic impairment exists, THEN use Furosemide with caution) and compiled in a knowledgebase.

DLIs have been categorized as errors related to drug choice (e.g., lab-based indications and contraindications), drug dosing (e.g., renal, hepatic, blood level- guided adjustments), laboratory monitoring (e.g., lab signals of toxicity, baseline and ongoing monitoring), lab result interpretation (e.g., drug interfering with a lab test), and broader quality improvement (e.g., surveillance for unrecognized toxicity and monitoring clinician response delays) [1]. Our decision support rules were in line with these DLI categories, in terms of the adequate responses (indication/contraindication/dose adjustment) to laboratory evidence of renal and/or hepatic inflammation or toxicity, medication-pregnancy contraindications, and indications to monitor relevant lab tests. IF and THEN rules were written in a way to discriminate medications, gender, and abnormal laboratory threshold levels. In addition to the literature, we consulted with clinicians to set the laboratory cutoff values for triggering a rule according to the transplant care context. The appropriate algorithms were then developed to facilitate their incorporation into the knowledge base. These algorithms were reviewed by one clinical pharmacologist and then by the head of our nephrology department who is a senior nephrologist with more than 30 years of clinical experience. Modifications were made to address the clinical context in which transplant follow-up care was delivered. Verification by our clinicians helped us to determine top priorities from a clinical point of view and put aside trivial DLI-considerations. On this basis, we excluded rules for the monitoring of routine lab tests that existed in the kidney transplant follow-up protocols, including complete blood counts, lipid profiles, renal, and liver function tests, and immunosuppressive blood trough levels. These exclusions aimed to mitigate the number of monitoring alerts that would most probably be ignored or inactivated later on.

For estimating renal function, creatinine clearance (CrCl) was automatically calculated using the Cockcroft and Gault formula [34]. For calculation of the lean body weight/mass (LBM), the Hume formula was used [35] [Additional file 1]. We triangulated the detection of liver dysfunction by combining different liver function tests, the history of cirrhosis, and the variables used to calculate clinical scores such as the Child-Pugh score.

A time frame was set to fire the alerts, wherever prior test values were necessary for triggering a rule. The upper threshold for this time frame was set to 6 months in which the system uses historical laboratory values.

Development of a workflow based CDSS

The content and the layout of alerts and their appearance were decided after multiple meetings among this project’s team members including a nephrologist and a clinical pharmacologist. After evaluating different scenarios, a consensus was reached on a final alert display. Unified Modeling Language (UML) was used to draw workflow diagrams embedded in the CDSS. After incorporating the final criteria lists into the rules, they were used to program the CDSS system using the C#.Net programming language and SQL Server databases. The designed DLI-CDSS was integrated into the CPOE component of the RTMS.

A pilot test of the CDSS

To test the DLI-CDSS, we defined 250 fictitious patients to test different algorithms associated with individual drugs, according to varying patient demographics (e.g., gender), clinical conditions (e.g., LBW and CrCl), and lab values (Cr and LFT). Additionally, we pilot tested the system with 100 real patients’ data prospectively collected at our clinic in September 2018. The aim was to achieve the optimal sensitivity, specificity, and accuracy of this DLI-CDSS in detecting DLIs according to our extracted rules. This verification was done by manual review and comparison of these patients’ profiles and the system’s performance.

Evaluation of user satisfaction of the human-computer interface

We used the “Questionnaire for User Interface Satisfaction (QUIS)” [36] to evaluate clinician-user satisfaction of the system. This tool assesses users’ subjective satisfaction with specific aspects of the human-computer interface and is one of Health Information Technology (HIT) usability study methods [37]. It has six questions for an overall measure of satisfaction and 21 main component questions to measure user satisfaction in four specific interface aspects (i.e., screen factors, terminology and system feedback, learning factors, and system capabilities). Two nephrologists and three clinical pharmacologists participated in this phase. They first attended a quick, direct training session on system use and then worked with it using different patient scenarios. Finally, they were asked to rate their satisfaction with the system on a five-point Likert scale. A mean of three and above was considered a higher satisfaction with the system.

Results

Selected medications for the knowledge base

For 595 kidney recipients, 29 immunosuppressive and non-immunosuppressive medications constituted 83% of all prescribed drugs. Based on our references and expert opinion, Prazosin and Prednisolone did not have high priority DLI-considerations, which meant that 27 medications were selected [Additional file 2]. Table 1 presents a subset of these selected medications. Figure 1 depicts the process flow in our study.

Table 1 Drug-lab interaction guidelines for a sample of our selected high-volume medications
Fig. 1
figure 1

Study flow for designing the DLI-CDSS

Knowledgebase for the DLI-CDSS

Among 27 medications, 17 medications needed adjustments regarding renal function, 15 required considerations based on hepatic function, eight medications had drug-pregnancy interaction, and 13 required baselines or follow-up lab monitoring (Table 1). Figure 2 shows a general algorithm based upon DLIs dealt with in this study. It simplifies the decision and screening process according to the individual patients’ high-risk condition. A sample of diagrams for individual drugs is provided in the additional materials [see Additional files 3, 4, 5, 6].

Fig. 2
figure 2

A summary decision rules embedded in the DLI-CDSS

The knowledgebase included the IF & THEN rules and contents associated with the alerts. The contents fell under three main categories of “drug selection (indication and contraindication)”, “dosing”, and “lab monitoring”.

Algorithms for DLIs in renal impairment

The renal function of individual patients based on CrCl was used to trigger alerts for 17 medications, prompting physicians to either adapt the dose, to choose an alternative drug, or to avoid it. Alert contents for dose adaptation involved: indicating an exact dose (e.g., prescribe 100 mg/day), suggesting a dose reduction (e.g., reduce the recommended dose by 50%), suggesting an extension in the dosing intervals (e.g., extend the dose interval to 12 h), or giving a limit for a maximum daily dose allowed (e.g., do not exceed 25 mg/day). For digoxin, the suggestions for an exact dose were based on individual patients’ CrCl and LBM.

Algorithms for DLIs in hepatic impairment

There were 15 medications needing an alert based on hepatic function. The alerts provided recommendations on dose initiation (e.g., initiate with 2.5 mg/day), dose reduction (e.g., reduce dose by 50%), taking caution (e.g., use with caution, since minor alterations of fluid and electrolyte balance may precipitate hepatic coma), or avoiding a drug.

Algorithms for drug-pregnancy interaction

In the case of pregnancy, warnings were provided to discontinue eight medications. For mycophenolate, there was also another type of alert that recommended monitoring the status of pregnancy through periodic βHCG tests (i.e., 8 to 10 days after the initiation and then every 3 months afterward). These algorithms were enhanced by a simple rule to have the alerts expire after 9 months or whenever a pregnancy termination was recorded in the RTMS.

Algorithms for monitoring drug-lab tests

In this category, alerts prompted physicians to request lab tests for monitoring at the baseline and/or during follow-ups. Additionally, in the case when an abnormal lab value was entered into the system for a monitored lab value, there were alerts to recommend on either dose adjustments, the prescription of a new supplementary medication (e.g., vitamin B12 or magnesium) or avoiding the medication (Fig. 2).

Alert workflow

Alert priority level in the workflow

Whenever the medication data and/or lab values of a patient were changed in the RTMS, the rule-based decision support module of the system matched the changes to the knowledge base in real-time and the associated algorithms were triggered to present patient-specific recommendations to the nephrologist. We placed each alert into one of three levels of clinical severity: level 1 alerts for a fatal or life-threatening interaction, level 2 alerts for an undesirable interaction with the potential for serious injury, and level 3 alerts for required monitoring. For easier visual comprehension, they were displayed by the color codes of red, orange, and yellow, respectively.

Alerts’ display rules

While the rules were processed in the background, the display of the alerts was interruptive (i.e., appeared as a pop-up) only when a rule was either contraindicated by a medication’s initiation/ continuation, or when it recommended adjusting the dose (Table 1). While using this system, physicians were not obliged to respond to the alert, or adhere to it; they were free to either make changes to the prescription or continue to proceed with their prescription plan.

Due to poly-pharmacy of kidney recipients, displaying alerts to physicians and interrupting their workflow with each rule would deluge them with a large number of alerts. To prevent this, we considered alerts to be interruptive only when stopping a medication or adjusting the dose would be necessary, i.e., level 1 severity alert. A pop-up alert was presented to the physician with a message containing the medication name, a recommendation on what to do, a reason accompanying the patient’s latest rule-associated lab value and its date, and a couple of visual clues. Figure 3 provides two screenshots of the system for alerts’ display. The severity levels 2 and 3 appeared on the prescription window without interrupting physician workflow and only in an informational way. In these cases, a small icon with the sign of monitor appeared in front of the medication. To read the alert, a physician could either hover over the medication name and see the alert’s content as a screen tip, or click on it to see the content as a pop-up window. Figure 4 provides the workflow embedded in this CDSS. As a single medication could generate multiple alerts, they were displayed on a single screen.

Fig. 3
figure 3

Two screenshots of the DLI-CDSS for a test patient with renal and hepatic impairments

Fig. 4
figure 4

Decision workflow embedded in the DLI-CDSS

Actions taken in response to alerts

Only the level 1 alerts required a reaction. This reaction could be “override this alert” or “stop medication”. To minimize the impact on an individual physician’s workflow, physicians could decide to keep, revise, or delete a medication in response to an alert. They could also decide to order or not order any rule-associated lab tests (Fig. 4). Althoughthe alerts could be overridden without any further action, they would reappear with every subsequent prescription, including refills. Each trigger of the rules and physicians’ reactions to them were registered in the system for future evaluation of the relevancy of alerts based on the complexities of kidney recipients’ clinical conditions, and to promote the compliance of nephrologists.

Piloting of the system

System testing was iteratively performed by the research team, by testing the logic embedded in the system against fictitious and the real patients. After the first round of design, the sensitivity and specificity of the designed system were suboptimal (sensitivity of 76% and specificity of 96%) due to several bugs in the system. We fixed the identified bugs and continued testing the system accordingly until no further problems were detected and we achieved 100% in sensitivity and specificity of the system in detecting DLIs of the fictitious and real patients. When the system was ready from a technical point of view, we pilot tested it to detect DLIs in data of 100 real adult patients collected from our clinic. These patients were commonly male (56%) with a mean age of 47.44 years (20 to 73) (Table 2). The system correctly detected 260 DLIs in these 100 patients and displayed 249 monitoring, seven hepatic, four pregnancy, and none renal alerts.

Table 2 Characteristics of 100 real patients whose data was used to validate the CDSS system

User satisfaction

Overall, our participants were highly satisfied with the system (4.14 (0.44), mean (SD) in a five-point Likert scale). Regarding the screen factors, the system scored 4.6 (0.24). Users rated the system 4.4 (0.38) in the terminology and system feedback and 3.9 (0.44) in the learning factors aspects. The system scored 3.76 (0.46) regarding the system capabilities.

Discussion

To our knowledge, this is the first DLI-CDSS to support physicians’ safe medication prescribing for vulnerable transplant recipients based on their lab values. The context and complexities in this field were examined and a system was designed to provide clinicians with a friendly, time-saving, and efficient tool, helping them to consider patients’ demographics, clinical parameters, and lab values in their prescriptions. By using the system, nephrologists can quickly comprehend whether discontinuation, switching to an alternative medication, dose adjustment, or lab monitoring is required based on their patients’ latest lab values. To avoid the alert fatigue, the alert appearance was decided to be interruptive only when medication with a serious risk needed to be discontinued or adjusted. Other alerts are appearing in a non-interruptive mode yet with visual clues on the prescription window to enable easy and intuitive notice. Overall, our clinicians were satisfied with the system, valued its availability, and expressed their interest to use the system in their daily practice. At the time of this report, we have started the implementation of this system for our nephrologists and are planning to evaluate its impact on preventing DLIs in this patient population.

Despite positive effects, various factors may deter CDSS use by clinicians, including their functional features and alert appropriateness [9, 38, 39], which mainly refer to targeting the right provider, on the right issue, in the right place, at the right time, and by the right mode. Among the underlying reasons for non-compliance, lower levels of expected potential harms/benefits for a warning or reminder play an important role [40, 41]. Despite the physicians’ recognition of the value of computerized alerts, they demand individualized alerts for their practices and warn that alerts must not interrupt the workflow or require too many clicks [42]. To address such issues and to comply with the related recommendations (such as [20, 43,44,45,46,47]), we categorized the alert’s significance in three levels of high, medium, and low, of which only the high (level 1) was considered to appear as interruptive pop-ups. This was mainly because we did not want to overwhelm clinicians with many interruptive warnings that most probably would end up in alert fatigue and then be ineffective. Moreover, we selected the most relevant alerts and reminders based on our transplant care context and workflow routines, aiming to increase alert specificity by a context-aware CDSS and to reduce alert overrides as recommended in the literature [48, 49]. Yet, the system was able to fire on average three drug-lab alerts for individual patients. This number is relatively less from what was found in drug labels for individual drugs [43]. To ease the comprehension, we applied screen tips and color codes denoting the priority levels for visual clues that allow physicians to get more information at a glance in a timely manner. In addition, we used only a concise text about the main warnings or reminders and a reason with the patient’s latest rule-relevant lab results. These user interfaces and alert presentation modes were aligned with the extracted user needs/requirements and recommended practice for promoting alert appropriateness aiming to increase clinician compliance [20, 44,45,46,47].

Different aspects should be emphasized in the continuous maintenance of CDSSs [50]. The workload pertaining to the management of embedded knowledge within CDSSs becomes even more important when one considers the large number of medications being introduced each year. On the one hand, there are commercial knowledge bases readily accessible for larger organizations with adequate resources that require customizations based on institution and specialty to ensure avoidance of errors in practice [51, 52]. On the other hand, access to CDSS may not be the case for smaller organizations due to costs entailed. Then, they would need to invest in developing in-house small scale knowledge bases, covering their most immediate needs, which would, in turn, require frequent updates with new evidence. It has been recommended that in such cases, updates should be monitored by assigned people regularly [21]. The accuracy of patient records is another aspect of knowledge management: inaccurate or out-of-date records would trigger inaccurate alerts [50]. Therefore, monitoring of the accuracy of patients’ records and addressing problems encountered would lead to clinicians’ reliance on such systems’ advice. The third issue related to CDSS’ maintenance involves evaluating and controlling alert fatigue and override rates [21, 53]. A study in an outpatient setting showed that about half of alerts were overridden from which only half were justifiable [54]. Another study showed that providers continued the same drug at 91.7% of orders despite a warning message probably because they believe the benefits outweigh the potential downsides [16]. In this context, evaluating the appropriateness of alerts based on clinical contexts and workflow becomes especially important [46]. Organizations embarking on CDSS systems need to consider such maintenance efforts in their contexts and secure adequate resources for sustainable CDSS use, in advance.

The medication process is intrinsically multidisciplinary and collaborative [55], in which clinical pharmacists and patients can also play a role besides physicians. However, the evidence about DLI-CDSSs exploiting pharmacists’ inputs in this process is sparse [38]. Currently, our clinical pharmacists are not actively involved in the double-checking of drug interactions; hence, we did not consider them as a user. In studies conducted in outpatient settings, the pharmacists, and not physicians, were those who received electronic alerts on missing laboratory results [11, 56]. Pharmacists had to order tests, remind patients to undergo tests, and review and manage abnormal results, which resulted in significantly improved lab monitoring. In other studies, pharmacists received computerized alerts based on elderly patients’ renal function and communicated the need for dose adjustment to both patients and their physicians [57, 58]. In a population-based randomized clinical trial, the proportion of medication errors was significantly lower in the DLI-CDSS group that alerted pharmacists when compared to the usual care group [59]. To close the loop of medication monitoring, patients themselves are also important. Hence, interventions targeting them alongside health professionals would improve laboratory monitoring and medication safety [42, 60]. Future studies are recommended to target patients, especially those with frequent DLI-CDSSs [60].

In the post kidney transplantation phase, the fertility of women is rapidly restored [61]. However, it accompanies the risk of side effects from immunosuppressive medications and potential renal, maternal (e.g., preeclampsia) and neonatal adverse outcomes [62,63,64]. Due to the higher risk compared to the general population, pre-pregnancy, antenatal, and postpartum care of renal recipients is highly recommended [65]. Notably, there are instances where prescribing a drug is contraindicated in pregnancy (see for example [66]). Drug–pregnancy alerts represent a category of advanced CDSSs [18]. Significant decreases are shown in physician violations of drug-pregnancy alerts with a CDSS [40]. As one of the main safety features of our CDSS in this patient population, a set of drug-pregnancy alerts were considered to appear with a positive pregnancy test to promote the safety of both mother and fetus.

Limitations

Althoughto our knowledge, this is the first study to focus on a patient- and context-specific DLI-CDSS in the transplantation domain, it has limitations. To develop a highly context-aware system with a higher specificity, we only included high volume medications used. This limits its overall applicability beyond kidney transplant patients. Nevertheless, it provides a platform that can easily be expanded to include medications of other specialties. Second, our patients were a chronic patient population closely monitored based on available post-transplant clinical practice guidelines (such as [67]). Therefore, we excluded those alerts judged to be redundant to our nephrologists such as a reminder for immunosuppressive level monitoring or Cr test. Third, we relied on estimated CrCl calculated using serum Cr as a cheap and routine parameter for kidney function; but, we are aware that this is not an exact measure of glomerular filtration rate. Fourth, the impact of drugs on the diagnostic interpretation of laboratory tests was out of the scope of our study (see for example [68]). The last but not the least, the result of our satisfaction study suggests that the system was generally well received by clinicians. Despite this, the impact of our efforts to address usefulness, usability, and alert appropriateness, alert compliance and patient outcomes need to be supported by future well-performed studies.

Conclusion

A multidisciplinary team developed a DLI-CDSS with the patient- and context-specific warnings and reminders on dosing recommendations and conflicts with patients’ lab-based safety considerations. We hope that with such an approach, DLIs can be more promptly recognized and more reliably addressed. However, we were aware that such systems would not be embraced by physicians if they are overwhelmed by a blizzard of poorly validated warnings. To account for this, we used the high priority DLI rules validated by clinicians. It is plausible that being vigilant to the side effects of medications based on lab values would promote patient safety. This should be documented by future studies.

Availability of data and materials

The datasets supporting the conclusions of this article are included within the article (and its additional files).

Abbreviations

DLI:

Drug-Laboratory Interaction

CDSS:

Clinical Decision Support System

pADE:

Preventable Adverse Drug Events

UMSU:

Urmia Medical Science University

RTMS:

Renal Transplant Management System

CPOE:

Computerized Provider Order Entry

CrCl:

Creatinine Clearance

LBM:

Lean Body Mass

UML:

Unified Modeling Language

LFT:

Liver Function Test

Cr:

Creatinine

AST:

Aspartate aminotransferase

ALT:

Alanine aminotransferase

References

  1. Schiff GD, Klass D, Peterson J, Shah G, Bates DW. Linking laboratory and pharmacy: opportunities for reducing errors and improving care. Arch Intern Med. 2003;163(8):893–900 PubMed PMID: 12719197.

    Article  PubMed  Google Scholar 

  2. Thomsen LA, Winterstein AG, Sondergaard B, Haugbolle LS, Melander A. Systematic review of the incidence and characteristics of preventable adverse drug events in ambulatory care. Ann Pharmacother. 2007;41(9):1411–26 PubMed PMID: 17666582.

    Article  PubMed  Google Scholar 

  3. Raebel MA, Lyons EE, Andrade SE, Chan KA, Chester EA, Davis RL, et al. Laboratory monitoring of drugs at initiation of therapy in ambulatory care. J Gen Intern Med. 2005;20(12):1120–6 PubMed PMID: 16423101. Pubmed Central PMCID: 1490279.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Simon SR, Andrade SE, Ellis JL, Nelson WW, Gurwitz JH, Lafata JE, et al. Baseline laboratory monitoring of cardiovascular medications in elderly health maintenance organization enrollees. J Am Geriatr Soc. 2005;53(12):2165–9 PubMed PMID: 16398903.

    Article  PubMed  Google Scholar 

  5. Graham DJ, Drinkard CR, Shatin D, Tsong Y, Burgess MJ. Liver enzyme monitoring in patients treated with troglitazone. Jama. 2001;286(7):831–3. 11497537.

    Article  CAS  PubMed  Google Scholar 

  6. Hurley JS, Roberts M, Solberg LI, Gunter MJ, Nelson WW, Young L, et al. Laboratory safety monitoring of chronic medications in ambulatory care settings. J Gen Intern Med. 2005;20(4):331–3 PubMed PMID: 15857489. Pubmed Central PMCID: 1490088.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Langdorf MI, Fox JC, Marwah RS, Montague BJ, Hart MM. Physician versus computer knowledge of potential drug interactions in the emergency department. Acad Emerg Med Off J Soc Acad Emerg Med. 2000;7(11):1321–9 PubMed PMID: 11073486.

    Article  CAS  Google Scholar 

  8. Woolf SH. The meaning of translational research and why it matters. Jama. 2008;299(2):211–3 PubMed PMID: 18182604.

    Article  CAS  PubMed  Google Scholar 

  9. Bayoumi I, Al Balas M, Handler SM, Dolovich L, Hutchison B, Holbrook A. The effectiveness of computerized drug-lab alerts: a systematic review and meta-analysis. Int J Med Inform. 2014;83(6):406–15 PubMed PMID: 24793784.

    Article  PubMed  Google Scholar 

  10. Were MC, Shen C, Tierney WM, Mamlin JJ, Biondich PG, Li X, et al. Evaluation of computer-generated reminders to improve CD4 laboratory monitoring in sub-Saharan Africa: a prospective comparative study. J Am Med Inform Assoc. 2011;18(2):150–5 PubMed PMID: 21252053. Pubmed Central PMCID: 3116261.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Raebel MA, Lyons EE, Chester EA, Bodily MA, Kelleher JA, Long CL, et al. Improving laboratory monitoring at initiation of drug therapy in ambulatory care: a randomized trial. Arch Intern Med. 2005;165(20):2395–401 PubMed PMID: 16287769.

    Article  PubMed  Google Scholar 

  12. Field TS, Rochon P, Lee M, Gavendo L, Baril JL, Gurwitz JH. Computerized clinical decision support during medication ordering for long-term care residents with renal insufficiency. J Am Med Inform Assoc. 2009;16(4):480–5 PubMed PMID: 19390107. Pubmed Central PMCID: 2705250.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Terrell KM, Perkins AJ, Hui SL, Callahan CM, Dexter PR, Miller DK. Computerized decision support for medication dosing in renal insufficiency: a randomized, controlled trial. Ann Emerg Med. 2010;56(6):623–9 PubMed PMID: 20452703.

    Article  PubMed  Google Scholar 

  14. Hendrayana T, Wilmer A, Kurth V, Schmidt-Wolf IG, Jaehde U. Anticancer dose adjustment for patients with renal and hepatic dysfunction: from scientific evidence to clinical application. Sci Pharm. 2017;85(1):8 PubMed PMID: 28264440. Pubmed Central PMCID: 5388145. Epub 2017/03/08. eng.

    Article  PubMed Central  CAS  Google Scholar 

  15. Feldstein AC, Smith DH, Perrin N, Yang X, Rix M, Raebel MA, et al. Improved therapeutic monitoring with several interventions: a randomized trial. Arch Intern Med. 2006;166(17):1848–54 PubMed PMID: 17000941.

    Article  PubMed  Google Scholar 

  16. Steele AW, Eisert S, Witter J, Lyons P, Jones MA, Gabow P, et al. The effect of automated alerts on provider ordering behavior in an outpatient setting. PLoS Med. 2005;2(9):e255 PubMed PMID: 16128621. Pubmed Central PMCID: 1198038.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Lau B, Overby CL, Wirtz HS, Devine EB. The association between use of a clinical decision support tool and adherence to monitoring for medication-laboratory guidelines in the ambulatory setting. Appl Clin Inform. 2013;4(4):476–98 PubMed PMID: 24454577. Pubmed Central PMCID: 3885910.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Kuperman GJ, Bobb A, Payne TH, Avery AJ, Gandhi TK, Burns G, et al. Medication-related clinical decision support in computerized provider order entry systems: a review. J Am Med Inform Assoc. 2007;14(1):29–40 PubMed PMID: 17068355. Pubmed Central PMCID: 2215064.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Horsky J, Schiff GD, Johnston D, Mercincavage L, Bell D, Middleton B. Interface design principles for usable decision support: a targeted review of best practices for clinical prescribing interventions. J Biomed Inform. 2012;45(6):1202–16 PubMed PMID: 22995208.

    Article  PubMed  Google Scholar 

  20. Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. Bmj. 2005;330(7494):765 PubMed PMID: 15767266. Pubmed Central PMCID: 555881.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Bates DW, Kuperman GJ, Wang S, Gandhi T, Kittler A, Volk L, et al. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc. 2003;10(6):523–30 PubMed PMID: 12925543. Pubmed Central PMCID: 264429.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Niazkhani Z, Pirnejad H, Rashidi KP. The impact of health information technology on organ transplant care: a systematic review. Int J Med Inform. 2017;100:95–107 PubMed PMID: 28241943.

    Article  PubMed  Google Scholar 

  23. Rashidi Khazaee P, Pirnejad H, Bagherzadeh J, Niazkhani Z. Towards realizing benefits of information Technology in Organ Transplant: a review. Studies Health Technol Inform. 2016;226:29–32 PubMed PMID: 27350458.

    Google Scholar 

  24. Jacobs J, Weir C, Evans RS, Staes C. Assessment of readiness for clinical decision support to aid laboratory monitoring of immunosuppressive care at U.S. liver transplant centers. Appl Clin Inform. 2014;5(4):988–1004 PubMed PMID: 25589912. Pubmed Central PMCID: 4287676.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Park ES, Peccoud MR, Wicks KA, Halldorson JB, Carithers RL Jr, Reyes JD, et al. Use of an automated clinical management system improves outpatient immunosuppressive care following liver transplantation. J Am Med Inform Assoc. 2010;17(4):396–402 PubMed PMID: 20595306. Pubmed Central PMCID: 2995663.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Staes CJ, Evans RS, Rocha BH, Sorensen JB, Huff SM, Arata J, et al. Computerized alerts improve outpatient laboratory monitoring of transplant patients. J Am Med Inform Assoc. 2008;15(3):324–32 PubMed PMID: 18308982. Pubmed Central PMCID: 2410008.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Hooper DK, Kirby CL, Margolis PA, Goebel J. Reliable individualized monitoring improves cholesterol control in kidney transplant recipients. Pediatrics. 2013;131(4):e1271–9 PubMed PMID: 23478865. Pubmed Central PMCID: 4535026.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Pirnejad H, Amiri P, Niazkhani Z, Shiva A, Makhdoomi M, Abkhiz S, et al. Preventing potential drug-drug interactions through alerting decision support systems: a clinical context based methodology. Int J Med Inform. 2019;127C:18–26.

    Article  Google Scholar 

  29. Rashidi Khazaee P, Bagherzadeh MJ, Niazkhani Z, Pirnejad H. Predicting the function of transplanted kidney in long-term care processes: application of a hybrid model. J Biomed Inform. 2019;91:103116 PubMed PMID: 30753950.

    Article  PubMed  Google Scholar 

  30. Rashidi Khazaee P, Bagherzadeh J, Niazkhani Z, Pirnejad H. A dynamic model for predicting graft function in kidney recipients’ upcoming follow up visits: a clinical application of artificial neural network. Int J Med Inform. 2018;119:125–33 PubMed PMID: 30342680.

    Article  PubMed  Google Scholar 

  31. Pagana KK, Pagana TJ, Pagana TN. Mosby’s Diagnostic and Laboratory Test Reference 14th Edition. 13 th edition ed. St. Louis: Mosby; 2016.

    Google Scholar 

  32. Up to date 2018 [cited 2018 28th May]. Available from: https://www.uptodate.com/home.

  33. Prescriber’s digital reference 2018 [cited 2018 25th April]. Available from: https://www.pdr.net/.

  34. Cockcroft D, Gault M. Prediction of creatinine clearance from serum creatinine. Nephron. 1976;16:31–41.

    Article  CAS  PubMed  Google Scholar 

  35. Hume R. Prediction of lean body mass from height and weight. J Clin Pathol. 1966;19(4):389–91.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Chin J, Diehl V, Norman K. Development of a Tool Measuring User Satisfaction of the Human-Computer Interface. CHI '88: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1988;213–8. https://0-doi-org.brum.beds.ac.uk/10.1145/57167.57203.

  37. Yen PY, Bakken S. Review of health information technology usability study methodologies. J Am Med Inform Assoc. 2012;19(3):413–22 PubMed PMID: 21828224. Pubmed Central PMCID: 3341772.

    Article  PubMed  Google Scholar 

  38. Fischer SH, Tjia J, Field TS. Impact of health information technology interventions to improve medication laboratory monitoring for ambulatory patients: a systematic review. J Am Med Inform Assoc. 2010;17(6):631–6 PubMed PMID: 20962124. Pubmed Central PMCID: 3000763.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Wright A, Sittig DF, Ash JS, Sharma S, Pang JE, Middleton B. Clinical decision support capabilities of commercially-available clinical information systems. J Am Med Inform Assoc. 2009;16(5):637–44 PubMed PMID: 19567796. Pubmed Central PMCID: 2744714.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Yu DT, Seger DL, Lasser KE, Karson AS, Fiskio JM, Seger AC, et al. Impact of implementing alerts about medication black-box warnings in electronic health records. Pharmacoepidemiol Drug Saf. 2011;20(2):192–202 PubMed PMID: 21254291.

    Article  PubMed  Google Scholar 

  41. Palen TE, Raebel M, Lyons E, Magid DM. Evaluation of laboratory monitoring alerts within a computerized physician order entry system for medication orders. Am J Manag Care. 2006;12(7):389–95 PubMed PMID: 16834525.

    PubMed  Google Scholar 

  42. Goldman RE, Soran CS, Hayward GL, Simon SR. Doctors’ perceptions of laboratory monitoring in office practice. J Eval Clin Pract. 2010;16(6):1136–41 PubMed PMID: 21176004.

    Article  PubMed  Google Scholar 

  43. Geerts AF, De Koning FH, Van Solinge WW, De Smet PA, Egberts TC. Instructions on laboratory monitoring in 200 drug labels. Clin Chem Lab Med. 2012;50(8):1351–8 PubMed PMID: 22868799.

    Article  CAS  PubMed  Google Scholar 

  44. Krall MA, Sittig DF. Clinician’s assessments of outpatient electronic medical record alert and reminder usability and usefulness requirements. Proceedings AMIA Symposium; 2002. p. 400–4. PubMed PMID: 12463855. Pubmed Central PMCID: 2244227.

    Google Scholar 

  45. Marcilly R, Ammenwerth E, Roehrer E, Nies J, Beuscart-Zephir MC. Evidence-based usability design principles for medication alerting systems. BMC Med Inform Decision Making. 2018;18(1):69 PubMed PMID: 30041647. Pubmed Central PMCID: 6057098.

    Article  Google Scholar 

  46. McCoy AB, Thomas EJ, Krousel-Wood M, Sittig DF. Clinical decision support alert appropriateness: a review and proposal for improvement. Ochsner J. 2014;14(2):195–202 PubMed PMID: 24940129. Pubmed Central PMCID: 4052586.

    PubMed  PubMed Central  Google Scholar 

  47. Payne TH, Hines LE, Chan RC, Hartman S, Kapusnik-Uner J, Russ AL, et al. Recommendations to improve the usability of drug-drug interaction clinical decision support alerts. J Am Med Inform Assoc. 2015;22(6):1243–50 PubMed PMID: 25829460.

    Article  PubMed  Google Scholar 

  48. Tolley CL, Slight SP, Husband AK, Watson N, Bates DW. Improving medication-related clinical decision support. Am J Health-System Pharm. 2018;75(4):239–46 PubMed PMID: 29436470.

    Article  Google Scholar 

  49. Ancker JS, Edwards A, Nosal S, Hauser D, Mauer E, Kaushal R, et al. Effects of workload, work complexity, and repeated alerts on alert fatigue in a clinical decision support system. BMC Med Inform Decision Making. 2017;17(1):36 PubMed PMID: 28395667. Pubmed Central PMCID: 5387195.

    Article  Google Scholar 

  50. AB AL-B, Selamat MH, Samat M, Nazira Y, Akkanat O. A Review on Clinical Decision Support Systems in Healthcare. J Convergence Inform Technol (JCIT). 2014;9(2):125–35.

    Google Scholar 

  51. Tiwari R, Tsapepas DS, Powell JT, Martin ST. Enhancements in healthcare information technology systems: customizing vendor-supplied clinical decision support for a high-risk patient population. J Am Med Inform Assoc. 2013;20(2):377–80 PubMed PMID: 22813760. Pubmed Central PMCID: 3638188.

    Article  PubMed  Google Scholar 

  52. Amkreutz J, Koch A, Buendgens L, Trautwein C, Eisert A. Clinical decision support systems differ in their ability to identify clinically relevant drug interactions of immunosuppressants in kidney transplant patients. J Clin Pharm Ther. 2017;42(3):276–85 PubMed PMID: 28224645.

    Article  CAS  PubMed  Google Scholar 

  53. van der Sijs H, Aarts J, Vulto A, Berg M. Overriding of drug safety alerts in computerized physician order entry. J Am Med Inform Assoc. 2006;13(2):138–47 PubMed PMID: 16357358. Pubmed Central PMCID: 1447540.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Nanji KC, Slight SP, Seger DL, Cho I, Fiskio JM, Redden LM, et al. Overrides of medication-related clinical decision support alerts in outpatients. J Am Med Inform Assoc. 2014;21(3):487–91 PubMed PMID: 24166725. Pubmed Central PMCID: 3994856.

    Article  PubMed  Google Scholar 

  55. Niazkhani Z, Pirnejad H, de Bont A, Aarts J. Evaluating inter-professional work support by a computerized physician order entry (CPOE) system. Studies Health Technol Inform. 2008;136:321–6 PubMed PMID: 18487751.

    Google Scholar 

  56. Raebel MA, Chester EA, Newsom EE, Lyons EE, Kelleher JA, Long C, et al. Randomized trial to improve laboratory safety monitoring of ongoing drug therapy in ambulatory patients. Pharmacotherapy. 2006;26(5):619–26 PubMed PMID: 16637791.

    Article  CAS  PubMed  Google Scholar 

  57. Geerts AF, De Koning FH, De Vooght KM, Egberts AC, De Smet PA, van Solinge WW. Feasibility of point-of-care creatinine testing in community pharmacy to monitor drug therapy in ambulatory elderly patients. J Clin Pharm Ther. 2013;38(5):416–22 PubMed PMID: 23808548.

    Article  CAS  PubMed  Google Scholar 

  58. Geerts AF, Scherpbier-de Haan ND, de Koning FH, van der Sterren TM, van Weel C, Vervoort GM, et al. A pharmacy medication alert system based on renal function in older patients. British J Gen Pract. 2012;62(601):e525–9 PubMed PMID: 22867675. Pubmed Central PMCID: 3404329.

    Article  Google Scholar 

  59. Bhardwaja B, Carroll NM, Raebel MA, Chester EA, Korner EJ, Rocho BE, et al. Improving prescribing safety in patients with renal insufficiency in the ambulatory setting: the drug renal alert pharmacy (DRAP) program. Pharmacotherapy. 2011;31(4):346–56 PubMed PMID: 21449624.

    Article  PubMed  Google Scholar 

  60. Fischer SH, Field TS, Gagne SJ, Mazor KM, Preusse P, Reed G, et al. Patient completion of laboratory tests to monitor medication therapy: a mixed-methods study. J Gen Intern Med. 2013;28(4):513–21 PubMed PMID: 23229907. Pubmed Central PMCID: 3599033.

    Article  PubMed  Google Scholar 

  61. Saha MT, Saha HH, Niskanen LK, Salmela KT, Pasternack AI. Time course of serum prolactin and sex hormones following successful renal transplantation. Nephron. 2002;92(3):735–7 PubMed PMID: 12372970.

    Article  CAS  PubMed  Google Scholar 

  62. Bramham K. Pregnancy in renal transplant recipients and donors. Semin Nephrol. 2017;37(4):370–7 PubMed PMID: 28711076.

    Article  PubMed  Google Scholar 

  63. Sifontis NM, Coscia LA, Constantinescu S, Lavelanet AF, Moritz MJ, Armenti VT. Pregnancy outcomes in solid organ transplant recipients with exposure to mycophenolate mofetil or sirolimus. Transplantation. 2006;82(12):1698–702 PubMed PMID: 17198262.

    Article  CAS  PubMed  Google Scholar 

  64. Bramham K, Nelson-Piercy C, Gao H, Pierce M, Bush N, Spark P, et al. Pregnancy in renal transplant recipients: a UK national cohort study. Clin J Am Soc Nephrol. 2013;8(2):290–8 PubMed PMID: 23085724. Pubmed Central PMCID: 3562860.

    Article  CAS  PubMed  Google Scholar 

  65. Shah S, Venkatesan RL, Gupta A, Sanghavi MK, Welge J, Johansen R, et al. Pregnancy outcomes in women with kidney transplant: Metaanalysis and systematic review. BMC Nephrol. 2019;20(1):24 PubMed PMID: 30674290. Pubmed Central PMCID: 6345071.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Wagner AK, Chan KA, Dashevsky I, Raebel MA, Andrade SE, Lafata JE, et al. FDA drug prescribing warnings: is the black box half empty or half full? Pharmacoepidemiol Drug Saf. 2006;15(6):369–86 PubMed PMID: 16294363.

    Article  PubMed  Google Scholar 

  67. Kidney Disease: Improving Global Outcomes Transplant Work G. KDIGO clinical practice guideline for the care of kidney transplant recipients. Am J Transplantation. 2009;9(Suppl 3):S1–155 PubMed PMID: 19845597.

    Google Scholar 

  68. van Balveren JA, Verboeket-van de Venne W, Erdem-Eraslan L, de Graaf AJ, Loot AE, Musson REA, et al. Impact of interactions between drugs and laboratory test results on diagnostic test interpretation - a systematic review. Clin Chem Lab Med. 2018;56(12):2004–9 PubMed PMID: 30332390.

    Article  PubMed  CAS  Google Scholar 

Download references

Acknowledgements

We acknowledge all clinicians and clinic staff who collaborated with us in this study to collect data

Funding

This study was extracted from a Master of Science thesis in the medical informatics domain approved by the Urmia Medical Science University (UMSU) (registered number 2245). UMSU had no role in the design of the study and collection, analysis, and interpretation of data as well as in writing the manuscript. This study did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Author information

Authors and Affiliations

Authors

Contributions

ZN and HP designed the study. MF collected the field data. MF and ZN extracted the IF & Then rules from main references and clinicians’ points of view. ZN, MF, HP, AS, KM, and PRK were all participated in data interpretation. ZN wrote the first draft and MF, HP, AS, KM, AG and PRK reviewed the draft and commented on it. All authors approved the final version.

Corresponding author

Correspondence to Habibollah Pirnejad.

Ethics declarations

Ethics approval and consent to participate

This study was reviewed and approved by the institutional research ethics committee of the Urmia Medical Sciences University (ethics code number IR.UMSU.REC.1396.312). Because this study only used patient data recorded in the patient medical records, and because it did not include any direct intervention on patients, therefore consent to participation was not required according to the UMSU’s research ethics policies.

Consent for publication

Provided by the deputy of research of Urmia Medical Science University.

Competing interests

None.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Formulas for CrCl and LBW.

Additional file 2.

Complete set of 27 medications.

Additional file 3.

Sample diagrams for individual drugs.

Additional file 4.

Sample diagrams for individual drugs.

Additional file 5.

Sample diagrams for individual drugs.

Additional file 6.

Sample diagrams for individual drugs.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Niazkhani, Z., Fereidoni, M., Rashidi Khazaee, P. et al. Translation of evidence into kidney transplant clinical practice: managing drug-lab interactions by a context-aware clinical decision support system. BMC Med Inform Decis Mak 20, 196 (2020). https://0-doi-org.brum.beds.ac.uk/10.1186/s12911-020-01196-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12911-020-01196-w

Keywords