CLIIR is...

  • A collaborative research center that believes in the importance of research to maximize the impact of digital health on health system performance.

  • A center that leverages data from UCSF and UC Health to serve as a learning lab and top-tier academic research and policy hub in digital health.


CLIIR's Cornerstone Initiative

Audit-log data captures moment to moment clinical care processes within the electronic health record (EHR). Data on who is doing what and when opens a window into how individual providers and care teams are using the EHR and the resulting clinical work processes. Prior to having access to audit-log data, such information would have to be manually sourced, requiring many hours of observation that is prone to human interpretation and error. Audit-log data makes these labor intensive approaches obsolete, providing more comprehensive data faster and with more accuracy. Taking this audit-log data and combining it with clinical data enables us to research the impact of provider workflows, behaviors and interactions with the EHR on patient outcomes.

National Research Network for EHR Audit-log
CLIIR-led Initiative 

CLIIR is establishing a national research network focused on advancing digital health via use of EHR audit-log data. The main topics that the network addresses are as follows: 

  1. Research Topics and Funding (e.g., types of research questions well suited to audit-log data, funding sources for audit-log research)
  2. Data Quality and Creating Meaningful Measures (e.g., accuracy, usefulness of data documentation, various levels of granularity, strategies for reducing noise/errors)
  3. Research Methodologies and Skillsets (e.g., methodological/modeling approaches well suited to audit-log data, skillsets of research team)


Image Viewing among Cardiologists and the Resulting Impact on Patient Outcomes
CLIIR Pilot Project

Traditionally, a radiologist interprets the image and generates a text-based imaging report with their interpretation of the findings.  However, human interpretation and synthesis of primary imaging data into text reports is a process with inherent imprecision and inaccuracy. As a result, a cardiologist may choose to rely on the imaging report, the primary image, or both when making diagnostic and treatment decisions, and they also may choose to consult with a radiologist when doing so.  We hypothesize that primary review of imaging (ideally with an imaging expert) improves care – and that by reviewing reports alone, information is missed that can help patient care. Our goal is to study the effect on inpatient outcomes of cardiologists viewing imaging reports compared to viewing images themselves (with or without an imaging expert – i.e., radiologist).



The Market Transparency Project for Health IT Interoperability Services Cooperative Agreement Program 
Sponsor: Office of the National Coordinator for Health IT (ONC)

The 2009 HITECH Act sought to promote nationwide adoption and effective use of interoperable electronic health records (EHRs). While EHR adoption has substantially increased, particularly among hospitals, the ability to move data across EHRs to support frontline clinical care and the ability to move data between EHRs and other systems and applications that support patient engagement, public health, research, and a wide variety of other health-related purposes has been substantially more limited. This project focuses on increasing transparency of interoperability functionality/services. The final result of our project will be an independent, open, online resource. 


National Survey of Health Information Exchange Organizations (HIO)
Sponsor: Office of the National Coordinator for Health IT (ONC)

Electronic health information exchange (HIE) is one of three goals specified by Congress in the 2009 Health Information Technology for Economic and Clinical Health (HITECH) Act to ensure that the $30 billion federal investment in electronic health records (EHRs) results in higher-quality, lower-cost care. The ability of providers to share data electronically is a core goal of HITECH and a central feature of a high-performing healthcare delivery system. Gaining insights into information blocking practices undertaken by provider organizations and health IT developers, the implementation of and use of standards to enable interoperability, the role of HIOs in supporting information exchange, and the sustainability and governance of HIOs is essential in supporting efforts to enable interoperability and exchange. Over the past eight years, our team has conducted five nationwide surveys of organizations working to promote HIE to determine the state of current efforts, scope of activities, and financing. The most recent findings were published in the March 2016 issue of Health Affairs and offered an independent, comprehensive evaluation of HIE progress.The nationwide survey of HIOs will enable us to focus on new achievements and identify challenges to create a current and accurate picture of HIE efforts. 


Synergies and Sequencing in Delivery and Payment Reform: Understanding What Works 
Sponsor: Agency for Healthcare Research and Quality (AHRQ) 

The Medicare Access and CHIP Reauthorization Act (MACRA) is an unprecedented expansion of value-based payment reform for physicians. Physicians will choose one of two tracks in which to participate. Alternative payment models (APMs) is the track that is widely considered to be the future of healthcare. The future impact of MACRA is unknown. However, recent experience can help to inform how physicians are likely to engage with APMs and the impact of these choices on the quality and cost of care. Our overall objective is to understand the effects of delivery and payment reforms on healthcare quality and spending in the United States. The objective of the project is to identify participation patterns and near-term effects of Meaningful Use and PCMH programs in the context of ACO efforts because these are key components of APMs. 


Advancing Our Understanding of the IT-Enabled Consumer
Sponsor: The Commonwealth Fund

Substantial public- and private-sector investment has sought to digitize health information with a key goal of engaging patients in becoming IT-enabled to manage their health. Yet in practice, these efforts have largely failed to scale and transform healthcare from an episodic, provider-centric model to a continuous, patient-centric model that empowers patients and caregivers by supporting them in complex health and care decisions. This project will generate new knowledge to reveal why efforts to-date have yet to usher in the era of the IT-enabled consumer – using consumer profiles as the foundation.


An Early Look at Patient-Facing APIs
Sponsor: The Commonwealth Fund

Healthcare is entering the next phase of patient-centered care as healthcare delivery systems start to “turn on” patient-facing application programming interfaces (APIs). As health systems begin this process, it is crucial to capture early successes and best practices so that this transition is safe, secure, and has the intended impact of accelerating patient access and use of their electronic health data and digital health development. Our project will distill these best practices by conducting semi-structured interviews with the health systems that are patient-facing API “early adopters.” The themes that emerge from synthesizing responses across interviews will allow us not only to identify best practices but also to characterize early challenges and pitfalls that may require intervention at the policy level.


The Project to Advance Interoperability and Data Access
Sponsor: The Healthcare Leadership Council and the Bipartisan Policy Center  

Advancing interoperability of systems and electronic information sharing in the U.S. is critical to support: 1. Better health outcomes for individuals in the U.S.; and 2. Higher quality, safer, more cost-effective care for individuals and populations. This project will help inform health information sharing priorities for those who deliver, receive, and pay for care, a vision or desired future state, key measures to help us determine whether we’ve made national progress against our vision and key legislative or regulatory policy actions that are needed – by the private sector and by government.