Real World Evidence for medical devices

A detailed look into the importance of Real World Evidence (RWE) to Post-Market Clinical Follow-up, EU MDR compliance and for the safety of medical devices.

What is Real World Evidence for medical devices?

Real World Evidence (RWE) is clinical evidence generated from observational data on the real-world use of medical devices. It differs from evidence produced through formal clinical trials because RWE relates to experience with a device in all settings and in all types of patient/user normally exposed to the device. RWE studies often run indefinitely rather than being time limited, and continually add new subjects to the dataset.

RWE has become increasingly important following the enactment of the Medical Device Regulation MDR 2017/745, fully implemented from May 2021. The MDR introduces enhanced requirements for Post-Market Clinical Follow-up (PMCF) of all medical devices, requiring that data be produced continually and throughout the entire lifetime of the device.

In order to meet these requirements, medical device manufacturers need to develop and implement an evidence generation system that produces RWE on device safety and performance while remaining in compliance with all relevant rules, regulations and wider legislation.

What are the differences between Real World Evidence and standard clinical data?

RWE is entirely different to other forms of clinical data and requires a completely new approach that is unfamiliar to most medical device manufacturers. “Standard” clinical data is generated through formal clinical trials that have the following general characteristics:

  • Carefully controlled inclusion and exclusion criteria, meaning the study population can be limited to a sample
  • Set ‘case’ and ‘control’ parameters enabling a direct comparison between two defined populations
  • Often involves some form of experimental exposure to address an hypothesis
  • A limit on recruitment number
  • A limit on study time period
  • Relatively few, often highly specialised, clinical sites at which the study is conducted.
Real World Evidence

By contrast, RWE of the type required to meet the requirements for PMCF systems under the MDR does not conform to these characteristics. Instead, Real World Evidence:

  • Is drawn from a study population that represents the entire population normally exposed to the device
  • Is non-comparative, focusing only on the performance of the subject device rather than making comparisons to something else
  • Does not involve experimental exposure. Instead, it studies the use of a device that is already approved for use in the manner being studied, and seeks to confirm or refute that it meets safety and performance objectives “out there in the world”.
  • Has no upper limit on recruitment number
  • Runs indefinitely, aiming to cover the “entire lifetime of the device”
  • Is conducted at all types of clinical site, not just specialist units

From this comparison it should be clear that planning, implementing, performing, monitoring and reporting RWE is entirely different to that of “standard” investigative clinical data.

Generating RWE can be challenging. Most medical device manufacturers have some experience in producing standard clinical data but comparatively few have any expertise in generating RWE of the type required by the MDR.

Designing a system to generate RWE while remaining compliant with all relevant rules and legislation is a demanding task that requires specialist knowledge. It begins with choosing the most appropriate method for generating RWE from the various options available.

What are the methods for Real World Evidence generation?

There are numerous different sources of RWE. The applicability and suitability of a particular source or method will vary depending upon several factors, including:

  • the type of medical device
  • its complexity
  • its risk classification
  • the depth and detail of data needed
  • the number of exposed subjects or users
  • existing sources of data

It is absolutely imperative that the correct choice is made for the clinical situation. A poor choice of RWE generation method may lead to a progressive accumulation of problems, as any weaknesses in the collection method or the data itself will compound over time. Choosing the wrong method can be an expensive mistake and in the worst case can lead to loss of regulatory approval for the device.

Patient surveys are easy to implement and can form the basis of comparatively simplistic RWE. Patients or users respond to a series of standardised questions following exposure to a medical device and the data is then accumulated and analysed. Patient surveys are reliant upon subjects being motivated to respond and can be prone to bias - often, patients in the best health are more able and willing to respond, skewing the data positively. Despite these shortcomings, patient surveys can be an appropriate design to obtain RWE on simple or low risk medical devices.

Retrospective cohort reviews are another reasonable but unsophisticated source of RWE. In a retrospective review, the medical records of subjects meeting specified exposure criteria are analysed in order to glean historical safety and performance data. This method has the advantage of being less prone to patchy subject compliance than patient surveys, but remains susceptible to positive selection bias because it is possible for reviewers to (unwittingly) select cohorts more likely to have positive outcomes. Eliminating bias entirely from retrospective reviews is challenging, requiring strict controls on data collection methods. Regulatory bodies will need to see evidence of stringent bias control methods in order for the data generated to be accepted as valid.

National registries represent a powerful source of RWE that is inherently less prone to bias than other methods. Where they exist, a national registry (such as the UK National Joint Registry (NJR)) collates data on every use of or exposure to a medical device in a certain category. In the case of the NJR, safety and performance data on every implantation of prosthetic hips, knees, shoulders and ankles is collected in the database, producing a massive and comprehensive source of bias-free data. Unfortunately, national registries only exist for a limited number of categories of device, and in the absence of such a national registry it may be necessary for manufacturers to build their own.

Medical Device Product Registries, in the absence of a national registry, represent the gold standard source of RWE for medical devices. The design of the registry can be carefully controlled to ensure that sources of bias are eliminated, and the use of a study protocol will help to ensure that the investigation proceeds according to a prospective, specified standard at all clinical sites, eliminating the potential for variability. A properly-designed registry will be capable of capturing RWE on device performance, adverse events, emerging risks, trends of side-effects, and systematic misuse, meeting the full range of requirements for PMCF as specified in MDR Annex XIV Part B and ensuring regulatory acceptability of PMCF methods both now and into the future.

What documentation is required for Real World Evidence in the MDR?

Real World Evidence generation systems, as a component of PMCF, will need to be documented in accordance with requirements for technical documentation as specified in the MDR. Annex II and III specify a range of documents that must be produced in support of every medical device, including a PMCF Plan, PMCF Report and a Clinical Evaluation Report (CER).

Additionally, MDR Annex XV lists a range of requirements that must be adhered to for every form of clinical investigation, including those intended to generate RWE. These requirements include the need to produce a clinical investigation plan, investigator’s brochure, and informed consent form, as well as securing ethical approval where required and adhering to data protection laws and regulations.

Overall, constructing a robust system for generating Real World Evidence is a specialist task but one that will safeguard the regulatory approval status throughout its commercial lifetime.

Need help with your MDR strategy?

Powerful PMCF systems for your MDR compliance

PMCF registries and plans for your medical devices designed by our MDR experts.

  • Study design & documents
  • PMCF plan development
  • Site on-boarding support
  • Real-time data collection

Find out more

Call us now to discuss your MDR requirements:

(+44) 0114 386 3349

Or send us your details and we will contact you:

MDR Consulting

Our team of MDR professionals are medical device regulatory consulting specialists offering tailored MDR compliance services.

MDR Training

Our comprehensive training services are delivered by experts and address all aspects of MDR compliance.

Who we work with

Our clients come from across the industry and range from pre-start businesses to stockmarket-listed multinationals. We also have key strategic partners based in the UK and Denmark.

  • It was a pleasure working with you. We are completely satisfied with your service and look forward to working with you again.

    CEO, EU medical software company
  • Your service surpassed our expectations and added value across our organisation. We now feel much better placed to prepare for the MDR.

    Chief Executive, MedTech pre-start
  • A comprehensive, detailed and highly professional service.

    Regulatory Manager, UK device manufacturer
  • International

    We work with medical device manufacturers based in the UK, Europe, the US and Asia, developing MDR strategies for both physical devices and software as a medical device.

  • Diversified

    Working with us gives you access to our growing international team of MDR-trained healthcare professionals from a wide variety of clinical backgrounds.

Read more about our team and philosophy

Get our free White Paper: Mastering the MDR — A comprehensive summary of the EU MDR

Download

FAQs

We have compiled some of our frequently asked questions. If you'd like to know anything else about what we do, feel free to ask us a question.

  1. We can work with the majority of medical device manufacturers seeking compliance of their devices in accordance with Medical Device Regulation (EU) 2017/745, including both hardware and software devices. We also offer a free, no-obligation consultation, so please feel confident about discussing your requirements with a member of our team.

  2. No. We will work with you to produce systems and to support your EU MDR compliance, but we do not conduct research ourselves. We will provide tools for you to conduct your own Post-Market Surveillance. Our range of services are designed to assist you in this matter.

  3. Yes. We adhere to the highest standards of professionalism and regard maintaining confidentiality and data security as a cornerstone of our practice. We also comply fully with the requirements of GDPR.

  4. Our medical device regulatory consulting is built around a strict quality framework and we only work with clients who share this commitment to quality. Our CEO is a medical doctor with years of experience in the medical device industry and assumes personal responsibility for every project. Our product development process integrates client feedback throughout product production, ensuring a constant focus on your needs.

  5. We work with clients of all sizes and at all stages of their regulatory compliance journey. Our team are here to help and are happy to respond to general enquiries, even if you don't feel like you know where to start. We are experts at 'tuning in' to your requirements and will guide you through the entire process. Our free MDR Compliance Guide and suite of MDR downloads stand as proof of our commitment to help you understand your obligations under the MDR.

  6. Yes. Software as a Medical Device is an increasingly-important segment of the medical device market. We have extensive experience in building regulatory systems for medical software and offer a special application of all our MDR services for software products. We also offer unique downloads and white papers that focus specifically on Software as a Medical Device.

  7. At its core, working with the MDR is about working with clinical evidence. Whether you need to generate evidence for PMCF, analyse data for writing a CER, or build an MDR-ready PMS system, our medical experts have the clinical acumen to ensure that your clinical evidence is produced and interpreted with the highest levels of professionalism. Medical professionals work with clinical evidence all day. We bring their specialist capabilities directly to your MDR strategy.

  8. We believe in transparency and aim to build long-term relationships with our clients. This commitment is demonstrated by our customer-focused pricing strategy. You pay a small deposit upfront, only paying the balance when the work has been completed to your total satisfaction. For higher-value projects we offer flexible payment packages on an individual basis — please contact a member of our team to find out more.

  9. Yes. Our unique business model allows us to scale to accommodate almost any amount of work. Many of our medical professionals remain clinically active, meaning that we have trained more than we presently need. This system allows us to have ready availability of redundant capacity that can be called upon in the event of a surge in demand. Whatever your requirements, our unique business model allows us to step in faster than any of our competitors.

  10. Yes. We run a number of events throughout the year focusing on specific aspects of MDR compliance. We also offer a limited number of free webinars on a limited basis — subscribe to our newsletter to be notified early when we publish new events. Of course, we also have our extensive MDR Compliance Guide and free MDR downloads suite, both of which offer extensive training on all aspects of MDR compliance.

Do you need help with your MDR strategy?

Contact us