Device Equivalence
Introduction
While validation studies are usualy presented as being a validation of a device, this is more of a legacy term from validayions of early devices that provided measurement funtionality only. Nowadays, many devices have other functions and statistics that are not included in the validation. Furthermore, it is now usual for manufacturers to provide different versions of a device with the same measurement technology but with different added funtionality or accessories. Validation, therefore, should not be considered as being of a particular device, but of a particular measurement technology (there can be more than one) in that device.
Where a particular technology is proven to be accurate (or inaccurate), that result should apply to all devices using that measurement technology. This is where equivalence comes into play. One of the devices with a certain measurement technology is validated according to a standard protocol. This is an expensive and time-consuming process involving the participation of many subjects, depending on the protocol for that technology. It is not necessary, nor desirable, to repeat that for every device, or brand of device, that uses that exact same measurement technology. A better approach, scientifically, practically and efficiently, is to prove that the measurement technologies are the same and that, the existing validation results must, therefore, apply.
Known as MEDDEV 2.7/1 rev 4, the most complete guidelines on how to prove equivalence were drawn up by the Health Technology and Cosmetics department of the European Commission [1]. In simple terms, this involves devising a checklist of everything involved in a device used to measure some medical value. This list is split into two sets, all the items directly involved in the measurement and all of the other items. The list can be filled in for any device and, once this is done, those devices can be compared.
If all of the items directly involved in the measurement match each other then, as far as taking that measurement is concerned, the devices are said to be equivalent and it doesn't matter which device is used. All devices that are proven to be equivalent to each other form a "family" of devices. Equivalence has major consequences because it means that the results, good or bad, of any validation of the measurement technology must be applied to all equivalent devices. It must be proven and peer-reviewed in the same way as any scientific procedure [2, 3].
The comparison does not just end at equivalence – it has another important function in identifying how any pair of equivalent devices actually differ. They are, after all, being sold as being different. This is found by comparing "all the other items". Sometimes one device has a few extra features than another device, like more memory or more analysis of the results. Sometimes they differ in use, like portable and table-top versions. Sometimes the only difference is in the branding but this too is important to prove, as it protects against fake copycat designs.
Non-MDR-Compliant Equivalences
Various professional societies have used alternative methods to evaluate devices for equivalence (also referred to as "derivative" by some).
The BIHS accepts declarations, in good faith, on information supplied on, a short form, by manufacturers [4, 5]. Hypertension Canada [6] require sworn affidavits. The DHL approve devices that are technically identical to another already validated device ("technisch baugleich mit einem bereits validierten anderen Messgerät") but information on how that is determined and on which validated devices are involved is not disclosed [7]. The ESH accept both BIHS and DHL listings but not those of Hypertension Canada [8]. The FDA accept 510(k) declarations, which are often chained through a sequence back to a validation carried out a long time ago, on the understanding that there have been no updates to the technology since then.
From a scientific perspective, the declaration, is just the first step in the process [2, 3]. This is no different, in principle, to any validation. No manufacturer is going to send a device for validation unless they believe it to be accurate and have likely tested it thoroughly already in their own internal quality control procedure, often in a dry run of the validation. Indeed, these internal checks are often accepted by regulatory authorities. The problem, of course, is that there are also fake claims by unscrupulous companies – which are often impossible to trace. Genuine errors can also be made. This is why the scientific community requires independent peer-reviewed proof [2, 3] and why the EU has moved to require it since May 2021 [9]. The World Hypertension League has called on the private sector and on governmental organisations to ensure that the only automated BP devices that are and that can be sold are those that have been tested independently [10].
This is why Medaval puts a question watermark (Query-mark) over devices for which there does not appear to be any scientific proof of accuracy. From a scientific perspective, based on published recommendations, we cannot accept that two devices are equivalent just on the say-so of the manufacturer. However, we recognise where the first step in the process has been taken, and accepted as the complete process by some societies, and we have created an assessment category, named "Equivalence awaiting proof", for these devices. These devices are neither watermarked nor recommended. The information is provided as-is.
Comparative-Equivalence Procedure
Medaval has drawn up, with the assistance of renowned experts, a protocol for comparative-equivalence (emphasising the two important aspects of the checks) in compliance with MEDDEV 2.7/1 rev 4 [1] and EU 2017/745 [9].
Medaval Comparative-Equivalence Specifications cover page
Step 1: Register Devices
To prove commonality of core elements and to classify differences, consistently and scientifically, Medaval provides an on-line Device Registration Form that allows the manufacturer to enter the device details in a straightforward standard comprehensive list. There are about 320 items at present for blood pressure monitors drawn up from all devices (the list increases to incorporate new innovations), so, for any particular device, many items will not apply. Device manuals, device images and display images are also required, as supporting evidence. Entries are coded automatically for comparison, with manual checks made, as necessary. All items must be complete before analysis can be performed. Of course assistance is provided during this phase.
Step 2: Medaval Compares the Devices
Following a request to assess a set of registered devices for comparative-equivalence, all items for each pair of devices will be compared by group [2, 3]. Each detail falls into one of three groups. Core details, upon which measurements are dependent, must be the same for all devices to prove equivalence. Other, generally software-based, features determine, in the main, the comparable usability of the devices. Accessories, generally hardware, have no influence on any results but some variations (e.g. wall v desk mounts) explain the differences between some models.
If all Core items are proven to be identical or equivalent, equivalence is proven. Once this is proven, the comparative aspect comes into play. A device can be identical (e.g. brand or language differences only), common (same features and accessories but some with different provision), superior (more features or accessories), simpler (fewer features or accessories), diverse (different features or accessories) or common diverse (both common and diverse) to another device.
Step 3: Medaval Generates a Scientific Report
An extensive report is produced for provision to a notary body (for regulation purposes) and a summary report, without sensitive proprietary details, for publication. A peer-reviewed paper is also provided [2, 3]. This includes how each pair of members compare to each other.
Equivalence is both commutative (if Device B is equivalent to Device A, then Device A must also be equivalent to Device B) and transitive (if both Device B and Device C are equivalent to Device A, then they must also be all equivalent to each other). This means that equivalence of core measurement technology defines a family of devices, rather than separate pairs. It also means that the results of all validations of that technology apply to all members of the family, irrespective of which devices are used in validation studies.
Validation is not included in the comparative-equivalence procedure, as this is dependent only on the device hardware and firmware. However, once equivalence is proven, a short report is written applying any existing validations to the technology to all devices sharing that technology. Similarly, all subsequent validation information is applied to all devices sharing the technology.
From January 2020, Medaval only accepts equivalences to MDR standards [1, 9]. Devices with declared equivalence/derivative to another device, with published evidence of validation, are indicated as having possible MDR equivalence and are not shown with a Query-mark.
Click on the icon YouTube to view our Comparative-Equivalence video on YouTube.
  1. European Commission – Health Technology and Cosmetics. MEDDEV 2.7/1 rev.4: Guidelines on Medical Devices – Clinical Evaluation: A Guide for Manufacturers and Notified Bodies under Directives 93/42/EEC and 90/385/EEC. Brussels, Belgium: European Commission; June 2016 (65 p). Available from: http://ec.europa.eu/DocsRoom/documents/17522/attachments/1/translations/
  2. O'Brien E, Stergiou GS. The pursuit of accurate blood pressure measurement: A 35-year travail. J Clin Hypertens (Greenwich). 2017 Aug;19(8):746-752. doi:10.1111/jch.13005. Epub 2017 Apr 21. PMID: 28429879.
  3. O'Brien E, Stergiou GS, Turner MJ. The quest for accuracy of blood pressure measuring devices. J Clin Hypertens (Greenwich). 2018 Jul;20(7):1092-1095. doi: 10.1111/jch.13279. PMID: 30003703.
  4. British and Irish Hypertension Society. BP monitors, Derivative Devices. [Internet] Leicester, UK: BIHS; 2017/2018. Available from: https://bihsoc.org/bp-monitors/.
  5. British and Irish Hypertension Society. Process for Listing of Validated Blood Pressure Monitors. [Internet] Leicester, UK: BIHS; 2017/2018. Available from: https://bihsoc.org/bp-monitors/process-for-listing-of-validated-blood-pressure-monitors/.
  6. Hypertension Canada. Blood Pressure Devices Recommended by Hypertension Canada. [Internet] Markham, Ontario, Canada: Hypertension Canada; 2018. Available from: https://hypertension.ca/hypertension-and-you/managing-hypertension/measuring-blood-pressure/devices/.
  7. Deutsche Hochdruckliga e.V. DHL [German Hypertension League]. Geprüfte Messgeräte 2001-2018 [Tested measuring instruments 2001-2018]. [Internet] Heidelberg, Germany: DHL; 2002-2018. Available from: https://www.hochdruckliga.de/messgeraete-mit-pruefsiegel.html.
  8. Stergiou GS, Asmar R, Myers M, Palatini P, Parati G, Shennan A, Wang J, O'Brien E; European Society of Hypertension Working Group on Blood Pressure Monitoring and Cardiovascular Variability. Improving the accuracy of blood pressure measurement: the influence of the European Society of Hypertension International Protocol (ESH-IP) for the validation of blood pressure measuring devices and future perspectives. J Hypertens. 2018 Mar;36(3):479-487. doi: 10.1097/HJH.0000000000001635. PMID: 29384984
  9. The European Parliament and the Council of the European Union. Regulation (EU) 2017/745 of the European Parliament and of the Council of 5 April 2017 on medical devices, amending Directive 2001/83/EC, Regulation (EC) No 178/2002 and Regulation (EC) No 1223/2009 and repealing Council Directives 90/385/EEC and 93/42/EEC (Text with EEA relevance). Official Journal of the European Union. 2017 May 05;60(L 117):1-175. Available from: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A32017R0745.
  10. Campbell NR, Gelfer M, Stergiou GS, Alpert BS, Myers MG, Rakotz MK, Padwal R, Schutte AE, O'Brien E, Lackland DT, Niebylski ML, Nilsson PM, Redburn KA, Zhang XH, Burrell L, Horiuchi M, Poulter NR, Prabhakaran D, Ramirez AJ, Schiffrin EL, Touyz RM, Wang JG, Weber MA. A Call to Regulate Manufacture and Marketing of Blood Pressure Devices and Cuffs: A Position Statement From the World Hypertension League, International Society of Hypertension and Supporting Hypertension Organizations. J Clin Hypertens (Greenwich). 2016 May;18(5):378-80. doi: 10.1111/jch.12782. Epub 2016 Feb 8. PMID: 26852890.