Although NICE never stipulated that an implant should move from a 3 to a 10 or a 15-year rating, ODEP decided the system would fail patients if manufacturers did not regularly submit data to support the continued use of their product at each of the time points.
ODEP have always realised that early data is less reliable in terms of predicting the long-term success of a product than more mature data from a longer study. ODEP also professes that by having benchmarks at time points between 3 and 15 years means that manufacturers will keep a careful watch on their product’s performance.
Thus, the system has evolved, with manufacturers notifying ODEP at the time of the implant being introduced into the market for a pre-entry rating and then, with time and with success of the implant, achieving a 15A* (Hips and Knees) or 10A (Shoulders) rating.
ODEP does not expect an implant to “rest” and not continue to move through the benchmarks at the allocated time periods. If the implant does not continue to move up through the ratings it could be withdrawn. ODEP realise that data collection is time consuming and ODEP does understand that companies can face difficulties in obtaining data to deadlines. We know that there is often a delay between the request and the delivery of data from some registries. Thus, a year of grace is available for manufacturers to obtain the necessary data for their next submission. ODEP will inform manufacturers when they are expected to submit and if after the appropriate reminders, the company does not submit their product will be de-registered and on the website the product will be noted as “lapsed”. Manufacturers, whose product has been rejected or where the rating has lapsed are invited to make a comment on the website if they wish. The product may have been withdrawn and that will also be recorded against its listing on the website
With the maturity of registries ODEP may well extend benchmarks, past the 15-year timepoint. These will keep pace with the data available in most of the national registries.
After an implant has achieved the highest benchmark, the manufacturer is expected to refresh their data every three years thereafter, to ensure good vigilance and surveillance of performance through data analysis. Regular reminders are issued to companies when their implants are approaching these gateways.
It is strongly recommended that manufacturers take note of all the sections of this website relating to benchmarks and what is required to complete a submission. The submission form and the table showing the standards required for each benchmark will be pivotal in planning an application.
The timelines for each round of ODEP are published. They include:
There is no restriction on making submissions in good time except availability of contemporary data (ODEP expects registry data to be the most up to date from registries; this will usually be data since the registries last annual report).
Manufacturers are welcome to contact ODEP to discuss any difficulties they are having in completing the submission form. They are reminded that if they have a contract with NJR they are entitled to have free advice from NEC Software Solutions UK Limited.
Manufacturers are expected to appeal to ODEP if they think ODEP has not judged them fairly or where the submission has been accepted but with caveat(s).
ODEP’s consider appeals very carefully. However, the decision at these appeals meetings are almost always final. This means that further contact about that implant should be for the next meeting for that particular type of implant.
Will ODEP allow a manufacturer to keep a product’s present benchmark when they want to modify the device?
It has always been ODEP’s view that if:
it will usually be regarded as a new device and will have to start the ODEP process from the beginning, the pre-entry stage.
It has often been argued that there is no such thing as a “minor modification”. There have been instances of “minor modifications leading to major changes in performance, often for the worse”. These facts do colour our view about “minor modifications”.
Manufacturers are well advised to let ODEP know of any “modification” they wish to make to one of their devices and it is much better that ODEP is informed rather than ODEP finding out.
Some modifications are acceptable, and acceptance is allowed on an implant-by-implant basis after exhaustive discussion. Often this involves taking advice from expert bioengineers or other experts
ODEP expects to be informed by Manufacturers if their implant has been the subject of a FSN.
Camouflage is a word that entered Registry parlance when the problems with stemmed metal on metal hip replacements were finally identified as being dangerous. At that time registries categorised hip replacements as being either cemented, uncemented or hybrid. Hybrid is where one part of the joint was cemented and the other was not. The overall results for hybrid uncemented or cemented stems with uncemented cups was good. Most of these incorporated a metal head on a HDP bearing within a metal acetabular shell. At that time, all bearing surfaces came under the 3 types of hip replacement. The numbers were very large and when metal on metal bearings came in their poor results were camouflaged by the excellent results of the other bearing combinations.
Since then, there have been other examples of camouflage or an implant being in the shadow of a large number of well performing ones. If a very effective knee replacement, which has been used very successfully thousands of times had one of its attributes altered there would be a risk of this attribute being unnoticed in a registry that was only looking at brands. The small number of the brand with this new part to it could fail repeatedly before the numbers were sufficient to alter the revision rate or PTIR (Patient Time Incident Rate) and come to the notice of the manufacturer or registry.
It was basically because of these issues with camouflage that the whole architecture of the NJR was redesigned in co-operation with the German Registry (EPRD). The NJR / EPRD database is now very much more granular and therefore more able to detect and investigate camouflage.
Thus, it is important that manufacturers declare all the product codes and their descriptors in an ODEP submission as increasingly ODEP are looking at product codes rather than just brands alone.
ODEP welcomes data from any source, where the data has been validated by one way or another. When ODEP started, there were few registries and most data came from peer reviewed, published studies. Increasingly manufacturers have made use of registry data, particularly where it is available through such electronic portals such as the NJR’s supplier feedback. Particularly for the early benchmarks such the 3 and 5 benchmarks ODEP welcomes more than one type of data.
Manufacturers are welcome to use data from Registries where the linkage between primary and revision procedures is secure. The data needs to be “cut” to the time point for which the submission is prepared. The International Society of Arthroplasty Registries (ISAR) have introduced standards for registries and ODEP takes careful note of the standing of a particular registry. ODEP is concerned about using data from a registry that does not account for patients moving from a hospital in one area to another hospital outside the catchment area of the registry involved. Our very strong preference only to use registry data where the linkage between primary and revision data is secure, preferably full proof.
ODEP welcomes data from clinical trials. It is thought to be reliable, and it is often good supporting evidence, particularly for early benchmarks, to be added to early registry data. When it all comes from the originator’s centre it needs added data from “other centres” to qualify for an A or A* rating.
ODEP expects any publications, podium presentations and posters to only be submitted when they have been previously peer reviewed.
Some manufacturers have first-class in-house data collecting systems. Unfortunately, they are not subjected to external validation, and it is thought possible for patients to escape from their follow up process. However, as one of the driving forces behind ODEP was to ensure that manufacturers should collect and review data about their implants, ODEP supports the use of this data but with some caveats. In 2023, ODEP implemented a new guideline requiring manufacturers to ensure that any in-house data used for ODEP submissions complies with ISO 14155:2020 standards. This provides ODEP with extra reassurance about the quality of the submitted data.
Can the implant keep its ODEP rating when an Implant, such as a joint replacement is transferred from one manufacturer to another? ODEP will be pleased to give its opinion on an implant-by-implant basis but, for it to happen, our guidelines include but not restricted to the following :
It is important that ODEP are made aware of all aspects of the transfer that relate to the product in a transparent manner.
This section focuses on the Guidance ODEP would like Manufacturers to be cognisant of when using their ODEP ratings in their collateral for Marketing for their joint replacements.
ODEP are supportive of manufacturers and distributors using ODEP ratings during the marketing of their products within the UK and international markets. ODEP would however like to provide guidance to ensure that any use of the ODEP ratings are used fairly and consistently and follow the principle of ensuring the ratings are not used to mislead current or potential customers in any way.
ODEP reserve the right to remove any rating from supplier’s products should there be consistent and deliberate non-conformance with the guidance above.