Uncertainty Analysis is an Important Part of Validation

“Testing” is a term that covers a vast range of activities. Not every test is a measurement; some are visual inspections or can be qualified with nominal descriptions such as “pass or fail” or “hot or cold”. However, for tests that either are measurements or include measurements, understanding the uncertainty of those measurements is important to interpreting resulting data. An important component of test method validation is an uncertainty analysis that systematically assesses the factors influencing the measurement.

Instruments and the process of calibration to reference standards are not perfect. Neither is the person performing the test, the environment, or the test method itself. Therefore, every measurement has some uncertainty associated with it. The use of recognized standard procedures reduces many potential sources of measurement uncertainty, however even when the method is standardized, the uncertainty of the method should be understood.

image

A measurement is a function of all the input quantities that affect the measurement. For example, for the measurement of volume there might be three measurements (length, width, height). The uncertainty in the volume measurement can be determined by calculating and combining each measurement uncertainty along with the uncertainty associated with other factors (e.g., temperature or hydration).

Measurement uncertainty is a statistical estimate of experimental error. Thus, when estimating the uncertainty of a measurement, uncertainty components which are of importance in the given situation should be taken into account using appropriate statistics.

When a test method validation includes an uncertainty analysis to systematically assess the factors influencing the measurement, use of the test method for inappropriate applications can be avoided. The test method may also be improved, controlled, or monitored in areas of high uncertainty, ultimately building more confidence into the associated results.

For more information, please visit our website at  medinstitute.com.

 

 

 

The Goals of Test Method Validation

Test method validation is a documented process that is used to confirm that the procedure to be employed for a specific test is suitable for its intended purpose. The validation of a test method by a laboratory should be a planned activity. Validation plans should be updated as development proceeds. The plan should include a description of the method and describe the various validation activities.

When planning a test method validation, consider the scope of the test method and the associated risk (link to previous blog) before the necessary validation activities are selected. The scope of the method is defined in terms of the method’s purpose and the breadth of medical devices that the method is intended for. The range and accuracy of the test method should be adequate for the test method’s intended purpose. The activities selected should be a balance between the rigor needed for a credible validation, breadth of applicability of the test method, and associated effort.

A validation should establish that the test method has: image-2

  • Accuracy within the needed range
  • Repeatability
  • Reproducibility
  • Robustness

A test method that has adequate accuracy will have instruments that are calibrated to reference standards and will have compared well to other methods or compared well in an inter-laboratory study.

A test method that is repeatable will yield successive measurements in close agreement under tightly controlled conditions within the same laboratory.

A test method that is reproducible will yield measurements in close agreement from different laboratories or within the same laboratory over a longer period of time.

A test method that is robust will demonstrate minimal sensitivity to external factors, such as operator skill or changes in ambient conditions.

Validated test methods, used appropriately, provide data that can be relied upon to make important decisions related to the verification and validation of medical devices with confidence.

To have a more thorough discussion or to answer any questions you may have regarding the test method validation process please contact MED Institute via our website at http://www.medinstitute.com