Published on 05/12/2025
Global Alignment of Formative and Summative Human Factors Expectations Across Regions
Human Factors (HF) and Usability testing are critical components in the development and validation of medical devices and pharmaceuticals. Understanding the regulatory landscape across regions, particularly the differences between formative and summative human factors studies, is vital for regulatory professionals. This guide outlines a step-by-step approach to navigate HF protocols in accordance with FDA, EMA, and MHRA expectations.
Step 1: Understand the Regulatory Framework
The first step in aligning human factors expectations globally is to clearly understand the relevant regulatory guidelines across regions.
- United States: The FDA mandates human factors considerations under guidance documents such as “Applying Human Factors and Usability Engineering to Medical Devices”.
- European Union: The EU has outlined expectations in the MedTech Regulation (MDR) and the In-Vitro Diagnostic Device Regulation (IVDR).
- United Kingdom: MHRA guidelines reflect those of the EU but also emphasize specific national requirements post-Brexit.
- International Guidelines: The ICH E6 (R2) guidelines also play a role in human factors considerations by promoting data integrity and quality assurance in clinical trials.
Step 2: Develop a Regulatory Strategy
Creating a robust regulatory strategy will set the foundation for successful human factors studies.
- Identify the target market:
- Assess whether to focus on US, EU, or UK markets initially.
- Determine any regional differences in user demographics and healthcare practices.
- Determine the regulatory requirements:
- Compile a checklist of formality required for formative and summative human factors studies across regions.
- Seek input from regulatory affairs, quality assurance, and clinical teams to ensure comprehensive coverage.
- Establish a timeline for human factors studies that aligns with overall project development timelines.
Step 3: Define Your Human Factors Protocol
Defining the human factors protocol is crucial in guiding both formative and summative studies.
- Formative Human Factors Studies:
- Define objectives and end-user tasks.
- Identify facilitators and barriers to usability.
- Engage with users early through:
- Concept validation studies.
- Iterative prototyping and testing sessions.
- Summative Human Factors Studies:
- Formulate a user study that evaluates overall usability performance.
- Define acceptance criteria based on regulatory expectations, ensuring compliance with usability validation.
- Engage an independent reviewer, if necessary, to enhance credibility.
Step 4: Conduct Formative Human Factors Studies
During this phase, the focus is on gathering qualitative feedback from typical users through various testing methods.
- Recruit a representative user sample based on target demographics.
- Execute the study ensuring that:
- Tasks represent real-world use scenarios.
- Observations are documented meticulously.
- Analyze data to identify trends, areas of confusion, and user errors.
- Iterate on design based on findings:
- Refine design features.
- Conduct follow-up testing as necessary to ensure improvements.
Step 5: Prepare for Summative Human Factors Validation
Preparation for summative testing is a critical step that informs the final usability validation.
- Finalize the device design based on formative study outcomes.
- Develop testing protocols:
- Align with defined standards such as ISO 9241.
- Incorporate metrics for task success and user errors.
- Draft documentation reflecting the planned methodology, including:
- Participant criteria.
- Environmental factors.
- Data analysis approaches.
Step 6: Implement Summative Human Factors Studies
Summative studies are designed to provide evidence of usability and are typically more structured than formative testing.
- Recruit participants who reflect the target user population.
- Execute the usability test:
- Ensure adherence to the developed protocol.
- Document user interactions and outcomes meticulously.
- Analyze the data:
- Calculate usability metrics and determine if acceptance criteria are met.
- Identify any deficiencies or areas for improvement.
Step 7: Compile and Submit Human Factors Documentation
Documentation is a key element throughout the human factors process. After the studies are complete, it’s essential to compile and submit all relevant documentation to the appropriate regulatory authority.
- Prepare a comprehensive report summarizing:
- Study objectives and methodologies.
- Results and conclusions drawn.
- Ensure all documentation is compliant with FDA expectations as well as other regional guidelines.
- Include a post-study action plan highlighting how identified issues will be addressed moving forward.
Step 8: Respond to Agency Questions and Deficiencies
Once submissions are made, expect to receive questions or requests for additional information from regulatory agencies.
- Anticipate common questions regarding:
- Participant recruitment processes.
- Risk assessments related to usability issues.
- Response strategies:
- Organize a cross-functional team to address complex inquiries involving regulatory affairs, clinical, and engineering expertise.
- Prepare clear, concise, and evidence-based responses supported by data from the studies.
- Document all interaction with agencies thoroughly to ensure clarity and traceability.
Step 9: Monitor and Report Post-Market Performance
Post-market surveillance is crucial for monitoring the long-term usability and performance of medical devices.
- Establish mechanisms to collect user feedback and report issues related to usability.
- Regularly review related data and effectiveness of the device throughout its lifecycle.
- Prepare periodic reports to regulatory bodies, addressing any new user studies or significant usability concerns that arise.
Conclusion
Understanding the regulatory landscape and aligning formative and summative human factors expectations across different regions requires a systematic approach. By following these steps, regulatory professionals can enhance their processes and ensure compliance with applicable guidelines, thus paving the way for successful submissions across regions. As human factors testing becomes increasingly pivotal in the regulatory landscape, integrating these practices into your organization’s framework is essential for compliance and product safety.