Mentor Research Institute

Healthy Contracts Legislation; Measurement & Value-Based Payment Contracting: Online Screening & Outcome Measurement Software

503 227-2027

Controls, Tests of Design (TOD) and Effectiveness (TOE) in Measurement and Value-Based Contracting For Mental and Behavioral Health Services


Summary

  • Effective controls are crucial for the success of value-based contracts in mental and behavioral health services as they ensure financial integrity, regulatory compliance, clinical quality, and operational efficiency.

  • Controls are mechanisms, policies, and procedures implemented to ensure that processes and operations function as intended, mitigating risks, ensuring compliance, and achieving desired outcomes. In value-based contracts, financial controls ensure billing accuracy, cost management, and payment reconciliation.

  • Compliance controls ensure adherence to federal, state, and local regulations, maintaining detailed records for audit trails.

  • Clinical controls implement evidence-based treatment protocols and track patient progress and outcomes.

  • Quality controls define and monitor metrics such as patient satisfaction and treatment adherence, while data controls ensure data accuracy, security, and analysis. Operational controls streamline workflows, allocate resources effectively, and provide ongoing training for healthcare providers.

  • Ethical controls manage conflicts of interest, uphold high ethical standards, and protect whistleblowers. Implementing these controls involves designing them to meet contract requirements, clearly documenting procedures, conducting tests of design and effectiveness, and continuously monitoring and improving control processes.

  • Tests of design evaluate whether controls are appropriately designed to achieve their objectives, while tests of effectiveness confirm that these controls function as intended in real-world operations. Together, these tests help organizations maintain robust internal controls and achieve their operational and financial objectives, ensuring the integrity of value-based payment models in healthcare.


Controls for Value-Based Contracts

Effective controls are critical for the success of value-based contracts in mental and behavioral health services. They ensure financial integrity, regulatory compliance, clinical quality, and operational efficiency. By implementing and maintaining robust controls, health plans and provider practices can achieve their shared goals, deliver high-quality patient care, and optimize the value-based payment model.

Definition of Controls: Controls are mechanisms, policies, and procedures implemented to ensure that processes and operations function as intended, mitigating risks, ensuring compliance, and achieving desired outcomes. In value-based contracts, controls help maintain the integrity of healthcare delivery and financial management.

1. Financial Controls

  • Billing Accuracy: Ensuring that billing practices comply with contract terms and are accurate, preventing overbilling or underbilling.

  • Cost Management: Monitoring and controlling costs to ensure that healthcare services are delivered within budget while maintaining quality.

  • Payment Reconciliation: Regularly reconciling payments received with services provided to ensure accuracy and address discrepancies promptly.

2. Compliance Controls

  • Regulatory Compliance: Ensuring adherence to federal, state, and local regulations, such as HIPAA, CMS guidelines, and other relevant laws.

  • Contractual Compliance: Monitoring adherence to the specific terms and conditions outlined in the value-based contract.

  • Audit Trails: Maintaining detailed records of all transactions and activities to provide evidence of compliance during audits.

3. Clinical Controls

  • Treatment Protocols: Implementing standardized treatment protocols to ensure consistency and quality in patient care.

  • Clinical Guidelines: Adhering to evidence-based clinical guidelines to ensure that treatments are effective and appropriate.

  • Patient Outcomes Monitoring: Tracking patient outcomes to evaluate the effectiveness of treatments and interventions.

4. Quality Controls

  • Quality Metrics: Defining and monitoring quality metrics such as access, patient satisfaction, therapist-patient alliance, medication adherence, and hospitalization rates.

  • Performance Reviews: Regularly reviewing the performance of healthcare providers and services to identify areas for improvement.

  • Continuous Improvement: Implementing continuous improvement processes based on performance data and feedback.

5. Data Controls

  • Data Accuracy: Ensuring that all data collected and reported is accurate, reliable, and up-to-date.

  • Data Security: Implementing measures to protect patient data and other sensitive information from unauthorized access and breaches.

  • Data Analysis: Using data analytics to monitor trends, identify issues, and make informed decisions.

6. Operational Controls

  • Workflow Efficiency: Streamlining workflows to improve efficiency and reduce unnecessary delays in care delivery.

  • Resource Allocation: Ensuring that resources (staff, equipment, etc.) are allocated effectively to meet patient needs and contract requirements.

  • Training and Development: Providing ongoing training and development for healthcare providers to ensure they are knowledgeable about value-based care principles and contract specifics.

7. Ethical Controls

  • Conflict of Interest Policies: Implementing policies to manage and disclose any potential conflicts of interest.

  • Ethical Standards: Upholding high ethical standards in all aspects of mental and behavioral healthcare delivery and financial management.

  • Whistleblower Protections: Providing protections for individuals who report unethical behavior or non-compliance.

Implementation of Controls in Value-Based Contracts

1. Control Design and Documentation:

  • Designing controls that are tailored to the specific requirements of the value-based contract.

  • Documenting control procedures clearly to ensure that all stakeholders understand their roles and responsibilities.

2. Control Testing:

  • Conducting tests of design to ensure that controls are appropriately designed to achieve their objectives.

  • Performing tests of effectiveness to verify that controls are operating as intended and achieving desired outcomes.

3. Continuous Monitoring and Improvement:

  • Regularly monitoring controls to ensure they remain effective and making adjustments as necessary.

  • Using feedback and performance data to continuously improve control processes.

Tests of Design and Tests of Effectiveness

Both tests of design and tests of effectiveness are crucial components of internal control evaluations. The test of design ensures that controls are properly constructed to address risks, while the test of effectiveness confirms that these controls are functioning as intended in real-world operations. Together, these tests help organizations maintain robust internal controls and achieve their operational and financial objectives.

Test of Design: According to the Institute of Internal Auditors (IIA), a test of design is an evaluation of whether controls are appropriately designed to achieve their intended objectives. This involves assessing the control's design to determine if it is capable of preventing or detecting and correcting material misstatements or operational failures. The test of design examines factors such as:

  • Control Objectives: Ensuring the control is aligned with the organization's objectives and regulatory requirements.

  • Control Activities: Reviewing the specific activities and processes that constitute the control.

  • Documentation and Evidence: Verifying that the control is well-documented and supported by sufficient evidence.

  • Implementation: Checking that the control is in place and operational as designed.

The goal of a test of design is to determine if the control, as designed, is capable of effectively mitigating the identified risks.

Test of Effectiveness: A test of effectiveness, as defined by the IIA, evaluates whether controls are operating as intended and are effective in achieving their objectives. This test involves examining the actual operation of the controls over a period to ensure they function consistently and reliably. The test of effectiveness includes:

  • Operational Testing: Observing and reviewing the control activities to ensure they are performed as designed.

  • Sampling: Selecting a sample of transactions or events to test the control's operation.

  • Error Rates: Assessing the frequency and significance of errors detected by the control.

  • Outcome Analysis: Evaluating the results of the control activities to ensure they meet the desired objectives and mitigate the identified risks.

The purpose of a test of effectiveness is to confirm that the controls are not only well-designed but also operate effectively in practice to achieve the intended risk mitigation.


DISCLAIMER and PURPOSE: This discussion document is intended for training, educational, and or research purposes only. The information contained herein is based on the data and perspectives available at the time of writing. It is subject to revision as new information and viewpoints emerge.

For more information see: https://www.mentorresearch.org/disclaimer-and-purpose

Key words: Supervisor education, Ethics, COVID Office Air Treatment, Mental Health, Psychotherapy, Counseling, Patient Reported Outcome Measures,