Uploaded image for project: 'FHIR Specification Feedback'
  1. FHIR Specification Feedback
  2. FHIR-27772

(Re)define assert execution to allow failed asserts to continue test processing

    XMLWordPrintableJSON

Details

    • Icon: Change Request Change Request
    • Resolution: Persuasive
    • Icon: Medium Medium
    • FHIR Core (FHIR)
    • R5
    • FHIR Infrastructure
    • TestScript
    • Testing FHIR
    • 7.2.1.6 Assert Execution
    • Hide

      Will add stopTestOnFail as proposed

      Show
      Will add stopTestOnFail as proposed
    • Richard Ettema/Rick Geimer: 12-0-0
    • Enhancement
    • Compatible, substantive
    • R5

    Description

      The current FHIR Testing - Assert Execution definition states:

       

      If the conditions of the assertion are not met, the test being executed fails and execution of the test is halted. Test execution will then continue with the next test.

       

      This limits the user to the first failed assert results for a given test. Asserts are independent of each other and only rely on the associated operation.

      https://chat.fhir.org/#narrow/stream/179166-implementers/topic/TestScript.20-.20assert.20processing

      The Zulip chat discussion proposed two possible approaches:

      Define a new TestScript.test.action.assert.stopTestOnFail boolean element.

       

      'true' - current behavior, stop test execution if this assert fails
      'false' - new default behavior, continue test execution regardless of this assert's result

      Or,

      Redefine the FHIR Testing - Assert Execution processing to allow all asserts to be evaluated.

      Feedback on pros and cons of either approach is welcome.

       

      Attachments

        Activity

          People

            richard.ettema Richard Ettema
            richard.ettema Richard Ettema
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: