Skip to content

core: functional testing strategy #106

Closed

Description

@beriberikix

Document the design and execution plan for functional testing.

Activity

  1. added this to the milestone on Jul 29, 2014
  2. dhermes commented on Sep 23, 2014

    @dhermes
    Contributor

    @tseaver This is the bug you were referring to for me to claim and do the regression test work in?

  3. tseaver commented on Sep 23, 2014

    @tseaver
    Contributor

    @dhermes Maybe. This one makes it a goal to document how we do functional tests (but maybe not to actually write any?).

    There is some jargon skew between "functional" / "regression" / "integration" testing. For instance, I consider that adding a unit test which fails before fixing a bug could be called "regression" testing, as it ensures that the fix is not accidentally undone later. From conversations with @silvolu, I believe he uses "regression test" to refer to tests which actually exercise the server API, versus the unit tests which stub / mock it.

    I contemplated writing a sample app which would serve both as the basis for narrative docs and as a possible set of regression tests (see my preliminary sketch).

  4. silvolu commented on Sep 24, 2014

    @silvolu
    Contributor

    @tseaver I should probably say "regression testing done with functional tests" :)
    What I mean is to ensure that changes tested only against mocks have not introduced new faults in the core set of functionalities by testing them against the real API.
    @dhermes this issue is mostly a placeholder, you (or I) can open a new one if you want.

  5. dhermes commented on Sep 25, 2014

    @dhermes
    Contributor

    Yeah I think this issue is just fine. As mentioned I'm tracking this in a dirty branch but hope to get real reviewable code soon.

  6. dhermes commented on Oct 22, 2014

    @dhermes
    Contributor

    #281 also chipping away at this

  7. dhermes commented on Nov 6, 2014

    @dhermes
    Contributor

    @silvolu As of #319 landing I am calling this "done".

    Re-open if you feel it's necessary.

  8. added a commit that references this issue on Nov 10, 2016
  9. added a commit that references this issue on Jan 17, 2020
  10. 98 remaining items

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

🚨This issue needs some love.testingtriage meI really want to be triaged.

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions