Getting Started on Litmus

Setting Up for the Test Run

1. Once you have a Litmus account, ensure you are logged in at http://litmus.songbirdnest.com/.
2. Click on the "run tests" link under "get testing!"
   
3. In "active test runs - recommended", select a "community testing" test run.
   
4. Select the platform/operating system that on which you will run the set of pre-selected tests.  Click to Submit configuration.
5. Select the testing group and subgroup of set of tests you would like to run.  Click Submit.

You are now ready to run a set of tests.

Executing the Test Run

• Tests can be executed and submitted in individually, or as a group.  It is suggested that you select "show all" in upper right to easily run (and eventually submit) all testcases in one window.  If you want to open the tests to run individually, you need to click on the testcase title (Not the "view" link to right; this opens the testcase to review results of every test result executed against the testcase).
• As you execute each test, set Result as follows:
• Not Run - you did not excute yet
• Pass - test passed with Expected Results
• Fail - always indicate the Bugzilla bug number in the "Associated bug #'s" field
• Test unclear/broken - add info into "Notes/Comments" as to the reason this Result was selected (NOTE: Songbird QA will monitor these and follow up.)
  

Submitting the Test Run

• At anytime during the test run, you can click on "Submit All Results" at the bottom of the page.  You may choose to do this for tests completed thus far, and come back to same test run later to complete.
  
• You can choose to:
• "Continue testing this Test Run under the same configuration"
  
• Go back and continue testing of current run.  You will notice that when you Submit back into the test run, all tests which had previously been moved off of "Not Run" are Green and complete.  No need to rerun those against the current test build and OS.
• All grey testcases still need to be executed.  Again, suggest you click on "show all"  to easily continue your test run.
• "Continue testing this Test Run, but change my configuration"
• If you have a second OS available and can do the same test run on that second OS, go for it! by selecting a new OS.
• NOTE: At anytime, you can go back to the test run in progress by doing the "Setting up for the Test Run" as outlined above.