Touchstone Functional Testing - Phase 1 - Test Plan

1.0 Document identifiers

1.1 Document Author

The document author is:

1.2 Document Revisions

1.3 References

The following documents were used as sources of information for this test plan:

•          Questcon Technologies, The Questcon Test Management Methodology; 01/07/2005; (Test Management Methodology Release 4.0.doc).

2.0 Introduction

2.1 Purpose

The objective of this test plan is to outline the test functional testing effort to be undertaken for the Touchstone project.  The Touchstone application is a rich-content internet application framework for the management of image and other digital media. It is part of a long-term content management strategy by MIT's Infrastructure Software Development and Architecture (ISDA) department.  It is made up of two parts: a web client and an Image Management Engine (IME) that forms a framework of distinct, reusable components.  The web client is built using Open Laszlo, which ports to Flash and to DHTML. As a result the user experience will feel more like a desktop application than a traditional web application

2.1.1 Project Description

MIT Touchstone is a new suite of technologies for authenticating a variety of web applications, being introduced by IS&T. MIT Touchstone does provide a single sign-on solution for applications that have been coded and configured to use the system. Within the context of Touchstone enabled applications, users will be able to seamlessly transition between systems without being prompted for additional authentication information.
The intended audience of this document includes all IT personnel involved in the development, testing, and support of Touchstone.

2.1.2 Project Technologies

MIT Touchstone utilizes/integrates with the following technologies:

• Stanford's WebAuth
• Internet 2's Shibboleth
• SAML (the Security Assertion Markup Language)
• A new account management system for some users outside of the traditional MIT community
• HTTP/S (extensive redirects)
• SSL
• MIT X.509 certificates
• Kerberos (via the HTTP/SPNEGO protocol)
• TLS
• OpenID
• Web Services
• MySQL (including replication)
• Apache
• Tomcat
• IDP High Availability Package
• LDAP
• KDC
• DNS load balancing 

2.2 Scope

2.2.1 Items To Be Tested

Each of the following UI components and front end functionality developed as part of the Touchstone project will be tested:

• Domains
• Libraries
• Collections
• Slideshows
• Items
• Search
• Sharing
• Login (for users who do not have certificates)
• Users
• Administration/Authorization/Registration
  • User Management (includes registration of new users)
  • Domain Management (includes editing metadata mapping)
  • Tag Management (manage categories and tags)
• Authorization (validate different users can only see/access things they are authorized to)

2.2.2 Items Not To Be Tested

The following modules and types of tests are considered to be outside the scope of this test effort and will not be tested by Questcon.  Testing will be performed by internal MIT personnel:

• All backend Touchstone APIs
  • Library
  • Libraries
  • Authz
  • Authzs
  • Bulk
  • Categories
  • Category
  • Item
  • Items
  • Map
  • Maps
  • User
  • Users
• Backend Authentication
• Repository
• Security testing
• Performance & scalability testing
• Recovery testing

2.3 Risks & Contingencies

The following risks have been identified, which may impact the testing effort.

3.0 Approach

3.1 Testing Strategy

The overall approach to this test effort will be to validate that the Touchstone UI meets the needs of the user community as a tool for managing images and other digital media.  Validation will be performed based on test cases derived from the documented use cases, front-end functional designs, as well as exploratory testing heuristics.
MIT has indicated that the user community is largely standardized on Mozilla's Firefox v2.0 web browser in a PC or Mac environment.  Rather than re-executing all tests with each browser, Questcon will execute approximately 80% of the test cases using Firefox and approximately 20% of the tests using IE 6 and 7 (both in a PC/Windows architecture).  There will be some overlap in testing and touch points, but not enough to significantly impact the schedule.
Questcon will analyze the test cases to identify the best candidates for execution using IE 6 and 7.  IE 6 and 7 test cases will be chosen based on the amount of functionality traversed in the application.  In other words Questcon will attempt to "touch" as much of the application as possible using IE 6 and 7. 
Furthermore, a significant portion of the user community utilizes the Mac OS X operating system with the Safari browser.  Some duplicate testing will be performed by Questcon utilizing Safari and Firefox for the Mac (10% or less).  MIT should designate a group of users to execute more tests using the Safari/Mac and Firefox/Mac combination of browser and operating system.  Questcon will assist the users in identifying the best tests to execute.
The following table outlines the various types of testing considered for this test effort, any additional comments about the testing, and the individual or group responsible for completing the testing.

3.2 Tools

The following tools will be used as part of the overall Touchstone testing effort:

3.3 Environmental Needs

Questcon anticipates the following server and client configurations for the QA environment:

3.3.1 Web Server Configuration

The QA environment web server may be accessed via:
Secure certificate servers
????
Non-certificate servers
????

3.3.2 Repository Server Configuration

3.3.3 Database Server Configuration

3.3.4 Client Configuration

...

...

...

...

...

...

...

4.0 Schedule of Deliverables and Resources

4.1 Deliverables

This section identifies the deliverables, delivery date and resource responsible for each deliverable.
Key Deliverables
Expected Delivery Date
Resource

4.2 Test Schedule

The planned test schedule of the Touchstone project has an anticipated start date of 04/25/2007 and completion date of 07/17/2007.  The estimated completion date is based on several assumptions, some of which have been identified in 2.3 Risks & Contingencies. 
Milestone
Target Timeframe
Summation of Activities

...