Meeting Notes

Kickoff Meeting 5/20/2011

Attendees: Michael Berger, Sean Velury, Dave Tanner, Ed Orsini, Felicia Leung, Don Flanders, Lisa Robinson, Alex Kozlov

I discussed the origins and scope of this project. Lisa and Alex were both interested in how this testing tool might aid the Web Browser release process for future browsers. They were looking for tests to run both in currently supported browser/operating systems, future browsers (IE9 FF4) and browsers that we may not support but customers call the help desk about (Chrome?).

Sean and Alex suggested the we limit our discovery process to the most important browser/operating system combinations.

The following people agreed to check which of the testing applications at this link (http://www.softwareqatest.com/qatweb1.html#FUNC) might be worth including in this discovery project:

• Ed will look at applications 1 through 20;
• Felicia will look at applications 21 through 40;
• Mike will look at applications 41 through 60;
• Dave will look at applications 61 through 79. Dave left this project because his has a new job in Student Systems. So no one looked at 61 through 79.

Alex agreed to look at Gartner Research to see if it has recommendations for Web Testing applications.

Sean agreed to look into various QA magazines and web sites he knows to see if he can identify the Top 10-20 Web Testing applications.

We agreed that we would test QTP 11 as part of this discovery project, since we already own and know QTP 10.

We agreed that we would use the Java web application APR-Hires as our test subject. And we have finalized a test plan for apr-hires.

I will set a meeting time of every two weeks after I talk to our missing members (Judith McJohn and Stephen Turner).

We will do email check-ins on the Friday between meetings.

We discussed some of the measures we want to evaluate each application against, which included:

• Support for all current IST browser/operating system combinations;
• Ease of use
• Documentation
• A healthy future for the application based on its community/company support.

Second Meeting 6/3/2011

Attendees: Michael Berger, Ed Orsini, Felicia Leung, Don Flanders, Alex Kozlov, Judith McJohn

We discussed the functional testing applications we had discovered so far and narrowed them down to QTP, Selenium, others. We discussed whether we should look at testing applications that emulate a browser, and we are leaning against that. Next steps: Michael Berger will narrow down our list of applications further.

We discussed the current criteria for evaluating these testing applications and added more criteria. Everyone is expected to add to this section as homework.

Third Meeting 6/17/2011

Attendees: Michael Berger, Don Flanders, Judith McJohn, Sean Velury, Lisa Robinson

We went over 13 different functional testing tools and sifted them down to the final five we will be testing. We also assigned each person to test at least one of the applications.

The criteria we used to winnow down our test list included:

1. Support for all MIT operating systems
2. Support for all MIT browsers
3. Ability to playback tests in a browser (instead of testing via browser emulation)
4. Ability to record tests (to make test creation easier)
5. Some sort of gui (versus code only framework)
6. Decent documentation
7. Some sort of name in the industry

Applications we will test:

Fourth Meeting, 7/5/2011

Attendees:

Fifth Meeting 7/29/2011

Attendees: Judith McJohn, Felicia Leung, Michael Berger

Most people have been too busy to test, so we are behind. Sean Velury has tested Eggplant and found that it does not meet our requirements, so we need to come up with a different tool for he and Alex to test.

Sixth Meeting 8/12/2011

Attendees: Michael Berger,