Automated Pentaho report testing notes

Automated Pentaho report testing meeting notes

Date: 9 Dec 2010
attendees: AdamM, Udai, Jakub, and Jeff

Reference - “Report Generation file testing” mentioned on this page - http://mifosforge.jira.com/wiki/display/MIFOS/Pentaho+Report+Testing

proposal

  • create an automated test for one of the reports currently in progress (a spike) - PASSED

Need a story and some dev tasks - what is approach?

Data

  • need a single data set, or at least a static instance of data warehouse that is running

Two approaches

  • embedded BI server (voted down)
  • run against existing pentaho instance - we are going to follow this approach.
  • running BI, tests will hit the URL (using url-fetch or Selenium) and get output as HTTP content (html,text or csv) which should be validated
  • work in spike is to figure out how to the pass report name, parameters to BI server and how to compare expected to actual results.

How to schedule?

  • Do Spike on the framework and documenting the approach.
  • Adam M will spike an automated test for MIFOSBI-122.  Actual spike on automation framework is MIFOSBI-144.