CL Test Grid Reports Overview

Pivot Reports

Pivot reports allow us to summarize all the test results into 2-dimensional tables.

For illustration:

Depending on what fields we choose for rows and columns, we have 12 possible combinations (the links are clickable):

Quicklisp Test Diff

The Quicklisp Test Diff presents changes in test results between consecutive Quicklisp distro versions: regressions (new failures) and improvement (falures that were present in older Quicklisp version, but have gone in the newer version).

Test Runs Report

The Test Runs Report is a table where every test run is represented by a row. Columns include test run description (lisp implementation, quicklisp distro, user contact, etc.) + a column for every library test status (ok/fail) linked to the corresponding library test log.

CSV Export

The full database dump to a CSV file may be used to import the test results into Excel, Open Office Calc, Google Spreadsheet, or other data analisys software.

Lisp Data

All the above reports where generated from Common Lisp data contained in the db.lisp file. The format is a simple list which may be read by a single read call.

For convenience, use (test-grid:read-db) if you have the sources checked out, or this code otherwise:

  (with-open-file (in #P"db.lisp"
                      :direction :input 
                      :element-type 'character)
    (with-standard-io-syntax
      (let ((*read-eval* nil))
        (read in)))))))