root/misc/ep2006.txt

    =========
    HyperTest
    =========

        Guido Wesdorp
        EuroPython 2006
        guido@merlinux.de


















    Introduction
    ============

      * More JavaScript :|

      * EcmaUnit, HTTPUnit, AppTest

      * Python command-line runner
















    Existing solutions, and why they suck
    =====================================

      * Unit tests suites

      * Functional testing

      * No AJAX, no low-level JS testing

      * Haven't seen everything yet...














    EcmaUnit - Unit tests
    =====================

      * Origin: Kupu

      * Traditional unit test API, like Python's 'unittest'

      * May be replaced with more light-weight lib later

      * Also works in Spidermonkey














    function TestTestCase() {
        this.name = 'TestTestCase';

        this.setUp = function() {
            /* not in use here */
        };

        this.testAssert = function() {
            this.assert(true);
            this.assertThrows(this.assert, undefined, this, false);
        };
            
        this.testAssertEquals = function() {
            this.assertEquals('foo', 'foo');
            this.assertThrows(this.assertEquals, undefined, this, 
                                'foo', 'bar');
        };
    };

    TestTestCase.prototype = new TestCase;

    window.ecmaunit_test_registry.push(TestTestCase);


    HTTP (REST) tests
    =================

      * Uses XMLHttpRequest

      * Examine returned headers and body

      * Test with real clients

      * Can mostly be replaced with server-side tests,

      * but nice when all tests are JS












    function test_square_root(testcase, status, headers, body) {
        testcase.assertEquals(status, '200');
        testcase.assertEquals(headers['content-type'].substr(0, 10), 
                                'text/plain');
        testcase.assertEquals(string.strip(body), '4');
    };

    window.httpunit_test_registry.push([
        test_square_root, // test function
        'httptestdata/square_root.txt', // url to test
        'POST', // method
        {'Content-Type': 'application/x-www-form-urlencoded'}, // headers
        'int=16' // body
    ]);










    App (functional) tests
    ======================

      * Sequence of user actions

      * Low-level functional testing

      * Light-weight framework with some helper functions

      * More high-level APIs will be made available later














    function test_sync(at, browser) {
        /* simple test of a plain HTML document */
        at.assertEquals(browser.title, 
                                'Test document 1');
        at.assertEquals(
            string.strip(
                browser.document.getElementsByTagName(
                    'body'
                )[0].childNodes[0].nodeValue
            ),
            'Test document content'
        );
        // in the end we have to make sure we send the browser to the right
        // next location, either by clicking a button or by setting a new
        // location
        browser.navigateTo('test_async.html');
    };

    window.app_test_registry.push(['test_sync.html', test_sync]);





    AJAX - hard to test
    ===================

      * Outside of any main loops

      * Errors in event handlers can not be caught

      * No sleep() or tight loops

      * Polling or callbacks

      * No test suites that handle it












    Async app tests
    ===============

      * Return special value, continue outside of the test function

      * User has to navigate away *and* call callback when done

      * Errors are not caught, user has to do error handling

      * No other ways to solve it... but at least it's possible!














    var poll_and_continue = function(at, browser, callback, orgtext) {
        var newtext = browser.getText(
            browser.document.getElementById('container')
        );
        if (newtext == orgtext) {
            misclib.schedule(window, poll_and_continue, 100, at, 
                                browser, callback, orgtext);
            return;
        };
        at.assertEquals(string.strip(newtext), 'Text loaded');
        callback();
    };
    function test_async(at, browser, callback) {
        var orgtext = browser.getText(
            browser.document.getElementById('container')
        );
        poll_and_continue(at, browser, callback, orgtext);
        browser.getElementsByText('load')[0].click();
        
        return at.CONTINUE_ASYNC;
    };
    window.app_test_registry.push(['test_async.html', test_async]);


    Browsertest test runner
    =======================

      * Python script

      * boots web server and runs browsers

      * browsers POST results to web server

      * web server receives and processes results

      * integration into Python test libs (py.test)












    johnny@medusa:~/projects/hypertest/trunk/hypertest$ ./run_browsertest
    Going to test browser: epiphany
    TestEcmaUnitTestCase (testecmaunit.js, js test)
    TestTestCase - testAssert: OK
    TestTestCase - testAssertEquals: OK
    TestTestCase - testAssertNotEquals: OK
    TestTestCase - testAssertTrue: OK
    TestTestCase - testAssertFalse: OK
    TestTestCase - testAssertThrows: OK
    time spent: 8 msecs

    TestHTTPUnitTestCase (testhttpunittests.js, http test)
    TestHTTPUnitTestCase - test_square_root: OK
    time spent: 75 msecs

    TestAppTestTestCase (testapptests.js, app test)
    TestAppTestTestCase - apptestdata/test_sync.html: OK
    TestAppTestTestCase - apptestdata/test_async.html: OK
    time spent: 439 msecs

    johnny@medusa:~/projects/hypertest/trunk/hypertest$ 



    py.test integration
    ===================

      * Hopefully soon...

      * Unit test integration via spidermonkey

      * Full integration using browsertest
















    References
    ==========

      * http://hypertest.johnnydebris.net

      * http://johnnydebris.net:8080/svn

      * http://kupu.oscom.org

      * guido@merlinux.de