How to write a SyncML test case

The SyncML package contains a testing script to replay prerecorded test sessions. This allows the developers to check if changes break things for one particular phone. So it would be great to have test cases for as many phones as possible.

Each test case should be for one database (like calendar or addressbook, but not both). The exception is for phones that handle tasks and calendar in one database like the P900 does. Here you should create test entries for tasks and calendar at the same time to see if it works properly.

Here's how to create a test case:

• Preparations in Horde:
  • create a user "syncmltest" with password "syncmltest" in horde. If the user's already there first delete and then recreate to get a fresh start.
    • create at least one test entry in the app you want to test (kronolith|nag|mnemo|turba). The entry should be named like "server..." (e.g. server1) and the description should contain an umlaut for charset testing. If you're creating a test case for the calendar, you should create at least two: one with an all day event and one with a normal (like 2hour) event.
  • Preparations in the Client (PDA/Outlook/whatever)
    • Create at least one testentry named "client...". The database must only contain this single entry (so you might need to do a backup of your phone first). Other than that the same information as for the test entries in horde above apply (umlauts, all day events).
  • Clean /tmp/sync: rm/tmp/sync/
  • Clean Horde SyncML Data. Login as user syncmltest and go to http:[yourinstall]/horde/services/portal/syncml.php. Use the button "Delete all SyncML Data" to delete all data for the syncmltest user.
  • Do a first sync run
  • In Horde: rename the "client..." entry to "client...s1" and create a new simple entry like "server_2"
  • In the client: rename "server..." to "server...c1" and create a new simple entry named "client_2"
  • Do second sync run
  • Do a third sync run. This should do nothing
  • In the client, delete server_2
  • in the server, delete client_2
  • do a fourth sync run
  • do a fifth sync run. This should do nothing.
  • The test itself is now finished. Create an archive of all the stuff in /tmp/sync and mail it to karsten --at-- horde.org to verify the testcase and addition to cvs.

For developers:

• If the phone uses wbxml this must be converted to xml first: for a in *.wbxml; do wbxml2xml -m 0 -o `basename $a .wbxml`.xml $a; done
  • all *.xml go into a directory under framework/syncml/tests with name testcase_[descriptionoftestcase]
  • in framework/syncml/tests do a ./testsync.php --dir=testcase_[descriptionoftestcase] to run the test.