An oracle is a principle or a mechanism that helps us in recognizing if the software under test is working according to some criteria. A heuristic is a fallible way of solving a problem; it can also help us discover and explore. James Bach and Michael Bolton have provided us with a lot of helpful heuristics already. One of them is a consistency heuristic mnemonically called HICCUPPS. Michael wrote an article about his use of this particular heuristic here (pdf). The idea is that a product should be consistent with:- History (consistent with it’s past behavior)
- Image (consistent with the image the organization wants to project)
- Comparable Products (consistent with a similar product)
- Claims (product behaves the way some document or person says it should – e.g. in advertisements)
- User’s expectations (consistent with what user wants or expects from the product)
- Product (behavior should be consistent throughout the whole product)
- Purpose (consistent with its apparent purpose)
- Statutes (behaving in compliance with legal or regulatory requirements)
Although this is all about hardware, I was reminded of the ‘Claims’-part of this heuristic when I recently saw a video of a BBC reporter at the Consumer Electronics Show (CES) who broke the alledgedly unbreakable SONIM phone on his first attempt. Examples don’t come any clearer than this. Don’t go about telling that your product is unbreakable unless you’re 100% sure it is. Then again, how can you ever be 100% sure? When you put up a fish tank for everyone to use, expect the unexpected. That’s an open invitation for creative people to think ‘out of the tank’. I guess they’ll have to revise their marketing tagline. How about ‘Unbreakable by anything but edges of fish tanks’?.
* edited typo: ‘Statutes’ instead of ‘Statuses’
Test Side Story 
