Testing & Software Blog

The occasional thoughts of a freelance software tester, drawn from experience across the software development life-cycle.

Assigning Priority to Bugs

A post about assigning priorities to bugs.

My current client uses an internal defect logging system rather than a proprietary tool. It doesn’t have separate “severity” and “priority” fields, instead we have two fields called “Priority” and “Internal Priority”. In practice testers no longer use the former at all, since all priorities bar the default are now reserved for issues raised by customers via the help desk. So testers use the latter as “our” priority to identify those bugs that need fixing urgently. It’s a numeric field which allows priorities from 1 to 999, although we don’t use anything like the full range.

Without getting into jargon-laden moon-language or buzzword-parody words like “Seriosity”, I’ve used the following two factors in assigning values to this when logging defects found during testing.

First take the importance of the feature in question, on a scale of one to three.

1 – Critical feature on the end-to-end life-cycle of the object under test
2 – Important but non-critical feature
3 – Minor or little-used feature

Note that I’m using “Feature” rather than “Function” here, and the definition of a feature is a level of granularity below the module it’s logged against. For example, a search module blowing up when you press “Go” would be a 1, but an advanced search criteria on the third tab not returning the correct rows might be a 2 or a 3.

Second, take the impact of the bug on the feature in question:

1 – Feature unusable with no workaround
2 – Workaround exists but significant inconvenience to the user
3 – More irritation than inconvenience

Then multiply the two figures together, and you get a figure from 1 to 9 (The numerically-literate among you will notice that you’ll never get 5,7 or 8), and assign that as the Internal Priority. So a critical feature that just doesn’t work at all will be Internal Priority 1, an inconvenience with a workaround on an important function will be 4, and so on.

It’s a bit quick-and-dirty. I know. But it works well enough, and is a little less subjective than “Think of a number between one and six”, and the product owner always has the option of raising or lowering it later.

What rules of thumb to you use for assigning priorities, severities, seriosities or whatever? Are testers even responsible for assigning priorities at the time of logging, or is the deferred to the product owner or a bug triage meeting?

Posted in Testing & Software | Tagged , | 6 Comments

Comment spam getting smarter?

If you run a blog, one of the maintenance chores is dealing with comment spam. They’re usually easy to recongise; either banal “This is a really informative post” or surreal bot-generated gibberish. This was a typical one from a few months back:

“What i do not realize is in reality how you’re no longer really much more well-preferred than you may be now. You are very intelligent. You understand therefore considerably when it comes to this topic, produced me personally consider it from numerous various angles. Its like women and men aren’t interested unless it��s something to accomplish with Lady gaga! Your personal stuffs great. Always take care of it up!”

This one, though, looked superficially convincing.

When I initially commented I clicked the “Notify me when new comments are added” checkbox and now each time a comment is added I get several e-mails with the same comment.
Is there any way you can remove me from that service?

Now I do have the subscribe-to-comments plugin installed, and it’s not inconceiveable that something might have gone wrong with it. But it smelled a bit fishy, not least because I didn’t recognise the name.

First clue (which ought to have been obvious from the fact that the comment was held in the moderation queue in the first place) was that nobody using that email address had ever left a comment on this site. The second clue was that it was left against a several months old post that had no comments.

Once I looked at the subscribe-to-comments database, there was no sign of that address. So I concluded it was spam, and shot it.

Hats off, by the way, to Askimet, which traps hundreds of spam comments a week, leaving just two or three in an average week that need to be moderated manually. No way could I have open comments on this blog without it; it’s an absolutely critical part of the WordPress ecosystem.

Posted in Testing & Software | Leave a comment

Great blog post from Mike TalksEverything I know about Testing I learned from Doctor Who..

Posted on by Tim Hall | Leave a comment

Good blog post by Trish Koo on how it’s not just sexist men who put obstacles in the way of women in technology.

Posted on by Tim Hall | Leave a comment

Bug Fixed

I’ve now fixed the bug on the Author page of this blog (Did any of you notice?), so it’s no longer giving a 404 error. It turned out that author names containing spaces didn’t work when the site was configured to use custom permalinks. After a bit of Googling, it turn out the fix is to update the table wp_users, changing the field user_nicename to get rid of the spaces (So it’s “Tim-Hall”, not “Tim Hall”).

For reasons best known to WordPress themselves, the user’s nicename isn’t editable though the WordPress control panel, so you have to update the database directly. I did it using phpMyAdmin which is available on my host.

Posted in Testing & Software | Tagged , | Leave a comment

When you get the “Windows help” phone scam, you are supposed to put the phone next to the subwoofer and turn the volume up to Eleven, aren’t you?

Posted on by Tim Hall | Leave a comment

Today’s test data has operatives “David Bryon”, “John Lawton”, “John Sloman”, “Pete Goalby” and “Bernie Shaw”. And they’re doing most of their work at Apocalypstick Avenue. Not sure what this says about me.

Posted on by Tim Hall | Leave a comment

All Your Song Are Belong To Us

If machine translation ever achieves perfection, it would  take all the fun out of things like this:

Lammi Bars and Hämeenkoski apply Cypriots kähinöissä was used, among other things, an ax and muovikuulapyssyä.
Häme police said Lammi and Hämeenkoski youth elvytteli Friday morning fight in the village back to life the old tradition.

First, pools of people were Hämeenkoski tough guy by a young man. The dispute was the subject of an online music service to use.

- Still do not have detailed information about the dispute reasons, but the use of Spotify, it had begun, Inspector Ilkka Iivari says.

In this situation, threatened, and one window was broken. Lammi Bars car ammuskeltiin muovikuulapyssyllä. After the episode kind of puddles left their villages of origin.

Häme Touch the kind of went after to explore the mystery of the broken window. Lammintausta supermarket in the center of the yard crews encountered again. Now threatened, such as an ax. Police release, the event was also a “catch up with other textiles.”

The situation ended with one hot young men tried to drive the car Hämeenkoski cover types on. From major injuries were avoided. Car hit a little to one young person, who left the hospital in order to check for dents.

According to police, the composition of the teams is not yet fully known. The main factors that are known to the police. The youngster age of about 18 years.

- It should be remembered that the villages of winning, the assizes disappears. Häme police recall in a statement.

Posted in Testing & Software | Leave a comment

Out of Context Bugs

Do you ever get sidetracked when you find a bug that’s outside the scope of the feature you’re currently testing? What do you do? Do you stop and raise a bug report there and then, or do you continue with your original testing and make a note of it for later?

I recently encountered such a bug while creating test data, and came to the conclusion it, while not a show-stopper, it was a little more than a minor annoyance and needed to be logged. It probably helped that I was able to isolate and repeat the bug while creating my test data, so didn’t end up chasing down rabbit holes in the process.

After logging the bug it turned out that another tester had noticed the problem much like I had, but hadn’t logged it at the time because of tight time constraints. I think that justified my logging it.

Posted in Testing & Software | Leave a comment

I’m experimenting with different menus for different sections of the site, which means hacking some of the PHP code. The idea is to make the different subjects (Music, Testing, etc) look more like a family of separate blogs rather than one single blog. Let me know what you think.

Posted on by Tim Hall | 3 Comments