Software Testing Certification

I will argue that there is a need for a new, Microsoft-sponsored software testing certification. The Wikipedia entry on software testing certification hits the nail on the head with regards to the weaknesses of all existing software testing certifications: "No certification currently offered actually requires the applicant to demonstrate the ability to test software. No certification is based on a widely accepted body of knowledge." Any certification can have one or more, possibly conflicting, goals. For example, the goal of a software testing certification may be to provide prospective employers with a measure of confidence that an engineer can actually perform software testing Or a goal may be to promote a specific set of technologies and/or products, such as Microsoft .NET and Visual Studio, or perhaps Test Driven Design. Or a goal may be to establish a community of software test engineers who share a common set of terminologies and practices with a view towards enhancing the rigor and effectiveness of the field of software testing in the very long run. Or a perfectly reasonable (but self-serving) goal for an organization is to create a software certification which is designed primarily to generate money for the granting organization by means of charging for required training courses, training materials, and exam fees.
There are a handful of companies who grant product-related certifications for their products. Examples include Rational/IMB, Mercury/HP, and Segue. Obviously these companies’ goal is to drive sales of their products. There are currently three main (and lots of smaller) non-product-related software certification granting organizations: the International Software Testing Quality Board (ISTQB), the International Institute for Software Testing (IIST), and "Software Certifications", formerly named the Quality Assurance Institute. The ISTQB (see has a pseudo-academic feel to it and is attempting to create a universally accepted body of knowledge. The ISTQB offers the "ISTQB Certified Tester" certification. This approach is laudable but fatally flawed. The ISTQB is almost entirely terminology based, which leads to a.) there is effectively a limited, discrete number of exam questions, b.) therefore the exam questions are readily available on the Internet, and c.) there is no direct correlation between holding this certification and the ability to actually perform software testing. One actual and typical ISTQB certification exam question is:
A deviation from the specified or expected behavior that is visible to end-users is called a(n):
a.) error
b.) fault
c.) failure
d.) defect
While vocabulary is important for clear communication, I argue that questions like this do not correlate with a person’s ability to perform good software testing. The IIST (see has a much more commercial feel than the ISTQB and clearly aims to make profit — they require you to take 10 days of their training which could cost upwards of $5000. The IIST offers the Certified Software Test Professional (CSTP) and Certified Test Manager (CTM) certifications. The problems with the IIST certifications are the same as the problems with the ISTQB certification: they are primarily vocabulary-based, the exam questions are easily available and memorized, and there’s no direct correlation between passing the certifications and testing ability.
"Software Certifications" (see is almost purely commercial and has a outdated feel. They offer a Certified Software Quality Analyst (CSQA) and a Certified Software Test Engineer (CSTE) certification. As with the ISTQB, the IIST, Software Certifications exams are primarily vocabulary based (including essay and short answer questions) and suffer the same flaws.
Anyway, my position is that Microsoft should sponsor a lightweight software testing certification or specialty. The primary goal of such a certification would be to provide at least a small measure of confidence that someone who holds the certification can actually perform certain types of software testing. A secondary goal would be to evangelize and promote Microsoft technologies, .NET in particular. From an economic standpoint, a certification that I am promoting would not necessarily make money for Microsoft directly, but it should be self-supporting at the very least, through the revenue generated by sales of curriculum and content materials to training partners and by certification exam revenue.
In part because the lines between software development and software testing are blurring, I suggest that the Microsoft software testing certification exam be roughly 80%-90% based on coding and design techniques and only 10%-20% based on vocabulary, and even those few vocabulary-related questions be carefully crafted so that they expose testing principles. For example, not, "Which of the following is the definition of ‘white box testing’?" (followed by possible definitions) but rather, "In a white box testing scenario which of the following statements is most often true?" (followed by something like, "Creating boundary condition test cases is easier than in a black box testing scenario." Besides correlating with actual software testing ability better than a vocabulary-based exam, a huge advantage of a coding/design based software testing certification exam is that you can create essentially an infinite number of exam questions which probe into a particular testing concept. The idea is to present a testing situation — system under test description, code, goal of the test, and so on, and then present code or design based alternatives as answers. Simply by changing the testing situation, you  create a new question which probes into the same knowledge concept, and stay ahead of the relentless posting of certification exam questions on the Internet. Based on surveys asking Test Managers what testing techniques they expect software testers to know, I have put together a preliminary course outline of 10 topics that can be covered in 3-4 hours each (perfect for a 4-day commercial course or a 1-semester college class), and which can be nicely tested in a 40-question multiple choice exam which takes 90 minutes, ideal for a Prometric (Microsoft’s certification exam delivery partner) certification scenario or college final exam.
This entry was posted in Software Test Automation. Bookmark the permalink.

2 Responses to Software Testing Certification

  1. Steven says:

    Hi Dr. McCaffrey   I totally agree with your opinion. The software test certification should be more technical and focus on codeing and design.

  2. Chris says:

    Hi,Would you be willing to share your course outline?

Comments are closed.