<< Chapter < Page
  Software engineering     Page 15 / 15
Chapter >> Page >

Evaluation of test phase reports can be combined with root-cause analysis to evaluate test process effectiveness in finding faults as early as possible. Such an evaluation could be associated with the analysis of risks. Moreover, the resources that are worth spending on testing should be commensurate with the use/criticality of the application: different techniques have different costs and yield different levels of confidence in product reliability.

Termination

A decision must be made as to how much testing is enough and when a test stage can be terminated. Thoroughness measures, such as achieved code coverage or functional completeness, as well as estimates of fault density or of operational reliability, provide useful support, but are not sufficient in themselves. The decision also involves considerations about the costs and risks incurred by the potential for remaining failures, as opposed to the costs implied by continuing to test.

Test reuse and test patterns

To carry out testing or maintenance in an organized and cost-effective way, the means used to test each part of the software should be reused systematically. This repository of test materials must be under the control of software configuration management, so that changes to software requirements or design can be reflected in changes to the scope of the tests conducted.

The test solutions adopted for testing some application types under certain circumstances, with the motivations behind the decisions taken, form a test pattern which can itself be documented for later reuse in similar projects.

Test activities

Under this topic, a brief overview of test activities is given; as often implied by the following description, successful management of test activities strongly depends on the Software Configuration Management process.

Planning

Like any other aspect of project management, testing activities must be planned. Key aspects of test planning include coordination of personnel, management of available test facilities and equipment (which may include magnetic media, test plans and procedures), and planning for possible undesirable outcomes. If more than one baseline of the software is being maintained, then a major planning consideration is the time and effort needed to ensure that the test environment is set to the proper configuration.

Test-case generation

Generation of test cases is based on the level of testing to be performed and the particular testing techniques. Test cases should be under the control of software configuration management and include the expected results for each test.

Test environment development

The environment used for testing should be compatible with the software engineering tools. It should facilitate development and control of test cases, as well as logging and recovery of expected results, scripts, and other testing materials.

Execution

Execution of tests should embody a basic principle of scientific experimentation: everything done during testing should be performed and documented clearly enough that another person could replicate the results. Hence, testing should be performed in accordance with documented procedures using a clearly defined version of the software under test.

Test results evaluation

The results of testing must be evaluated to determine whether or not the test has been successful. In most cases, “successful” means that the software performed as expected and did not have any major unexpected outcomes. Not all unexpected outcomes are necessarily faults, however, but could be judged to be simply noise. Before a failure can be removed, an analysis and debugging effort is needed to isolate, identify, and describe it. When test results are particularly important, a formal review board may be convened to evaluate them.

Problem reporting/test log

Testing activities can be entered into a test log to identify when a test was conducted, who performed the test, what software configuration was the basis for testing, and other relevant identification information. Unexpected or incorrect test results can be recorded in a problem-reporting system, the data of which form the basis for later debugging and for fixing the problems that were observed as failures during testing. Also, anomalies not classified as faults could be documented in case they later turn out to be more serious than first thought. Test reports are also an input to the change management request process.

Defect tracking

Failures observed during testing are most often due to faults or defects in the software. Such defects can be analyzed to determine when they were introduced into the software, what kind of error caused them to be created (poorly defined requirements, incorrect variable declaration, memory leak, programming syntax error, for example), and when they could have been first observed in the software. Defect-tracking information is used to determine what aspects of software engineering need improvement and how effective previous analyses and testing have been.

References:

http://en.wikipedia.org/wiki/Software_testing, http://ocw.mit.edu/OcwWeb/Electrical-Engineering-and-Computer-Science/6-171Fall2003/CourseHome/,http://www.cs.cornell.edu/courses/cs501/2008sp/, http://www.comp.lancs.ac.uk/computing/resources/IanS/SE7/,http://www.ee.unb.ca/kengleha/courses/CMPE3213/IntroToSoftwareEng.htm, http://www.cs.kuleuven.ac.be/~dirk/ada-belgium/aia/contents.html#5,http://www.softwareqatest.com/qatfaq1.html, etc...

Questions & Answers

the reason for learning this course?
Gabriel Reply
what is soo muchh tough to understand in so software engineering?
Syed
components of software engineering
khan Reply
what is coding
YUSUF Reply
Coding is a type of a language that a computer understand..
HANAN
it's how a computer interprets software, programs and what to do when it reads the code. Code is like our sub-conscious but to a computer if that makes sense.
Dustin
hello, I don't know anything about software but I have this passion to learn. where do I start from pls
Oliver Reply
computer science class or just take a introduction to computers class. You can always try to find a mentor or self teach yourself as well.
Dustin
What is coding
diwakar
what important of software
Tom Reply
dorimon in hindi
Yogesh
Hello
Mark
Mrs dorimon
Mark
hello
Tom
ha
Khizer
I'm. new in programming
Khizer
did anyone help
Khizer
me
Khizer
ok on me am new in programming
Tom
can I have job sa programmer without degree
Khizer
hello guy's
Shey
what can helps new in programming
Tom
I want to know more about programming
Shey
hello
Francis
hello
Xotambek
hi
Peterson
how r u my friends ?
Xotambek
l would like to know what do I need if I want to.create a sun glasses where you can see everything when you're sharing something via bluetooth
Peterson
hi
Peterson
I have so many things that I want to create in the technology industry
Peterson
but I need a group of people who are willing bring ideas on the table and work together to make success
Peterson
wow
Shey
What sorts of feild knowledge do you need?
leo
Mr. Peteson pinchinat, hello!
leo
I don't really know what do I need to learn that's why I'm asking
Peterson
I need help to create all those things that I want to.
Peterson
peterson pinchinat I have so many ideas and much more things in my mind
Khizer
hello
Purity
even Me guys
Mark
if you have many ideas than I have so let's work together let's build a team . let's put our ideas and start working together to make success.
Peterson
I really like to work with software
Khizer
any I like that people how have interest on new technology and software developer, engineering
Khizer
wow!!! we have something in common.
Peterson
great then we can share some ideas and then see how we can make things happen
Peterson
so where we can do work
Khizer
we have to find a way. I'm living in Brooklyn what about you?
Peterson
there we shared work
Khizer
I know people from India they are really good in compute
Peterson
thanks
Khizer
first we need to find out how we gonna work. I know the distance won't be a problem we need to trust each other and create a great team then bring revolution in the technology
Peterson
I have an idea
Khizer
ok
Peterson
send me the website?
Peterson
wait for a 2 days I make that and tell you ok
Khizer
perfect
Peterson
good
Shey
Yes ,It is possible to be a programmer without University Degree.You have a lot professional courses that you access and register for on the net.Please get hook and search ..thanks
NICCK-PAT
Great ,I am NICCk-PAT in Paris France.
NICCK-PAT
hello
Dustin
how do i create software
Ahmad Reply
Hii
Sameer
what is the IEEE ?
Shankar Reply
a external device cable capable of transferring large amounts of data at high speed.
Dustin
really
Shey
How to learn in this app? ..help me
HANAN Reply
how make a software engineer
Ajaykumar Reply
how to use this app ..help me
HANAN
what is incremental model?
Shir Reply
explain software proses explain with kannada
preethi Reply
please and my qution
preethi
best project for bsc students
Mounika Reply
software engineering best project for bsc students
Mounika
Tell me medam what is the project do you have
Harinathreddy
software engineering
Mounika
Let you explain for me about that project
Harinathreddy
hii
Sameer
I'm in!!
Amanson
hii
Yogesh
can i ask you some questions
Yogesh
hi how are you
Ahmad
guy's please I need you to tell me more about software Engineering
Shey
am new in the field
Shey
what it the best app that can be use to code a software
Claude
no app
dawit
then how do they do it
Claude
differentiate between writing and jotting
Mmem Reply
configration management
Ravi Reply
what is a computer software
Chinaza Reply
Computer software is programming code executed on a computer processor at either the machine-level or the level of the operating system. ... The physical components of a computer are the hardware, and the digital programs running on the hardware are the software.
SATYAM
9292
Saeed

Get the best Software engineering course in your pocket!





Source:  OpenStax, Software engineering. OpenStax CNX. Jul 29, 2009 Download for free at http://cnx.org/content/col10790/1.1
Google Play and the Google Play logo are trademarks of Google Inc.

Notification Switch

Would you like to follow the 'Software engineering' conversation and receive update notifications?

Ask