Theme: Regression Testing: Myths and Illusion’s
In this session we discussed what we think regression testing is based around these questions:
- What is Regression Testing?
- Is a Regression Test the same every time?
- Do you need to do a Regression Test for every functional change?
- Should Regression Testing be automated?
- Are bugs found when doing Regression testing Regression defects?
I asked Q1 and Q2 of the following people and these were their responses:
- Checking something has regressed or not
- Do a smoke test every time, random selection it’s up to you
- Checking you haven’t screwed up things you haven’t changed or don’t think you’ve changed
- Checks based on what’s gone before and built up depending on new functionality
Director of Production:
- Looking to measure any detrimental changes to existing functionality that doesn’t fall in to the direct scope of what has been changed
- Therefore the Regression test is similar ever time, broadly similar and might have a body of tests that you’d approach most times
- To test something which is related to the changes you’ve made
- That relationship should be driven by discussions and peoples experiences, check things that are related to what has changed
Fast forward the Audio to 3m 55s, unless you want to hear the setting up issues we had, most being caused by me :-D.
Although the discussion is mainly chatting there is a small transcript from the session as detailed below: With a Link to a pdf: *** Michael Bolton: Regression.pdf ***
[9/11/2014 2:58:24 PM] Stephen Blower: Rules:
I will be recording this session and publishing it, so if you object then I’d suggest two things, don’t talk and just listen or bail. Thanks.
This will officially last until 21:30 BST, anyone who wants to continue after that time can and I will pass control over to them.
As we are going to be talking on Skype we need to have some control.
Therefore this will be facilitated:
New Thread: ( envy ) without spaces
Continue Thread: : ) without spaces
I must Talk Now: ( devil ) without spaces - You will be aloud to talk immediately, but this is a one shot, once used you may not be able to use it again, depending on if the reason is valid.
[9/11/2014 3:30:07 PM] Michael Corum: @pmberry2007 on twitter
[9/11/2014 3:30:11 PM] Stephen Blower: yes
[9/11/2014 3:30:18 PM] Michael Bolton: @Michael Ta.
[9/11/2014 3:31:01 PM | Edited 3:31:11 PM] Srinivas Kadiyala: When we are talking on regression testing – do we need to perform the testing on every operating system / browser ?
[9/11/2014 3:31:57 PM] Srinivas Kadiyala: Clients / Managers would asks for regression testing on each browser.
[9/11/2014 3:32:03 PM] tobietrice86:
[9/11/2014 3:32:33 PM] Srinivas Kadiyala: Current updated browser – Whats the difference of doing the testing / regression testing?
[9/11/2014 3:32:40 PM] Michael Bolton:
[9/11/2014 3:33:26 PM] Michael Bolton: Beauty.
[9/11/2014 3:33:34 PM] Michael Bolton: I presume that’s Neil.
[9/11/2014 3:33:49 PM] Stephen Blower: Toby
[9/11/2014 3:34:23 PM] Michael Bolton: Oh, Tobie. Well, very nice. Neil, you’re still a good guy.
[9/11/2014 3:34:34 PM] emjaykay80: Lol
[9/11/2014 3:35:27 PM] emjaykay80:
[9/11/2014 3:39:23 PM] Stephen Blower: noun
the act of going back to a previous place or state; return or reversion.
Biology. reversion to an earlier or less advanced state or form or to a common or general type.
Psychoanalysis. the reversion to a chronologically earlier or less adapted pattern of behavior and feeling.
a subsidence of a disease or its manifestations:
a regression of symptoms.
of, pertaining to, or determined by regression analysis :
regression curve; regression equation.
[9/11/2014 3:39:35 PM] Michael Corum: (*)
[9/11/2014 3:39:35 PM] tobietrice86:
[9/11/2014 3:39:51 PM | Edited 3:39:59 PM] Srinivas Kadiyala: Got it..
[9/11/2014 3:40:17 PM] Stephen Blower: going to you Tobie New Question next
[9/11/2014 3:40:38 PM] Stephen Blower: Is it Tobie or Toby?
[9/11/2014 3:40:48 PM] tobietrice86: Toby
[9/11/2014 3:42:14 PM] Stephen Blower: cool thought so
[9/11/2014 3:43:52 PM] Stephen Blower: Backslidding term I like, as it seems to state what Regression actually is using a clearer term
[9/11/2014 3:52:19 PM | Edited 3:53:37 PM] Stephen Blower: -:)-
[9/11/2014 3:54:26 PM] tobietrice86:
[9/11/2014 3:54:43 PM] Michael Bolton: Off for a sec. Be right back.
[9/11/2014 3:56:37 PM] Michael Corum:
[9/11/2014 4:05:09 PM] Stephen Blower: Love your Test Bash picture Emma
[9/11/2014 4:05:40 PM] emjaykay80: Thanks Stephen
[9/11/2014 4:11:35 PM] tobietrice86:
[9/11/2014 4:16:20 PM] Michael Corum:
[9/11/2014 4:17:15 PM] Srinivas Kadiyala:
[9/11/2014 4:18:19 PM] Stephen Blower:
[9/11/2014 4:27:04 PM] Srinivas Kadiyala: What if the bugs are not found by Tester A – during testing ,
But if the Tester B finds it in regression testing ?
(“Where there was no change in code/Build”)
Do programmers will/needs to accepts it?
[9/11/2014 4:27:37 PM] Srinivas Kadiyala: To fix it..
[9/11/2014 4:28:14 PM] Srinivas Kadiyala: Yes – Bolton
[9/11/2014 4:29:28 PM] Srinivas Kadiyala: Product owner can be manager / Client / BA ?
[9/11/2014 4:30:07 PM] Michael Bolton: The product owner, by definition, is the person who has responsibility for making decisions about the product and the project.
[9/11/2014 4:30:46 PM] Michael Bolton: The product owner MIGHT also be a manager, a client, the BA, an executive, the CEO, or any number of things.
[9/11/2014 4:31:13 PM] tobietrice86: Hey everyone – I need to head off in a mo. Feel free to carry on talking. Been a great chat!
[9/11/2014 4:31:18 PM] Michael Bolton: The product owner in this question is the one who has authority over the question, “Should this bug be fixed, or not fixed?”
[9/11/2014 4:31:28 PM] Michael Corum: Good to “meeet” you Toby
[9/11/2014 4:31:54 PM] emjaykay80: I am sure we will meet again Toby
[9/11/2014 4:32:04 PM] tobietrice86: @TobyTheTester – grab me on there!
[9/11/2014 4:32:08 PM] tobietrice86: Ciao
[9/11/2014 4:32:36 PM] Srinivas Kadiyala: Sorry. Microphone is not working properly.
Couldn’t check before the call ..
[9/11/2014 4:33:10 PM] *** Michael Bolton sent Regression.pdf ***
[9/11/2014 4:35:12 PM] Stephen Blower: No worries Srinivas Kadiyala
[9/11/2014 4:38:01 PM] Srinivas Kadiyala: Thank you all.. Good night