Software Test Optimization

 REVIEW:  How many developers does it take to test a product? September 28, 2020  by  Wayne Rash OVERVIEW: A collection of feedback from specific and named software organizations on how they form their development teams. Summary Quotes: " While in most cases, for every two to five developers, one tester would be fine..." "many variables come into play, ranging from  the availability of automation tools in testing  to the income reliability of the project, to how much of the testing can be automated" Software Criticality factor - "mission critical applications, including automotive, heavy truck, and mining equipment product development. A single failure could lead to death or disaster." Further thoughts from the reviewer:  We need a way to rate the efficiency and skills of test team.  AKA some warm bodies can reduce the efficiency of a test team.  We need consistency on how we generate test cases and determine coverage.  We need software ...

 REVIEW:  Konica Minolta settles lawsuit alleging flaws in EHR software for $500,000  by  ELISE REUTER  of MedCityNews "The whistleblower case alleged that an electronic health records company acquired by Konica Minolta cheated on certification tests to hide software issues." Summary: -" In 2015, Konica Minolta acquired Viztek , a North Carolina-based health IT company." -"Viztek allegedly hard-coded its software to pass certification requirements" (a.k.a. doing the Volkswagen) -Not a lot more details here, but another example of the length of deceit people and companies will go to hide defects rather than fix them.

Let's start the conversation with these questions: How would you describe your software test methodology? Agile, structured, ad hoc, custom, or other. Approximately what percentage of your software tests are automated? What are your software test automation tools? Which software test environments are all used? embedded, desktop, web, apps, IOT, other. What test levels are all formally documented in your software test scope: unit/module, build, functional, system (structure rather than test type) Do you have a formal test strategy or process document guiding your test planning? What are your priorities and goals for test improvements? (such as maintainability, new function efficiency, or defect reduction) After baselining your current test state, the next step is digging into a deeper review of a recent test project's test documentation and assets.  Contact KLOMAR to take the next step!

COVID-19 is clearly the most important test of the day and containing it is everyone's top priority.  Ok testers, in a language you can understand: IF ((you have had exposure to a COVID-19 positive person) OR (you have a temperature) OR (you have lower respiratory congestion)) THEN {       You should be tested for COVID-19       While awaiting a Negative Test        {                 Quarantine        } } Continue smartly! And in an abbreviated data-driven format: Exposure     Temp    LowRespCongest    Test/Quarantine Y                    *                  *                            Y *                    ...

Vulnerability Alerts   Last updated:  March 6, 2020 I highly recommend this article which uses the    National Vulnerability Database . Some great data presented on vulnerabilities, products, and historical trends.

Testers can have some interesting "hobbies".  Many careers enjoy spotting their unique products in the wild, aka everyday life.  Can you spot any application or web sites test data in the wild? 13March2020: original report still exists in the wild and daily email blast added another : TEST TEST TEST jobs in CONE ESTATES 10March2020: Test 111111111 CW Hospitality LLC   Tampa, FL, USA Employment Type Full-Time Test  111111111111111111111111111111111111111111111111111111 Report Job or Report your Finds!!!

AP Boeing blames incomplete testing for astronaut capsule woes By MARCIA DUNN AP Aerospace Writer ARTICLE REVIEW by Software Test Optimization blog writers:  As many sources reported, and Boeing has confirmed, Boeing did not sufficiently test end-to-end functionality of the Starliner capsule.  There should be no doubt in the risk associated with this software, and the need for structured engineering processes.  This is a process failure as reported, management did not plan for or require system functional testing.

What should you have in place prior to your next software project? 1. Test Strategy (process, gates, objectives, metrics) by Test Process Owner 2. Test Plans for each Project (who, what outline, when, where, how, needs) by Test Project Owners 3. Defect/Escapes Process (tracking and feedback of defects/escapes) 

If you are at a loss for how to improve your test process, start by rating the severity and impact of defects that escape your development and test process.  Group these escapes by product/system function, test issues (no test or scenario, the test was not run, missing data, defect found but scope/severity wrong, ...), and development/root cause issues so that you can then prioritize changes to attack.  Enjoy!

https://www.thespacereview.com/article/3881/1  (see the entire article for context) Starliner software setback by Jeff Foust Monday, February 10, 2020 "... Process escapes At its Thursday meeting, ASAP said it was concerned the two software errors were symptoms of a more fundamental problem. “The panel has a larger concern with the rigor of Boeing’s verification processes,” Hill said. ASAP called for reviews of Boeing’s software development and testing processes. “Further,” he added, “with confidence at risk for a spacecraft that is intended to carry humans in space, the panel recommends an even broader Boeing assessment of, and corrective actions in, Boeing’s SE&I [systems engineering and integration] processes and verification testing.” ..."

In 2020, I don't think there should be much opposition to the view that we need to improve the quality of software development and testing.  Recent events at Boeing and the Iowa Caucus  are examples of software issues in the news (impacting all levels of software from embedded to apps and web development).  Software Test Optimization blog will share information on improving software development and testing in the news and will propose methods for improving software quality through development and test optimization.  Welcome!