Tag Archives: testing

First Software Solutions Conference, Arlington, Va., Nov. 16-18, 2015

Software: Catalyst of Change

With the increasing reliance on and penetration of software into everyday lives, the need for organizations to predictably develop, acquire, and sustain high-quality software systems has never been greater. To address this need, the Carnegie Mellon University Software Engineering Institute (SEI) is pleased to announce that it will host its first Software Solutions Conference (SSC) at the Hilton Crystal City in Arlington, Va., from Nov. 16 through 18.

Review the conference program here.
Continue reading


SEI Presentations on DevOps and Testing in Chicago, September 18

Stephany Bellomo of the SEI will be speaking at the Unicom DevOps Chicago Summit on September 18, 2014 on “Design Implications of DevOps.” Here is an abstract of Stephany’s talk:

Continue reading

SATURN 2014 Call for Submissions

SATURN 2014 marks the 10th Software Engineering Institute (SEI) Architecture Technology User Network (SATURN) conference—the largest conference dedicated to software architecture in North America. Since 2003, an international audience of practicing software architects, industry thought leaders, developers, technical managers, and researchers have gathered at SATURN to share ideas, insights, and experiences about effective architecture-centric practices for developing and maintaining software-intensive systems.

SATURN 2014 will take place in Portland, Oregon from May 5—May 9, 2014.

Continue reading

SATURN 2013 Architectural Evaluation Session (notes)

Notes by Brendan Foote

All Architecture Evaluation Is Not the Same: Lessons Learned from More Than 50 Architecture Evaluations in Industry
Matthias Naab, Jens Knodel, and Thorsten Keuler, Fraunhofer IESE

Matthias has evaluated many systems’ architecture, ranging from tens of thousands of lines of code to tens of millions, and primarily in Java, C++ and C#. From this he distills out commonalities in the various stages of the evaluations. To start with, the initiator of the evaluation was either the development company or an outside company, such as a current customer or a potential one. The questions being asked also varied—whether wondering if the architecture is adequate for one’s solutions, what the impact would be of changing the system’s paradigm, or how big a difference there was between a system and the reference architecture.

Continue reading

Press Release: ACM Distinguished Paper to be Awarded for Best Contribution of QoSA 2013 Conference

QoSA is the premier forum for the presentation of new results in the area of software architecture quality. It brings together researchers, practitioners and students who are concerned with software architecture quality in a holistic way. As a working conference QoSA has a strong practical bias, encompassing research papers, industrial reports and invited talks from renowned speakers.

The best contribution of the conference will receive the ACM SIGSOFT Distinguished Paper Award.   To learn more, see the full press release about QoSA and the award.

SATURN 2013, Minneapolis MN April 29-May 3: Call for Submissions

In 2013, the Software Engineering Institute (SEI) Architecture Technology User Network (SATURN) software architecture onference will celebrate its 9th year. Each year SATURN attracts an international audience of practicing software architects, industry thought leaders, developers, technical managers, and researchers to share ideas, insights, and experience about effective architecture-centric practices for developing and maintaining software-intensive systems.

Continue reading

SATURN 2012 Keynote: Michael Stal, Win-Win With Agile Architecture

Win-Win with Agile Architecture
Michael Stal, Siemens Corporate Research

This keynote covered software architecture and how it can be combined with Agile in systematic way; perspectives on agility and architecture.

“Experts solve problems, geniuses avoid them” (Einstein). Architects should be geniuses.

Architecture and design are two sides of the coin. If you knew everything in advance, you could design the best architecture. Waterfall would be a perfect fit.  But the real world is not perfect.

The other side of the coin is represented by the Agile Manifesto. In software architecture, embracing change is important. However, change should be planned.

Continue reading

Improving Testing Outcomes Through Software Architecture – Paul Clements

Testing plays a critical role in the development of software-reliant systems. Even with the most diligent efforts of requirements engineers, designers, and programmers, faults inevitably occur. These faults are most commonly discovered and removed by testing the system and comparing what it does to what it is supposed to do. This blog post at the SEI Blog by Paul Clements summarizes a method that improves testing outcomes (including efficacy and cost) in a software-reliant system by using an architectural design approach that describes a coherent set of architectural decisions taken by architects to help meet the behavioral and quality attribute requirements of systems being developed.

See also these additional posts by Paul here on the SATURN blog about architecture support for testing.

Model Problems in Architecture Support for Testing: The Votes Are In

Recently in this space I’ve described the SEI’s recent research in architecture support for testing (AST), with which we are striving to understand how architecture can be used to lead to better testing outcomes. I also described a testing practitioner’s workshop we held at the SEI in February, which resulted in a set of 29 model problems in AST. These are problems that, if solved, would make a substantial difference in the testing of software. I invited readers of this blog to add their votes to those of our workshop participants to produce a ranking of the model problems in terms of importance, using the following scale:

  • VH (Very High) = 5 (meaning that the respondent places a very high value on this capability)
  • H (High) = 4
  • M (Medium) = 3
  • L (Low) = 2
  • VL (Very Low) = 1 (meaning that this is a capability that is not at all valuable to the respondent)

As promised, here are the results.

Continue reading

Free SEI Webinar 4/28: Assurance Cases for Medical Devices

On Thursday, April 28 from 1:30 to 2:30 Eastern time, Chuck Weinstock of the SEI will present a free SEI webinar, titled “Assurance Cases for Medical Devices.”


About the Webinar

Recently the U.S. Food and Drug Administration (FDA) issued guidance to infusion-pump manufacturers recommending the use of an assurance case to justify claims of safety. An assurance case is somewhat similar in form and content to a legal case. It specifies a claim regarding a property of interest, evidence that supports that claim, and a detailed argument explaining how the evidence supports the claim. Assurance cases have been used in Europe for more than 15 years to argue safety cases for military, avionics, railway, and nuclear systems. The FDA is the first U.S. organization to officially encourage their use in assessing safety-critical systems.

Continue reading