What the heck happened to Focus and Non-Focus projects in SCAMPI v1.3?

Jeff, I’m a CMMI Appraiser in New Jersey, a relatively new CMMI Appraiser, actually, so I appreciate the information you have been sharing in this blog about the meaning behind the changes to the SCAMPI model.  I would like to add a question.  When they simplified the terminology by removing the terms ‘focus project’ and ‘non-focus project’ in V1.3, what impact does that have on CMMI Appraisers like me?  ~Plato B.

Wow!  Two questions in a row from fellow Lead Appraisers.  Sure, I'd be happy to answer this one.  The impact of this particular terminology change is significant, and affects all CMMI Appraisers, from new to experienced.  Before explaining how, let’s take a moment to define the terms "focus project" and "non-focus project."

As you know, for each maturity level of the CMMI, there are process areas associated with that level.  To assess these process areas, projects were selected to be focused upon (‘focus projects’).   ‘Non-focus projects,’ or extra projects, were also selected as a way to get extra information to help gather more data and to verify the institutionalization of the process.

For example, let’s say a company had 100 projects.  A subset of 25 projects might have been selected to be appraised: twenty focus projects and five non-focus projects.  Because focus projects had to satisfy 100% of the applicable goals in the CMMI model for that level, and because they had to show evidence for all of the associated practices, we would do a deep dive on all 20 focus projects.

Non-focus projects didn’t require a deep dive that included all of the process areas.  With the five non-focus projects, we would pick and choose what process areas we wanted to look at.  In one, we might have looked at how good they were at planning and estimating.  In another, we might have looked at how strong they were at Verification.  Basically we were selecting process areas throughout the organization, and were looking for examples to verify that, yes, in all of these other projects, the projects were consistently meeting the intent of CMMI.

So what changed when the SEI removed the terms from this version of the SCAMPI method?

The simple answer is the sampling methodology changed.  The sampling strategy is beyond the scope of this post (I have blogged about this subject recently), but the big difference regarding focus and non-focus projects is that they no longer exist, and instead we are now required to create a data collection plan based on an algorithm provided by the SEI.  The plan will take an “inside out” view, requiring us to identify the source of evidence for various process areas by identifying which project we are going to look at for that particular piece of data. It’s more complex than that, but you get the picture.  

The new sampling methodology creates an additional planning effort, making preparation for the appraisal more difficult.   It will also be more difficult for companies to cherry-pick the projects that are going to be appraised, broadening the selection of available projects and increasing the credibility of the appraisal and of the CMMI in general.  All good stuff!

We understand why the SEI did this – in fact, we strongly support it.  The new sampling methodology makes appraisals more consistent and helps deter companies who are interested in gaming the system.  But let’s not kid ourselves about the impact of the change.  By simplifying the terminology, the SEI has radically modified the sampling strategy.  The preparation for the appraisal will require more effort and experience, which will increase the amount of time and effort it takes to conduct an appraisal.

Welcome to the ever-changing life of a CMMI Appraiser, Plato.  No one said the path would be easy!

Jeff Dalton is a Certified SCAMPI Lead Appraiser, Certified CMMI Instructor, Candidate SCAMPI Appraiser Observer, author, and consultant with years of real-world experience with the CMMI in all types of organizations.  Jeff has taught thousands of students and has received an aggregate satisfaction score of 4.97 out of 5 from his students.

Learn more about CMMI Appraisers at www.broadswordsolutions.com

What is a "Pre-Appraisal" and what are the rules?

Hey Appraiser!

Can you tell me something about the ‘pre appraisal’ requirements and restrictions?

I want to know the following specifically

• What is the minimum required number of days that the appraiser himself needs to spend with the client company during the preappraisal

• How are man-days different than normal working days when talking about the pre appraisal duration?
• Does bringing more people from the appraiser for the pre appraisal work if the preappraisal days are reduced
•  How many days a client can ask for from the appraiser , for the pre appraisal?

You say "Pre Appraisal" and I say "SCAMPI C!"  Sounds like a song.

There is no formal event in the CMMI world known as a "pre-appraisal" but that term is often used to describe a "gap analysis" or a "SCAMPI C" so I'll assume that's what you're referring to.

To answer your questions specifically:

- There is no minimum required days that the appraiser needs to send with the client company.  In order to do a thorough and professional job the appraiser should spend time talking with a large cross-section of your organization, select project that provide documentation for review, and to review the process documentation.  There should also be time for meeting with your executive sponsor and other key stakeholders

- man-days and "normal working days" should be the same.  Just remember that appraisals often required "pre-work" that is often done offsite, and "post-work" that is often done offsite as well.

- nine-women can't make a baby in one month, so more people from the appraiser's organization may not help.  There are SOME administrative things that can be shared by other people, but the LA still needs to see and speak with everyone, so it doesn't make much difference for a pre-appraisal.

- the LA and the client sponsor should collaborate on the amount of days required.  It all depends on the goals and objectives, the deliverables that have been agreed to, and the scope of the appraisal.  For me, a pre-appraisal is usually 2-3 days, but I have had them last as long as 5 days.

Good luck!

www.broadswordsolutions.com