From: Judy Malsbury [jmalsbur@pppl.gov]
Sent: Tuesday, November 13, 2001 9:37 AM
To: Wayne Reiersen
Subject: RE: Software QA

Wayne - I don't know what they actually do, but what they can do - a 
combination of depending upon the reputation of the company 
developing the software, performing some tests when new versions are 
installed to assure that they work as predicted, having some way for 
the PPPL users to report problems to the Computer Division, the 
Computer Division maintaining awareness of problems identified by the 
company owning the software and analyzing the impact of these 
problems on PPPL, etc.

Also, when NCSX uses commercial software to do analysis, there needs 
to be some mechanism within the project to review the reasonableness 
of the results. The amount of work required to do this review would 
be a function of the risk inherent in an error. The review might be a 
peer review, alternate calculation, etc.  There are examples of where 
a simple math error or error in precision has caused significant 
problems later on.

Judy

>This sounds reasonable as to where the responsibility lies.  However, I am
>not sure what the Engineering Department actually does (or can do) to assure
>that the commercial software used is bug-free and reliable.
>
>
>Wayne T. Reiersen
>Princeton Plasma Physics Laboratory MS08
>PO Box 451
>Princeton NJ 08543
>
>609/243-2479 (phone) 609/243-3030 (fax)
>
>-----Original Message-----
>From: Judy Malsbury [mailto:jmalsbur@pppl.gov]
>Sent: Tuesday, November 13, 2001 9:10 AM
>To: Dori Barnes
>Cc: wreiersen@pppl.gov
>Subject: Re: Software QA
>
>Thanks. Judy
>
>>Judy,
>>    I would think that NCSX's  would NOT need a specialized system for
>>control of software, but would use the existing policies and
>>procedures. The Computer Division manages the CADD facility and
>>software so we do have "ownership/responsibility" for that software
>>and it comes under the Engineering Department policies. I also would
>>imagine that the Computer Division would be responsible for any
>>custom code development. So, I would guess that just a sentence
>>saying that software development and control on NCSX will follow
>>existing Engineering Department procedures would be sufficient.
>>Dori
>>
>>>Dori - From your perspective and familiarity with the software QA
>>>policy, would NCSX need to develop their own system for the control
>>>of software or would this be covered by the Computer Division's
>>>system? Who has PPPL's ownership/responsibility for the commercial
>>>software that they use, e.g. analysis packages, Pro-E? I believe
>>>the risk with these software packages is minimal, but who is
>>>responsible to assure that they are assessed and any necessary
>>>actions taken?
>>>
>>>When NCSX needs custom code developed for them, I am assuming that
>>>this will be done by the Computer Division and therefore under your
>>>software QA program. Is this a correct assumption?
>>>
>>>I am generating the NCSX QA Plan and was questioning whether there
>>>was any need for NCSX to generate a procedure on software
>>>development and control.
>>>
>>>Thanks, Judy
>>
>>Dori Barnes
>>Head, Computer Engineering Division
>>PPPL
>>Phone 609-243-2557
>>FAX 609-243-3086