Roger, Ada validation/conformance testing does indeed continue, and is no less rigorous than when it was sponsored by DoD. We continue to upgrade the test suite (now at version 2.2) and continue to issue certificates. Of course, I'm an insider, so you might view my assurances with some skepticism, but I can assure you that I would not put my part of the organization behind this process if it were becoming sloppy. To say that the commercial sector has less need for rigor than DoD is a mistake. Ada compilers are used in a wide variety of safety-critical applications (e.g., Air Traffic Control systems) where rigor is essential. We are working to bring Ada conformity assessment under the ISO umbrella in the sense that there is a developing ISO standard for the conformity assessment process. For information on this process, contact Jim Moore, Convener of the ISO/IEC/SC22/WG9 Working Group for Ada ([log in to unmask]). For information on the current conformity assessment process, see http://eds-conform.com/ACAA-1-4.pdf or contact the Ada Conformity Assessment Authority's Technical Representative, Randy Brukardt ([log in to unmask]). For general information about the EDS Ada Conformity Assessment Laboratory operated by EDS, see http://www.eds-conform.com or contact me directly. Phil Brashear EDS Conformance Testing Center 4646 Needmore Road, Bin 46 P.O. Box 24593 Dayton, OH 45424-0593 (937) 237-4510 [log in to unmask] www.eds-conform.com > -----Original Message----- > From: Roger Racine [SMTP:[log in to unmask]] > Sent: Tuesday, May 18, 1999 4:06 PM > To: [log in to unmask] > Subject: Conformance Testing > > Our company is involved in an Army project planning to use Ada. An Army > officer wrote a memo describing his concerns over the loss of DoD > involvement in what used to be validation of compilers. A very rough > synopsis of his concerns is: > > * Since the testing is now being done by a commercial group (the ARA), > the > testing might be less rigorous than when it was done by the AJPO, so as to > satisfy the commercial sector, which has less need for rigor than the DoD. > This might lead to less assurance that the compiler is defect-free, which > then leads to the conclusion that the end system will be less reliable. > > We are being asked to comment on this memo, and would like any information > regarding the Conformance Testing that might alleviate this concern. For > example, is ISO, or any independent organization, involved in the > definition of the tests? > > Since the government dropped testing, has testing continued? > > Basically, I could use any ammunition on why conformance testing is either > A) just as good as it used to be; or B) why conformance testing is not a > major factor in end-system reliability. > > Pointers to web sites or technical articles would also be welcome. > > Roger Racine > Roger Racine > Draper Laboratory, MS 31 > 555 Technology Sq. > Cambridge, MA 02139 > 617-258-2489