HOME  |  CONTENTS  |  DISCUSSIONS  BLOG  |  QUICK-KITs|  STATES

Google

       Search WWW Search wifcon.com

FAR 15.101:  Source Selection Processes and Techniques

Comptroller General - Key Excerpts

New PDL, the incumbent contractor, protests the terms of the solicitation. It argues that the use of the lowest-price, technically-acceptable source selection process is not appropriate for this acquisition, and it maintains that the Navy should employ a tradeoff process. The protester also argues that because the inherent risk of unsuccessful contract performance is high, the agency should conduct a comparative assessment of the offerors' past performance. Lastly, the protester contends that the agency has improperly omitted several husbanding services that are provided under an existing contract for husbanding services in Australia.

An agency has the discretion to determine its needs and the best way to meet them. USA Fabrics, Inc., B-295737; B-295737.2, Apr. 19, 2005, 2005 CPD para. 82 at 4. Agency acquisition officials have broad discretion in the selection of the evaluation criteria that will be used in an acquisition, and we will not object to the absence or presence of a particular evaluation criterion so long as the criteria used reasonably relate to the agency's needs in choosing a contractor or contractors that will best serve the government's interest. King Constr. Co. Inc., B-298276, July 17, 2006, 2006 CPD para. 110 at 3.

The record here reflects that the agency reasonably determined that it could meet its needs using a low-priced, technically-acceptable approach to evaluate offers with an acceptable or neutral record of past performance. The contracting officer states that this decision was based on the fact that the requirement was relatively noncomplex, and there was relatively little performance risk. In addition, there was a substantial amount of information provided to the offerors in the solicitation, including estimated quantities for each line item by port. Contracting Officer's Statement at 2. While the protester disagrees with the agency's conclusions, the protester's disagreement does not render the agency's determinations unreasonable.  (PDL Toll, B-402970, August 11, 2010)  (pdf)


The RFP, issued as a service-disabled veteran-owned small business set-aside, sought proposals for the award of a fixed-price contract for construction services, including architectural, mechanical, electrical, utility, fire alarm, and fire protection systems work, and asbestos and lead abatement services. RFP at 1. Offerors were advised that the evaluation and award selection would be “made on the basis of both cost and technical considerations most advantageous to the Government,” that the technical evaluation factors combined (construction management, past performance, and schedule, listed in descending order of importance) were “approximately equal in importance to cost or price,” and that “if the technical proposals are essentially equal, the award will be made on the basis of lowest cost.” Id. at 2-3. Cost/price was to be evaluated “on the basis of its realism and acceptability to the Government.” Id.

In reviewing a protest against an agency’s evaluation of proposals and award, including a tradeoff determination, we examine the record to determine whether the agency’s judgment was reasonable and consistent with the solicitation’s evaluation criteria and applicable statutes and regulations. Ostrom Painting & Sandblasting, Inc., B-285244, July 18, 2000, 2000 CPD para. 132 at 4. Generally, in a negotiated procurement, an agency may properly select a lower-rated, lower-priced proposal where it reasonably concludes that the price premium involved in selecting a higher-rated proposal is not justified in light of the acceptable level of technical competence available at a lower price. Bella Vista Landscaping, Inc., B-291310, Dec. 16, 2002, 2002 CPD para. 217 at 4. A protester’s mere disagreement with the agency’s determinations does not establish that the evaluation or source selection was unreasonable. Weber Cafeteria Servs., Inc., B‑290085.2, June 17, 2002, 2002 CPD para. 99 at 4. Our review of the record here confirms the reasonableness of the agency’s evaluation of the proposals and its tradeoff determination.

(section deleted)

To the extent McGoldrick argues that the agency’s award to SPD on the basis of its lower-rated, lower-priced proposal violates the RFP’s terms, which McGoldrick interprets as permitting award on that basis only if the proposals were essentially equal in technical merit, the protester’s position is based on an unreasonable interpretation of the RFP, since, as stated above, the RFP clearly permitted a tradeoff between equally weighted technical and price factors. See Angel Menendez Envtl. Servs., Inc., supra, at 3-4. The agency reports, and our review of the record confirms, that the contracting officer, as the source selection authority, considered the evaluation narratives and worksheets and found no significant advantages or disadvantages between the proposals to justify the payment of the price premium associated with McGoldrick’s proposal ($1 million), given the level of technical competence available at SPD’s substantially lower price. McGoldrick simply has not provided any persuasive basis to question the reasonableness of the agency’s award to SPD on the basis of its lower-rated, substantially lower-priced proposal.  (McGoldrick Construction Services Corporation, B-310340.3; B-310340.4, May 16, 2008) (pdf)


DIT-MCO asserts that the Navy improperly failed to perform an adequate source selection analysis using the recalculated evaluated prices. Noting that the agency's original source selection decision was based on the mistaken understanding that Eclypse's price was approximately 25 percent lower than DIT-MCO's, when in fact the actual price difference was only approximately 3 percent in favor of Eclypse, the protester maintains that the agency then improperly failed to make “a best value analysis that weighed, compared and assessed the technical, past performance and experience benefits and weaknesses of each offer against the price” as correctly recalculated. Protester Comments, Apr. 28, 2008, at 1. DIT-MCO asserts that the agency’s actions had the effect of giving disproportionate weight to price--the least important evaluation factor---in the award decision.

We find the protester's position to be without merit. Again, the record reflects that the Navy determined Eclypse's and DIT-MCO's proposals to be essentially equal under the non-price factors, with “[t]he technical evaluation team [finding] nothing during their review of the proposals that would distinguish between DIT-MCO and Eclypse based on the [AWTS] unit that they are offering.” AR exh. 4, at 2.

Although the record indicates that DIT-MCO was advised by the Navy during the February 12 post­award debriefing that both its proposal and Eclypse's had received the same ratings under the non-price factors, with no discernible technical differences in the proposed equipment, Agency Report, Apr. 17, 2008, at 4, the protester did not challenge the technical evaluation results in its initial, agency-level protest. Rather, DIT‑MCO first challenged the technical evaluation in its March 20 protest to our Office, when it asserted that the awardee's proposed product failed to meet the RFP requirements relating to size and weight, and that the evaluation improperly failed to account for DIT‑MCO's advantages in this area and with respect to AC dielectic testing. Under our Bid Protest Regulations, however, protests other than those based on alleged solicitation improprieties generally must be filed no later than 10 calendar days after the protester knew, or should have known, of the basis for protest, whichever is earlier. 4 C.F.R. 21.2(a)(2) (2008). Since DIT‑MCO has made no showing that its challenge to the technical evaluation was based on new information learned after the debriefing and thus could not have been raised in its agency-level protest, its failure to raise this protest ground within 10 days of the debriefing in its agency-level protest renders untimely the subsequent assertion of this protest ground in its protest to our Office. Foundation Eng'g Scis., Inc., B-292834, B‑292834.2, Dec. 12, 2003, 2003 CPD para. 229 at 3 n.2.

While the protester is correct that agencies must adequately document cost/technical tradeoff decisions, detailing the relative strengths and weaknesses of the various proposals and explaining the reasons underlying a cost/technical tradeoff, Johnson Controls World Servs., Inc., B-289942, B-289942.2, May 24, 2002, 2002 CPD para. 88 at 6-7, no cost/technical tradeoff was required here, since the proposals were determined to be technically equal and the agency made award to the offeror submitting the lowest priced proposal. Further, the award was consistent with the terms of the solicitation. Although the RFP provided that the non-price evaluation factors were significantly more important than price, it also provided that, as proposals became more equal under the non‑price factors, the importance of price would increase. RFP at 60. In this regard, in a negotiated procurement with a best value evaluation methodology, where selection officials reasonably regard proposals as being essentially equal technically, price properly may become the determining factor in making award, notwithstanding that the solicitation assigned price less importance than technical factors. Synergetics, Inc., B-299904, Sept. 14, 2007, 2007 CPD para. 168 at 7. In these circumstances, in the absence of a timely challenge to either the technical or cost evaluation results, we find the award to Eclypse on the basis of its lowest priced, technically equal proposal to be unobjectionable.  (DIT-MCO International Corporation, B-311403, June 18, 2008) (pdf)


LEADS challenges the agency’s determination that EIS’s quotation represents the best value to the government, arguing that in selecting EIS’s lower-rated, lower‑priced proposal for award, the agency placed undue emphasis on price and essentially converted the basis for award from a determination of “best value” to one of “lowest-cost, technically acceptable.” Protest at 9, 12. The protester also asserts that the agency’s source selection decision is not adequately documented, and that it misrepresents the relative merits of LEADS’s and EIS’s quotations.  Source selection officials have broad discretion in determining the manner and extent to which they will make use of the technical and cost/price evaluation results; tradeoffs may be made, and the extent that technical superiority may be sacrificed for a cost/price advantage is governed by the test of rationality and consistency with the established evaluation factors. Joppa Maint. Co., Inc., B-281579; B-281579.2, Mar. 2, 1999, 2000 CPD para. 2 at 7. A protester’s mere disagreement with the source selection decision does not show that the source selection was not reasonably based or was otherwise inconsistent with the solicitation’s award language. Financial & Realty Servs., LLC, B-299605.2, Aug. 9, 2007, 2007 CPD para. 161 at 5-6. In addition, our Office has also long recognized that an agency, in making a source selection, may properly conclude that a technical scoring advantage based primarily on incumbency does not indicate an actual technical superiority that would warrant paying a cost premium. EDAW, Inc., B-272884, Nov. 1, 1996, 96-2 CPD para. 213 at 7; Sparta, Inc., B‑228216, Jan. 15, 1988, 88-1 CPD para. 37 at 4.

We disagree with the protester that the agency failed to adequately document its source selection, placed undue emphasis on price in selecting EIS’s quotatation for award, and essentially changed the basis for award from “best value” to “lowest-cost, technically acceptable.” In this regard, the agency’s source selection statement (which totals six pages) provides a summary of each quotation’s strengths and weaknesses, as well as the reasoning for the evaluation ratings received under each of the evaluation factors. The source selection statement continues by comparing the ratings of each of the quotations, providing an overall ranking of the quotations as evaluated under the non-price factors, and provides a table of the evaluated prices and summary of the agency’s review of the prices quoted. The source selection statement accurately acknowledges LEADS’s evaluated technical advantages, but concludes that the protester’s higher technical rating does not outweigh EIS’s price advantage. We find that the agency’s source selection decision is adequately documented, and given the specific price/technical merit tradeoff made in selecting EIS’s quotation for award, see no indication in the record that the agency, in making its source selection, placed undue emphasis on price or made award on a “lowest-cost, technically acceptable” basis.  We also do not agree with the protester that the agency’s source selection decision misrepresents the relative merits of LEADS’s and EIS’s quotations. In this regard, LEADS primarily complains that the statement in the source selection decision that LEADS’s quotation’s higher technical rating under the evaluation factors of experience and transition plan was due to LEADS’s status as the incumbent, which assertedly indicated that the source selection decision failed to reflect the actual advantages of LEADS’s quotation under these factors. Specifically, the protester contends with regard to the experience evaluation factor that its rating of “excellent” was not “merely by virtue of its status as the incumbent,” but was also, for example and as recognized by the evaluators, due to the “relevance, depth and scope of LEADS’ experience.” Protester’s Comments at 5. The protester also argues that its quotation should have been viewed as significantly superior to EIS’s under the experience factor (despite EIS’s “good” rating), given that the evaluators noted that a “chart” provided in EIS’s quotation “referenced vaguely relevant and similar experience in the RFQ.”   Supplemental Protest at 9. We agree with the protester that the agency, in assigning LEADS’s quotation an “excellent” rating under the experience factor, identified numerous strengths with regard to LEADS’s “experience,” and that these strengths are related to the relevance, depth and scope of LEADS’s experience. However, the agency also found that the vast majority of these strengths were in the context of LEADS’s 12-year record of performance as the incumbent contractor. We find no basis in this record to conclude that the agency did not reasonably assess the merits of LEADS’s quotation under this factor.  (LEADS Corporation, B-311002; B-311002.2, March 26, 2008) (pdf)


In any event, the protester’s argument is unpersuasive as it reflects an unreasonable interpretation of the RFP. To be reasonable, an interpretation of solicitation language must be consistent with the solicitation when read as a whole and in a manner that gives effect to all of its provisions. Stabro Labs, Inc., B-256921, Aug. 8, 1994, 94-2 CPD para. 66 at 4. The protester’s interpretation that the RFP does not permit the agency to find that a lower-rated, lower-priced proposal represents the best value to the agency unless the proposals are found to be technically equal, is unreasonable because it renders meaningless the RFP’s clear instruction to all offerors that all technical factors combined were to be approximately equal in importance to price. Contrary to the protester’s position, the solicitation permitted a tradeoff between technical and price factors and did not prohibit an award to an offeror that submitted a lower-rated, lower-priced proposal. (Angel Menendez Environmental Services, Inc., B-310340.2, April 11, 2008) (pdf)


Where, as here, the RFP states a best value evaluation plan--as opposed to selection of the lowest priced, technically acceptable offer--evaluation of proposals is not limited to determining whether a proposal is merely technically acceptable; rather, proposals should be further differentiated to distinguish their relative quality under each stated evaluation factor by considering the degree to which technically acceptable proposals exceed the stated minimum requirements or will better satisfy the agency’s needs. See The MIL Corp., B-294836, Dec. 30, 2004, 2005 CPD para. 29 at 8; Johnson Controls World Servs., Inc.; Meridian Mgmt. Corp., B-281287.5 et al., June 21, 1999, 2001 CPD para. 3 at 8. In fact, we have long stated that evaluation ratings should be merely guides for intelligent decision-making, see Citywide Managing Servs. of Port Washington, Inc., B‑281287.12, B-281287.13, Nov. 15, 2000, 2001 CPD para. 6 at 11, and that therefore evaluators and SSAs should reasonably consider the underlying bases for ratings, including the advantages and disadvantages associated with the specific content of competing proposals, in a manner that is fair and equitable and consistent with the terms of the solicitation. See MD Helicopters, Inc.; AgustaWestland, Inc., B-298502 et al., Oct. 23, 2006, 2006 CPD para. 164 at 15. Indeed, as indicated above, the FAR requires that agencies sufficiently document their judgments, including documenting the relative strengths, deficiencies, significant weakness, and risks supporting their proposal evaluations. See FAR sections 4.801(b), 15.305(a), 15.308; Century Envtl. Hygiene, Inc., supra, at 4. Here, given the nearly complete absence in the record of any assessment of the firms’ different approaches under the mission capability and proposal risk subfactors (as noted above, the SSET did assess Jacobs’s proposed “seamless team” approach and lack of OCIs as proposal strengths, justifying a blue/excellent rating with low risk under the management practices subfactors), we find that the SSET failed to evaluate the firms’ proposals under these subfactors consistent with the RFP, which we find prevented the SSA from meaningfully weighing the relative merits of the offerors’ proposals. In this regard, the SSA indicated in his testimony that it was his practice in making selection decisions to look beyond the color/adjectival ratings in weighing the offerors’ proposals, see Tr. at 323-25, and the contemporaneous record evidences that the SSA attempted to look beyond the adjectival ratings here to ascertain the relative quality of the firms’ technical proposals. See, AR, Tab 50, Memorandum for Record, Jan. 30, 2007. However, we do not find that the SSA was provided with a reasonable opportunity to do so here, given the SSET’s failure to qualitatively assess the merits of the offerors’ proposals, as required by the RFP. See Tr. at 330-39. Accordingly, since the record evidences that the agency did not evaluate the proposals under the mission capability and proposal risk subfactors in a way that reasonably distinguished their relative merits in accordance with the RFP’s evaluation scheme, we sustain the protests.  (Systems Research and Applications Corporation; Booz Allen Hamilton, Inc., B-299818; B-299818.2; B-299818.3; B-299818.4, September 6, 2007) (pdf)


The protester contends that the contracting officer and SSA improperly converted the procurement to one based on low price among technically acceptable offers instead of following the RFP’s provision that technical superiority was to be significantly more important than price. As explained below, we conclude that the record shows that the evaluation and selection decision here were reasonable and consistent with the RFP. Based on the record here, we find the tradeoff determination and award reasonably based. Our review, as discussed further below, confirms not only the SSA’s view of the comparable technical merit of the proposals, but also the reasonableness of the determination that, given the level of technical merit available at a significantly lower price, an award to Crown based on its slightly higher-rated proposal was not warranted. The evaluation record here is clear. As the contracting offficer points out in her analysis of the TEP report, both firms’ proposals presented comparable strengths under each evaluation factor. For instance, under the prior experience factor, where both firms were rated “excellent,” each was credited for extensive experience with HUD and other property closings at similar volumes and in similar geographic areas. For the technical and management factor, both firms met state licensing requirements, provided comprehensive quality control plans, set out detailed work strategies, and have several offices in the area. Given the similarity in the noted strengths for both proposals, we find reasonable the contracting officer’s conclusion that the difference in technical ratings assigned for the factor (“excellent” for Crown and “good” for Lawyers) does not reflect any material difference in technical merit. For past performance, Crown’s proposal was rated “excellent” and Lawyers’ was rated “good.” While there is little explanation of the difference in past performance ratings in the record, our review shows that at least two past performance references rated Lawyers “excellent” under each subfactor. Additionally, while one evaluator apparently noted some negative performance information for the firm, the same evaluator also cited numerous strengths for the firm. For the final technical factor, personnel qualifications, the record also supports the SSA’s conclusion that the two firms’ proposals were comparable in technical merit. Both firms’ staff resumes and biographies showed that all proposed key personnel met or exceeded the RFP’s experience requirements and that the level of effort proposed was satisfactory for successful performance of the work. While Crown was credited (and rated “excellent”) for having personnel committed solely to this project, it is also clear in the evaluation record that Lawyers (rated “good” for the personnel factor) was found to have fully staffed the effort with qualified, experienced personnel, for which its proposal was rated favorably. (Crown Title Corporation, B-298426, September 21, 2006) (pdf)


ATI misunderstands the nature of this acquisition. Where, as here, a solicitation calls for detailed technical proposals and sets forth weighted evaluation criteria that enable the agency to make comparative judgments about the relative merits of competing submissions, the agency properly may rate one submission higher than another based on its exceeding the solicitation’s stated requirements. ManTech Sec. Tech. Corp., B-297133.3, Apr. 24, 2006, 2006 CPD para. 77 at 7; see also Chicago Dryer Co., B-293940, June 30, 2004, 2004 CPD para. 137 at 4 (protest that agency should have selected protester’s technically acceptable, lower-priced proposal over awardee’s technically superior, higher-priced proposal that exceeded solicitation’s minimum requirements was denied where solicitation provided for comparative evaluation of technical proposals, which indicated that qualitative distinction would be made between competing submissions). Here, the record shows that the agency rated Brown’s quotation higher than the protester’s primarily because Brown’s provided several features that exceeded the minimum requirements of the solicitation in ways deemed beneficial to the agency. For example, the record shows that Brown’s test stand had a component that was larger than required under the specifications, which the agency deemed desirable because it would enhance the ease of operating the device. In comparison, ATI’s quotation did little more than reiterate the specifications verbatim; it provided nothing that exceeded the minimum requirements of the RFQ. Since firms were specifically advised that the agency was conducting this acquisition on a best value (as opposed to low price, technically acceptable) basis, there was nothing improper in the agency’s making these qualitative distinctions between the quotations, and selecting the higher-priced Brown quotation as providing the most advantageous product considering price and non-price factors; this is especially so in light of the fact that the RFQ advised firms that the non-price factors were significantly more important than price. (Aviation Technology, Inc., B-298313.2, September 21, 2006) (pdf)


In a competitive procurement under the Federal Supply Schedule program in which the solicitation announced that award would be made on a best value basis and that technical factors were more important than price, the agency improperly selected the awardee to receive the order based upon the awardee's technically acceptable, lowest-priced quote.  (Computer Products, Inc., B-284702, May 24, 2000)

Comptroller General - Listing of Decisions

For the Government For the Protester
New PDL Toll, B-402970, August 11, 2010  (pdf) Systems Research and Applications Corporation; Booz Allen Hamilton, Inc., B-299818; B-299818.2; B-299818.3; B-299818.4, September 6, 2007 (pdf)
McGoldrick Construction Services Corporation, B-310340.3; B-310340.4, May 16, 2008 (pdf) Computer Products, Inc., B-284702, May 24, 2000
DIT-MCO International Corporation, B-311403, June 18, 2008  (pdf)  
LEADS Corporation, B-311002; B-311002.2, March 26, 2008 (pdf)  
Angel Menendez Environmental Services, Inc., B-310340.2, April 11, 2008 (pdf)  
Crown Title Corporation, B-298426, September 21, 2006 (pdf)  
Aviation Technology, Inc., B-298313.2, September 21, 2006 (pdf)  
Legal

Protests

Bona Fide Needs Rule
Public Laws
Legislation
Courts & Boards


Rules & Tools
Workforce
Reading

Small Business
 

   
 
 

ABOUT  l CONTACT