Jump to content

Comparative analysis with technical factors in equal wieght


Recommended Posts

I have an noncomplex SOW that is FFP over $5.5M. I am considering the use of comparative analysis. The program office wants the two technical factor we defined to be equal in weight. I'm being asked how we will do a trade-off selection. My understanding and reply was the government is finding the best value using comparative analysis to select the contractor that is best suited and provides the best value, considering the evaluation factors in this Notice to Fair Opportunity. The Government may not make an award at a significantly higher overall price to achieve a marginal increase in superior technical capability. Best value evaluation is, in and of itself, a subjective assessment by the Government of the proposed solution that provides the optimal results to the Government. The Government may conduct a tradeoff analysis if appropriate that involves the assessment of benefits of superior proposal features (i.e., benefits clearly attributable to increased productivity, increased probability of successful task order performance, and unique and innovative approaches or capabilities) versus the total price. This may result in a proposal being awarded other than the highest technically-rated Offeror, or other than the lowest price Proposal, that is superior in the technical solution that merits a higher price.

Does anyone have questions or see a concern for this as written?

Has anyone had success in using technical factors that are equal in weight?

Link to comment
Share on other sites

Factors of approximately equal importance are fine.  I've done it many times -- it is my default position until I decide that one or more factors really are more important than others.

You are using far too many words.  Is this over $5.5 Million?  If yes, all you have to say in the solicitation is that all three factors (two technical plus price) are of approximately equal importance and the Government will select the best value offer using a tradeoff approach.

Link to comment
Share on other sites

1 hour ago, ji20874 said:

You are using far too many words.  Is this over $5.5 Million?  If yes, all you have to say in the solicitation is that all three factors (two technical plus price) are of approximately equal importance and the Government will select the best value offer using a tradeoff approach.

This answer couldn’t be better.  It’s perfect.

 

Link to comment
Share on other sites

@ji20874, thank you. I clarified my original post to reflect the requirement is an SOW, that is FFP, over $5.5M. We are considering comparative analysis to determine best value and may utilize a trade off after price analysis and technical evaluation. We have encountered legal counsel making us do trade off when it is not warranted because we said we "are" doing it (I want to streamline this). At my agency, I believe they read way to much into everything and complicate matters. I know words matter, so I'm trying to make this clear and streamlined (without over complicating it, which can be challenging depending on reviewers and approvals).

@formerfed, thank you. Which answer couldn't be better?

Link to comment
Share on other sites

A trade off approach really isn’t rocket science.  But I think that you should also describe what you mean by that term.  

Best value means that you are considering both quality [technical, non-price] and price of offers. A trade off approach generally means that you reserve the right to pay more for a conforming [proposal, offer, quote] that provides sufficient additional value to justify the additional cost over lower priced, conforming [proposal(s), offer(s), quote(s)].

[Select your applicable terms (e.g., proposal, offer, quote, etc.)]

Link to comment
Share on other sites

If there is a protest, the protest forum would use similar descriptions to define best value and the trade off comparisons to establish the standards for justifying the basis of award, if those terms aren’t otherwise defined in a solicitation, task order competition, etc.

Many State governments and Industry organizations are using the term “best value” (BV) in the sense that both quality of the non-price and price are considered. That is to distinguish from “low bid”and “Quality (or “Qualification”) Based Selections” (QBS). 

Link to comment
Share on other sites

1 hour ago, joel hoffman said:

But I think that you should also describe what you mean by that term.  

I disagree.  The word "tradeoff" already had a meaning -- we do not need solicitations with homemade definitions.

Link to comment
Share on other sites

Yes, but describe the “meaning”, so everyone is on the same page. 

Link to comment
Share on other sites

Once definitions become part of the described process, it adds complications and sets the stage for protests based on terminology.  All that’s needed in the solicitation is what ji20874 already mentioned.  Orders are supposed to be simple.  Too many agencies decide to make them complicated.  
 

Let’s not forget what this process is about.  It’s getting the government a good deal to optimally meet a program/mission need in a timely and responsive manner.  Placing orders against multiple award IDIQ contracts is supposed to be a streamlined way of doing that.  Adding a complicated source selection process with extensive bureaucratic details complicated things, adds delays, and sets the stage for losers to find a way for a second chance.  That’s not what FAR 16.505 is supposed to be.  

 

Link to comment
Share on other sites

12 hours ago, joel hoffman said:

Yes, but describe the “meaning”, so everyone is on the same page. 

I disagree.  The word "tradeoff" already had a meaning -- we do not need solicitations with homemade definitions meanings.

Link to comment
Share on other sites

So, let’s review what the task order notice of fair competition would appear to explain  to competitors,  as recommended here.

There are three factors approximately equal in importance - two technical and price.

The Government will select the best value offer using a tradeoff approach.

Im assuming that there will be some type of evaluation of the quality of the technical proposals and some type of evaluation or comparison of prices.

From Ray’s posts, Ray apparently wants:

1. to make a “comparative analysis to determine best value” and

2. “may use a trade off after price and technical evaluation”.

Im not sure what “comparative analysis to determine best value”  means. What is Ray comparing? 

Does this mean simply comparing each proposer’s two technical factors and prices to each other to rate the three factors then decide what proposal provides the best value? How would Ray determine the best value? 

Or will Ray evaluate each proposer’s  technical factors against some “comparative” evaluation criteria , somehow evaluate prices then compare the technical and prices between proposers? (Looks like some type of tradeoff process to me).

Ray indicated that Legal apparently says it is mandatory to do a trade off analysis (when we say we are doing it). But Ray apparently wants that to be done only if necessary.

Is Ray indicating that no “tradeoff analysis” is necessary if the highest  rated technical proposal is also the lowest priced proposal and no other higher priced proposal offers any technical advantages over the highest rated technical proposal?

Well, it is true that there is no tradeoff in that case. There is nothing to tradeoff. You simply document the fact that the best technical proposal is also the lowest priced proposal right? But that is still a tradeoff analysis in its simplest form - that no tradeoff is involved.

From a reread of Ray’s first post, Ray obviously would analyze whether or not to trade-off paying more when there are any technical proposals offering some type of advantages or additional value over the lowest priced technical proposal. Well that is a tradeoff analysis.

I think that the only way to avoid a tradeoff  (paying more than the minimum conforming proposal) is to only choose the lowest priced conforming proposal or to simply add up total scores of a proposal to define what is the “best value”.

People usually make best value determinations almost every day when shopping, if they ever decide to buy anything other than the lowest priced product that would meet their minimum requirements.

They are trading off paying a higher price for additional value when they decide to buy a product offering any advantages, desirability,  value or benefits over another lower priced item.

I just don’t know how Ray would use a “comparative analysis” to distinguish from “using a tradeoff” to determine the best value.

 

 

Link to comment
Share on other sites

As I see it, comparative evaluation is simply one way to do a tradeoff.  The offers are compared directly to each other (without assigning scores, points, or adjectival ratings) and the best value offer is selected considering all the factors.  

Even when a tradeoff process is declared in a solicitation, we know from GAO case law that a tradeoff need not be documented when one offer is both higher technically rated and lower priced in comparison to another.  

Link to comment
Share on other sites

A comparative process as described above still uses a tradeoff analysis to determine the winner. A decision is made to trade off or not tradeoff paying a higher price. And if the lowest priced proposal is the best price, there is obviously no tradeoff. But you compared the proposals. One would still document the basis of the selection for the record.

Link to comment
Share on other sites

I am middle of the road regarding “tradeoff”.   I struggle that the term is already defined (in the parent contract and/or a notice of fair opportunity).  FAR Part 2 does not define tradeoff.   FAR 52.202-1 provides that as a clause it only applies to a provision or a clause.

FAR part 16.505(b)(iv) provides for orders over $5.5 million that the notice of fair opportunity must provide for (C) Disclosure of the significant factors and subfactors, including cost or price, that the agency expects to consider in evaluating proposals, and their relative importance;” and further states in (D) that if “best value” is used then such an award decision must be documented.  There is no discussion that the term tradeoff must be stated in the notice but is only discussed with regard to an award documentation.

Most importantly FAR 16.505(b)(v)(B) states that Formal evaluation plans or scoring of quotes or offers are not required.

Mixing of metaphors between FAR part 15 and 16 is a slippery slope which I believe is happening in this thread.   So in part I agree with @ji20874 however I do understand @joel hoffmanconcern but I believe Joel's intent is overkill in a fair opportunity selection process.

So by example here is what I believe what @Ray L. Savoy ought to state in the Fair Opportunity Notice with the caveat that my thoughts are created in a vacuum of sorts as I do not know what the ordering clause of the parent contract says with regard to placement procedures for task orders with regard to application of fair opportunity.

 

Example Notice - This is a notice of fair opportunity.  In reviewing responses to this notice comparative analysis will be used.  Technical factors are __________ and _______________ and are equal.  These factors when combined are less in important than price.  

Link to comment
Share on other sites

Carl, I agree not to over complicate the task order competition but I don’t think that your example - for a competition exceeding five and a half million dollars - really informs the competing firms how they can win the competition. All they would know that price is the most important factor/consideration and that there are two equally important technical factors. That’s it.

Thats not fair to the firms,  who have to invest in time and resources to prepare technical proposals and strategize how to best meet your needs in a competitive manner.
 

46 minutes ago, C Culham said:

Example Notice - This is a notice of fair opportunity.  In reviewing responses to this notice comparative analysis will be used.  Technical factors are __________ and _______________ and are equal.  These factors when combined are less in important than price.  

 

Link to comment
Share on other sites

I'm good with Carl's words.  It fully satisfies FAR 16.505(b)(1)(iv).

Joel, please review FAR 16.505(b)(1)(iv).  You may reasonably assume that some proposal-writing instructions for the technical factors (page limits, submission instructions, and so forth) will be included in the fair opportunity notice if applicable.

Link to comment
Share on other sites

6 hours ago, ji20874 said:

I'm good with Carl's words.  It fully satisfies FAR 16.505(b)(1)(iv).

Joel, please review FAR 16.505(b)(1)(iv).  You may reasonably assume that some proposal-writing instructions for the technical factors (page limits, submission instructions, and so forth) will be included in the fair opportunity notice if applicable.

I disagree that Carl’s words fully satisfy 16.505(b)(1)(iv).

“(iv) Orders exceeding $5.5 million. For task or delivery orders in excess of $5.5 million, the requirement to provide all awardees a fair opportunity to be considered for each order shall include, at a minimum—
...(D) Where award is made on a best value basis, a written statement documenting the basis for award and the relative importance of quality and price or cost factors; “

There is no description of the basis of award, which would help the proposers prepare their strategy and their proposal.

Simply stating that it will be best value award does not describe the basis of award. Carl didn’t directly state that it is best value either, although such is implied.

Since one must state the basis of award, how would this sentence be an overkill?

“The government reserves the right to pay more for a conforming [proposal, offer, quote] that provides sufficient additional value to justify the additional cost over lower priced, conforming [proposal(s), offer(s), quote(s)].”

[Note to specifier: Select your applicable terms (e.g., proposal, offer, quote, etc.)]

Link to comment
Share on other sites

Let’s not forget these awardees already competed for awards with lengthy technical proposals.  Ordering is supposed to be streamlined.  There shouldn’t be a need to defining things, complex evaluations, or lengthy proposals.  Many GWACS have a good track record of 10 day solicitation period, 5-10 days evaluation and section, and order awards. The key is knowing how to conduct the process.  It’s simple and straightforward until people don’t make it that way.

Link to comment
Share on other sites

One agency and their CO asked for me to not disclose their identity.  But companies here might recognize this.  They issue an RFQ stating a need.  Responses are limited - generally a couple pages for technical.  Experience/past performance requires the identify of ALL same or similar work in recent years.  Every instance requires a contact point and multiple backups are permitted.  If the government can’t verify performance in five days from any reference, the company receives neutral.  Omitting experience or false references is grounds for further consideration.  Selections are done in less than 10 days.

 

 

 

 

 

 

Link to comment
Share on other sites

2 hours ago, formerfed said:

Let’s not forget these awardees already competed for awards with lengthy technical proposals.  Ordering is supposed to be streamlined.  There shouldn’t be a need to defining things, complex evaluations, or lengthy proposals.  Many GWACS have a good track record of 10 day solicitation period, 5-10 days evaluation and section, and order awards. The key is knowing how to conduct the process.  It’s simple and straightforward until people don’t make it that way.

Formerfed, we don’t know here what two technical factors or SOW that Ray is evaluating for his task order or what the ID/IQ covers. Ray did not mention a GWAC.

I don’t necessarily disagree with you in principle.

However, ID/IQ task orders that exceed $5.5 million may often be for more complex scopes of work, especially for construction or design-build projects.

The comparative factors might or might not be significant here. 

Link to comment
Share on other sites

On 5/3/2020 at 5:50 PM, ji20874 said:

I disagree.  The word "tradeoff" already had a meaning -- we do not need solicitations with homemade definitions.

Okay what is the meaning of “tradeoff” and how does the “meaning” relate to the basis of award, which must be stated in the fair opportunity announcement here? 

Link to comment
Share on other sites

2 hours ago, ji20874 said:

You don't know what tradeoff means?

I know what it means. You said it has “a meaning” and I’m looking for for your “official” definition of the word to substitute for my apparent “homemade definition”. 

Link to comment
Share on other sites

For Part 15 Source selections, the Tradeoff acquisition process is described in FAR 15.101-1  and agency supplements and references thereto. For DoD the actual analyses are also described in detail in the 2016 version of the DoD Source Selection Procedures in Paragraph 3.9 “Best Value Decision”

For DoD, the selection authority first makes a “comparative analysis” between the proposals after proposals have been evaluated against evaluation criteria.

For DoD source selections, there are three possible outcomes from the comparative analysis:  

1. The proposal with the lowest total evaluated price is superior in terms of non- cost factors;
2. There are no meaningful distinctions between the non-cost portions of the proposals;
3. The proposal with the lowest total evaluated price is not superior in terms of non-cost factors.

The Best Value determination is pretty clear in the first two outcomes. The lowest priced conforming proposal would represent the best value.

However, in the case of the third outcome, the decision is not as clear. The Selection authority must perform a tradeoff analysis among competing proposals to  consider whether or not the benefits of the non-cost strengths in a higher rated proposal warrant the additional price premium.

I asked what Ray meant by “comparative analysis” and Tradeoff analysis, if necessary. I wasn’t sure whether Ray meant comparing proposals directly to establish factor ratings or making the comparative analysis that is described in the DoD Source Selection Process, under the Best Value Decision methodology.

I should have noticed the apparent tip off when Ray said that they would perform a Tradeoff analysis, if necessary, after the comparative analysis. Others concluded that Ray was referring to direct comparisons between proposals for evaluation purposes, whether or not ratings were to be assigned.

Now I think that Ray was referring to the steps that are outlined in the 2016 DoD Source selection procedures to Determine the proposal offering the best value. That would answer my confusion about why Ray used the two terms separately for a tradeoff acquisition process. 

Regardless of what the steps are called, Ray was probably describing  a form of tradeoff process proposed for a task order competition.

I think all agree that task order competitions should be streamlined  as much as possible.

However, if the best value basis of award would allow the government to award to other than the lowest confirming offer, some form of a tradeoff process would have to be used. 

There were a couple of simplified statements to describe the technical factors, their relative importance and the relative importance of price factor vice the non-price factors. Those statements would indicate that the government was going to use a best value method. They also indicate that some type of tradeoff might be necessary. I have proposed a sentence to describe the governments right to select a higher priced, conforming [proposal, quote, offer] (name as applicable), if it warrants paying more than a lower priced, conforming [proposal, quote, offer]. That would be determined as the best value to the government.

Its pretty straight forward and not overly complicated, doesn’t directly use the Part 15 terms.

I do think that a protest forum might apply some Part 15 standards of review though, since it is essentially a trade-off type best value process, vice some other,  simpler method.

Ray didn’t indicate the importance of price relative to the non-price factors. That must be stated, as referenced above in 16.505. Price could be more important than non-price; all three could be equal in importance (meaning that, when combined, non-price are more important than price) ; price could be equal to non-price (meaning that, when non—priced are combined, price is the single most important factor).

I don’t think that Ray needs to or even should use the terms “comparative analysis” and/or “tradeoff analysis” to refer to the steps involved.

Ray, simply referring to a “comparative analysis”, without explaining what you are comparing, is ambiguous as evidenced in this thread. That term has a specific meaning in the DoD Source Selection Procedures, which are agency specific and which are probably not familiar to contractors or those government employees other than the DoD acquisition personnel using those procedures.  Some people apparently think that it means to evaluate proposals against each other. I wondered if it was that or what turns out to be the DOD coined step in a tradeoff process.

Link to comment
Share on other sites

Guest
This topic is now closed to further replies.
×
×
  • Create New...