2020 Census:

Census Bureau Needs to Improve Its Life-Cycle Cost Estimating Process

GAO-16-628: Published: Jun 30, 2016. Publicly Released: Jun 30, 2016.

Additional Materials:

Contact:

Robert Goldenkoff
(202) 512-2757
goldenkoffr@gao.gov

 

Office of Public Affairs
(202) 512-4800
youngc1@gao.gov

What GAO Found

Since 2012, the U.S. Census Bureau (Bureau) has taken significant steps to improve its capacity to carry out an effective cost estimate; however, its October 2015 cost estimate for the 2020 Census does not fully reflect characteristics of a high-quality estimate and cannot be considered reliable. To reflect these characteristics, an organization must meet or substantially meet four best practices. Overall, GAO found the cost estimate partially met the characteristics of two best practices (comprehensive and accurate) and minimally met the other two (well-documented and credible). One reason why GAO's overall assessment is low is because the estimate is not well-documented. Improving cost estimation practices will increase the reliability of the Bureau's cost estimate, which will in turn help improve decision making, budget formulation, progress measurement, course correction when warranted, and accountability for results.

Best practices state a risk and uncertainty analysis should be performed to determine the level of risk associated with the cost estimate. The Bureau carried out such an analysis only for a portion of estimated costs for fiscal years 2018 to 2020. According to Bureau officials, they scoped the analysis narrowly to those 3 years when most of the census costs occur. GAO found that, as a result, the Bureau's risk and uncertainty analysis (modeled costs) covered $4.6 billion, only about 37 percent of the $12.5 billion total estimated life-cycle cost, and less than one-half of the total estimated cost of the census during future fiscal years.

Components of Total 2020 Census Life-Cycle Cost Estimate

Components of Total 2020 Census Life-Cycle Cost Estimate Note: All figures are in constant 2020 dollars.

The Bureau has risk identification processes, which identify a broad range of risks that could affect the cost of the 2020 Census. Yet this awareness of risk is not leveraged in the Bureau's cost estimation. The cost estimation team did not consult risk registers or examine specific risks directly for inclusion in the cost model or risk and uncertainty analysis. It was not known what risks, if any, had been accounted for in other data in the cost model. As a result, neither the Bureau nor GAO are able to determine with confidence what risks the Bureau is prepared to mitigate or address within its $12.5 billion cost estimate. Improving control over how risk is accounted for will improve confidence that the Bureau's budgeted contingencies are at appropriate levels.

Why GAO Did This Study

In October 2015, the Bureau estimated that with its new approach it can conduct the 2020 Census for $12.5 billion, $5 billion less than the $17.8 billion it estimated it would cost to repeat the design and methods of the 2010 Census. Reliable cost estimates can help an agency manage large complex activities like the 2020 Census, as well as help Congress make funding decisions and provide oversight.

GAO was asked to evaluate the reliability of the Bureau's life-cycle cost estimate. Among other objectives, this report assesses the extent to which (1) the Bureau's life-cycle cost estimate met GAO's best practices for cost estimation and (2) the Bureau identified and accounted for key risks facing the 2020 Census. To meet these objectives, GAO reviewed documentary and testimonial evidence from Bureau officials responsible for developing the 2020 Census cost estimate. GAO used its cost assessment guide ( GAO-09-3SP ) and Standards for Internal Control in the Federal Government ( GAO-14-704G ) as criteria.

What GAO Recommends

GAO is making three recommendations including that the Secretary of Commerce direct the Bureau to take specific steps to ensure its cost estimate meets the characteristics of a high-quality estimate and improve control over how risk and uncertainty are accounted for in cost estimation. The Department of Commerce agreed with GAO's recommendations and provided additional context that was incorporated, as appropriate.

For more information, contact Robert Goldenkoff at (202) 512-2757 or goldenkoffr@gao.gov.

Recommendations for Executive Action

  1. Status: Open

    Priority recommendation

    Comments: Commerce agreed with this recommendation and has made significant progress. In October 2017 the Bureau provided an update to the 2020 Census cost estimate. The cost of the 2020 Census has increased from $12.3 billion to $15.6 billion. As of October 2018, the Bureau's 2017 cost estimate has met or substantially met three out of the four characteristics of a reliable cost estimate (comprehensive, accurate, and credible), while it only partially met the characteristic for being well-documented. The Bureau should continue its efforts to ensure that its life-cycle cost estimate is well-documented. Specifically, the Bureau partially met the following best practices within the well-documented characteristic: 1. Capturing source data used, the reliability of the data, and how the data were normalized. 2. Describing step by step how the estimate was developed so a cost analyst unfamiliar with the program could understand what was done and replicate it and 3. Discussing the technical baseline description and ensuring that data in the baseline is consistent with the estimate. Moreover, the Bureau will also need to implement a system to track and report variances between actual and expected cost elements. Tools to track these variances are important because it enables management to measure progress against planned outcomes. Since the Bureau's October 2017 cost estimate for the 2020 Census does not fully reflect the characteristics of a high-quality estimate as described in our Cost Estimating and Assessment Guide it cannot be considered reliable. In order to fully implement this recommendation, the Bureau needs to submit a revised version of the cost estimate with accompanying documentation that demonstrates these specific practices.

    Recommendation: To help ensure the Bureau produces a reliable cost estimate for the 2020 Census, the Secretary of Commerce and Under Secretary for Economic Affairs should direct the Census Bureau to take the following steps to meet the characteristics of a high-quality estimate: (1) Comprehensive--among other practices, ensure the estimate includes all life-cycle costs and documents all cost-influencing assumptions. (2) Well-documented--among other practices, ensure that its planned documentation plan captures the source data used; contains the calculations performed and the estimating methodologies used for each element; and describes step by step how the estimate was developed. (3) Accurate--among other practices, ensure the estimating technique for each cost element is used appropriately and that variances between planned and actual cost are documented, explained, and reviewed. (4) Credible--among other practices, ensure the estimate includes a sensitivity analysis, major cost elements are cross-checked to see whether results are similar, and an independent cost estimate is conducted to determine whether other estimating methods produce similar results.

    Agency Affected: Department of Commerce

  2. Status: Closed - Implemented

    Priority recommendation

    Comments: Commerce agreed and has taken action to implement this recommendation. On May 4, 2018, in response to GAO's recommendation, Bureau officials provided GAO with their Life Cycle Cost Estimate Version Control Plan document. Our review of the Bureau's 2017 life cycle cost estimate determined that the Bureau substantially met GAO criteria for documenting cost-influencing ground rules and assumptions. Specifically, documentation of the Bureau's approach included guidance on cost estimate updates, changes and releases and procedures for providing traceable sources of information for cost assumptions. Such changes support the overall reliability of cost estimates that management can use for making informed decisions.

    Recommendation: To further ensure the credibility of data used in cost estimation, the Secretary of Commerce and Under Secretary for Economic Affairs should direct the Census Bureau to establish clear guidance on when information for cost assumptions can and should be changed as well as the procedures for documenting such changes and traceable sources for information being used.

    Agency Affected: Department of Commerce

  3. Status: Open

    Priority recommendation

    Comments: Commerce agreed with this recommendation. Specifically, we reported that the Bureau should ensure that its budget for contingencies for the 2020 Census reflect an accurate accounting of risk and uncertainty. In doing this, the Bureau should improve controls over risk and uncertainty in the cost estimate process, and institutionalize these controls by providing clear methods for their use. In July 2018, we completed a review of documentation to support the updated Oct 2017 cost estimate and found that the Bureau performed uncertainty and sensitivity analysis on the estimate and appropriately added funding into the cost estimate to reflect inherent uncertainty and to account for specific risks. In order to fully implement this recommendation, the Bureau will need to link specific risks to funds set aside in the $1.2 billion general risk contingency fund. Therefore, as of October 2018, this recommendation remains valid and should be addressed: that the Bureau properly account for risk in the 2020 Census cost estimate.

    Recommendation: To ensure Bureau and congressional confidence that the Bureau's budgeted contingencies are at appropriate levels, the Secretary of Commerce and Under Secretary for Economic Affairs should direct the Census Bureau to improve control over how risk and uncertainty are accounted for and communicated with the Bureau's decennial cost estimation process, such as by implementing and institutionalizing processes or methods for doing so with clear guidance.

    Agency Affected: Department of Commerce

 

Explore the full database of GAO's Open Recommendations »

Dec 10, 2018

Dec 4, 2018

Nov 16, 2018

Nov 5, 2018

Oct 25, 2018

Sep 28, 2018

Sep 20, 2018

Sep 17, 2018

Sep 12, 2018

Sep 5, 2018

Looking for more? Browse all our products here