Project Name:

The Federated Data Usage Platform (DUP): a Shared Federal Asset

Contractor: BrightQuery, Inc.

Lessons Learned

  • Importance of Iterative Development

The phased and iterative development approach enabled continuous improvement across UI, application logic, and integrations. This helped in early identification of issues and ensured stable, production-ready outputs at each stage.

  • Value of Strong Data Integration Strategy 

Standardizing integration across multiple external data sources proved critical for scalability and consistency. Early alignment on APIs, schemas, and ingestion patterns significantly reduced downstream complexity. 

  • Need for Early QA and Governance Alignment 

Incorporating QA planning and governance requirements early in the lifecycle ensured compliance with NSDS standards. This minimized rework and enabled smooth validation with zero defects during testing.

  • End-to-End Integration Should Be Validated Continuously The progressive integration and testing approach demonstrated that validating integrations throughout development significantly reduced deployment risk. Continuous verification allowed defects to be identified and resolved before entering the final acceptance stages.
  • Early User Acceptance Improves Solution Quality Conducting structured User Acceptance Testing before final deployment ensured that business  expectations and technical implementation remained aligned. Early stakeholder feedback  improved overall usability and increased confidence in production readiness. 
  • Performance and Accessibility Must Progress Together Performance testing, accessibility validation, and security verification proved equally important in delivering a production-ready government platform. Addressing these quality attributes throughout the project reduced the need for significant rework during later phases. 
  • Standardized Data Improves Cross-Agency Collaboration Working with data from the National Center for Science and Engineering Statistics, the Bureau of Economic Analysis, the Bureau of Labor Statistics, the Census Bureau, and the National Center for Health Statistics highlighted the value of consistent metadata, standardized terminology, and well-defined integration interfaces. Standardization simplified chatbot responses and improved the quality of cross-agency data discovery. 
  • Agency Collaboration Strengthens Solution Adoption Regular collaboration with participating government agencies demonstrated that continuous stakeholder engagement improves requirement clarity and testing effectiveness. Agency feedback helped validate that the platform supports real-world research and policy analysis use cases while remaining aligned with federal expectations. 
  • A Strong Foundation Has Been Established for the Final Project Phase By the conclusion of the third quarter, the project has established a mature, stable, and well-tested solution ready for final refinement activities. The remaining quarter can now focus on user experience improvements, adoption planning, final validation, and successful project transition rather than major technical development. 

 

Click here to learn more about this project

Disclaimer: America’s DataHub Consortium (ADC), a public-private partnership, implements research opportunities that support the strategic objectives of the National Center for Science and Engineering Statistics (NCSES) within the U.S. National Science Foundation (NSF). These results document research funded through ADC and is being shared to inform interested parties of ongoing activities and to encourage further discussion. Any opinions, findings, conclusions, or recommendations expressed above do not necessarily reflect the views of NCSES or NSF. Please send questions to [email protected].