NETL’s Energy Data eXchange (EDX), a virtual platform that provides public access to ongoing research sponsored by the Department of Energy’s (DOE) Office of Fossil Energy and Carbon Management (FECM), is migrating to a multi-cloud environment in March to improve accessibility and reliability while incorporating evolving artificial intelligence (AI) and machine learning (ML) capabilities.
NETL built EDX to support researchers and the use/re-use of data products. EDX also seamlessly integrates compliance with federal, DOE, and NETL standards for publication and data curation that includes support and tools for metadata, citations, discoverability, licensing, and accessibility. In 2022, the assistant secretary of FECM directed that all FECM-funded research be provided via EDX. In 2023, EDX Spatial was launched as a multi-cloud curated mapping platform for displaying research and development spatial data resources that are published on EDX.
EDX ensures discoverability on federated search engines and raises the visibility of data submissions. EDX supports the entire life cycle of data development, from initial research collaboration through publication of findings and final data release. EDX provides secure, private workspaces that include functions for data storage and sharing, notebooks and team chats for any NETL project collaborator.
“NETL’s expertise and experience in effective data management has helped establish EDX as an authoritative source for high-quality energy data and information,” NETL’s Jennifer Bauer explained.
The migration to a multi-cloud environment is in response to evolving needs of the energy research community and solves new challenges like providing access to larger datasets, faster throughput, secure collaboration, access to high-end computations and data visualization tools.
The imminent upgrade also supports the growing mission of NETL’s Science-based Artificial Intelligence and Machine Learning Institute (SAMI) Institute to use science-based models, AI and ML methods, data analytics, and high-performance computing to accelerate applied technology for clean, efficient and affordable energy production and use.
NETL’s Chad Rowan explained that “Robust application programming interfaces will connect the multi-cloud system to NETL resources like the Watt machine learning cluster and the Joule supercomputer to provide computing capabilities at the source of the data whether that be in the cloud or locally within NETL systems.”
Coupled with the multi-cloud capabilities, EDX custom tools will become more robust and flexible for the new era of data management.
EDX users will experience a temporary service disruption in support of migrating the EDX platform to the cloud starting at 8 p.m. EST, Friday, March 15, 2024. During this outage, EDX users will not be able to access EDX resources and all EDX related services. EDX users should plan on completing all data uploads by Thursday, March 14, 2024. EDX plans to resume normal operations at 7 a.m. EST, Monday, March 18, 2024.
Please reach out to EDX support if you have any questions or concerns at edxsupport@netl.doe.gov.
NETL is a U.S. Department of Energy national laboratory that drives innovation and delivers technological solutions for an environmentally sustainable and prosperous energy future. By using its world-class talent and research facilities, NETL is ensuring affordable, abundant, and reliable energy that drives a robust economy and national security, while developing technologies to manage carbon across the full life cycle, enabling environmental sustainability for all Americans.