Open Subsurface Data Universe (OSDU)

Last updated:
8:58am Nov 23, 2020

https://www.opengroup.org/osdu/forum-homepage

Access OSDU data today with TIBCO Spotfire

The Tibco Data Science team has an application under development that will allow you to access OSDU data, as it becomes available:

OSDU APIs       AWS Azure GCP
R1 Test Environment   Download Spotfire App Not available for R1 Not available for R1
R2 Test Environment   R2 Spotfire       Work Ongoing TBD 

Download your Spotfire app today and be ahead of the curve analyzing OSDU data.





Overview

TIBCO is a proud member of Open Group's Open Subsurface Data Universe™ Forum. The OSDU is developing a standard data platform for the oil and gas industry, which will reduce silos and put data at the center of the subsurface community.

The OSDU data platform will:

• Enable secure, reliable, global, and performant access to all subsurface and wells data

• Reduce current data silos to enable transformational workflows

• Accelerate the deployment of emerging digital solutions for better decision-making

• Create an open, standards-based ecosystem that drives innovation

This will revolutionize the industry’s ability to deliver new capabilities and reduce implementation and lifecycle costs across the subsurface community.

Official Brochure: PDF iconosdu_brochure_sept-web.pdf

Target

Data at the Center: All Subsurface and Wells Data Stored in a Single Data Platform

  • Multiple OSDU instances, acting as one, around the world addressing the latency distance limitations between 3D users and their applications/data:
    • When using 3D apps the maximum distance for reasonable performance is approximately 40 MSEC. This means for global Operators that they need multiple OSDU Platform implementations around the world. In this case Meta and Master data is replicated around the world and real data remains in the region it belongs
  • Data (structured/unstructured/real time) to be stored using standard data formats. We move away from proprietary formats and focus on formats that we can use more broadly
  • Extracting Metadata to ensure that all data in the OSDU Data Platform can be located using Search or latest Graph technologies: We should be able to do shallow and deep search
  • Master data ensuring that we have single set of definitions across OSDU and adjacent Data Platforms
  • Well defined set of APIs providing a standard way of accessing the data in the OSDU Data Platform. Make sure that all applications can use a single set of APIs to access all data sources in the OSDU platform

New Generation of Applications being Developed/Acquired:

  • Flexible orchestration of workflows
  • (Micro) Services driven
  • Kubernetes support: All micro services Kubernetes ‘’’driven’’
  • User Interface: HTML5 driven (including 3D support) and therefore support for any device such as tablets, phones, etc
  • Getting enabled for VR Collaboration support: Important for global cooperation
  • Both Physics and Data Driven applications: The latter category gets more and more important when thinking about Machine Learning, etc
  • Artificial Intelligence: Exploiting Machine Learning wherever possible
  • Support for existing apps: Often you have existing apps, based on MS Windows desktop/Linux desktop, and we have the opportunity to do an ‘’lift and shift’’ of these applications to the OSDU platform

Scope

Current Scope

  • Coverage: any organization with a need to store, manage or analyze subsurface and wells data
  • Portfolios: subsurface including exploration, development, and wells
  • Support for Data Driven (Artificial Intelligence) Applications: All data in one Data Platform will enable AI (such as Machine Learning) based applications to access this data

Current Problem Statement

  • Data is linked to applications: we are not data-driven but applications-driven and, therefore, we will have silos
  • Data is stored in silos: therefore, there is no lineage between data sources or from wells back to exploration
  • Metadata is not stored with the data: metadata is information about the data
  • Limited/no search capabilities: since we have no metadata, we have no real search capabilities
  • Data set-up: not suitable for data-driven applications

OSDU Scope

  • All public cloud-based: provides unlimited scalabilty
  • All data for the data platform services loaded via the data ingestion services: extract metadata, data quality, etc
  • Well-defined (RestFUL) APIs defining the access to the data platform services
  • Applications: (micro) services-based
  • Information security: covering all elements with focus on data security
  • In-country solution: for those countries where we are unable to move data out of the country and where there are no cloud services
  • Support for legacy applications based on Microsoft® Windows or Linux® desktop

Business Impact

The OSDU Forum will:

  • Publish a Reference Architecture: a cloud-native subsurface and wells data platform reference architecture with initial implementations by Microsoft® Azure and Amazon Web Services® and Google® GCP, with others expected
  • Define Application Standards to to ensure applications (microservices) developed by various parties, can run on the same OSDU data platform
  • Leverage Industry Data Standards for frictionless integration and data access

This will result in:

  • Reducing data silos: subsurface data integrated and accessible in one data platform
  • Workflows in the cloud: user workflows seamlessly executed across the OSDU platform, taking advantage of powerful cloud-native solutions
  • Access to all metadata: users will have access to powerful search capabilities
  • Competition and co-operation: software vendors, oil companies, academia, and open community projects can developsoftware on the OSDU data platform

Membership

Be a part of the future, become a member of OSDU today: https://www.opengroup.org/membership

For a full list of members, visit HERE

TIBCO Analytics

TIBCO Analytics is a comprehensive insight platform for visualization, modeling, streaming, data management, and model ops. The following software was showcased at TIBCO Analytics Forum 2019:

  • TIBCO Spotfire - The most comprehensive visual analytics platform on the market with built-in data wrangling, predictive modeling, and real-time analytics
  • TIBCO Data Science - Collaborative advanced analytics platform, helping Data Scientists model, deploy, and scale AI/ML solutions across their organization
  • TIBCO Streaming - Enterprise-grade, cloud-ready streaming analytics for quickly building real-time applications at a fraction of the cost and risk of alternatives
  • TIBCO Data Virtualization - Enterprise data virtualization solution that federates access across multiple and varied data sources
  • TIBCO EBX - Master Data Management to govern all your data assets in one solution including but not limited to: workflow, data quality, and role-specific applications
  • TIBCO ComputeDB - Distributed in-memory optimized analytics database, delivers high throughput, low latency, and high concurrency for unified analytic workloads

Acknowledgments & References:

Special thanks to the TIBCO Data Science team who are working on these analyses using Spotfire (Visual Analytics; Python): Michael O'ConnellVinoth Manamala, Andrew Berridge, Catalina Herrera.

 

             Michael O'Connell, Ph.D., is the chief analytics officer at TIBCO, where he helps clients with analytics software applications that drive business value. He has written a bunch of scientific papers and software packages on statistical methods. He also likes listening to electronic music; watching basketball, football and cricket; going to art galleries and walking around neighborhoods.
With a passion for data and analytics, Catalina Herrera is a Data Scientists at TIBCO and has spent her entire career helping industry push beyond digitization to business transformation. She’s held both educational and technical positions, worked with state-of-the-art technology solutions across multiple industry verticals, and served as a data scientist and a SaaS technology evangelist. Today she works with Fortune 100 companies and global technology leaders on digital transformation initiatives.
Vinoth Manamala is a Data Scientist at TIBCO, based in Toronto. He is passionate about solving complex industry problems using Big Data and machine learning. He brings his experience to his current role where he works with organizations to use their data assets to their fullest potential in support of their business operations. He is an avid sportsperson; plays cricket and badminton, and also loves to travel for nature and food.


Andrew Berridge is a Senior Staff Data Scientist at TIBCO. He specializes in extending, customizing and developing Spotfire and driving its future in all industries. He is the author of TIBCO Spotfire, A Comprehensive Primer 2nd Edition (Packt). He loves restoring classic cars and playing in orchestras in his spare time.