INT

Empowering Visualization

CONTACT US SUPPORT

OSDU

Microsoft and INT Deploy IVAAP for OSDU Data Platform on Microsoft Energy Data Services

This post was co-authored by Kadri Umay, Principal Program Manager, Microsoft.

Energy companies are currently going through a massive transformation by moving hundreds of applications to monitor, interpret, and administer their data into the cloud. In addition, they have embarked on adopting a common data standard, the OSDU™ Data Platform, to simplify interoperability between applications to facilitate data access, exchange, and collaboration.

With Microsoft Energy Data Services, energy companies can leverage new cloud-based advanced data visualization capabilities for geoscientists provided by INT and Microsoft Energy Data Services.

Microsoft Energy Data Services is a data platform fully supported by Microsoft, that enables efficient data management, standardization, liberation, and consumption in energy exploration. The solution is a hyperscale data ecosystem that leverages the capabilities of the OSDU Data Platform and Microsoft’s secure and trustworthy cloud services with our partners’ extensive domain expertise.

INT is proud to be among the early adopters who have been involved since the preview of Microsoft Energy Data Services. INT is a very active member of the OSDU Forum that offers IVAAP™, an advanced data visualization platform that allows geoscientists to easily access, interact with, and visualize data to create dashboards within Microsoft Azure, leveraging Microsoft Energy Data Services.

The IVAAP data visualization platform helps geoscientists and data scientists simplify their data work with the following features:

  • Access to the OSDU Data Platform is already supported (well, seismic, reservoir), and any other data sources from a single application in the cloud.
  • Full interoperability, which means data types aligned with the OSDU Data Platform can be extended to support custom formats and aggregate custom DDMS.
  • Intuitive, user-defined dashboards for engineers, geophysicists, and managers to visualize and interact with large datasets of well logs and seismic schematics, build data collections, and launch their machine learning—all from one place.
  • Many standard data connectors, powerful APIs, and SDKs that provide developers and architects ways to implement their own workflow easily.
  • Accelerated delivery of geoscience, drilling, and production cloud-enabled solutions with seamless support on Microsoft Azure.

“Providing a reliable, trusted platform as a service that accelerates the deployment of the OSDU Data Platform is key for any successful cloud transformation. Through the IVAAP platform’s integration with Microsoft Azure, customers will now have immediate access to these capabilities. This integration will simplify the access and provisioning of the massive amount of data generated by the energy industry, enabling impeccable and secure digital interactions. Our partnership with Microsoft in deploying Microsoft Energy Data Services is an important step toward our goal of providing reliable, cost-effective solutions for energy ISVs in the OSDU Data Platform.”

—Dr. Hughes Thevoux-Chabuel, VP Cloud Solutions, INT

Microsoft Energy Data Services is an enterprise-grade, fully managed OSDU Data Platform for the energy industry that is efficient, standardized, easy to deploy, and scalable for data management—ingesting, aggregating, storing, searching, and retrieving data. The offering will provide the scale, security, privacy, and compliance expected by our enterprise customers. The platform offers out-of-the-box compatibility with INT IVAAP, an advanced data visualization platform that allows geoscientists to easily access, interact with, and visualize the OSDU Data Platform to create dashboards with data contained in Microsoft Energy Data Services.

Learn more

Visit us online at int.com/ivaap for a preview of IVAAP or for a demo of INT’s other data visualization products. 

For more information, please visit www.int.com or contact us at intinfo@int.com.

 

An Inside Look at the New Release of the IVAAP Data Backend SDK

INT recently announced the release of IVAAP 2.9. We sat down with Thierry Danard, INT’s VP of Core Platform Technologies, for a quick chat about what this release includes for the Data Backend SDK.

 

Hi Thierry, what can you tell us about IVAAP 2.9 for the Data Backend?

There are a few low-level changes that won’t make it to the release notes, but that will make a difference for users. For example, we optimized the data caching mechanism. Instead of being based on the number of datasets, the data caches are now based on the size of these datasets. This typically means lower latency as more datasets tend to be cached within the same memory space. This is a feature we initially used only with WITSML wells that we have extended to other connectors and data types.

At a high level, we added a powerful “tiled images” feature. Some INT customers have large rasters that they need to visualize, or that their customers need to visualize as part of a portal. These images are stored as good old TIFF image files on a local file system or in the cloud. To visualize these images in IVAAP, you just need to point at the location of these tiles, and IVAAP does the rest. While the idea of visualizing images online might seem mundane, there is quite a lot of technology to make this happen.

First, these image files are LARGE. They can be up to 4 GB in TIFF format, and that’s a compressed format! To make the visualization of these images seamless, you need to be really good at:

  1. Downloading these files from the cloud, fast
  2. Reading these images in their native format
  3. Rendering these images as small tiles and sending these tiles to the viewer efficiently
  4. Stitching these images back together as one raster on the viewer side
  5. Caching these images long enough, but not too long
  6. Doing all this concurrently, for a large number of simultaneous users

That’s the technology side of it. From a business perspective, what’s really interesting is that there is no preprocessing of the images required. The ingestion workflow requires no specialized tooling. There’s no need to “precut” each TIFF as multiple tiles at multiple resolution levels. The “cutting” is all done on the fly and it’s seamless to end users. This is particularly important to keep storage to a minimum when you migrate your image library to the cloud. When each TIFF file takes gigabytes, a library of only a few thousand files already has a significant footprint, so you don’t want to expand that footprint with file duplication.

 

Is this image tiling feature something I could use for my own image storage?

Yes. The technology we developed makes abstraction of the storage mechanism possible. The reading, cutting, rendering, and caching are part of the IVAAP Data Backend SDK’s API. You can reuse these parts in your code.

 

What’s the purpose of this SDK, and how does it apply to images?

One of the strengths of IVAAP is that it allows the visualization of data from multiple data sources. For example, just for visualization of wells, IVAAP supports Peloton WellView, PPDM, WITSML, LAS files in the cloud, etc. These data sources typically share a common data model, but what’s different between them is the medium or protocol to access this data. The typical use case of the IVAAP Data Backend SDK is to facilitate the implementation of that access layer.

Images are treated as data. Just like we have “well” web services, we have “image” web services. The image web services are generic in nature—it’s the same service code running regardless of their underlying storage mechanism. It’s only the access code that differs. As a matter of fact, we implemented access to four types of image stores on top of our SDK:

  • Images stored locally on disk
  • Images stored in Amazon S3
  • Images stored in Microsoft Azure Blob Storage
  • Images stored in Google Cloud Storage

In this particular example, we used our own SDK to develop both the data layer and the web service layer.

 

Is the IVAAP Data Backend SDK a web framework?

While this SDK does provide an API to create your own web services, it goes well beyond that. If you call the IVAAP Data Backend SDK a framework, then it’s a highly specialized framework. And it’s not just a web framework, it’s also a data framework. Also, web frameworks tend to force you into a container. To scale your application, you are limited by the capabilities of this container. The IVAAP Data Backend SDK abstracts the container away, giving customers multiple options for how to deploy it and scale it.

From a technical perspective, a good SDK should empower developers. Often, this means requiring the least amount of effort to get the job done. From a business perspective, a good SDK should reduce development costs. Calling the IVAAP Data Backend SDK “yet another web framework” is missing the point of its value. Its value is not about doing the same thing as your favorite “other framework,” it’s about fitting your use case in the most effective way.

 

Then … how is the IVAAP Data Backend SDK a good fit?

Obviously, the integration with the rest of IVAAP is a strong benefit. You could write your data access object (DAO) layer using the API of your choice, but you would still need to write more mundane aspects, such as:

  • Exposing this data in a REST API, following the exact protocol that the IVAAP client expects. There would be hundreds of REST services to implement.
  • Integrating with services from the Admin server. For example, how users are identified, how to find out who has access to what, what are the datasets within a project, etc.

The second fit is that the SDK is designed to work with geoscience data. It integrates the data models of multiple data types, such as wells, seismic, surfaces … and raster images. While the IVAAP Data Backend SDK can be used outside of a geoscience context, a good portion of its API is geoscience-specific.

During design, we were particularly careful not to make any assumptions about how our customers’ geoscience data is stored. No matter how exotic your data systems might be, the IVAAP Data Backend will be able to access them. We are not just talking about storage, we are also talking about real-time feeds and machine learning (ML) workflows. We verified this multiple times. One particularly visible example is OSDU. INT has been on the leading edge of OSDU development, following the multiple iterations or flavors of OSDU services without requiring a change to our SDK.

 

How is the IVAAP Data Backend SDK effective?

Its API is quite simple to learn. Multiple INT customers have used this SDK to develop their own IVAAP customizations, and its API has always been well received. One aspect that is particularly liked is the lookup architecture. Plugging a class requires no XML, just one Java annotation, and it’s the same annotation used across the entire API. It’s an elegant mechanism, easy to learn, and even easier to use.

The real proof of the IVAAP Data Backend SDK’s effectiveness is the time it takes external developers to learn it and develop their own connector. We tested the effectiveness of the SDK by asking new hires to develop a connector, only armed with their knowledge of Java. Without any prior geoscience knowledge, the average time to get that connector up and running has been 2 weeks.

Another way that the backend keeps developers effective is by not taking away their favorite development tool. While the IVAAP Data Backend uses a powerful cluster architecture in production deployments, the typical developer’s day is with their favorite IDE (NetBeans, Eclipse, IntelliJ, etc.) and a well-known application server (Tomcat, Glassfish). Development is much faster when you don’t need to launch an entire cluster for a simple debugging session.

Effectiveness and fit are key. The goal of a typical framework is to help you get started faster. It provides a shortcut to skip the implementation of the mundane concerns of an application. In IVAAP’s case, for many customers, the application itself is already written. For these customers, the IVAAP Data Backend SDK helps you get finished faster instead. It provides customers with the API to finish the last mile of an IVAAP deployment, the access layer to their proprietary data store.

For more information or for a free demo of IVAAP, visit int.com/products/ivaap/.

INT Advances IVAAP as Universal Subsurface Cloud Viewer with Full OSDU™ Data Platform Support

Empower energy users’ experience by embedding advanced subsurface data visualization with your data science in your digital solutions.

INT, a leading provider of data visualization software, just announced the newest version of their universal subsurface visualization and analytics application platform, IVAAP™. Offering full OSDU Data Platform support, IVAAP 2.9 enables exploration, visualization, and computation of energy data. The new release also expands IVAAP’s map-based search, data discovery, and data selection with 3D seismic volume intersection, 2D seismic overlays, reservoir, and basemap widgets to visualize all energy data types in the cloud.

As an OSDU-native application, IVAAP can accelerate the integration between the OSDU Data Platform and other EDM platforms. For example, INT recently partnered with Halliburton Landmark to demonstrate the power of interoperability between systems — linking IVAAP to Landmark EDM through the OSDU Data Platform on AWS. 

A major new feature of IVAAP is its integration capabilities with processing or machine learning services. This new capability was added in response to many energy companies who had many algorithms and models in various programs — Python, TensorFlow, Jupyter notebooks, to name a few — spread across the organization and were faced with the challenge to share them and make them accessible in other apps. With this new capability, IVAAP accelerates workflow integration and simplifies Machine Learning Operations (MLOps). 

“We’ve been working to fully integrate new features in IVAAP that can streamline user workflows, reducing time to decision and empowering users with data visualization to help them to collaborate, make strong, accurate business decisions, and otherwise improve their ability to work with subsurface data for energy,” said Olivier Lhemann, president of INT. “With this release, we bring that full circle — users can now access their data using the power of the OSDU Data Platform, perform machine learning and processing models, and visualize the results.”

IVAAP’s workflow integration opens up a brand new user experience where now data scientists, modelers, geophysicists, and data managers can search data in the cloud, select data of interest, and launch computation from a single platform. IVAAP is providing new ways for operators, services, and energy technology software providers to enrich their digital solutions with powerful visualization and integration capabilities to OSDU Data Platform and machine learning for further automation. 

Learn more about IVAAP at int.com/ivaap.

For more information, please visit www.int.com or contact us at intinfo@int.com.

Intel OpenVino and IBM Red Hat Select IVAAP to Demonstrate the Power of New Hybrid Cloud OSDU Data Platform

This offering powers a unified environment to drive AI, accelerated data analytics, and high-performance computing (HPC) integrated with IVAAP Data Visualization platform.

IBM and Red Hat joined forces to deliver the only market-ready hybrid cloud implementation of the OSDU Data Platform. Additionally, Intel, IBM, and Red Hat are teaming up to deliver a fully hybrid cloud-to-edge OSDU-enabled industry offering to power a unified environment to drive AI, accelerated data analytics, and high-performance computing (HPC). By leveraging Intel’s AI-optimized Xeon Processors with the Intel Open Visual Inference and Neural Network Optimization (OpenVINO) toolkit, operators can benefit from Intel’s performance optimizations built for OpenShift and IBM Cloud Pak for Data.

The OpenVINO toolkit helps optimize computer vision inference models that use artificial intelligence and machine learning (AI/ML) on Intel platforms. It focuses on models that have already been trained, and applies capabilities learned after training a neural network to yield results. The Intel distribution of the OpenVINO toolkit enables the optimization, tuning, and running of comprehensive AI inference using the included model optimizer and runtime and
development tools.

Bringing to Life OSDU Seismic Interpretation Workflows from Intel/IBM Red Hat with IVAAP: A Demonstration on Salt and Fault Detection

Seismic interpretation—the tedious manual task of picking faults and horizons within sections to ultimately build an earth model that identifies proven hydrocarbons—is undergoing a fundamental shift. The application of AI/ML to uncover hidden patterns and correlations enables geoscientists to gain visibility into complex relationships between geologic features and seismic data. Because artificial neural networks learn by example and can solve problems with diverse, unstructured and interconnected data, deep learning (a subfield of ML) is an exciting technology for seismic interpretation.

As an example of the power of IBM Open Data for Industries, Intel and IBM have partnered with INT—a widely adopted oil and gas visualization software provider for more than 30 years—to deliver an end-to-end workflow using INT IVAAP for upstream data visualization.

IVAAP OpenSeismic salt dome formation

Thanks to its hybrid cloud foundations, this implementation of the OSDU Data Platform can easily be applied as a supervised deep learning approach to locating subsurface features, such as a salt dome. Deploying an optimized model generated from OpenVINO on the platform can accelerate the end-to-end seismic interpretation workflow.

In this example, the data was visualized using INT’s IVAAP to locate the seismic information by navigating through the IVAAP geospatial interface. Once the data is selected in the IVAAP project, it can easily be retrieved within the OSDU delivery API for use in a Jupyter Notebook where the OpenVINO libraries are available.

The seismic inference workflow integrates INT IVAAP visualization for the selection of a data and AI model, and integrates to an IBM Open Data for Industries instance within a Jupyter Notebook for inference processing. The inference results and statistics can be viewed within IVAAP visualization for quality inspection and analysis. This complete AI inference workflow—from the data and model elections up to display of inference results—can be easily leveraged to other data types and inference models. In addition, it can be extended through to additional subsurface inference workloads from data QC to interpretation and extrapolation. IVAAP can also be used to visualize facies characterization, data classification, log prediction, and more.

3D_seismic-dualscreen_small

The Power of Collaboration—and a Robust Visualization Solution—in the Cloud

As IBM, Red Hat, and Intel have shown, collaborations are key to driving success of the OSDU Data Platform—their shared goal is to make edge computing and connected hybrid clouds more secure, open, and flexible with complete interoperability.

To make the most of these interconnected functionalities, you need a robust, cloud-based front-end visualization that works with the OSDU platform to consume that data, launch and execute machine learning workflows, and visualize the results, all in one platform in the cloud.

To learn more about how IVAAP supports machine learning, visit int.com/solutions/machine-learning/ or to learn more about INT’s partnership with IBM, check out our press release.

INT to leverage IBM, Red Hat Open Technologies to Enhance Efficiencies in Oil & Gas Exploration and Drilling Workflows

The latest version of INT’s data visualization platform, IVAAP, integrates with IBM Open Data for Industries, IBM’s hybrid cloud implementation of the Open Group OSDU data.

HOUSTON, TX — April 15, 2021 — INT today announced that IVAAP — a leading enterprise subsurface data visualization platform — integrates with IBM Open Data for Industries for Cloud Pak for Data built on Red Hat OpenShift. These open technologies will enable the upstream industry to visualize exploration and drilling data across hybrid cloud environments to drive efficiencies and speed decision making.

As the oil and gas industry undergoes unparalleled transformation, members of the value chain are seeking solutions to maximize digital opportunities across their operations. Data is a critical asset and when leveraged with artificial intelligence, can yield mission-critical insights and competitive advantage.  However, quite often, domain-specific data exists in silos — limiting workflow efficiencies that leverage data insights for real-time decision-making.

Today’s announcement focuses on open technologies for the IVAAP platform that remove these barriers:

  • IVAAP leverages IBM Open Data for Industries for IBM Cloud Pak for Data, a data platform enabling seamless integration of data sources with the flexibility to deploy across any infrastructure that leverages The Open Group OSDU Forum data standard. The Open Group OSDU Forum is an industry organization that brings together technology leaders, producers and members of the oil and gas value chain to build a data foundation based on data standards making subsurface data easier to find, combine, and use across geoscience workflows.
  • IVAAP integrates with IBM Open Data for Industries for IBM Cloud Pak for Data powered by Red Hat OpenShift, the industry’s leading open source Kubernetes platform. This will enable INT customers to run IVAAP on-premise, unlocking speed and agility for local operations as well as remote locations through the cloud, yet all with one consistent architecture. This provides upstream operators greater value and flexibility for real-time operational decision-making, as well as consistency to the enterprise operations.

“We are extremely excited about the work we are engaging in with The Open Group OSDUTM Forum and our collaboration with IBM. For clients who manage hybrid cloud environments, our goal is to bring the technology to where they need it — in the cloud and in their locally hosted environment.”

— Olivier Lhemann, President of INT.

“Our collaboration with INT enables choice and flexibility in deploying subsurface data visualization across hybrid cloud environments. By leveraging IBM Open Data for Industries for IBM Cloud Pak for Data, INT and the oil and gas community can leverage an enterprise-grade, open-source platform based on the OSDU data foundation, improving access to subsurface data across any infrastructure, including public cloud, local country cloud and on-prem,” says Dariusz Piotrowski, Global Solutions Leader,
IBM Industrial Sector.

IVAAP is a sophisticated domain visualization and analytics platform that provides central access to data regardless of where it is — stored in the cloud and on-premise. Users can access, view, search, visualize, and analyze their subsurface data — wellbore, seismic, schematics, log, and more — in a web browser.

About INT:

INT software empowers the largest Oil & Gas (IOC/NOC) and services companies in the world to visualize their complex subsurface data (seismic, well log, reservoir, and schematics in 2D/3D). INT offers a visualization platform (IVAAP) and libraries (GeoToolkit) developers can use with their data ecosystem to deliver subsurface solutions (Exploration, Drilling, Production). INT’s powerful HTML5/JavaScript technology can be used for data aggregation, API services, high-performance visualization of G&G and petrophysical data in a browser. INT simplifies complex subsurface data visualization.

Read the press release on PRWeb.

For more information about IVAAP or INT’s other data visualization products, please visit https://www.int.com.

INT, the INT logo, and IVAAP are trademarks of Interactive Network Technologies, Inc., in the United States and/or other countries.

Red Hat, the Red Hat logo and OpenShift are trademarks or registered trademarks of Red Hat, Inc. or its subsidiaries in the U.S. and other countries.