Hotel Distribution

Trio Data Engine – Doing the Heavy Lifting of API Data for Kibana

Illustration - Trio Data Engine - XML API Crane concept
Trio Data Engine doing the heavy lifting of API data for Kibana

Triometric

We’ve just launched Trio Data Engine, a more agnostic way of collecting, preparing and aggregating API transaction data for extracting intelligence and insights using other BI environments including popular open source tools such as Kibana. To find out more about this powerful data processing hub and how it can benefit our data driven customers, I spoke to Jonathan Boffey, our VP of Business Development and one of the architects behind this new approach to helping customers get value from their data.

By way of a bit of background, Triometric has been working closely over a number of years with many B2B travel distributors to give them detailed real-time visibility into their potentially billions of API search and book transactions. We capture API data, transform it, analyse it and report on it via dashboards and reports. Such insights are invaluable for managing product supply and demand, system performance, customer search and buying behaviour and so on.

What is the Trio Data Engine?

The new Trio Data Engine offers a componentised approach to the delivery of value-added XML data.  It is used as a heavy duty processing hub to take XML data inputs from various sources, transform them according to set business rules, then push or pipeline the results to the consuming system. Simply put, enterprises can exploit the power of Triometric’s high volume XML collection and processing capability to surgically process the XML data they need to feed their existing reporting analytic systems.

How did Trio Data Engine come about?

Our industry experience tells us that we have a unique and very powerful XML data preparation capability, but there are other technologies in play that we need to interface with. Our market observations tells us that more and more enterprises are looking for and implementing Big Data environments, either using commercial products or  open-source products such as the Elasticsearch, Logstash, and Kibana (ELK) stack.

In the latter case, while Elasticsearch is a search specialised data store and Kibana is a popular visualisation layer, Logstash is aimed at web and system logs rather the more complex structured data like XML. Handling complex XML data, indexing it and enriching and aggregating it in line with company business rules is what we do best. It’s our core business and at last count, our systems globally process over 3 billion hits per day.

In working with a large big bed bank customer recently, we were able to demonstrate that our XML analytic technology proved to be the ideal platform to act as the processing hub for collecting and preparing large volumes of raw real-time XML data and transforming it into a fit state for feeding into Elasticsearch ahead of final analysis and visualisation with Kibana, which was the business users’ chosen reporting technology. It is a classic coming together of respective company strengths making a formidable integrated solution to tackle the complexity of getting access to XML data and then being able to use it to get to the deep insights that can drive decisions.

Why is the Trio Data Engine needed?

There are three simple reasons why the Trio Data Engine delivers value to enterprises that are investing to become data-informed and data-driven: access, complexity, scale.

  • Access

In addition to widening the scope of interactive user reporting, the Trio Data Engine helps travel companies get fast reliable access from multiple sources to large volumes of clean and aggregated data for historic analysis and feeding into AI systems for more prescriptive analysis. In other words to help travel companies analyse in great detail their API data in much the same way as they already analyse their website data.

  • Complexity

To add to the complexity, distributors inherently deal with a large number of variables within the context of the traveller and the trip. The Trio Data Engine applies our expertise in preparing, enriching and aggregating XML and getting it in shape for a wide range of BI tools including our own reporter. Many enterprises including travel ones are utilising Open-source Big Data technologies such as the ELK stack as the core for their data analytics program. However, very often, the challenge for such Open-source projects is the transformation from an exploratory IT project to a real enterprise-grade solution with a wider scope of data inputs. The Trio Engine takes away the complexity of preparing XML or JSON for this organisations with this type of transaction stream.

  • Scale
    Today’s organisations ideally want to be able to analyse all of the data all of the time and have that information available quickly.  Travel APIs produce not only complex data but in very large quantities. When you have time-sensitive processing tasks, doing those tasks faster than the competition is important. Trio Data Engine is designed to handle high volumes of data traffic quickly and at scale. Simply put the Trio Data Engine can take raw data and transform it for analysis for billions of transactions per day.

What gap in the market is it filing?

Much of today’s travel business is still booked via indirect channels linked by a network of APIs. Millions of search requests and replies, bookings and cancellations pass through these APIs every hour of every day. By analysing this message stream in real-time travel companies can get answers to a raft of questions such as what are customers looking and are they getting what they requested. Is inventory availability keeping up with demand or conversely not selling as pre-contracted. How can pricing be managed to impact positive revenue flow, and so on.

The best insights are generated not from answering one question but from answering a set of connected questions. Answering these connected questions often requires companies to use a connected set of data sources. This requires companies to look not at one source of data but at variety of sources and build a bigger picture from a single analytics engine and interface. The Trio Engine and its ability to give access to high volumes of search and booking data is one of those contributing sources that can help travel companies get deep meaningful insights and a 360 degree view of their customers, distribution channels, markets and more.

Read our Travel Analytics Blog for more articles like these.



Logos, product and company names mentioned are the property of their respective owners.