Talend implementation cases in enterprise projects: global experience

‍

Modernization of the banking system by integrating the ESB service bus (BANKING SECTOR)

About the company

Landesbank is a German international universal bank that provides services in four areas: private banking (VIP personal banking), corporate banking, commercial real estate financing and selective capital market activities. The bank annually serves about two million retail customers and about 69,000 corporate clients from more than 200 branches in Berlin.

Problem: obsolescence of the bank's IT system

To cope with the ever-increasing volume of account data, Landesbank has decided to upgrade its core banking system. However, the introduction of the new system required thorough preliminary preparation, and if the transition attempt failed, there was a risk of closing the bank.

Landesbank is a member of the German group of national savings banks, and its business processes are closely linked to the central information technology provider Finanz Informatik (abbreviated. FI), which uses a modern banking system — OSplus. The difficulty of updating the system was also due to the fact that in order to integrate our own banking applications with data on Landesbank customers, addresses, income and accounts, it was necessary to create a new interface in parallel with the deployment of OSplus.

It was also necessary to take into account that incoming data comes in different formats, and for their further transfer to specialists from different departments, each accepting documents in its own format, it was necessary to convert this data into the requested formats. The previous integration platform used by the bank could not process a large data stream, and the transition to the new system required several stages, which only increased the time.

Solution

Talend ESB integration has helped optimize information transfer processes. Now, when a business process is launched in the OSplus banking system, data is transferred to other applications via the Talend ESB service bus. Most interfaces are programmed to work according to events, and only a few are “scheduled” in advance.

To ensure the transparency of processes within the company, a special TMF portal was created on the basis of Talend ESB (short from English. Tools & Methods Framework), which monitors error management.

Simplifying integrations in the online store infrastructure using ESB (E-COMMERCE)

About the company

Otto Group is a German online store, Europe's largest mail order store with more than 2.8 million items and 6,800 clothing brands for the whole family. It processes about 7 million online orders annually and up to ten new orders per second on peak days.

Problem: the complexity of the project's IT landscape

The existing IT architecture of the online store consisted of a Teradata database and a large number of data islands. The complexity of the architecture was also that some data islands used SQL, while others used PL/SQL, Oracle, and Perl scripts. Thus, to determine which advertising offer would be most suitable for customers, the company had to transform huge amounts of data, and the information system needed a single integration tool.

In addition, the project had a lot of integration scripts that were very difficult to maintain,
because the developers who originally wrote the code were no longer on staff.

Solution

Otto decided to create a new data lake from scratch and use Talend as a bridge between the new data lake, which stores data from its online store and partner websites, and the Exasol 250 TB database.

Talend software also made it possible to use our own CI/CD process in development. The use of Talend made it possible to continuously integrate data sources, develop and deliver new updates and applications, and create test environments for launching new software. All this helped to increase the speed of development and the speed of fixing problems on the project and, in general, helped reduce the risks associated with new development and integrations.

Thus, if the system receives a request from a customer to delete their data from the Otto system, this does not take much time, since there is no longer any need for lengthy searches through all databases. Talend made it possible to quickly share data with their sources, making it easier to delete data from Exasol and the Cloudera data lake.

Process automation, processing and storage of all data in a single system using the ESB enterprise service bus (PHARMACEUTICAL INDUSTRY)

About the company

Bayer AG is a German chemical and pharmaceutical multinational corporation with more than 150 years of history and key competence in the field of healthcare in the world.

Problem: outdated information system with manual data processing

Bayer is constantly researching and testing new drugs to determine their efficacy and safety for further market launch. This process requires the accumulation, analysis and storage of a huge amount of clinical data from patients and volunteers. Data is also collected from laboratories and electronic devices. All information is automatically anonymized at the point of collection.

The old information system was outdated and could not cope with the load and the constantly growing data flow. Moreover, some processes were not automated, operations were processed manually, which often led to errors caused by human factors.

Solution

Instead of supporting the old system, Bayer decided to completely change the environment and infrastructure architecture. Bayer held a hackathon, during which it thoroughly tested Talend and came to the conclusion that it was best suited for continuous improvement of the system, given its principles of flexibility and the ability to support a microservice architecture.

The Talend ESB bus has become a middleware that connects repositories while being hidden from users' eyes. The data enters Oracle's local data lake, connects to the SAS system for advanced analytics and uses Oracle Life Sciences Data Hub to store data on clinical trials of drugs and drugs.

The Talend ESB service bus made it possible to quickly and in accordance with requirements add new functions, make the received data better and increase the speed of its processing. Another advantage of Talend for the company is the ability to track everything that happens to data, including where it comes from and where it is sent.