Solutions

Integrations for data exchange between IT systems

We design data exchange between systems using ESB, ETL, and DWH so integrations are manageable and scalable.

Our clients

Clients and partners

Capital Group
FSK Group
SMLT
Tochno
Dogma
Sber City
FM Logistic
Danone
Relief Center
Pandora
Digital Systems and API Integration
Saint-Gobain
Askona
FIX PRICE
Snezhnaia Koroleva
Muztorg
TVOE
Greenway
Polaris
Campari
Yandex
Lenta
International perfume and cosmetics brand
Digital Systems and API Integration
RAEC
EKF
L'Etoile
Inventive Retail Group

Integrations

Change one system without rewriting the rest

The integration layer cures four ailments of rigid data exchange: data loss, cascading rework, source overload and inconsistency. ESB, Kafka and n8n solve different problems.

50flows in 6 months — a speed benchmark for an ESB project
48flows in production with a target loosely coupled architecture
16xfaster launch of standard integrations compared to code

ESB

Routing, transformation, guaranteed delivery and low-code support of legacy exchanges.

Kafka

Durable log: an event is stored, re-read, multiple consumers read at their own pace.

n8n

Fast orchestration of a process and AI steps where heavy event streaming isn't needed.

sourcedata contractESB/Kafka/n8nmonitoringconsumers

System integration is the structured exchange of data between CRM, ERP, 1C, warehouse, website, and marketplaces: it defines which system is the source for each entity, in what form it is transferred, how often it is sent, and what happens if one of the systems fails. API integration is one way to enable that exchange: a connection to a specific system's programmatic interface. The difference is practical: API answers the question of how to access the data, while system integration answers how the exchange is organized across the entire landscape.

APIs alone do not provide controlled exchange: as long as ETL logic and storage live inside the systems themselves, every new connection adds a dependency, and the failure of one service stops adjacent ones. We move transfer into a separate layer - ESB, ETL, and storage (DWH or Data Lake) - so the systems no longer need to know about each other, exchange becomes observable, and replacing one system does not trigger a cascade of changes in the others.

Below are the types of integration and when each is suitable, the exchange scheme through a bus and storage, our tool stack, and answers to common questions about system integration.

200+1C:Retail systems connected through a single API in one of the projects
48exchange flows launched on the ESB for a manufacturing enterprise
1–2 monthstypical project timeline under the risk-free model
>100 messages/minthroughput of a high-load flow without scaling the source

What we connect into a single IT ecosystem

Point-to-point exchange versus a data bus

Point-to-point exchange

  • When one system fails, data is lost: the source treats the message as delivered while the receiver never accepted it.
  • The source delivers data as is, and each consumer transforms it into its own format, so any change in the source triggers a cascade of edits.
  • Consumers duplicate requests to the source system and overload it; usually it is an old monolithic system.
  • API inside the source system: its downtime blocks all consumers at once.

ESB and storage

  • If the connection drops, the message is treated as unprocessed and delivered on the next pass.
  • A change to the ERP or another system affects only the source-to-warehouse connectors; nothing changes for the consumers.
  • Consumers query the repository, reducing the load on the source without system changes or additional resources.
  • API connectors are moved into a separate service: they run independently of the source and handle high load.

Integration types: point-to-point, broker, ESB, and iPaaS

The integration type determines not the speed of the first build, but the total cost of owning the environment. The difference between types is where the ETL functions and data storage sit relative to the systems: the closer they are to the systems themselves, the more the systems depend on each other.

Integration typeWhen it fitsWhat you pay withWhere it breaks down
"Point-to-point" - direct connection between two systemsTwo or three systems with simple logic: off-the-shelf API and connectors let you launch quicklyCheap at the start, but ETL and storage remain inside the systems themselves, and each new connection has to be added manuallyThe systems know too much about each other: if the source becomes unavailable, the consumer stops, and a new field in a record triggers a cascade of changes across all related integrations
Message broker - Kafka, RabbitMQ, and similar toolsEvent-driven exchange where it is important not to lose messages and to see delivery historyBroker infrastructure and agreement on a single format: the contract becomes fixed, and changing it is expensiveThe broker delivers the entire queue, the recipient takes extra data and filters it itself; after the broker is down, the source resends everything accumulated
Data bus (ESB) - a separate ETL and storage layerMany systems and data flows, with filtering for each consumer, load control, and independence between systemsArchitecture analysis and design before launch: most of the budget goes to preparation, not codeIt breaks because of wrong boundaries: if you move business logic into the intermediary layer, loose coupling turns back into a monolith
iPaaS - integration platform as a cloud serviceSaaS landscape and common scenarios where a visual builder and fast deployment are neededSubscription and vendor lock-in: the exchange logic and data live in the vendor's environmentIt runs into edge cases and data residency requirements; complex transformations still have to be described manually

A detailed comparison of the pros and cons of each type is in the article. How to choose an integration type. How the choice of type affects system coupling is explained in the article Integrations for a Loosely Coupled Architecture, and a comparison of specific products is in the review ESB solutions in the CIS market.

Four data-exchange tasks our approach solves

We eliminate data loss during exchange

With point-to-point exchange, data can be lost when one system fails: one system treats the message as delivered while the other never received it. We set up integrations so that if the connection drops, the message is treated as unprocessed and is delivered on the next pass.

We swap IT systems without touching the rest

In the old approach, any change in the source triggers a cascade of edits across all related flows. With us, a change in ERP or any other system affects only the source-to-storage connectors; for all consumers, everything stays unchanged.

We cut the load without rework or extra resources

Different systems need the same data, and consumers duplicate requests to the source, raising the load. Consumers query the storage instead, so load on the main source drops without reworking the system or adding resources.

API as a separate service

To connect many similar consumers, such as retail outlets, the API is often built inside the system, and its downtime becomes a problem for everyone. We build API connectors as a separate service rather than inside the application, so they work independently of the source and handle high load.

How exchange works via ESB and the warehouse

Sources → warehouse → consumers

Source systems

ERP / 1Cmaster data
CRMclients, deals
Marketplaces and websitesorders, products

Data bus (ESB) + storage

Source-to-warehouse connectorsindependent microservices
DWH / Data Lakeshared structured storage
Monitoring and loggingcontrol over every flow

Consumers

Retail and servicesvia API connectors
BI / analyticsreports from ready-made data
ESB components are independent of one another and can run on different servers in different locations. An exchange failure in any one system affects only that system — everything else keeps working.

Proven with 1C: any transformation logic is possible

With a ready data store, BI adoption becomes easier

By implementing ESB, we create a shared structured enterprise data repository: a Data Warehouse (DWH). Any analytics or reporting system can be connected to such a repository with ease because all data is already prepared. We design the repository architecture so that generating reports from large volumes of data does not reduce the speed of daily data exchange.

The monitoring system tracks every flow

  1. We log the key stages of each flow.

  2. If an error occurs that needs attention, you get a Telegram message describing the error with a link to the details.

  3. You respond to incidents proactively, not after users report them.

  4. The support operator knows exactly where and what went off script, which helps resolve the incident faster.

  5. We deploy a monitoring system from scratch or set up monitoring in your existing infrastructure.

Assess where AI can deliver impact in your process

A typical workflow

  1. 01

    Designing a loosely coupled architecture

    We analyze the current IT architecture (AS-IS), work through data exchanges for key entities, design the TO-BE architecture, and prepare a transition roadmap, tool recommendations and documentation. You get a transition plan tailored to your business.

  2. 02

    Migrating the most critical flows

    BPMN process diagrams, deployment and setup of components (ETL, storage, logging, monitoring), connector setup, log collection, documentation and training. This solves 80% of data-exchange problems between systems.

  3. 03

    Migrating the remaining flows to populate the storage

    BPMN process diagrams, connector setup, log and monitoring collection, documentation and training. You get a single enterprise-wide exchange mechanism and complete data for analytics.

We select proven open-source products

We use open-source solutions, so clients cut licensing costs with no risk of restrictions under different countries' laws. If you have preferences, we can also work with other products, including paid-license ones.

Tooling stack for data exchange

ETL

Talend (ETL)

Graphical low-code studio for building connectors, part of Salesforce. We use the Community Edition.

DevOps

GitLab

Open-source web tool for the DevOps lifecycle: version control and access rights (role) management.

Database

PostgreSQL

An open-source object-relational DBMS for data storage, under active development for more than 35 years.

Logs

Elastic Stack

Log storage, analysis, and search on the Elasticsearch platform for enterprise security and observability.

Monitoring

Grafana

Dashboards on flow status: out-of-the-box data visualization and analysis across a wide range of sources.

Stack

Choice of brokers and BI

ActiveMQ, RabbitMQ, Kafka; ETL - Ballerina, Nifi, Datareon, WSO2, MuleSoft; databases - MongoDB, Hadoop, Arenadata; BI - Yandex DataLens, Redash, Google Data Studio, Microsoft Power BI.

When you need your own web service instead of exchange between ready-made systems

Some tasks do not fit into any existing system: calculations, a partner portal, a public calculator. We build such services and connect them to the same integration environment.

Calculation services and calculators

Delivery cost, configurator, preliminary quote: the logic lives in a separate service and is called in the same way by the website, CRM, and customer account, without duplicating rules in each channel.

API for partners and external systems

We publish the contract (REST, GraphQL, or SOAP where required by the counterparty), protect it with authentication and limits, and document it. The partner integrates against the specification, not through email threads.

Portals and customer accounts

A client or contractor portal as a separate application on top of the operational system: requests, statuses, documents, without giving external users access to 1C or ERP.

We do not touch heavy systems

New logic is moved into a nearby service rather than built into ERP customizations. Platform updates stop being a risk to custom functionality.

Where to go next

Integration tools

What we use to build the exchange and which tasks each tool is suited for.

FAQ

Frequently asked questions about system integration

What is system integration, and how is it different from API integration?

System integration is the structured exchange of data between CRM, ERP, 1C, warehouse, website, and marketplaces: it defines which system is the source for each entity, in what form it is transferred, how often it is sent, and what happens if a system fails. API integration is one way to enable that exchange: a connection to a specific system's programmatic interface. API answers the question of how to access the data, while system integration answers how the exchange is organized across the entire landscape. APIs alone do not provide controlled exchange: without a separate transfer layer, every new connection adds a dependency between systems.

What types of integration exist, and how do you choose?

There are four main types: point-to-point, a message broker, an ESB data bus, and iPaaS. They differ in where the ETL functions and storage sit relative to the systems: in point-to-point, both are inside the systems themselves; with a broker, queue storage is moved outside; with an ESB, both the ETL layer and the storage layer are separated. The choice depends on the number of systems and flows, fault-tolerance requirements, and who will maintain the exchange after launch. A comparison across four criteria is in the table above; the full breakdown is in the article. How to choose an integration type.

How is ESB different from point-to-point and from a broker?

In point-to-point integration, systems exchange data directly and must know each other's format, speed, and availability. A broker externalizes message storage, but ETL logic remains on the system side, and the queue is delivered to the recipient as a whole, so the recipient has to filter it. ESB separates all three roles: the system generates and consumes data, the ETL layer passes it in the required form, and the storage layer stores it. As a result, the bus filters the stream for a specific consumer and controls the load on the source, while the failure of one system does not block the others. The comparison of the three types across five loose-coupling criteria is in the article Integrations for a Loosely Coupled Architecture.

What should you do if a system has no API?

The absence of an API does not block integration, but it changes the support cost. The selection order goes from the most reliable contract to the most fragile: an official API or webhook, then governed file exchange (CSV, XML, SFTP, email), then CLI or SDK, then a custom adapter, and only as a last resort browser automation for rare operations. The lower the level, the fewer guarantees the vendor provides and the more monitoring you need on your side. A breakdown of all levels with examples is in the article. Integration Without API: How to Connect a Closed System.

What determines the cost and timeline of an integration project?

Cost is determined by the number of connected systems, the number of entities in the exchange, whether ready-made access and a server are available, and the transfer mode: batch exchange is cheaper than real-time. The project moves in stages - analysis of the current architecture, design of the target scheme, migration of the most urgent flows, then the rest - and most of the budget goes not into code, but into analysis and design before launch. You can estimate the amounts for your own landscape in integration flow cost calculator; we define the deliverable, timeline, and cost in documents before work begins.

How do you avoid losing data during exchange?

Loss occurs when the source considers a message delivered but the recipient did not accept it, which is typical for direct point-to-point exchange. We design flows so that if the connection drops, the message remains unprocessed and is retried on the next pass, and the connector validates the system contract - data completeness and correctness - before sending it to the consumer. Key stages of each flow are logged: if an error requires action, a Telegram message is sent with a description and a link to details.

Material

Integration types comparison table

We assessed how three popular integration types affect IT landscape quality and compiled the result into a compact comparison table. Submit a request and get the file for free.

  • three integration types in one comparison
  • impact on IT landscape quality
  • free on request
Get the comparison table

Cases

Integration and ESB case studies

Read all

Testimonials

Client feedback on integration projects

All reviews

The KT.Team team is a mature development partner. The delivery process is very clearly organized, and the smooth collaboration within the engineering team deserves special mention. When the team sees that the development process needs fine-tuning, it does it. During discussions, the team digs into the essence of the tasks and seeks to understand the business context. The work is aimed not at formally fulfilling the specification but at solving the real problem. Thanks to strong engineering expertise and product thinking, the team can be trusted not only with implementation but also with the architecture of the entire system.

Digital Systems and API Integration Vadim MizhenskyHead of Digital Product Development, FSK Group

The Muztorg group of companies has been working successfully with the KT.Team team for more than two years. The high professionalism of our partners helps us a great deal, as does their ability to combine well-structured project management with minimal formal constraints. I would especially like to note the friendliness and openness of the KT.Team staff.

Digital Systems and API Integration Dmitry SavelievBoard Advisor on Digital Development, Muztorg

You set a high standard for working with contractors. After you, dealing with others leaves a feeling of falling short of expectations.

Digital Systems and API Integration Dmitry StolbovCEO, MechTech Ecosystem

We have been working with kt.team for more than a year, and in that time we have come a long way — from quickly launching a small website to an introductory catalog and several integrations. The team responded promptly to our requests and additions to the specification; together we tested several hypotheses and chose the ones that worked best. None of this prevented us from jointly creating a project with a modern design and functionality convenient both for users and for Maxxium employees.

Andrey IvanovHead of Digital Transformation Department, Maxxium

We came to KT.Team with a request to set up a platform to easily connect clients, carriers and WMS in FM Logistic France. The result was successively achieved, and by now we have onboarded a big client on the new platform — it's a great result! I'd like to especially note very good reactivity and professionalism of the project managers, devs and ops who always help us.

Eric DuboilleDirecteur Expertise E-Commerce, FM France SAS, FM Logistic

You know our business better than we do!

Digital Systems and API Integration Maxim ManhaevFounder, Taxi 369

Discuss the solution: Integrations for data exchange between…

Enter your email or phone number so we can get back to you.

Send via: