Skip to content
forked from apache/seatunnel

SeaTunnel is a distributed, high-performance data integration platform for the synchronization and transformation of massive data (offline & real-time).

License

Notifications You must be signed in to change notification settings

FuYouJ/seatunnel

This branch is 22 commits ahead of, 448 commits behind apache/seatunnel:dev.

Folders and files

NameName
Last commit message
Last commit date
Aug 30, 2024
Mar 11, 2024
Feb 28, 2022
Aug 21, 2024
Sep 2, 2024
Sep 3, 2024
Jun 6, 2023
Sep 3, 2024
Aug 24, 2024
May 11, 2024
Sep 3, 2024
Sep 2, 2024
Aug 30, 2024
Sep 3, 2024
Sep 2, 2024
Aug 29, 2024
Aug 28, 2024
Aug 12, 2024
Jul 20, 2024
Sep 3, 2024
Aug 28, 2024
Aug 28, 2024
Aug 14, 2024
Dec 16, 2023
Aug 4, 2023
Oct 25, 2023
Nov 10, 2022
Jul 8, 2024
Jul 8, 2024
Jul 19, 2024
Aug 22, 2024
Feb 28, 2022
Feb 28, 2022
Sep 3, 2024
Aug 27, 2024
Sep 2, 2024

Repository files navigation

Apache SeaTunnel

SeaTunnel Logo

Build Workflow Join Slack Twitter Follow

Table of Contents

Overview

SeaTunnel is a next-generation, high-performance, distributed data integration tool, capable of synchronizing vast amounts of data daily. It's trusted by numerous companies for its efficiency and stability.

Why Choose SeaTunnel

SeaTunnel addresses common data integration challenges:

  • Diverse Data Sources: Seamlessly integrates with hundreds of evolving data sources.

  • Complex Synchronization Scenarios: Supports various synchronization methods, including real-time, CDC, and full database synchronization.

  • Resource Efficiency: Minimizes computing resources and JDBC connections for real-time synchronization.

  • Quality and Monitoring: Provides data quality and monitoring to prevent data loss or duplication.

Key Features

  • Diverse Connectors: Offers support for over 100 connectors, with ongoing expansion.

  • Batch-Stream Integration: Easily adaptable connectors simplify data integration management.

  • Distributed Snapshot Algorithm: Ensures data consistency across synchronized data.

  • Multi-Engine Support: Works with SeaTunnel Zeta Engine, Flink, and Spark.

  • JDBC Multiplexing and Log Parsing: Efficiently synchronizes multi-tables and databases.

  • High Throughput and Low Latency: Provides high-throughput data synchronization with low latency.

  • Real-Time Monitoring: Offers detailed insights during synchronization.

  • Two Job Development Methods: Supports coding and visual job management with the SeaTunnel Web Project.

SeaTunnel Workflow

SeaTunnel Workflow

Configure jobs, select execution engines, and parallelize data using Source Connectors. Easily develop and extend connectors to meet your needs.

Supported Connectors

Getting Started

Download SeaTunnel from the Official Website.

Choose your runtime execution engine:

Use Cases

Explore real-world use cases of SeaTunnel, such as Weibo, Tencent Cloud, Sina, Sogou, and Yonghui Superstores. More use cases can be found on the SeaTunnel Blog.

Code of Conduct

Participate in this project in accordance with the Contributor Covenant Code of Conduct.

Contributors

We appreciate all developers for their contributions. See the List Of Contributors.

How to Compile

Refer to this Setup for compilation instructions.

Contact Us

Landscapes

SeaTunnel enriches the CNCF CLOUD NATIVE Landscape.

Apache SeaTunnel Web Project

SeaTunnel Web is a web project that provides visual management of jobs, scheduling, running and monitoring capabilities. It is developed based on the SeaTunnel Connector API and the SeaTunnel Zeta Engine. It is a web project that can be deployed independently. It is also a sub-project of SeaTunnel. For more information, please refer to SeaTunnel Web

Our Users

Companies and organizations worldwide use SeaTunnel for research, production, and commercial products. Visit our Users for more information.

License

Apache 2.0 License

Frequently Asked Questions

1. How do I install SeaTunnel?

Follow the Installation Guide on our website to get started.

2. How can I contribute to SeaTunnel?

We welcome contributions! Please refer to our Contribution Guidelines for details.

3. How do I report issues or request features?

You can report issues or request features on our GitHub Repository.

4. Can I use SeaTunnel for commercial purposes?

Yes, SeaTunnel is available under the Apache 2.0 License, allowing commercial use.

5. Where can I find documentation and tutorials?

Our Official Documentation includes detailed guides and tutorials to help you get started.

7. Is there a community or support channel?

Join our Slack community for support and discussions: SeaTunnel Slack.

About

SeaTunnel is a distributed, high-performance data integration platform for the synchronization and transformation of massive data (offline & real-time).

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 99.0%
  • TypeScript 0.5%
  • Shell 0.2%
  • Batchfile 0.1%
  • Python 0.1%
  • JavaScript 0.1%