GitHub - MTSWebServices/syncmaster: No-code ETL tool, based on onETL + PySpark · GitHub

Name		Name	Last commit message	Last commit date
.github		.github
docker		docker
mddocs		mddocs
syncmaster		syncmaster
tests		tests
.dockerignore		.dockerignore
.env.docker.test		.env.docker.test
.env.local.test		.env.local.test
.gitignore		.gitignore
.gitlab-ci.yml		.gitlab-ci.yml
.pre-commit-config.yaml		.pre-commit-config.yaml
.readthedocs.yaml		.readthedocs.yaml
.spdx-license-header.txt		.spdx-license-header.txt
CONTRIBUTING.rst		CONTRIBUTING.rst
LICENSE.txt		LICENSE.txt
Makefile		Makefile
README.rst		README.rst
SECURITY.rst		SECURITY.rst
config.docker.yml		config.docker.yml
config.yml		config.yml
docker-compose.test.yml		docker-compose.test.yml
docker-compose.yml		docker-compose.yml
pyproject.toml		pyproject.toml
uv.lock		uv.lock

仓库 files navigation

What is Data.SyncMaster?

Data.SyncMaster is as no-code ETL tool for transferring data between databases and file systems. List of currently supported connections:

Apache Hive
Clickhouse
Iceberg (REST Catalog + S3)
MSSQL
MySQL
Oracle
Postgres
FTP
FTPS
HDFS
S3
Samba
SFTP
WebDAV

Based on onETL and Apache Spark.

Goals

Make transferring data between databases and file systems as simple as possible
Provide a lot of builtin connectors to transfer data in heterogeneous environment
RBAC and multitenancy support

Non-goals

No streaming support for now, only batch operations
This is not a change data capture (CDC) solution

Documentation

See https://syncmaster.readthedocs.io

关于

No-code ETL tool, based on onETL + PySpark

etl no-code spark transfer-data

Apache-2.0 license

Custom properties

Report repository

发布

Used by

贡献者

Languages