202 Unstar Star 660 Fork 280

GVPsxfad / porter

Create your Gitee Account
Explore and code with more than 5 million developers,Free private repositories !:)
Sign up
This repository doesn't specify license. Without author's permission, this code is only for learning and cannot be used for other purposes.
Clone or download
Cancel
Notice: Creating folder will generate an empty file .keep, because not support in Git
Loading...
README_EN.md

Porter | 中文

GitHub release License

Abstract

Porter began in 2017 and provides data synchronization, but it's not just limited to data synchronization, it's widely used within the Suixingpay. Mainly provide the following features:

  • Database real-time synchronization
  • Database migrate
  • Database governance
  • Custom source and target data synchronization
  • Custom data extraction logic

Core features

  • Native support Oracle|Mysql to Jdbc relational database final consistent synchronization
  • Plugin friendly, Support for custom source consumer plugins, target loading plugins, and alarm plugins for secondary development.
  • Support for custom source, target table, field mapping
  • Support configuration file based node synchronization task configuration.
  • Support management of background synchronization task push, node, task management. Provides task running indicator monitoring, node running logs, and task abnormal alarms.
  • Support node resource limit and allocation.
  • A distributed architecture based on the Zookeeper cluster plugin. Support for custom cluster plugins.

Quick start

Compile from source

git clone https://github.com/sxfad/porter.git
cd porter
git checkout version
gradle build
Find the installation package from the build/distributions list

Configuration

configuration document

porter.id=unique id
#cluser
porter.cluster.strategy=ZOOKEEPER
porter.cluster.client.url=127.0.0.1:2181
porter.cluster.client.sessionTimeout=100000

#stastistics
porter.cluster.statistic.sourceType=KAFKA_PRODUCE
porter.cluster.statistic.servers=127.0.0.1:9200
porter.cluster.statistic.topic=your kafka topic

#standalone
porter.cluster.strategy=STANDALONE
porter.cluster.client.home=./.porter

Run

tar zxvf build/distributions/porter-boot-version.tar
porter-boot-version/bin/porter-boot

Debug

porter-boot-version/bin/porter-boot  debug port

Operating environment

porter-boot-version/bin/porter-boot --spring.profiles.active=Operating environment

Elegant close

porter-boot-version/bin/shutdown.sh

Document

Architecture

architecture_design dataflow

Screenshot

Home

	manager-boot default website: http://127.0.0.1:8081
	manager-boot default account: admin admin

Contact Us

  • QQ group:835209101

Comments ( 32 )

Sign in for post a comment

About

Porter是一款数据同步中间件,主要用于解决同构/异构数据库之间的表级别数据同步问题. spread retract
Cancel

Releases (5)

All

Gitee Metrics

Contributors

All

Activities

load more
can not load any more
Java
1
https://git.oschina.net/sxfad/porter.git
git@git.oschina.net:sxfad/porter.git
sxfad
porter
porter
master

Search

132457 8cb2edc1 1899542 131848 70c8d3a4 1899542