[doc] Use Rainbond deployment DolphinScheduler Cluster (#10951)
* [doc] Use Rainbond deployment DolphinScheduler Cluster Signed-off-by: Qi Zhang <smallqi1@163.com> * Update docs/docs/en/guide/installation/rainbond.md * Update docs/docs/en/guide/installation/rainbond.md * Update docs/docs/zh/guide/installation/rainbond.md * Update docs/docs/zh/guide/installation/rainbond.md * [doc] modify rainbond doc and add image Signed-off-by: Qi Zhang <smallqi1@163.com> * fix: img link Signed-off-by: Qi Zhang <smallqi1@163.com> * fix: modify proposal Signed-off-by: Qi Zhang <smallqi1@163.com> * docs: move rainbond docs to integration Signed-off-by: Qi Zhang <smallqi1@163.com> Signed-off-by: Qi Zhang <smallqi1@163.com> Co-authored-by: Jiajie Zhong <zhongjiajie955@gmail.com>
This commit is contained in:
Qi Zhang
GitHub
parent
c59a8503f4
commit
a4bdadbb84
|
|
@ -386,6 +386,15 @@ export default {
|
|||
title: 'Kubernetes Deployment',
|
||||
link: '/en-us/docs/dev/user_doc/guide/installation/kubernetes.html',
|
||||
},
|
||||
{
|
||||
title: 'integration',
|
||||
children: [
|
||||
{
|
||||
title: 'Rainbond Deployment',
|
||||
link: '/en-us/docs/dev/user_doc/guide/integration/rainbond.html',
|
||||
},
|
||||
],
|
||||
},
|
||||
],
|
||||
},
|
||||
{
|
||||
|
|
@ -965,6 +974,15 @@ export default {
|
|||
title: 'Kubernetes部署(Kubernetes)',
|
||||
link: '/zh-cn/docs/dev/user_doc/guide/installation/kubernetes.html',
|
||||
},
|
||||
{
|
||||
title: '集成',
|
||||
children: [
|
||||
{
|
||||
title: '基于Rainbond部署(Cluster)',
|
||||
link: '/zh-cn/docs/dev/user_doc/guide/integration/rainbond.html',
|
||||
},
|
||||
],
|
||||
},
|
||||
],
|
||||
},
|
||||
{
|
||||
|
|
|
|||
|
|
@ -0,0 +1,64 @@
|
|||
# Use Rainbond Deployment
|
||||
|
||||
This section describes the one-click deployment of high availability DolphinScheduler clusters through the [Rainbond](https://www.rainbond.com/) cloud native application management platform. This method is suitable for users who don't know much about complex technologies such as `Kubernetes`, lowering the threshold for deploying DolphinScheduler in `Kubernetes` mode.
|
||||
|
||||
## Prerequisites
|
||||
|
||||
* Available Rainbond cloud native application management platform is a prerequisite，please refer to the official `Rainbond` documentation [Rainbond Quick install](https://www.rainbond.com/docs/quick-start/quick-install)
|
||||
|
||||
## DolphinScheduler Cluster One-click Deployment
|
||||
|
||||
* Logging in and accessing the built-in open source app store, search the keyword `dolphinscheduler` to find the DolphinScheduler App.
|
||||
|
||||
|
||||
|
||||
* Click `install` on the right side of DolphinScheduler to go to the installation page. Fill in the corresponding information and click `OK` to start the installation. You will get automatically redirected to the application view.
|
||||
|
||||
| Select item | Description |
|
||||
| ------------ | ------------------------------------ |
|
||||
| Team name | user workspace，Isolate by namespace |
|
||||
| Cluster name | select kubernetes cluster |
|
||||
| Select app | select application |
|
||||
| app version | select DolphinScheduler version |
|
||||
|
||||
|
||||
|
||||
* Wait a few minutes, the installation completes and `DolphinScheduler` will be running.
|
||||
|
||||
|
||||
|
||||
* Access DolphinScheduler-API components and the default user credentials are `admin` / `dolphinscheduler123`.
|
||||
|
||||
|
||||
|
||||
## API Master Worker Node Telescopic
|
||||
|
||||
DolphinScheduler API、Master、Worker all support scaling multiple instances, ensuring the high availability of the entire service.
|
||||
|
||||
Take `worker` as an example: enter the `component -> Telescopic` page, and set the number of instances.
|
||||
|
||||
|
||||
|
||||
To verify `worker` node, enter `DolphinScheduler UI -> Monitoring -> Worker` page to view detailed node information.
|
||||
|
||||
|
||||
## Configuration file
|
||||
|
||||
API and Worker Services share the configuration file `/opt/dolphinscheduler/conf/common.properties`. To modify the configurations, you only need to modify that of the API service.
|
||||
|
||||
## How to support Python 3？
|
||||
|
||||
Worker service is installed with default `Python3`，you can add environment variables `PYTHON_HOME=/usr/bin/python3`
|
||||
|
||||
## How to support Hadoop, Spark, DataX ？
|
||||
|
||||
Take `DataX` as an example:
|
||||
|
||||
1. Install the plugin。Rainbond Team View -> Plugin -> Install plugin from the App Store -> search `initialization plugin` Install.
|
||||
2. Open plugin.enter Worker component -> plugin -> open `initialization plugin` and modify the configuration.
|
||||
* FILE_URL：http://datax-opensource.oss-cn-hangzhou.aliyuncs.com/datax.tar.gz
|
||||
* FILE_PATH：/opt/soft
|
||||
* LOCK_PATH：/opt/soft
|
||||
3. Update component, the plug-in `Datax` will be downloaded automatically and decompress to `/opt/soft`
|
||||
|
||||
---
|
||||
|
|
@ -0,0 +1,65 @@
|
|||
# 基于 Rainbond 部署 DolphinScheduler 高可用集群
|
||||
|
||||
本文描述通过 [Rainbond](https://www.rainbond.com/) 云原生应用管理平台 一键部署高可用的 DolphinScheduler 集群，这种方式适合给不太了解 Kubernetes、容器化等复杂技术的用户使用，降低了在 Kubernetes 中部署 DolphinScheduler 的门槛。
|
||||
|
||||
## 前提条件
|
||||
|
||||
* 可用的 Rainbond 云原生应用管理平台，请参阅文档 [Rainbond 快速安装](https://www.rainbond.com/docs/quick-start/quick-install)
|
||||
|
||||
## DolphinScheduler 集群一键部署
|
||||
|
||||
* 对接并访问内置的开源应用商店，搜索关键词 `dolphinscheduler` 即可找到 DolphinScheduler 应用。
|
||||
|
||||
|
||||
|
||||
* 点击 DolphinScheduler 右侧的 `安装` 进入安装页面，填写对应的信息，点击确定即可开始安装，自动跳转至应用视图。
|
||||
|
||||
| 选择项 | 说明 |
|
||||
| -------- | ------------------------------------------------------------ |
|
||||
| 团队名称 | 用户自建的工作空间，以命名空间隔离 |
|
||||
| 集群名称 | 选择 DolphinScheduler 被部署到哪一个 K8s 集群 |
|
||||
| 选择应用 | 选择 DolphinScheduler 被部署到哪一个应用，应用中包含有若干有关联的组件 |
|
||||
| 应用版本 | 选择 DolphinScheduler 的版本，目前可选版本为 3.0.0-beta2 |
|
||||
|
||||
|
||||
|
||||
* 等待几分钟后，DolphinScheduler 集群就会安装完成，并运行起来。
|
||||
|
||||
|
||||
|
||||
* 点击访问，将访问 DolphinScheduler-API 组件，默认的用户密码是`admin` / `dolphinscheduler123`
|
||||
|
||||
|
||||
|
||||
## API Master Worker 节点伸缩
|
||||
|
||||
DolphinScheduler API、Master、Worker 都支持伸缩多个实例，多个实例可以保证整个集群的高可用性。
|
||||
|
||||
以 Worker 为例，进入组件内 -> 伸缩，设置实例数量。
|
||||
|
||||
|
||||
|
||||
验证 Worker 节点，进入 DolphinScheduler UI -> 监控中心 -> Worker 查看节点信息。
|
||||
|
||||
|
||||
|
||||
## 配置文件
|
||||
|
||||
API 和 Worker 服务共用 `/opt/dolphinscheduler/conf/common.properties` ，修改配置时只需修改 API 服务的配置文件。
|
||||
|
||||
## 如何支持 Python 3？
|
||||
|
||||
Worker 服务默认安装了 Python3，使用时可以添加环境变量 `PYTHON_HOME=/usr/bin/python3`
|
||||
|
||||
## 如何支持 Hadoop, Spark, DataX 等？
|
||||
|
||||
以 Datax 为例：
|
||||
|
||||
1. 安装插件。Rainbond 团队视图 -> 插件 -> 从应用商店安装插件 -> 搜索 `通用数据初始化插件` 并安装。
|
||||
2. 开通插件。进入 Worker 组件内 -> 插件 -> 开通 `通用数据初始化插件` ，并修改配置
|
||||
* FILE_URL：http://datax-opensource.oss-cn-hangzhou.aliyuncs.com/datax.tar.gz
|
||||
* FILE_PATH：/opt/soft
|
||||
* LOCK_PATH：/opt/soft
|
||||
3. 更新组件，初始化插件会自动下载 `Datax` 并解压到 `/opt/soft`目录下。
|
||||
|
||||
---
|
||||
Binary file not shown.
|
After Width: | Height: | Size: 90 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 154 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 642 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 128 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 718 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 120 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 425 KiB |
Loading…
Reference in New Issue