seaweedfs kubernetes operator
Go to file
Chris Lu 91b6927e12 go mod download cloud.google.com/go/storage 2021-11-03 02:03:53 -07:00
.github/workflows Create main.yml 2021-05-06 11:04:02 -07:00
api/v1 add ingress for volume servers 2020-11-10 00:11:17 -08:00
config update go mod 2021-11-03 01:59:34 -07:00
controllers update to use latest grpc API 2021-11-03 01:38:38 -07:00
hack Add verify codegen and manifests 2020-10-30 05:15:18 +00:00
.gitignore aux files 2020-07-26 14:50:48 -07:00
.travis.yml Create .travis.yml 2021-06-09 12:22:10 -07:00
Dockerfile simple change to test travis build 2021-06-09 12:32:27 -07:00
LICENSE added apache 2.0 license 2021-10-20 11:33:21 -07:00
Makefile Add preserveUnknownFields to false 2021-09-15 12:49:33 +02:00
PROJECT Add instructions for end-user deployment 2020-11-15 11:18:19 +08:00
README.md Update README.md 2021-07-15 14:01:14 -07:00
go.mod update go mod 2021-11-03 01:59:34 -07:00
go.sum go mod download cloud.google.com/go/storage 2021-11-03 02:03:53 -07:00
main.go detect ENABLE_WEBHOOKS!=false 2020-11-03 20:24:19 -08:00
seaweedfs-operator.iml Update seaweedfs-operator.iml 2021-02-25 08:25:10 -08:00

README.md

Build Status

SeaweedFS Operator

This Kubernetes Operator is made to easily deploy SeaweedFS onto your Kubernetes-Cluster.

The difference to seaweedfs-csi-driver is that the infrastructure (SeaweedFS) itself runs on Kubernetes as well (Master, Filer, Volume-Servers) and can as such easily scale with it as you need. It is also by far more resilent to failures then a simple systemD service in regards to handling crashing services or accidental deletes.

By using make deploy it will deploy a Resource of type 'Seaweed' onto your current kubectl $KUBECONFIG target (the operator itself) which by default will do nothing unless you configurate it (see examples in config/samples/).

Goals:

  • Automatically deploy and manage a SeaweedFS cluster.
  • Ability to be managed by other Operators.
  • Compability with seaweedfs-csi-driver
  • Auto rolling upgrade and restart.
  • Ingress for volume server, filer and S3, to support HDFS, REST filer, S3 API and cross-cluster replication.
  • Support all major cloud Kubernetes: AWS, Google, Azure.
  • Scheduled backup to cloud storage: S3, Google Cloud Storage , Azure.
  • Put warm data to cloud storage tier: S3, Google Cloud Storage , Azure.
  • Grafana dashboard.

Installation

This operator uses kustomize to deploy. The installation process will install one for you if you do not have one.

By default, the defaulting and validation webhooks are disabled. We strongly recommend that the webhooks be enabled.

First clone the repository:

$ git clone https://github.com/seaweedfs/seaweedfs-operator --depth=1

To deploy the operator with webhooks enabled, make sure you have installed the cert-manager(Installation docs: https://cert-manager.io/docs/installation/) in your cluster, then follow the instructions in the config/default/kustomization.yaml file to uncomment the components you need.

Lastly, change the value of ENABLE_WEBHOOKS to "true" in config/manager/manager.yaml

Afterwards fire up:

$ make install

Then run the command to deploy the operator into your cluster:

$ make deploy

Verify if it was correctly deployed with:

$ kubectl get pods --all-namespaces

Which may return:

NAMESPACE                   NAME                                                     READY   STATUS    RESTARTS   AGE
kube-system                 coredns-f9fd979d6-68p4c                                  1/1     Running   0          34m
kube-system                 coredns-f9fd979d6-x992t                                  1/1     Running   0          34m
kube-system                 etcd-kind-control-plane                                  1/1     Running   0          34m
kube-system                 kindnet-rp7wr                                            1/1     Running   0          34m
kube-system                 kube-apiserver-kind-control-plane                        1/1     Running   0          34m
kube-system                 kube-controller-manager-kind-control-plane               1/1     Running   0          34m
kube-system                 kube-proxy-dqfg2                                         1/1     Running   0          34m
kube-system                 kube-scheduler-kind-control-plane                        1/1     Running   0          34m
local-path-storage          local-path-provisioner-78776bfc44-7zvxx                  1/1     Running   0          34m
seaweedfs-operator-system   seaweedfs-operator-controller-manager-54cc768f4c-cwz2k   2/2     Running   0          34m

See the next section for example usage - at this point you only deployed the Operator itself!

You need to also deploy an configuration to get it running (see next section)!

Configuration Examples

apiVersion: seaweed.seaweedfs.com/v1
kind: Seaweed
metadata:
  name: seaweed1
  namespace: default
spec:
  # Add fields here
  image: chrislusf/seaweedfs:2.54
  volumeServerDiskCount: 1
  hostSuffix: seaweed.abcdefg.com
  master:
    replicas: 3
    volumeSizeLimitMB: 1024
  volume:
    replicas: 1
    requests:
      storage: 2Gi
  filer:
    replicas: 2
    config: |
      [leveldb2]
      enabled = true
      dir = "/data/filerldb2"

Maintenance and Uninstallation

  • TBD

Development

Follow the instructions in https://sdk.operatorframework.io/docs/building-operators/golang/quickstart/

$ git clone https://github.com/seaweedfs/seaweedfs-operator
$ cd seaweedfs-operator

# register the CRD with the Kubernetes
$ make deploy

# build the operator image
$ make docker-build

# load the image into Kind cluster
$ kind load docker-image chrislusf/seaweedfs-operator:v0.0.1

# From another terminal in the same directory
$ kubectl apply -f config/samples/seaweed_v1_seaweed.yaml

Update the operator

# delete the existing operator
$ kubectl delete namespace seaweedfs-operator-system

# rebuild the operator image
$ make docker-build

# load the image into Kind cluster
$ kind load docker-image chrislusf/seaweedfs-operator:v0.0.1

# register the CRD with the Kubernetes
$ make deploy

develop outside of k8s

$ git clone https://github.com/seaweedfs/seaweedfs-operator
$ cd seaweedfs-operator

# register the CRD with the Kubernetes
$ make install

# run the operator locally outside the Kubernetes cluster
$ make run ENABLE_WEBHOOKS=false 

# From another terminal in the same directory
$ kubectl apply -f config/samples/seaweed_v1_seaweed.yaml