Use PorterLB in BGP Mode

This document demonstrates how to use PorterLB in BGP mode to expose a Service backed by two Pods. The BgpConf, BgpPeer, Eip, Deployment and Service described in this document are examples only and you need to customize the commands and YAML configurations based on your requirements.

Instead of using a real router, this document uses a Linux server with BIRD to simulate a router so that users without a real router can also use PorterLB in BGP mode for tests.

Prerequisites

• You need to prepare a Kubernetes cluster where PorterLB has been installed.
• You need to prepare a Linux server that communicates with the Kubernetes cluster properly. BIRD will be installed on the server to simulate a BGP router.
• If you use a real router instead of BIRD, the router must support BGP and Equal-Cost Multi-Path (ECMP) routing. In addition, the router must also support receiving multiple equivalent routes from the same neighbor.

This document uses the following devices as an example:

Step 1: Install and Configure BIRD

If you use a real router, you can skip this step and perform configuration on the router instead.

1. Log in to the BIRD machine and run the following commands to install BIRD:

   sudo add-apt-repository ppa:cz.nic-labs/bird
   sudo apt-get update 
   sudo apt-get install bird
   sudo systemctl enable bird 
   

   NOTE

   • BIRD 1.5 does not support ECMP. To use all features of PorterLB, you are advised to install BIRD 1.6 or later.
   • The preceding commands apply only to Debian-based OSs such as Debian and Ubuntu. On Red Hat-based OSs such as RHEL and CentOS, use yum instead.
   • You can also install BIRD according to the official BIRD documentation.

2. Run the following command to edit the BIRD configuration file:

   vi /etc/bird/bird.conf
   

3. Configure the BIRD configuration file as follows:

   router id 192.168.0.5;
   
   protocol kernel {
       scan time 60;
       import none;
       export all;
       merge paths on;
   }
   
   protocol bgp neighbor1 {
       local as 50001;
       neighbor 192.168.0.2 port 17900 as 50000;
       source address 192.168.0.5;
       import all;
       export all;
       enable route refresh off;
       add paths on;
   }
   

   NOTE

   • For test usage, you only need to customize the following fields in the preceding configuration:

     router id: Router ID of the BIRD machine, which is usually set to the IP address of the BIRD machine.

     protocol bgp neighbor1:

     • local as: ASN of the BIRD machine, which must be different from the ASN of the Kubernetes cluster.
     • neighbor: Master node IP address, BGP port number, and ASN of the Kubernetes cluster. Use port 17900 instead of the default BGP port 179 to avoid conflicts with other BGP components in the system.
     • source address: IP address of the BIRD machine.

   • If multiple nodes in the Kubernetes are used as BGP neighbors, you need to configure multiple BGP neighbors in the BIRD configuration file.

   • For details about the BIRD configuration file, see the official BIRD documentation.

4. Run the following command to restart BIRD:

   sudo systemctl restart bird 
   

5. Run the following command to check whether the status of BIRD is active:

   sudo systemctl status bird
   

   

   NOTE

   If the status of BIRD is not active, you can run the following command to check the error logs:

   journalctl -f -u bird
   

Step 2: Create a BgpConf Object

The BgpConf object is used to configure the local (Kubernetes cluster) BGP properties on PorterLB.

1. Run the following command to create a YAML file for the BgpConf object:

   vi porter-bgp-conf.yaml
   

2. Add the following information to the YAML file:

   apiVersion: network.kubesphere.io/v1alpha2
   kind: BgpConf
   metadata:
     name: default
   spec:
     as: 50000
     listenPort: 17900
     routerId: 192.168.0.2
   

   NOTE

   For details about the fields in the BgpConf YAML configuration, see Configure Local BGP Properties Using BgpConf.

3. Run the following command to create the BgpConf object:

   kubectl apply -f porter-bgp-conf.yaml
   

Step 3: Create a BgpPeer Object

The BgpPeer object is used to configure the peer (BIRD machine) BGP properties on PorterLB.

1. Run the following command to create a YAML file for the BgpPeer object:

   vi porter-bgp-peer.yaml
   

2. Add the following information to the YAML file:

   apiVersion: network.kubesphere.io/v1alpha2
   kind: BgpPeer
   metadata:
     name: porter-bgp-peer
   spec:
     conf:
       peerAs: 50001
       neighborAddress: 192.168.0.5
   

   NOTE

   For details about the fields in the BgpPeer YAML configuration, see Configure Peer BGP Properties Using BgpPeer.

3. Run the following command to create the BgpPeer object:

   kubectl apply -f porter-bgp-peer.yaml
   

Step 4: Create an Eip Object

The Eip object functions as an IP address pool for PorterLB.

1. Run the following command to create a YAML file for the Eip object:

   vi porter-bgp-eip.yaml
   

2. Add the following information to the YAML file:

   apiVersion: network.kubesphere.io/v1alpha2
   kind: Eip
   metadata:
     name: porter-bgp-eip
   spec:
     address: 172.22.0.2-172.22.0.10
   

   NOTE

   For details about the fields in the Eip YAML configuration, see Configure IP Address Pools Using Eip.

3. Run the following command to create the Eip object:

   kubectl apply -f porter-bgp-eip.yaml
   

Step 5: Create a Deployment

The following creates a Deployment of two Pods using the luksa/kubia image. Each Pod returns its own Pod name to external requests.

1. Run the following command to create a YAML file for the Deployment:

   vi porter-bgp.yaml
   

2. Add the following information to the YAML file:

   apiVersion: apps/v1
   kind: Deployment
   metadata:
     name: porter-bgp
   spec:
     replicas: 2
     selector:
       matchLabels:
         app: porter-bgp
     template:
       metadata:
         labels:
           app: porter-bgp
       spec:
         containers:
           - image: luksa/kubia
             name: kubia
             ports:
               - containerPort: 8080
   

3. Run the following command to create the Deployment:

   kubectl apply -f porter-bgp.yaml
   

Step 6: Create a Service

1. Run the following command to create a YAML file for the Service:

   vi porter-bgp-svc.yaml
   

2. Add the following information to the YAML file:

   kind: Service
   apiVersion: v1
   metadata:
     name: porter-bgp-svc
     annotations:
       lb.kubesphere.io/v1alpha1: porter
       protocol.porter.kubesphere.io/v1alpha1: bgp
       eip.porter.kubesphere.io/v1alpha2: porter-bgp-eip
   spec:
     selector:
       app: porter-bgp
     type: LoadBalancer
     ports:
       - name: http
         port: 80
         targetPort: 8080
     externalTrafficPolicy: Cluster
   

   NOTE

   • You must set spec:type to LoadBalancer.
   • The lb.kubesphere.io/v1alpha1: porter annotation specifies that the Service uses PorterLB.
   • The protocol.porter.kubesphere.io/v1alpha1: bgp annotation specifies that PorterLB is used in BGP mode.
   • The eip.porter.kubesphere.io/v1alpha2: porter-bgp-eip annotation specifies the Eip object used by PorterLB. If this annotation is not configured, PorterLB automatically uses the first available Eip object that matches the protocol. You can also delete this annotation and add the spec:loadBalancerIP field (for example, spec:loadBalancerIP: 172.22.0.2) to assign a specific IP address to the Service.
   • In the BGP mode, you can set spec:loadBalancerIP of multiple Services to the same value for IP address sharing (the Services are distinguished by different Service ports). In this case, you must set spec:ports:port to different values and spec:externalTrafficPolicy to Cluster for the Services.
   • If spec:externalTrafficPolicy is set to Cluster (default value), PorterLB uses all Kubernetes cluster nodes as the next hops destined for the Service.
   • If spec:externalTrafficPolicy is set to Local, PorterLB uses only Kubernetes cluster nodes that contain Pods as the next hops destined for the Service.

3. Run the following command to create the Service:

   kubectl apply -f porter-bgp-svc.yaml
   

Step 7: Verify PorterLB in BGP Mode

The following verifies whether PorterLB functions properly.

1. In the Kubernetes cluster, run the following command to obtain the external IP address of the Service:

   kubectl get svc
   

   

2. In the Kubernetes cluster, run the following command to obtain the IP addresses of the cluster nodes:

   

3. On the BIRD machine, run the following command to check the routing table. If equivalent routes using the Kubernetes cluster nodes as next hops destined for the Service are displayed, PorterLB functions properly.

   ip route
   

   If spec:externalTrafficPolicy in the Service YAML configuration is set to Cluster, all Kubernetes cluster nodes are used as the next hops.

   

   If spec:externalTrafficPolicy in the Service YAML configuration is set to Local, only Kubernetes cluster nodes that contain Pods are used as the next hops.

   

4. On the BIRD machine, run the following command to access the Service:

   curl 172.22.0.2
   

   

Feedback

Was this page helpful?

Glad to hear it! Please tell us how we can improve.

Sorry to hear that. Please tell us how we can improve.