Ixia-c traffic engine deployment on Azure with Mellanox DPDK

public-cloud/aws/ixia-c-dpdk-aws/deployment/Terraform/cloud-init.aws.yml

@@ -13,7 +13,7 @@ runcmd:
   - Agent2Eth1MacAddress=$(aws ec2 describe-network-interfaces --filters Name=addresses.private-ip-address,Values=${Agent2Eth1PrivateIpAddresses[0]} Name=vpc-id,Values=${VpcId} | jq .NetworkInterfaces[0].MacAddress --raw-output)
   - sed -i "s/Agent1Eth1MacAddress/$Agent1Eth1MacAddress/g" ${GitRepoConfigPath}/*.json
   - sed -i "s/Agent2Eth1MacAddress/$Agent2Eth1MacAddress/g" ${GitRepoConfigPath}/*.json
-  - sed -i "s/Agent1Eth1IpAddress/${Agent1Eth1PrivateIpAddresses[0]}/g" ${GitRepoConfigPath}/*.json   
+  - sed -i "s/Agent1Eth1IpAddress/${Agent1Eth1PrivateIpAddresses[0]}/g" ${GitRepoConfigPath}/*.json
   - sed -i "s/Agent2Eth1IpAddress/${Agent2Eth1PrivateIpAddresses[0]}/g" ${GitRepoConfigPath}/*.json
   - sed -i "s/Agent2Eth0IpAddress/${Agent2Eth0IpAddress}/g" ${GitRepoExecPath}/settings.json
 merge_how:

public-cloud/azure/ixia-c-dpdk-azure-mellanox/Makefile

@@ -0,0 +1,29 @@
+###############################
+# Infrastructure deployment
+###############################
+
+all: azure run
+
+.PHONY: azure
+azure:
+	$(MAKE) -C ./deployment/Terraform all
+
+.PHONY: clean
+clean:
+	$(MAKE) -C ./deployment/Terraform clean
+
+.PHONY: run
+run:
+	$(MAKE) -C ./deployment/CloudShell run
+
+.PHONY: connect
+connect: connect-agent1
+
+.PHONY: connect-agent1
+connect-agent1:
+	$(MAKE) -C ./deployment/CloudShell connect-agent1
+
+.PHONY: connect-agent2
+connect-agent2:
+	$(MAKE) -C ./deployment/CloudShell connect-agent2
+

public-cloud/azure/ixia-c-dpdk-azure-mellanox/README.md

@@ -1,51 +1,91 @@
-# KENG-on-Azure-Boost-2-Agents-2-Eth-1-Vnet-1-Public-Subnet-1-Private-Subnet
+# Ixia-c traffic engine deployment on Azure with Mellanox DPDK
 
-## Description
-This deployment creates a topology with a single virtual network having a single public facing subnet and a single private subnet.
+## Overview
+This is a public cloud lab where [Ixia-c](https://github.com/open-traffic-generator/ixia-c) has two traffic ports connected within a single subnet of an Azure.
+The environment is deployed using [Terraform](https://www.terraform.io/) and [Cloud-Init](https://cloud-init.io/) is used to configure the application and traffic engines.
+Performance improvements are enabled through [DPDK](https://www.dpdk.org/) support.
+Once the lab is up, a Python script is used to request Ixia-c to generate traffic and report statistics.
 
-## Authentication Variables
+## Prerequisites
+* This lab requires the commands below to be executed from within [Azure CloudShell](https://learn.microsoft.com/en-us/azure/cloud-shell/overview).
+* The created VMs needs to have at least ConnectX4 or ConnectX5. Mellanox ConnectX3 is not longer supported.    
+  Use the `lspci` command to check NIC type.   
+E.g.
 ```
-terraform.hcp.auto.tfvars
+ubuntu@terraform-v8KJ8A-azure-community-mellanox-agent1-instance:~$ lspci
+8ada:00:02.0 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx Virtual Function] (rev 80)
 ```
-You **MUST** uncomment all lines in this file and replace values to match your particular environment.  
-Otherwise, Terraform will prompt the user to supply input arguents via cli.
 
-## Required Variables
-```
-terraform.required.auto.tfvars
-```
-You **MUST** uncomment all lines in this file and replace values to match your particular environment.  
-Otherwise, Terraform will prompt the user to supply input arguents via cli.
+## Clone the repository
 
-## Optional Variables
 ```
-terraform.optional.auto.tfvars
+git clone --recursive https://github.com/open-traffic-generator/otg-examples.git
 ```
-You **MAY** uncomment one or more lines as needed in this file and replace values to match your particular environment.
 
-## Required Usage
-```
-terraform init
-terraform apply -auto-approve
-terraform destroy -auto-approve
-terraform output SshKey | tail -n +3 | head -n-3 | sed "s/^[ \t]*//" > SshKey.pem
-Agent1DnsName=$(terraform output | grep agent1 | sed -n 's/.*=.//p' | tr -d '"')
-```
+## Navigate to the lab subdirectory within the repository
 
-## Optional Usage
 ```
-terraform validate
-terraform plan
-terraform state list
-terraform output
+cd otg-examples/public-cloud/azure/ixia-c-dpdk-azure-mellanox
 ```
 
-## KENG Sample Usage
-```
-chmod 400 SshKey.pem
-ssh -i SshKey.pem ubuntu@$Agent1DnsName
-$ source ./venv/bin/activate
-$ cd keng-python
-$ docker ps
-$ ./unidirectional.sh -s 4100
- ```
+## Deploy Ixia-c lab
+
+1. Create Terraform deployment.
+
+2. Wait approximately 6 minutes for infrastructure to be deployed.
+
+3. Execute Python test case to generate traffic between Azure instances.
+
+    ```
+    make azure
+    ```
+
+4. Connect to Agent1 Azure VM .
+
+    ```
+    make connect
+    ```
+
+
+## Execute Traffic Test additional times as needed
+
+1. Execute unidirectional test case to generate traffic between Azure instances.
+
+    ```
+    ubuntu@agent1$ make run
+    ```
+
+2. Execute bidirectional test case to generate traffic between Azure instances.
+
+    ```
+    ubuntu@agent1$ make run-bidirectional
+    ```
+
+3. Execute rfc2544 test case to generate traffic between Azure instances.
+
+    ```
+    ubuntu@agent1$ make run-rfc2544
+    ```
+
+4. Optionally execute on Agent1 if instance is rebooted prior to running traffic
+
+    ```
+    ubuntu@agent1$ make dpdk
+    ```
+
+## Results
+1. Unidirectional TCP flow
+![Diagram](./images/unidirectional_community_mellanox.png)
+2. Bidirectional TCP flow
+![Diagram](./images/bidirectional_community_mellanox.png)
+1. RFC-2544 for the following frame sizes: 256B, 512B, 1024B and 1500B   
+![Diagram](./images/rfc2544_256-512-1024-1500B_community_mellanox.png)
+
+## Destroy the lab
+
+1. Destroy the Terraform deployment
+
+    ```
+    ubuntu@agent1$ exit
+    make clean
+    ```

public-cloud/azure/ixia-c-dpdk-azure-mellanox/configs/bidirectional.json

@@ -0,0 +1,160 @@
+{
+    "ports": [
+        {
+            "name": "VM1-TE1",
+            "location": ""
+        },
+        {
+            "name": "VM2-TE1",
+            "location": ""
+        }
+    ],
+    "layer1": [
+        {
+            "name": "l1",
+            "port_names": [
+                "VM1-TE1",
+                "VM2-TE1"
+            ],
+            "speed": "speed_10_gbps"
+        }
+    ],
+    "flows": [
+        {
+            "name": "f1",
+            "tx_rx": {
+                "choice": "port",
+                "port": {
+                    "tx_name": "VM1-TE1",
+                    "rx_names": ["VM2-TE1"]
+                }
+            },
+            "metrics": {
+                "enable": true
+            },
+            "size": {
+                "choice": "fixed",
+                "fixed": 4100
+            },
+            "rate": {
+                "choice": "percentage",
+                "percentage": 10
+            },
+            "duration": {
+                "choice": "fixed_seconds",
+                "fixed_seconds": {
+                    "seconds": 30
+                }
+            },
+            "packet": [
+                {
+                    "choice": "ethernet",
+                    "ethernet": {
+                        "dst": {
+                            "choice": "value",
+                            "value": "Agent2Eth1MacAddress"
+                        },
+                        "src": {
+                            "choice": "value",
+                            "value": "Agent1Eth1MacAddress"
+                        }
+                    }
+                },
+                {
+                    "choice": "ipv4",
+                    "ipv4": {
+                        "dst": {
+                            "choice": "value",
+                            "value": "Agent2Eth1IpAddress"
+                        },
+                        "src": {
+                            "choice": "value",
+                            "value": "Agent1Eth1IpAddress"
+                        }
+                    }
+                },
+                {
+                    "choice": "tcp",
+                    "tcp": {
+                        "src_port": {
+                            "choice": "value",
+                            "value": 643
+                        },
+                        "dst_port": {
+                            "choice": "value",
+                            "value": 543
+                        }
+                    }
+                }
+            ]
+        },
+        {
+            "name": "f1-reversed",
+            "tx_rx": {
+                "choice": "port",
+                "port": {
+                    "tx_name": "VM2-TE1",
+                    "rx_names": ["VM1-TE1"]
+                }
+            },
+            "metrics": {
+                "enable": true
+            },
+            "size": {
+                "choice": "fixed",
+                "fixed": 4100
+            },
+            "rate": {
+                "choice": "percentage",
+                "percentage": 10
+            },
+            "duration": {
+                "choice": "fixed_seconds",
+                "fixed_seconds": {
+                    "seconds": 30
+                }
+            },
+            "packet": [
+                {
+                    "choice": "ethernet",
+                    "ethernet": {
+                        "dst": {
+                            "choice": "value",
+                            "value": "Agent1Eth1MacAddress"
+                        },
+                        "src": {
+                            "choice": "value",
+                            "value": "Agent2Eth1MacAddress"
+                        }
+                    }
+                },
+                {
+                    "choice": "ipv4",
+                    "ipv4": {
+                        "dst": {
+                            "choice": "value",
+                            "value": "Agent1Eth1IpAddress"
+                        },
+                        "src": {
+                            "choice": "value",
+                            "value": "Agent2Eth1IpAddress"
+                        }
+                    }
+                },
+                {
+                    "choice": "tcp",
+                    "tcp": {
+                        "src_port": {
+                            "choice": "value",
+                            "value": 653
+                        },
+                        "dst_port": {
+                            "choice": "value",
+                            "value": 553
+                        }
+                    }
+                }
+            ]
+        }
+    ]
+}