This section helps you get started using VulcanManager to create and analyze Layer 4-7 performance. Before proceeding, please ensure you have the latest version of VulcanManager and the latest firmware installed on the chassis. The design philosophy of VulcanManager is to keep it simple for you to configure and run test scenarios, analyze results, and generate reports. To complete a Layer 4-7 test, there are four main steps to follow:
The following sections will describe these steps in general so that users know the basic test framework of VulcanManager. With the understanding of the concepts adopted in VulcanManager, users will be able to independently set up complex tests to verify the performance of their device under test (DUT). For this initial test, it is recommended to connect the two ports back-to-back on the chassis with a cable.
Two ports back-to-back connected for a simple test.
Our first step will be to show you how to set up a simple bi-directional raw TCP test scenario.
Configuring Your First Test Project
A test project is a self-contained collection of ports, subnets, traffic profiles, etc. in a directory commonly found in C:\Users\\Documents\Xena\VulcanManager.
1. Open VulcanManager and choose the Client <-> Server Topology template from Featured quick start templates. This template offers an end-to-end testing where the test platform acts as both client and server. Once opened, notice the three application tabs in the menu; Edit, Run Test and Reporting. These are the three contexts for setting up a test, executing it, observing real time statistics, at last, analyzing the collected statistics, and generating reports.
2. Press Add Chassis button located in the Edit tab. Enter the IP address of the chassis, use the default port number and password for the chassis. Upon arrival, the chassis will be preconfigured with: IP address 192.168.1.210, port 22606 and password “xena”. If you are using Xena’s Live Demo system, the IP address is 18.104.22.168 and the password is “xena”.
3. After the chassis is added, right click a port to quickly reserve it. If your username appears next to the port, it means the port is yours to use. Do it to another port because you need at least two ports to create. Notice that, anywhere in the application, when you see the port icon, you can right-click to get the context menu for port operations.
4. If you only want to see the ports that you use, you can check the checkboxes Used beside those ports and then click the Show Only Used Ports checkbox on top of the Chassis Explorer.
Configuring Test Case
In the Edit context, you will see two buttons in the Explores group. Use these buttons to switch between Chassis Explorer and Test Explorer.
- Press Test to switch to test setup. In the Test Explorer, you will see the Test Project tree and with a test case selected, you can see the list view of traffic scenarios and their subnet, port association.
- Press Add Scenario and choose Raw from the Stateful Loading branch in the Scenario Selector dialog. Select subnets and ports for the client and server part of the traffic scenario.
- You have successfully created a test scenario of RAW type with default settings. Assign a port you have reserved to Client Port and Server Port, respectively.
Run Test Case
The Run Test tab is a dashboard with a summary of realtime statistics.
- Press the Run button in the top menu. It turns Stop when the test is started.
- Click the test case icon in the Realtime Statistics Explorer to see a summary of realtime statistics. The realtime statistics are grouped into three columns. Layer 5-7 client statistics from the client side are on the left. Layer 4 statistics are in the middle. Layer 1-3 client statistics are on the right.
- See the progress bar of Concurrent Users (user) and Layer 5-7 Throughput (bps) above the statistics table.
- When the test is finished, the Stop button turns Reset.
- To see all statistics, go to the Reporting tab.
Statistics and Generate Report
During the test run, counters are sampled and stored. In Statistics Explorer, statistics are grouped into Client and Server.
- Expand Client and Server to check port related and scenario related statistics.
- Select statistics to see them in the chart.
- Click the checkbox next to a statistic to Include Chart in Report.
- Click Create PDF to generate a test report.
- Click Save Statistics DB to save all statistics into SQLite database storage file.