The available HEPnet Canada perfSonar hosts.

All hosts are members of the perfSonar HEPnet-Canada community.

Hosts Location Notes Interface Vancouver, TRIUMF 9000 MTU 1 GE Vancouver, TRIUMF 9000 MTU 1GE Vancouver, SFU 9000 MTU 10GE Vancouver, SFU 9000 MTU 1GE University of Victoria 9000 MTU, host not on LHCONE 10GE University of Victoria 9000 MTU, host not on LHCONE 1GE Toronto, SciNet Tier 2 10GE Toronto, SciNet Tier 2 1GE Montreal, CLUMEQ Tier 2 10GE Montreal, CLUMEQ Tier 2 1GE

If you wish to have a host added to this list please contact Ian Gable


To deploy the HEPnet provided persfSonar boxes, please follow these instructions. This will ensure that your hosts join the right measurement communities and are correctly placed in the network. This brief guide is intended to supplement the existing perfSonar documentation, not serve as replacement.

Physical Placement

The purpose of the boxes when placed at an ATLAS site is to measure the network end to end. This means that the nodes should be placed as far as possible to the end of your network and in the same address space as other ATLAS grid services. Ideally the nodes would be placed on the same network switch as your Storage Elements. The nodes should be placed to ensure that the traffic flows over any HEPnet lightpaths in the same way as your regular ATLAS traffic. The perfSonar box should not be placed behind a firewall. It's not recommended by Internet 2 to run the service behind a firewall. The perfSonar Toolkit was designed to run without a firewall, and well over 100 instances are operated safely in this fashion.

HEPnet Provided Boxes

Sites provided with perfSonar will have received two Dell models. These two models serve separate monitoring functions. The Dell R610 is the high performance box equipped with a Intel X520 10G network card; it should be dedicated to monitoring throughput. The second model is a Dell R410 with only on board Broadcom NIC; this box should be used for network latency measurements.

Basic Software Installation

Once the boxes are physically installed the next step is to install the perfSonar Performance Toolkit made by Internet 2. The perfSonar installation is a CentOS 6 based distribution which uses the specialized web100 kernel. It should be installed from the latest 'NetInstall' image available from the download page. The installation process will be very familiar to those who have installed RHEL based distribution such as Scientific Linux. For installation instructions please follow the detailed guide provided.

The boxes should be given IPNames that follow the following convention: Dell R410 Latency box:

Dell R610 Throughput Box:

Once both boxes are up, log in via the web interface and enable the bandwidth services for ps-bandwidth and the latency services for ps-latency using the service enable instructions. Use the 'Only Enable Bandwidth Services' and the 'Only Enable Latency Services' buttons.

Configuring for HEPnet Canada

In order to participate in Canadian network measurement it is necessary for the box to join a measurement community. The host should join the HEPnet-Canada community. Follow the instructions for adding a host to a community.

Once you have your box configured you can test against the other HEPnet Canada hosts.

Firewalls not recommended

Internet 2 does not recommend running the perfSonar Toolkit behind a firewall. This configuration is used safely throughout ESnet's and Internet 2's large deployment of perfSonar boxes. One easy security measure for the boxes is choosing very strong user account password and limiting the number of users. Obviously also avoid reusing the account password with any production system. Another simple tactic is to use switch ACLs to limit access to the ssh port of the machine.

In the event that it impossible to remove the firewall on the perfSonar box you can refer to a list of required open service ports and a range of ports for bandwidth testing. You must also then set the allowed port range for bandwidth testing appropriately.