⦿ CDRouter 10.0 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 10.0 Build 2 | April 5, 2016 |
Maintenance release 1 | CDRouter 10.0 Build 9 | April 28, 2016 |
Maintenance release 2 | CDRouter 10.0 Build 10 | May 24, 2016 |
Maintenance release 3 | CDRouter 10.0 Build 11 | June 21, 2016 |
Note: CDRouter 10.0 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 10.0 testvars using the config upgrade utility.
CDRouter 10.0 Build 2 April 5, 2016
New Features and Enhancements
CDRouter
New web interface with a number of exciting new features!
CDRouter 10.0 introduces a new web interface for CDRouter with an updated and more modern look and feel! The new interface is built on a powerful new PostgreSQL results database and web server written in the Golang programming language. In addition to the new look and feel and updated internals , we’ve also added a number of exciting new features and enhancements. Keep reading to find out more!
User model with local user authentication
One of the key features included in the new web interface is a user model which makes it easier for small teams to more efficiently utilize their CDRouter systems and share results with others.
Please see this Knowledge Base article for more information.
Support for HTTPS and HTTP/2
CDRouter 10.0 supports HTTPS out of the box, making it possible to securely access your CDRouter system from anywhere. By default, a self-signed certificate is generated and is used to serve HTTPS connections. However, a real certificate can be installed if desired. CDRouter can also be configured to redirect all HTTP traffic to HTTPS to further secure your system.
CDRouter 10.0 also supports HTTP/2 over HTTPS with no additional configuration. HTTP/2 brings major improvements in terms of performance and latency. HTTP/2 is supported by the most current release of Firefox and Chrome. See the official HTTP/2 website for more information on HTTP/2.
Enhanced tagging, filtering, and sorting options
CDRouter 10.0 includes improved tagging, filtering and sorting options. Index pages can now be filtered using multiple tags simultaneously, resources can be filtered by name and table columns can be sorted to make it easier to find what you’re looking for.
History and logging for all actions on system
CDRouter 10.0 introduces a new history page which serves as an audit trail to help you keep track of actions performed on your CDRouter system. Each action is logged with the name of the user responsible for the action, a timestamp and a link to the resource that was modified. The history page can be filtered, sorted and searched to allow finding changes quickly.
Updated home page with new dashboard
CDRouter’s home page has been revamped to offer a new dashboard view which aims to give a quick overview of your CDRouter system. The new home page shows the live status of the currently running or most recent result and lists a summary of subsequent recent results. Also, an import target for importing resources is conventiently located on the homepage in addition to links to the most recently modified configurations and packages.
New package editor
The package editor has undergone a major overhaul in CDRouter 10.0. In previous releases, a package’s testlist was made up of tests. Each test could only be added once and tests were executed in a predetermined order. In CDRouter 10.0, a package’s testlist can be made up of tests, modules or entire add-ons. Each test, module and addon can appear any number of times in the testlist and can be executed in any order. CDRouter 10.0’s powerful new package editor allows you to arbitrarily add, remove, copy and rearrange entries in your package’s testlist.
Unified license & installer
CDRouter 10.0 uses a single, unified license & installer for both CDRouter and CDRouter Multiport. In past releases, two installers were distributed, one for CDRouter Multiport customers and one for all other CDRouter customers. In addition, CDRouter Multiport customers were required to install their license file in a different location than other CDRouter customers. This is no longer necessary. Starting with CDRouter 10.0, Multiport is treated as an addon and all CDRouter customers have just one installer to download & install. Likewise, all CDRouter customers now install their license file in the same location. We hope this removes a common source of confusion and helps you get up and running with CDRouter faster.
Config search feature
A new config search page allows you to quickly find the values of specific testvars in a config file. By default, the config search page will display testvars that are set to non-default values. Filter boxes allow searching for testvars in a config file by name, value or testvar group. For example, the config search page could be used to display all testvars with
supports
in their name set toyes
to quickly see which features are enabled in the config file.Improved importing and exporting of multiple resources
CDRouter 10.0 introduces the ability to export multiple configurations, packages and results in a single export archive. In addition, capture files can optionally be excluded when exporting a result thus greatly reducing the size of the generated export archive. These improvements make it even easier to transfer resources between CDRouter systems quickly.
New automation & integration possibilities with updated JSON API
CDRouter 10.0 includes a brand new JSON API accessible via HTTP/HTTPS. CDRouter’s JSON API makes it possible to automate the configuration, creation and subsequent analysis of CDRouter test results, and opens the door for integrating CDRouter with other testing tools. To learn more about CDRouter’s JSON API, please contact support@qacafe.com for more information.
New software and license upgrade features
Installing updates is easier than ever. Users now have the ability to automatically fetch and install software upgrades and license files with the push of a button from the updated CDRouter 10.0 web interface. In addition, software and license updates can also be performed manually via drag and drop.
CDRouter 10.0 will periodically check for software updates and display a banner when updates are available. License and software upgrades are managed via the System > Update License and System > Upgrade CDRouter pages.
Capture file time stamps are now absolute
For consistency with the log files generated by CDRouter, all capture files now have absolute, rather than relative, time stamps. This makes it easier to correlate a packet in a capture file with events in the log.
New test case for verifying DHCP options provided by the client
The new cdrouter_dhcp_30 test case can be used to verify that a DHCP client includes certain options in the DHCP messages that it sends to the server. To run this test the new wildcard testvars wanDhcpClientOptionCode and wanDhcpClientOptionCode must be enabled and properly configured for the option(s) that you wish to validate. Up to 16 instances of these testvars can be defined.
CDRouter Nmap
CDRouter upgraded to use Nmap 7
CDRouter provides its own bundled installation of Nmap, a utility for network discovery and security auditing. CDRouter has been upgraded to use Nmap version 7.
CDRouter Performance
New LAN to LAN performance test capabilities
Two new modules containing test cases to generate UDP or TCP traffic over IPv4 or IPV6 between two clients on the LAN-side of a DUT. The LAN clients may be wired, wireless, or one of each. The test cases also generate PASS or FAIL results based on meeting configured throughput thresholds.
Performance Configuration Summary
Added summary information about performance-specific configuration into the log before the start of each Performance test run.
CDRouter TR-069
New testvars for setting file server credentials
In all previous releases of CDRouter the file server used in various TR-069 test cases used the same set of credentials as the ACS. This release adds two new testvars which allow the file server credentials to be configured with unique values by enabling the new testvars acsFileServerUser and acsFileServerPassword.
Support for testing TR-069 over IPv6 when 6to4 and 6rd are enabled
Prior to this release CDRouter supported testing TR-069 over native IPv6 WAN modes only. With this release CDRouter now supports testing TR-069 over all IPv6 WAN modes including 6to4 and 6rd, which were not originally supported.
CDRouter Multiport
New Guest modules for IPv4 and IPv6
Two new modules containing test cases to verify the proper operation of ‘guest’ mode on a CPE have been added to the Multiport add-on. The IPv6 guest module will also require the IPv6 Add-on. For more information on the guest module, please read this QA Cafe University Article
New Test Modules and Test Cases
CDRouter
New DHCP client options test case
TEST CASE: cdrouter_dhcp_30 MODULE: dhcp-c DESCRIPTION: DHCP client includes vendor defined options
CDRouter Performance
New LAN-to-LAN IPv4 Performance Module
MODULE: perf-lan DESCRIPTION: tests for testing Performance between to LAN clients for IPv4 NEW TEST CASES: 9
New LAN-to-LAN IPv6 Performance Module
MODULE: perf-lan-v6 DESCRIPTION: tests for testing Performance between to LAN clients for IPv6 NEW TEST CASES: 9
CDRouter Multiport
New Multiport Guest Module
MODULE: guest DESCRIPTION: tests for testing guest mode for IPv4 NEW TEST CASES: 11
New Muliport v6 Guest Module
MODULE: guest-v6 DESCRIPTION: test for testing guest mode for IPv6 NEW TEST CASES: 9
Bug Fixes and Notes
CDRouter
Fixed an issue with the ipv6_dns_120 test where a DNS response with missing rdata and rdlength > 0 was causing a fatal error. A warning is now issued instead.
Fixed an issue that prevented CDRouter-demo from being installed if the IOL-BBF-069 addon was already installed.
Resolved an bug displaying the documentation for custom test cases that had more than one “.” character in the test case name.
The
cdrouter-cli -check-version
command is now aware of maintenance release updates.Updated CDRouter’s MTU calculation logic when running in DS-Lite mode on the WAN. CDRouter will now look at both the IPv6 WAN mode as well to determine what the maximum link MTU is in DS-Lite mode.
The config file “diff” comparison view in the web interface would sometimes not scroll or properly synchronize the views of both config files. This problem has been fixed in this release.
Fixed an issue with the cdrouter_http_270 test where sending a HTTP 200 (OK) response message causes a fatal error when the TCP session is not avaiable.
CDRouter’s 802.1ad VLAN stacking feature has been enhanced to support devices that use “QinQ” style of tunnelling. Setting the wanOuterVlanQinQ to “yes” will enable this mode. Please see the CDRouter User Guide and the following Knowledge Base article for more details.
CDRouter Multiport
- The CDRouter Multiport add-on no longer requires a separate installer. As a result, there is now a single installer for all CDRouter systems.
CDRouter IPv6
- Resolved an issue with the ipv6_ndp_30 test case when validating the contents of the DNS Recursive Name Server option in configurations where the number of IPv4 WAN DNS servers defined exceeds the number of IPv6 WAN DNS servers defined.
CDRouter TR-069
Resolved a fatal error on systems that do not have the TR69-EDM add-on when running the od128 test module against non-IGD devices.
The tr69_160 and tr69_170 test cases are now automatically skipped if the testvar tr69UploadRPC is set to “no”.
Fixed a bad parameter path when running the od128_test_15.3 test case against an STB.
CDRouter BBF.069
- CDRouter 10.0 requires BBF.069 version 6.0.5 or greater. Please see the BBF.069 installation guide for more information.
CDRouter 10.0 Build 9 April 28, 2016
New Features and Enhancements
CDRouter
New bulk edit feature
A new bulk edit feature has been added to the Configurations, Packages, and Results pages within the web interface. Clicking the new Bulk Edit button allows users to edit the attributes of multiple resources from a single menu. Attributes that can be modified with the bulk edit feature include ownership, tags, whether or not a result is starred, and whether or not a result is archived.
New DHCP server test for verifying that client address lies within the configured pool
The new cdrouter_dhcp_server_4 test case can be used to verify that CDRouter’s DHCP client receives an address within the configured DHCP pool. The DHCP pool is configured using the testvars dhcpClientStart and dhcpClientEnd. The value of these testvars must match the DHCP pool configuration on the DUT to pass this test.
Filter settings now saved as URL parameters
Many of the filter settings available within CDRouter’s web interface are now automatically saved as URL parameters. This makes it possible for users to bookmark URLs for specific views and share direct links to specific views on their system with colleagues. This enhancement also improves navigation by retaining filter/view settings when users click the back button in their browser.
CDRouter TR-069
Updated TR-135 profiles
The tr135_profiles test module has been updated to support a number of new profiles including Baseline:2, DigitalOutput:2, DigitalOutput:3, HistoPerfMon:1, and HistoECPerfMon:1.
CDRouter Multiport
Support for unique DHCP Vendor Class Identifier options
The dhcpClientVendorClass testvar can now be uniquely defined on each configured LAN interface. This makes it possible to test DHCP conditional serving scenarios where certain DHCP Vendor Class Identifiers (option 60) trigger the DUT’s DHCP server to provide addresses from specific pools. With this capability multiple LAN interfaces can be configured, each with unique Vendor Class Identifiers. By also configuring a unique DHCP pool for each interface it’s possible to verify that a specific Vendor Class Identifier results in an address from a certain pool, using the new cdrouter_dhcp_server_4 test case.
CDRouter Performance
Added Zoom Capability to Performance Graphs
Added the ability to zoom in and out on performance graphs, allowing users to see a more granular view of graphs that have a large number of data points.
New Test Modules and Test Cases
CDRouter
New DHCP server pool test
TEST CASE: cdrouter_dhcp_server_4 MODULE: dhcp-s DESCRIPTION: Verify DHCP server returns IP address within configured pool
Bug Fixes and Notes
CDRouter
The cdrouter_forward_2 test case is not compatible with multi-wan configurations and will now be automatically skipped if more than one WAN interface are defined in the configuration file.
Resolved an issue with the CSV results export. Previously the CSV output would include only the first 250 test results. This issue has been fixed and the CSV export now includes all results.
Resolved an issue when calculating the WAN MTU in the cdrouter_dos_2 test case when PPPoE with an IPSec tunnel are configured.
Some log messages have been removed while performing firewall scans. This reduces the size of the test log significantly when performing firewall scans over large port ranges.
Resolved an issue that prevented CDRouter from stopping a running test package while the the RestartDut command was still running. If that command failed to return for some reason, CDRouter would be unable to interrupt it or start a new job.
Improved the performance of the web interface when loading and viewing large log files.
Resolved a display issue with the packet viewer when using Google Chrome or Firefox browsers on Linux platforms.
Resolved an issue with the cdrouter_dhcp_server_3 test case where the wrong MAC address would be used.
Resolved an issue where ERROR messages printed in the log seemed to be invisible unless the cursor hovered over it.
CDRouter’s WAN DHCP server will now detect if the DUT’s WAN DHCP client lease expires during a test run. If the lease expires CDRouter will wait up to 150 seconds for the DUT to renew the address before proceeding to the next test case. If the DUT does not renew the address CDRouter will display a warning in the test log indicating that subsequent tests may fail because the DUT no longer has a valid address.
When creating a new configuration from the web interface, the config will remain in edit mode until explicitly closed. The Create button has also been renamed Save. These changes result in behavior that is now identical to the previous web interface.
Support for WEP-40 and WEP-104 based group ciphers for WPA Pre-Shared Key has been deperecated and will be removed from future releases of CDRouter.
CDRouter TR-069
CDRouter’s ACS now has additional checks to ensure that the TCP connection for the current CWMP session is closed before initiating a new CWMP session.
Resolved an issue with od128_test_8.3 and od128_test_8.4 related to the new ACS file server credentials added in the initial release of CDRouter 10.0.
CDRouter Multiport
Resolved a logic issue with the cdrouter_firewall_101 test case when run in a multiport configuration with multiple LAN interfaces defined.
Resolved a fatal error during start in IPv6 only configurations when two or more LAN interfaces were used.
Resolved an issue in the cdrouter_basic_10 test case when run in configurations that included multiple LAN interfaces and subnets.
CDRouter Performance
Resolved an issue where the UDP loss percentage was reported as NaN%.
Resolved a UDP sequence numbering issue by increasing to a 64-bit counter instead of a 32-bit counter.
Reduced the log file size of the UDP performance test cases by surpressing the ‘OUT-OF-ORDER’ messages from being displayed in the log file. The summary displayed in the log still provides the total count of UDP datagrams that are received ‘out-of-order’.
Resolved an issue where the wireless performance settings for LAN-to-LAN test cases were not being used if only a secondary interface was configured as wireless.
Resolved an issue when a DUT does not advertise an IPV6 prefix to the performance LAN client. CDRouter incorrectly assumed a prefix length of 0, instead of /64.
Resolved an issue where CDRouter was putting a WARNING message in the log erroneously indicating that the IPv6 DHCP lease time for the Performance LAN client was 0.
Resolved an issue when perfPingEnable was enabled, the LAN-to-LAN Performance tests would not run.
CDRouter 10.0 Build 10 May 24, 2016
New Features and Enhancements
CDRouter
New test case for verifying the DHCP lease time given to a LAN client
The new cdrouter_dhcp_server_5 test case can be used to verify the lease time given to an IPv4 LAN client. The lease time may be specified with the newly added testvar dhcpClientLeaseTime.
CDRouter TR-069
New validation commands available in CWMP Scenario Testing feature
The CWMP Scenario Testing feature now allows
GetParameterValues
responses to be checked using regular expressions and custom TCL code blocks, allowing more thorough validation of parameters in the DUT’s TR-069 data model. See the CWMP Scenario Testing section of the CDRouter TR-069 User Guide for details and examples.New test case to verify the DUT’s behavior in response to a 8005 “retry request” fault code
The new tr69_320 test case verifies that the DUT will resend a CWMP message when the ACS responds with a 8005 “Retry request” fault code. The BBF TR-069 Amendment 5 specification requires clients to immediately resend the request within the same CWMP session.
CDRouter IPv6
New test case for verifying that the DHCPv6 address given to a LAN client is from within a specific address pool
The new dhcpv6_server_2 test case can be used to verify that a DHCPv6 client on the LAN is given an IPv6 address from within the address pool configured on the DUT. The DUT’s IPv6 address pool is defined by the testvars ipv6DhcpClientStart and ipv6DhcpClientEnd.
New test case for verifying the DHCPv6 valid lifetime given to a LAN client
The new dhcpv6_server_3 test case can be used to verify the valid lifetime given to an IPv6 LAN client. The lifetime may be specified with the newly added testvar ipv6DhcpClientValidLifetime.
New test case for verifying DHCPv6 options provided by the client
The new dhcpv6_150 test case can be used to verify that a DHCPv6 client includes certain options in the DHCPv6 messages that it sends to the server. To run this test the new wildcard testvars wanDhcpv6ClientOptionCode and wanDhcpv6ClientOptionCode must be enabled and properly configured for the option(s) that you wish to validate. Up to 16 instances of these testvars can be defined.
New Test Modules and Test Cases
CDRouter
New DHCP server lease time test case
TEST CASE: cdrouter_dhcp_server_5 MODULE: dhcp-s DESCRIPTION: Verify DHCP server returns IP address with expected lease time
CDRouter TR-069
New CWMP 8005 “Retry request” fault code test case
TEST CASE: tr69_320 MODULE: tr69 DESCRIPTION: Verify CWMP 8005 fault method retry behavior
CDRouter IPv6
New DHCPv6 server address pool test case
TEST CASE: dhcpv6_server_4 MODULE: dhcpv6-s DESCRIPTION: Verify DHCP server returns address within configured pool
New DHCPv6 server valid lifetime test case
TEST CASE: dhcpv6_server_3 MODULE: dhcpv6-s DESCRIPTION: Verify server returns IP address with expected valid lifetime
New DHCPv6 client vendor defined options test case
TEST CASE: dhcpv6_150 MODULE: dhcpv6-c DESCRIPTION: Verify DHCPv6 client includes vendor defined options
Bug Fixes and Notes
CDRouter
The Jobs page of the web interface now contains a “Schedule Again” button to allow selected jobs to be repeated without having to relaunch the assocaited test package.
Resolved an issue where some of the test cases in the firewall module would fail when they were run after test cases in the vservice test module within the same test package.
Results can now be starred directly from the detailed results view within the web interface. The star icon and the result ID are now displayed in the top left corner below the CDRouter logo.
Resolved an issue that allowed tags with invalid characters (including #, $, %, etc.) to be applied to resources using the Tags and Bulk Edit buttons.
Fixed a problem where the web interface did not correctly redirect the browser after logging a user in.
Updated the CDRouter migration tool
cdrouter-migrate
to handle errors in tag values. If a config/package/result has a tag containing invalid characters, those characters will be converted to hyphens (‘-’) during migration. Previously the item containing the tag would not be migrated.Increased the clickable area around checkboxes in the web interface.
CDRouter now allows plain-text config files to be imported individually. A config file must end in ‘
.conf
’ in order for CDRouter to import it.Resolved a fatal error in the cdrouter_firewall_101 test case in multiport LAN configurations where a port defined as part of a UDP virtual service is also included on the firewallUdpOpenPorts list.
Resolved a “Too many open files” error which prevented users from logging in to the web interface when the system was under load.
The Visualize package graph now displays results in order of newest to oldest rather than oldest to newest.
Highlighted log messages are now printed in the start log for any testvar values that have been overridden via the command line or additional package options. This enhancement makes it much easier to identify run-time changes to the config file.
Resolved a fatal error when running in PPTP mode on the WAN with GRE versions other than 0.
Resolved a system hang issue with the RestartDut when set to a value of
echo -n
.Skipped, waiting, and pending tests are now filtered out by the Visualize tool when plotting the results for a test run. This resolves an issue where the wrong tests where linked to each individual point on the Visualize graph.
CDRouter TR-069
In CDRouter’s TR-069 data model profile tests, parameters defined to contain a list of a particular data type were being incorrectly encoded as that data type in outgoing requests from the ACS. CDRouter now correctly encodes such parameters as ‘string’ (eg. Device.DHCPv4.Server.Pool.1.DNSServers is now encoded as
'<Value xsi:type="xsd:string">202.254.101.1,202.254.101.2</Value>'
).The od128_test_8.3 test case now includes some additional checks to verify that the CPE did indeed download the correct file from the download server. These are the same checks that are performed in the od128_test_8.4 test case.
The tr69_131 test case has been updated. This test now includes a new initial step that loads the original firmware, specified by the testvar tr69DownloadOriginalImage, first. The test then proceeds to upgrade the firmware, specified by the testvar tr69DownloadImage, and then downgrade back to the original firmware, specified by the testvar tr69DownloadOriginalImage. This change allows this test to run after the existing download tests in the od128 test module without producing a false negative test result.
CDRouter Multiport
- Resolved an issue where the guest_30 and ipv6_guest_30 test cases caused a failure if the NMAP add-on was not licensed.
CDRouter Performance
Resolved an issue where the Visualize Performance tool would not display graphs for large data sets with greater than 1,000 data points.
Resolved a statistical issue when using a non-default value for perfOmit, which sometimes erroneously showed a negative percentage for loss.
Improved support for a large number of UDP streams. In previous releases, the NTA1000 performance with a large number of UDP streams would drop off. This release allows the NTA1000 to maintain line rate speeds as the number of UDP streams is increased to the maximum.
Allow the testvar perfInterval to be set to a value of 0. When this testvar is set to 0, only the final performance metric is included in the log; performance statistics for each interval are omitted. This can be useful when testing with a large number of streams.
The bandwidth per stream is now automatically calculated when the testvars perfDownloadBandwidth, perfUploadBandwidth, or perfLantoLanBandwidth are set to 0.0 (which signifies maximum rate).
CDRouter SNMP
- CDRouter now decodes and displays packets as SNMP when a non-standard SNMP port is used.
CDRouter 10.0 Build 11 June 21, 2016
New Features and Enhancements
CDRouter
Support for DHCPv4 Rapid Commit
CDRouter’s DHCPv4 server and client now support the Rapid Commit option defined in IETF RFC 4039. Rapid Commit shortens the normal 4-message DHCP exchange by eliminating the DHCPOFFER and DHCPREQUEST messages from the exchange. When Rapid Commit is enabled, which is signified by the presence of DHCP option code 80, a shorter 2-message exchange may be used (DHCPDISCOVER –> DHCPACK).
Rapid Commit support can be enabled within CDRouter’s DHCP server on the WAN using the new testvar dhcpServerRapidCommit. Likewise, Rapid Commit can be enabled within CDRouter’s LAN DHCP clients using the new testvar dhcpRapidCommit. These testvars should only be set to yes if the DUT’s WAN DHCP client and LAN DHCP server, respectively, support Rapid Commit.
New test cases for DHCPv4 Rapid Commit
Two new test cases for DHCPv4 Rapid Commit have been added. The cdrouter_dhcp_31 test case verifies that the DUT’s WAN DHCP client supports the Rapid Commit option, while the cdrouter_dhcp_server_31 test cases verifies that the DUT’s LAN DHCP server supports the Rapid Commit option.
Testvars can now be set using the config bulk edit feature
The bulk edit pop-up for configuration files now supports testvars. Using this feature testvar values can be changed in multiple configuration files with one operation.
CDRouter IPv6
New test case for DHCPv6 Rapid Commit on the WAN
The dhcpv6_160 test case can be used to verify that the DUT’s WAN DHCPv6 client supports Rapid Commit option. In addition, Rapid Commit support within CDRouter’s WAN DHCPv6 server can now be enabled or disabled using the new testvar dhcpv6ServerRapidCommit.
New Test Modules and Test Cases
CDRouter
New DHCP Rapid Commit test for DUT’s WAN DHCP client
TEST CASE: cdrouter_dhcp_31 MODULE: dhcp-c DESCRIPTION: Verify client supports DHCP Rapid Commit option
New DHCP Rapid Commit test for DUT’s LAN DHCP server
TEST CASE: cdrouter_dhcp_server_31 MODULE: dhcp-s DESCRIPTION: Verify server supports DHCP Rapid Commit option
CDRouter IPv6
New DHCPv6 Rapid Commit test for DUT’s WAN DHCPv6 client
TEST CASE: dhcpv6_160 MODULE: dhcpv6-c DESCRIPTION: Verify client supports DHCPv6 Rapid Commit option
Bug Fixes and Notes
CDRouter
Resolved an issue with the testlist portion of the Package editor. In earlier releases selecting an individual test case would select all instances of that test case in the test list, not just the one instance that was selected. This issue has been resolved in this release.
Resolved an issue with the test log annotation navigation arrows.
Updated reference link to DynDNS.org’s Update Specificiation in in cdrouter_dyndns_10.
Highlighted log messages are now printed in the start log if the config file has been overridden via the command line or additional package options. This enhancement makes it much easier to identify when the default test package config file has been overridden with an alternate config file at run time.
Resolved an issue with the
cdrouter
CLI when the-wait
option was used in conjunction with the-jobid
option. Previously some CLI commands launched with these options would not return, which caused problems with automation scripts.Resolved various issues associated resource tags that contain invalid characters. Tags are now validated when applied, and can only contain letters, numbers, dots, hyphens, spaces, and underscores.
Resolved an issue when restarting a test package and specifying a test to begin and end at would potentially skip tests defined between them.
Updated the cdrouter_vservice_40 test to handle cases where the DUT fails to translate the source IP address when forwarding packets to the
virtualUdpServiceHost
address. The test will now fail in this situation.
CDRouter IPv6
Resolved an option parsing issue when processing certain DHCPv6 Solicit packets.
CDRouter will now automatically set the O-bit in Router Advertisements sent on the WAN whenever prefix delegation is enabled.
CDRouter Performance
- Resolved an issue in the final displayed output when perfInterval is set to ‘0’ and multiple streams are configured.
CDRouter Live
- When creating the secure connection between CDRouter and its paired Live server, CDRouter validates the server certificate sent. Part of the check involves a DNS Request being sent. CDRouter changed the behavior to send this request over UDP instead of TCP.
⦿ CDRouter 10.1 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 10.1 Build 2 | August 16, 2016 |
Maintenance Release 1 | CDRouter 10.1 Build 3 | September 13, 2016 |
Maintenance Release 2 | CDRouter 10.1 Build 4 | October 6, 2016 |
Note: CDRouter 10.1 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 10.1 testvars using the config upgrade utility.
CDRouter 10.1 Build 2 August 16, 2016
New Features and Enhancements
CDRouter
New device manager
A powerful new device manager has been added to CDRouter’s web interface! This feature makes it very easy to catalog the various devices that are connected to a CDRouter system. Information such as model number, firmware version, serial number, etc. can all be a viewed in a single place for each device that has been defined.
Files can also be uploaded to the CDRouter system and associated with devices. This makes it possible to store and organize device firmware images, configuration files, certificates, etc. directly within CDRouter’s web interface.
CDRouter test results can be automatically associated with individual devices, making it very easy to quickly sort and view results by device. For more information, please see this Knowledge Base article.
Support for HTTP/2
CDRouter now supports HTTP/2 and has two new test modules for verifying HTTP/2 connections, with and without TLS encryption, through the DUT.
Match highlighting in config files
The config editor now supports match highlighting. This feature provides a few different UI enhancements:
When text within the config file is selected, any matches will be automatically highlighted in a light green color and a light green indicator will be displayed in the scrollbar.
When the config file is searched (using the Find button), any matches will be automatically highlighted in a light yellow color and a light yellow indicator will be displayed in the scrollbar.
Match highlighting is case sensitive. Indicators are also only displayed for matches within fully expanded sections. Using the Expand All option is recommended to maximize the usefulness of the match highlighting feature.
New timestamp format in log files
Log files now display the timestamp as the first field. In addition, the timestamp can be either a short format (just the time) or a long format (both the date and time). The long format is always stored in the actual log file. To select the format displayed in the web interface, there is now a pull down list in the ADMIN -> SYSTEM -> Preferences page.
Enhanced log file navigation within the web interface
It is now possible to jump directly to a specific line in a log file within the web interface. For example, to jump to line 107 of a log file, add a hash followed by the line number to the URL:
http://cdrouter.lan:8015/results/20160708150312/tests/6#107
Note that the URL hash can also be modified to jump to another line without requiring a full page refresh.
Log viewer now supports expanding and collapsing of test sections
Sections are used to break test logs into pieces in order to make parsing through results easier. A new feature has been added allowing the user to expand/collapse each log section or all log sections. Clicking on a log section header (brown line) will toggle whether that section is expanded or collapsed.
There are also two links at the top of the page to expand or collapse all log sections. In addition, there are up and down arrows next to each section that can be used to jump to the previous or next section. Note that this feature is only available for log files viewed from the results page, not live/running results.
CDRouter IPv6
Support for HTTP/2 over IPv6
CDRouter now also supports HTTP/2 over IPv6 and has two new test modules for verifying HTTP/2 connections, with and without TLS encryption, through the DUT.
CDRouter TR-069
Restructuring of data model profile tests
CDRouter’s TR-069 data model verification tests have been renamed and reorganized. This update aligns CDRouter with the overall structure and naming convention now used by the Broadband Forum for the CPE WAN management protocol (CWMP).
Test cases are now grouped by root or service data model as opposed to specification (root and service data models can include profiles from multiple specifications). Test module names are also now more descriptive and are comprised of the root or service object name and version. For example, the new InternetGatewayDevice1_profiles test module includes tests for all of the profiles defined in the InternetGatewayDevice:1 root data model.
Likewise, test case names are now more descriptive and are comprised of the root or service object name, the profile name, and a short abbreviation of the test type. For example, the GetParameterNames test for the Baseline profile within the InternetGatewayDevice root data model is now named InternetGatewayDevice_Baseline_gpn_1 as opposed to tr098_profile_1, as it was in previous releases.
Aside from the organizational changes listed above, all tests are identical to previous releases. The same seven tests are available for each defined profile, and test names now include a short abbreviation that makes it easy to map a test name to the type of test being executed:
Test Abbreviation Test Name *_gpn_1 Verify * Profile using GetParameterNames from top level *_gpn_walk_2 Verify * Profile using GetParameterNames walk at each level *_gpn_req_3 Verify * Profile parameters with ‘Write’ requirement have Writable flag *_gpv_4 Verify * Profile using GetParameterValues RPC *_spv_5 Verify * Profile using SetParameterValues RPC *_ado_6 Verify * Profile using AddObject and DeleteObject on all creatable objects *_gpn_and_gpv_7 Verify * Profile using GetParameterValues for all GetParameterNames full paths The test modules required to validate the three root data models currently defined by the Broadband Forum are included with the CDRouter TR-069 add-on. Test modules for verifying the the six currently defined service data models are included with the optional TR69-EDM add-on. The following table lists the required add-ons for each new test module:
Test Module Required Add-ons InternetGatewayDevice1_profiles TR-069 Device1_profiles TR-069 Device2_profiles TR-069 FAPService1_profiles TR-069 + TR69-EDM FAPService2_profiles TR-069 + TR69-EDM STBService1_profiles TR-069 + TR69-EDM StorageService_profiles TR-069 + TR69-EDM VoiceService1_profiles TR-069 + TR69-EDM VoiceService2_profiles TR-069 + TR69-EDM Users are encouraged to update all test packages to use the new profile test module and test case names defined in this release. For any packages that are not updated, CDRouter will map the old names to the new names and attempt to execute the correct tests from this release.
CDRouter SNMP
New SNMP Scenario Testing module
A new test module, snmp_scenarios.tcl, has been added allowing users to define their own custom SNMP scenario “scripts” to send SNMP requests to the DUT for any MIB object and verify the values returned. This adds a lightweight interface to add new SNMP tests without having create fully developed test cases using TCL. See the SNMP Scenario Testing section of the CDRouter SNMP User Guide for details on how to create a new scenarios script file and add it to yoru CDRouter test configuration.
New SNMP SetRequest test cases
The new snmp_400, snmp_wan_400, ipv6_snmp_400, and ipv6_snmp_wan_400 test cases can be used to verify that an SNMP agent allows a SetRequest on the read/write
SNMPv2-MIB::sysName.0
OID .
CDRouter Performance
Maximum number of streams increased
The max number of streams allowed for performance tests has been increased from 125 to 500. The number of streams can be configured using the testvar perfStreams.
New stream increment feature
The number of streams can be automatically incremented whenever a performance test is run multiple times in a package. The beginning number of streams is set with perfStreams and the increment value is set with the new testvar perfStreamIncr.
Support for running the LAN-to-LAN performance tests in Live mode
The IPv4 and IPv6 LAN-to-LAN performance test modules can now be run in ‘Live’ mode, when the testvar wanLiveEnable is set to yes.
New Test Modules and Test Cases
CDRouter
New HTTP/2 test modules
MODULE: http2.tcl DESCRIPTION: HTTP/2 related test cases NEW TEST CASES: 6
MODULE: http2-tls.tcl DESCRIPTION: HTTP/2 over TLS related test cases NEW TEST CASES: 6
CDRouter IPv6
New HTTP/2 test modules
MODULE: http2-v6.tcl DESCRIPTION: IPv6 HTTP/2 related test cases NEW TEST CASES: 6
MODULE: http2-tls-v6.tcl DESCRIPTION: IPv6 HTTP/2 over TLS related test cases NEW TEST CASES: 6
CDRouter SNMP
New SNMP Scenario Testing module
MODULE: snmp_scenarios.tcl DESCRIPTION: General SNMP configuration testing for user defined SNMP scenarios NEW TEST CASES: 1
New SetRequest test cases
TEST: snmp_400 MODULE: snmp.tcl DESCRIPTION: Verify SNMP agent allows SetRequest on read-write OID
TEST: snmp_wan_400 MODULE: snmp-wan.tcl DESCRIPTION: Verify SNMP agent allows SetRequest on read-write OID
TEST: ipv6_snmp_400 MODULE: snmp-v6.tcl DESCRIPTION: Verify SNMP agent allows SetRequest on read-write OID
TEST:ipv6_snmp_wan_400 MODULE: snmp-wan-v6.tcl DESCRIPTION: Verify SNMP agent allows SetRequest on read-write OID
Bug Fixes and Notes
CDRouter
CDRouter’s web interface now displays a “spinner” at the top of the page to indicate when operations are in progress. A progress meter is also displayed as log files and other pages are being loaded.
A bug was fixed where CDRouter’s packet view was showing duplicate lines in some circumstances, even though the data in the packet was present only once.
A bug was fixed where sometimes selecting a packet in the log of a currently running test did not show the packet decode of that packet.
The layout of the sharing dialog in the web interface has been fixed so that multiple users and their descriptions no longer crowd each other.
Updated the vservice test module to work correctly in multiport environments with interfaces that don’t support virtual LAN clients.
The Jobs page of CDRouter’s web interface now displays an “Extra CLI Arguments” column containing any additional arguments that may have been specified with the test package when it was launched.
The default value for the unknownPassthrough has been changed from “no” to “yes”. This value will be used if the testvar is not explicitly defined in the config file.
The layout of the log viewer within the web interface has been tweaked slightly to improve compatibility with long test case names. As part of this change the navigation buttons have been relocated from the center to the right side of the top pane.
The default value for the testvar ftpPortTimeout has been increased from 80 to 120 seconds for consistency with the TCP maximum segment lifetime.
Resolved an issue with the Visualize tool when displaying graphs for large test runs. The Visualize tool now caps and displays only the first 2k points for all test runs.
The /api/v1/results/:id/?updates API endpoint has been updated. This endpoint will now send back a successful response with the current state of the result instead of returning a 400 result is not running” JSON error which would bubble up to the web UI as well.
Resolved a session cookie browser issue that produced an error in some situations when downloading export or logdir archives from the web UI.
A new log message type, NOTICE, has been introduced and is now used instead of the IMPORTANT message type. This change aligns CDRouter’s logs with the standard format defined by syslog.
The new log message type SECTION is now used to mark the start of each new test section in the log file. This change makes it easier to identify and navigate through the sections within a log file.
The testvar wanAtmInterface has been deprecated and will be removed from future releases of CDRouter. The wanInterface now supports defining ATM interfaces directly:
testvar wanInterface 0.0.35
A bug has been fixed in the cdrouter_dhcp_server_700 test where the expected DNS server provided by the DUT is now specified by the testvar lanDnsServer rather than lanIp as it was previously.
The dns_200 and dns_201 tests (and all variants) have been modified to provide better failure messages.
The importing of very large results has been improved. Previously, CDRouter was running out of memory in some cases.
A bug was fixed in the cdrouter_https_250 test related to chunked data not getting parsed correctly.
Fixed a bug where trying to restart a package by selecting just failed tests actually ran failed and skipped test from the previous run of the package.
CDRouter no longer supports WEP-40 and WEP-104 based group ciphers for WPA Pre-Shared Key. The wpaGroupCipher no longer supports these modes.
Updated the cdrouter_dhcp_server_5 test to resolve a fatal error when the DUT’s DHCP server does not provide an address to CDRouter’s LAN DHCP client.
Fixed a problem in the vservice module that caused tests to fail for ports that were not within the range defined by portScanStart and portScanStop
Fixed a problem in the cdrouter_vservice_40 test case that caused it to fail in cases where the virtualLANTransType is set to private.
A new testvar, dnsForwardServerStatus, has been introduced to indicate whether the DUT is expected to forward DNS Server Status Request messages or not. The dns_150, dns_tcp_150, ipv6_dns_150 and ipv6_dns_tcp_150 tests now use this testvar to determine pass/fail results.
Resolved a fatal error in the cdrouter_sip_200 and cdrouter_sip_tcp_200 test cases when LAN clients do not receive an IP address from the DUT.
Resolved an issue where all custom modules/tests were skipped when lanInterface was set to ‘none’.
Resolved a web server crash when starting up on systems that have have link local IPv4 addresses configured. The web server now properly binds to interfaces with link local IPv4 addresses and no longer crashes.
Updated CDRouter’s DNS packet parser to better handle malformed responses from the DUT. This enhancement addresses a fatal error that was reported in the dns_120 test case.
Resolved a fatal error in the dns_120 test case when processing certain malformed DNS packets from the DUT.
Updated the “clickable” area around symbols in the package editor to make deleting and expanding items in the Test List easier.
CDRouter IPv6
Resolved an issue with the dhcpv6_160 test case and other tests in the dhcpv6-c test module when processing DHCPv6 packets from the client that contain 10 or more DHCPv6 options.
Updated constraint check for dhcpv6WanAssignNextPrefix to ensure it is on a different network from dhcpv6WanAssignPrefix
CDRouter TR-069
Updated the od128_test_23.1 test case to work correctly when the ACS is running with an IPv6 address.
Updated the tr69_320 test case to use the TCP session key instead of the session cookie when determining if the Inform was sent in the same session. The 9008 fault string sent by the ACS in this test was also updated from “Retry requested” to “Retry request” for consistency with TR-069 Amendment 5.
CDRouter Multiport
- The cdrouter_wanfail_10 test case requires DHCP on all WAN interfaces and will now be automatically skipped if DHCP is not the configured mode on any enabled WAN interfaces.
CDRouter Performance
- The perf-lan and perf-lan-v6 tests are now skipped if the testvar supportsPerformance is set to a value of no.
CDRouter Live
- Relaxed the restriction on skipping the entrire dos.tcl module in ‘Live’ mode. The following tests are now allowed when wanLiveEnable is set to yes: cdrouter_dos_1, cdrouter_dos_2, cdrouter_dos_10, cdrouter_dos_30, and cdrouter_dos_32.
CDRouter Storage
- The maximum value for the testvars storageSmbMaxSessions and storageFtpMaxSessions have been increased from 20 to 64.
CDRouter 10.1 Build 3 September 13, 2016
Bug Fixes and Notes
CDRouter
The web interface now stores the hide/show comments setting for a log file as a URL parameter. This allows users to share links to log files that will open with all comments displayed.
CDRouter’s web interface now uses a Unix socket instead of a TCP socket for internal communication with the
cdrouter-cli
command. This change should be transparent to all users and provide a small increase in performance. This change also eliminates a possible startup error due to conflicts with other system services related to the talkback port which is no longer used.Resolved a fatal error in the cdrouter_app_10 test case when running in multi-WAN configurations.
Exclamation points “!” can now be used in tag names within the web interface
Config file names may no longer contain backslash (
'\'
) or forward slash ('/'
) characters. Launching existing test packages with config files whose name contains either of these characters may result in a system error.Updated CDRouter to ensure that the results for a test run contain all of the tags from both the test package and the config file associated with the results.
Resolved an issue with the timestamps that are generated for results less than a week old on the Trending Results graph.
Resolved an issue with the
cdrouter -running
command not returning the correct status for a system with more than 25 completed jobs in the job queue.The Recent Results table for a device within the web UI has been updated with a new column that displays the package name.
Resolved an issue where a RADIUS server could not be created on a secondary LAN interface in a 802.1x (WPA-Enterprise) scenario.
Updated the package editor to ensure the user is prompted before navigating to another page, if there are unsaved changes pending.
If multiple test packages are launched at the same time, CDRouter will now ensure that they are added to the Job Queue in the same order they were listed.
The cdrouter_nat_520 test case was updated to test the same conditions for ‘port-restricted’ NAT devices as it does for other NAT modes. The test now verifies that ‘port-restriced’ NAT devices do not forward packets from the WAN that have a different IPv4 address and the same source port as an existing mapping.
Resolved an issue in cdrouter_dhcp_server_3, where in a multiport scenario, not all interfaces where checked for an existing MAC address before creating new host with a conflicting MAC address.
CDRouter SNMP
- Resolved an issue where snmp_wan_204 and ipv6_snmp_wan_204 were not skipped if lanInterface was set to none. Even though these test SNMP on the WAN interface of a DUT, they require that a LAN interface is available and active.
CDRouter Performance
- Resolved an issue where the tests in CDrouter Performance add-on were unable to run within a topology that include a DHCP Relay and multiple routing hops between the performance client and server instances.
CDRouter 10.1 Build 4 October 6, 2016
New Features and Enhancements
CDRouter
New navigation option for jumping to a specific page within the UI
A ‘Go To Page’ text box is now available on the Devices, Configurations, Packages and Results index pages within the web UI. This makes navigating to specific pages on systems with large indexes much easier.
Bug Fixes and Notes
CDRouter
Resolved an issue with the dns_100 when the DUT uses the 3rd and 4th WAN DNS servers specified by the testvars wanBackupDnsServer2 and wanBackupDnsServer3, respectively.
CDRouter’s general purpose WAN HTTP server now supports CSS files. All CSS files will be now be returned with a content-type header of
text:css
.Clicking on a packet in the log viewer opens the decode window and now stores the packet number as a
?decode=
URL parameter. When a URL containing a?decode=
parameter is opened, CDRouter’s log viewer will scroll to line and open the packet decode window automatically.The default value of the testvar wanNatIp has been changed from the next IP address after the wanIspIp to the value of wanIspAssignIp.
Resolved a UI issue on the Results page, where really long ‘Configuration’ file names did not wrap and could potential cover up the ‘Device’ name.
Fixed a problem with the dhcpServerMac testvar that caused LAN clients not to match the DUT’s source MAC address when receiving DHCP/DHCPv6 responses.
The web API has been updated to support more test result log filtering options. For more information, please see the web API test log documentation.
The test description for cdrouter_basic_1 has been updated and clarified. This test performs an ARP on the LAN for the default gateway IP learned by CDRouter’s LAN client.
The cdrouter_basic_10 test case has been updated to verify that the default gateway and subnet mask values provided by the DUT’s DHCP server on the LAN match the expected values in the config file, as defined by the testvars lanIp and lanMask, respectively. This ensures that the basic LAN settings in the CDRouter config file are consistent with the DUT’s actual running configuration.
The date format of the package Visualize graphs has been updated to more clearly indicate when each test result was run.
Enhanced the MAC address generation and check config function to help avoid MAC address conflicts within a configuration file and on virtualized interfaces.
CDRouter Multiport
- Resolved an issue with CDRouter’s stack rotation logic on the LAN for IPv6 that would cause test cases to run against invalid interfaces in certain configurations.
CDRouter TR-069
Updated the cdrouter_cwmp_gpv_test and tr111_p2_1 test cases to support the Device:2 (TR-181 Issue 2) data model.
Corrected a misleading log message in the cwmp_scenario_1 test that indicated a SOAP Fault was expected.
CDRouter IPv6
- Updated the config file constraints to prevent private IPv4 addresses from being used for IPv6 6to4 and 6rd setups. Such configurations are not valid and are incompatible with test modules that rely on external utilities, such as Nmap and SNMP.
CDRouter SNMP
Resolved an issue with the snmp_scenario_1 test. In SNMP Scenarios containing SetRequests with multiple OIDs, the SetRequest message sent to the DUT omitted all but one of the OIDs. CDRouter now sends SetRequest messages with all of the OIDs listed in the scenario file.
In the snmp_scenario_1 test, the results of SetRequest messages were not being reported in the log file. This has been fixed. SetRequests are now reported in the test log in the same way as GetRequest and GetNextRequest messages.
CDRouter Performance
- Resolved an issue with the Configuration Checker when validating acceptable values for perfWanIpv6.
⦿ CDRouter 10.2 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 10.2 Build 2 | November 28, 2016 |
Maintenance Release 1 | CDRouter 10.2 Build 3 | December 6, 2016 |
Maintenance Release 2 | CDRouter 10.2 Build 4 | January 9, 2017 |
Maintenance Release 3 | CDRouter 10.2 Build 5 | February 16, 2017 |
Note: CDRouter 10.2 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 10.2 testvars using the config upgrade utility.
CDRouter 10.2 Build 2 November 28, 2016
New Features and Enhancements
CDRouter ICS
New Internet Connection Sharing (ICS) add-on for CDRouter!
We are pleased to announce a brand new add-on for CDRouter - CDRouter ICS! Check out our website for more information.
CDRouter
New package option for creating custom testlists
CDRouter now allows users to define and manage custom testlists, which are a collection of tests that can be named and referenced within test packages. This feature makes it possible to define a single set of tests and then select that set of tests by name when creating test packages.
For example, a user may want to define a set of 50 tests for basic qualification of every device that they test. This list of tests can be created and given a name such as basic qualification tests. Any test package that is created can then include the testlist basic qualification tests alongside individual test cases, modules, or add-ons.
Testlists are created by setting the Use As Testlist option when creating a test package within CDRouter’s web interface.
The Use As Testlist option can also be toggled from the main packages index page by clicking on the testlist icon.
To add a testlist to an existing package, toggle the Show Testlists button in the package editor. This will open a fourth pane showing all available testlists. Testlists can be added in the same manner as addons, modules, and individual test cases.
New search filter within log viewer
CDRouter’s log viewer now includes a text based search filter. This new feature makes it easy to display only the log messages that match the specified text.
When a search filter is applied, pressing the control key (or command key on a Mac) will clear the search filter and automatically scroll to the selected line.
New advanced filtering options within log viewer
CDRouter’s log viewer now supports a number of advanced log filtering features which can be accessed by clicking on the Additional filters… link within the log viewer.
Clicking the Additional filters… link will display a pop up window that allows multiple filters to be defined, each with specific criteria. Once applied, only the log messages or packets that match the defined filters and criteria will be displayed.
When an advanced filter is applied, pressing the control key (or command key on a Mac) will clear the search filter and automatically scroll to the selected line.
New cdrouter-cli -new-testpath option makes editing existing tests easier
The
cdrouter-cli
command now contains a-new-testpath
option which makes creating custom testpaths from existing testcases easier. The-new-testpath
option takes an optional comma-separated list of existing addons, test modules and testcases which will be copied into the new testpath. For example, if you wish to create a custom testpath containing copies of the CDRouter testcasescdrouter_basic_1
,cdrouter_nat_1
andcdrouter_nat_2
, do the following:$ mkdir my_custom $ cd my_custom $ cdrouter-cli -new-testpath cdrouter_basic_1,cdrouter_nat_1,cdrouter_nat_2 $ ls config.dic errors.dic labels.dic modules my_custom_basic.tcl my_custom_nat.tcl
The
my_custom
directory now contains copies of all three tests in the filesmy_custom_basic.tcl
andmy_custom_nat.tcl
. The test and module names have been prefixed withmy_custom
so that they don’t conflict with the existing, official versions. The new testpath’smodules
andlabels.dic
files have been populated such that the copied tests have the same licensing and configuration restrictions as the originals.A message is printed when
cdrouter-cli -new-testpath
terminates explaining how to add the custom testpath to CDRouter so that the copied tests will appear in CDRouter’s package editor. Please see the CDRouter Developers Guide for more details on custom testpaths and editing testcases.New IPv4 reverse path check test case added to firewall module
The new cdrouter_firewall_508 test case can be used to verify that the DUT does not forward packets from LAN to WAN if the source address of the is not contained within the LAN subnet.
Scaling tests display any unallocated IP addresses
To help troubleshoot and debug failures in the scaling module CDRouter will now display all addresses that were not allocated at the end of the test. This makes it very easy to identify which addresses were not assigned by the DUT.
CDRouter Performance
Support for multicast performance testing
Four new test modules have been added to the CDRouter Performance add-on: perf-mcast, perf-mcast-v6, perf-mcast-lan, and perf-mcast-lan-v6. These test modules enable performance testing with multicast streams in both the upstream and downstream directions, and from LAN to LAN over IPv4 and IPv6.
Added the ability to set the MAC address of the performance server
The MAC address of the performance server can now be explicitly set using the testvar perfWanMac. Setting this testvar may improve performance slightly by eliminating the need for the DUT to ARP for the performance server’s MAC address at the beginning of every performance test case.
CDRouter IPv6
Support for MAP-T
CDRouter now includes support for RFC7599, Mapping of Address and Port using Translation (MAP-T). MAP-T is a stateless NAT64 technique that is designed to deliver IPv4 services over native IPv6 connections without having to deploy a full dual-stack network infrastructure. It also incorporates some carrier grade NAT (CGN) concepts by allowing multiple end user devices to share a single public IPv4 address.
For more information please see our Knowledge Base article on MAP-T testing .
CDRouter TR-069
Updated CWMP profiles
CDRouter’s Device2_profiles test module has been updated to support version 2.11 of the Device:2 data model published by the Broadband Forum. All profiles defined in the following data models are now supported:
Data Model Version InternetGatewayDevice:1 1.14 Device:1 1.14 Device:2 2.11 STBService:1 1.4 VoiceService:1 1.1 VoiceService:2 2.0 StorageService:1 1.2 FAPService:1 1.1 FAPService:2 2.1 This update adds support for the new Device:2 profiles listed below:
Test Module Profile Device2_profiles LEDBasic:1 Device2_profiles LEDAdv:1 Device2_profiles DeviceImage:1 Device2_profiles FAST:1 Device2_profiles UserInformationBasic:1 Device2_profiles UserInformationExtended:1 Better support for TR-069 over IPv6
CDRouter’s various TR-069 test modules have been updated to better support IPv6 WAN configurations. Previously many tests were not compatible with IPv6 and would be skipped automatically when the acsIp was set to an IPv6 address. Most tests have been updated and will now run when the CWMP transport is IPv6.
New configuration option for ACS domain
The new testvar acsDomain, which defaults
acs.qacafe.com
can be used to set a custom domain name for the ACS. CDRouter will automatically create a DNS entry for this domain that maps to the IP address specified by the testvar acsIp. This domain is also used by CDRouter’s XMPP server when XMPP connection requests are enabled.
New Test Modules and Test Cases
CDRouter
New firewall test
TEST CASE: cdrouter_firewall_508 MODULE: firewall.tcl DESCRIPTION: Verify outbound packets are not forwarded if the source address is not a prefix of the interior network
CDRouter IPv6
New MAP-T test module
MODULE: mapt.tcl DESCRIPTION: MAP-T tests for mapping IPv4 to IPv6 NEW TEST CASES: 20
CDRouter TR-069
New profiles added to the Device2_profiles module
MODULE: Device2_profiles DESCRIPTION: TR-181 Issue 2 CWMP Profile testing for Device data model NEW PROFILES: LEDBasic:1, LEDAdv:1, DeviceImage:1, FAST:1, UserInformationBasic:1, UserInformationExtended:1 NEW TEST CASES: 37
CDRouter Performance
New multicast performance modules
MODULE: perf-mcast.tcl DESCRIPTION: IPv4 UDP Multicast performance test cases NEW TEST CASES: 2
MODULE: perf-mcast-v6.tcl DESCRIPTION: IPv6 UDP Multicast performance test cases NEW TEST CASES: 2
MODULE: perf-mcast-lan.tcl DESCRIPTION: IPv4 UDP Multicast LAN-to-LAN performance test cases NEW TEST CASES: 2
MODULE: perf-mcast-lan-v6.tcl DESCRIPTION: IPv6 UDP Multicast LAN-to-LAN performance test cases NEW TEST CASES: 2
CDRouter IPv6
Bug Fixes and Notes
CDRouter
Resolved an issue in CDRouter’s TCP protocol stack that was causing retransmissions from the DUT to be missed.
Within the log viewer, the flag toggle button has been moved from the button bar to a new flag icon next to the test case name in the top left-hand corner.
The dns_220, dns_230, dns_240, and dns_250 tests have been modified so that the CDRouter LAN client no longer uses underscores in the hostname field of the DHCP Discover and Request packets.
CDRouter writes test results to a temporary directory while a test package is running, before writing them to the final results directory. This temporary directory had been in /tmp, which on NTA1000 systems, is on the smaller solid state drive. In some cases this could fill up the SSD. CDRouter now writes to the /usr/cdrouter-data/temp directory, which for NTA1000 systems, is on the larger data drive.
Resolved an issue with the dhcpServerMac testvar. In previous releases enabling this testvar would result in a MAC address filter being applied to both the DUT’s DHCP server on the LAN and the DUT’s DHCP client on the WAN. This issue has been fixed, and the dhcpServerMac testvar now only sets a MAC filter for the DUT’s DHCP server on the LAN. To set a MAC filter for the DUT’s DHCP client on the WAN, the testvar dhcpClientMac should be used instead.
CDRouter now requires a Linux kernel 3.10 or newer. If you get an error message indicating your kernel is too old, please refer to this article that explains how to update your kernel and other system software.
Resolved an issue where tags applied to a device would not be applied to results using the device.
Resolved an issue with the cdrouter-diag script where it would hang in certain situations.
Resolved an issue with the
-print-skipped
option that caused the cdrouter-cli command not to report when some tests were being skipped.The cdrouter_basic_2 and cdrouter_basic_20 tests are now skipped if the wanIspGateway testvar is defined. This testvar is typically used for DHCP relay test setups.
CDRouter is now able to store and return multiple SRV records for a given FQDN.
Resolved an issue when validating the ST and USN headers in the upnp module which was causing valid URNs to be rejected as invalid.
The eapradius_5 test case has been updated to generate warnings if the Calling-Station-Id and Called-Station-Id RADIUS attributes are not properly formatted.
Resolved an issue with HTTP/1.0 and HTTP/1.1 tests. When terminating the TCP session, CDRouter had not been waiting for the Fin+Ack from the DUT, and would report that it received an unknown TCP packet when the Fin+Ack arrived. CDRouter now waits for the Fin+Ack before sending its own and terminating the TCP session.
CDRouter Performance
Removed the 2,000 data point cap for the performance graph display. Now an unlimited number of data points may br graphed.
Changed the graph’s zoom capability from drag-to-select to a sliding window.
CDRouter IPv6
Resolved a fatal error with the ndp-wan test module when running with a static LAN configuration.
The ndp-wan and slaac-wan test modules can now be run in configs that do not include a LAN interface.
CDRouter TR-069
Resolved an issue in the CWMP Scenario feature that was causing the results from a request to contain information from prior requests.
Updated the way the ACS handles a SetParameterValuesResponse containing a Status value of “1”. Previously, the ACS would wait tr69RebootTimeout seconds or until an Inform with Event Code “1 BOOT” was received, just in case the the DUT needed to reboot in order to commit and apply the changes made by the SPV request. Now, an SPV Response with Status “1” will cause the ACS to send a Connection Request to the DUT and wait for a successful Inform. This event will signal that all changes have been applied, regardless of whether a reboot was required or not.
Updated the tr60_30 test case to better support environments where IPv6 is used as the transport for the TR-069 session. This test will attempt the CPE connection request over IPv6 if the connection request URL is IPv6 based.
The tr69_wireless test module originally verified stats using the newer
UnicastPacketsSent
andUnicastPacketsReceived
counters defined in the WiFiLAN:2 profile. This module has been updated to also support older devices that implement the less granularTotalPacketsSent
andTotalPacketsReceived
counters defined in the WiFiLAN:1 profile.Resolved a fatal error in the tr69_wireless test module when the
UnicastPacketsSent
andUnicastPacketsReceived
parameters returned by the device under test are empty strings.Improved algorithm for locating the correct WAN instance within the DUT’s data model to operate on during specific TR-069 tests. The updated algorithm is more portable and supports IPv4 and IPv6 WAN interfaces for DUT’s implementing the IGD:1, Device:1, or Device:2 root data models.
Resolved an issue in the tr69_230 and od128_test_27.1 test cases where a TCP FIN from a prior connection with the DUT was causing the ACS to clear its request list and end the CWMP session that was currently in progress.
CDRouter SNMP
The default timeout for SNMP requests has been increased from 1 second to 5 seconds. This can be customized with the snmpTimeout testvar. CDRouter will automatically interrupt any SNMP command that does not complete within 5 minutes.
Resolved an issue in the snmp_202 test case that caused the value of sysUpTimeInstance not to be parsed correctly, causing the test to fail.
Resolved an issue in the snmp_204 test case that occurs when the DUT does not return a value for an instance of ifPhysAddress.
CDRouter 10.2 Build 3 December 6, 2016
New Features and Enhancements
CDRouter
Enhanced tag filtering
The Popular Tags feature on the Devices, Configurations, Packages, and Results pages within CDRouter’s web interface now include a text box for filtering the tag list. This makes it much easier to locate specific tags on systems that have a large number of tags available to choose from. This new functionality has also been carried forward to the Admin > Tags page.
Bug Fixes and Notes
CDRouter
Resolved an issue with the software upgrade features available within CDRouter’s web interface on the Admin > System page.
Users that have installed the initial release of CDRouter 10.2 (Build 2) must install this maintenance release (or a subsequent maintenance release) manually following the instructions avaialable here.
Users upgrading from CDRouter 10.0 or 10.1 to this maintenance release (or a subsequent maintenance release) can do so using the software upgrade feature within the web interface.
Removed the Send results to another CDRouter system package option which is no longer supported and was removed in CDRouter 10.0.
The output of “cdrouter-cli -info” has been modified slightly. The OS info was sometimes incomplete. This has been fixed. The OS and kernel lines have been combined. The CPU info line has been moved up, and the “Loaded Tcl version” and “Loaded buddy version” lines have been removed.
The config file constraints have been updated to ignore all LAN side settings when the testvar lanMode is to a value of none.
CDRouter SNMP
- Resolved an issue where the test cases snmp_wan_201 and ipv6_snmp_wan_201 should be skipped when the testvar lanInterface is set to none. These tests require a lan interface to be defined because a lan client is used as part of these tests.
CDRouter 10.2 Build 4 January 9, 2017
New Features and Enhancements
CDRouter
Editable notes field added to Device, Configuration, and Package editors in web UI
All resource types (Devices, Configurations, Packages, and Results) now have an editable Notes field within the web UI. The Notes field supports Markdown making it possible to bold or italicize text, add bullet lists, and add hyperlinks. For a complete list of the formatting options available, please see the Markdown Syntax page.
New testvar to support WAN subnets with different sizes
A new testvar has been added to support routed setups where CDRouter’s and the DUT’s WAN interface subnets are not the same size. The wanIspAssignMask testvar can be used to specify the IPv4 subnet mask that applies to the DUT’s WAN interface. See the Connecting to CDRouter through multiple routers article in our Knowledge Base for more information and examples of how to configure CDRouter in a routed setup.
Bug Fixes and Notes
CDRouter
Resolved an issue with the cdrouter_pppoept_1 and cdrouter_pppoept_2 test cases that could result in bogus DNS servers being applied to the LAN stack in bridge mode configurations.
Resolved an issue with the cdrouter_dmz_200 test. For protocol 47, some fields in the GRE header were not set correctly.
Updated the results export utility to include the config snapshot file in the exported archive.
Resolved an issue with the cdrouter_dhcp_30 test. This test is now automatically skipped when there are no DHCP client options defined.
Resolved a problem in the cdrouter_apps_131 test case in which CDRouter’s STUN server was formatting the CONNECTION-REQUEST-BINDING attribute incorrectly.
CDRouter IPv6
The test cases dslite_10 and dslite_11 test cases require DHCP on the LAN side of the DUT and will now be automatically skipped if the testvar lanMode is set to static.
Updated the ipv6_ndp_2 test case to include one additional second of tolerance when validating the duration between router advertisements from the DUT.
Resolved an issue with the prefix comparison logic in the dhcpv6_pd_60, dhcpv6_pd_61, dhcpv6_pd62, and dhcpv6_pd_63 test cases.
CDRouter TR-069
Resolved an issue with CWMP profile data validation for parameters that have multiple ranges defined. Previously parameter values were only validated against the last range defined for the parameter and not against all ranges defined.
Updated CDRouter’s STUN server to correctly pad out the message data to a multiple of 64 bytes when calculating the MESSAGE-INTEGRITY attribute.
Resolved an issue with SetParameterValues profile tests where white space at the end of a parameter value was being stripped before being written back to the DUT.
This issue was reported specifically for the
Device.WiFi.Radio.{i}.RegulatoryDomain
parameter which has a value that is defined as being exactly three characters in length. The DUT was returning a value ofEU
which CDRouter was then truncating toEU
in the subsequent SetParameterValues RPC sent to the DUT. This led to a CWMP fault which ultimately caused a test failure.Fixed a problem that was causing the BBF.069 “5_029_SOAP_response” test case to report ‘can’t read “target(unknown)”: no such element in array’ when checking the value of the SOAPAction header.
CDRouter SNMP
Updated the snmp-wan.tcl module to use remoteHostIp as the source for SNMP requests, instead of dynamically selecting the source address from the Free Network range.
Resolved an issue when processing fragmented SNMP responses from the DUT.
CDRouter Performance
Resolved an issue in the API where making a call to retrieve a bandwidth metric did not return values for the interface_1 and interface_2 parameters. This issue also resulted in missing information within the performance graph tool tip for all indvidual data points.
Resolved an issue in which using the wlan0 interface on the NTA1000 platform resulted in a fatal error when running the LAN-to-LAN Performance test cases.
Resolved an issue in which running the LAN-to-LAN Performance tests in a configuration where each LAN interface was configured on a different subnet resulted in a fatal error.
CDRouter 10.2 Build 5 February 16, 2017
Bug Fixes and Notes
CDRouter
Resolved an issue with the configuration validation logic that allowed a the testvar lanInterface to be set to the same wireless interface in multiple LAN configuration groups.
Updated the Import utility within the web interface to address issues when loading archives larger than 500MB and some types of archives exported from ealier versions of CDRouter.
CDRouter IPv6
Updated test dhcpv6_130 to resolve a false positive test result when the client did not send a DHCPv6 Renew message as part of step 6 in the procedure.
Updated the mapt_23 test case to verify that the IPv6 Next Header is set to 17 (UDP) or that the packet contains a Fragmentation Header with a Next Header value of 17 (UDP). Previously this test would fail if the received packet contained a Fragmentation Header, even though this is allowed within the specification.
Updated the mapt_40 test case to verify that the IPv6 Next Header is set to 58 (ICMPv6) or that the packet contains a Fragmentation Header with a Next Header value of 58 (ICMPv6). Previously this test would fail if the received packet contained a Fragmentation Header, even though this is allowed within the specification.
Updated the rfc6092_rc_17 and rfc6092_rec_33 test cases to resolve an address scope issue when sending packets on the WAN.
Updated the ipv6_upnp_10, ipv6_upnp_12, and ipv6_upnp_20 test cases to better support implementations that use non link-local addresses in their SSDP LOCATION URLs.
Updated the start procedure to ensure CDRouter’s DHCPv6 server uses the startTimeout testvar to determine how long to wait for the DUT to request an IA_PD prefix, instead of using a fixed 150-second timeout value.
CDRouter TR-069
Updated the tr111_p2_100, 101 & 102 test cases to ensure the second STUN server would properly authenticate and accept the DUT’s Binding Requests.
Resolved a fatal error in tr69_410 when CDRouter is unable to get the DUT’s original NTP settings from a GetParameterValues RPC for the
InternetGatewayDevice.Time
object.
CDRouter Performance
- Resolved a potential divide by 0 error when calculating latency in test cases: perf_6, ipv6_perf_9, perf_lan_9, and ipv6_perf_lan_9.
CDRouter Multiport
- Resolved an issue where CDRouter tried to use an interface marked as a guest interface in ipv6_lan_mp_2. Any interface define with testvar lanGuestMode set to yes should be skipped for this test.
⦿ CDRouter 10.3 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 10.3 Build 1 | March 23, 2017 |
Maintenance Release 1 | CDRouter 10.3 Build 3 | April 19, 2017 |
Maintenance Release 2 | CDRouter 10.3 Build 4 | May 15, 2017 |
Maintenance Release 3 | CDRouter 10.3 Build 6 | June 20, 2017 |
Note: CDRouter 10.3 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 10.3 testvars using the config upgrade utility.
CDRouter 10.3 Build 1 March 23, 2017
New Features and Enhancements
CDRouter DOCSIS
New DOCSIS add-on for CDRouter!
We are pleased to announce a brand new add-on for CDRouter - CDRouter DOCSIS! Check out our website for more information.
CDRouter
New DHCP tests added to the dhcp-s module
Six new DHCP server test cases have been added to the dhcp-s test module: cdrouter_dhcp_server_6, cdrouter_dhcp_server_7, cdrouter_dhcp_server_8, cdrouter_dhcp_server_9, cdrouter_dhcp_server_800, and cdrouter_dhcp_server_801.
New description field for device attachments
A description field has been added for each device attachment (file) to better identify and describe the attachment.
New CDRouter version information
CDRouter version information can now be gathered from several key binaries using a new “-version” flag.
/usr/bin/cdrouter -version /usr/cdrouter/bin/cdrouterd -version /usr/cdrouter/bin/cdrouter-migrate -version
Improvements to the configuration diff tool
The UI for the Configuration Diff tool has been updated.
Only the configuration within the left-side panel is editable. (Previously, both left and right were editable. This change includes removing the ability to ‘move’ changes from the configuration on the left to the configuration on the right via the indicator arrows. Only the indicator arrows that move changes from the configuration on the right to the one on the left are available now.
Also added a warning when trying to use the ‘swap’ feature, if the left-side configuration file has changes from the original. The warning will prompt the user to save the changes that were made to the left-side configuration file before performing the swap of configuration files.
Filter results by test case
The Results index page within the web interface can now be filtered by test case using the Filter by testcase… option:
When a test case filter is applied, only results that contain the specified test case are displayed. The test case status can also be specified (as either All, Run, Passes, Failures, or Flagged). This makes it very easy to display only the test results where the specified test case passed, failed, etc.
A small vertical bar of color is also displayed on the left side of the index to indicate the status of the specified test in each result. A green bar indicates that the test passed and a red bar indicates that the test failed. No color bar indicates that the test is either pending (it has not run yet) or that it was not run (because the run was stopped).
Automatic toggle of packets checkbox on the results page
When updating the log file drop-down filter menu on the Results page, the Packets checkbox now gets toggled accordingly. More specifically, when Pass/Fail or Log Only is selected, the Packets checkbox is automatically cleared. When All Lines or Packets Only is selected, the Packets checkbox is automatically selected.
New device connect functionality added to the Device manager
The Device manager now supports connecting to the DUT’s web management interface from within CDRouter’s web UI. This makes it very easy to configure and manage the different devices connected to a CDRouter system without having connect a laptop or PC to them.
This feature relies on information from a number of new fields that must be populated for each device on the Devices page, including:
- Power On Command
- Power Off Command
- Management URL
- Allow connections to device over HTTPS without valid certs
- Configure management interface address
- Interface
- Address
ThePower On Command
andPower Off Command
fields are used to specify the command(s) required to remotely turn the DUT on or off. This would typically require some kind of network power distribution unit.The
Management URL
is the URL normally used to access the DUT’s web interface.If selected, the
Configure management interface address
checkbox will temporarily set up an IP address on an interface on the host machine, using the information from theInterface
andAddress
fields. This can conveniently use an interface that is normally connected to the DUT’s LAN port for testing. This interface cannot be used this way when a package is running, and any IP address will be automatically removed when a package is launched.Regardless of which method is used to connect to the device, once connected, the DUT’s web interface can be accessed by clicking on the “Connected” button or the “View management interface” link. If a package is launched while connected, the connection will be removed.
Additional information provided in error messages for UPnP tests
When parsing XML in UPnP tests, additional information (the path being searched) is now provided if a given element/attribute is not found.
CDRouter TR-069
New test module to verify CWMP connection request robustness
The new tr69_conn_req module adds 14 new test cases to verify that the DUT responds (or does not respond) correctly to TR-069 Connection Request attempts under a variety of conditions. This module was developed as a result of the D1000 modem vulnerability discovered in November of 2016.
Support for RFC 6265 style cookies
CDRouter’s ACS now supports RFC 6265 style cookies, as required by TR-069 Amendment 5. Test testvar acsCookieMode can be set to rfc6265 to enable this behavior. Note that rfc6265 is also the new default value for this testvar.
Support for dual-stack ACS
CDRouter’s ACS can now support CWMP sessions over IPv4 and IPv6 at the same time. The optional testvar acsDualStackIp must be explicitly defined in the config file with the secondary address of the ACS. CDRouter will automatically resolve DNS requests for acs.qacafe.com with the appropriate address.
CDRouter Performance
Additional fields added to Performance CSV files
Six new fields have been added to the CSV files generated when performance tests are run. These fields are:
- protocol: enum string “TCP” or “UDP”
- direction: enum string “upload”, “download”, or “lantolan”
- metric2: floating point number [loss percentage, will be 0 for all TCP tests]
- units2: The string “Percentage”
- device1: the physical interface where perf client is located
- device2: the physical interface where perf server is located
There will be a performance CSV file created in the results directory for the following tests:perf.tcl perf-v6.tcl perf-lan.tcl perf-lan-v6.tcl perf_1 ipv6_perf_1 perf_lan_1 ipv6_perf_lan_1 perf_2 ipv6_perf_2 perf_lan_2 ipv6_perf_lan_2 perf_3 ipv6_perf_3 perf_lan_3 ipv6_perf_lan_3 perf_4 ipv6_perf_4 perf_lan_4 ipv6_perf_lan_4 perf_5 ipv6_perf_5 perf_lan_5 ipv6_perf_lan_5 perf_6 ipv6_perf_6 perf_lan_6 ipv6_perf_lan_6 perf_7 ipv6_perf_7 perf_lan_7 ipv6_perf_lan_7 perf_8 ipv6_perf_8 perf_lan_8 ipv6_perf_lan_8 The information in these CSV files is also available as result metrics using CDRouter’s API.
CDRouter Nmap
New version of Nmap
CDRouter now uses version 7.40 of Nmap.
New Test Modules and Test Cases
CDRouter
- New DHCP Server test cases
TEST: cdrouter_dhcp_server_6
MODULE: dhcp-s.tcl
DESCRIPTION: Verify DHCP server returns same IP address when client restarts
TEST: cdrouter_dhcp_server_7
MODULE: dhcp-s.tcl
DESCRIPTION: Verify DHCP server returns same IP address when client releases then restarts
TEST: cdrouter_dhcp_server_8
MODULE: dhcp-s.tcl
DESCRIPTION: Verify DHCP server returns same IP address when client restarts using Requested IP Address option
TEST: cdrouter_dhcp_server_9
MODULE: dhcp-s.tcl
DESCRIPTION: Verify DHCP server returns same IP address when client releases and restarts using Requested IP Address option
TEST: cdrouter_dhcp_server_800
MODULE: dhcp-s.tcl
DESCRIPTION: Verify DHCP server does not become exhausted after a large number of DHCP restarts
TEST: cdrouter_dhcp_server_801
MODULE: dhcp-s.tcl
DESCRIPTION: Verify DHCP server does not become exhausted after a large number of DHCP release then restarts
CDRouter TR-069
New TR-069 connection request test module
MODULE: tr69_conn_req.tcl DESCRIPTION: TR-069 tests for TCP Connection Request NEW TEST CASES: 14
Bug Fixes and Notes
CDRouter
In previous versions of CDRouter, when re-launching a package from the Results page within the web UI, the device snapshot from that test run would be used instead of the device currently associated with the package. This issue has been resolved. When re-launching a package from the Results page the current configuration file and device associated with that package are now used.
Resolved an issue when importing packages into CDRouter that contain testlists. Previously the the link between the test package and test list would be lost during the import process. This has been fixed so that imported packages are still linked to any testlists they may contain.
When decoding a packet with an unknown ethernet proto type field, CDRouter had been displaying the unknown type field in decimal rather than hexadecimal. This has been fixed.
CDRouter no longer supports 5GHz WAN Access Point (AP) mode for 5GHz wireless on the WAN testing (2.4GHz AP mode for wireless on the WAN is still supported). The testvar wanApBand has now been obsoleted and removed from the default config file. In addition, all 5GHz channels have been removed from the wanApChannel testvar.
Updated the Import utility to resolve an error when attempting to import some of the items in an archive while skipping others.
In prior versions of CDRouter, an error would be generated if CDRouter’s LAN client was unable to renew its DHCP lease during a test run. This situation could happen if the DUT’s DHCP server stopped responding or crashed. CDRouter has been updated to handle this situation more gracefully.
Resolved an issue with the vservice test module when running in multiport LAN configurations with different subnets. Previously these tests were not subnet aware, and would not work properly if multiple LAN subnets were defined. This issue has been resolved and these tests now work as expected in multi-subnet configurations.
Resolved an issue with the Config Diff tool where every line was highlighted when comparing a Config to the default Config. This issue was introduced in CDRouter 10.2 and has been resolved so that only lines that different are now highlighted.
The cdrouter_firewall_100, cdrouter_firewall_101, and cdrouter_firewall_110 test cases now listen for leaked traffic on all configured LAN interfaces. Previously these tests would only listen for leaked traffic on the primary LAN interface, even if multiple LAN interfaces and subnets were defined in the configuration file.
CDRouter now uses a newer version of tcllib under the hood (version 1.18).
CDRouter now uses a newer version of openssl under the hood (version 1.0.2k).
The dhcpInform and dhcpRapidCommit testvars previously had default values of “yes”. Since these are not commonly supported functions, their default values are now set to “no”.
Previously, the cdrouter_dhcp_20 test would be skipped if there were no LAN interfaces configured (lanInterface = none). However, since this is a WAN side test, this test is now able to run in this situation.
A bug has been fixed where setting lanInterface to “none” caused an error in certain configurations.
CDRouter now uses the tDOM Tcl package when parsing and manipulating XML documents. This replaces the TclDOM and TclXML packages which were used previously. The tDOM package is more efficient and should improve XML processing performance and speed in tests that rely on XML such as TR-069 tests, UPnP tests, etc.
CDRouter’s WAN offload interface code has been refactored. These changes improve speed and performance when running tests that utilize offload interfaces on the WAN such as Nmap, SNMP, TR-069, etc.
Certain warning messages were not formatted and highlighted the same as others. This has been fixed.
Looking at a result shows the configuration and package snapshots used. Clicking on either the configuration or package snapshots allows copying the snapshot to a new resource. If a resource with that name already exists, a “(copy N)” suffix will be added to the new name. This suffix was getting added even if no resource with that name existed, which was not necessary. This has been fixed.
When clicking the Restart button on CDRouter’s home page, the most recent result will be run again. There was a bug where the snapshot of the config and package were being used, rather than the actual, current config and package. This has been fixed.
In previous releases, if multiple IP addresses are assigned to the management interface (typically eth0) with the same IP address but different netmasks, CDRouter could fail to start. This issue has been resolved.
Trying to set the wirelessCountryCode testvar on NTA1000 v5 systems would sometimes fail, resulting in a warning message being displayed in the start log. To resolve this issue, a full “yum update” must be performed on the NTA1000 system. To do this, simply open a terminal window, then as root run the following commands:
yum reinstall crda yum -y update
This may take several minutes to complete. Also note that performing the yum update requires the NTA1000 system to be connected to the internet.
CDRouter IPv6
Resolved a fatal error in the mapt_23 test case when processing IPv6 fragments.
Updated the test cases ipv6_ndp_30, ipv6_ndp_31, ipv6_ndp_32, and ipv6_ndp_33 to include one additional second of tolerance when validating the duration between router advertisements from the DUT.
CDRouter Multiport
- Resolved a fatal error in the test cases cdrouter_ripwan_5, cdrouter_ripwan_8, cdrouter_ripwan_9, cdrouter_ripwan_20, cdrouter_ripwan_50, and cdrouter_ripwan52.
CDRouter TR-069
Modified configuration rules for how to enable the ability to run TR-069 tests.
The default value of the supportsCWMP testvar has been changed to “no”. In order to enable and run the TR-069 addon(s), your CDRouter configuration file must have supportsCWMP uncommented and explicitly set to “yes”. In previous versions of CDRouter, supportsCWMP was assumed to be “yes” if the testvar was commented out and if the acsIp testvar was also explicitly set.
If the testvar supportsCWMP is not in your configuration file, you can use CDRouter’s Configuration Upgrade Utility to have it inserted automatically. Information on how to use this tool may be found in this KB article.
The acsCaCertPath testvar has been updated to allow an empty string to be specified. This will prevent the ACS from transmitting any CA certificates when negotiating the SSL connection.
The od128_test_35.1 and od128_test_35.6 test cases have been updated to resolve an issue with the way the ACS processes the DUStateChangeComplete RPC and queries the DUT’s DeploymentUnit table.
The tr69 test module can now be run against non-IGD devices such as STBs and VoIP ATAs. Previously this test module would be skipped if the tr69DeviceType testvar was set to a value of STB or VoIP. Now only tests tr69_50 through tr69_63 will be skipped since they require IGD functionality.
CDRouter SNMP
Two new testvars have been introduced, snmpManagerIp and snmpManagerIpv6. These specify the source address that CDRouter will use when making SNMP requests from the WAN network. CDRouter no longer uses the “Free Network” range for SNMP requests.
Resolved an issue in various SNMP tests that were previously unable to set a value to an empty string. Empty string values are now supported.
The ipv6_snmp_wan_201 and ipv6_snmp_wan_204 test cases no longer send ARPs to determine the DUT’s LAN and WAN MAC addresses. The DUT’s MAC addresses are now determined automatically via NDP in these test cases.
CDRouter 10.3 Build 3 April 19, 2017
New Features and Enhancements
CDRouter
New disk usage warning
If the disk partition where CDRouter stores its results gets too full, a banner will be displayed on the Results page to indicate this.
New DHCP server test cases for verifying the Requested IP Address option
Two new test cases, cdrouter_dhcp_server_10 and cdrouter_dhcp_server_11, have been added to the dhcp-s test module. These tests verify the DUT’s DHCP server behavior when responding to clients that request valid and invalid addresses via the DHCP Requested IP Address option.
CDRouter TR-069
New port mapping test cases that verify LeaseDuration
Two new tests, tr69_54 and tr69_64, have been added to the tr69 test module. These tests are designed to verify that the DUT properly handles port mappings that are specified with a non-zero duration using the PortMappingLeaseDuration parameter.
CDRouter IPv6
New v6 testvars for outbound firewall
The existing firewallOutBlockedTcpPorts, firewallOutBlockedUdpPorts, and firewallOutBlockedIpProtos testvars are now used just for v4 testing. There are three new testvars dedicated to v6 testing: ipv6FirewallOutBlockedTcpPorts, ipv6FirewallOutBlockedUdpPorts, and ipv6FirewallOutBlockedUdpPorts.
New Test Modules and Test Cases
CDRouter
- New DHCP Server test cases
TEST: cdrouter_dhcp_server_10
MODULE: dhcp-s.tcl
DESCRIPTION: Verify DHCP server returns requested IP address when new client uses Requested IP Address option
TEST: cdrouter_dhcp_server_11
MODULE: dhcp-s.tcl
DESCRIPTION: Verify DHCP server does not return an address when invalid Requested IP Address option is used
CDRouter TR-069
- New TR-069 port mapping tests
TEST: tr69_54
MODULE: tr69.tcl
DESCRIPTION: Verify dynamic TR-069 TCP port mapping is removed after lease duration expires
TEST: tr69_64
MODULE: tr69.tcl
DESCRIPTION: Verify dynamic TR-069 UDP port mapping is removed after lease duration expires
Bug Fixes and Notes
CDRouter
Resolved an issue with the new device connect feature in which the management IP address was not getting removed from the interface when CDRouter was restarted.
Resolved an issue where Device information would be removed when bulk editing packages within the web UI.
CDRouter’s LAN DHCP clients will now automatically clear any existing addresses when they are restarted without performing a DHCPRELEASE. This change was made to ensure that all DHCPDISCOVER messages, regardless of which state the client is in, are sent with with a source address of 0.0.0.0 and not the previous address. This change will resolve an issue associated with this behavior that was reported in the dns_220 test case.
Updated the cdrouter_dhcp_server_8 and cdrouter_dhcp_server_9 test cases to include only one Requested IP Address option (DHCP option 50) in the DHCPREQUEST messages sent by CDRouter’s LAN DHCP client.
The MAC filtering tests in the mac-filter test module have been updated to now produce a PASS result if the DUT does not allow clients with restricted MAC addresses to associate wirelessly.
The firewallOutBlockedIpProtos testvar now limits values to 0-255. Values outside this range will show an error when running a config check.
CDRouter IPv6
Resolved an issue with the mapt_23 and mapt_40 test cases when processing fragments.
Added 1 second to the Router Advertisement timeout that CDRouter uses in various test cases when waiting for RAs from the DUT or validating that RAs are sent by the DUT when expected.
Modified the constraint logic for the ipv6LanIp to no longer allow all zeros for the host ID portion. The all zeros host ID represents an anycast address for the given prefix which has special meaning and should not normally be used by the DUT.
CDRouter’s DHCPv6 server on the WAN has been updated to automatically age out (send lifetimes of zero) for any prefixes that are not currently in use when processing received messages from the DUT’s DHCPv6 client. This update should resolve an issue with some client implementations while running the dhcpv6_60 test case.
CDRouter TR-069
CDRouter’s ACS no longer generates the quoted string syntax for the qop and algorithm URL parameters in the WWW-Authenticate header during CWMP connection requests, as required in Section 3.4 of RFC 7616. In previous releases, CDRouter’s ACS generated the quoted string syntax for these parameters which was not compatible with some CWMP implementations.
Updated tests tr69_conn_req_10, tr69_conn_req_11, tr69_conn_req_12, tr69_conn_req_13, and tr69_conn_req_15 to generate a PASS result if the DUT responds to the connection request with an HTTP 405 “Method Not Allowed”.
Resolved a fatal error in the tr69_conn_req_4 test case with some connection request URLs.
Updated the tr111_p1_20, tr111_p1_21, tr111_p1_22, tr111_p1_23, and od128_test_24.1 test cases to upper-case the DeviceManufacturerOUI suboption of DHCP option 125 in all DHCPREQUEST messages sent by CDRouter’s LAN clients. The DeviceManufacturerOUI suboption is based on the DeviceInfo.ManufacturerOUI parameter which is defined as having an all upper-case value according to Section F.2.5 of TR-069 Amendment 5. Previous versions of CDRouter used lower-case values for this suboption.
Resolved an issue with the tr69_conn_req_4 test case. This test was not being cleaned up properly in some failure modes. This resulted in an invalid connection request URL being used in the following test case.
Updated and enhanced the test case titles and descriptions in the tr69_conn_req test module.
Updated the ACS to handle a malformed DUStateChangeComplete message that was causing a fatal error. If the DUT encodes the Results OpResultStruct element as an array CDRouter will now log an Fail messge and continue with the test.
Updated the tr69_conn_req test module to better handle IPv6 based connection request URLs. This update resolves a few different instances of fatal errors in this module when running over IPv6.
Resolved an issue with the od128_test_35.1 and od128_test_35.6 test cases. In previous versions these test cases were hard coded to look up parameters from the Device root data model during validation. When these tests were run against InternetGatewayDevice implemenations parameter validation would fail because of this issue.
CDRouter 10.3 Build 4 May 15, 2017
Bug Fixes and Notes
CDRouter
Relaxed the skip logic constraints to allow some of the DHCP Server tests in the dhcp-s module to run if the the configured DHCPv4 pool size is 1. In previous versions the entire module would be skipped with this configuration setting. The DHCPv4 pool size is determined by the values in dhcpClientStart and dhcpClientEnd.
Resolved an issue with the ‘obtain IP address’ timeout value when starting a new DHCP client on the LAN for the test cases in the dhcp-s module.
Resolved an issue with the way names are generated when copying configs and other resources in the web interface. CDRouter now correctly leaves the original resource name intact and appends ”(copy 1)” to the end.
The configuration associated with a saved testlist can now be cleared by selecting the “Please choose a config to use…” option when editing the package within the web UI.
Resolved an issue with the wireless scan and association logic used during the start up procedure when wireless interfaces are configured.
Resolved an issue with the cdrouter_dhcp_server_31 test. CDRouter was incorrectly failing the test when the DUT sent back a DHCPACK in response to a DHCPDISCOVER with the Rapid Commit flag.
CDRouter will now skip test modules mapt and dslite if testvar supportsIPv4 is set to “no”. [LH #3239]
CDRouter IPv6
- Resolved an issue in the dhcpv6_server_9 test case to only verify the IPv6 servers defined (uncommented) in the configuration file. Up to four (4) IPv6 DNS server may be defined, using the testvars ipv6WanDnsServer, ipv6WanBackupDnsServer, ipv6WanBackupDnsServer2, and ipv6WanBackupDnsServer3.
CDRouter TR-069
Resolved an issue introduced in release 10.3 with the SOAP headers generated by CDRouter. The cwmp version string in the SOAP header is based on the value of the cwmpProtocolVersion testvar. If this testvar is set to 1.0, the SOAP header will include cwmp-1-0. If this testvar is set to 1.1, the SOAP header will include cwmp-1-1. If ths testvar is set to 1.2, 1.3, or 1.4, the SOAP header will include cwmp-1-2.
Updated the tr69_conn_req_30, 31, 32 test cases to verify a successful connection request prior to initiating the DoS attack in each test. This resolves an error that would occur when running these tests in isolation.
If the Name parameter for the primary WAN instance is not writeable, the tr69_conn_req_40 test case will now use the ProvisioningCode parameter instead to test for the TR-069 code injection vulnerability.
CDRouter BBF.069
- Resolved fatal errors in the 5_095_xml_namespace_prefix_validation and 5_073_SPA_incorrect_param_name tests. These fatal erros are related to the updated XML parser included in release 10.3 Build 1 of CDRouter.
CDRouter 10.3 Build 6 June 20, 2017
Bug Fixes and Notes
CDRouter
Added constraints for staticRoute testvars staticRouteLanNetwork, staticRouteLanNextHop, staticRouteWanNetwork, staticRouteWanNextHop such that now the config checker verifies that the “Network” destination is not on the same subnet as the interface and the “NextHop” is on the same network as the sending interface.
Added option
-new-testpath
in cdrouter-cli -help output.Updated the tests in the firewall test module to better support configurations that utilize virtual services on multiple unique LAN subnets.
Resolved an issue with the cdrouter_app_17 test case that could lead to an invalid test case failure. This test had an issue parsing port numbers that were a single digit from the FTP header.
Resolved an issue with the installer that reported an error/warning when installing CDRouter 10.3 Build 4 on an Ubuntu operating system.
The ipsecTunnelKeyType testvar will now generate a config error if it is set to a value of IKE and the system does not have the CDRouter IKE add-on enabled within its license.
Added support for vservice tests to be compatible with multiport LAN config.
The log file generated using cdrouter-diag script will no longer include the cdrouter.log file to reduce its overall size.
Modified the cdrouter_dhcp_server_540 test case to allow an ICMP Echo sent to the wrong MAC address to be counted as a successful probe and therefore PASS the test.
CDRouter IPv6
Updated CDRouter to automatically skip the dhcpv6_150 test if the wanDhcpv6ClientOptionCode testvar is not defined.
Updated the dhcpv6_20 and dhcpv6_pd_20 test cases to be more strict in what DHCPv6 messages it expects to receive from a DUT. These tests will now report a failure earlier if CDRouter’s DHCPv6 server does not receive a Renew/Request message from the DUT when expected.
CDRouter BBF.069
This release of CDRouter requires BBF.069 Release 8.1.
For a complete list of the changes associated with BBF.069 Release 8.1, please see the release notes.
⦿ CDRouter 10.4 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 10.4 Build 2 | August 16, 2017 |
Maintenance Release 1 | CDRouter 10.4 Build 3 | September 14, 2017 |
Maintenance Release 2 | CDRouter 10.4 Build 4 | October 3, 2017 |
Note: CDRouter 10.4 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 10.4 testvars using the config upgrade utility.
CDRouter 10.4 Build 2 August 16, 2017
New Features and Enhancements
CDRouter
Support for layer 3 GRE tunnels on the WAN
CDRouter now supports layer 3 IPv4 GRE tunnels on the WAN, as defined in RFC 2784. For more information, please see the CDRouter User Guide.
A new gre test module, with 16 test cases, has also been added. This test module can be used to validate GRE tunnel behavior on the DUT. [LH #3260]
Username/password replaces API token on import page
In previous releases the API token of the remote system was required when importing results from another CDRouter system. With this release the username and password of the remote system can now also be used since it is usually easier to remember.
Username/password fields added to cdrouter command
When automatic login has been disabled, the
cdrouter
command line tool requires the-token
argument be provided for authentication. Two new arguments have now been added that can be used in place of-token
:-username
and-password
. These can be more convenient and easier to remember than the token field. In addition, two new environment variables are now recognized as well: CDROUTER_API_USERNAME and CDROUTER_API_PASSWORD. Any combination of environment variables or command line arguments can be used, but the command line arguments take priority. Also, @FILE values can be provided for-password
or CDROUTER_API_PASSWORD, in which case the actual password value will be read from FILE.New location for CDRouter TCL test modules
Prior to CDRouter 10.4, the location on disk for all CDRouter TCL test module files was
/usr/share/doc/cdrouter
. In order to improve CDRouter’s directory layout, the new location is/usr/cdrouter/tests
. For backward compatability, CDRouter installs a symbolic link for/usr/share/doc/cdrouter
that points to/usr/cdrouter/tests
.BBF.069 add-on now bundled with CDRouter
Please see the BBF.069 section below for more information.
New IPv4 test cases for DNS bit 0x20 technique
Two new test cases, dns_420 and dns_tcp_420 have been added to verify the DUTs functionality in regards to the DNS bit 0x20 technique, as specified in this IETF draft.
Support for ForceRenew Nonce Authentication
CDRouter now supports DHCP ForeceRenew Nonce Authentication, as defined in RFC 6704. DHCP authentication can be enabled within CDRouter by setting the new testvar supportsDhcpAuth to a value of yes. In addition, three new test cases have been added to dhcp-c.tcl module to verify the DUT’s DHCP authentication functionality: cdrouter_dhcp_32, cdrouter_dhcp_33, and cdrouter_dhcp_34. [LH #3074]
Support for configuring the 802.11 mode that a LAN client uses to associate
CDRouter’s simulated LAN clients can now be configured to associate using a specific 802.11 mode. Previously the LAN clients only supported ‘auto’ where they would choose the ‘best’ mode offered by the AP/SSID with which they were attempting to associate. The new testvar lan80211Phy can be used to select the 802.11 mode for the LAN client. [LH #2786]
New test case for verifying DHCP server vendor defined options
The new cdrouter_dhcp_server_30 test case has been added to the dhcp-s test module. This test is designed to verify that the DUT’s DHCP server includes specific vendor defined options as defined by the new testvars lanDhcpClientOptionCode and lanDhcpClientOptionData. [LH #3253]
New test case for verifying DHCP server options for DNS servers
The new cdrouter_dhcp_server_630 test case has been added to the dhcp-s test module. This test is designed to verify that the DUT’s DHCP server returns the correct DNS servers. [LH #3253]
CDRouter IPv6
New IPv6 test cases for DNS bit 0x20 technique
Two new test cases, ipv6_dns_420 and ipv6_dns_tcp_420 have been added to verify the DUTs functionality in regards to the DNS bit 0x20 technique, as specified in this IETF draft.
Support for authenticated DHCPv6 Reconfigure with Rebind
CDRouter now supports Authenticated DHCPv6 Reconfigure with Rebind as defined in RFC 6644 using the authentication mechanism described in Section 21.5 of RFC 3315. In addition, five new test cases have been added to the dhcpv6-c test module to verify the DUT’s DHCPv6 authentication functionality: dhcpv6_32, dhcpv6_33, dhcpv6_34, dhcpv6_35, and dhcpv6_36. [LH #3075]
CDRouter TR-069
New CWMP Bootstrap Scenario available at start of test run
It is now possible to have CDRouter’s ACS execute a custom set of CWMP methods against the DUT at the beginning of each test run. The new testvar, cwmpScenarioBootstrap, can be configured to specify the name of a “scenario” script file containing the commands you want to run. The script file may contain any of the scenario commands available with CDRouter’s CWMP Scenario Testing feature. This can be used to make additional configuration changes on the DUT before running any tests. The ACS will run the commands from the CWMP Scenario file after the DUT has initialized and contacted the ACS for the first time. The CDRouter TR-069 User Guide contains more information on how to create a CWMP Scenario script file.
CDRouter BBF.069
CDRouter BBF.069 add-on included in main CDRouter installation
In CDRouter 10.4, the CDRouter BBF.069 add-on has been fully integrated with the rest of the CDRouter installation and is no longer distributed as a separate package. Customers who have purchased BBF.069 will now receive updates automatically when upgrading to new versions of CDRouter.
As part of this integration, it is no longer necessary to copy additional testvars into your config file in order to run BBF.069 tests. The latest BBF.069 tests have been updated to use testvars that already exist within CDRouter wherever possible, and a small set of new testvars prefixed with
'bbf069'
are automatically included in CDRouter’s configuration file. Please see the CDRouter BBF.069 User Guide for details on these changes and to upgrade your existing config files.
CDRouter Performamce
New graph scaling feature
The bandwidth performance graph within CDRouter’s web UI now supports setting the upper Y-axis value range from the default of 1,000Mb/sec to either 100 or 10,000.
New application latency tests
Added three new test cases to each of the IPv4 and IPv6 modules to help measure the average latency of a LAN client making DNS queries, performing DHCP renews, and restarting DCHP entirely. These six new test cases perf_10, perf_11, perf_12, ipv6_perf_10, ipv6_perf_11, and ipv6_perf_12.
New performance requirements
Beginning with CDRouter 10.4, a 3.10.103 or higher kernel is required to run any of the performance tests. If performance tests are being skipped due to an older kernel, please refer to this Knowledge Base article for instructions on updating this.
CDRouter DOCSIS
Support for CM provisioning over IPv6
CDRouter DOCSIS now supports provisioning of the CM over IPv6. To enable IPv6 provisioning, the new testvar docsisIpProvisioningMode must be set to a value of ipv6-only. For more information, please see the CDRouter DOCSIS user guide.
New IPv6 specific CM test modules
Four new test modules have been added to the CDRouter DOCSIS add-on: dhcpv6-docsis, firewall-docsis-v6, nmap-docsis-v6, and snmp- docsis-v6. These modules are designed to verify the IPv6 functionality of a CM when operating in an IPv6 enabled provisioning mode.
New Test Modules and Test Cases
CDRouter
New GRE test module
MODULE: gre.tcl DESCRIPTION: IPv4 over GRE related test cases NEW TEST CASES: 16
New DNS test cases for bit 0x20 technique
TEST: dns_420 MODULE: dns.tcl DESCRIPTION: Verify DNS proxy handles use of bit 0x20 in DNS labels
TEST: dns_tcp_420 MODULE: dns-tcp.tcl DESCRIPTION: Verify DNS proxy handles use of bit 0x20 in DNS labels
New DHCP server test case to verify vendor defined options
TEST: cdrouter_dhcp_server_30 MODULE: dhcp-s.tcl DESCRIPTION: DHCP server includes vendor defined options
New DHCP server test case to verify returned DNS servers
TEST: cdrouter_dhcp_server_630 MODULE: dhcp-s.tcl DESCRIPTION: DHCP server returns correct DNS server(s)
New tests for DHCP Forcerenew Nonce Authentation
TEST: cdrouter_dhcp_32 MODULE: dhcp-c.tcl DESCRIPTION: client supports DHCP Forcerenew Nonce Authentication
TEST: cdrouter_dhcp_33 MODULE: dhcp-c.tcl DESCRIPTION: client ignores DHCPFORCERENEW without Authentication option
TEST: cdrouter_dhcp_34 MODULE: dhcp-c.tcl DESCRIPTION: client ignores DHCPFORCERENEW authenticated with incorrect nonce
CDRouter IPv6
New IPv6 DNS test cases for bit 0x20 technique
TEST: ipv6_dns_420 MODULE: dns-v6.tcl DESCRIPTION: Verify DNS proxy handles use of bit 0x20 in DNS labels
TEST: ipv6_dns_tcp_420 MODULE: dns-tcp-v6.tcl DESCRIPTION: Verify DNS proxy handles use of bit 0x20 in DNS labels
New test cases for Authenticated DHCPv6 Reconfigure with Rebind
TEST: dhcpv6_32 MODULE: dhcpv6-c.tcl DESCRIPTION: Verify client supports DHCPv6 Reconfigure Key Authentication
TEST: dhcpv6_33 MODULE: dhcpv6-c.tcl DESCRIPTION: Verify client ignores DHCPv6 Reconfigure without Authentication option
TEST: dhcpv6_34 MODULE: dhcpv6-c.tcl DESCRIPTION: Verify client ignores DHCPv6 Reconfigure with incorrect Reconfigure Key
TEST: dhcpv6_35 MODULE: dhcpv6-c.tcl DESCRIPTION: Verify client supports DHCPv6 Reconfigure with Rebind request
TEST: dhcpv6_36 MODULE: dhcpv6-c.tcl DESCRIPTION: Verify client ignores DHCPv6 Reconfigure requesting a Solicit
CDRouter Performance
New IPv4 DHCP Renew latency, DHCP Restart latency, and DNS query latency tests
TEST: perf_10 MODULE: perf.tcl DESCRIPTION: IPv4 DHCP renew latency test
TEST: perf_11 MODULE: perf.tcl DESCRIPTION: IPv4 DHCP restart latency test
TEST: perf_12 MODULE: perf.tcl DESCRIPTION: IPv4 DNS query latency test
New IPv6 DHCP Renew latency, DHCP Restart latency, and DNS query latency tests
TEST: ipv6_perf_10 MODULE: perf-v6.tcl DESCRIPTION: IPv6 DHCP renew latency test
TEST: ipv6_perf_11 MODULE: perf-v6.tcl DESCRIPTION: IPv6 DHCP restart latency test
TEST: ipv6_perf_12 MODULE: perf-v6.tcl DESCRIPTION: IPv6 DNS query latency test
CDRouter DOCSIS
New DHCPv6 client module for CMs
MODULE: dhcpv6-docsis.tcl DESCRIPTION: DOCSIS CM DHCPv6 client related tests NEW TEST CASES: 22
New IPv6 firewall module for CMs
MODULE: firewall-docsis-v6.tcl DESCRIPTION: IPv6 firewall tests including port scans against the CM NEW TEST CASES: 6
New IPv6 SNMP module for CMs
MODULE: nmap-docsis-v6.tcl DESCRIPTION: Nmap based IPv6 portscan tests from the WAN to the CM NEW TEST CASES: 16
New IPv6 Nmap module for CMs
MODULE: snmp-docsis-v6.tcl DESCRIPTION: IPv6 SNMP related test cases against DOCSIS CM on WAN NEW TEST CASES: 18
Bug Fixes and Notes
CDRouter
Resolved an issue with CDRouter’s web UI where in some cases, trying to create a new configuration file or edit an existing configuration file would cause the browser to repeatedly reload the configuration page. [LH #3276]
CDRouter will now print a warning message in the log if any configured test interface unexpectedly changes state or is disconnected during a test run. [LH #2854]
CDRouter will now skip test modules upnp-v6 and rip-wan along with test cases tr69-50 through tr69-64 when the testvar wanMode is set to dslite. [LH #3297]
The test case rfc4787_req_8 will now run if the testvar natMode is set to port-restricted. Previously this test case would be skipped in this configuration. [LH #3313]
Resolved an issue with test case dslite_20 where CDRouter improperly fragmented its outgoing IPv4 packet on the LAN side before sending it to the DUT. CDRouter now sends the packet on the LAN without fragmentation. [LH #3296]
Resolved an issue with the cdrouter_mptcp_2 test case that would result in an inconsistent multipath TCP option length that would lead to a test failure. This issue would only appear if the test was repeated multiple times during a single test run. [LH #3301]
Resolved an issue where an additional LAN client that was created during a test was not properly deleted at the end of the test. This was causing the next test that required an additional LAN client to generate a fatal error. [LH #3279]
The multicastToUnicast testvar has been obsoleted and is no longer used by CDRouter. In prior releases, CDRouter’s wireless interfaces would drop IPv6 multicast packets containing a unicast MAC address unless this testvar was explicitly set to “yes”. Per RFC 6085, CDRouter no longer drops multicast packets containing a unicast MAC address that matches CDRouter’s receiving interface. Setting this testvar no longer has any effect.
The default value of the pppoeServiceName has been changed from ‘qacafe’ to ‘any’ to improve out-of-the-box compatibility with more CPE devices. Any PPPoE based configuration files that relied on the previous default value must now be updated to explicitly set the pppoeServiceName testvar to a value of ‘qacafe’. [LH #3273]
CDRouter IPv6
The ipv6_upnp_35, ipv6_upnp_36, ipv6_upnp_40, ipv6_upnp_41, ipv6_upnp_45, ipv6_upnp_50, ipv6_upnp_100, ipv6_upnp_igd2_35, ipv6_upnp_igd2_36, ipv6_upnp_igd2_40, ipv6_upnp_igd2_41, ipv6_upnp_igd2_45, ipv6_upnp_igd2_50 and ipv6_upnp_igd2_100 will now be skipped if the DUT is not running IPv4 on the WAN. Although these tests are part of the CDRouter IPv6 add-on, they only use IPv6 to send UPnP commands to the DUT. The DUT still needs to have IPv4 enabled since many of the tests are creating IPv4 port-mappings.
The ipv6_upnp_12 test was unable to send a packet from the remoteHost due to no valid source address if a link local address was used in the XML attributes. This has been resolved. [LH #3294]
Resolved an issue with the ipv6_firewall_506 test case in which the packet with source address of :: (all zeros) was not actually being transmitted. [LH #3290]
The ipv6_upnp_20 test was modified to properly handle square brackets when parsing a relative IPv6 URL in a UPnP message. [LH #3283]
CDRouter’s IPv6 stacks will now automatically join the solicited-node multicast group for all configured unicast source addresses. This will happen dynamically as stacks are created during a test run.
In addition, CDRouter’s WAN stack will join the link-local and site-local scope all routers multicast groups, ff02::2 and ff05::2, respectively, if configured to act as a router. By default all multicast joins will be performed using MLDv2. CDRouter can be configured to use MLDv1 instead by setting the testvar mldVersion to a value of “1”.
Prior to this release CDRouter’s stacks were not joining these multicast groups. [LH #3293]
The default value of the mldVersion testvar has been changed from 1 to 2.
Added a new testvar ipv6WanAssignPrefixLen which specifies the prefix length learned by the relayed DHCPv6 network.
CDRouter TR-069
Updated some test cases to honor the boolen type value defined with the testvar tr69ForceBoolean when performing sets.
Resolved an issue where CDRouter was not displaying the contents of the HTTP 404 message in the log file when the DUT makes a bad GET request to the TR-069 file server.
Resolved an issue where CDRouter’s DHCP server would not disable the ACS URL Discovery feature when the acsDiscoveryUrl testvar was set to “none” in some configurations. [LH #3280]
CDRouter BBF.069
Previously there was a bug where all test cases within the BBF.069 add-on would run if supportsCWMP testvar was set to
no
. In this build all the test cases in BBF.069 add-on will be skipped if supportsCWMP testvar is set tono
.Resolved an issue were certain automated tests were being labeled as “Manual”, and were being skipped during normal test runs. The bbf069-requires-manual-testing label was updated so that only tests requiring manual intervention will be skipped during normal test runs. [LH #3295]
CDRouter Performance
Resolved an issue where CDRouter’s configuration constraint check did not properly check against the max allowed value for the testvars perfDownloadMaxLatency, perfUploadMaxLatency, and perfLantoLanMaxLatency in the Wireless subsection within the CDRouter Performance Add-On portion of the config file. [LH #3323]
Increased the max value allowed for the testvars perfDownloadMaxLatency, perfUploadMaxLatency, and perfLantoLanMaxLatency to 2,000,000 microseconds (2 seconds). [LH #3323]
CDRouter 10.4 Build 3 September 14, 2017
Bug Fixes and Notes
CDRouter
Resolved an issue with the import utility. When importing a test run that included a device, the package snapshot for that result would not reference the correct, imported device ID. [LH #3303]
Resolved an issue in CDRouter’s “export as csv” option on the Results page within the web UI. In previous versions the CSV file generated by CDRouter would include all results regardless of any filters applied. With this fix only the results that match the current filter or that are selected, will be included in the exported CSV file. [LH #3345]
Resolved an issue with the DHCP Server Identifier option (option 54) included in DHCPOFFER and DHCPACK messages transmitted by CDRouter’s DHCP server on the WAN. Starting with release 10.4 Build 2, CDRouter’s DHCP server would populate this DHCP option with a value of 255.255.255.255 instead of the actual DHCP server address. With this build the correct DHCP server address is now used. [LH #3364]
Resolved a potential fatal error in the dns_rfc5625_22 test case when DNS forwarding is not working as expected within the DUT. [LH #3346]
CDRouter IPv6
Resolved an issue with the ipv6_slacc_wan_11 test case in which CDRouter was incorrectly setting the S-bit in Neighbor Advertisements when reponding to multicast Neighbor Solicitations from the DUT. This fix adheres to the requirement in Section 4.4 of RFC 4861 which states that the S-bit “MUST NOT be set in multicast advertisements or in unsolicited unicast advertisements.” [LH #3360]
Updated the ipv6_basic_13 and ipv6_basic_15 test cases to send the ICMPv6 ping in step 2 of the procedure to the all routers multicast group
ff02::2
instead of the all nodes multicast groupff02::1
. This change ensures that the test is targeting the DUT specifically and that other nodes connected to the LAN will not influence the test. [LH #3343]Resolved an issue with CDRouter’s WAN IPv6 stack routing table to handle multiple hop environments. [LH #3350]
CDRouter TR-069
- Resolved an issue when parsing the
DeviceSummary
parameter during start to determine which profile tests should be automatically skipped. In previous versions of CDRouter any profiles associated with service objects (ie VoiceService:1) that were included in theDeviceSummary
parameter reported by the DUT would be incorrectly skipped by CDRouter. This issue only impacted configurations where theDeviceSummary
parameter was present and used for determining which tests to skip. [LH #3349]
CDRouter Performance
- The LAN to LAN UDP latency test cases, perf_lan_9 and ipv6_perf_lan_9, now produce CSV files which are used for graphing the latency. Previously these tests did not produce CSV files and as a result the graph could not be generated. [LH #3344]
CDRouter 10.4 Build 4 October 3, 2017
Bug Fixes and Notes
CDRouter
Resolved an issue with CDRouter’s import utility when trying to import a result that did not include a Device. This issue was introduced in the previous 10.4 Maintenance Release (MR1) and does not impact other versions of CDRouter.
Resolved an issue with CDRouter’s test package initialization (start.tcl) in a routed or relayed closed-loop setup when not providing a value for the testvar wanIspAssignGateway.
Updated CDRouter’s behavior when creating new DHCP enabled LAN clients. Prior to this release, when new LAN clients were created a gratuitous ARP would be sent to announce the new client’s MAC / IP information to the DUT. However, most modern devices are configured to ignore or drop gratuitous ARP messages. This could lead to ARP conflicts in certain test scenarios. As a result, CDRouter will now ARP for the gateway in addition to sending a gratuitous ARP whenever a new LAN DHCP client created. ARP-ing for the gateway should force the DUT to update its ARP cache with the correct, current information for the new LAN client. This change improves compatibility with some devices.
CDRouter IPv6
- Changed the default value for ipv6LanIp to be 3001:dddd::%eui64%, so that a default configuration for IPv6 will not cause a configuration check error.
CDRouter TR-069
The CWMP Scenario testing feature was updated to support the ability to use dynamic path instances in the value of a SetParameterValues request. This makes it possible to set the value of certain parameters to refer to another object instance that was created during the same test scenario. For example, after calling AddObject to dynamically create a new instance of WiFi.SSID., the new instance, “WiFi.SSID.%INSTANCE%”, may be specified as the value in a SPV request as the value of the Bridging.Bridge.1.Port.LowerLayers parameter. [LH #3392]
Resolved an issue when parsing certain URLs in the tr69_conn_req_4 test case that could result in a fatal error. [LH #3399]
CDRouter BBF.069
- The tests in the BBF.069 Upload module are now skipped if the testvar tr69UploadRPC is set to a value of ‘no’.
⦿ CDRouter 10.5 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 10.5 Build 1 | November 2, 2017 |
Maintenance Release 1 | CDRouter 10.5 Build 2 | December 6, 2017 |
Maintenance Release 2 | CDRouter 10.5 Build 3 | January 10, 2018 |
Maintenance Release 3 | CDRouter 10.5 Build 4 | February 6, 2018 |
Note: CDRouter 10.5 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 10.5 testvars using the config upgrade utility.
CDRouter 10.5 Build 1 November 2, 2017
New Features and Enhancements
CDRouter
New test module for verifying wifi client associations
A new wifi test module (wifi.tcl) has been added to CDRouter. This test module includes five new tests that are designed to verify that the DUT supports various wifi client association scenarios and modes, and that the DUT’s wifi beacons contain the expected information.
These tests can be repeated to stress the DUT’s wireless AP making it possible to expose issues that only appear after a large number of wireless client disassociation / association sequences.
New ARP test module
A new ARP specific test module (arp.tcl) has been added to CDRouter. This module contains a variety of tests that verify the DUT’s behavior with respect to different types of ARP requests, ARP cache entries, and its susceptibility to ARP spoofing and potential DoS situations. Two new testvars have been introduced to define the expected behavior of the DUT with respect to ARP: arpMode and arpSupportGratuitous.
In addition, two tests which create a large number of ARP requests and replies have been added (arp_60 and arp_61). These tests are designed to stress the DUT’s ARP functionality and can be useful additions to existing test packages. These tests can trigger unexpected and potentially problematic ARP related issues in some devices.
The arp module also introduces a new type of CDRouter test that analyzes data generated from previous tests (arp_30 and arp_31). In these cases the data being analyzed is the ARP history of all LAN or WAN clients, respectively, that have been created up to the point where these tests were executed during a particular test run. To ensure that the largest possible data set is analyzed, these test should be executed at the end of a test run or at multiple points during a test run include some point near the end.
For more information please see our ARP testing guide which is availale here.
New HTTP tests for verifying GET requests with a large number of headers
Six new HTTP tests have been added to CDRouter to verify GET requests over various transports using a large number of headers. While the HTTP RFCs do not limit the maximum number of header fields, some implementations limit the number of headers potentially causing problems for applications that depend on a large number of HTTP headers. These new tests are:
Test Module cdrouter_http_103 http.tcl cdrouter_http_206 http.tcl cdrouter_http2_106 http2.tcl cdrouter_http2_tls_106 http2-tls.tcl cdrouter_https_103 https.tcl cdrouter_https_206 https.tcl The new testvar httpMaxHeaderCount, which defaults to 200, can be used to configure the number of headers included in each GET request.
New HTTP tests for verifying WebSocket functionality
Four new HTTP test cases have been added to CDRouter to verify HTTP WebSocket connections. These new tests are:
Test Module cdrouter_http_300 http.tcl cdrouter_http_301 http.tcl cdrouter_https_300 https.tcl cdrouter_https_301 https.tcl New ICMP Time Exceeded test case
A new test case, cdrouter_icmp_30, has been added to the icmp.tcl module to complement the existing cdrouter_icmp_10 test. This new test verifies that an ICMP Time Exceeded packet is sent by the DUT for TCP packets with a TTL 1. The existing cdrouter_icmp_10 test case verifies the same behavior for UDP instead of TCP.
New tool to compare differences in test results
A new Results Diff tool has been added to CDRouter to allow test case results from different test runs to be compared in a side-by-side table. Users may select up to 5 different test runs from the Results page for the Results Diff tool to compare. For more details and examples, please see the “How can I compare multiple test results?” article in our Knowledge Base.
Move to Top, Move to Bottom buttons for package editing
There are now two new buttons in the package edit page. When adding tests or modules to a package, they get placed at the end of the list. Large packages can make it cumbersome to move tests/modules around. These new buttons allow you to move selected tests/modules to the top or bottom of the list.
Installing new license automatically loads new test suite
After loading a new license, either by clicking the Download & Install License button or by the drag and drop method, the CDRouter test suite will now be automatically updated. Restarting CDRouter is no longer required to load the updated test suite. Note that installing a new licese on the command line via
cdrouter-cli -update-license
still requires manually restarting CDRouter.New cdrouter-clone utility available for the NTA1000
Users upgrading to a new NTA1000 hardware platform can use the new cdrouter-clone utility to automatically transfer their CDRouter data from the system being replaced. The cdrouter-clone utility will connect to the old system and transfer an exact copy of the entire CDRouter database. This simplifies the process of moving to a new platform and minimizes downtime by ensuring that all of the same config files, test packages and results from the old system are copied to the new NTA1000 in one step.
Please see ‘How to transfer CDRouter configs, packages, and results to a new NTA1000’ for details on using the cdrouter-clone utility.
Better handling of custom test paths
CDRouter’s handling of custom test paths has been refactored and improved. If there are bad custom test paths CDRouter’s web interface will now start up as normal (previously it would start up in recovery mode) and display a warning in the banner indicating that there are issues with the test path configuration. Clicking on the warning message will open the Preferences page where users can fix or remove any invalid custom test paths.
L2TP and PPTP WAN modes now support server configuration via FQDN
Historically, CDRouter required that the L2TP or PPTP WAN tunnel endpoint be manually configured via IP address within the DUT. CDRouter now supports configuration of the L2TP or PPTP WAN tunnel endpoint via FQDN. To enable this feature, a static DNS entry for the L2TP/PPTP WAN tunnel endpoint FQDN must be added to the CDRouter configuration file. For example, if the DUT is configured with an L2TP tunnel endpoint of
l2tp.qacafe.com
, a static DNS entry that maps this domain name to the value of wanIspIp must be added:testvar dnsHostname1 l2tp.qacafe.com testvar dnsIp1 202.254.1.1
CDRouter IPv6
New HTTP tests for verifying GET requests with a large number of headers
Six new HTTP tests have been added to CDRouter to verify IPv6 GET requests over various transports using a large number of headers. These new tests are:
Test Module ipv6_http_103 http.tcl ipv6_http_206 http.tcl ipv6_http2_106 http2.tcl ipv6_http2_tls_106 http2-tls.tcl ipv6_https_103 https.tcl ipv6_https_206 https.tcl The new testvar httpMaxHeaderCount, which defaults to 200, can be used to configure the number of headers included in each of the test cases listed above.
New HTTP tests for verifying WebSocket functionality
Four new HTTP test cases have been added to CDRouter to verify IPv6 HTTP WebSocket connections. These new tests are:
Test Module ipv6_http_300 http-v6.tcl ipv6_http_301 http-v6.tcl ipv6_https_300 https-v6.tcl ipv6_https_301 https-v6.tcl
CDRouter TR-069
Support for Device:2 within the tr69_wireless test module
The tr69_wireless module has been updated to support Device:2 implementations. Because the Device:2 root data model does not provide the same configuration options for WPA/WPA2 cipher modes that are available in the InternetGatewayDevice:1 root data model, three new Device:2 specific WPA/WPA2 tests have been added: tr69_wireless_30, tr69_wireless_31, and tr69_wireless_32. The existing tr69_wireless_1, tr69_wireless_10, and tr69_wireless_11 test cases map directly to the Device:2 data model and have been updated to support it.
New test for verifying that wireless radio can be disabled via TR-069
A new test case, tr69_wireless_2, has been added to the tr69_wireless test module to verify that the DUT’s radio can be disabled via TR-069. This test supports both InternetGatewayDevice:1 and Device:2 implementations.
Received CWMP traffic can now be filtered by device serial number and OUI
CDRouter’s ACS now supports filtering of incoming CWMP sessions by device serial number and OUI. When enabled, the ACS will only respond to incoming CWMP traffic from the configured device. All incoming CWMP sessions from other devices will be ignored.
This feature allows CDRouter’s ACS to work better in environments where multiple devices are active and sending CWMP traffic to the ACS. To utilize this feature, the testvars tr69DeviceSn and tr69DeviceOui must be enabled and properly set to the values of the
OUI
andSerialNumber
reported by the DUT in the DeviceId portion of its Inform messages.
CDRouter Performance
Added new testvars to allow for addtional configuraion of latency tests
Added the testvars perfLatencyAttempts, perfApplicationAttempts, and perfApplicationDelay to allow more configuration options when running the IPv4 and IPv6 application latency performance test cases. Each testvar definition includes more information on how they affect the test cases.
New Test Modules and Test Cases
CDRouter
New ARP test module
MODULE: arp.tcl DESCRIPTION: ARP functional test cases NEW TEST CASES: 13
New wifi test module
MODULE: wifi.tcl DESCRIPTION: WiFi client association and verification tests NEW TEST CASES: 6
New HTTP tests for verifying GET requests with a large number of headers
TEST: cdrouter_http_103 MODULE: http.tcl DESCRIPTION: Verify HTTP/1.0 GET connections with large number of headers
TEST: cdrouter_http_206 MODULE: http.tcl DESCRIPTION: Verify HTTP/1.1 GET connections with large number of headers
TEST: cdrouter_http2_106 MODULE: http2.tcl DESCRIPTION: Verify HTTP/2 GET connections with large number of headers
TEST: cdrouter_http2_tls_106 MODULE: http2.tcl DESCRIPTION: Verify HTTP/2 GET connections over TLS with large number of headers
TEST: cdrouter_https_103 MODULE: https.tcl DESCRIPTION: Verify HTTPS/1.0 GET connections with large number of headers
TEST: cdrouter_https_206 MODULE: https.tcl DESCRIPTION: Verify HTTPS/1.1 GET connections with large number of headers
New HTTP and HTTPS tests to verify WebSocket functionality
TEST:cdrouter_http_300 MODULE: http.tcl DESCRIPTION: Verify HTTP/1.1 WebSocket Ping message
TEST:cdrouter_http_301 MODULE: http.tcl DESCRIPTION: Verify HTTP/1.1 WebSocket Text message
TEST:cdrouter_http_300 MODULE: http.tcl DESCRIPTION: Verify HTTPS/1.1 WebSocket Ping message
TEST:cdrouter_https_301 MODULE: http.tcl DESCRIPTION: Verify HTTPS/1.1 WebSocket Text message
New test to verify that an ICMP Time Exceeded packet is sent for TCP traceroute with TTL 1
TEST: cdrouter_icmp_30 MODULE: icmp.tcl DESCRIPTION: Verify ICMP Time Exceeded packet is sent for TCP traceroute with TTL 1
CDRouter IPv6
New HTTP tests for verifying IPv6 GET requests with a large number of headers
TEST: ipv6_http_103 MODULE: http-v6.tcl DESCRIPTION: Verify IPv6 HTTP/1.0 GET connections with large number of headers
TEST: ipv6_http_206 MODULE: http-v6.tcl DESCRIPTION: Verify IPv6 HTTP/1.1 GET connections with large number of headers
TEST: ipv6_http2_106 MODULE: http2-v6.tcl DESCRIPTION: Verify IPv6 HTTP/2 GET connections with large number of headers
TEST: ipv6_http2_tls_106 MODULE: http2-v6.tcl DESCRIPTION: Verify IPv6 HTTP/2 GET connections over TLS with large number of headers
TEST: ipv6_https_103 MODULE: https-v6.tcl DESCRIPTION: Verify IPv6 HTTPS/1.0 GET connections with large number of headers
TEST: ipv6_https_206 MODULE: https-v6.tcl DESCRIPTION: Verify IPv6 HTTPS/1.1 GET connections with large number of headers
New HTTP and HTTPS tests to verify IPv6 WebSocket functionality
TEST:ipv6_http_300 MODULE: http.tcl DESCRIPTION: Verify HTTP/1.1 WebSocket Ping message
TEST:ipv6_http_301 MODULE: http.tcl DESCRIPTION: Verify HTTP/1.1 WebSocket Text message
TEST:ipv6_https_300 MODULE: http.tcl DESCRIPTION: Verify HTTPS/1.1 WebSocket Ping message
TEST:ipv6_https_301 MODULE: http.tcl DESCRIPTION: Verify HTTPS/1.1 WebSocket Text message
CDRouter TR-069
New Device:2 specific test cases in the tr69_wireless module
TEST: tr69_wireless_30 MODULE: tr69_wireless.tcl DESCRIPTION: Verify WPA wireless configuration (Device:2 only)
TEST: tr69_wireless_31 MODULE: tr69_wireless.tcl DESCRIPTION: Verify WPA2 wireless configuration (Device:2 only)
TEST: tr69_wireless_32 MODULE: tr69_wireless.tcl DESCRIPTION: Verify WPA/WPA2 wireless configuration (Device:2 only)
New test for verifying that the DUT’s wireless radio can be disabled
TEST: tr69_wireless_2 MODULE: tr69_wireless.tcl DESCRIPTION: Verify access point can be disabled (IGD & Device:2)
Bug Fixes and Notes
CDRouter
Resolved an issue associated with decoding and displaying 802.2 LLC packets in test logs. Previously CDRouter was not decoding these packets properly leading to warning messages in test logs whenever an 802.2 LLC packet was received.
CDRouter now uses TCL version 8.6.7.
The default value of the testvar portScanStop has been changed from ‘2048’ to ‘65535’. This modification has been made to address many recent security issues that were the result of open ports high in the range. By default CDRouter will now scan then entire port range rather than just a small subset of ports during firewall and dmz scans. Note that this change will result in signficantly larger log files and longer run times for these tests in this release. [LH #3359]
Updated the various port scan tests in the firewall module to resolve an issue with certain implementations. Previously CDRouter would listen for and respond to all ARP requests received during the port scan tests. This was required to properly detect open ports due to virtual services. However, when renewing a WAN DHCP lease some implementations send ARP requests for the WAN gateway on the LAN. If this occurred during a firewall port scan test CDRouter would respond and overwrite the DUT’s ARP cache entry for the default WAN gateway with a bogus LAN side address. This would lead to a broken default route and failures for any subsequent tests that required LAN to WAN forwarding. This issue has been resolved with this release, and the new arp_50 test case has been added to explicity test for this unexpected and insecure behavior within the DUT. [LH #3372]
The list of modules displayed in the Package Editor is now sorted alphabetically. [LH #3422]
The test case name located in the top left-hand corner of the log viewer is now linked to the documentation page for that test case.
CDRouter will now alert the user in the ‘start’ log if one or more custom test cases conflicts with and overwrites existing, pre-defined test cases. [LH #3363]
Resolved an issue with the skip logic for the test case cdrouter_dhcp_30 when multiple WAN interfaces are configured. [LH #3430]
Refactored CDRouter’s cleanup code to better handle various situations where a test run might be stopped. When a test is run stopped, either by the user or by a run-time option, CDRouter will clean up by actively bringing down any WAN connections, disassociating all wireless LAN clients, and releasing all DHCPv4 and DHCPv6 client addresses on the LAN. CDRouter also produces failures now if any wireless LAN interfaces are disassociated when entering or exiting a test case. [LH #3341]
Resolved an issue with the log viewer Auto-update feature in the latest versions of Google Chrome (versions 60+). [LH #3427]
CDRouter Multiport
The guest-v6 test module will now be automatically skipped if IPv6 is not enabled on the guest LAN interface (ie the testvar ipv6LanMode is set to a value of none). [LH #3442]
Addressed an issue with skip test logic for the dhcp-s test module when mutliple LAN interfaces are defined and the primary LAN interface has the testvar lanMode set to a value of static. [LH #3453]
CDRouter TR-069
The tr69_wireless module now performs an additional IPv6 connectivity check when associating if IPv6 is enabled within CDRouter.
CDRouter now utilizes the parameter
Device.RootDataModelVersion
to determine if a DUT supports the Device:2 root data model. This parameter was added to version 2.4 of the Device:2 data model. If not present, CDRouter will revert to its original behavior and examine the data model for the parameterDevice.IP.IPv4Enable
to determine if a DUT supports the Device:1 or Device:2 root data model.The tr69_1 test case has been updated to verify that the
Device.RootDataModelVersion
parameter exists in Informs from the DUT if the DUT supports Device:2.4 or greater.The constraints for the testvar cwmpProfileObject have been tightened. Prior to CDRouter 10.1 this testvar did not require the user to specify the version number. In CDRouter 10.1 and later releases, the version number is required. The config check for this testvar will now ensure that it is set to one of the following three values: ‘InternetGatewayDevice:1’, ‘Device:1’, or ‘Device:2’.
The start log now only displays the list of profiles that the DUT supports. This change reduces the number of profile related log messages displayed in the start log signficantly. [LH #3415]
The tr69_51 and tr69_61 test cases have been modified to include an extra step of verification. Now, in addition to verifying that the port mapping works for the expected remote host address, these tests also verify that the port mapping does not work if other WAN hosts try to use it. [LH #3366]
Resolved a fatal error when parsing improperly formed ‘DUStateChangeComplete’ RPCs from the DUT in test od128_test_35.6. [LH #3425]
The tr69_wireless module has been updated to verify that all supported security modes are working when multiple modes have been configured. For example, in tests that configure the DUT for both WPA and WPA2, CDRouter will attempt to associate, pass traffic, and verify counter stats, using both WPA and WPA2 independently. Previously CDRouter’s wireless LAN client would be configured for ‘auto’ mode during the verication process and thus verify only a single mode of operation.
The od128_test_19.1 test case has been updated to cache and restore the WPA/WPA2 wireless security settings. This will help ensure that the DUT is left with its original wireless configuration at the end of the test. [LH #3395]
CDRouter Nmap
The default value of the nmapPorts testvar has been changed from the keyword ‘default’ to ‘0-65535’. As a result, all Nmap scans will now operate over the entire port range by default. Like the change that was made to the portScanStop testvar, the reaseon for this modification is to improve testing and help identify open ports high in the range that have been the cause of many recent security issues.
Note that this change will result in signficantly larger log files and longer run times for the Nmap tests in this release. Some users may need to adjust the nmapScanTimeout testvar value to ensure that the Nmap tests run fully and do not timeout and exit early. [LH #3359]
CDRouter Storage
- Resolved an issue with the IPv6 storage tests where a ‘couldn’t connect to server’ error was not producting a failure and leading to false positive test results. [LH #3434]
CDRouter Performance
- Resolved an issue where a WLAN client using the mode WPA Enterprise (802.1X) would fail when using EAP-PEAP as the authentication method during the performance throughput test cases. [LH #3369]
CDRouter 10.5 Build 2 December 6, 2017
Bug Fixes and Notes
CDRouter
When enabled, CDRouter’s 3rd and 4th DNS servers will include the EDNS0 option in the DNS test cases, most notably dns_121 and dns_tcp_121. The 3rd and 4th DNS servers can be enabled using the testvars wanBackupDnsServer2 and wanBackupDnsServer3. [LH #3464]
Updated the logic in the cdrouter_dhcp_20 test case to be more strict about the order in which DHCP messages are received from the DUT. This resolves a possible false positive result in this test for some implementations. [LH #3499]
Resolved an issue in the cdrouter_dos_20 and cdrouter_dos_21 test cases where CDRouter dropped a packet that should have been sent to the DUT, resulting in a potential false positive test result. [LH #3491]
CDRouter TR-069
Additional type checking has been added to the optional syntax validation phase of all Data Model Profile tests (ie. Device2_profiles.tcl, InternetGatewayDevice1_profiles.tcl, etc.). If syntax validation is enabled, the XML-encoded data type of each parameter value returned by the DUT is compared against the parameter definition to ensure they match. Any inconsistencies are flagged and will cause a failure.
Resolved a fatal error condition in the tr69_51 and tr69_61 test cases when running with a small free network configuration that provides only one additional free network for testing. [LH #3347]
Resolved an issue when parsing custom CWMP profiles that define optional parameters within a partial path. Previously if the parent object was defined as Required CDRouter would treat all parameters under that object as required. Now, if a partial path under a required parent object is defined as Optional, CDRouter will treat all parameters under that partial path as optional as well. [LH #3482]
The order in which CDRouter loads CWMP profiles has been modified. In earlier releases CDRouter would load vendor defined (custom) profiles first, followed by all official profiles defined by the Broadband Forum. In this release the order is reversed - official profiles are loaded first, followed by all vendor defined profiles. This change makes it possible for users to modify the attributes of an official parameter by defining it in a vendor defined profile. Note that modifications made via the cwmpModifyParameters testvar are applied after all profiles are loaded. [LH #3409]
The tr69_210 and tr69_220 test cases have been updated to accommodate cases where the DUT may send additional “4 VALUE CHANGE” Event Codes to the ACS that are not related to the change in the WAN address. [LH #2314]
CDRouter BBF.069
- The default values of the bbf069ACSURL and bbf069AlternateACSURL testvars have been modified to ‘http://acs1.broadband-forum.org' and ‘http://acs3.broadband-forum.org', respectively. Note that for SSL configurations, these testvars must be explicitly modified to specify a transport of https instead of http. [LH #3468]
CDRouter ICS
- The constraints associated with CDRouter ICS have been updated. Specifically, CDRouter will now generate a warning if IPv4 or IPv6 ICS is enabled and there is no valid global IPv4 or IPv6 address available, respectively, on the ICS interface. In addition, IPv6 ICS is now restricted to configurations that utilize DHCPv6 prefix delegation (ie IPv6 WAN modes of DHCP, PPPoE, static, or autoconf). [LH #3475]
CDRouter DOCSIS
Resolved a fatal error during DOCSIS startup on systems that do not have the IPv6 add-on enabled. [LH #3495]
When the CM interface is rebooted or restarted CDRouter will now also wait for the eRouter interface, if present, to also restart before continuing. [LH #3489]
Updated the logic in the docsis_dhcp_20 test case to be more strict about the order in which DHCP messages are received from the DUT. This resolves a possible false positive result in this test for some implementations. [LH #3499]
Modified docsis_dhcp_4 and docsis_dhcp_5 to allow the DUT to send a DHCPRELEASE before restarting its DHCP process with a DHCPDISCOVER. [LH #3488]
CDRouter 10.5 Build 3 January 10, 2018
Bug Fixes and Notes
CDRouter
Support for PPPoA and ATM interfaces has been deprecated and will be removed in future releases of CDRouter. Please contact QA Cafe support for more details. [LH #3511]
Modified dns_45, dns_46, dns_tcp_45, and dns_tcp_46 to no longer use underscores in the domain name. [LH #2860]
Added a 5 ms delay after associating and authenticating via wireless to provide more time for the DUT to open the controlled port and allow traffic to flow. This modification was made after observing that some DUTs do not immediately open the controlled port leading to dropped packets and ultimately longer test durations. [LH #3446]
Resolved a WPA2 issue associated with group re-keying. In previous releases CDRouter would incorrectly drop key packets whenever a WPA2 group message was received. This would lead to warnings in test logs and cause some devices to disassociate CDRouter’s LAN client(s). This issue only impacted WPA2 configurations when re-keying occurred. [LH #3533]
Updated some tests in the static.tcl module to ensure that “next-hop” addresses in static routes (defined by staticRouteLanNextHop) are always assigned the same MAC address in any test for the entire test run. This will prevent erroneous test failures due to ARP caching in the DUT from one test to another. [LH #3538]
CDRouter Multiport
- Resolved an issue in the cdrouter_natmp_100, cdrouter_natmp_101, and cdrouter_natmp_102 test cases. These tests now properly verify an assymetric traffic path by sending response traffic back to the DUT on an alternate WAN interface. This issue was introduced with the routing changes implemented within the 10.4 release of CDRouter. Earlier versions do not have this issue. [LH #3506]
CDRouter IPv6
Resolved an issue in the icmpv6_31 test case and the slaac-wan test module related to solicited Neighbor Advertisements sent by CDRouter on the WAN. In previous releases, the Router bit in all solicited NAs would be unset during these tests by CDRouter. This could cause some devices to lose WAN connectivity during these tests resulting in unexpected behavior. This issue has been resolved in this build. All solicited NAs will now have the Router bit set during these tests. [LH #3508]
Modified ipv6_dns_45, ipv6_dns_46, ipv6_dns_tcp_45, and ipv6_dns_tcp_46 to no longer use underscores in the domain name. [LH #2860]
Added ipv6_upnp_204 and ipv6_upnp_igd2_204 to the requires_ipv4 skip list. These tests use IPv6 for the transport of UPnP but require IPv4 to also be active, so that the DUT’s WAN’s IPv4 address may be modified and verified to have changed. [LH #3535]
Resolved an issue with the mapt_14 test case which was preventing CDRouter’s LAN client from sending packets with a source address “0.0.0.0”. [LH #3531]
CDRouter TR-069
Additional detail is now printed if CDRouter is unable to parse custom profile definitions from the cwmpProfilePath file. [LH #3516]
Updated the od128_test_16.5 test case to disable Passive Notification settings on the DUT before ending the test. [LH #3492]
When testing with a device that supports the XMPP protocol for Connection Requests, the DUT will only be configured with the minimum settings needed to enable it to connect to CDRouter’s XMPP server. In order to ensure that all XMPP-capable devices can connect, CDRouter will no longer attempt to configure additional XMPP settings that are not strictly required. [LH #3517]
Added a more accurate log message and clarified a few of the steps listed for test *tr69_210 to remove some confusion surrounding some of the test’s actions. [LH #3539]
The command key used by CDRouter during the OD-128 reboot test, od128_test_14.1, has been changed from
Rebooting for OD-128 test 14
toRebooting for CDRouter test
. This change was made to make the command key and subsequent logging more generic since this test is called in other test cases. [LH #3546]The od128_test_14.1 test case has been updated to better handle wireless LAN clients. If wireless is used, CDRouter’s LAN client will be explicitly disassociated at the start of the test and restarted at the end of the test. [LH #3543]
CDRouter DOCSIS
Added some additional log messages to the DOCSIS TFTP server to display the full path of the config file that is being transferred. [LH #3515]
Fixed a copy error that prevented the docsisTftpBootFile from being written at the start of a test run if the file already exists. [LH #3512]
CDRouter Storage
Added two new testvars storageSmbPacing and storageFtpPacing which allow users to configure a delay, in milliseconds, that is applied between client transactions within the various storage scaling tests. The default value is 0 milleseconds. [LH #3523]
Fixed a potential false positive condition when a DUT’s FTP server reports that too many sessions are active. This condition would sometimes not get reported as a failure in the FTP scaling test cases, ftp_52 and ftps_52. [LH #3521]
CDRouter 10.5 Build 4 February 6, 2018
Bug Fixes and Notes
CDRouter
Resolved an issue with the Device Connect feature in which HTTP 302 redirects, used by some devices for their manangement web page, were not being properly translated by CDRouter’s web proxy. [LH #3550]
Resolved a fatal error in cdrouter_dhcp_server_630 test when using a configuration with the combination of the wanMode testvar set to a value of static and the DNStoDHCP testvar set to a value of yes. [LH #3553]
CDRouter TR-069
Updated tests od128_test_16.2, od128_test_16.4, and od128_test_24.1. At the end of each test any notifications that were enabled are now properly disabled. This update prevents unexpected ‘4 VALUE CHANGE’ events related to these tests from impacting subsequent tests. [LH #3556]
Resolved an issue in which CDRouter’s ACS was not explicitly sending an empty string tag, <string></string>, in GetParameterNames and GetParameterValues RPCs when the root object from a custom profile could not be determined. [LH #3566]
The default value of the testvar acsSslVersion has been changed from sslv23 to tlsv1_2. This change ensures that by default CDRouter’s ACS complies with the current best practices defined in Section 3.3 of TR-069 Amendment 5, which states that SSL 3.0 and TLS 1.0 SHOULD NOT be used and that TLS 1.2 SHOULD be used instead. Any old configs that relied in the previous default value of sslv23 may need to be updated if the DUT does not support TLS 1.2. [LH #3575]
Updated test case tr69_410 to ensure that only one NTP server is available at any time and verify that the DUT is able to sync its clock with each one. [LH #3537]
CDRouter BBF.069
- CDRouter’s ACS was updated to resolve a problem with the way HTTP Cookies are stored and verified during the 5_036_redirect_cookies test. The use of quotes around cookie values is now more consistent and based on the value of the acsCookieMode testvar. [LH #3559]
CDRouter IPv6
- Modified the criteria of a ‘PASS’ in the test cases ipv6_mdns_10 and ipv6_mdns_12 to only accept mDNS responses from the DUT’s IPv6 link-local address. This was modified to match what is specified in RFC 6762, section 3. [LH #3565]
⦿ CDRouter 10.6 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 10.6 Build 1 | April 4, 2018 |
Note: CDRouter 10.6 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 10.6 testvars using the config upgrade utility.
CDRouter 10.6 Build 1 April 4, 2018
New Features and Enhancements
CDRouter
New package launch option for selecting configuration file
CDRouter’s web UI and API now support the selection of a configuration file When launching or restarting a test package or testlist. This makes it possible to run a set of tests across multiple configurations without having to copy or create test packages for each combination.
For more information on this new feature, please refer to the Knowledge Base article found here.
New mDNS test case
A new mDNS test case, mdns_13, has been added to verify that the DUT does not forward mDNS queries received on the LAN to the WAN.
Support for 5 Ghz wireless on the WAN (WAN AP mode)
CDRouter now supports 5 GHz AP mode on the WAN. This makes it possible to test travel routers, WiFi range extenders, and other devices that support 5 GHz wireless on the WAN. Previously only 2.4 GHz AP mode was supported by CDRouter.
This feature is only supported on the wlan0 wireless interface within NTA1000v5 systems running image version 5.2 or greater.
For more information on how to enable and configure CDRouter’s WAN AP for wireless on the WAN testing, please see the User Guide.
CDRouter IPv6
New IPv6 mDNS test case
A new IPv6 mDNS test case, ipv6_mdns_13, has been added to verify that the DUT does not forward IPv6 mDNS queries received on the LAN to the WAN.
Three new ICMPv6 test cases
Three new ICMPv6 tests, icmpv6_32, icmpv6_33, and icmpv6_34, have been added. The icmpv6_32 test case verifies that the DUT sends a Time Exceed response when it receives an IPv6 packet with a Hop Limit of 1 on the WAN.
The icmpv6_33 and icmpv6_34 tests verify that the DUT does not send a Time Exceeded and responds to inbound ICMPv6 Echo Request packets with a Hop Limit of 0 on the LAN and the WAN, respectively.
CDRouter TR-069
New TR-143 test module
CDRouter now supports TR-143 performance testing over HTTP with the new tr143_http.tcl test module.
The tr143_http test module includes a mix of functional, performance, and negative tests, including:
- Tests for verifying the upload and download functionality of the DUT using various IPv4 and IPv6 address and domain based URLs
- Tests that measure the DUT’s upload and download throughput
- Tests that measure the DUT’s upload and download response time
- Tests that simulate various error conditions and verify that the DUT properly reports these conditions to the ACS
For more information please see the CDRouter TR-069 User Guide.
New test case for verifying CPE source port selection
Section 3.2.1.2 of TR-069 Amendement 5 states that ‘Each time the CPE first connects to the ACS after rebooting, it SHOULD use a different ephemeral TCP source port in order to avoid the possibility of reusing the same port that it used last time.’ A new test case, tr69_420, has been added to verify this recommendation.
New ACS and ACS download server certificates
The ACS and ACS download server certificates shipped with CDRouter 10.5 and earlier releases will expire in June and August of 2018, respectively. These certificates have been updated and are now valid until March of 2020.
The new certificates included with this release will be used automatically by CDRouter if HTTPS is enabled for TR-069. This may cause certain devices to fail the SSL handshake during start if they do not have the correct, new root certificate installed in their trusted CA store. This is likely to impact only older devices or devices running older firmware. Newer devices may have the correct root certificate installed by default.
Please contact support@qacafe.com for more information.
Support for Custom CWMP Profiles in XML format
Custom CWMP Profiles allow users to test their own extensions to the CPE data model. In previous versions of CDRouter, Custom Profiles had to be generated by hand by creating a specially-formatted text file. Users may now provide their own XML files containing custom CWMP Profiles and vendor-specific object and parameter definitions in the same standard format as the data model definition files published by the Broadband Forum. Custom Profiles in either format are supported by CDRouter. For more details on creating Custom Profiles, please see the CWMP Profile Testing section of the CDRouter TR-069 User Guide
New Test Modules and Test Cases
CDRouter
New mDNS test case
TEST: mdns_13 MODULE: mdns.tcl DESCRIPTION: Verify DUT does not forward LAN mDNS query onto the WAN
CDRouter IPv6
New IPv6 mDNS test case
TEST: ipv6_mdns_13 MODULE: mdns-v6.tcl DESCRIPTION: Verify DUT does not forward IPv6 LAN mDNS query onto the WAN
New IPv6 Hop Limit 0 test cases
TEST: icmpv6_32 MODULE: icmpv6.tcl DESCRIPTION: Verify ICMPv6 Time Exceeded packet is sent when incoming Hop Limit is 1 on WAN
TEST: icmpv6_33 MODULE: icmpv6.tcl DESCRIPTION: Verify DUT responds to ICMPv6 Echo Request with Hop Limit of 0 on the LAN
TEST: icmpv6_34 MODULE: icmpv6.tcl DESCRIPTION: Verify DUT responds to ICMPv6 Echo Request with Hop Limit of 0 on the WAN
CDRouter TR-069
New TR-143 test module
MODULE: tr143_http.tcl DESCRIPTION: TR-143 tests for performance diagnostics using HTTP NEW TEST CASES: 26
New CWMP source port verification test
TEST: tr69_420 MODULE: tr69.tcl DESCRIPTION: Verify CWMP source port changes after reboot
Bug Fixes and Notes
NTA1000
- On NTA1000 systems running image versions earlier than 5.0, all of test interfaces are set to UP state by default. As a result, these interfaces may obtain an IPv6 autoconf address and interfere with running tests. CDRouter will now log a warning message during start and remove the address before running tests when this condition is detected. [LH #3611]
CDRouter
Resolved a UI issue with the line/bar graph and pie chart on the ‘Home’ page. This page now proprly updates when being actively viewed while tests are running. [LH #3536]
Changed the default page size system preference from 10 to 25, to better match current customer usage. The option to change this preference remains for each host and browser combination. Pages size options are (10, 15, 20, 25 and 50) and can be configured on the Preferences page within the web UI. [LH #3598]
Added additional validation for testvars that are defined as type ‘host-name’ within CDRouter’s config dictionary. This testvar type is now validated against the rules defined in RFC 3986 Appendix A. This resolves an issue with invalid domain name or host name testvar values that were passing the config check. [LH #3851]
Updated the cdrouter_dhcp_server_10 test case to first ARP for the address that will be requested to ensure that it is not in use by another host on the LAN. If the address is in use CDRouter will pick another address and repeat this process until a free address is found. This resolves a false negative test result due to CDRouter improperly requesting an address that was already in use by another host. [LH #3572]
Two new tools (cdrouter-backup and cdrouter-restore) have been developed to assist in the backup and restoration of CDRouter test results and system data. The cdrouter-backup tool will backup all CDRouter data on a system and copy it to a local or remote destination. The cdrouter-restore tool performs the inverse operation and restores the system from a saved backup. For more information on these tools please refer to this page or contact support@qacafe.com. [LH# 3459]
Support for dynamic WEP has been deprecated and will be removed in the next major release of CDRouter. Dynamic WEP is a wireless security mode that uses 802.1X to exchange WEP keys and is configured within CDRouter by setting the testvar lanSecurity to a value of 802.1X-WEP. A deprecation warning will now be displayed in the start log of any test run that has dynamic WEP enabled. [LH #3615]
When copying resources in the web UI such as Configs, Packages, and Devices, the copies will be owned by the user making the copy, not the original owner of the resource. [LH #3387]
Resolved an issue in the rfc4787_req_5 and rfc4787_req_6 tests cases that could lead to invalid test failures. Previously the WAN UDP echo server used in these tests would always send UDP echo response packets back to the source port selected by the LAN client. If the DUT translated the source port of the outbound UDP echo request, the response would be sent to the wrong port resulting in a test case failure. The UDP echo server now sends responses back to the translated source port of the original request. [LH #3591]
The tests in the static.tcl module have been updated to support static routes on different LAN and/or WAN interfaces and subnets. [LH #3542]
CDRouter now maintains a global list of reserved MAC addresses. Any test that creates a new stack that has a specific IPv4 or IPv6 address associated with it will now reserve its MAC address. This ensures that MAC to IP mappings will remain consistent for duration of a test run, and that CDRouter will not use or assign reserved MACs. This mdofication will prevent erroneous test failures due to ARP cache poisoning by CDRouter. [LH #3541]
The “Pause between tests” Package option will now pause before the shutdown final phase as well as between tests. This makes it possible to leave CDRouter on at the end of test run, allowing features like ICS to continue running for data/log collection or internet access for firmware downloads etc. The only exception is if a fatal error occurs during the test run in which case CDRouter will shutdown immediately without pausing. [LH #3557]
Resolved an issue in the ipv6_frag_2 test case when run with configurations that set the jumboMtu testvar to a value greater than 3000. This test was not explicitly setting the MTU on the WAN to force fragmentation. This meant that for certain configurations with jumbo MTUs enabled fragmentation of the outbound packet would not occur. To resolve the MTU on the WAN is now explicitly set to 1280 bytes which will force fragmentation even if jumbo MTUs are enabled. [LH #3652]
Added additional config check for the staticRouteLanNextHop testvar to ensure that all next hops are on the correct LAN subnet. [LH #3606]
Updated the arp_3 test case to not clear the LAN client’s ARP cache at the start of the test. Previously the LAN client’s ARP cache would be cleared at the start of the test. If the DUT attempted to ping the LAN client during the test, the LAN client would have to ARP for the DUT’s IP, which would result in the DUT sending an ARP reply leading to a false positive test result. With this change the LAN client’s ARP cache is preserved, so the LAN client will not need to send an ARP request before sending a ping response to the DUT. [LH #3667]
Certain wireless cards have a power save mode that is enabled by default. Power save mode can have an effect on results, particularly performance tests. CDRouter now explicitly turns off power save mode for any wireless cards used in a test run. When the test run completes power save mode is set back to its default value. [LH #3678]
Added the ability to specify the keyword none for the testvar lanDomainName. This keyword means that the DUT will not provide a Domain Name as a DHCP option to any of the LAN clients. [LH #3498]
Resolved a file descriptor leak in cdrouterd that lead to an unresponsive CDRouter UI. [LH #3691]
Updated CDRouter’s multicast tests to work within a multi-hop topology where an intermediate router or CMTS is also running IGMP. [LH #3651]
CDRouter IPv6
Updated the static-v6.tcl module to ensure that all next-hop stacks utilize reserved MAC addresses. [LH #3541]
Updated the ula_10, 11, and 12 test cases to ensure that the WAN is fully disabled before checking for any changes in the DUT’s Router Advertisements. [LH #3564]
Updated the icmpv6_31 and ipv6_jumbo_11 test cases to resolve an issue that would prevent subsequent tests from being able to properly fragment and send large packets. [LH #3671]
Fixed a packet decoding problem in the mapt_42 test case. ICMPv4 packets mapped onto ICMPv6 by the DUT should now be decoded properly in the test log. [LH #3650]
Updated CDRouter’s multicast tests to work within a multi-hop topology where an intermediate router or CMTS is also running MLD. [LH #3651]
CDRouter TR-069
The od128_test_15.4 test case has been updated to send a GetParameterAttributes request for one parameter and one partial path (“InternetGatewayDevice.Services.STBService.1.Capabilities.VideoDecoder.”). The test had previously been sending a request for two parameters when the tr69DeviceType testvar was set to “STB”. [LH #3594]
The ACS has been updated to support the acsWaitForConnectionRequest testvar setting with XMPP connection requests. Previously, only HTTP connection requests were affected by this testvar. [LH #3529]
The tr69_400 has been updated to support Device:1 and Device:2 implementations. [LH #3620] [LH #3617]
Updated the tr69_400 test case to include two hops on the WAN so that the structure of the RouteHops table returned by the DUT can be properly validated. Previously, this test used a destination that was only one hop away. [LH #1786]
Resolved an issue where the ACS fails to retransmit its TCP SYN segment when initiating an HTTP Connection Request to the DUT. [LH #3592]
CDRouter Nmap
CDRouter will now send a Neighbor Solicitation for the DUT’s IPv6 global unicast address at the start of each IPv6 Nmap test. The address provided by the DUT in the associated Neighbor Advertisement will be used as the target address of the test. [LH #3587]
Nmap has been updated from version 7.40 to 7.60. [LH #3570]
CDRouter Multiport
- CDRouter no longer applies the dhcpClientOptionCode, dhcpv6ClientOptionCode, and dhcpv6ServerOptionCode testvars (and associated “Data” testvars) globally across all of CDRouter’s LAN and WAN interfaces. These testvars are now supported within Multiport interface definitions. This permits DHCP clients and servers on each interface to supply their own unique set of additional DHCP/DHCPv6 options to the DUT.
CDRouter DOCSIS
- The docsis_dhcp_20 test was updated to address a fatal error that occurred when running the test in an environment without any eRouter IPv4 or IPv6 address configured (wanMode and ipv6WanMode both set to “none”) [LH #3670]
⦿ CDRouter 10.7 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 10.7 Build 1 | April 26, 2018 |
Maintenance Release 1 | CDRouter 10.7 Build 2 | May 2, 2018 |
Maintenance Release 2 | CDRouter 10.7 Build 3 | June 7, 2018 |
Maintenance Release 3 | CDRouter 10.7 Build 4 | July 9, 2018 |
Note: CDRouter 10.7 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 10.7 testvars using the config upgrade utility.
CDRouter 10.7 Build 1 April 26, 2018
New Features and Enhancements
CDRouter
New package scheduler!
CDRouter now includes a built in package scheduler! This feature makes it possible to automatically schedule packages to run every day at a specific time. For more information please see this Knowledge Base article.
Support for DNS over TLS
CDRouter’s WAN DNS servers now support DNS over TLS as defined in RFC 7858.
With the addition of DNS over TLS, CDRouter’s DNS servers now support three different transports: traditional DNS over UDP on port 53, DNS over TCP on port 53, and DNS over TLS (over TCP) on port 853.
For more information please see our Knowledge Base article on testing DNS over TLS with CDRouter .
New DNS over TLS test module
To facilitate the testing and adoption of support for DNS over TLS within CPE devices, a new test module, dns-tls.tcl, has been added to CDRouter. This test module adds 34 new test cases that utilize DNS over TLS as a transport.
New DNS test case for verifying privacy-enabling DNS behavior
A new DNS test case, dns_500, for verifying that the DUT’s DNS proxy does not leak DNS queries in plaintext over UDP or TCP on the WAN has been added.
This test is skipped by default. To run this test, DNS over TLS must be enabled on the DUT. In addition, the DUT must support ‘strict privacy’ for authentication as defined in Section 6.6 of RFC8310 and set the new testvar dnsUsageProfile to a value of strict-privacy.
Note that variants of this test have been added to all DNS specific test modules as well. These tests are: dns_tcp_500. dns_tls_500, ipv6_dns_500, ipv6_dns_tcp_500, and ipv6_dns_tls_500.
CDRouter IPv6
Support for IPv6 DNS over TLS
CDRouter’s WAN IPv6 DNS servers now also support DNS over TLS as a transport. See the announcement above for more information.
New DNS over TLS test module
To facilitate the testing and adoption of support for IPv6 DNS over TLS within CPE devices, a new test module, dns-tls-v6.tcl, has been added to CDRouter. This test module adds 29 new test cases that utilize DNS over TLS as a transport.
CDRouter TR-069
New ID-181 test module
A new ir181 test module has been added to CDRouter! This module includes 50 new test cases based on revision 14 of the Broadband Forum’s CWMP Interoperability and Functionality Test Plan as defined in ID-181.
Please note that ID-181 is currently in draft status within the Broadband Forum. Once approved, this test plan will be published as IR-181. Future releases of CDRouter will be updated to ensure consistency with the most recent available versions of the ID/IR-181 test plan.
CDRouter BBF.069
BBF.069 updated
CDRouter is now shipping with Release 9.0 of the BBF.069 scripts from the UNH-IOL. For a complete list of modifications included with this release, please see the bug fixes and notes section below.
New Test Modules and Test Cases
CDRouter
New DNS over TLS module
MODULE: dns-tls.tcl DESCRIPTION: DNS over TLS proxy and DNS failover related tests NEW TEST CASES: 35
New DNS test cases for verifying privacy-enabling DNS behavior
TEST: dns_500 MODULE: dns.tcl DESCRIPTION: Verify DNS proxy enforces DNS strict privacy usage profile
TEST: dns_tcp_500 MODULE: dns-tcp.tcl DESCRIPTION: Verify DNS proxy enforces DNS strict privacy usage profile
TEST: dns_tls_500 MODULE: dns-tls.tcl DESCRIPTION: Verify DNS proxy enforces DNS strict privacy usage profile
CDRouter IPv6
New IPv6 DNS over TLS module
MODULE: dns-tls-v6.tcl DESCRIPTION: IPv6 DNS over TLS proxy and DNS failover related tests NEW TEST CASES: 30
New IPv6 DNS test cases for verifying privacy-enabling DNS behavior
TEST: ipv6_dns_500 MODULE: dns-v6.tcl DESCRIPTION: Verify DNS proxy enforces DNS strict privacy usage profile
TEST: ipv6_dns_tcp_500 MODULE: dns-tcp-v6.tcl DESCRIPTION: Verify DNS proxy enforces DNS strict privacy usage profile
TEST: ipv6_dns_tls_500 MODULE: dns-tls-v6.tcl DESCRIPTION: Verify DNS proxy enforces DNS strict privacy usage profile
CDRouter TR-069
New IR-181 test module
MODULE: ir181.tcl DESCRIPTION: CWMP Interoperability and Functionality Test Plan NEW TEST CASES: 49
Bug Fixes and Notes
CDRouter
CDRouter’s utilities for migrating results from pre-10.0 systems has been deprecated. Future versions of CDRouter will not have the ability to migrate older results directly. If migration is needed, we recommend that users first install CDRouter 10.7, perform the results migration, and then upgrade to the latest release of CDRouter. [LH #3715]
Resolved an issue where CDRouter would run all tests on a ‘Restart’ of a test package, even though the user selected Failed only or Passed only in the ‘Restart this package’ pop-up dialog. [LH #3694]
Improved the cleanup process of the additional clients created in the LAN scaling tests for wireless interfaces. [LH #3706]
Modified behavior of wireless LAN clients that become disassociated during the CDRouter scaling test cases. They will not attempt to automatically reassociate. [LH #3713]
CDRouter Multiport
Resolved an internal routing issue in the ipv6_ripngwan_9 that resulted in a false negative test result. [LH #3732]
Resolved an issue in the ipv6_ripngwan_100 test case in which duplicate routes were advertised by CDRouter on the WAN. [LH #3734]
CDRouter IPv6
Fixed an issue where CDRouter’s LAN client would try to configure a Unique Local Address (ULA) for itself even if the supportsULA testvar is set to “no”. [LH #3629]
Resolved an issue in the ipv6_ripng_100 test case in which duplicate routes were advertised by CDRouter on the WAN. [LH #3734]
Updated test cases v6_cpe_1_5_a,v6_cpe_1_5_b,v6_cpe_1_5_c, and v6_cpe_1_5_d to use the dhcpv6RestartLatency and dhcpv6PDLatency testvars. These testvars allow CDRouter to give extra time for some DUT’s to (respectively) reinitiate DHCPv6 Prefix Delegation requests and to advertise a newly-learned prefix on the LAN. [LH #3721]
Resolved a misleading log message issue in the ipv6_ndp_30 test case. [LH #3722]
CDRouter BBF.069
The 5_092_CWMP_Faults_Upload test case has been updated to resolve an exception in cases where a TransferComplete RPC is not received. [LH #136]
CDRouter’s HTTP Cookie handling has been updated which corrects a problem in the 5_036_redirect_cookies test where an unsolicited CWMP session for a periodic Inform caused the wrong cookie value to be recorded. [LH #124]
The 5_014_DNS_server test has been updated to accommodate CPE devices which intentionally map domain names in DNS requests to mixed-case spelling. [LH #127]
All Upload and Download tests have been updated to include additional skip logic which prevents them from being run when relevant testvars are not properly configured. [LH #154]
The 5_010_Multiple_TCP_conn test case has been updated to ensure all subsequent connects include a Authentication header. [LH #155]
The unh_path and unh_base testvars have been removed and replaced with individual testvars. [LH #129]
The UNHWRAP procedure has been replaced by CDRouter’s built in SOAP validation. [LH #117]
The 5_041_maximum_SOAP_message test case has been updated to resolve an exception during the clean up procedure and ensure that the DUT is restored to its original state. [LH #158] [LH #157]
Updated the 5_037_redirect_response_data test to use an HTTPS URL in its “307 (Temporary Redirect)” message if the original ACS URL is also HTTPS. Prior to this change, the ACS always redirected the DUT to an HTTP URL. [LH #167]
CDRouter 10.7 Build 2 May 2, 2018
Bug Fixes and Notes
CDRouter
Updated the cdrouter_mcast_110 and cdrouter_mcast_120 tests so that the testvar iptvMaxFailures will trigger when either the forwarding check fails or the joining of the group fails. Previously, the check for the joining of the group was not considered by iptvMaxFailures. Also, these tests will now abort when the total number of failures is greater than or equal to iptvMaxFailures. Previously, the tests would abort when the total number of failures was greater than iptvMaxFailures. [LH #3742]
The cdrouter_urlfilter_40 test case has been updated to include the server name indication (SNI) TLS header. [LH #3738]
The cdrouter_app_25, cdrouter_app_26, cdrouter_app_27, and cdrouter_app_28 test cases have been updated to ensure that the DUT is actively using the primary DNS server before testing for failover to other non-primary DNS servers. [LH #3729]
CDRouter IPv6
Updated the dhcpv6_server_3 test case to support dynamic DHCPv6 valid lifetimes on the LAN that are based on the WAN side IA_PD valid lifetime. To verify this behavior the testvar ipv6DhcpClientValidLifetime can now be set to a keyword value of
dynamic
if the valid lifetime varies based on the delegated prefix received on the WAN. If set todynamic
this test will verify that the valid lifetime received on the LAN is less than or equal to the IA_PD valid lifetime assigned by CDRouter’s DHCPv6 server on the WAN (which is configured using the testvar dhcpv6IAValidLifetime).Corrected the mapt_42 test case to verify that ICMPv4 Type 3 messages are translated to ICMPv6 Type 1, where appropriate. [LH #3744]
Updated the dhcpv6_pd_62 test case to verify that the advertised prefix on the LAN matches the IA_PD provided by CDRouter on the WAN, regardless of the SLA ID used by the DUT (if any). [LH #3743]
Updated the dhcpv6_pd_63 test case to take into consideration the DUT’s expected SLA ID as configured using the testvar ipv6LanSubnetId. [LH #3743]
The ipv6_urlfilter_40 test case has been updated to include the server name indication (SNI) TLS header. [LH #3738]
Updated the dhcpv6_server_9 test case to allow the DUT to provide its link-local or unique-local IPv6 address as the DNS server to IPv6 LAN clients when the testvar ipv6DNStoLAN is set to a value of no. Previously this test only allowed the DUT’s global address in this configuration. [LH #3736]
CDRouter Nmap
Resolved an issue (introduced in CDRouter 10.6) in which the value of the nmapPorts testvar was being ignored, resulting in all Nmap scans being performed over the default port range of 0-2048. [LH #3747]
Resolved an issue (introduced in CDRouter 10.6) in which the scan type argument was not being passed into Nmap resulting in all tests performing the same scan. [LH #3749]
CDRouter 10.7 Build 3 June 7, 2018
Bug Fixes and Notes
CDRouter
Modified the behavior of the following DNS test cases: dns_210, dns_220, dns_230, dns_240, dns_tcp_210, dns_tcp_220, dns_tcp_230, and dns_tcp_240. If the lanDomainName is set to the keyword none, the LAN client will omit the domain name and include only a hostname in the DNS queries for local names that are sent to the DUT. [LH #3773]
CDRouter 10.6 introduced an issue in which the following test cases were not properly terminating the PPP link when a WAN mode of PPPoE was used: upnp_203, upnp_igd2_203, upnp_210, upnp_igd2_210, upnp_220, and upnp_igd2_220. This issue has been resolved. [LH #3759]
The cdrouter_upnp_203 test case and variants have been updated to handle implementations that utilize an intermediate
Connecting
connection status. [LH #3799]CDRouter’s DNS servers have historically been configured with a WAN MTU of 1404. This restriction has been lifted and the DNS servers will now use the MTU of the parent stack. [LH #3802]
Resolved an issue in the scaling and scaling-v6 test modules where CDRouter continued with the test when the DUT assigned an already used IP address to a client without any warning message. CDRouter now successfully detects and prints out a message letting user know that duplicate IP address was detected. In this scenario we mark the test case as failure. [LH #3746]
CDRouter IPv6
The
WANv6_terminate_link
API call has been updated to wait for the DHCPv6 prefix delegation (IA_PD) binding to update in WAN modes where DHCPv6 prefix delegation is enabled. Prior to this modification, this call only terminated the PPP link or waited for the DHCPv6 IA_NA binding to update. Tests that utilize this call will now support stateless WAN modes, such asautoconf
andstatic
, when DHCPv6 prefix delegation is enabled. This includes ula_10, ula_11, ula_12, ipv6_ripng_wan_50, ipv6_ripngwan_52, dhcpv6_pd_62, v6_cpe_2_2_b, ipv6_upnp_203, ipv6_upnp_igd2_203, ipv6_upnp_210, ipv6_upnp_igd2_210, ipv6_upnp_220, and ipv6_upnp_igd2_220. [LH #3759]CDRouter 10.6 introduced an issue in which the following test cases were not properly terminating the PPP link when an IPv6 WAN mode of PPPoE was used: ula_10, ula_11, ula_12, ipv6_ripng_wan_50, ipv6_ripngwan_52, v6_cpe_2_2_b, ipv6_upnp_203, ipv6_upnp_igd2_203, ipv6_upnp_210, ipv6_upnp_igd2_210, ipv6_upnp_220, and ipv6_upnp_igd2_220. This issue has been resolved. [LH #3759]
The default router lifetime in all RAs sent by CDRouter on the WAN has been changed from 1800 seconds to three times the WAN RA interval specified by the testvar ipv6RASendInterval. This is consistent with the recommended default value listed in Section 6.2 of RFC 4861. [LH #3787].
The dhcpv6_pd_15 test case has been modified to remove all IA_PD specific checks and instead focus on the behavior of LAN side RAs when the WAN link is down. In addition this test now waits for an RA from the DUT with a non-zero router lifetime before running the final connectivity check at the end of the test. These modifications are more consistent with the requirements being tested and also result in the test running much faster. [LH #3754]
The ipv6_slaac_wan_12 and ipv6_slaac_wan_13 test cases have been updated to better support bridge devices such as APs, Ethernet switches, etc. These tests now explicitly ensure that the router bit in Neighbor Advertisements received from the DUT is 0 for bridges and 1 for routers. Previously these tests would fail if the router bit was 0 for any type of device, which would lead to false negatives for bridge devices where the router bit is expected to be 0. [LH #3774]
Resolved an issue with CDRouter’s ICMPv4 checksum calculation in MAP-T mode. This issue resulted in dropped ICMPv4 packets and bad ICMP checksum warning messages in various test logs. [LH #3782]
Resolved an issue in the slaac-wan and cpe-v6 modules in which the M-bit in WAN RAs sent by CDRouter was being enabled for non DHCP WAN modes. These modules now properly set the M-bit based on the configured WAN mode. [LH #3783]
The ula_10, ula_11, ula_12, and dhcpv6_pd_15 test cases have been updated to wait for wait the longer of the WAN RA lifetime or the LAN RA interval + 1 LAN RA interval for the DUT to send the expected RAs on the LAN. These tests have also been updated to wait for the duration of the testvar dhcpv6PDLatency rather than a fixed delay of 5 seconds before performing the final connectivity check. [LH #3790]
CDRouter BBF.069
- The 5_019_conn_request and 5_020_conn_request_session_exists tests were updated to handle cases when the DUT sends a fragmented message to the ACS. [LH #3777]
CDRouter Nmap
- The nmap and nmap-v6 test modules are now multiport aware. Previously these tests were always executed on the primary LAN interface. In multiport configurations, these tests will now cycle through LAN interfaces. [LH #3418]
CDRouter 10.7 Build 4 July 9, 2018
New Features and Enhancements
CDRouter Nmap
New version of Nmap
CDRouter now uses version 7.70 of Nmap.
Bug Fixes and Notes
NTA1000
- Version 5.4 of the NTA1000 operating system image is now available! Please contact support@qacafe.com for more information.
CDRouter
Resolved a fatal error in the wifi_1 and wifi_2 test cases by automatically skipping them if no wifi interfaces with DHCP or DHCPv6 are available. These tests require a wifi interface that has DHCP or DHCPv6 enabled. [LH #3805]
Resolved a fatal error associated with setting the lanMac or wanMac testvars to a value of
00:00:00:00:00:00
. The config check utility now explicitly prevents these testvars from being set to this value. [LH #3780]The cdrouter_eapol_1 test case has been updated. For wired supplicants only, the destination MAC address of EAPOL packets from the DUT’s 802.1X authenticator can now be either the supplicant’s unicast MAC address or the PAE group address 01:80:C2:00:00:03. Previously only the unicast MAC address of the supplicant was allowed. [LH #3820]
Resolved an
invalid token
error when logging in to a CDRouter system via the web UI. [LH #3807]The web UI now supports all result filtering view modes while a result is running. Previously these options were only available for finished results. [LH #3792]
CDRouter’s 802.1X supplicant now waits up to 100ms for an EAPOL Failure message whenever it sends an EAPOL Logoff. Reception of an EAPOL Failure message indicates that the controlled port has been closed and resolves a race condition in certain test cases in the eapol test modules. [LH #3775]
CDRouter now actively monitors the state of all configured LAN and WAN network interfaces. If any configured interface is down at the start of a test CDRouter will fail the test. [LH #3794]
CDRouter IPv6
Introduced a new testvar, dhcpv6RelayServer, which can be set to the IPv6 address of the relay-server that forwards DHCPv6 requests from the DUT. This testvar is only necessary when the source IPv6 address of DHCPv6 requests sent by the relay-server is on a different prefix than the address being assigned to the DUT. [LH #3798]
Relaxed the requirements in the ipv6_ndp_wan_16 test case. Previously this test would FAIL if the DUT did not use its GUA as the source address of the NA sent to CDRouter. This test now allows the DUT to use any of its valid source addresses (GUA, LLA, etc.) as the source address of the NA. [LH #3801]
Resolved a false negative result when running the v6_cpe_1_2 test with the ipv6WanMode set to a value of
autoconf
. [LH #3800]
CDRouter TR-069
- Resolved an issue associated with maintaining the WAN PPPoE session while running the tr143_http test module. This issue resulted in premature termination of the PPPoE session leading to test failures. [LH #3829]
CDRouter DOCSIS
- Removed the 1,000,000 byte (1 MB) file size limit for the DOCSIS TFTP server. The DOCSIS TFTP server now supports large files and can be used for downloading firmware via the CM interface using the SNMP Scenarios feature. [LH #3806]
⦿ CDRouter 11.0 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 11.0 Build 1 | September 4, 2018 |
Maintenance Release 1 | CDRouter 11.0 Build 2 | October 4, 2018 |
Maintenance Release 2 | CDRouter 11.0 Build 5 | November 13, 2018 |
Note: CDRouter 11.0 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 11.0 testvars using the config upgrade utility.
Attention: Operating System Deprecation Notice
Support for the Ubuntu operating system has been deprecated. CDRouter systems running on Ubuntu will now see warning messages during installation and in the ‘start’ log of a test run. Support for this operating system will be officially removed with the next major version of CDRouter (12.0). Please contact support@qacafe.com for additional information and assistance in migrating to a supported operating system.
CDRouter 11.0 Build 1 September 4, 2018
New Features and Enhancements
CDRouter
New USP add-on!
We are pleased to announce CDRouter USP - a brand new add-on for testing the Broadband Forum’s User Services Platform (USP) protocol as defined in TR-369!
The USP add-on includes a powerful new USP controller with support for all three MTPs with and without MTP and USP layer encryption. A number of new USP specific test modules for verifying core functionality and profile support for the Device:2.12, FAPService:2.1, STBService:1.4, StorageService:1.2, and VoiceService:2.0 data models have also been developed.
Please see our website and the CDRouter USP User Guide for more information.
Updated WAN DHCP and DHCPv6 server
CDRouter’s WAN DHCP and DHCPv6 servers have been updated to better support testing of non-routing devices such as Ethernet switches and wireless access points. Specifically, CDRouter’s DHCP and DHCPv6 servers now serve addresses from a pool when the forwardingMode is
bridge
. This allows CDRouter to provide addresses to multiple clients when testing switches and APs. In standard routing configurations where the testvar forwardingMode is set toroute
these updates should be transparent.For more information, please see this Knowledge Base article .
Update to the ‘Results Diff’ tool
The Results Diff tool has been updated with a filter to only display test cases that did not produce the same result in all test runs being compared. For more information, please see the “How can I compare multiple test results?” article in our Knowledge Base.
CDRouter IPv6
Support for IPsec site-to-site VPN tunnels over IPv6
CDRouter now supports the testing of IPsec site-to-site (ie tunnel mode) VPN tunnels over IPv6 on the WAN. This new feature allows users to define, terminate, and test a mix of IPv4 and IPv6 IPsec VPN tunnels on the WAN with CDRouter.
Support for manually keyed IPv6 IPsec tunnels is included with the CDRouter IPv6 add-on. Support for dynamic IKEv1 IPv6 IPsec tunnels requires both the CDRouter IKE and CDRouter IPv6 add-ons.
IKEv1 based IPv6 IPsec tunnels can be tested using the existing ike and ike-natt (if NAT-T is enabled) test modules.
The ESP protocol for all defined IPv6 IPsec tunnels (manually keyed or keyed with IKEv1) can be tested with the new ipsec-esp-v6 test module which includes 10 new test cases.
New Duplicate Address Detection (DAD) test in the ndp test module
A new test, ipv6_ndp_16, has been added to the ndp test module. This test verifies that the DUT responds to DAD-style Neighbor Solicitations for its global IPv6 address on the LAN.
New test in ndp test module to verify behavior when IPv6 default route is lost
A new test, ipv6_ndp_34, has been added to the ndp test module. This test verifies that the DUT stops advertising itself as a router on the LAN when it receives Router Advertisements on the WAN with a router lifetime of zero. This test is designed to verify requirements G-4 and G-5 in RFC 7084.
Unique Local Address (ULA) tests
Two new tests, ula_13 and ula_14 have been added to the ula test module. These tests verify the DUT’s behavior with respect to ULA provisioning of LAN clients when it loses its default router on the WAN. This condition is simulated by sending Router Advertisements with a router lifetime of zero on the WAN.
New IPSEC pass-through module for IPv6
A new test module, ipsecpt-v6, adds six new test cases that can be used to verify the DUT’s functionality with respect to IPSEC pass-through connections from LAN to WAN and vice-versa over IPv6.
CDRouter TR-069
Updated CWMP profiles
CDRouter’s Device2_profiles test module has been updated to support version 2.12 of the Device:2 data model published by the Broadband Forum. All profiles defined in the following data models are now supported:
Data Model Version InternetGatewayDevice:1 1.14 Device:1 1.14 Device:2 2.12 STBService:1 1.4 VoiceService:1 1.1 VoiceService:2 2.0 StorageService:1 1.2 FAPService:1 1.1 FAPService:2 2.1 This update adds support for the new Device:2 profiles listed below:
Test Module Profile Device2_profiles L2TPBasic:1 Device2_profiles L2TPv3Adv:1 Device2_profiles VXLANBasic:1 Device2_profiles VXLANAdv:1 Device2_profiles LMAPPreconfiguration:1 Device2_profiles LMAPController:1 Device2_profiles BASAPM:1 Device2_profiles TWAMPReflectorBasic:1 New TR-069 Wireless configuration test cases
The tr69_wireless module has been updated with new tests to verify wireless LAN configuration with WPA/WPA2 Enterprise security settings. In addition to configuring the DUT with various combinations of WPA, WPA2, and WPA/WPA2, each test also verifies that CDRouter’s wireless client can connect to and pass traffic through the DUT in the specified configuration.
CDRouter IKE
Support for IKEv1 IPsec site-to-site VPN tunnels over IPv6
The CDRouter IKE add-on now supports configuration of IPv6 IKEv1 based IPsec VPN tunnels. Please see the note in the CDRouter IPv6 section above for more information.
CDRouter SNMP
New SNMPWalk command for SNMP scenario testing
The SNMP Scenario Testing feature has been updated to support SNMPWalk commands to retrieve multiple OID values at one time. SNMPWalk requests allow you to get all OID instances that exist at a particular node in the MIB hierarchy, and verify the value returned by the DUT.
Improved SNMP Scenario capabilities
Two new ways to check the DUT’s response to SNMP commands have been added to SNMP Scenario Testing:
Commands in SNMP Scenarios now support an
'expr'
argument to allow you to verify whether an OID’s value is less than, greater than, or equal to a specific value.A new
'contains'
argument to the SNMPTable command allows you to check the results of a table column as an single unit as opposed to checking each individual row.
New Test Modules and Test Cases
CDRouter IPv6
New test module for verifying IPsec site-to-site VPN tunnels over IPv6
MODULE: ipsec-esp-v6.tcl DESCRIPTION: IPv6 IPSEC ESP tests for IPSEC based VPNs NEW TEST CASES: 10
New Duplicate Address Detection test case
TEST: ipv6_ndp_16 MODULE: ndp.tcl DESCRIPTION: Verify DUT responds to DAD-style Neighbor Solicitations for global address on LAN
New test to verify behavior when DUT loses default IPv6 route on WAN
TEST: ipv6_ndp_34 MODULE: ndp.tcl DESCRIPTION: Verify DUT does not advertise itself as a default router when WAN RA lifetime is 0
New ULA test cases
TEST: ula_13 MODULE: ula.tcl DESCRIPTION: Verify unique local prefix is advertised when WAN RA lifetime is 0
TEST: ula_14 MODULE: ula.tcl DESCRIPTION: Verify Route Information option for unique local prefix is valid when WAN RA lifetime is 0
New IPsec pass-through module for IPv6
MODULE: ipsecpt-v6.tcl DESCRIPTION: IPv6 IPSEC based VPN pass through from the LAN to the WAN NEW TEST CASES: 6
CDRouter TR-069
Three new test cases to verify “WPA/WPA2 Enterprise” wireless LAN security configurations
TEST: tr69_wireless_40 MODULE: tr69_wireless.tcl DESCRIPTION: Verify WPA-Enterprise configuration (Device:2 Only)
TEST: tr69_wireless_41 MODULE: tr69_wireless.tcl DESCRIPTION: Verify WPA2-Enterprise configuration (Device:2 Only)
TEST: tr69_wireless_42 MODULE: tr69_wireless.tcl DESCRIPTION: Verify WPA/WPA2-Enterprise configuration (Device:2 Only)
CDRouter USP
Three new test modules for verifying core USP functionality
MODULE: usp_basic DESCRIPTION: Basic USP functionality tests NEW TEST CASES: 4
MODULE: usp DESCRIPTION: Extended USP functionality tests NEW TEST CASES: 30
MODULE: usp_conformance DESCRIPTION: Broadband Forum ID-369 USP conformance tests NEW TEST CASES: 62
MODULE: usp_scenarios DESCRIPTION: General USP configuration testing for user defined USP scenarios NEW TEST CASES: 1
Six new test modules for verifying USP profiles
MODULE: USP_Device2_profiles DESCRIPTION: TR-181 Issue 2 USP profile testing for Device:2 root data model NEW TEST CASES: 768
MODULE: USP_FAPService2_profiles DESCRIPTION: TR-196 Issue 2 USP profile testing for FAPService:2 data model NEW TEST CASES: 293
MODULE: USP_STBService1_profiles DESCRIPTION: TR-135 USP profile testing for STBService:1 data model NEW TEST CASES: 96
MODULE: USP_StorageService1_profiles DESCRIPTION: TR-140 USP profile testing for StorageService:1 data model NEW TEST CASES: 53
MODULE: USP_VoiceService2_profiles DESCRIPTION: TR-104 Issue 2 USP profile testing for VoiceService:2 data model NEW TEST CASES: 90
MODULE: usp_profiles DESCRIPTION: USP profile testing for user defined CWMP profiles NEW TEST CASES: 5
Bug Fixes and Notes
CDRouter
ATM support has been removed from CDRouter. This includes support for PPPoA as a WAN mode and the associated pppoa-c and renum-pppoa test modules. [LH #1530]
Support for 802.1X-WEP, also known as Dynamic WEP, as a wireless security mode has been removed from CDRouter. [LH #3700]
The data migration tools included with CDRouter 10.x have been removed. These tools were included to help migrate data from older systems to the new database introduced in CDRouter 10.0. Users running versions of CDRouter prior to 10.0 must upgrade to a 10.x release in order to preserve and migrate any old results. Please contact support@qacafe.com for more information or assistance. [LH #3715]
Resolved a display inconsistency with CDRouter’s web UI associated with the bulk edit feature. If the bulk edit feature was used to change the ‘device’ associated with one or more test results, the change was not reflected correctly on the Home page. The edited result(s) on the Home page and the Results page now match. [LH #3873]
Resolved an issue with the cdrouter_dhcp_32 test case in which CDRouter was sending the FORCERENEW message to the DUT on the server port (port 68). CDRouter now sends the message on the correct client port (port 67). [LH #3731]
Resolved an issue that caused a fatal error when CDRouter’s LAN client unexpectedly failed to connect to the DUT in a “Hotspot” configuration. [LH #3866]
Added a wifi hotspot sub-section to the “LAN->802.11 Wireless” configuration section of a default CDRouter configuration file. These testvars existed previously, but were not made visible in a default CDRouter configuration file [LH #3851]:
SECTION "Hotspot Router Settings" { testvar browserLoginUrl1 testvar browserLogoutUrl1 SECTION "Hotspot Clients" { testvar clientLoginName1 testvar clientLoginPassword1 } SECTION "Advanced Hotspot Settings" { testvar browserLoginProc testvar browserLogoutProc testvar browserScriptsPath } }
Added a new testvar browserScriptsPath to specify the name of the file that contains custom login and logout Tcl procs for “hotspot” configuration. [LH #3876]
The custom login and logout scrtps for “hotspot” scenarios are loaded into the ‘global’ Tcl namespace, so that specifying the buddy namespace (buddy::<proc_name>) to locate the custom procs is no longer required. [LH #3876]
Updated CDRouter to ensure that LAN clients with a designated IP address in the config file are allocated a static MAC address that is used throughout the test run. Test modules that create LAN clients with a designated address include: apps.tcl (inboundH323Host), dmz.tcl (lanDmzHost), mac-filter.tcl (filteredMacIp, unfilteredMacIp), static.tcl (staticRouteLanNextHop), static-v6.tcl (staticIpv6RouteLanNextHop), vservice.tcl (virtualTcpServiceHost, virtualUdpServiceHost). [LH #3855]
Updated the cdrouter_tport_10 test case to work when the DUT is configured to forward unknown traffic to a designated “DMZ” host on the LAN. [LH #3823]
CDRouter now waits up to startTimeout seconds for the DUT to contact the XMPP server during start when XMPP is enabled. Previously this value was hardcoded to a value of 65 seconds which might be too short for some DUTs. [LH #3878]
CDRouter IPv6
The looping logic and associated log messages in the dhcpv6_pd_15 test case have been cleaned up. This change allows the test to run faster and produces a more descriptive log file. [LH #3788]
Improved the logging of test case dhcpv6_140 to be more explicit about the expected timings of received DHCPv6 Solicit messages. [LH #3711]
Improved filtering to suppress excessive and unnecessary logging of received packets in the scaling and scaling-v6 modules. Broadcast and multicast packets sent by CDRouter’s LAN clients are already displayed in the log. The log files will not redundantly display messages from every other client on the LAN that receives these packets. [LH #3844]
The url-filter-v6 module is no longer skipped if the supportsDnsProxy testvar is set to “no”. [LH #3838]
CDRouter TR-069
A warning message will now be displayed in SPV profile test logs for any required parameters that are missing within the DUT’s data model. [LH #3847]
Updated support for the Device:2 (TR-181) data model when the acsCreatePortMapOnIGD testvar is set to “yes”. This allows the ACS to send Connection Requests to a TR-069 CPE device connected to the LAN-side of a TR-069 Gateway. Previously, only the InternetGatewayDevice:1 (TR-098) data model was supported. See “LAN Side TR-069 Devices” (Example 3) in the CDRouter TR-069 User Guide for more information and configuration details. [LH #3843]
All of the profile verification modules (Device2_profiles.tcl, InternetGatewayDevice1_profiles.tcl, cwmp_profiles.tcl, etc.) were updated to resolve a problem with the data validation of certain parameters in the data model. These tests will now correctly verify that parameters defined as a
list
of a particular data type are encoded with syntax typestring
in the SOAP message sent by the DUT, and not the data type of the individual elements. For example, CDRouter will verify that theDevice.Bridging.Bridge.{i}.Port.{i}.PriorityRegeneration
parameter (defined in the data model as a list ofunsignedInt
) is encoded as astring
by the DUT, and that each element of that string is an unsignedInt. Note that data validation is only done when the cwmpDataValidation testvar is set to “yes”. [LH #3879]The tests in the tr69_wireless.tcl and ir181.tcl modules were updated so that they no longer attempt to connect a wireless LAN client if the required wireless settings could not be successfully configured on the DUT. [LH #3868]
The tr69_410 test case has been updated. This test now verifies that the DUT’s NTP client is in the Synchronized state before performing additional validation on the DUT’s current local time. In addition, time validation of the DUT’s current local time has been improved. [LH #3810]
Updated the ACS to handle cases when the DUT sends an Inform with an empty
DeviceSummary
parameter. [LH #3656]Resolved an issue in the tr69_30 test case. The host making the connection request to the DUT must now be in the same address family (IPv4/IPv6) as the DUT’s Connection Request URL. [LH #3585]
Resolved a problem in the ir181_test_5.5.1 test which caused a fatal error and halted the test package. [LH #3882]
Upated tests ir181_test_5.6.9, ir181_test_5.6.11, and ir181_test_5.6.13. The tests now set the RadiusServerIPAddr parameter properly and no longer report an error when the DUT the RadiusSecret parameter with an empty string [LH #3890]
The various wireless tests in the ir181 test module have been updated and no longer attempt to set or query the
BeaconType
parameter on Device:2 systems. This parameter is defined only for IGD:1 and Device:1. [LH #3893]
CDRouter Performance
There is a known issue with CentOS 7.5 systems that may impact performance results. This issue is related to a CentOS bug that has been reported but not yet fixed. Please contact support@qacafe.com for more information and steps to resolve this issue. [LH #3891]
Support for omitting the first n UDP throughput measurements intervals has been removed. The testvar perfOmit may still be specified for TCP throughput tests. Using this testvar for TCP was the original intent to compensate for the ‘slow-start’ mechanism that many TCP implementations use. UDP has no such mechanism, so omitting the first few intervals is not needed. [LH #3750]
CDRouter SNMP
The SNMPTable command has been updated with a new
contains
argument that checks all rows of a particular table column and produces a single PASS/FAIL result instead of issuing separate PASS/FAIL results for each row. [LH #3815]A new SNMPWalk command has been added which allows multiple OIDs to be requested at once instead of having to issue separate GetRequest or GetNextRequest commands. [LH #3789]
CDRouter 11.0 Build 2 October 4, 2018
New Test Modules and Test Cases
CDRouter TR-069
New test cases added to TR-069 “ir181” module
Six new test cases have been added to the ir181.tcl module. These tests cover the “Localized Strings” section of the Broadband Forum ID-181 test plan to verify that the CPE correctly handles strings containing non-ASCII and multi-byte characters received from the ACS.
New Test Modules and Test Cases
CDRouter
New TR-069 test cases added to verify “Localized Strings” in CWMP messages
TEST: ir181_test_5.7.1 MODULE: ir181.tcl DESCRIPTION: ID-181 Test 5.7.1: Non-ASCII Characters in a SetParameterValues RPC
TEST: ir181_test_5.7.2 MODULE: ir181.tcl DESCRIPTION: ID-181 Test 5.7.2: Multi-Byte Encoding in a SetParameterValues RPC
TEST: ir181_test_5.7.3 MODULE: ir181.tcl DESCRIPTION: ID-181 Test 5.7.3: Non-ASCII Characters in a ParameterKey
TEST: ir181_test_5.7.4 MODULE: ir181.tcl DESCRIPTION: ID-181 Test 5.7.4: Multi-Byte Encoding in ParameterKey
TEST: ir181_test_5.7.5 MODULE: ir181.tcl DESCRIPTION: ID-181 Test 5.7.5: Non-ASCII Characters in CommandKey
TEST: ir181_test_5.7.6 MODULE: ir181.tcl DESCRIPTION: ID-181 Test 5.7.6: Multi-Byte Encoding in CommandKey
Bug Fixes and Notes
CDRouter
Resolved a fatal error in the cdrouter_dmz_1 test case when configuring a static MAC address using the lanDmzHostMac testvar. [LH #3912]
Resolved a fatal error in the cdrouter_dyndns_1 test case when the final update error code received from the DUT is ‘null’. [LH #3901]
Added a warning message if a LAN CLient receives an Information Element (IE) in an Association Response that includes an unexpected capability. [LH #3714]
Resolved an issue in which the values spcecified for the testvars clientLoginName and clientLoginPassword were not being used. [LH #3918]
Resolved the issue with the test case arp_12 where CDRouter did not send any gratuitious arp after creating lan clients. [LH#3921]
Starting in version 11.0, when CDRouter is running in “bridge mode”, CDRouter’s LAN clients now send DHCP requests which the DUT bridge will forward to the WAN link (see the note above for more details). In order for CDRouter’s DHCP server to distinguish the DUT’s client from LAN clients, the wanDutClientID testvar must be set to the hex value that appears in the DUT’s DHCP Client-ID option. Similarly, the ipv6WanDutDuid testvar must be set to the DUT’s DHCPv6 Client-ID option when CDRouter is running in bridge mode. It is no longer necessary to set the wanDutMac testvar when running in bridge mode. [LH #3906]
CDRouter TR-069
Resolved an issue in certain od128 and tr69 test cases where CDRouter’s ACS was sending a
CommandKey
argument that was greater than 32 characters when issuing a Reboot RPC. This caused some DUTs to reject the Reboot PRC request entirely. This issue has been resolved. CDRouter now always sends a validCommandKey
argument that is less than 32 characters. [LH #3903]Improved the processing of DUStateChangeComplete messages to prevent a fatal error from occurring if the message from the DUT could not be successfully parsed. [LH #3425]
Resolved an issue in CDRouter’s FTP server that caused a fatal error in the ir181_test_5.2.3 and ir181_test_5.2.5 tests when the DUT attempted to download diagnostics data. [LH #3926]
CDRouter IPv6
- Resolved an issue that caused CDRouter to send ICMPv6 Router Advertisements with the M-flag set when the WAN addressing mode (ipv6WanMode) was set to “autoconf”. This problem did not occur in CDRouter versions before 11.0 Build 1. [LH #3905]
CDRouter 11.0 Build 5 November 13, 2018
New Features and Enhancements
CDRouter
New test cases to detect presence of BCMUPnP_Hunter malware
Four new UPnP format string vulnerabilty test cases have been added to CDRouter: cdrouter_upnp_400, cdrouter_upnp_igd2_400, ipv6_upnp_400, and ipv6_upnp_igd2_400. These new tests check to see if the DUT’s UPnP server is susceptible to the UPnP string format vulernability recently identified within the
BCMUPnP_Hunter
malware.For more information on the
BCMUPnP_Hunter
malware, please see these links:https://blog.netlab.360.com/bcmpupnp_hunter-a-100k-botnet-turns-home-routers-to-email-spammers-en/ http://defensecode.com/whitepapers/From_Zero_To_ZeroDay_Network_Devices_Exploitation.txt
New Test Modules and Test Cases
CDRouter
New UPnP test cases for verifying susceptibility to BCMUPnP_Hunter malware
TEST: cdrouter_upnp_400 MODULE: upnp.tcl DESCRIPTION: Check for UPnP format string vulnerability used by BCMPUPnP_Hunter malware
TEST: cdrouter_upnp_igd2_400 MODULE: upnp.tcl DESCRIPTION: Check for UPnP format string vulnerability used by BCMPUPnP_Hunter malware
CDRouter IPv6
New UPnP test cases for verifying susceptibility to BCMUPnP_Hunter malware
TEST: ipv6_upnp_400 MODULE: upnp-v6.tcl DESCRIPTION: Check for UPnP format string vulnerability used by BCMPUPnP_Hunter malware
TEST: ipv6_upnp_igd2_400 MODULE: upn-v6p.tcl DESCRIPTION: Check for UPnP format string vulnerability used by BCMPUPnP_Hunter malware
Bug Fixes and Notes
CDRouter
Resolved an issue with the dmz test module in which a fatal error would be produced if the testvar lanDmzHostMac was not specified. [LH #3942]
Resolved an issue with the MTU configuration of CDRouter’s WAN DNS servers. The DNS server MTU now takes into account the WAN mode being used (DHCP, PPPoE, etc.). [LH #3981]
CDRouter TR-069
Resolved a problem with one of the parameter paths used when the ACS attempts to add new XMPP entries to the Device.XMPP.Connection. table in the DUT’s data model during the start phase of testing. [LH #3804]
Resolved an issue with setting the LocalTimeZoneName parameter in the test tr69_410. In previous versions of CDRouter, the parameter had a space in the string to set the timezone. This space has been removed to adhere to what is specified in the TR-098 Amendment 2 specification. [LH #3941]
⦿ CDRouter 11.1 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 11.1 Build 1 | December 4, 2018 |
Maintenance Release 1 | CDRouter 11.1 Build 2 | December 20, 2018 |
Note: CDRouter 11.1 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 11.1 testvars using the config upgrade utility.
Attention: Operating System Deprecation Notice
Support for the Ubuntu operating system has been deprecated. CDRouter systems running on Ubuntu will now see warning messages during installation and in the ‘start’ log of a test run. Support for this operating system will be officially removed with the next major version of CDRouter (12.0). Please contact support@qacafe.com for additional information and assistance in migrating to a supported operating system.
CDRouter 11.1 Build 1 December 4, 2018
New Features and Enhancements
CDRouter
Support for generating 802.11 wireless packet captures
CDRouter now has the ability to create 802.11 wireless packet captures during a test run. This feature can be enabled using the new wifiCapture testvar. When enabled, CDRouter will automatically create a monitor interface and generate 802.11 wireless captures for each WiFi interface that is in use.
A default capture filter will be applied when this testvar is set to a value of on. The default capture filter is dynamic based on the association state of the first wireless client on each physical WiFi interface.
Optionally, a user defined capture filter can be defined, in standard pcap-filter syntax, using the new wifiCaptureFilter testvar. User defined filters are applied by setting the wifiCapture to a value of filter.
All 802.11 packet captures generated by CDRouter will be available in the result directory on disk or via the Files dropdown within CDRouter’s web UI log viewer.
Improved packet capture viewer through TraceFrame
CDRouter’s packet capture viewer that allows users to perform deep packet analysis on the captures generated during testing has been dramatically improved through its integration with TraceFrame, the technology behind QA Cafe’s CloudShark Enterprise packet capture repository and analysis tool. Some of the key features include:
- An unlimited number of packets can be viewed at one time. This eliminates CDRouter’s 2000 packet limit on capture logs
- Faster and more efficient processing of packet views
- Sortable columns for each packet field
- The ability to drag-and-drop packet filters from the decode view into the filter box
And more! Use this new feature when looking at the packet captures generated while testing.
Security test list automatically included
With the advent of many broadband gateway security issues over the past few years, CDRouter now includes a security package that combines many security related test cases into a ready to use package to run against your devices. This package is also marked as a test list, so it can be included automatically in any other CDRouter test packages that you build. You can read more about the security test list in our quick start guide.
CDRouter Multiport
Support for virtual LAN test interfaces
This feature allows users to define logical LAN test interfaces that utilize a shared Linux system device, provided the MAC addresses are unique. This feature relaxes the one-to-one requirement between test interfaces and system devices that was enforced in earlier versions of CDRouter.
Virtual LAN test interfaces are defined with
testvar_groups
just like traditional test interfaces in earlier versions. Any test interface that supports virtualization can have virtual LAN test interfaces attached to it. For example, configurations like this are now possible with the Multiport add-on:# -- main LAN testvar lanInterface wlan1 testvar_group lan2 { testvar lanInterface eth2 } testvar_group lan3 { testvar lanInterface wlan1 testvar lanMac 00:00:00:22:22:22 } testvar_group lan4 { testvar lanInterface eth2 testvar lanMac 00:00:00:33:33:33 }
Support for additional LAN clients
This feature allows users to configure additional LAN clients on each non-unique LAN test interface (any test interface that doesn’t have a hard-coded MAC address) using the new lanClients testvar.
This feature makes it possible to easily create a large number of additional, persistent test clients without having to define LAN test interfaces or virtual LAN test interfaces using individual
testvar_groups
. For example, a simple but very powerful configuration that incorporates both the virtual LAN test interfaces and additional LAN clients features to create six test clients might look like this:# -- main LAN testvar lanInterface wlan1 testvar lanClients 2 testvar_group lan2 { testvar lanInterface eth2 testvar lanClients 2 } testvar_group lan3 { testvar lanInterface wlan1 testvar lanMac 00:00:00:22:22:22 } testvar_group lan4 { testvar lanInterface eth2 testvar lanMac 00:00:00:33:33:33 }
The combination of LAN test interfaces and additional LAN clients determine how many unique test clients will be created by CDRouter. Any test clients that are the result of the additional LAN clients feature are named using a sub-interface type convention, ie
lan.1
,lan.2
,lan2.1
,lan2.2
, etc. Test interfaces that have no additional LAN clients are simply referred to by their interface name, ielan3
,lan4
, etc.
CDRouter IPv6
Support for MAP-E
CDRouter now includes support for RFC7597, Mapping of Address and Port with Encapsulation (MAP-E). MAP-E is a stateless NAT64 technique that is designed to deliver IPv4 services over native IPv6 connections without having to deploy a full dual-stack network infrastructure. It also incorporates some carrier grade NAT (CGN) concepts by allowing multiple end user devices to share a single public IPv4 address.
For more information please see our Knowledge Base article on MAP testing with CDRouter.
CDRouter TR-069
New TR-069 Diagnotstic Tools test module
A new test module has been added to verify that the ACS can configure the DUT to run various diagnostic tests over the network. The module defines 30 new tests using the diagnostics provided by the IPPing, UDPEcho, and UDPEchoPlus service profiles in the DUT’s data model. The tests check whether the DUT is able to execute the requested diagnostics and report the correct results back to the ACS.
New ‘Event’ command for CWMP Scenario scripts
The CWMP Scenario Testing feature now supports an
Event
command to have the ACS wait for the DUT to send an Inform message containing a specific Event Code such as4 VALUE CHANGE
or8 DIAGNOSTICS COMPLETE
. This provides greater control over the flow of the scenario script by ensuring the ACS does not send subsequent commands until a specific event code has been received.Please see the CDRouter TR-069 User Guide for more details and examples of how to use this feature.
New tests in od128 test module to verify additional ChangeDUState operations
Four new tests have been added to verify that the ACS can install and update software components on the DUT using the ChangeDUState RPC method. The new tests provide additional coverage to ensure the DUT processes ChangeDUState requests with different combinations of arguments.
New tests in tr69 test module to verify changes across reboots
Two new tests, tr69_101 and tr69_102, have been added to verify that changes made by the ACS to the DUT’s data model are still in effect after the device is rebooted.
New testvar for specifying the DUT’s supported data model and profiles
A new testvar cwmpSupportedDataModel has been added to this release. This new testvar obsoletes the tr69FakeDeviceSummary and tr69ProfileMatch testvars and provides a host of new features and functionality that were not available previously.
There are now many different ways to specify the root and service data model profiles supported by the DUT. In addition, CDRouter now also has the ability to verify the DUT’s supported data model against a specific version of the data model published by the Broadband Forum.
Please see the TR-069 User Guide for more information.
New Test Modules and Test Cases
CDRouter IPv6
New test module for verifying MAP-E functionality
MODULE: mape.tcl DESCRIPTION: MAP-E tests for mapping IPv4 to IPv6 NEW TEST CASES: 19
CDRouter TR-069
New test module to run network diagnostic tests from the DUT
MODULE: tr69_diagnostics.tcl DESCRIPTION: TR-069 tests for diagnostic tools NEW TEST CASES: 30
New tests to verify ChangeDUState operations
TEST: od128_test_35.2 MODULE: od128.tcl DESCRIPTION: OD-128 Test 35 Part 2: Change DU State - Install with Execution Environment Reference
TEST: od128_test_35.3 MODULE: od128.tcl DESCRIPTION: OD-128 Test 35 Part 3: Change DU State - Update with only UUID
TEST: od128_test_35.4 MODULE: od128.tcl DESCRIPTION: OD-128 Test 35 Part 4: Change DU State - Update with only URL
TEST: od128_test_35.5 MODULE: od128.tcl DESCRIPTION: OD-128 Test 35 Part 5: Change DU State - Update with UUID and URL
New tests to verify ACS changes persist across reboot
TEST: tr69_101 MODULE: tr69.tcl DESCRIPTION: Verify values set by SetParameterValues are persistent across Reboot
TEST: tr69_102 MODULE: tr69.tcl DESCRIPTION: Verify objects created by AddObject are persistent across Reboot
Bug Fixes and Notes
CDRouter
The default value of the testvar wifiBeaconPhy has been changed from n to n a ac. [LH #3977]
Removed PPPoE as an option for testvars lanMode and ipv6LanMode. This was a legacy option used for internal testing at QA Cafe. We have not run into any instances where PPPoE was needed for testing with simulated LAN clients. [LH #3934]
As a result of the new virtual LAN test interfaces and additional LAN clients features added in this release, the naming convention for device capture files has changed.
In previous releases, all device captures were named using the convention:
<test name>-<test interface>.cap
In 11.1 a single device capture is generated for each wireless test client using the convention:
<test name>-<test interface>.<client>.cap
Whereas all Ethernet test clients are aggregated into a single device capture file using the convention:
<test name>-<lan or wan>-<device name>.cap
Within the web UI for all releases, the test name is ommitted from the device capture file name in the Files drop down on the Results page.
This release also introduces the wifi capture feature which creates a new 802.11 capture for each wireless Linux system device in use:
<test name>-<lan or wan>-<device name>.cap
The cdrouter_esp_400, cdrouter_scale_1, and cdrouter_scale_2 tests now allow up to 10 seconds for HTTP reads. Previously this was 5 seconds. [LH #3985]
The cdrouter_upnp_igd2_400 and ipv6_upnp_igd2_400 test cases are now skipped when using a configuration file that has the testvar upnpDevice set to a value of InternetGatewayDevice:1. [LH #3995]
Resolved a fatal error associated with the establishment and testing of manually keyed IPv4 IPSec tunnels on systems do not have the IPv6 add-on. This issue was introduced in release 11.0.1 and does not impact earlier versions of CDRouter. [LH #4011]
Due to incompatibilities with certain wireless drivers, the cdrouter_dos_10 test case will now only run on Ethernet LAN interfaces. [LH #4026]
CDRouter IPv6
The icmpv6_10 and icmpv6_32 test cases have been updated to verify the DUT’s behavior when receiving IPv6 packets with Hop Limits of 0 and 1. Previously these tests only verified the case where the Hop Limit was 1. [LH #3886]
The ipv6_esp_400, ipv6_scale_1, and ipv6_scale_2 tests now allow up to 10 seconds for HTTP reads. Previously this was 5 seconds. [LH #3985]
The cdrouter_pptppt_2, cdrouter_pptppt_100, and cdrouter_scale_20 test cases have been updated to bring up a full PPP session within the PPTP connections that are established. [LH #3920]
CDRouter TR-069
Additional XML syntax validation is now performed on all CWMP messages received from the DUT. Any message containing a variable number of elements, such as an Inform or GetParameterValuesResponse, must indicate the correct number of elements or leave the number of elements unspecified.
Example: The GetParameterValuesResponse below is encoded with the
ParameterList
XML tag specifying an array of 2ParameterValuesStruct
elements, but actually contains 3 parameters:<SOAP-ENV:Body> <cwmp:GetParameterValuesResponse> <ParameterList SOAP-ENC:arrayType="cwmp:ParameterValueStruct[2]"> <ParameterValueStruct> ..... </ParameterValueStruct> <ParameterValueStruct> ..... </ParameterValueStruct> <ParameterValueStruct> ..... </ParameterValueStruct> </ParameterList> </cwmp:GetParameterValuesResponse> </SOAP-ENV:Body>
The ACS now will log a Warning message and ignore any message with incorrect element syntax.
WARNING(tr69): Malformed array length in SOAP message. 3 elements in ParameterList, but arrayType attribute reads 'cwmp:ParameterValueStruct[2]'
This may result in test failures if the ACS does not receive a message with the correct syntax. [LH #3929]
Updated the Set-Cookie header sent by the ACS to ensure invalid characters are not included. The Set-Cookie header is composed from the
OUI
andSerialNumber
arguments in the DUT’s Inform message, which could potentially contain characters that are not permitted in the Set-Cookie header. [LH #2327]The acsDiscoveryUrl testvar default value has been updated. The default value is now built using the value of acsDomain instead of the acsIp. As a result, the default ACS discovery URL provided by CDRouter’s DHCP/DHCPv6 servers is
http://acs.qacafe.com:80
. [LH #3952]Tests that verify
ChangeDUState
operations (od128_test_35.1 through od128_test_35.6) will now be skipped if the testvars tr69DUChangeExecEnvRef, tr69DUInstallImage, and tr69DUInstallUUID are not configured. [LH #3974]The Tcl interpreter shipped with CDRouter has been patched to fix a problem with the ACS message handler. TR-069 responses containing unusual combinations of characters with special meaning in TCL were not being parsed correctly by the Tcl interpreter. [LH #3991]
Fixed the capitalization of the
ExecutionEnvRef
tag inChangeDUState
SOAP messages during uninstall operations. [LH #4001]The tr69FakeDeviceSummary and tr69ProfileMatch and have been deprecated and replaced by the new cwmpSupportedDataModel testvar. [LH #3856]
CDRouter Performance
- Fixed the allowed range of values for perfStreamIncr to match the max values supported by CDRouter. [LH #3963]
CDRouter 11.1 Build 2 December 20, 2018
New Features and Enhancements
CDRouter
Update to the Bulk Edit tool for test packages
The Bulk Edit tool on the Packages page of the web interface has been updated to support Config file selection. This change makes it possible to change the config file of multiple packages with a single operation. [LH #4031]
CDRouter TR-069
New TR-069 wireless test case
A new test case, tr69_wireless_50, has been added to the tr69_wireless test module. The purpose of this test is to verify that the DUT can be configured to use all of the wifi channels that it supports based on the value of the
PossibleChannels
parameter. This test queries the DUT for the value of thePossibleChannels
parameter and walks through each returned value attempting to configure the DUT to use that channel, associate to the DUT on that channel, and pass traffic.
New Test Modules and Test Cases
CDRouter TR-069
New test case for verifying that all supported wifi channels can be enabled and used
TEST: tr69_wireless_50 MODULE: tr69_wireless.tcl DESCRIPTION: Verify that all supported channels can be configured and used (IGD & Device:2)
Bug Fixes and Notes
CDRouter
The testvar staticHost has been deprecated. [LH #4050]
Resolved a problem in the vservice.tcl module that was causing a non-fatal “Can’t find suitable LAN stack” error in some configurations. [LH #3980]
Resolved a fatal error during start when testvars dhcpv6ClientOptionCode and dhcpv6ClientOptionData were configured with non default values. [LH #4047]
CDRouter Nmap
- Resolved a fatal error when running Nmap tests on the WAN using config a file in which the testvar lanInterface was set to a value of none. [LH #3833]
CDRouter TR-069
Resolved a fatal error in the ir181_test_5.3.3 test case. [LH #4040]
Updated the tr69_wireless test module and the ir181_test_5.6.1 through ir181_test_5.6.15 test cases to properly restore auto channel selection at the end of the tests based on the value of the
AutoChannelEnable
parameter returned by the DUT at the start of the test. [LH #4023]The tr69_wireless test module, od128_test_19.1 test case, and ir181_test_5.6.1 through ir181_test_5.6.15 test cases have been updated to be compatible with configurations that utilize multiple wireless clients. [LH #3552]
CDRouter Performance
- Resolved a problem in the perf_mcast_lan_2 test that caused it to report zero throughput even though multicast traffic was actually received. [LH #3894]
⦿ CDRouter 11.2 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 11.2 Build 1 | February 6, 2019 |
Maintenance Release 1 | CDRouter 11.2 Build 2 | March 4, 2019 |
Note: CDRouter 11.2 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 11.2 testvars using the config upgrade utility.
Attention: Operating System Deprecation Notice
Support for the Ubuntu operating system has been deprecated. CDRouter systems running on Ubuntu will now see warning messages during installation and in the ‘start’ log of a test run. Support for this operating system will be officially removed with the next major version of CDRouter (12.0). Please contact support@qacafe.com for additional information and assistance in migrating to a supported operating system.
CDRouter 11.2 Build 1 February 6, 2019
New Features and Enhancements
CDRouter
802.11ac Wave 2
CDRouter now supports 802.11ac Wave 2 connections for both simulated LAN clients and WiFi WAN connections. This support comes through the new NTA1000v6 platform, released alongside CDRouter 11.2. If you are interested in upgrading your system to the NTA1000v6, please reach out to sales@qacafe.com.
In addition, Wi-Fi scaling tests are now supported on all 3 of the NTA1000v6 wireless cards.
Support for DNS over HTTPS (DoH)
CDRouter’s WAN DNS servers now support DNS over HTTPS (DoH) as defined in RFC 8484.
With the addition of DNS over HTTPS, CDRouter’s DNS servers now support four different transports: traditional DNS over UDP on port 53, DNS over TCP on port 53, DNS over TLS (DoT) on port 853, and DNS over HTTPS on port 443.
For more information please see our Knowledge Base article on testing DNS over TLS and HTTPS with CDRouter.
CDRouter Multiport
Support for layer 2 GRE tunnels on the WAN
CDRouter now supports layer 2 IPv4 GRE tunnels on the WAN, as defined in RFC 2784. For more information, please see the CDRouter User Guide.
A new l2gre test module, with 12 test cases, has also been added. This test module can be used to validate layer 2 GRE tunnel behavior on the DUT.
In addition, two more application style L2GRE tests have been added to apps and apps-v6 test modules. [LH #3260]
CDRouter IPv6
Support for IPv6 DNS over HTTPS (DoH)
CDRouter’s WAN IPv6 DNS servers now also support DNS over HTTPS as a transport. See the announcement above for more information.
CDRouter TR-069
New commands added to CWMP Scenario Testing feature
The CWMP Scenario Testing feature now includes support for GetParameterAttributes and SetParameterAttributes requests to allow scenarios to configure Notifications for any parameter in the CPE’s data model. The Event command has also been updated so that the parameters in Inform messages can be verified when a “Value Change” Event occurs.
These new commands are documented in the CWMP Scenario Testing section of the CDRouter TR-069 User Guide.
CDRouter ICS
Automatically generated capture file for all ICS traffic
When ICS is enabled CDRouter now automatically generates a separate capture file, per test case, for all ICS traffic. The new capture files can be accessed by clicking on the file labeled ics in the Files drop-down within the web UI.
ICS capture files allow users to quickly and easily see exactly what cloud service or resources a device is communicating with. This information is very helpful in understanding the behavior of a device and assessing its overall security.
New Test Modules and Test Cases
CDRouter
New L2GRE application tests
TEST: cdrouter_app_140 MODULE: apps.tcl DESCRIPTION: Verify IPv4 L2GRE session through the router
CDRouter Multiport
New GRE test module
MODULE: l2gre.tcl DESCRIPTION: L2 over GRE related test cases NEW TEST CASES: 12
CDRouter
New IPv6 L2GRE application tests
TEST: ipv6_app_140 MODULE: apps-v6.tcl DESCRIPTION: Verify IPv6 L2GRE session through the router
CDRouter TR-069
New ACS redirection test cases
TEST: tr69_35 MODULE: tr69.tcl DESCRIPTION: Verify CPE follows 302 redirects to new ACS server with a specified port number
TEST: tr69_36 MODULE: tr69.tcl DESCRIPTION: Verify CPE follows 307 redirects to new ACS server with a specified port number
Bug Fixes and Notes
CDRouter
The CDRouter Customer Lounge website has been redesigned and no longer supports password authentication. Instead, registered users can log in by entering their email address to receive a single-use login token via email. Consequently, the Automatic Upgrade feature on the
/system/upgrade
page of CDRouter’s web interface no longer requires a password. A valid, registered email address must still be entered for users to be able to automatically upgrade CDRouter to the latest version, however. Please contact support@qacafe.com if you have any questions about the CDRouter customer Lounge. [LH #3998]The renum-dhcp, renum-l2tp, renum-pptp, and renum-pppoe test modules have been updated. Many of the tests in these modules have been updated with an additional test metric to explicitly verify that the orignal IP is properly restored and that traffic is flowing at the end of the test. The following table list the test cases affected: [LH #4062]
renum-dhcp renum-l2tp renum-pppoe renum-pptp cdrouter_renumber_1 cdrouter_renum_l2tp_1 cdrouter_renum_pppoe_1 cdrouter_renum_pptp_1 cdrouter_renumber_2 cdrouter_renum_l2tp_2 cdrouter_renum_pppoe_2 cdrouter_renum_pptp_2 cdrouter_renumber_3 cdrouter_renum_l2tp_3 cdrouter_renum_pppoe_3 cdrouter_renum_pptp_3 cdrouter_renumber_4 cdrouter_renum_l2tp_6 cdrouter_renum_pppoe_6 cdrouter_renum_pptp_6 cdrouter_renumber_5 cdrouter_renum_l2tp_50 cdrouter_renum_pppoe_50 cdrouter_renum_pptp_50 cdrouter_renumber_6 The dhcp-c.tcl modules can now be run when CDRouter is in “bridge mode” (testvar forwardingMode is set to “bridge”). [LH #3954]
Improved the TCP behavior associated with the IPv4 https and http2 test cases to better handle packets received out of order and also delayed closing the session to ensure receiving the TCP FIN. [LH #3846]
The version of TCL that CDRouter uses has been upgraded to 8.6.9.
The version of the wpa_supplicant driver that CDRouter uses has been upgraded to 2.7.
Resolved a memory leak leading to system unresponsiveness. This issue was triggered when an OSPFv3 LS Update packet was received by CDRouter. [LH #4081]
Resolved an issue with the NTP server option provided by CDRouter’s DHCP server on the WAN. In previous releases if two NTP servers were defined, the DHCP option would contain only the information for the second NTP server. Both NTP servers are now included in the DHCP option, if specified. [LH #4059]
CDRouter Multiport
The interface rotation logic for failure retries has been modified. Prior to this release, if the test retry package option was enabled in a configuration with multiple LAN interfaces, CDRouter would rotate to the next test interface when a test failed. Now, when a test fails under these conditions, all test retries will utilize the same test interface rather than rotating to the next test interface. [LH #4045]
Prior to this release, the scheme for automatically generating MAC addresses for wireless clients involved appending a 24-bit client identifier to the 24-bit cdrouterOui:
<24-bit OUI><24-bit Client ID>
This scheme is not sufficient for certain configurations where some additional uniqueness, per wireless interface, is required.
If there is more than one wireless LAN interface in use, CDRouter now ensures that all wireless LAN interfaces have a unique 32-bit MAC prefix which is composed by appending an 8-bit random interface identifier to the 24-bit cdrouterOui.
The scheme for automatically generating MAC addresses for wireless clients now involves appending a 16-bit random client identifier to the unique 32-bit interface prefix:
<24-bit OUI><8-bit Interface ID><16-bit Client ID>
Note that this change applies only to wireless clients when there are more than one wireless LAN interface in use. If there is only a single wireless LAN interface in use CDRouter retains the pre 11.1 behavior. [LH #4066]
The lanMac can no longer be specified for wireless interfaces if more than one wireless interface is configured. [LH #4066]
If more than one wireless interface is in use, the following tests and modules will now be skipped [LH #4066]:
Test Cases Test Modules cdrouter_dhcp_server_3 mac-filter.tcl static_1 dmz.tcl static_2 vservice.tcl static_10 triggerp.tcl static_20 arp_10 arp_11 arp_12 arp_13 cdrouter_app_220 cdrouter_app_225 cdrouter_app_227 static_v6_1 static_v6_2
CDRouter IPv6
- Improved the TCP behavior associated with the IPv6 https and http2 test cases to better handle packets received out of order and also delayed closing the session to ensure receiving the TCP FIN. [LH #3846]
CDRouter TR-069
Updated the tr69_1 test case to verify the MaxEnvelopes and CurrentTime fields in Inform messages [LH #3948]
Updated the tr69_320 test case to include the
cwmp:ID
header in the Fault response sent by the ACS. [LH #4053]The new testvar acsStrictSyntaxChecking can be used to enable or disable the additional XML syntax validation of array lengths on all CWMP messages received from the DUT. This additional XML syntax check was originally added in CDRouter 11.1 and enabled by default. Setting this testvar to “off” will disable this. [LH #4064] [LH #3929]
Upated tests ir181_test_5.6.9, ir181_test_5.6.11, and ir181_test_5.6.13. The tests now set the RadiusServerIPAddr parameter properly and no longer report an error when the DUT the RadiusSecret parameter with an empty string [LH #3890]
CDRouter 11.2 Build 2 March 4, 2019
Bug Fixes and Notes
CDRouter
A new testvar dhcpRelayServer has been added. This testvar specifies the IPv4 address of the DHCP relay server and is only needed in setups where the relay server is on a different subnet than the address being assigned to the DUT. This testvar is equivalent to the IPv6 testvar dhcpv6RelayServer which was added in CDRouter 10.7.4. [LH #4082]
The generic HTTP server used by CDRouter in various test cases now utilizes the native Linux TCP stack for improved performance and robustness. Certain test cases that require specific non-standard HTTP or TCP behavior will continue to use CDRouter’s built-in TCP stack. [LH #2244]
CDRouter IPv6
All CDRouter stacks that are directly connected to the DUT now perform IPv6 Duplicate Address Detection (DAD) on all link-local, unique-local, and global unicast addresses before configuring and using them.
This change impacts CDRouter’s primary WAN stack and all IPv6 enabled LAN clients. If conflicts are detected during DAD, a warning will be displayed in the log file. Additionally, if privacy addresses are used on the LAN CDRouter will automatically assign a new, random privacy address and attempt DAD again.
Note that this enhancement has resulted in changes to the underlying pktsrc API that may impact custom tests. Please refer to the pktsrc API notification section below for more information. [LH #3955]
Updated the dhcpv6_pd_62 test case so that it no longer sends unnecessary IPv6 ping requests after the WAN link has been brought down. [LH #4092]
Update the rip-ng and rip-ng-wan test modules to wait up to 50 seconds for RIPng updates from the DUT, in accordance with Section 2.3 of RFC 2080. RFC 2083 states that the DUT’s RIPng timer should trigger every 30 seconds +/- 15 seconds. By waiting up to 50 seconds CDRouter ensures that all RIPng updates sent by the DUT should have been received. Previously these tests waited up to 40 seconds, which was not adequate in some cases. [LH #4103]
The ipv6_ripng_200 test case is now properly skipped if the testvar ripAcceptWanUpdate is set to a value of no. [LH #4101]
Updated the ipv6_ndp_wan_16 test case to resolve a fatal error that occurred while running in static WAN mode. [LH #4091]
The testvar supportsULA now defaults to a value of no. [LH #4102]
CDRouter TR-069
Updated the tr69_80 and tr69_81 test cases to ignore authentication failures (if present) during the clean portion of the test. This allows CDRouter to always restore the DUT’s original connection request username and password regardless of the final result of the test. [LH #4079]
Resolved an issue with the tr69_64 test cases in which
LeaseDuration
parameter was being set to two conflicting values in the same SetParameterValues call. [LH #4094]
Pktsrc API Notifications
As a result of ticket #3955 detailed above, the following pktsrc API modifications have been made and may impact custom tests.
The
IPv6_set
proc supports a new, optional argumentnodad
which will disable DAD when setting an address on a stack.The following pktsrc API calls now have an optional
packet
argument which is used for retrieving a DHCPv6 packet from a callback. The optionalpacket
argument should be used instead of callingStack_get_protocol s DHCPv6 <packet>
which is no longer guaranteed to work with DAD enabled.- DHCPv6_client
- DHCPv6_client_decline
- DHCPv6_client_release
- DHCPv6_confirm
- DHCPv6_information_request
- DHCPv6_rebind
- DHCPv6_renew
- DHCPv6_request
- DHCPv6_server_wait_for_event
⦿ CDRouter 11.3 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 11.3 Build 1 | March 28, 2019 |
Maintenance Release 1 | CDRouter 11.3 Build 2 | April 25, 2019 |
Note: CDRouter 11.3 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 11.3 testvars using the config upgrade utility.
Attention: Operating System Deprecation Notice
Support for the Ubuntu operating system and CentOS 6 has been deprecated. CDRouter systems running on Ubuntu or CentOS 6 will now see warning messages during installation and in the ‘start’ log of a test run.
Support for both of these operating systems will be officially removed with the next major version of CDRouter (12.0). Please contact support@qacafe.com for additional information and assistance in migrating to a supported operating system.
All CDRouter systems will require the CentOS 7 operating system in order to install CDRouter 12.0 and beyond.
CDRouter 11.3 Build 1 March 28, 2019
New Features and Enhancements
CDRouter
Support for captive DNS
The cdrouter_app_30 and ipv6_app_112 test cases have been updated to support captive DNS, which is a DNS filtering feature that re-routes all outbound DNS requests to the DUT’s local DNS server.
Captive DNS prevents LAN clients from bypassing any DNS based content filtering or parental control mechanisms that may be implemented within the DUT. The new testvar dnsCaptive specifies whether or not captive DNS is enabled within the DUT.
CDRouter IPv6
New IPv6 Top-100 Test List
CDRouter now includes a sample test package containing CDRouter’s top 100 IPv6 test cases. The tests in the IPv6 Top-100 test list focus on fundamental IPv6 functionality that every IPv6 CPE gateway should support. This test package can be used as a testing benchmark of essential IPv6 support, and is a great way to quickly evaluate the IPv6 operation of any CPE device. This package is also marked as a test list, so it can be included automatically in any other CDRouter test packages that you build. You can read more about the IPv6 Top 100 test list in our quick start guide.
CDRouter TR-069
New TR-069 Essentials Test List
CDRouter now includes a sample test package containing CDRouter’s TR-069 test cases. The tests in the TR-069 Test List focus on core TR-069 functionality including CWMP protocol operation and Baseline data model support that every TR-069 capable CPE device should support. This test package can be used to set a baseline for a CPE’s TR-069 support, and is a great way to quickly evaluate the fundamental operation of any TR-069 device. This package is also marked as a test list, so it can be included automatically in any other CDRouter test packages that you build. You can read more about the TR-069 test list in our quick start guide.
Support for TR-069 Amendment 6 enhancements
CDRouter has been updated to support many of the new features and enhancements added to Amendment 6 of the TR-069 specification published by the Broadband Forum. Updates include support for Alternate Firmware Images, Heartbeat Inform Events, and Wildcard Parameter Names. New test cases have been added to the tr69.tcl module to validate these features on the CPE device under test.
CDRouter Performance
New testvar for specifying differentiated services code point (DSCP) value
The new testvar perfDSCP can be used to set the differentiated services field (DS field) in the IPv4 header or the traffic class field (TC field) in the IPv6 header of all performance traffic that is generated by CDRouter to a specific value.
NTA1000
New 5.5 Golden Image
A new version of the NTA1000 disk images has been created. This set of disk images is based on the new nta1000-updates-5.5-3.el7.x86_64.rpm, which is also available. This set of disk images and the RPM are for pre-v6 NTA1000 systems only. For more information, please see the Golden Image Release Notes.
New Test Modules and Test Cases
CDRouter TR-069
TR-069 Amendment 6 Wildcard Parameter Names
TEST: tr69_wildcard_1 MODULE: tr69.tcl DESCRIPTION: Validate GetParameterValues RPC works with wildcards
TEST: tr69_wildcard_2 MODULE: tr69.tcl DESCRIPTION: Validate GetParameterNames RPC works with wildcards
TEST: tr69_wildcard_3 MODULE: tr69.tcl DESCRIPTION: Validate GetParameterAttributes RPC works with wildcards
TR-069 Amendment 6 Heartbeat Inform Events
TEST: tr69_heartbeat_1 MODULE: tr69.tcl DESCRIPTION: Verify non-heartbeat sessions take precedence
TEST: tr69_heartbeat_2 MODULE: tr69.tcl DESCRIPTION: Verify other events are not included in heartbeat messages
TEST: tr69_heartbeat_3 MODULE: tr69.tcl DESCRIPTION: Verify heartbeats are discarded if there is an existing heartbeat session
TEST: tr69_heartbeat_4 MODULE: tr69.tcl DESCRIPTION: Verify non-heartbeat Informs take precedence over Heartbeats
TEST: tr69_heartbeat_5 MODULE: tr69.tcl DESCRIPTION: Ensure heartbeats are dropped if heartbeat session is being retried
TR-069 Amendment 6 Alternate Firmware Images
TEST: tr69_inactive_firmware_1 MODULE: tr69.tcl DESCRIPTION: Verify Multiple Firmware Images mechanism functions properly
Bug Fixes and Notes
CDRouter
In CDRouter 11.2, the Automatic Upgrade feature in CDRouter’s web interface was updated to support the newly redesigned CDRouter Customer Lounge website, which no longer supports password authentication. Please see the CDRouter 11.2 Release Notes for details. [LH #3998]
The generic
cdrouter_check_connectivity
proc which is used by CDRouter to verify that IPv4 and/or IPv6 connectivity is working as expected in various test cases has been updated. This proc will now always check both IPv4 and IPv6 connectivity if called with a value of auto. [LH #4113]Resolved an issue with pptp-pt test module in which the PPTP pass-through connections were not properly cleaned up, causing subsequent tests from the pppoe-pt module to generate a fatal error. [LH #4110]
Resolved an issue with the dns_tls_150 and dns_tls_400 test cases which were not using TLS as a transport. [LH #4124]
CDRouter IPv6
Updated the dhcpv6_pd_15 test case to send a Router Solicitation instead of just waiting for the DUT to send its next periodic unsolicited RA. [LH #4118]
The icmpv6_34 test case will now be skipped in DHCPv6 relay or routed IPv6 setups. Previously this test case would run but fail in these setups because the intermediate router or relay would drop the ping packet that was sent by CDRouter with a TTL of 0. [LH #4112]
Resolved an issue with the ipv6_dns_tls_150 and ipv6_dns_tls_400 test cases which were not using TLS as a transport. [LH #4124]
The v6_cpe_2_5 test case is not compatible with DHCPv6 on the LAN and will now be skipped unless autoconf is used. [LH #4084]
The common test cleanup produced used within the cpe-v6 module has been updated to send a valid RA based on the settings in the configuration file once all other cleanup steps have been performed. [LH #4084]
CDRouter TR-069
- The tr69_wireless_50 test case has been updated to verify that each WiFi channel reported by the DUT is supported by the CDRouter system’s wireless interface before attempting to test it. [LH #4104]
CDRouter Performance
Upgraded the underlying core engine for the Performance Addon to use iPerf v3.6. This upgrade included several minor bug fixes and enhancements to iPerf. It also allows a CDRouter log enhancement to display both the sender and receiver summary statistics for the UDP throughput test cases. [LH #3106]
Modified the multicast upload performance test cases perf_mcast_2 and ipv6_perf_mcast_2 to restrict the number of streams to 1, regardless of the value set for perfStreams or perfStreamIncr, to achieve more realistic results.
CDRouter 11.3 Build 2 April 25, 2019
Bug Fixes and Notes
CDRouter
Resolved an issue where the testvar wanDutClientID was not always evaluated as case-insensitive. Both upper and lower case hex characters will now be equivalent. [LH #4130]
In previous releases, the CDRouter web CLI would generate the following error message if the
-https
flag was not specified when running commands on systems with HTTP Strict Transport Security (HSTS) enabled via the ‘force_https’ option in the web server configuration file:[root@astro ]# cdrouter -package "foo" -token ea39bf22 2019/03/15 09:55:22 json: cannot unmarshal array into Go struct field .data of type job.Job
The CDRouter web CLI has been updated to automatically detect if the
force_https
option is enabled and behave as if the-https
has been applied which will prevent this error from occurring. [LH #4125]CDRouter now has a basic unicast reverse path forwarding filter (uRPF) for both IPv4 and IPv6. With this modification CDRouter will drop incoming packets if the source address of the packet matches a unicast source address of the receiving stack. [LH #4096]
In configurations with more than 10 LAN test clients, CDRouter now rotates through the list of clients numerically rather than alphabetically. [LH #4069]
All of the DHCP/DHCPv6/autoconf scaling tests have been re-factored. These tests now utilize any existing LAN stacks or additional LAN clients that may have been created using the lanClients testvar.
These changes impact the following tests:
Test Module Add-On Test Case(s) scaling Base all scaling-v6 IPv6 all sip-alg Base cdrouter_sip_200 sip-alg-tcp Base cdrouter_sip_tcp_200 ftp Storage ftp_52 ftps Storage ftps_52 ftp-v6 Storage ipv6_ftp_52 ftps-v6 Storage ipv6_ftps_52 smb Storage smb_52 smb-v6 Storage ipv6_smb_52 In addition, the cdrouter_scale_3 and ipv6_scale_3 tests have been updated for compatibility with configurations that have a small free network range. These tests will now create as many unique WAN servers as possible and increment port numbers on the servers if needed to create additional endpoints. [LH #4020]
Resolved an issue with the HTTP server that is initialized in the cdrouter_renum_pppoe_6 test case. This issue prevented devices from establishing a TCP connection to the server, which ultimately led to a false negative test failure. Note that this issue was introduced in CDRouter 11.2.1, and only impacts the 11.2.X releases. [LH #4152]
CDRouter IPv6
Resolved an issue with the config validation logic for the testvar ipv6LanIp. In previous releases this testvar would generate a config check error if a full 64-bit prefix was specified in addition to the keyword
%eui64%
for the 64-bit host ID. This issue has been resolved, making it possible to specify values such as3001:1111:1111:1111::%eui64%
or3001:1111:1111:1111:%eui64%
for this testvar. [LH #4018]The perf-mcast-v6 test module is not compatible with 6to4 and 6rd IPv6 WAN modes and will now be automatically skipped in these configurations. [LH #4146]
CDRouter BBF.069
This release includes bug fixes that are not yet available in the official test scripts used for Broadband Forum BBF.069 Certification testing. The UNH-IOL is expected to make these changes available after completing its next development and validation cycle. Please contact the UNH-IOL for more information.
Updated tests in the XMPP.tcl module to adjust for recent changes in CDRouter’s TLS protocol implementation. This will resolve errors that occurred while processing TLS messages. [LH #4139]
Updated the 5_097_DUT_properly_encodes_and_decodes_XML_entities test case to resolve a problem that occurs with XMPP Connection Requests. [LH #4135]
CDRouter USP
- CDRouter’s USP controller was updated to use any existing websocket connection that may exist with the DUT (agent) instead of automatically initiating a new connection. [LH #4136]
⦿ CDRouter 11.4 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 11.4 Build 1 | May 23, 2019 |
Maintenance Release 1 | CDRouter 11.4 Build 2 | June 20, 2019 |
Note: CDRouter 11.4 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 11.4 testvars using the config upgrade utility.
Attention: Operating System Deprecation Notice
Support for the Ubuntu operating system and CentOS 6 has been deprecated. CDRouter systems running on Ubuntu or CentOS 6 will now see warning messages during installation and in the ‘start’ log of a test run.
Support for both of these operating systems will be officially removed with the next major version of CDRouter (12.0). Please contact support@qacafe.com for additional information and assistance in migrating to a supported operating system.
All CDRouter systems will require the CentOS 7 operating system in order to install CDRouter 12.0 and beyond.
CDRouter 11.4 Build 1 May 23, 2019
New Features and Enhancements
CDRouter
Updated log file viewer
CDRouter’s integrated log file viewer has been updated to improve the overall performance and usability when viewing and analyzing large log files.
This update increases the limit on the number of log lines that can be displayed from 100k to 700k when using newer releases of the Chrome, Firefox, and Safari browsers (Microsoft Edge imposes a limit of 270k lines). In addition to increasing the number of lines that can be viewed, the load time and scrolling / navigation performance have been significantly improved. [LH #4134]
Packet decode pane in log file viewer can now be resized
The packet decode pane within CDRouter’s log file viewer can now be resized both vertically and horizontally making it easier for users to optimize their analysis layout and view. [LH #4134]
New DHCP test cases
Three new DHCP test cases have been added to CDRouter to verify that the DUT’s client or server only responds to DHCP requests on the correct port. Please see the new test modules and test cases section below for more information. [LH #3828]
New network health check feature available during startup
CDRouter will now perform a series of tests at the end of the “start” procedure to verify basic network connectivity between the DUT and CDRouter. A new testvar, healthCheckEnable, has been added to enable these checks. When running them, CDRouter will successively ping each known router hop along the path between its local interface and the DUT. A summary of the results are displayed at the end of the “start” test log. This can be helpful in routed setups for detecting possible packet loss or routing problems during the initialization of a test run. [LH #4145]
CDRouter TR-069
Support for HTTP bulk data collection
CDRouter now supports HTTP Bulk Data Collection as defined in Annex N of TR-069 Amendment 6. The new tr69_annex_n test module has been added to test and verify this functionality. The tr69_annex_n test module includes 16 new test cases that provide coverage for basic bulk data collection over HTTP and HTTPS using different combinations of CSV and JSON encoded data, single and multiple parameter reporting, with and without optional URI parameters.
Note that HTTP Bulk Data Collection requires Device:2 data model support. [LH #3835]
New test case for verifying SetParameterValues failure with multiple invalid parameters
A new test case, tr69_26, has been added to the tr69 test module. This test case verifies that the DUT generates the proper Fault structure when it receives a
SetParameterValues
RPC with multiple invalid parameters, based on the following requirement in Section 3.5 of TR-069 Amendment 6:A SetParameterValuesFault element, to be used only in an error response to the SetParameterValues method, that contains a list of one or more structures indicating the specific fault associated with each parameter in error. [LH #4147]
Enhancements to HTTP redirect test cases
The tr69.tcl test module has been updated to more thoroughly verify how the CPE follows HTTP redirects from the ACS. Four new test cases (tr69_35 through tr69_38) have been added to verify redirects to a different TCP port number and redirects from HTTP to HTTPS.
The existing redirect test cases (tr69_31 through tr69_34) have also been modified so that HTTPS URLs will be redirected to another HTTPS URL (not HTTP). Additionally, all of these tests now issue an alternate URL containing a fully-qualified domain name, as opposed to an IP address. These changes produce more realistic scenarios for testing HTTP redirects. [LH #2056]
New test case for verifying CPE fault codes
A new test case, tr69_27, has been added to the tr69 test module. This test verifies that the CPE returns the correct CWMP fault code for various scenarios according to Section A.5.1 of TR-069 Amendment 6. [LH #4163]
New test case for verifying InstanceWildcardsSupported parameter
A new test case, tr69_wildcards_supported, has been added to the tr69 test module. This test verifies that the
InstanceWildcardsSupported
parameter aligns with the functionality of the DUT.Note that the
InstanceWildcardsSupported
parameter requires Device:2 data model support. [LH #4133]
CDRouter Performance
Support for performance over stacked VLAN configurations on the WAN
CDRouter’s performance tests can now be run in configurations that utilize stacked VLANs on the WAN. Both types of stacked VLAN configurations, 802.1ad and QinQ, are supported. [LH #4010]
New Test Modules and Test Cases
CDRouter
New DHCP test cases for verifying correct ports are used
TEST: cdrouter_dhcp_35 MODULE: dhcp-c DESCRIPTION: Verify client ignores DHCPFORCERENEW messages on port 67
TEST: cdrouter_dhcp_36 MODULE: dhcp-c DESCRIPTION: Verify client ignores DHCPOFFER messages on port 67
TEST: cdrouter_dhcp_server_36 MODULE: dhcp-s DESCRIPTION: Verify DHCP server ignores DHCPDISCOVER messages on port 68
CDRouter TR-069
New test module for Annex N bulk data collection
MODULE: tr69_annex_n DESCRIPTION: TR-069 tests for Annex N Bulk Data Collection TEST CASES: 16
New test case for verifying SetParameterValues failure with multiple invalid parameters
TEST: tr69_26 MODULE: tr69 DESCRIPTION: Verify error code is returned for every failed parameter in SetParameterValues
New test case for verifying CPE fault codes
TEST: tr69_27 MODULE: tr69 DESCRIPTION: Verify CPE returns the correct fault codes
New test case for verifying InstanceWildcardsSupported parameter
TEST: tr69_wilcards_supported MODULE: tr69 DESCRIPTION: Validate the InstanceWildcardsSupported parameter aligns with the functionality of the DUT
New tests to verify HTTP redirects to a different TCP port number and redirects from HTTP to HTTPS
TEST: tr69_35 MODULE: tr69 DESCRIPTION: Verify CPE follows 302 redirects to new ACS server with a specified port number log
TEST: tr69_36 MODULE: tr69 DESCRIPTION: Verify CPE follows 307 redirects to new ACS server with a specified port number log
TEST: tr69_37 MODULE: tr69 DESCRIPTION: Verify CWMP session can be redirected from HTTP to HTTPS using 302
TEST: tr69_38 MODULE: tr69 DESCRIPTION: Verify CWMP session can be redirected from HTTP to HTTPS using 307
Bug Fixes and Notes
CDRouter
Resolved a false negative failure in the rfc5508_rec_2 test case when run in configurations using PPTP or L2TP on the WAN. [LH #4159]
The ability to expand and collapse sections within CDRouter’s log file viewer has been removed. This feature is not compatible with CDRouter’s updated and improved log file viewer. [LH #4134]
CDRouter’s log file viewer now has its own search feature which can be accessed by typing
CTRL + F
within the log file viewer. Previously this command would open the browser’s native search feature, which is no longer supported in CDRouter’s updated log file viewer. Most search functions supported natively by the browser are also supported by CDRouter’s built-in search feature. [LH #4134]A number of fixed delays have been removed from the scaling tests. These delays should not be needed by most modern devices. Removal of these delays reduces the duration of the scaling tests. [LH #4155]
Enhancements have been made to CDRouter’s wireless LAN clients to improve error detection and reconnection when its association to access point has been lost [LH #4155]
Resolved a test case cleanup issue in the cdrouter_app_140 and ipv6_app_140 test cases that could prevent these tests from running properly if they were run multiple times in the same test run. [LH #4167]
CDRouter IPv6
The rfc5508 test module is not compatible with DS-Lite WAN mode and is now automatically skipped in these configurations. [LH #3403]
The ndp and ndp-wan test modules have been updated to use a new set of procs to determine the MAC address of the DUT when needed. [LH #4093]
CDRouter TR-069
Tests tr69_31 through tr69_34 have been updated to send HTTP redirects with URLs containing a fully-qualified domain name of an alternate ACS, rather than an IP address. This provides a more realistic redirection scenario and verifies that the DUT performs full HTTPS/TLS certificate validation with the new ACS. [LH #2056]
Two new testvars have been added: docsisDhcpRelayServer and docsisDhcpv6RelayServer. These testvars specify the DHCP/DHCPv6 relay server address of the CMTS in DOCSIS test setups. These testvars complement the dhcpRelayServer and dhcpv6RelayServer testvars, and are only needed in certain network configurations. Normally, CDRouter only has routing information to reach the IP subnet/IPv6 prefix of the DUT’s WAN interface and its own local interface. If the relay server uses an unknown address (such as its upstream WAN interface) as the source address for DHCP/DHCPv6 requests, CDRouter would not be able to respond to them because the address is not in CDRouter’s routing table. These testvars will allow CDRouter to send responses back to the specified addresses. [LH #4115]
The “XMPP connection request configuration” check that runs in the CDRouter “start” procedure was updated to better handle situations where the DUT sends an Inform to the ACS before responding to the connection request. This prevents the problem of having the ACS receive an unexpected “6 CONNECTION REQUEST” Inform while the first test case is running. [LH #4154]
CDRouter Performance
- CDRouter Performance now takes advantage of kernel-based packet filtering on systems with a 4.14 or newer Linux kernel. Older systems will continue to implement user-space packet filtering. Kernel-based packet filtering is more efficient and improves the overall performance of the system. As part of this update, CDRouter will also automatically truncate the value of the testvar perfUdpLen, if needed, to avoid fragmentation. [LH #4140]
CDRouter ICS
- The default value of the icsInterface testvar has been changed to none instead of eth0. Note that this will cause a configuration error if supportsICS is set to “yes”, but this testvar has not been explicitly set. When setting the value of icsInterface, CDRouter will automatically provide a list of possible values from the available interfaces on the system. [LH #4144]
CDRouter 11.4 Build 2 June 20, 2019
New Features and Enhancements
CDRouter
New IPv4 fragmentation test module
A new test module, nat-frag, has been added to this release. This test module includes six new test cases that verify the behavior of the DUT’s NAPT implementation with TCP, UDP, and ICMP fragmentation with both in-order and out-of-order fragments. [LH #4141]
New Test Modules and Test Cases
CDRouter
New test module verifying NAPT behavior with IPv4 fragmentation
MODULE: nat-frag DESCRIPTION: NAPT tests for IPv4 fragmentation TEST CASES: 6
Bug Fixes and Notes
CDRouter
Resolved an issue in CDRouter’s web UI associated with filtering results by date. This issue only impacted the Microsoft Edge and Firefox browsers. [LH #4123]
CDRouter now supports L2GRE test scenarios that contain one or more routing hops between the L2GRE client and remote endpoint. No additional configuration is required to support these setups; CDRouter will automatically account for any intermediate routers, if present. [LH #4190]
The password input box on the
/system/upgrade
page within the web UI has been removed. This field is no longer required by the new CDRouter Customer Lounge when upgrading CDRouter through the web interface. [LH #4117]Resolved an error when trying to view the start.txt log file within the web UI for results generated in CDRouter 9.3 or earlier releases. This issue was introduced in CDRouter 11.4.1, and impacts the 11.4.1 release only. [LH #4183]
Resolved an issue with the elapsed time calculation for a running test within the web UI. This update prevents the elapsed time from changing formats during a test run. [LH #3709]
The cdrouter_dhcp_35 test case is now automatically skipped if the DUT does not support DHCP authentication, as configured by the testvar supportsDhcpAuth. [LH #4193]
Resolved an issue with CDRouter’s PPTP client shutdown routine that would prevent forwarding of IPv4 multicast traffic on the LAN in subsequent tests. [LH #4187]
CDRouter 11.1.1 through CDRouter 11.4.1 contained an issue in which the number of wireless LAN clients created by CDRouter was not restricted by the lanWirelessMaxClients testvar. This issue has been resolved. CDRouter now adheres to the lanWirelessMaxClients when creating wireless LAN clients. [LH #4195]
Removed the
requires-dhcp-pool-size-le-64-wireless-lan
skip label which was used to skip the cdrouter_scale_10 test case in configurations where only wireless LAN interfaces were available and the DHCP pool size was greater than 64. This constraint no longer applies to NTA1000v6 systems which can create more than 64 wireless LAN clients. To resolve this issue the cdrouter_scale_10 test case has been updated to generate a failure if the DHCP pool cannot be exhausted. [LH #4194]
CDRouter DOCSIS
- CDRouter’s network health check feature has been updated to support DOCSIS setups. The network connectivity health tests performed at the end of the start procedure will now verify connectivity to nodes along the path between the DUT’s Cable Modem and CDRouter’s WAN interface. Note that you must set the healthCheckEnable testvar to yes to enable this health check feature. [LH #4119]
CDRouter TR-069
The testvar acsDownloadCaCertPath is now disabled by default. This means it does not have a value unless it is uncommented and given one in a CDRouter configuration file. This now matches the behavior of acsCaCertPath. [LH #4211]
In tests tr69_31 through tr69_38, the alternate ACS (acs-download.qacafe.com) was not transmitting the CA certificates contained in the acsDownloadCaCertPath file when initializing an SSL/TLS connection with the DUT. This has been resolved. Note that the certificates from this file will only be sent if acsDownloadCaCertPath is explicitly defined in the config file. Otherwise, only the server certificate (acsDownloadCertPath) will be sent. [LH #4204]
Added an additional configuration constraint to verify that the CWMP bootstrap scenario file exists and is readable, if defined using the testvar cwmpScenarioBootstrap. [LH #4196]
CDRouter’s RADIUS server will now be automatically enabled when running ir181_test_5.6.9, ir181_test_5.6.11, ir181_test_5.6.13, tr69_wireless_40, tr69_wireless_41, and tr69_wireless_42. Previously these tests would not enable the RADIUS server, which would lead to test failures if the RADIUS server was not already enabled during start (which would occur only if WPA/WPA2 Enterprise were initially configured). [LH #4179]
The AddObject issued by CDRouter for the
Device.Firewall.Chain
parameter in the ir181_test_5.5.1, ir181_test_5.5.2, ir181_test_5.5.3, and ir181_test_5.5.4 tests is now properly formatted. Previously this AddObject was not using calculating the correct instance number which would generate a CWMP fault when sent to the DUT. [LH #4179]The source and destination addresses used to verify the port mapping behavior in the ir181_test_5.5.1, ir181_test_5.5.2, ir181_test_5.5.3, and ir181_test_5.5.4 are now obtained from the configured free network range. [LH #4179]
The length of the packets used for the forwarding portion of the ir181_test_5.5.1, ir181_test_5.5.2, ir181_test_5.5.3, and ir181_test_5.5.4 has been set to 256 bytes. Previously the length was not specified which would generate a fatal error. [LH #4179]
The ir181_test_5.5.1, ir181_test_5.5.2, ir181_test_5.5.3, and ir181_test_5.5.4 tests were previously issuing a GetParameterValues RPC for the parameter
Device.DestinationInterface
, which does not exist in the Device:2 data model and would generate a CWMP fault when sent to the DUT. This issue is the result of a typo in the IR-181 test plan which has now been reported to the Broadband Forum. The correct parameter isDevice.DestInterface
. These tests have been updated to use the correct parameter name. [LH #4179]Previously the ir181_test_5.5.1, ir181_test_5.5.2, ir181_test_5.5.3, and ir181_test_5.5.4 tests were specifying an invalid type value of
integer
when issuing SetParameterValues RPCs for certain parameters. These tests have been updated to specify the correct type syntax ofint
for the impacted parameters. [LH #4179]The ir181_test_5.4.3 now sets the
Protocol
parameter for the port mapping instance that is created to UDP as defined in test test procedure. Previously this test set theProtocol
parameter to TCP. [LH #4200]The ir181_test_5.4.1 through ir181_test_5.4.9 tests (with the exception of ir181_test_5.4.2) now query the DUT for WAN interface instance that is in use and use that interface when creating port mappings. [LH #4201]
The ir181_test_5.3.1 test was updated to resolve a fatal error that occurred when the DUT did not return an expected instance of the “Device.Ethernet.Link.{i}.LowerLayers” parameter [LH #4203]
The ir181_test_5.2.6 test case now explicitly sets all required parameters even if the default value for each parameter is what is defined in the test procedure. [LH #4207]
The ir181_test_5.2.7 test case now explicitly sets the
Interface
parameter to an empty string as specified in the test procedure. [LH #4208]The **URL that the ACS sends in its ChangeDUState request no longer matches the filename of the image being downloaded. The DUT seems to require the URL to contain the name of the file ending in “.gz”.
We changed the URL format so that the ACS could use the same URL in each of the od128_test_35.* tests, regardless of which image was actually being downloaded. One of the requirements of the ChangeDUState request is that the CPE must follow through with the requested Install or Update, even if the URL is the same as one that was used in a previous operation.
Tests od128_test_35.1 through od128_test_35.6 have been updated and now require two different Deployment Unit images in order to run. Three additional testvars have been introudced in order to support this enhancement. All six of the following testvars must now be defined in order to run these tests:
- tr69DUInstallUUID - tr69DUChangeExecEnvRef - tr69DUInstallImage - tr69DUInstallImageVersion - tr69DUInstallImageAlternate - tr69DUInstallImageAlternateVersion
The ACS will first check the
Device.SoftwareModules.DeploymentUnit.{i}.Version
parameter to determine which version of the Deployment Unit is currently installed (if any), and then send a ChangeDUState RPC to instruct the DUT to download a different image version, either tr69DUInstallImage or tr69DUInstallImageAlternate.Note that the
URL
argument will always contain the same file name in each test ("DeploymentUnitImage.bin"
), but the ACS will dynamically map the URL to either the tr69DUInstallImage or tr69DUInstallImageAlternate image file. This verifies that the DUT follows through with the requested Install or Update operation, even if the URL is the same as one that was used in a previous operation. [LH #4184]Tests od128_test_35.3 through od128_test_35.6 may no longer be run independently. Unlike most tests in CDRouter, these tests rely on the assumption that test od128_test_35.1 has already been run and that the Deployment Unit image is installed on the DUT. CDRouter will automatically abort these tests if the first test in the set has not already been run. [LH #4184]
CDRouter BBF.069
- Many of the SSL Certificate files used with the BBF.069 tests have been updated with new expiration dates. Note that certificates shipped with earlier versions of CDRouter’s BBF.069 add-on may no longer be valid. [LH #4197]
⦿ CDRouter 11.5 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 11.5 Build 2 | July 18, 2019 |
Maintenance Release 1 | CDRouter 11.5 Build 3 | August 14, 2019 |
Note: CDRouter 11.5 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 11.5 testvars using the config upgrade utility.
Attention: Operating System Deprecation Notice
Support for the Ubuntu operating system and CentOS 6 has been deprecated. CDRouter systems running on Ubuntu or CentOS 6 will now see warning messages during installation and in the ‘start’ log of a test run.
Support for both of these operating systems will be officially removed with the next major version of CDRouter (12.0). Please contact support@qacafe.com for additional information and assistance in migrating to a supported operating system.
All CDRouter systems will require the CentOS 7 operating system in order to install CDRouter 12.0 and beyond.
CDRouter 11.5 Build 2 July 18, 2019
New Features and Enhancements
CDRouter
Support for WPA3
CDRouter now supports WPA3-Personal and WPA3-Enterprise in client mode on the LAN and access point (AP) mode in the WAN.
WPA3 requires many advanced new wireless features which are also now supported, including Protected Management Frames (PMF), 256 bit ciphers (GCMP and CCMP), and new key management suites such as Simultaneous Authentication of Equals (SAE) and Suite-B.
Additional information about all new wireless enhancements included in this release are provided below.
New WPA configuration presets for WiFi Alliance security modes
CDRouter now supports a simplified configuration model for six common wireless security modes defined by the WiFi Alliance: WPA-Personal, WPA-Enterprise, WPA2-Personal, WPA2-Enterprise, WPA3-Personal, and WPA3-Enterprise. These six modes are now options that can be configured directly in client mode on the LAN using the testvar wpaMode.
These modes represent configuration presets that force all other WPA related testvars to specific, fixed values which speeds up and simplifies the configuration process. For more information on these modes and advanced WPA configuration please see this Knowledge Base article.
These modes are also available as options for configuring CDRouter’s AP on the WAN using the testvar wanApWpaMode.
Note that when any of these modes are used the advanced WPA configuration options highlighted below are configured automatically and do not need to be specified.
Note that WPA3-Enterprise modes require the 802.11ac Wave 2 wireless adapter included in the NTA1000v6 platform. As a result, WPA3-Enterprise is not supported on older NTA1000 systems.
Support for WPA Protected Management Frames (PMF)
CDRouter now supports Protected Management Frames (PMF) for RSN and WPA3. PMF support is required for all WPA3 security modes and optional for all RSN security modes. The new testvars wpaPMF and wanApWpaPMF can be used to enable or disable PMF support in client mode on the LAN and AP mode on the WAN, respectively.
By default these testvars are set to a value of
auto
, which will enable PMF for WPA3 modes and disable PMF for all other modes.Support for GCMP pairwise and group ciphers
CDRouter now supports Galois Counter Mode Protocol (GCMP) cipher suites in addition to Counter Mode CBC-MAC Protocol (CCMP) and TKIP. For client mode on the LAN the testvars wpaCipher and wpaGroupCipher have been updated with two new GCMP specific options:
GCMP-128
andGCMP-256
.In AP mode on the WAN, the testvars wanApWpaCipher and wanApWpaGroupCipher also support these new options.
Support for 256 bit CCMP pairwise and group ciphers
CDRouter now supports 256 bit CCMP cipher suites in addition to 128 bit CCMP, TKIP, and GCMP (128 and 256 bit). The testvars wpaCipher and wpaGroupCipher have been updated with with a new 256 bit CCMP option:
CCMP-256
.In AP mode on the WAN, the testvars wanApWpaCipher and wanApWpaGroupCipher also support this new option.
Support for the SAE key management suite
WPA3-Personal requires use of the Simultaneous Authentication of Equals (SAE) key management suite, which is now supported by CDRouter and can be enabled in client mode on the LAN by setting the new testvar wpaKeyMgmt to a value of
SAE
. When SAE is enabled the SAE secret must also be configured using the new testvar wpaSaePassword.In AP mode on the WAN, SAE can be enabled by setting the testvar wanApWpaKeyMgmt to
SAE
and setting the SAE secret using the new testvar wanApWpaSaePassword.Support for Suite-B key management suites
WPA3-Enterprise requires use of IEEE 802.1X using Suite B compliant EAP, which is now supported by CDRouter and can be enabled in client mode on the LAN by setting the new testvar wpaKeyMgmt to a value of either
SUITE-B
(which uses SHA-256 key derivation) orSUITE-B-192
(which uses SHA-384 key derivation).In AP mode on the WAN, the testvar wanApWpaKeyMgmt also supports these new options.
Support for advanced WPA key management suites
CDRouter now supports advanced 802.1X and PSK key management suites for WPA and WPA2 that utilize SHA-256 for key derivation. The new testvar wpaKeyMgmt includes the options
802.1X-256
andPSK-256
for enabling these key management suites in client mode on the LAN.In AP mode on the WAN, the testvar wanApWpaKeyMgmt also supports these new options.
Note that legacy key management suites utilizing SHA-128 for key derivation can be configured using the
802.1X
andPSK
options on the LAN side and the WAN side.
CDRouter TR-069
Support for TLS version 1.3
CDRouter’s ACS can now be configured for TLS 1.3.
CDRouter Performance
Support for multiple LAN client performance testing
CDRouter now supports performance testing with multiple LAN clients using the new perf-multi and perf-multi-v6 test modules that are included with the CDRouter Performance add-on.
These tests measure the aggregate download and upload throughput of multiple LAN clients over IPv4 and IPv6 using TCP and UDP traffic. In addition to verifying the aggregate bandwidth, CDRouter can also optionally verify that each individual LAN client achieved a minimum fairness throughput using the new testvar perfFairness.
Up to 32 Ethernet and/or wireless LAN clients can be used during these tests. In addition up to 30 streams per LAN client for a maximum of 960 UDP or TCP connections per test can be configured.
Note that this functionality requires the CDRouter Performance and Multiport add-ons.
Support for performance testing up 5.0 Gbps
The CDRouter Performance add-on now supports maximum single client performance speeds of up to 2.5 Gbps and multi-client speeds of up to 5.0 Gbps on the new NTA1000v6-10G platform.
This feature makes it possible to fully saturate and test cutting edge access points and routers that include 2.5GBASE-T and 5GBASE-T Ethernet interfaces and wireless interfaces capable of greater than 1 Mbps throughput.
NTA1000
New NTA1000v6-10G platform with 2.5/5/10 Gbps Ethernet interfaces
The new NTA1000v6-10G platform includes an integrated dual port 10GBASE-T Ethernet network interface that supports Ethernet speeds of 2.5/5/10 Gbps over standard Category 5e and 6 cabling.
With this addition there are now two NTA1000 platforms to choose from - the NTA1000v6 which includes eight Gigabit Ethernet NICs, three wifi NICs, and support for up to 128 wireless clients, and the NTA1000v6-10G which includes eight Gigabit Ethernet NICs, two 10 Gigabit Ethernet NICs, two wifi NICs, and support for 64 wireless clients.
Support for 2.5/5/10GBASE-T Ethernet interfaces
With the addition of the new NTA1000v6-10G platform, CDRouter 11.5 now supports 2.5/5/10GBASE-T Ethernet network interfaces for functional and performance testing. Performance testing is limited to 2.5 Gbps (single client) and 5.0 Gbps (multi-client).
Testvar updates
Testvars added to this release:
- WPA3 LAN side wireless client testvars
- wpaKeyMgmt - Specifies which RSN/WPA authentication key management suite to use with the DUT.
- wpaPMF - Specifies if WPA protected management frames should be used with the DUT.
- wpaSaePassword - Specifies the WPA SAE password to be used with the DUT.
- WPA3 WAN side wireless AP testvars
- wanApWpaPMF - Specifies if WPA protected management frames should be used by the WAN Access Point authenticator.
- wanApWpaSaePassword - Set the 802.11 WPA SAE password used by the WAN Access Point authenticator.
- New multiple LAN client performance testvar
- perfFairness - Forces all LAN clients to share the available bandwidth when enabled during multi-LAN performance tests.
Testvars modified or removed in this release:
- Wireless LAN configuration
- lanSecurity - The values
WPA-PSK
andWPA-802.1X
have been deprecated and will be removed in a future release. Existing configs should be updated to use the valueWPA
and the new settings available in the wpaMode testvar instead. - wpaMode - The following additional values are now available:
auto
,RSN
,WPA-Enterprise
,WPA-Personal
,WPA2-Enterprise
,WPA2-Personal
,WPA3-Enterprise
,WPA3-Personal
. TheWPA2
setting has been deprecated and will be removed in a future release. - wpaCipher - The value
AES-CCMP
has been deprecated and will be removed in a future release. Existing configs should be updated to use any of the new, more specific values ofCCMP-128
,CCMP-256
,GCMP-128
, orGCMP-256
. - wpaGroupCipher - The value
AES-CCMP
has been deprecated and will be removed in a future release. Existing configs should be updated to use any of the new, more specific values ofCCMP-128
,CCMP-256
,GCMP-128
, orGCMP-256
. - wifiBeaconWpaMode - The value
WPA2
has been deprecated and will be removed in a future release. Existing configs should be updated to use the valueRSN
instead. - wifiBeaconWpaCipher - The value
AES-CCMP
has been deprecated and will be removed in a future release. Existing configs should be updated to use the valueCCMP-128
for WPA1 configs, or the new testvar wifiBeaconRsnCipher for WPA2/WPA3 configs. - wifiBeaconWpaGroupCipher - The value
AES-CCMP
has been deprecated and will be removed in a future release. Existing configs should be updated to use any of the new, more specific values ofCCMP-128
,CCMP-256
,GCMP-128
, orGCMP-256
. - See the wireless LAN Configuration Knowledge Base article for more details on using these new settings.
- lanSecurity - The values
- Wireless WAN Configuration
- wanApWpaMode - The value
WPA2
has been deprecated and will be removed in a future release. Existing configs should be updated with one of the new values supported by this testvar. - wanApWpaKeyMgmt - The values
WPA-PSK
andWPA-802.1X
have been deprecated and will be removed in a future release. Existing configs should be updated. - wanApWpaCipher - The value
AEX-CCMP
has been deprecated and will be removed in a future release. All existing configs should be updated.
- wanApWpaMode - The value
- TR-069 TLS configuration
- acsSslVersion - The values
tls
andtlsv1_3
have been added to this testvar. The valuesslv23
has been removed and will cause a config error if it is used.
See the Notes section below for more details.
- acsSslVersion - The values
Test Modules and Test Cases
CDRouter TR-069
New IR-181 test case
TEST: ir181_test_5.3.5 MODULE: ir181 DESCRIPTION: IR-181 Test 5.3.5: Device Connect/Disconnect Notification
CDRouter Performance
New multiple LAN client performance module for IPv4
MODULE: perf-multi DESCRIPTION: IPv4 multiple LAN clients performance tests TEST CASES: 4
New multiple LAN client performance module for IPv6
MODULE: perf-multi-v6 DESCRIPTION: IPv6 multiple LAN clients performance tests TEST CASES: 4
Notes
CDRouter
A number of WPA specific testvars have had options deprecated in this release. To maintain backwards compatibility with older configurations, CDRouter will automatically map any deprecated WPA related testvar values to new, supported values according to the following table:
Testvar Deprecated Values New Value lanSecurity WPA-802.1X, WPA-PSK WPA wpaMode WPA2 RSN wpaCipher AES-CCMP CCMP-128 wpaGroupCipher AES-CCMP CCMP-128 The testvars used to define the expected contents of the DUT’s wifi beacons for the wifi_20 test case have been updated to support WPA3. Some testvar options have been deprecated while other new options have been added.
Testvar Deprecated Values New Values wifiBeaconWpaMode WPA2 RSN wifiBeaconWpaKeyMgMt 802.1X-256, PSK-256, SAE, SUITE-B, SUITE-B-192 wifiBeaconWpaCipher AES-CCMP CCMP-128, CCMP-256, GCMP-128, GCMP-256 wifiBeaconWpaGroupCipher AES-CCMP CCMP-128, CCMP-256, GCMP-128, GCMP-256 wifiBeaconPhy The static test module has been updated to support host routes. [LH #4212]
The wifi_40 test case has been updated. This test now disassociates all additional LAN clients at the start of the test and performs a new scan for the configured SSID rather than relying on cached and potentially out of date scan data. All clients are re-associated at the end of the test. [LH #4175]
Resolved an issue with multi-service gateway configurations on CentOS 7 systems. This issue prevented secondary WAN interfaces on separate VLANs from receiving and responding to traffic from the DUT. This issue was introduced in CDRouter 11.4.1 and impacts only the 11.4.1 and 11.4.2 releases. [LH #4226]
Resolved an issue with the elapsed time reported for a running test within CDRouter’s web UI. In CDRouter 11.4.1 and 11.4.2, refreshing the results page within the browser would reset the elapsed time to 00:00 or the elapsed time of the test when the page was first loaded. [LH #4225]
CDRouter Multiport
Resolved a fatal error in the static_10 and static_20 test cases when run in a multi-service gateway type configuration with multiple WAN interfaces. [LH #4227]
Updated static_20 and static_v6_20 to support dynamic static routes defined on secondary WAN interfaces. [LH #4213]
CDRouter IPv6
The static-v6 test module has been updated to support host routes. [LH #4212]
The ula_12 test case is not compatible with 6to4 or 6rd WAN modes and is now automatically skipped when 6to4 or 6rd are configured. [LH #4233]
CDRouter TR-069
CDRouter’s ACS no longer supports SSL v2. This change was required to add support for TLS v1.3. The acsSslVersion testvar can now be configured with the value
tlsv1_3
or the new defaut mode oftls
, which will negotiate down from TLS v1.3 to v1.2 to v1.1 and finally to v1.0. The previous default value,sslv23
, has been removed and will cause a config error if it is used. Existing config files that explicitly use this value must be updated to usetls
or another valid setting. [LH #3725]The list of ciphers supported by CDRouter’s ACS has been updated. In order to add support for TLS v1.3, a number of new ciphers were added while older ciphers were dropped. Please see the documentation for the testvar acsCipherSuite for the complete list of ciphers supported in this release. For details on which older ciphers have been dropped, please contact support@qacafe.com.
The tr69_400 and ir181_test_5.2.6 test cases have been updated to support both IP addresses and FQDNs for the
Host
parameter entries in theRouteHops
table returned by the DUT. Previously only IP addresses were supported. [LH #4218]Resolved an issue in the ir181_test_5.5.1 test case where the
DeleteObject
RPC called at the end of the test was not properly specifying a full object path. [LH #4232]Resolved a fatal error in ir181_test_5.6.13 if run individually. [LH #4229]
Tests od128_test_35.1 through od128_test_35.6 have been updated so that the
URL
argument of the ChangeDUState RPC contains the file name indicated by the tr69DUInstallImage file instead of"DeploymentUnitImage.bin"
. This change was made to ensure that the format of the file name in the URL remains consistent with any naming requirements imposed by the DUT implementation.Note that the
URL
argument will always contain the same file name in each test, but the ACS will still dynamically map the URL to either the tr69DUInstallImage or tr69DUInstallImageAlternate image file. This verifies that the DUT follows through with the requested Install or Update operation, even if the URL is the same as one that was used in a previous operation. [LH #4230]A new test, ir181_test_5.3.5 has been added to the ir181 module. This test did not exist in early drafts of the IR-181 specification which is why it was not included in previous releases. [LH #4210]
Tests tr69_31 through tr69_38 have been updated to be more compatible with private TLS/SSL certificates. When the acsDownloadCertPath testvar is set, CDRouter will automatically determine the fully-qualified domain name of the alternate ACS server from the CN field of the specified certificate. The primary ACS will use that domain name instead of the default (acs-download.qacafe.com) in the HTTP redirect it sends to the DUT. If the CN field of the certificate file is set to a wildcard domain (eg.: *.example.com), CDRouter will use the hostname “acs-download” with the target domain (“acs-download.example.com”). [LH #4214]
Test tr69_wireless_50 was updated to resolve an error that occurred when the LAN client failed to reassociate with the DUT. [LH #4240]
Updated the od128_test_19.1 test case to select a channel from the list channels supported by the DUT rather than using channel 11, which may or may not be supported by the DUT. [LH #4198]
CDRouter Performance
The maximum value of perfStreams testvar has been reduced from 500 to 128. This change was made to improve the overall consistency and repeatability of performance test results. [LH #4148]
The maximum number of streams will be automatically capped to 32 when running the multi-perf and multi-perf-v6 test modules if the perfStreams testvar is set to a value greater than 32. [LH #4148]
Relaxed skip logic to allow the perf-lan and perf-lan-v6 tests to run in bridge mode configurations. [LH #4178]
The test descriptions of perf_10 and ipv6_perf_10 mistakenly referred to testvar “perfDHCPRestartLatency”, which does not exist. The correct testvar perfDHCPRestartMaxLatency. The test descriptions have been updated. [LH #4244]
Performance graphs now support values greater than 1 Gbps. In addition, a all performance graphs now default to auto for the graph scale.
All latency tests now verify and graph the upload and download latencies independently. Previously only the sum of the upload and download latencies was verified and graphed. [LH #3330]
CDRouter USP
Resolved a fatal error when generating STOMP error messages. [LH #4219]
Resolved issue with test case usp_30 that sometimes resulted in a fatal error when trying to download new firmware. Also adjusted test to be more event driven instead of time based. [LH #4189]
CDRouter 11.5 Build 3 August 15, 2019
New Features and Enhancements
CDRouter
WAN side 802.1X authenticator now supports EAP-PEAP
CDRouter’s WAN authenticator now supports EAP-PEAP v0 and v1 with MS-CHAPv2 using anonymous outer identities. PEAP can be enabled by setting the testvar wanEapType to the new value
eap-peap
. CDRouter’s WAN authenticator is used to authenticate wired and wireless clients when 802.1X authentication is enabled on the WAN. [LH #4209]New test case for verifying the DUT’s ping behavior on the WAN
A new test case, cdrouter_icmp_7 has been added to the icmp module. This test case verifies the expected behavior of the DUT when it receives ICMP pings on the WAN. If the testvar wanPingRespond is set to yes, this test will verify that the DUT responds to pings on the WAN. If set to no, this test verifies that the DUT does not respond to pings on the WAN. [LH #4261]
CDRouter BBF.069
BBF.069 updated
CDRouter is now shipping with Release 9.1 of the BBF.069 scripts from the UNH-IOL. For a complete list of modifications included with this release, please see the notes section below.
Testvar updates
Testvars added to this release:
- None
Testvars modified or removed in this release:
- None
Test Modules and Test Cases
CDRouter
New ICMP test case
TEST: cdrouter_icmp_7 MODULE: icmp DESCRIPTION: Verify ICMP Echo Requests to router's WAN side IP address from the WAN
Notes
CDRouter
Some refactoring of CDRouter’s client and server EAP/EAPOL functionality has been performed as part of the work associated with adding EAP-PEAP support to the WAN side 802.1X authenticator. [LH #4209]
The default value of the wanPingRespond has been changed from yes to no for consistency with the default configuration of most DUTs. [LH #4261]
Set the maximum value of the natMaxTcpConns to 4000. This is the largest value supported on current NTA1000 systems. [LH #4256]
CDRouter IPv6
Resolved an issue associated with the dhcpv6ClientOptionRequest testvar. In previous releases CDRouter’s DHCPv6 clients were not honoring this testvar. [LH #4250]
The ula_12 test case has been updated and can now be run in 6to4 and 6rd WAN configurations. [LH #4234]
CDRouter Performance
- CDRouter will now generate a failure if any of the interfaces used for a performance test do not have IPv4 and/or IPv6 addresses at the start of the test. [LH #4176]
CDRouter TR-069
The wireless configuration verification tests in the tr69_wireless and ir181 test modules have been updated. These tests now validate that the DUT includes the client MAC in the
AssociatedDevice
table after the basic traffic verification step has been performed. This resolves an issue with some implementations where theAssociatedDevice
table was verified before it had been fully updated by the DUT. [LH #4246]Resolved a regression in the tr69_wireless_40, tr69_wireless_41, tr69_wireless_42, ir181_test_5.6.9, ir181_test_5.6.11, and ir181_test_5.6.13 test cases which prevented CDRouter from properly associating with the DUT after changing the wireless configuration. This regression was introduced in release 11.5.2 as part of the WPA3 work. [LH #4262]
Updated the od128_test_19.1 test case to prevent configuration of a wireless channel that is not supported by the DUT. [LH #4247]
The cdrouter_heartbleed_300 test case has been updated to use an alternate ACS server to verify the Heartbleed exploit against the DUT. The DUT’s
Device.ManagementServer.URL
parameter will temporarily be changed to direct the DUT to the alternate ACS. The location of SSL certificates for the alternate ACS are configurable using the acsDownloadCertPath and acsDownloadCaCertPath testvars. [LH #4259]Re-factored the code associated with the tr69ForceBoolean testvar. [LH #4223]
CDRouter BBF.069
The bbf069UploadType testvar was updated to support the “3 Vendor Configuration File <i>” and “4 Vendor Log File <i>” FileType values. [LH #156]
The 5_103_periodic_inform_time_past and 5_104_periodic_inform_time_future tests were updated to improve validation of the DUT’s reported CurrentTime parameter and any parsing errors in the test log. [LH #179]
The 5_081_download_queuing test was updated with additional logging to aid in troubleshooting failures. [LH #171]
Resolved an issue in the 5_036_redirect_cookies test sometimes caused the ACS to quote the DUT’s cookie value, resulting in a mismatch and eventual test failure. [LH #159]
Updated 5_098_inform_ip_address_change test to make it compatible with changes to CDRouter’s DHCP server in CDRouter 11.0. Those changes were causing a fatal error in this test. [LH #170]
Resolved an issue in the 5_032_redirect_multiple_redirections test to ensure the alternate ACS uses the correct transport and port when redirecting the DUT back to the primary ACS. [LH #182]
Updated the 5_019_conn_request and 5_020_conn_request_session_exists tests to support XMPP connection requests. Before this, only HTTP connection requests were supported. [LH #185]
The 5_023_conn_TLS and 5_024_conn_TLS_1_2 tests were updated to ensure the DUT does not have any pending Inform messages at the start of the test. Prior to this change, an unexpected connection from the DUT could cause the ACS to accept the CWMP session without requiring TLS 1.0, resulting in a false positive test result. [LH #186]
CDRouter will now automatically skip the DHCPv4.tcl test module if IPv4 is not enabled in the config file. Likewise, the DHCPv6.tcl test module if IPv6 is not enabled. [LH #181]
The 5_097_DUT_properly_encodes_and_decodes_XML_entities_test test was updated to ensure that the DUT is always returned to its original state at the end of the test. In some situations, the test would exit early without resetting the Device.ManagementServer.Username and Device.ManagementServer.Password parameters to their original values. [LH #161]
Resolved a packet processing bug that was causing “ERROR(pktsrc)” errors to be reported in the 5_019_conn_request and 5_020_conn_request_session_exists tests. [LH #172]
Fixed a timing problem that caused the 5_089_factoryReset test to miss the TCP FIN sent by the DUT, resulting in a false negative test result. [LH #164]
Updated the 5_020_conn_request_session_exists test to address a fatal error caused when the DUT unexpectedly terminates the initial CWMP session. [LH #175]
Test cases 5_021_conn_after_interval, 5_067_SPA_Active_notif_persist, 5_074_addObject, 5_060_GPA_complete_path and 5_061_GPA_multiple_complete_path were updated to address an error that can occur if the GetParameterAttributes request fails unexpectedly. [LH #165]
Resolved an issue in the 5_021_conn_after_interval test that could cause a fatal error when resetting the PeriodicInformInterval parameter. [LH #169]
Fixed a bug in the 5_042_SPV_SOAP_Fault test that resulted in a fatal error in some situations. [LH #162]
A number of additional tests that require user intervention will now be skipped if the test package is not run with “pause mode” enabled. The full list of manual tests is shown below [LH #163]:
- 5_001_DHCPv4_ACS_discovery
- 5_002_DHCPv6_ACS_discovery
- 5_003_DHCPv4_ACS_rediscovery
- 5_004_DHCPv6_ACS_rediscovery
- 5_005_DHCPv4_Inform_retry
- 5_006_DHCPv6_Inform_retry
- 5_011_Same_mechanism_after_factoryReset
- 5_012_DHCPv4_null_term_URL
- 5_013_DHCPv6_null_term_URL
- 5_016_ACS_URL_mod_3rd_party
- 5_018_event_discard_after_bootstrap
- 5_066_SPA_Active_notif
- 5_069_SPA_complete_path_passive_notif
- 5_070_SPA_partial_path_passive_notif
- 5_071_SPA_complete_partial_path_passive_noti
- 5_072_SPA_disable_notif
- 5_079_Manual_Reboot
- 5_089_factoryReset
- 5_098_inform_ip_address_change
- 5_099_no_inform_ip_address_change
- 5_100_enable_cwmp_to_false
- 5_105_default_active_notification_throttle
- 5_001_DHCPv4_ACS_discovery
Patched the 5_068_SPA_atomic test case to ensure that the value set in subsequent SetParameterAttribute RPCs is different than the initial value at the start of the test. [LH #4270]
⦿ CDRouter 11.6 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 11.6 Build 1 | September 12, 2019 |
Maintenance Release 1 | CDRouter 11.6 Build 2 | October 10, 2019 |
Note: CDRouter 11.6 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 11.6 testvars using the config upgrade utility.
Attention: Operating System Deprecation Notice
Support for the Ubuntu operating system and CentOS 6 has been deprecated. CDRouter systems running on Ubuntu or CentOS 6 will now see warning messages during installation and in the ‘start’ log of a test run.
Support for both of these operating systems will be officially removed with the next major version of CDRouter (12.0). Please contact support@qacafe.com for additional information and assistance in migrating to a supported operating system.
All CDRouter systems will require the CentOS 7 operating system in order to install CDRouter 12.0 and beyond.
CDRouter 11.6 Build 1 September 12, 2019
New Features and Enhancements
CDRouter
TraceFrame updated
CDRouter’s integrated packet viewer has been upgraded to TraceFrame version 1.2, which includes the following enhancements:
- Improved speed and performance
- Additional space added to the middle of the ASCII decode pane
- Add ALT+Click support to the decode tree (expands all)
- Ignore a load error if file is truncated
- Correctly display fragmented IPv4 packets
- Add new loading graphic for summary pane
- Speed up perceived loading of large files
- Prevent error if click+drag in summary table
- Fix crash if no file was opened
- Improved speed and performance
New multicast test cases
Four new test cases have been added to the mcast module. These new tests are designed to verify the behavior of the DUT when processing received IGMP packets that have the unspecified source address of 0.0.0.0. Please see the New Test Modules and Test Cases section below for more information. [LH #4181]
New DHCP client tests
Two new DHCP client tests have been added to the dhcp-c test module. These tests verify that the DUT’s WAN DHCP client consistently requests the same set of parameters and advertises the same client ID in accordance with RFC 2131. Please see the New Test Modules and Test Cases section below for more information. [LH #4291]
Log viewer UI tweaks
A number of visual tweaks have been made to the log viewer to improve functionality and the visibility of search results when using
CTRL+F
within the browser. [LH #4278]- Previously, only the current search match was highlighted. Now, all
matches are highlighted yellow.
- Previously, the current search match was highlighted yellow for a brief
period of time. Now, the current search match is highlighted orange
persistently.
- Previously, non-matching lines were dimmed to 25% opacity. Now,
non-matching lines are only dimmed to 60% opacity as 25% was deemed
illegible on certain monitors.
- Previously, only the current search match was highlighted. Now, all
matches are highlighted yellow.
CDRouter IPv6
Support for LW4o6
CDRouter now supports Lightweight 4over6 (LW4o6), as defined in RFC 7596. LW4o6 is an IPv6 transition technology that shares some concepts with MAP-E and DS-Lite. For more information, please see our Knowledge Base article on MAP and LW4o6 testing.
New multicast test cases
Two new test cases have been added to the mcast-v6 module. These new tests are designed to verify the behavior of the DUT when processing received MLD packets that have the unspecified source address of ::. Please see the New Test Modules and Test Cases section below for more information. [LH #4181]
New IPv6 “unnumbered” WAN mode for Prefix Delegation
CDRouter now supports configurations in which the DUT requests a DHCPv6 Delegated Prefix without creating its own on-link global IPv6 WAN address. Now, devices that do not use DHCPv6 or SLAAC on the WAN to autoconfigure an address are supported with the “unnumbered” mode of the ipv6WanMode testvar. More information and configuration examples can be found in our Knowledge Base article,
IPv6 Stateless Addressing with Prefix Delegation.
CDRouter USP
Added support for MQTT
The USP add-on now supports MQTT as an MTP. For more information, please see the CDRouter USP User Guide. [LH #4192]
CDRouter Nmap
Nmap updated
The CDRouter Nmap add-on has been updated to Nmap release 7.80. Please see the Nmap 7.80 release announcement for more information on changes associated with this update. [LH #4279]
Testvar updates
Testvars added to this release:
- None
Testvars modified or removed in this release:
- MAP start port
- mapStartPort - This testvar now supports a minimum value of
0
. [LH #4289]
- mapStartPort - This testvar now supports a minimum value of
- IPv6 WAN mode
- ipv6WanMode - This testvar now supports the value
unnumbered
. [LH #4138]
- ipv6WanMode - This testvar now supports the value
- Supports Multicast Out and Supports IPv6 Multicast Out
- supportsMulticastOut
- supportsIPv6MulticastOut - These testvars now default to
no
for consistency with the default configuraiton of most CPE. [LH #4285]
New Test Modules and Test Cases
CDRouter
New multicast test cases for verifying DUT’s behavior when processing IGMP packets with unspecified source address
TEST: mcast_80 MODULE: cdrouter_mcast DESCRIPTION: Verify IGMP router accepts reports with unspecified source address
TEST: mcast_81 MODULE: cdrouter_mcast DESCRIPTION: Verify IGMP snooping switch scenario with unspecified source address
TEST: mcast_82 MODULE: cdrouter_mcast DESCRIPTION: Verify IGMP proxy interface answers general IGMP query requests with unspecified source address
TEST: mcast_83 MODULE: cdrouter_mcast DESCRIPTION: Verify IGMP proxy interface answers specific IGMP query requests with unspecified source address
New DHCP client tests
TEST: cdrouter_dhcp_40 MODULE: dhcp-c DESCRIPTION: Verify client requests same parameters in all subsequent DHCP messages
TEST: cdrouter_dhcp_41 MODULE: dhcp-c DESCRIPTION: Verify client uses same Client ID in all subsequent DHCP messages
CDRouter IPv6
New multicast test cases for verifying DUT’s behavior when processing MLD packets with unspecified source address
TEST: ipv6_mcast_80 MODULE: mcast-v6 DESCRIPTION: Verify MLD router accepts reports with unspecified source address
TEST: ipv6_mcast_81 MODULE: mcast-v6 DESCRIPTION: Verify MLD snooping switch scenario with unspecified source address
Notes
CDRouter
CDRouter’s web UI now supports TLSv1.3 and no longer supports SSLv3. [LH #4273]
The cdrouter.py Python client has been up updated to version 0.4.27 which resolves an issue with Marshmallow 3.0. [LH #4288]
Updated wpa_supplicant to version 2.9. [LH #4274]
Updated hostapd to version 2.9. [LH #4275]
The cdrouter_mcast_2 test case can now be run in bridge mode. Previously this test was skipped if the forwardingMode was set to bridge. The IPv4 hop count is now also automatically set to 0 if bridge mode is enabled. [LH #4181]
The mape_11, mape_13, mapt_11, and mapt_13 test cases are now automatically skipped if the testvar mapStartPort is set to a value of 1, or if the testvar mapStartPort is set to a value of 0 and the testvar mapSharingRatio is set to a value of 1. These tests verify that a MAP CE correctly translates UDP / TCP ports which are outside of its port set. They are not relevant if the CE’s port set contains no excluded ports and should therefore be skipped. [LH #4289]
Re-factored the PSID calculation code for MAP (MAP-E, MAP-T, LW4o6). The testvar mapStartPort now supports a minimum value of 0 (in previous releases the minimum value supported by this testvar was 1). This allows a MAP CE’s port set to be configured with a PSID offset length of zero bits, which was not possible in previous releases. [LH #4289]
CDRouter IPv6
- The ipv6_mcast_2 test case can now be run in bridge mode. Previously this test was skipped if the forwardingMode was set to bridge. The IPv6 hop count is now also automatically set to 0 if bridge mode is enabled. [LH #4181]
CDRouter TR-069
Resolved an issue with the tr69_27 test case. This test was validating the wrong fault code for one error condition. In addition, the inner fault code was not being properly validated in all conditions. [LH #4300]
Updated the tr69_inactive_firmware_1 test case to use the ACS download server rather than the general purpose HTTP server for firmware downloads. This makes it possible to enable HTTP authentication for firmware downloads, which is not possible with the general purpose HTTP server. Some logging was also cleaned up in this test case. [LH #4281]
CDRouter 11.6 Build 2 October 10, 2019
Notes
CDRouter
Upgraded CDRouter’s web server HSTS functionality to achieve an A+ rating via SSL Labs. [LH #4318]
Upgraded the javascript library used for markdown rendering on the client side within CDRouter’s web UI. This resolves some markdown rendering issues. [LH #4295]
Resolved a logic issue in the nat_frag_1 and nat_frag_2 test cases that resulted in a fatal error in certain scenarios. [LH #4304]
The cdrouter_basic_20 test case will now only be skipped if the testvar wanDutMac is not defined for the main WAN group. [LH #4293]
Resolved an issue with the cdrouter_dhcp_40 test case that would result in a fatal error if the parameter request list provided by the DUT was an empty list. [LH #4317]
CDRouter IPv6
- Resolved an issue associated with the preservation of the A-bit and O-bit values in Router Advertisements sent by CDRouter on the WAN in certain test cases. This issue was only present when the testvar ipv6WanMode was set to PPPoE and the testvar ipv6PPPoEAddressMode was set to autoconf. [LH #4296]
CDRouter TR-069
Resolved a fatal error in the ir181_test_5.1.1 test case. [LH #4323]
The tr69_26 test case now utilizes the value of the tr69MinPeriodicInform testvar rather than a fixed value of 50 during the
SetParameterValues
RPC. This modification makes it possible to run this test against devices that do not support a periodic inform interval of 50 seconds. [LH #4322]The tr69_27 test case has been updated to specify the proper root object in all SetParameterValues RPCs for IGD devices [LH #4320].
Updated the ir181_test_5.1.8 test for compatibility with the revised procedure in IR-181 Corrigendum 1. [LH #4206]
The tr69_inactive_firmware_1 test was updated to resolve an error in the URL sent by the ACS to restore the DUT’s original firmware at the end of the test. The URL of the Download RPC now contains the domain name of the file server instead of its IP address. The test has also been updated to provide additional logging if there are any errors encountered during this process. [LH #4311] [LH #4312]
CDRouter BBF.069
- Patched the 5_038_basic_authentication test case so that it can be run
from the command line without the
-pt
flag. This patch has also been submitted to the UNH-IOL. [LH #4306]
CDRouter USP
- Resolved issue in CoAP / DTLS processing which was causing CDRouter to send empty UDP packets during the DTLS handshake. [LH #4268]
⦿ CDRouter 11.7 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 11.7 Build 1 | November 14, 2019 |
Maintenance Release 1 | CDRouter 11.7 Build 2 | December 12, 2019 |
Note: CDRouter 11.7 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 11.7 testvars using the config upgrade utility.
Attention: Operating System Deprecation Notice
Support for the Ubuntu operating system and CentOS 6 has been deprecated. CDRouter systems running on Ubuntu or CentOS 6 will now see warning messages during installation and in the ‘start’ log of a test run.
Support for both of these operating systems will be officially removed with the next major version of CDRouter (12.0). Please contact support@qacafe.com for additional information and assistance in migrating to a supported operating system.
All CDRouter systems will require the CentOS 7 operating system in order to install CDRouter 12.0 and beyond.
CDRouter 11.7 Build 1 November 14, 2019
New Features and Enhancements
CDRouter
Automatic decryption of SSL payloads
CDRouter now has the ability to automatically decrypt SSL payloads for all managed stacks on any configured test interface. This makes it possible to inspect encrypted traffic directly within the log file viewer and packet capture viewer without having to export the capture file, install decryption keys, and set up decryption rules in external tools such as Wireshark.
In addition, CDRouter’s CloudShark integration will automatically include and apply the necessary decryption keys when capture files are pushed to a remote CloudShark instance.
Note that this feature supports decryption of SSL for protocols on known ports only. [ch493]
New testvar for specifying expected RSN pairwise ciphers
The new testvar wifiBeaconRsnCipher can be used to specify the list of RSN pairwise ciphers advertised by the DUT in its wifi beacons. This testvar can be used in conjunction with the existing wifiBeaconWpaCipher testvar for DUT’s operating in mixed modes that support both WPA and RSN.
Note that the group cipher is always expected to be the same for both WPA and RSN modes. As a result there is no need for a separate RSN specific testvar for the expected group cipher. [ch1143]
CDRouter USP
Updates for Broadband Forum TR-469
The usp_conformance test module has been updated with 98 new test cases. With these new tests CDRouter now contains a complete implementation of the Broadband Forum’s TR-469 Conformance Test Plan for User Services Platform Agents.
CDRouter Performance
Display of additional 802.11 header information for each client on every interval
During performance throughput tests CDRouter will now provide additional 802.11 information per reporting interval for each wireless client in use.
For 802.11n clients, CDRouter provides information about the HT characteristics:
chan-width=40 rx-bitrate=364.5 tx-bitrate=450.0 signal=-39 rx-short-gi=0 tx-short-gi=1 noise=-95 rx-mcs=22 tx-mcs=23
For 802.11ac clients, CDRouter provides information about the VHT characteristics:
chan-width=80 rx-bitrate=1300.0 tx-bitrate=975.0 signal=-44 rx-short-gi=1 tx-short-gi=1 noise=-101 rx-vht-mcs=7 tx-vht-mcs=7 rx-vht-nss=4 tx-vht-nss=3
Testvar updates
Testvars added to this release:
- wifiBeaconRsnCipher - New testvar for specifying the RSN pairwise ciphers that the DUT is expected to advertise. [ch1143]
Testvars modified or removed in this release:
- None
New Test Modules and Test Cases
CDRouter USP
Broadband Forum TR-469 USP Conformance Test Module
MODULE: usp_conformance DESCRIPTION: Broadband Forum TR-469 USP conformance tests TEST CASES: 98
Notes
CDRouter
Resolved an issue associated with properly setting the wireless regulatory domain using the testvar wirelessCountryCode on NTA1000 systems that utilize the ath10k wireless driver. [ch1011]
The testvar wirelessCountryCode now defaults to the value
auto
. When set toauto
CDRouter will automatically determine and set the wireless regulatory domain used during a test run based on the locale settings of the operating system. Note that the wireless regulatory domain cannot be modified by CDRouter on non-CentOS systems. [ch1011]The testvar httpServerIp can now be set to either an IPv4 or an IPv6 address. [ch566]
CDRouter’s integrated packet viewer has been upgraded to TraceFrame version 1.2.1, which includes fixes for a few minor packet decode display issues. [ch770]
Resolved a fatal error that would occur if a test package using a wireless interface is queued while another test package using the same interface in wireless on the WAN mode is actively running. [ch1760]
CDRouter IPv6
Resolved an issue with the dns_rfc5625_14, dns_rfc5625_15, and dns_rfc5625_17 test cases. These tests now listen for DNS queries from the DUT on all four DNS servers, if configured. Previously these tests would only listen on the first two DNS servers. [ch1634]
CDRouter now displays the target address of received Neighbor Solicitation and Neighbor Advertisement messages directly in the log. [ch1660]
The dhcpv6-pd test module can now be run in IPv6 WAN unnumbered mode. [ch1748]
CDRouter TR-069
Updated the descriptions of the tr69_140 through tr69_170 test cases to clarify that the tr69_140 and tr69_150 test cases verify the
Upload
RPC as defined in Amendment 2 or earlier of the TR-069 specification whereas tr69_160 and tr69_170 verify the newUpload
RPC as defined in Amendment 3 and later versions of the specification. [ch1417]Resolved a potential fatal error with XMPP based connection requests. [ch1080]
The tr69_101, tr69_hearbeat_2, tr69_heartbeat_4, and ir181_test_5.1.1 tests now utilize the value of the tr69MinPeriodicInform testvar value when configuring the periodic inform interval on the DUT. Previously these tests relied on fixed values that may not be supported on all devices. [ch1282]
Resolved an issue where successful XMPP connection requests were being reported as failures and causing tests to fail. [ch1596]
CDRouter BBF.069
Updated the 5_035_redirect_in_session test case to abort rather than continue if a CWMP session fails to start. This patch has been reported upstream to the UNH-IOL as well. [ch537]
Resolved a fatal error in the 5_120_xmpp_incorrect_jabber_id. This patch has been reported upstream to the UNH-IOL as well. [ch1812]
Resolved a potential fatal error in the ACS_XMPP_send_connection_request test case. This patch has been reported upstream to the UNH-IOL as well. [ch1420]
CDRouter USP
CDRouter’s CoAP DTLS implementation will now send a TLS alert message when closing a session. This notifies the remote peer that the session has been closed. [ch880]
The usp_30 test case procedure and cleanup process have been modified to determine which firmware slot is active at the start of the test and revert the original firmware to the same slot at the end of the test. [ch1021]
CDRouter ICS
- CDRouter ICS will now return the TTL of the upstream resolver rather than a fixed TTL of 0 when resolving DNS queries using the system resolver. [ch490]
CDRouter 11.7 Build 2 December 12, 2019
New Features and Enhancements
CDRouter
New SIP ALG test cases
Three new SIP ALG test cases have been added to verify that the DUT properly handles outbound SIP calls with multiple DHCP LAN clients that do not register a port. The new tests are cdrouter_sip_201, cdrouter_sip_tcp_201, and ipv6_sip_201, and verify this behavior over UDP/IPv4, TCP/IPv4, and UDP/IPv6, respectively.
As part of this work, CDRouter’s SIP client behavior has also been modified. CDRouter’s SIP client will now omit the port number from its SIP headers if the default port value is in use (5060⁄5061). Previously, the port number was always included even the default port was used.
New Test Modules and Test Cases
CDRouter
New SIP ALG test cases
TEST: cdrouter_sip_201 MODULE: sip-alg DESCRIPTION: Verify outbound SIP calls with multiple DHCP LAN clients without registering a port
TEST: cdrouter_sip_tcp_201 MODULE: sip-alg-tcp DESCRIPTION: Verify outbound SIP calls with multiple DHCP LAN clients (TCP) without registering a port
CDRouter IPv6
New SIP ALG test case
TEST: ipv6_sip_201 MODULE: sip-v6 DESCRIPTION: Verify outbound SIPv6 calls with multiple DHCP LAN clients without registering a port
Notes
CDRouter
- Added the DUT’s LAN IP to the list of excluded MAC addresses in the cdrouter_dos_30 and cdrouter_dos_32 test cases. This resolves a potential ARP conflict in certain test scenarios. [ch2348]
CDRouter IPv6
- Updated the option type used in the ipv6_basic_10 test case from Type 07 (0x07) to Type 17 (0x11). This change is consistent with the option type used in Revision 5.0.0 of the IPv6 Ready Core Protocols Test Specification. [ch1923]
Performance
- The iperf process scheduling algorithm used by CDRouter has been modified and improved for compatibility with newer operating systems and kernels. This change impacts only CentOS 7 and 8 systems. [ch1662]
CDRouter DOCSIS
- Updated the test descriptions for the docsis_firewall_100, docsis_firewall_101, docsis_firewall_110, ipv6_docsis_firewall_100, ipv6_docsis_firewall_101, and ipv6_docsis_firewall_110 to reference the correct testvars for specifying the expected open and closed TCP and UDP ports for the DOSCIS interface firewall. [ch2087]
Pktsrc API Notifications
Changes to
IPv4_set
andIPv4_reconfigure
ARP functionalityPreviously,
IPv4_reconfigure
would send a gratuitous ARP when changing a stack’s IPv4 address whileIPv4_set s ip
would not. CDRouter’s behavior has been unified such that by default, both methods now send a gratuitous ARP, while also adding options to disable this new behavior if it is not desired.IPv4_set
now supports an optionalnoarp
argument if setting the ip field, i.e.IPv4_set s ip <ip> noarp
. This change is meant to be symmetric with thenodad
argument supported by theIPv6_set
call which works similarly.IPv4_reconfigure
now passesnoarp
to its call toIPv4_set
instead of callingARP_announce
directly. [ch885]
⦿ CDRouter 11.8 Release Notes
Release History
Release Type | Release Number | Release Date |
---|---|---|
Original | CDRouter 11.8 Build 1 | January 23, 2020 |
Maintenance Release 1 | CDRouter 11.8 Build 2 | February 27, 2020 |
Note: CDRouter 11.8 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 11.8 testvars using the config upgrade utility.
Attention: Operating System Deprecation Notice
Ubuntu and CentOS 6 will not be suported in future releases
All CDRouter systems will require the CentOS 7 operating system in order to install CDRouter 12.0 and beyond.
Support for the Ubuntu operating system and CentOS 6 has been deprecated. CDRouter systems running on Ubuntu or CentOS 6 will now see warning messages during installation and in the ‘start’ log of a test run.
Support for both of these operating systems will be officially removed with the next major version of CDRouter (12.0). Please contact support@qacafe.com for additional information and assistance in migrating to a supported operating system.
CDRouter 11.8 Build 1 January 23, 2020
New Features and Enhancements
CDRouter
New PPPoE pass-through test case
A new test case has been added to the pppoe-pt (PPPoE pass-through) test module. This new test, cdrouter_pppoept_3, verifies PPPoE pass-through sessions using a random session ID whereas the other tests in this module use sequential session IDs. [ch1606]
CDRouter TR-069
Support for the Device:2.13 data model
CDRouter now supports the Broadband Forum’s Device:2.13 data model for CWMP as defined in TR-181 Issue 2 Amendment 13. [ch585]
Updated CWMP profiles
CDRouter’s Device2_profiles test module has also been updated to support the Device:2.13 data model. All profiles defined in the following data models are now supported:
Data Model Version InternetGatewayDevice:1 1.14 Device:1 1.14 Device:2 2.13 STBService:1 1.4 VoiceService:1 1.1 VoiceService:2 2.0 StorageService:1 1.3 FAPService:1 1.1 FAPService:2 2.1 This update adds support for the new Device:2 profiles listed below:
Test Module Profile Device2_profiles PacketCaptureDiagnostics:1 Device2_profiles SELTDiagnostics:1 Device2_profiles MQTTClientCon:1 In addition, one test, FAPService2_REMLTE_ado_6, has been removed due to changes in Device:2.13 data model requirements. [ch585]
CDRouter USP
Support for the Device:2.13 data model
CDRouter now supports the Broadband Forum’s Device:2.13 data model for USP as defined in TR-181 Issue 2 Amendment 13. [ch585]
Updated CWMP profiles
CDRouter’s USP_Device2_profiles test module has also been updated to support the Device:2.13 data model. All profiles defined in the following data models are now supported:
Data Model Version Device:2 2.13 STBService:1 1.4 VoiceService:2 2.0 StorageService:1 1.3 FAPService:2 2.1 This update adds support for the new Device:2 profiles listed below:
Test Module Profile USP_Device2_profiles MQTTClientCon:1 USP_Device2_profiles BinaryControl:1 USP_Device2_profiles LevelControl:1 USP_Device2_profiles LevelControlIntensity:1 USP_Device2_profiles EnumControl:1 USP_Device2_profiles BinarySensor:1 USP_Device2_profiles LevelSensor:1 USP_Device2_profiles LevelSensorLowThreshold:1 USP_Device2_profiles LevelSensorHighThreshold:1 USP_Device2_profiles MultiLevelSensor:1 USP_Device2_profiles EnumSensor:1 USP_Device2_profiles SELTDiagnostics:1 USP_Device2_profiles PacketCaptureDiagnostics:1 USP_Device2_profiles CoAPAgent:1 USP_Device2_profiles WebSocketAgent:1 USP_Device2_profiles MQTTAgent:1 USP_Device2_profiles CoAPController:1 USP_Device2_profiles WebSocketController:1 USP_Device2_profiles MQTTController:1 USP_Device2_profiles ControllerTrust:1 In addition, one test, USP_FAPService2_REMLTE_ado_6, has been removed due to changes in Device:2.13 data model requirements. [ch585]
NTA1000
New 7.0 Golden Image
Version 7.0 of the NTA1000 operating system image, aka the golden image, is now available. This version is supported on all NTA1000v2 through NTA1000v6 platforms and is based on CentOS 7. For more information, please see the Golden Image Release Notes.
Testvar updates
Testvars added to this release:
- None.
Testvars modified or removed in this release:
- cwmpSupportedDataModel and
uspSupportedDataModel - these testvars will now accept a
value of
Device:2.13
.
New Test Modules and Test Cases
CDRouter TR-069
New Device:2.13 profile tests
PROFILE: PacketCaptureDiagnostics:1 MODULE: Device2_profiles NEW TEST CASES: 6
PROFILE: SELTDiagnostics:1 MODULE: Device2_profiles NEW TEST CASES: 6
PROFILE: MQTTClientCon:1 MODULE: Device2_profiles NEW TEST CASES: 6
CDRouter USP
New Device:2.13 profile tests
PROFILE: MQTTClientCon:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: BinaryControl:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: LevelControl:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: LevelControlIntensity:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: EnumControl:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: BinarySensor:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: LevelSensor:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: LevelSensorLowThreshold:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: LevelSensorHighThreshold:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: MultiLevelSensor:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: EnumSensor:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: SELTDiagnostics:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: PacketCaptureDiagnostics:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: CoAPAgent:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: WebSocketAgent:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: MQTTAgent:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: CoAPController:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: WebSocketController:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: MQTTController:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
PROFILE: ControllerTrust:1 MODULE: USP_Device2_profiles NEW TEST CASES: 4
Notes
CDRouter
Updated version of Tcl shipped with CDRouter to 8.6.10. [ch2468]
The test constraints and skip logic for configurations utilizing wireless virtualization have been re-factored. These changes impact tests within the
incompatible-with-multiple-wireless-radio
skip label. This makes it possible to run any test cases that require the creation of LAN clients with specific user defined MAC addresses if at most one wireless interface that supports virtualization is enabled. Previously, these tests were skipped if one or more wireless interfaces with virtualization support were enabled. [ch1921]Created a new
requires-wired-wan
skip label. All tests that require virtualization on the WAN are now contained within this label and will therefore only run in configurations that utilize a wired WAN interface. [ch1921]The cdrouter_dos_10 test is not compatible with configurations where the wanMode is set to a value of
none
and will now be skipped automatically in these configurations. [ch2350]Updated the dns_60 test case and all variants to wait dnsFailoverDelay seconds before verifying that the original servers have been restored. Previously these tests waited a fixed 5 seconds which was not always sufficient. [ch2147]
CDRouter now generates a configuration error if both the lanMode and ipv6LanMode testvars are set to a value of
none
. This prevents a fatal error in certain configurations from occurring. [ch2983] [ch2502]
CDRouter TR-069
- The value Completed for the
UploadDiagnosticsState
andDownloadDiagnosticsSate
parameters in the Device:2.13 data model has been deprecated and replaced with the value Complete. A number of tests in the ir181 and tr143_http test modules have been updated to handle this change. Devices implementing Device2:12 or earlier MUST use a value of Completed for these two parameters, whereas devices implementing Device:2.13 may use values of Completed or Complete. [ch2669]
CDRouter Multiport
- Resolved an issue associated with reconnection of CDRouter’s wireless LAN clients if disassociated during a test run. Previously, only one wireless client would reconnect - all other clients would not reconnect, resulting in failures in all subsequent tests. [ch2620]
CDRouter IPv6
- CDRouter’s relay server for 6to4 and 6rd will now be configured with a link-local IPv6 address which can be used by the DUT for Neighbor Unreachability Detection, as defined in Section 9 of RFC 5969 and Section 3.8 of RFC 4213. [ch2230]
CDRouter Performance
- Resolved a fatal error when running perf_multi_2, perf_multi_4, ipv6_perf_multi_2, or ipv6_perf_multi_4 test cases in PPPoE mode on the WAN. [ch2197]
CDRouter USP
- Resolved an issue with parameters specified by the testvar uspSkipParameters not being properly skipped during USP profile validation tests. [ch3066]
CDRouter 11.8 Build 2 February 27, 2020
New Features and Enhancements
CDRouter Multiport
New LAN multiport routing test cases
Four new test cases have been added to the CDRouter Multiport add-on. These tests verify TCP and UDP routing over IPv4 and IPv6 between LAN clients.
The cdrouter_lan_mp_21 and cdrouter_lan_mp_22 test cases verify TCP and UDP routing between LAN clients over IPv4, respectively. The ipv6_lan_mp_21 and ipv6_lan_mp_22 test cases verify the same functionality over IPv6.
CDRouter TR-069
New ACS domain name and TLS server certificates
The ACS and ACS download server certificates shipped with previous releases of CDRouter have expired and have been replaced by a new set of test certificates signed by Sectigo.com (formerly COMODO).
The Common Name (CN) field of these certificates has been changed from acs.qacafe.com and acs-download.qacafe.com to acs.cdroutertest.com and acs-download.cdroutertest.com, respectively. The default value of the acsDomain testvar, which identifies the fully-qualified domain name (FQDN) of CDRouter’s ACS, has also been changed from acs.qacafe.com to acs.cdroutertest.com.
It is important to note that these changes may break some existing CDRouter configurations. CPE devices may fail to resolve the ACS IP address through DNS and and will not be able to validate the expired TLS server certificates until your configurations have been updated.
Please see the following Knowledge Base article for instructions to update your configurations:
CDRouter IPv6
New DS-Lite test case
A new test case, dslite_42, has been added to the dslite module. This test verifies that the DUT copies the IPv4 TOS field into the IPv6 Traffic Class field and vice versa when handling DS-Lite traffic, as defined in Section 7.1 of RFC6333.
Testvar updates
Testvars added to this release:
- uspControllerUseNonPayloadProtection - this testvar controls
whether or not CDRouter’s USP Controller sends a
mac_signature
value. [ch2053]
Testvars modified or removed in this release:
- mapTunnelTrafficClass - this testvar supports the new
value of
auto
, which indicates that the IPv6 Traffic Class field is expected to be copied from the IPv4 Type of Service (TOS) field of the original IPv4 header in test case mape_21. [ch2168] - acsDomain - the default value of this testvar has been
changed from
acs.qacafe.com
toacs.cdroutertest.com
. - acsCertPath - the default value of this testvar has been updated to the location of the new ACS server certificate.
- acsCaCertPath - the default value of this testvar has been updated to the location of the new ACS CA bundle.
- acsDownloadCertPath - the default value of this testvar has been updated to the location of the new ACS download server certificate.
- acsDownloadCaCertPath - the default value of this testvar has been updated to the location of the new ACS download server CA bundle.
- supportsH323AlgOutbound - this testvar is now deprecated and will be removed in the next release of CDRouter.
- supportsH323AlgInbound - this testvar is now deprecated and will be removed in the next release of CDRouter.
- inboundH323Host - this testvar is now deprecated and will be removed in the next release of CDRouter.
New Test Modules and Test Cases
CDRouter IPv6
New DS-Lite test case
TEST: dslite_42 MODULE: dslite DESCRIPTION: Verify IPv4 TOS is copied to IPv6 Traffic Class
CDRouter Multiport
New TCP and UDP LAN to LAN routing tests
TEST: cdrouter_lan_mp_21 MODULE: lan-mp DESCRIPTION: Verify TCP routing between multiple LAN ports
TEST: cdrouter_lan_mp_22 MODULE: lan-mp DESCRIPTION: Verify UDP routing between multiple LAN ports
TEST: ipv6_lan_mp_21 MODULE: lan-mp-v6 DESCRIPTION: Verify HTTPv6 routing between multiple IPv6 LAN ports
TEST: ipv6_lan_mp_22 MODULE: lan-mp-v6 DESCRIPTION: Verify UDP routing between multiple IPv6 LAN ports
Notes
CDRouter
The arrangement of the Auto-Update and test navigation buttons within the web UI have been switched. This prevents the navigation buttons from moving when a test is finished versus running. [ch3088]
Updated the
Visualize Package
feature to properly escape special characters in package names. [ch3159]CDRouter’s HTTP client no longer includes the
Accept-Encoding: gzip
header option in requests. [ch2551]The CDRouter web UI no longer supports HTTP/2. This resolves an issue with the Automatic and Manual upgrade features within the CDRouter web UI when initiated over HTTPS with a browser that supports HTTP/2. HTTP/2 support will be re-enabled in the future when the underlying library has been patched. [ch3719]
Certain wifi cards manage their regulatory domain via firmware and cannot be configured for a specific country code. CDRouter will now ignore these cards when setting the country code. This resolves a fatal error on certain systems. [ch2464]
The following tests which involve H323 ALG functionality will be removed in the next release of CDRouter: cdrouter_app_200, cdrouter_app_205, cdrouter_app_207, cdrouter_app_220, cdrouter_app_225, and cdrouter_app_227. [ch3891]
CDRouter TR-069
CDRouter will now generate a config check warning if IPv6 is disabled and the testvar acsIp is set to an IPv6 address. Previously this configuration would generate a fatal error at run time. [ch3047]
Resolved an issue with the tr69_wireless module in which the original PSK was not being properly restored at the end of each test. This issue was introduced in CDRouter 11.5 and impacted only tests utilizing WPA in configurations where the testvar lanSecurity was set to the value
WPA
. [ch3382]
CDRouter BBF.069
- Resolved a race condition with XMPP based connection requests. This issue has also been reported upstream to the UNH-IOL. [ch3781]
CDRouter IPv6
Update the logic for the mape_21 test case to recognize the new
auto
value for mapTunnelTrafficClass such that the test case will pass if and only if the DUT copies the IPv4 TOS field into the IPv6 Traffic Class field when performing MAP-E translation. [ch2168]Resolved an off by one issue with CDRouter’s LAN side DHCPv6 pool size calculation. [ch3858]
CDRouter Storage
- Resolved an issue in the storage tests in which a failed initial connection to the server would result in a test case pass rather than failure. [ch3512]
CDRouter USP
A new testvar, uspControllerUseNonPayloadProtection has been added. This testvar controls whether or not CDRouter’s USP Controller sends a
mac_signature
value. [ch2053]General improvements to session management within the USP Controller. [ch2053]
Added heartbeat support for STOMP. [ch2053]
Numerous improvements based on initial verification testing of the USP conformance test plan (Broadband Forum TR-469). [ch2053]
Minor bugfixes in USP scenarios. [ch2056]
⦿ CDRouter 12.0 Release Notes
CDRouter 12.0 March 26, 2020
Notices
Important Installation Notes
The following prerequisites must be met before upgrading to CDRouter 12.0:
➊ New minimum system requirements
CDRouter 12.0 requires a CentOS 7 or CentOS 8 operating system. The Ubuntu and CentOS 6 operating systems are no longer supported, and CDRouter 12.0 will not install if you are using one of these operating systems.
NTA1000 platforms running CentOS 6 should be upgraded using the Rebuild the NTA1000 Operating System guide prior to installing CDRouter 12.0.
If you do not have an NTA1000 or are otherwise unable to upgrade your operating system from Ubuntu or CentOS 6, please contact support@qacafe.com for assistance.
➋ Minimum CDRouter version requirement
The auto-upgrade utility in CDRouter’s web interface will not be able to install CDRouter 12.0 unless you are already running version 11.8.2. You must install CDRouter 11.8.2 before upgrading to CDRouter 12.0 using the auto-upgrade methods in the web UI.
If you are running an earlier release of CDRouter, you may upgrade to CDRouter 12.0 or later versions using the manual upgrade procedure via the CLI. Please follow the “Manual installation” instructions in the CDRouter Installation and Upgrade Guide to manually upgrade your system.
➌ New procedure for installing CDRouter
CDRouter 12.0 and subsequent versions will now be distributed as an rpm file that is only supported by the CentOS 7 and 8 operating systems.
The CDRouter Installation and Upgrade Guide has been updated with instructions for manually installing and upgrading CDRouter with the new installer format.
Please contact support@qacafe.com if you need any assistance.
➍ Config upgrades
CDRouter 12.0 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 12.0 testvars using the config upgrade utility.
See the Testvar Updates section below for important notes about config file changes in this release.
New Features and Enhancements
CDRouter
New Security Add-on!
We are very excited to introduce the CDRouter Security add-on! This add-on includes a number of features designed to test and evaluate the overall security of a CPE device. Included with the Security add-on are port scanning tools utilizing Nmap, a new traffic analysis feature based on Suricata, and two new test modules for verifying schedule-based internet access restrictions which is a common parental controls feature.
Please see the CDRouter Security User Guide for more information.
New config editor view for displaying only modified testvars
The config editor within CDRouter’s web UI includes a new button labeled Expand Changed that will collapse all SECTIONs and testvar_groups in the config file that do not contain any changes. This makes it easier to see which testvars are not set to their default values. Previously, config files were displayed with all sections collapsed. Note that the expand changed view is also now the default view for all config files. [ch3673]
CDRouter USP
New USP controller domain name and TLS server certificates
The USP controller certificates shipped with previous releases of CDRouter have been replaced by a new set of test certificates signed by Sectigo.
In addition, the Common Name (CN) field of these certificates has been changed from controller.qacafe.com to controller.cdroutertest.com. The default value of the uspControllerDomain testvar, which identifies the fully-qualified domain name (FQDN) of CDRouter’s USP controller, has also been changed from controller.qacafe.com to controller.cdroutertest.com.
It is important to note that these changes may break some existing CDRouter configurations. CPE devices may fail to resolve the controller IP address through DNS and and will not be able to validate the expired TLS server certificates until your configurations have been updated.
Testvar Updates
Testvars added to this release:
enableSuricata - this enables the Suricata based traffic analysis feature that is included with the new CDRouter Security add-on.
internetSchedule<day-of-week>Mode
: there is one of these for each day of the week. Its value can beallow
,deny
ornone
. If set tonone
, the DUT has no schedule for the given LAN client for that day of the week. If set toallow
ordeny
, then the tests are run and the time ranges specified dictate when the LAN client should be allowed (allow
) or denied (deny
) internet access. These testvars can be configured separately for each LAN testvar group (main
,lan2
,lan3
, etc).internetSchedule<day-of-week>Times
: Again, there is one of these for each day of the week. Its value should be a time range such as9:00am - 5:00pm
which dictates when the LAN client should be allowed or denied internet access. These testvars can be configured separately for each LAN testvar group (main
,lan2
,lan3
, etc).
Testvars modified or removed in this release:
With the addition of the new CDRouter Security Add-on, testvars for the NMAP and ICS features have been moved and are no longer found at the top level of the config file hierarchy. These testvars can now be found immediately under the “CDRouter Security Add-on” section.
Note that upgrading older config files will automatically reformat all testvars and move the NMAP and ICS testvar sections from their previous location to the “CDRouter Security Add-on” section.
SECTION "CDRouter Security Add-On" { # testvar enableSuricata no SECTION "CDRouter ICS" { # testvar enableICS no # testvar icsInterface none # testvar icsShareIPv4 yes # testvar icsShareIPv6 yes } SECTION "CDRouter Nmap" { # testvar enableNmap no # testvar nmapPorts 0-65535 # testvar nmapScanTimeout 600 # testvar nmapTimingTemplate 5 } SECTION "Parental Controls" {↔} }
The testvars supportsNmap and supportsICS have been deprecated in favor of the new testvars enableNmap and enableICS, respectively. The original testvar names will continue to work until they are removed in a future release. All configs utilizing these testvars should be updated to use the new testvar names.
The testvars supportsH323AlgOutbound, supportsH323AlgInbound, and inboundH323Host are obsolete and have been removed from this release.
All wireless LAN and WAN testvars and testvar values that were deprecated in CDRouter 11.5 as part of the update required to support WPA3 have been removed. Any configs using deprecated testvars or testvar values must be updated.
Notes
CDRouter
The wildcard test certificates shipped with CDRouter have been updated. These certificates are used by CDRouter’s DNS servers when testing DNS over TLS (DoT) or DNS over HTTPS (DoH). Configurations that reference the old wildcard certificates will need to be updated for compatibility with CDRouter 12.0. Please see this Knowledge Base article for more information. [ch3773]
The test cases cdrouter_app_200, cdrouter_app_205, cdrouter_app_207, cdrouter_app_220, cdrouter_app_225, and cdrouter_app_227 are obsolete and have been removed from the apps test module. [ch3891]
All wireless LAN and WAN testvars and testvar values that were deprecated in CDRouter 11.5 as part of the update required to support WPA3 have been removed. Any configs using deprecated testvars or testvar values must be updated. [ch4014]
In certain configurations some wireless country codes are not fully supported by the underlying wifi drivers used by CDRouter. This may result in the drivers failing to load and the wifi interface(s) disappearing from the system.
CDRouter now attempts to restore the system to a fully working state when this error condition is detected. Specifically, CDRouter will automatically reconfigure the system to use US/840 to restore the missing interface(s) and then attempt to set the regulatory domain to the system’s default which is based on timezone. If this fails CDRouter will attempt to set the domain to US/840, and generate an error to alert the user if this is unsuccessful.
In addition, when determining the system’s default regulatory domain, which is based on timezone, US/840 will be used if the derived alpha2 domain code is considered invalid. [ch4134]
CDRouter TR-069
The wireless configuration verification tests in the tr69_wireless and ir181 test modules now validate that the DUT includes the client MAC in the
AssociatedDevice
table 5 seconds after the basic traffic verification step has been performed. This provides ample time for the DUT to update theAssociatedDevice
table. [ch3915]Resolved a fatal error with the wireless configuration tests in the tr69_wireless and ir181 test modules when run in multiport configurations utilizing both wireless and wired LAN interfaces. [ch3938]
Resolved an issue with CDRouter’s device data model version detection algorithm. Also addressed an issue with a
Complete
versusCompleted
error associated with the Device:2.13 data model in the tr143_http test module [ch3944]
CDRouter Storage
- Resolved a false pass related to an error condition in the FTP storage tests if the initial connection was successfully established but subsequently timed out. [ch3936]
⦿ CDRouter 12.1 Release Notes
CDRouter 12.1 April 23, 2020
Notices
Important Installation Notes
If you are upgrading from CDRouter 11.x or earlier versions, you must meet the prerequisites listed in the CDRouter 12.0 Release Notes prior to upgrading to CDRouter 12.1. Please review that document and contact support@qacafe.com if you need any assistance.
Config Upgrades
CDRouter 12.1 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 12.1 testvars using the config upgrade utility.
New Features and Enhancements
CDRouter
Support for 802.11ax
CDRouter now supports 802.11ax WiFi in client mode on the LAN and AP mode on the WAN using the new NTA1000v7 platform which is also now available. If you are interested in learning more, or interested in upgrading your system to an NTA1000v7, please reach out to sales@qacafe.com.
NTA1000
New NTA1000v7 platform
Version 7 of the NTA1000 platform is now available! The NTA1000v7 includes a new 2x2 dual-band 802.11ax capable wireless interface and is available in two hardware configurations:
Hardware Configuration wifi0-acn WiFi Interface wifi1-ax WiFi Interface wifi2-ac2 WiFi Interface 10GBASE-T Interface NTA1000v7-S Yes Yes Yes No NTA1000v7-10G Yes Yes No Yes The NTA1000v7-S includes three WiFi interfaces and supports up to 65 WiFi clients (64 802.11ac capable clients + 1 802.11ax capable client). The NTA1000v7-10G includes two WiFi Interfaces and one dual-port 10GBASE-T Ethernet adapter and supports 33 WiFi clients (32 802.11ac capable clients + 1 802.11ax capable client).
For more information, please see the NTA1000v7-S or NTA1000v7-10G Quick Start Guides or contact sales@qacafe.com.
Testvar Updates
Testvars added to this release:
- None.
Testvars modified or removed in this release:
The testvar dhcpv6WanEnablePD now has a dynamic default value, and will be set to yes if ipv6WanMode is autoconf, DHCP, unnumbered, or PPPoE (if ipv6PPPoEAddressMode is autoconf or DHCP). This dynamic default is only applied if forwardingMode is route. [ch2184]
The testvar wifiBeaconPhy has been updated to include a new supported value of ax. This makes it possible to verify the beacons of 802.11ax enabled devices with the wifi_20 test case. [ch3851]
The testvar lan80211Phy has been updated to include a new supported value of ax. [ch3851]
Notes
CDRouter
Updated many of the tests in the mcast and mcast-v6 modules to to protect against receiving unexpected multicast packets. This resolves an issue associated with test logic triggering on non-test multicast traffic. [ch4293]
Updated certificates for supporting WPA3 and Suite B profile for Transport Layer Security. [ch4427]
CDRouter Multiport
- Resolved a race condition that could lead to a fatal error in the following test cases: guest_12, guest_13, guest_16, guest_17, ipv6_guest_12, ipv6_guest_13, ipv6_guest_16, and ipv6_guest_17. [ch4216]
CDRouter TR-069
Resolved a fatal error in test cases ir181_test_5.2.2, ir181_test_5.2.3, ir181_test_5.2.4, and ir181_test_5.2.5 when the Performance add-on is not enabled within the system’s license file. These tests will now run on systems that do not have the Performance add-on. [ch4016]
Updated the tr69_wireless_50 test case to test only channels that are supported by both the DUT and the wireless interface being used within CDRouter. [ch4326]
The Sectigo AddTrust External CA Root required to validate CDRouter’s ACS and ACS download server certificates will expire in May of 2020. This root CA has been replaced with the new Sectigo USERTrust RSA CA that expires in 2038. The Sectigo root is located in the
acs.cdroutertest.com-rootca.pem
in the/usr/cdrouter/tests/
directory.Note that the old Sectigo root CA used SHA1 with RSA encryption. The new root uses SHA384 with RSA encryption. Some DUT’s may need to have the new root CA installed in order to properly validate CDRouter’s ACS and ACS download server certificates.
For more information on Sectigo Chain Hierarchy and Intermediate Roots, please see this page. [ch4263]
CDRouter IPv6
CDRouter will automatically enable DHCPv6 prefix delegation on the WAN for IPv6 WAN modes of autoconf, DHCP, unnumbered, or PPPoE (if the PPPoE address mode is either autoconf or DHCP). Note that this change does not apply to bridge mode configurations. [ch2184]
Updated the mape_21, mapt_21, and dslite_42 test cases to ensure that the ECN bits within the TOS / Traffic Class field are always set to a value of 0x00 to avoid translation issues with ECN capable implementations. [ch4461]
CDRouter USP
Resolved a fatal error condition in the usp_basic_4 test case. [ch4382]
Updated the usp_conformance_1_60 to remove an unneeded check for the
subscription_id
in anOnBoardRequest
. [ch4433]Numerous updates to the usp_conformance test module in preparation for the Broadband Forum’s USP certification program. [ch3917]
CDRouter Security
- CDRouter’s internet connection sharing (ICS) feature has been updated to support routed test setups where one or more router hops are present on the WAN. In addition, the ICS feature is now enabled on all configured WAN interfaces. Previously, ICS was enabled only on the primary WAN interface. [ch4158]
CDRouter BBF.069
- The BBF.069 tests require IPv4 and will now be skipped if IPv4 is not enabled. [ch4215]
⦿ CDRouter 12.2 Release Notes
CDRouter 12.2 May 21, 2020
Notices
Important Installation Notes
If you are upgrading from CDRouter 11.x or earlier versions, you must meet the prerequisites listed in the CDRouter 12.0 Release Notes prior to upgrading to CDRouter 12.2. Please review that document and contact support@qacafe.com if you need any assistance.
Config Upgrades
CDRouter 12.2 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 12.2 testvars using the config upgrade utility.
New Features and Enhancements
CDRouter
Support for 64 wifi clients on ath10k based wireless adapters
The maximum number of wifi clients supported by ath10k based wireless adapters within CDRouter has been increased from 32 to 64. [ch3689]
CDRouter USP
Broadband Forum USP Agent Certification
CDRouter is the official test tool of the Broadband Forum’s USP Agent Certification program. This release of CDRouter includes a full implementation of TR-469 Conformance Test Plan for USP Agents in the usp_conformance test module. [ch4627]
More information on how to use the CDRouter USP Add-On to perform self-testing certification can be found here.
CDRouter Web API
New parameter for fetching detailed data in Web API requests
Many API calls which return a list of resources (configs, results, etc.) can now be modified to return all fields for that resource. Previously, only requests for an individual instance of a resource would provide detailed information, whereas requests for a list of resources yielded a summary view of the resource. See the CDRouter Web API documentation for details. The cdrouter.py Python module has also been updated to support the new
detailed
parameter. [ch4349]
Testvar Updates
Testvars added to this release:
- The new testvar ipv6RelayServerGlobal can be used to specify the global IPv6 address of CDRouter’s 6rd/6to4 relay server. [ch4343]
Testvars modified or removed in this release:
- None.
Notes
CDRouter
The libraries and utilities used by CDRouter have been rebuilt on CentOS 7 (previously these were built on CentOS 6 which is nearing end-of-life status). In addition, certain libraries and utilities will now be pulled in from the system automatically as dependencies when CDRouter is installed. [ch3424]
CDRouter’s Ethernet MTU is no longer automatically reduced when VLANs are enabled. [ch4766]
CDRouter USP
- Updated the default value of the testvar uspParameterPath1
to
Device.DeviceInfo.ModelName
. [ch4572]
CDRouter Security
Updated the ET Open ruleset shipped with the CDRouter Security add-on to version 9456. [ch4533]
Added support for non-UDP/TCP security alerts which lack ports. Previously, CDRouter assumed all alert events coming from Suricata’s eve-log would contain
src_port
anddest_port
keys, which is not true for alerts associated with, for example, ICMP packets. Therefore, CDRouter has been updated to support alerts without port information. [ch4556]IPv6 internet connection sharing (ICS) now provides connectivity for all addresses within the WAN network defined by the testvars ipv6WanIspAssignIp and ipv6WanIspPrefixLen. Previously only addresses within the delegated prefix were given connectivity. [ch4158]
IPv6 internet connection sharing (ICS) can now be enabled in configurations that do not have DHCPv6 prefix delegation enabled. [ch4657]
CDRouter IPv6
- CDRouter’s 6rd/6to4 relay server is now configured with the IPv6 global address specified by the new testvar ipv6RelayServerGlobal. Previously, CDRouter’s relay server was only configured with an IPv6 link-local address, which made it impossible for IPv6 packets originated by the relay server (for example, ICMPv6 Packet Too Big messages) to reach IPv6 LAN clients behind the DUT. Adding this new testvar and configuring the relay server with this IPv6 global address resolves this issue, allowing LAN clients performing Path MTU discovery to learn the PMTU of IPv6 hosts accessed over the tunnel. [ch4343]
CDRouter Performance
- Improved logging for performance tests using more than one stream. [ch1770]
CDRouter TR-069
- Updated tests tr143_http_11, tr143_http_12, tr143_http_13, tr143_http_14, and tr143_http_50 to support the Device:2.13 data model. [ch4471]
⦿ CDRouter 12.3 Release Notes
CDRouter 12.3 June 18, 2020
Notices
Important Installation Notes
If you are upgrading from CDRouter 11.x or earlier versions, you must meet the prerequisites listed in the CDRouter 12.0 Release Notes prior to upgrading to CDRouter 12.3. Please review that document and contact support@qacafe.com if you need any assistance.
Config Upgrades
CDRouter 12.3 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 12.3 testvars using the config upgrade utility.
New Features and Enhancements
Apple HomeKit
New HomeKit add-on for CDRouter!
The HomeKit add-on for CDRouter provides fully automated testing of the Apple HomeKit-enabled Router Certification Test Plan. For more information, please contact sales@qacafe.com.
CDRouter
The Top 100 test list has been updated!
All FTP and TFTP related test cases have been removed from the Top 100 test list in favor of more HTTP and HTTPS test cases. This change was made because FTP and TFTP are less relevant today and not as widely used as HTTP and HTTPS. In addition, three basic LAN side ARP test cases have been added.
The table below summarizes the changes to the Top 100:
Test Cases Removed Test Cases Added cdrouter_basic_1 arp_1 cdrouter_app_2 arp_2 cdrouter_app_3 arp_3 cdrouter_app_10 cdrouter_http_300 cdrouter_app_11 cdrouter_http_301 cdrouter_app_12 cdrouter_http_250 cdrouter_app_15 cdrouter_http_270 cdrouter_app_16 cdrouter_http_280 cdrouter_app_17 cdrouter_https_250 cdrouter_app_18 cdrouter_https_300 cdrouter_app_124 cdrouter_https_301 New WiFi band steering test case
Band steering is a proprietary technique used to push, or steer, specific clients to either the 2.4 or 5 GHz frequency band. Steering is typically used for load balancing across multiple radios or to improve the overall aggregate performance of the AP by forcing older legacy clients to the 2.4 GHz band and/or newer more modern clients to the 5 GHz band.
Band steering is not officially defined or included in any IEEE 802.11 specification. However, it is a widely supported feature in modern WiFi access points and is implemented in a variety of ways by different manufacturers. Band steering is only possible for dual-band clients and requires that the AP broadcast the same SSID and use the same security settings on all radios and bands.
CDRouter’s new wifi_50 test case verifies the DUT’s band steering functionality. The new testvar lan80211BandSteering defines the expected band steering behavior of the DUT. If band steering is not supported or enabled, set this testvar to a value of
none
. If the DUT is configured to steer clients to either the 2.4 or 5 GHz band, set this testvar to a value of2.4GHz
or5GHz
, respectively. [ch3761]
Testvar Updates
Testvars added to this release:
The new testvar lan80211BandSteering is used in the wifi_50 test case to configure the expected WiFi band steering behavior of the DUT. [ch3761]
The new HomeKit add-on introduces six new testvars: supportsHomeKit, homeKitRouterName, homeKitHATHostname, homeKitHATRulesPath, homeKitRouterSetupCode, and homeKitManualEnabled.
Testvars modified or removed in this release:
- The testvars lanChannel and wanApChannel have been updated to support twelve new 5 GHz channels: 68, 72, 76, 80, 84, 92, 96, 144, 169, 173, 177, and 181. [ch5110]
New Test Modules and Test Cases
CDRouter
New WiFi band steering test
TEST: wifi_50 MODULE: wifi DESCRIPTION: WiFi Band Steering test
Apple HomeKit
New add-on and test module for Apple Homekit-enabled Router Certification Test Plan
MODULE: homekit DESCRIPTION: Apple HomeKit Secure Router Certification Test Plan NEW TEST CASES: 53
Notes
CDRouter
CDRouter’s wifi channel plan has been updated. Twelve new 5 GHz channels are now available: 68, 72, 76, 80, 84, 92, 96, 144, 169, 173, 177, and 181. These new channels are supported by CDRouter’s LAN clients and may also be used by CDRouter’s AP on the WAN.
Note that when CDRouter is in AP mode on the WAN the list of available channels is restricted by the frequency band, regulatory settings, and capabilities of the underlying hardware and drivers. If the selected channel is not available or cannot be used, CDRouter will generate a warning and abort the test run. [ch5110]
The logging in tests cdrouter_dos_20, cdrouter_dos_21, cdrouter_dos_31, cdrouter_dos_33 and cdrouter_dos_34 has been updated to resolve some misleading log messages. [ch4381]
Updated the cdrouter_mcast_70 test case to resolve a false positive test result. [ch4921]
CDRouter Security
- Updated the ET Open ruleset shipped with the CDRouter Security add-on to version 9477. [ch5176]
CDRouter USP
The Broadband Forum has changed the name of TR-469 to TP-469. All references to TR-469 within CDRouter have been updated to reflect this change. [ch5328]
In previous releases CDRouter’s USP controller used the
msg_type
field in the protobuf header to drive events. Changes in the USP 1.1 specification require a different approach. CDRouter now infers a message’s type from the decoded protobuf message instead of relying on themsg_type
field. [ch5398]
⦿ CDRouter 12.4 Release Notes
CDRouter 12.4 July 16, 2020
Notices
Important Installation Notes
If you are upgrading from CDRouter 11.x or earlier versions, you must meet the prerequisites listed in the CDRouter 12.0 Release Notes prior to upgrading to CDRouter 12.4. Please review that document and contact support@qacafe.com if you need any assistance.
Config Upgrades
CDRouter 12.4 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 12.4 testvars using the config upgrade utility.
New Features and Enhancements
CDRouter USP
Updates to the conformance test plan for USP agents
The usp_conformance test module has been updated to reflect the changes in version 1.0.2 of the Conformance Test Plan for User Services Platform Agents as defined in Broadband Forum TP-469 Issue 1 Corrigendum 2. [ch5495]
More information on how to use the CDRouter USP Add-On to perform self-testing certification can be found here.
Testvar Updates
Testvars Added to This Release
- None.
Testvars Modified or Removed in This Release
- None.
New Test Modules and Test Cases
CDRouter
New Apple HomeKit tests
TEST: homekit_TCSR015 MODULE: homekit DESCRIPTION: HomeKit Test TCSR015
TEST: homekit_TCSR027 MODULE: homekit DESCRIPTION: HomeKit Test TCSR027
TEST: homekit_TCSR028 MODULE: homekit DESCRIPTION: HomeKit Test TCSR028
Notes
CDRouter TR-069
The
acs.cdroutertest.com-ca.pem
file has been updated to remove an expired intermediate CA. The default ACS and ACS download server certificate chains now contain only one intermediate CA. [ch5573]The
acs.qacafe.com
certificate chain is now expired and has been removed [ch5621].An alternate SHA1 certificate chain for
acs.cdroutertest.com
andacs-download.cdroutertest.com
is now available on the support site. This may be needed for older legacy devices that do not support the current SHA384 certificate chain that is shipped with CDRouter. [ch5579]The tr143_http module does not require a LAN interface and can now be run in configurations that have only a WAN interface defined. [ch3053]
Tests od128_test_8.1 through od128_test_7 have been updated to check the
Device.DeviceInfo.SoftwareVersion
parameter at the end of the test to verify that the DUT is running the new firmware image. The tr69DownloadImageVersion testvar should be properly set to match the version of the new firmware. These tests have also been updated to optionally reinstall the original firmware on the DUT at the end of the test. The tr69DownloadImageVersion testvar must be set to the path of the original firmware image in order for this to occur. [ch4904]The tr143_http module has been updated to resolve an issue in PPPoE over IPv6 WAN configurations. [ch4452]
CDRouter Security
- Updated the ET Open ruleset shipped with the CDRouter Security add-on to version 9496. [ch5541]
CDRouter USP
The
wildcard.cdroutertest.com-ca.pem
file has been updated to remove an expired intermediate CA. The default USP controller server certificate chain now contain only one intermediate CA. [ch5573]The USP firmware download tests have been improved. This change impacts test cases usp_conformance_9_3 through usp_conformance_9_7 and usp_30. [ch5909]
CDRouter Performance
- The version of iPerf shipped with CDRouter has been updated to 3.8.1. [ch4926]
CDRouter SNMP
- The snmp_301, snmp_wan_301, ipv6_snmp_301, and ipv6_snmp_wan_301 test cases have been updated. A new step has been added to the test procedure. These tests now verify that a good community string can be walked before attempting to walk a bad community string. [ch5109]
CDRouter DOCSIS
- The snmp_docsis_301 and ipv6_snmp_docsis_301 test cases have been updated. A new step has been added to the test procedure. These tests now verify that a good community string can be walked before attempting to walk a bad community string. [ch5109]
Apple HomeKit
- Various tests in the homekit module have been improved. [ch5567]
⦿ CDRouter 12.5 Release Notes
CDRouter 12.5 August 13, 2020
Notices
Important Installation Notes
If you are upgrading from CDRouter 11.x or earlier versions, you must meet the prerequisites listed in the CDRouter 12.0 Release Notes prior to upgrading to CDRouter 12.5. Please review that document and contact support@qacafe.com if you need any assistance.
Config Upgrades
CDRouter 12.5 includes many new features and configuration testvars. Old config files can be automatically upgraded to include all new CDRouter 12.5 testvars using the config upgrade utility.
Python 2 Deprecation
Support for Python 2 within cdrouter.py has been deprecated and will be removed in a future release of CDRouter. All scripts using cdrouter.py should be updated to use Python 3, which is fully supported.
New Features and Enhancements
CDRouter TR-069
New HTTP 301 redirect test cases
Four new test cases for verifying that the DUT properly follows HTTP 301 redirects have been added to the tr69 test module. These new tests are clones of the existing HTTP 302 and 307 redirect tests. [ch5915]
Note that while HTTP 301 redirects indicate that the resource has been moved permanently, Section 3.4.2 of TR-069 Amendment 6 states that all redirects, apply only for remainder of the current session:
If the CPE is redirected, the redirected URL MUST apply only to the remainder of the current Session or until a subsequent redirect occurs later in the same Session. The redirected URL MUST NOT be saved by the CPE (i.e. as the value of Management-Server.URL, as defined in [27], [34] , and [35]) for use in any subsequent Session or any subsequent retries of the Session. This requirement MUST hold even if the 301 (Moved Permanently) HTTP status code is used for redirection.
Testvar Updates
Testvars added to this release:
- None.
Testvars modified or removed in this release:
- The testvar wirelessCountryCode has been obsoleted. Please see this Knowledge Base article for more information on changing the WiFi regulatory domain settings on a CDRouter system. [ch5173]
New Test Modules and Test Cases
CDRouter TR-069
New HTTP 301 redirect test cases for TR-069
TEST: tr69_41 MODULE: tr69 DESCRIPTION: Verify CPE follows 301 redirects to new ACS server
TEST: tr69_42 MODULE: tr69 DESCRIPTION: Verify CPE follows multiple 301 redirects to ACS server
TEST: tr69_43 MODULE: tr69 DESCRIPTION: Verify CPE follows 301 redirects to new ACS server with a specified port number
TEST: tr69_44 MODULE: tr69 DESCRIPTION: Verify CWMP session can be redirected from HTTP to HTTPS using 301
Notes
CDRouter TR-069
The tr69_wireless module and the related WiFi tests in the ir181 module have been updated to support configurations that include multiple LAN interfaces. [ch4017]
Fixed a bad log message in the tr69_37 test case. [ch5947]
CDRouter USP
- Fixed a typo in the default value of the testvar uspObject2. [ch6413]
CDRouter Security
- Updated the ET Open ruleset shipped with the CDRouter Security add-on to version 9524. [ch5979]
⦿ CDRouter 12.6 Release Notes
CDRouter 12.6 September 10, 2020
Notices
Important installation notes: If you are upgrading from CDRouter 11.x or earlier versions, all prerequisites listed in the CDRouter 12.0 Release Notes must be met prior to upgrading to CDRouter 12.6. Please contact support@qacafe.com for assistance if needed.
Config upgrades: CDRouter 12.6 includes many new features and configuration testvars. Config files may be easily upgraded to include all new CDRouter 12.6 testvars using the config upgrade utility.
Python 2 deprecation: Support for Python 2 within cdrouter.py has been deprecated and will be removed in a future release of CDRouter. All scripts using cdrouter.py should be updated to use Python 3, which is fully supported.
Ruby gem deprecation: The CDRouter Ruby gem wrapper for CDRouter’s web API has been deprecated and is no longer supported. All scripts using this gem should be updated to use Python 3 and the cdrouter.py package instead.
New Features
DOCSIS: The DOCSIS DHCP and DHCPv6 servers now support the configuration of custom options using the following new testvars: [ch6147]
Multiport: Seven new guest network tests have been added. These tests are designed to verify that two clients connected to the same guest network are fully isolated and cannot communicate with each other. [ch5254]
New Test Cases Module Description guest_40 guest Verify ARP traffic is not leaked on the guest network guest_42 guest Verify unicast traffic is not leaked on the guest network guest_44 guest Verify broadcast traffic is not leaked on the guest network guest_46 guest Verify multicast traffic is not leaked on the guest network ipv6_guest_40 guest-v6 Verify IPv6 neighbor discovery traffic is not leaked on the guest network ipv6_guest_42 guest-v6 Verify IPv6 unicast traffic is not leaked on the guest network ipvs_guest_46 guest-v6 Verify IPv6 multicast traffic is not leaked on the guest network
Change Log
Apple HomeKit: Logging in all port scans has been quieted to reduce the size of logs files. A summary is printed at the end of every port scan indicating which ports were open, closed, or stealth. [ch6345]
BBF.069: Resolved a potential fatal error in the 5_110_BPC test case. [ch6478]
CDRouter: Added additional checks to a prevent a fatal error when running the scaling tests in certain configurations. [ch5831]
Security: The ET Open ruleset shipped with the CDRouter Security add-on has been updated to version 9545. [ch6362]
TR-069: The
tr69_wireless_50
test case now verifies all 20 MHz WiFi channels supported by the DUT. [ch4178]USP: The USP notification timeout is now configurable and is set to the same value as the USP message timeout using the testvar uspMessageTimeout. [ch6223]
Web API: A new
jenkins.py
script has been added to the/examples
subdirectory of the cdrouter.py project. This script replicates the functionality that had been provided by the now deprecated CDRouter Ruby gem. Please see the updated “Using CDRouter with Jenkins” article in our Knowledge Base for an explanation of this new python script. [ch6428]
⦿ CDRouter 12.7 Release Notes
CDRouter 12.7 October 8, 2020
Notices
Important installation notes: If you are upgrading from CDRouter 11.x or earlier versions, all prerequisites listed in the CDRouter 12.0 Release Notes must be met prior to upgrading to CDRouter 12.7. Please contact support@qacafe.com for assistance if needed.
Config upgrades: CDRouter 12.7 includes many new features and configuration testvars. Config files may be easily upgraded to include all new CDRouter 12.7 testvars using the config upgrade utility.
Python 2 deprecation: Support for Python 2 within cdrouter.py has been deprecated and will be removed in a future release of CDRouter. All scripts using cdrouter.py should be updated to use Python 3, which is fully supported.
Ruby gem deprecation: The CDRouter Ruby gem wrapper for CDRouter’s web API has been deprecated and is no longer supported. All scripts using this gem should be updated to use Python 3 and the cdrouter.py package instead.
New Features
CDRouter: AP mode in the 5 GHz band is now supported on ath9k based wireless cards. [ch7281]
Multiport: The testvar dutMgmtPort now accepts a list of ports which are verified in the guest_30 and ipv6_guest_30 test cases. [ch6426]
Change Log
CDRouter: The list of add-ons in CDRouter’s default configuration file have been re-organized to improve navigation. [ch7138]
Security: The ET Open ruleset shipped with the CDRouter Security add-on has been updated to version 9562. [ch6673]
TR-069: Resolved a bug associated with the testvar acsCreatePortMapOnIGD when used with devices supporting the
Device:2
root data model. [ch6186]TR-069: Cleaned up an XML encoding bug in the
SetParameterValues
CWMP data model verification tests. Specifically, CWMP parameters with complex types ofIPv4Address
,IPv6Address
,IPv4Prefix
,IPv6Prefix
, andAlias
were transmitted with the complex type rather than the base type. [ch7220]
⦿ CDRouter 12.8 Release Notes
CDRouter 12.8 November 5, 2020
Notices
Important installation notes: If you are upgrading from CDRouter 11.x or earlier versions, all prerequisites listed in the CDRouter 12.0 Release Notes must be met prior to upgrading to CDRouter 12.8. Please contact support@qacafe.com for assistance if needed.
Config upgrades: CDRouter 12.8 includes many new features and configuration testvars. Config files may be easily upgraded to include all new CDRouter 12.8 testvars using the config upgrade utility.
Python 2 deprecation: Support for Python 2 within cdrouter.py has been deprecated and will be removed in a future release of CDRouter. All scripts using cdrouter.py should be updated to use Python 3, which is fully supported.
Ruby gem deprecation: The CDRouter Ruby gem wrapper for CDRouter’s web API has been deprecated and is no longer supported. All scripts using this gem should be updated to use Python 3 and the cdrouter.py package instead.
New Features
Performance: Two new test modules have been added to this release:
Test Module Address Family Number of Tests Description fixed-rate-perf IPv4 192 IPv4 fixed rate performance tests fixed-rate-perf-v6 IPv6 192 IPv6 fixed rate performance tests These test modules focus on fixed rate performance testing. Fixed rate performance tests set the transmit bandwidth (or rate) and the threshold to hard-coded values that are defined by the test case. This is in contrast to CDRouter’s existing configured rate performance tests, which instead rely on the transmit bandwidth/rate and thresholds that are defined by the user in the config file.
Fixed rate performance tests require no additional configuration, are easy to interpret, are interface agnostic, and allow multiple rates to be verified in a single test run. Please see the Performance User Guide for more information. [ch6357]
USP: The usp_conformance test module has been updated to reflect the changes in version 1.0.3 of the Conformance Test Plan for User Services Platform Agents as defined in Broadband Forum TP-469 Issue 1 Corrigendum 3.
More information on how to use the CDRouter USP Add-On to perform self-testing certification can be found here.
Change Log
CDRouter: In previous releases the cdrouter_dhcp_server_700 test case was not being properly skipped when the testvar dhcpInform was set to a value of no. This bug has been fixed. [ch7051]
CDRouter: Resolved a routing issue in the cdrouter_dmz_1 test case. [ch7396]
DOCSIS: The primary DHCP and DHCPv6 servers on the WAN will now ignore DHCP/DHCPv6 messages from DOCSIS clients if DOCSIS is disabled. [ch6440]
Security: The ET Open ruleset shipped with the CDRouter Security add-on has been updated to version 9583. [ch7415]
TR-069: The tr69_27 test case has been updated to support more specific vendor defined CWMP fault codes in the range 9800-9899. [ch6188]
TR-069: Resolved an issue with the cwmp_scenario_1 test case when calling the
Reboot
RPC from within a CWMP scenario. Prior to this release, theReboot
RPC would be issued with a CommandKey greater than 32 bytes which would generate a CWMP fault in some implementations. This release ensures that the CommandKey forReboot
RPC calls is always less than 32 bytes. [ch7620]USP: Added a guard to prevent a possible fatal error in the usp_conformance_3_12 test case.[ch7553]
USP: The following USP conformance tests require DHCP and will now be automatically skipped if DHCP is not enabled. [ch7699]
- usp_conformance_8_1
- usp_conformance_8_2
- usp_conformance_8_3
- usp_conformance_8_4
⦿ CDRouter 12.9 Release Notes
CDRouter 12.9 December 3, 2020
This release adds a number of IPv6 test cases to the Apple HomeKit add-on and addresses a few smaller issues, particularly in the TR-069 add-on.
New Features
- HomeKit: IPv6 support has been added to the Apple HomeKit add-on! Please see the homekit-v6 test module for more information. [ch7274]
Change Log
CDRouter: Support for infinite DHCP / DHCPv6 lease times on the WAN has been removed. [ch7652]
CDRouter: A number of dead links to older release notes in the config file template and testvar documentation have been fixed. [ch7846]
DOCSIS: An invalid reference to the DOCSIS 3.0 MULPI specification has been removed from the docsis_firewall_1, docsis_firewall_2, ipv6_docsis_firewall_1, and ipv6_docsis_firewall_2 test cases. [ch7850]
NTA1000: A new system update is available for NTA1000v7 systems running CentOS 8. This provides a new custom kernel and wireless firmware, as well as a few other enhancements. These updates can be applied by following the instructions here. [ch7562] [ch7567]
Security: The ET Open ruleset shipped with the CDRouter Security add-on has been updated to version 9604. [ch7739]
TR-069: The Broadband Forum has changed the name of the IR-181 test specification to TP-181. For consistency with the the Broadband Forum, the name of CDRouter’s ir181 module and all included tests have been updated to reference TP-181 instead of IR-181. Aliases for the original module and test names have been added to ensure that all existing test packages will continue to run without interruption. [ch6101]
TR-069: Resolved a fatal error associated with DST conversions in the ir181_test_5.1.2 and tr69_410 test cases. [ch7721]
USP: The maximum amount of time CDRouter will wait, in seconds, for a device to fully reboot when triggered during USP tests is now configurable using the new testvar uspRebootTimeout. Previously all USP related reboot timeouts were hard coded to 120 seconds. [ch7219]
Notices
Important installation notes: If you are upgrading from CDRouter 11.x or earlier versions, all prerequisites listed in the CDRouter 12.0 Release Notes must be met prior to upgrading to CDRouter 12.9. Please contact support@qacafe.com for assistance if needed.
Config upgrades: CDRouter 12.9 includes many new features and configuration testvars. Config files may be easily upgraded to include all new CDRouter 12.9 testvars using the config upgrade utility.
Python 2 deprecation: Support for Python 2 within cdrouter.py has been deprecated and will be removed in a future release of CDRouter. All scripts using cdrouter.py should be updated to use Python 3, which is fully supported.
Ruby gem deprecation: The CDRouter Ruby gem wrapper for CDRouter’s web API has been deprecated and is no longer supported. All scripts using this gem should be updated to use Python 3 and the cdrouter.py package instead.
⦿ CDRouter 12.10 Release Notes
CDRouter 12.10 January 14, 2021
New Features
CDRouter: Four new RDK specific test lists have been added to CDRouter! These test lists make it possible to quickly and easily replicate the quarterly RDK-B release validation testing performed by the RDK group using CDRouter. For more information on RDK-B testing with CDRouter, please contact support@qacafe.com. [ch7835]
TR-069: Two new tests, 5.1.11 and 5.1.12, have been added to the Broadband Forum TP-181 module. These tests verify vendor specific parameter functionality, and are the only tests that were omitted from the original implementation of this test plan within CDRouter. [ch8361]
These tests operate on the list of vendor defined parameters specified by the new testvar cwmpVendorSpecificParams. Here is a simple example:
testvar cwmpVendorSpecificParams { { Device.X_VENDOR_SyslogCfg.ServerIPAddress string { 3.3.3.3 3.3.3.4 } } }
TR-069 & USP: CDRouter now supports the Broadband Forum’s recently published
Device:2.14
data model! This update adds 12 CWMP tests and 8 USP tests for the newAccessControl
andIPLayerCapacity
profiles. In addition theVoiceService:2
data model and associated profile tests have been updated. [ch7834]
Change Log
CDRouter: The DNS failover tests dns_45 and dns_46 (and all variants) have been re-factored for compatibility with current DNS proxy implementations. [ch7237]
Most modern DNS proxies maintain a list of DNS servers and may use any or all of them at any point in time to resolve queries. What the DUT considers its primary DNS server may or may not be what is listed as the primary DNS server in CDRouter’s config file. Furthermore, the DUT’s primary DNS server may change over time as tests are run.
These tests now attempt to detect the primary DNS server in use by the DUT before the failover behavior of each error code is verified. The new test procedure is:
- For each error code that is tested, send three, valid DNS queries from a LAN client.
- Determine which WAN DNS server(s) receive these queries.
- If the same WAN DNS server receives all three queries, mark this server logically within CDRouter as the DUT’s primary DNS server.
- If the queries are received by different WAN DNS servers, abort, since there is no way for CDRouter to predict the DUT’s behavior regarding DNS.
- For a specific error code, set the auto-detected primary DNS server to return the error code and verify that the DUT does or does not send another query to one of the other backup WAN DNS servers.
- Repeat the above steps for all DNS error codes.
CDRouter: Fixed a CDRouter startup error when running on systems that have been upgraded to CentOS 8.3. [ch8636]
CDRouter: Fixed a possible fatal error in the cdrouter_dyndns_1 test case. [ch8728]
Performance: The multi-client performance tests and logging have been re-factored to resolve a potential fatal error in certain configurations. [ch6912]
Security: The ET Open ruleset shipped with the CDRouter Security add-on has been updated to version 9623. [ch8245]
TR-069: Test procedures and test metrics have been added to all tests in the tp181 test module. [ch7295]
Notices
Important installation notes: If you are upgrading from CDRouter 11.x or earlier versions, all prerequisites listed in the CDRouter 12.0 Release Notes must be met prior to upgrading to CDRouter 12.10. Please contact support@qacafe.com for assistance if needed.
Config upgrades: CDRouter 12.10 includes many new features and configuration testvars. Config files may be easily upgraded to include all new CDRouter 12.10 testvars using the config upgrade utility.
Python 2 deprecation: Support for Python 2 within cdrouter.py has been deprecated and will be removed in a future release of CDRouter. All scripts using cdrouter.py should be updated to use Python 3, which is fully supported.
⦿ CDRouter 12.11 Release Notes
CDRouter 12.11 February 11, 2021
New Features
BBF.069: All BBF.069 tests are now distributed in plaintext. [ch8667]
CDRouter: CDRouter now supports wireless channel hopping which is a feature that enables frequency agility through dynamic channel selection within 802.11 access points.
Channel hopping allows an access point to automatically reconfigure itself and hop to a different wireless channel if:
- There is excessive interference, congestion, or latency on the current channel
- Radar is detected (this is required for DFS regulatory compliance)
Support for channel hopping is enabled by default and requires no additional configuration. If all of CDRouter’s wireless LAN clients are disassociated by the DUT during a test run the primary client will now automatically rescan and attempt to locate the DUT by SSID. If the DUT has changed channels CDRouter’s LAN clients will follow and attempt to re-associate on the new channel.
Rescanning occurs between test cases only. As a result, a channel hopping event may produce a failure within the test case in which it occurred. The lanChannel and lanBSSID testvars can be used to restrict the movement of CDRouter’s wireless LAN clients if needed. [ch4566]
TR-069: CDRouter’s XMPP configuration has been enhanced. When XMPP is enabled, the ACS can now configure the DUT to connect to the XMPP Server using a static “ServerTable” entry, or through a standard DNS request. These options augment the preferred default method of discovering the XMPP server through a DNS-SRV record request. See the XMPP Connection Requests section of the TR-069 User Guide for configuration details. [ch8069]
Change Log
CDRouter: The testvar wirelessForceReconnect has been obsoleted and removed from the default config file. CDRouter’s wireless LAN clients will now only re-associate (if needed) between test cases, not within them. [ch4566]
CDRouter: SCTP (IP protocol type 132) has been removed from the default list of IP protocol types that is verified in the
cdrouter_dmz_200
test case. [ch8121]CDRouter: The
dns_500
test case and all variants have been updated to support query resolution over either IPv4 or IPv6 on the WAN in dual-stack configurations. [ch9050]IPv6: The
jumbo-v6
module is now automatically skipped if IPv6 is not enabled. [ch9046]Security: The ET Open ruleset shipped with the CDRouter Security add-on has been updated to version 9652. [ch8801]
TR-069: Fixed a
550 file does not exist
error in the tp181_test_5.2.3 test case. [ch8061]TR-069: Resolved a potential fatal error in the
tp181_test_5.2.6
test case. [ch8397]
Notices
Important installation notes: If you are upgrading from CDRouter 11.x or earlier versions, all prerequisites listed in the CDRouter 12.0 Release Notes must be met prior to upgrading to CDRouter 12.11. Please contact support@qacafe.com for assistance if needed.
Config upgrades: CDRouter 12.11 includes many new features and configuration testvars. Config files may be easily upgraded to include all new CDRouter 12.11 testvars using the config upgrade utility.
Python 2 deprecation: Support for Python 2 within cdrouter.py has been deprecated and will be removed in a future release of CDRouter. All scripts using cdrouter.py should be updated to use Python 3, which is fully supported.