S8710A Device Benchmarking Toolset

Introduction

5G is moving fast. Accelerating 5G deployments globally are having a ripple effect throughout the mobile ecosystem. 5G also represents an exponential increase in technical complexity. Key challenges come from 5G new radio (NR), massive multiple input multiple output (MIMO), millimeter-wave (mmWave) frequencies, and over-the-air (OTA) test methods.

Device and chipset makers and operators must effectively overcome these challenges to reach commercialization faster than the competition. Understanding 5G device quality trends and position against competitors is vital. Many device manufacturers and operators do not have a reliable and consistent process to compare 5G devices and identify instances of software regression. This makes it difficult to evaluate how your device quality is developing against competitors and your previous builds. A standardized method to acquire and compare the benchmarking performance results may be missing, which makes it difficult to compare results reliably and to understand how quality is developing or how your product stands against competitors. Also, software regression testing is complicated without proper tools.

The S8710A Device Benchmarking Toolset is part of Keysight’s 5G Network Emulation Solution portfolio that addresses the entire device development workflow – from early design, to acceptance and manufacturing. The S8710A Device Benchmarking Toolset will accelerate performance validation and allow you to reach first-to-market status with high-quality devices.

What is S8710A Device Benchmarking Toolset?

Keysight’s S8710A Device Benchmarking Toolset is an end-to-end test solution that enables device makers and mobile operators to automate testing and reporting across different device builds and models. It delivers an integrated lab-based test solution that cost-effectively enables users to benchmark devices, troubleshoot, resolve issues and, ultimately, enhance product quality. Each device is tested separately, after which a benchmarking report including ranking and scoring of devices is created. The toolset offers pre-defined test cases and customizable test scripts to meet specific customer requirements.

With the S8710A Device Benchmarking Toolset, you will gain objective insight into comparable 5G product features and selected KPIs. The toolset comes with test automation capabilities that enable high-volume testing and repeatability – directly improving product quality, achieving consistency in testing, and minimizing the risk of human error.

This document describes the components and functionality of the S8710A Device Benchmarking Toolset.

Who benefits from using S8710A Device Benchmarking Toolset?

• MNOs to verify that devices comply with their device test requirements

• Device manufacturers to ensure their devices are accepted by the major mobile network operators before launch to the market

• Chipset manufacturers to ensure that their chipsets perform according to the major mobile network operators’ specifications

• Test houses and test labs that run tests to independently verify that devices are compliant with the MNO performance requirements

S8710A Device Benchmarking Toolset Features

The S8710A Device Benchmarking Toolset enables standardized lab-based end[1]to-end automation of 5G device benchmarking with a predefined set of test cases, customizable scripts, and extensive reports. The toolset enables automated regression testing to benchmark daily software builds, hardware builds, and competitor devices, and test automation capabilities to reproduce test campaigns on a daily basis.

The solution offers:

• Fully automated end-to-end test environment for benchmarking devices produced by any manufacturer or devices built using modems from any chipset maker

• Automated benchmark report generation for the device under test

• User-definable ranking of individual KPIs to determine the device’s overall score

• Comparison reports showing the rank, scores and KPIs from a range of devices

• Pre-defined test cases to obtain KPI measurements

• High-volume testing and repeatability