Disclosed is an anechoic test chamber that includes six antenna probes, replacing a single probe with a small array, and using the array to form a beam to provide a similar signal to the probe signal, and reducing the transmission loss. At least five of the probes are aligned in the anechoic chamber such that the probes are aligned in azimuth along four columns separated from a center point by +/−5 degrees and +/−15 degrees. The probes are further aligned in elevation along three rows at the center point and separated from the center point by +/−5 degrees, wherein the alignments in azimuth and elevation are within 3 degrees measured spherically of the alignments stated. Also disclosed is a planar array that replaces probe antennas and forms beams to provide coverage to the chamber, and utilizing probe arrays to emulate base station signals to evaluate UE performance.
A testing method is provided for diagnosing faults in a multimedia over coax alliance (MoCA) local area network (LAN) including a WiFi segment. The method including, responsive to selection of a test sequence that includes testing of the WiFi segment, causing display of instructional images that depict how an operator couples the test hardware to a wireless component, invoking the test hardware to perform a test by automatically selecting, in dependence upon a problem generically identified by a user, a test and invoking the test, and automatically evaluating results returned by the test, without user interpretation of the results returned, to determine at least one of (i) whether to report a recommendation to replace/repair an identified component, and (ii) whether to (a) repeat the causing display of instructional images, (b) invoke the test hardware to perform an additional test and (c) automatically evaluate results returned by the additional test.
The disclosed technology teaches testing voice connection routing over 911 circuits as if voice calls originated from an E911 device in coverage areas of cell tower locations, without requiring a physical presence of the E911 device in each coverage area. A remote test agent audio bridge and tester originates a first call to a test user with a first phone number, creates a media bridge, emulates an E911-compliant mobile device to originate a second call to a 911 operator, relays audio over the media bridge as a verbal exchange between the first and the second calls, and logs an evaluation of the verbal exchange. The emulation includes spoofing a call origination from an origination location being tested, the spoofed origination location being within coverage of an originating cell.
H04W 24/06 - Réalisation de tests en trafic simulé
H04M 3/22 - Dispositions de supervision, de contrôle ou de test
H04M 3/42 - Systèmes fournissant des fonctions ou des services particuliers aux abonnés
H04M 3/51 - Dispositions centralisées de réponse aux appels demandant l'intervention d'un opérateur
H04W 64/00 - Localisation d'utilisateurs ou de terminaux pour la gestion du réseau, p.ex. gestion de la mobilité
H04W 40/20 - Sélection d'itinéraire ou de voie de communication, p.ex. routage basé sur l'énergie disponible ou le chemin le plus court sur la base de la position ou de la localisation géographique
4.
TRANSPORT AUDIO QUALITY TESTING REMOTE FROM TESTING SITE
The technology includes a method, computer medium, and system for testing transport audio quality irrespective of tester location. The technology involves a virtual test agent (VTA) selecting a Mobility Management Engine (MME) for routing a second call through a Serving Gateway (SGW) assigned by the MME for audio communication with a tester terminus over a transport segment under test, so a tester can evaluate audio quality over the transport segment under test. The VTA makes a first call to a tester appliance, and makes a second call, over the transport segment under test, to the tester terminus by signaling the MME. The VTA bridges the first and second calls by relaying audio during a test of subjective audio quality, whereby the bridging assures that the relayed audio in the second call continues to be relayed over the transport segment under test and not re-routed by core network components.
H04M 3/22 - Dispositions de supervision, de contrôle ou de test
G10L 25/60 - Techniques d'analyses de la parole ou de la voix qui ne se limitent pas à un seul des groupes spécialement adaptées pour un usage particulier pour comparaison ou différentiation pour mesurer la qualité des signaux de voix
5.
INTER-CORE TRANSPORT AUDIO QUALITY TESTING REMOTE FROM TESTING SITE
The technology includes a method, computer medium, and system for testing audio quality of a transport segment between two core networks. A first virtual test agent (VTA) selects a Mobility Management Engine (MME) corresponding to an eNodeB served by a first core network for routing a second call, through a Serving Gateway (SGW) assigned by the MME for audio communication with a tester terminus. The second call is made from the first VTA to a second VTA at a second core network over a transport-segment-under-test that connects the first and second core networks, So that a tester can evaluate audio quality over the transport-segment-under-test. The first VTA makes a first call to a tester appliance, makes a second call, over the transport-segment-under-test, to the second VTA implementing audio evaluation, by signaling the MME, and bridges the first and second calls by relaying audio during a test of subjective audio quality.
The technology includes a method, computer medium, and system for remote testing over-the-air (OTA) audio quality using a test platform positioned at core network, the test platform comprising first and second cellular handsets and bridging logic that interconnects, controls, and bridges the first and second cellular handsets. The method includes triggering the bridging logic. The bridging logic initiates a first call over the first cellular handset to a tester, and initiates a second call over the second cellular handset to a destination, wherein the second call is initiated over-the-air. The bridging logic and the first and second cellular handsets are positioned in a location that causes routing by a cellular network of the first call over a segment under test. The bridging logic bridging audio between the first and the second calls, including relaying audio. The tester determines that the second call was established based on the relayed audio.
A method of a test controller controlling a test platform to run test applications is provided, wherein an authenticated connection exists between the test platform and a phone home service through which secure tunnel information for the test controller has been obtained. The method including the test controller (i) transmitting an instruction to the test platform over an initiated first secure tunnel between the test platform and the test controller, and (ii) controlling the test platform to perform a requested test using the test application using an established second secure tunnel between (a) the test platform and (b) the test controller.
G06F 9/455 - Dispositions pour exécuter des programmes spécifiques Émulation; Interprétation; Simulation de logiciel, p.ex. virtualisation ou émulation des moteurs d’exécution d’applications ou de systèmes d’exploitation
The disclosed technology teaches systems and methods for high fidelity emulation of a Wi-Fi environment for testing with three or more transmitters set to differing output signal strengths. The disclosed method includes using a PCAP file of captured packets from multiple stations with respective source addresses, RF bands, and channels within bands. The captured packets record metadata containing, at least, signal strength and time stamps. The method further includes analyzing the PCAP file to determine pairs of source addresses and channels, evaluating the pairs for signal strength, and allocating the pairs to three or more transmitters based on grouping by at least the channels and the evaluated signal strengths, and using the time stamps on the captured packets, replaying with synchronization over the transmitters at the set output signal strengths. The PCAP file can include packets from multiple protocols, and time-varying pairs with varying signal strength overtime.
H04L 43/106 - Surveillance active, p.ex. battement de cœur, utilitaire Ping ou trace-route en utilisant des informations liées au temps dans des paquets, p.ex. en ajoutant des horodatages
H04L 47/283 - Commande de flux; Commande de la congestion par rapport à des considérations temporelles en réponse à des retards de traitement, p.ex. causés par une gigue ou un temps d'aller-retour [RTT]
The technology disclosed teaches a method of testing performance of a device-under-test during cloud gaming over a live cellular network. The method comprises instrumenting the device-under-test with at least one instrument app that interacts with a browser on the device-under-test and captures performance metrics from gaming network traffic. The browser and the instrument app can be invoked using a test controller separated from the device-under-test, causing the browser to connect to a gaming simulation over the live cellular network. A segmented gaming image stream is transmitted to the browser, with segmented playing at varying bit rates and image complexity while the instrument app causes the browser to transmit artificial gameplay events to a gaming simulation test server. Performance metrics from the gaming network traffic are captured, as well as gaming images rendered by the browser during the segmented gaming image stream.
H04N 21/647 - Signalisation de contrôle entre des éléments du réseau et serveur ou clients; Procédés réseau pour la distribution vidéo entre serveur et clients, p.ex. contrôle de la qualité du flux vidéo en éliminant des paquets, protection du contenu contre une modification non autorisée dans le réseau ou surveillance de la charge du résea
H04N 21/234 - Traitement de flux vidéo élémentaires, p.ex. raccordement de flux vidéo ou transformation de graphes de scènes MPEG-4
10.
ONE WAY LATENCY ESTIMATION WITHOUT CLOCK SYNCHRONIZATION
A method for determining whether clock skew may exist between a sending node and a remote node during two-way network testing (using protocols such as TWAMP), and a computational method for revising measured latency data to compensate for clock differences.
A method for determining whether clock skew may exist between a sending node and a remote node during two-way network testing (using protocols such as TWAMP), and a computational method for revising measured latency data to compensate for clock differences.
The method for compensating for clock skew comprises monitoring the network latency between two nodes during a defined time interval. When clock skew is detected, a flag is set, and, after the time interval has completed, clock skew S is estimated using the minimum latency values for the interval. The recorded latency values for the interval are then revised using the calculated clock skew S, and one-way latency results reported.
A method for determining whether clock skew may exist between a sending node and a remote node during two-way network testing (using protocols such as TWAMP), and a computational method for revising measured latency data to compensate for clock differences.
The method for compensating for clock skew comprises monitoring the network latency between two nodes during a defined time interval. When clock skew is detected, a flag is set, and, after the time interval has completed, clock skew S is estimated using the minimum latency values for the interval. The recorded latency values for the interval are then revised using the calculated clock skew S, and one-way latency results reported.
The improved accuracy can be achieved with only on a few computations after the data have been collected. This a posteriori approach saves on computational resources, which can be at a premium for network testing equipment.
H04L 43/106 - Surveillance active, p.ex. battement de cœur, utilitaire Ping ou trace-route en utilisant des informations liées au temps dans des paquets, p.ex. en ajoutant des horodatages
Path-loss measurements are determined for a test client device moving along a path in a field test environment in which field Wi-Fi mesh network nodes are distributed. The path-loss measurements are reproduced in a field-to-lab test environment that includes a test client device disposed in an electromagnetically-isolated chamber and field test Wi-Fi mesh network nodes disposed in respective electromagnetically-isolated chambers. The test client device and the field test Wi-Fi mesh network nodes are in wired or wireless communication with each other via signal lines. A programmable attenuator is electrically coupled to each signal line. The attenuation of each programmable attenuator is varied to reproduce the path-loss measurements from the field test environment. Path-loss measurements at the location of each field Wi-Fi mesh network node are also reproduced with the programmable attenuators to reproduce the field Wi-Fi mesh network node configuration.
The disclosed technology teaches creating a real time visualization and analysis of Wi-Fi performance and behavior of a DUT in wireless communication with a selected Wi-Fi test device. Also included is performing a radiated test of the DUT using transceiver signals from multiple test antennas impinging on antennas of the DUT, capturing packet details of traffic between the DUT and the selected Wi-Fi test device using a sniffer that is RF coupled to antennas of the selected Wi-Fi test device, and generating a time series summary stream in real time from the packet details captured by the sniffer, including summaries of both performance and behavior metrics. The performance metrics summarize throughput and other measured characteristics of a received signal and the behavior metrics capture transmitter settings that the DUT and test devices choose. Also included is generating scrolling visualizations of selected metrics from the stream as the radiated test proceeds.
H04L 43/045 - Traitement des données de surveillance capturées, p.ex. pour la génération de fichiers journaux pour la visualisation graphique des données de surveillance
H04L 43/08 - Surveillance ou test en fonction de métriques spécifiques, p.ex. la qualité du service [QoS], la consommation d’énergie ou les paramètres environnementaux
The frame sequence table (FST) architecture disclosed here partitions an FST stored in the Block RAM on an FPGA into at least two tables for emulating frame sequences for testing network equipment by providing more accurate emulations of network environments. In some implementations, one FST (the primary FST) provides frame listings for high data rate streams, while the other FST provides low data rate streams (the “slow” FST, or SFST). Data compression techniques may be used for the primary FST, allowing emulation of high frame rates using multiple repetitions of frames, while the separation of low frequency streams into the SFST (along with residuals from the primary FST), allows them to be represented accurately when mixed into the final data stream in the output port. A “ping-pong” state machine implemented in firmware governs the selection of data streams from the primary FST and SFST into the output data flow.
H04L 43/08 - Surveillance ou test en fonction de métriques spécifiques, p.ex. la qualité du service [QoS], la consommation d’énergie ou les paramètres environnementaux
H04L 47/10 - Commande de flux; Commande de la congestion
14.
Resilient coordination, command, and control of widely distributed test agents
Disclosed is using service-based controllers to manage test agents and performance of multi-agent tests running on a network, a connection-interrupted agent losing connection to a first controller, calling home after the loss, and being connected to a second controller which, after being connected to the agent, accesses a list of active tests which should be running, directing the agent to stop running tests that are not on the list and receiving from the agent a state report on running tests on the list. Additionally, instantiating and setting states of fresh primary and peer coordination FSMs using the state report from the test agent, establishing coordination interactions with additional controllers of additional test agents that are participating with the connection-interrupted agent in the active tests, and the connection-interrupted agent continuing to conduct active tests and directing results to the second controller without need to tear down and restart the active tests.
H04L 67/141 - Configuration des sessions d'application
H04L 67/1001 - Protocoles dans lesquels une application est distribuée parmi les nœuds du réseau pour accéder à un serveur parmi une pluralité de serveurs répliqués
15.
Key performance indicators (KPI) for tracking and correcting problems for a network-under-test
The disclosed technology teaches testing a mesh network using new service application level KPIs that extend the TWAMP measurement architecture. A control-client receives and parses a configuration file to populate memory with IP addresses, ports, and test session parameters for disclosed KPIs used to originate two-way test sessions from a first network host; with control-servers and session-reflectors. The method extends the receiving, parsing and originating to dozens to thousands of control-clients, by sending to the control-clients configuration files to originate respective test sessions with control-servers in a mesh network using respective test session parameters; and while the test is running, sending an updated configuration file to at least one control-client that introduces a new control-server or replaces a control-server; and expanding the test to include the new or replacement control-server without stopping or restarting TW test sessions with other control-servers; and monitoring the running test sessions and receiving results.
H04L 69/16 - Implémentation ou adaptation du protocole Internet [IP], du protocole de contrôle de transmission [TCP] ou du protocole datagramme utilisateur [UDP]
At least three uses of the technology disclosed are immediately recognized. First, a video stream classifier can be trained that has multiple uses. Second, a trained video stream classifier can be applied to monitor a live network. It can be extended by the network provider to customer relations management or to controlling video bandwidth. Third, a trained video stream classifier can be used to infer bit rate switching of codecs used by video sources and content providers. Bit rate switching and resulting video quality scores can be used to balance network loads and to balance quality of experience for users, across video sources. Balancing based on bit rate switching and resulting video quality scores also can be used when resolving network contention.
H04N 21/647 - Signalisation de contrôle entre des éléments du réseau et serveur ou clients; Procédés réseau pour la distribution vidéo entre serveur et clients, p.ex. contrôle de la qualité du flux vidéo en éliminant des paquets, protection du contenu contre une modification non autorisée dans le réseau ou surveillance de la charge du résea
H04N 21/234 - Traitement de flux vidéo élémentaires, p.ex. raccordement de flux vidéo ou transformation de graphes de scènes MPEG-4
17.
Automatically locating resources using alternative locator expressions during heterogeneous component-based testing in a portable automation framework
The disclosed technology provides resource locators keyed to resource names with failover alternate resource locators keyed to resource positions on user interfaces in a test environment: providing a central repository for resource locators and storing a set of alternative locator expressions for a resource in the central repository. The set includes first resource locators keyed to resource names on UIs and respective second resource locators keyed to resource positions on UIs that can be evaluated when the resource name in the respective first resource locator is invalid. The method invokes a resource location navigator to locate a particular resource using a first resource locator keyed to a resource name on the user interface, automatically invoking the resource location navigator using the second resource locator keyed to the resource position after failure of locating the particular resource using the resource name, and accessing the particular resource using the second resource locator.
G06F 11/36 - Prévention d'erreurs en effectuant des tests ou par débogage de logiciel
G06F 11/20 - Détection ou correction d'erreur dans une donnée par redondance dans le matériel en utilisant un masquage actif du défaut, p.ex. en déconnectant les éléments défaillants ou en insérant des éléments de rechange
G06F 9/451 - Dispositions d’exécution pour interfaces utilisateur
G06F 11/32 - Surveillance du fonctionnement avec indication visuelle du fonctionnement de la machine
18.
Measuring and using dispersion for user mobility analytics to improve management of cellular systems
The disclosed technology teaches dispersion analysis of individual UE devices, measuring the span of cellular locations in a 5G network over which the bulk of a user's data, voice minutes and text messaging usage take place. Dispersion analysis also measures the span of cellular locations over which the bulk of a user's transactions and failed transactions take place, providing insights into camping behavior on specific cellular locations and hot spot formation. The technology disclosed includes new collection and filtering of location data to pinpoint cellular communication challenges encountered by users as well as system improvement and remediation opportunities. Additionally, this technology enables reporting of the detected behavior and related hot spots formation analysis with identifiers of UE mobile devices involved. The technology also applies to 3G 4G and future mobile networks and can be utilized for a group of UE devices selected for analysis, by device, geography, or affinity.
H04W 4/00 - Services spécialement adaptés aux réseaux de télécommunications sans fil; Leurs installations
H04W 24/10 - Planification des comptes-rendus de mesures
H04W 36/32 - La resélection étant déclenchée par des paramètres spécifiques par des données de localisation ou de mobilité, p.ex. des données de vitesse
H04W 48/18 - Sélection d'un réseau ou d'un service de télécommunications
H04W 84/04 - Réseaux à grande échelle; Réseaux fortement hiérarchisés
H04W 36/00 - Dispositions pour le transfert ou la resélection
19.
Diagnosing faults in a multimedia over coax alliance (MoCA) local area network (LAN) including a WiFi segment
A testing method is provided for diagnosing faults in a multimedia over coax alliance (MoCA) local area network (LAN) including a WiFi segment. The method including, responsive to selection of a test sequence that includes testing of the WiFi segment, causing display of instructional images that depict how an operator couples the test hardware to a wireless component, invoking the test hardware to perform a test by automatically selecting, in dependence upon a problem generically identified by a user, a test and invoking the test, and automatically evaluating results returned by the test, without user interpretation of the results returned, to determine at least one of (i) whether to report a recommendation to replace/repair an identified component, and (ii) whether to (a) repeat the causing display of instructional images, (b) invoke the test hardware to perform an additional test and (c) automatically evaluate results returned by the additional test.
The disclosed technology teaches techniques for generating a high quantity of internet traffic flows, such as in the form of data packets, to stress test network components by using range variable field modifiers. The techniques generate a large scale of flows at a relatively fast speed by using a process that may involve a finite state machine feedback loop and a multiple range variable field modifier process. Start and end range pointers for range entries of data packet modifiers are stored in memory and used with pointer and counter values, which are varied and updated in a relatively fast feedback loop. Data packet modifiers may be selected based on the pointer and counter values and are used to modify or generate data packets.
H04L 43/106 - Surveillance active, p.ex. battement de cœur, utilitaire Ping ou trace-route en utilisant des informations liées au temps dans des paquets, p.ex. en ajoutant des horodatages
21.
Hot swappable and externally accessible fan tray and enclosure configured to house the hot swappable and externally accessible fan tray
A fan tray for an enclosure containing devices to be cooled is provided. The fan tray includes a top cover having a top surface and a bottom surface facing opposite the top surface, wherein, when the fan tray is mated to the enclosure, (i) the top surface is exposed relative to outside the enclosure and (ii) the bottom surface is contained within the enclosure, a fan-receiving portion extending from the bottom surface of the top cover and configured to receive one or more fans, and one or more electrical connectors configured to provide electrical power to the one or more fans.
A method of a test controller controlling a test platform to run test applications is provided, wherein an authenticated connection exists between the test platform and a phone home service through which secure tunnel information for the test controller has been obtained. The method including the test controller (i) generating an instruction to load and prepare a test application, the instruction including a URL for a repository that stores the test application as a component executable on the test platform, (ii) transmitting the generated instruction to the test platform over an initiated first secure tunnel between the test platform and the test controller, and (iii) controlling the test platform to perform a requested test using the test application using an established second secure tunnel between (a) the test platform or the test application and (b) the test controller.
G06F 9/455 - Dispositions pour exécuter des programmes spécifiques Émulation; Interprétation; Simulation de logiciel, p.ex. virtualisation ou émulation des moteurs d’exécution d’applications ou de systèmes d’exploitation
Path-loss measurements are determined for a test client device moving along a path in a field test environment in which field Wi-Fi mesh network nodes are distributed. The path-loss measurements are reproduced in a field-to-lab test environment that includes a test client device disposed in an electromagnetically-isolated chamber and field test Wi-Fi mesh network nodes disposed in respective electromagnetically-isolated chambers. The test client device and the field test Wi-Fi mesh network nodes are in wired or wireless communication with each other via signal lines. A programmable attenuator is electrically coupled to each signal line. The attenuation of each programmable attenuator is varied to reproduce the path-loss measurements from the field test environment. Path-loss measurements at the location of each field Wi-Fi mesh network node are also reproduced with the programmable attenuators to reproduce the field Wi-Fi mesh network node configuration.
The disclosed technology takes into account mobility behavior and interactions with a serving cellular network of a UE mobile device, when determining network interaction parameters for the UE, including providing an identifier of the UE to a NWDAF component that subscribes to receive notices that report changed or changing events, including a change in connectivity to any cell for any UE and any service usage on the cell and performs a dispersion analysis by analyzing the incoming notices to determine multiple dispersion indices as the UE mobile device changes its selection of a base station or a cell or a slice. Also included are network elements receiving the dispersion analysis for the UE mobile device and performing a policy update and/or a radio access network (RAN) decision for the UE mobile device based on at least the dispersion analysis. The technology also applies to 3G, 4G and future mobile networks.
The technology disclosed relates to a method for storing and time-correlating real-time and queryable test results of a test of a device under test (DUT). The method includes initiating the test applied to the DUT to collect real-time data from a multitude of data streams for multiple aspects of the DUT, the collected data including counters and fact-type values, the collected data having imperfectly synchronized time bases and the collected data being collected from different sources asynchronously at different times, specifying a recording time interval for recording the data collected among multiple databases, recording data according to the specified recording time interval, such that each piece of the recorded data is associated with a particular time interval, and at a conclusion of the test, correlating the recorded data with the test configuration data about a test state in the respective time intervals.
Disclosed is a method of efficient testing by selective UI interaction, through test script sections including setup, execution and verification, applied to an AUT that operates in both API mode and UI)mode, including providing a test environment that, when testing the UI mode of the AUT, defaults to ignoring the UI mode during setup and supplying setup values stored in a file directly to an API without rendering or interacting with UI elements in the setup section of the script. The method includes encountering an override directive in the setup section of the test script, which mandates interaction with a specified UI element in the setup section, and responsive to the directive, overriding of the default of ignoring the specified UI element in the setup section, rendering the specified UI element, and applying a bot to interact with and supply setup values from the file to the specified UI element.
The disclosed technology for utilizing already-provisioned components in a test scenario without need to purge and re-provision the already provisioned components includes interpreting first and second sections of a test script. In the first section, the method includes encountering a reusable-resource-tag and a first instance of requesting provisioning of an associated resource, and provisioning the associated resource and designating the associated resource as reusable. In the second section, the disclosed method includes encountering a second instance of requesting provisioning of the associated resource, determining that the associated resource was designated as being reusable, and reusing an already provisioned instance of the associated resource instead of provisioning a new instance and instead of destroying the already provisioned instance and re-provisioning the associated resource. Further, extending test scripting to determining whether an associated resource has already been provisioned, and the interpreter determining that the resource was designated as being reusable.
The disclosed technology teaches testing with a test parameter data structure, applied to an AUT that operates in both API and UI mode, processing a configurable script to test in both modes. UI mode renders and interacts with UI elements utilizing values stored in the structure, used by the script in both modes, providing display mark-up in the script that is rendered in UI mode and formats fields to receive data that map to specific elements, leaving to be completed a mapping connection between the fields in the display and specific elements in the structure. The method includes providing a mapping of fields to elements, based on names, and while processing the script in UI mode, rendering the mark-up from the script, using a bot to interact with and complete the mark-up, applying the mapping to identify elements to complete fields, and causing processing of the fields in the mark-up.
The disclosed technology teaches enhancing error messages from tests, providing an error annotation memory in which to store annotations of errors for reference upon recurrence of the errors. Following one or more tests, the technology includes parsing an error log and causing display to a user of one or more errors including error codes, and receiving from the user, for at least some of the errors, a respective error source category and/or problem resolution hint. The method also includes storing an error code and the respective error source category and/or problem resolution hint, received from the user, as an annotation in the error annotation memory. Further taught is receiving and correlating a subsequent error including a subsequent error code, with the error source category and/or problem resolution hint available from the error annotation memory, and enhancing a message accompanying the subsequent error and causing display of the enhanced message.
The technology disclosed provides a method of testing handling of HTTPS sessions of a plurality of clients with a plurality of servers by a switching, bridging or routing device (i.e., a DUT), where the testing is conducted by a test system coupled to ports on the DUT. The method includes using client state machines running on at least four processor cores, communicating through the DUT with server state machines running on at least four additional processor cores. The method also includes, for each connection between a client represented by a client state machine and a server represented by a server state machine, setting up an HTTPS session by negotiating an encryption protocol and completing an HTTPS handshake. Further, the method includes following the setup of between 100,000 HTTPS sessions and 10,000,000 HTTPS sessions, conducting a stress test including combining payload data and header information without using the negotiated encryption.
Disclosed is a method of calibrating phase alignment of signals from multiple transmit antennas on multiple channels during OTA testing of a MIMO DUT, including generating a noisy test signal by adding noise to a signal pattern and transmitting the noisy test signal to the DUT on first and second channels OTA and sweeping a relative phase of the signal pattern, but not the added noise, in the first and second channels, while receiving from the DUT reports of a SNR for a received signal on at least one of the first channel and subsequently on the second channels. The method also includes analyzing variation in the SNR to determine phase alignment of the first and second channels, as received and processed by the DUT and using the determined phase alignment to perform OTA testing of the DUT. The method can also include receiving a RSRP and/or a RSSI.
H04B 17/12 - Surveillance; Tests d’émetteurs pour l’étalonnage d’antennes d’émission, p.ex. de l’amplitude ou de la phase
H04B 7/06 - Systèmes de diversité; Systèmes à plusieurs antennes, c. à d. émission ou réception utilisant plusieurs antennes utilisant plusieurs antennes indépendantes espacées à la station d'émission
32.
Automatically locating resources using alternative locator expressions during heterogeneous component-based testing in a portable automation framework
The disclosed technology provides resource locators keyed to resource names with failover alternate resource locators keyed to resource positions on user interfaces in a test environment: providing a central repository for resource locators and storing a set of alternative locator expressions for a resource in the central repository. The set includes first resource locators keyed to resource names on UIs and respective second resource locators keyed to resource positions on UIs that can be evaluated when the resource name in the respective first resource locator is invalid. The method invokes a resource location navigator to locate a particular resource using a first resource locator keyed to a resource name on the user interface, automatically invoking the resource location navigator using the second resource locator keyed to the resource position after failure of locating the particular resource using the resource name, and accessing the particular resource using the second resource locator.
G06F 11/36 - Prévention d'erreurs en effectuant des tests ou par débogage de logiciel
G06F 11/20 - Détection ou correction d'erreur dans une donnée par redondance dans le matériel en utilisant un masquage actif du défaut, p.ex. en déconnectant les éléments défaillants ou en insérant des éléments de rechange
G06F 9/451 - Dispositions d’exécution pour interfaces utilisateur
G06F 11/32 - Surveillance du fonctionnement avec indication visuelle du fonctionnement de la machine
The disclosed technology addresses the problem of testing performance of RU scheduling algorithms used by an OFDMA enabled AP to support multiple clients, using a two-armed test harness with a wired connection to one side of an AP under test and multiple wireless clients coupled in RF communication with the AP. The wireless clients can be connected over the air or conductively to antenna(s) of the AP under test. The test harness generates test traffic. A sniffer radio listens to RU allocation and schedules traffic broadcast by the AP to multiple clients. A recording module records the RU allocation and traffic and a report generator categorizes the recorded resource allocation with the scheduling traffic heard by the sniffer radio and provides resource allocation statistics. The wireless clients are connected conductively or OTA to antennas of the AP under test. One sniffer radio replaces multiple sniffers used in prior test systems.
The disclosed technology teaches delivering scarce test equipment resources to a user within a test organization: receiving a test graph that specifies equipment capabilities needed, by class and times when the capabilities are needed. The technology includes maintaining an inventory of equipment resources and capabilities, by class, and responsive to the user invoking the graph, scheduling the needed equipment: identifying alternative resources responsive to the need and selecting a group of resources to schedule; bundling the group of resources to schedule into an immediate bundle needed to start the test and a deferred bundle needed later, after the start of the test; and queuing a deferred bundle reservation for a later time, after the scheduled start of the test. During the test, the technology includes notifying the user of availability of the equipment resources in the deferred bundle when they become available and marking the deferred bundle as in use.
G06Q 10/06 - Ressources, gestion de tâches, des ressources humaines ou de projets; Planification d’entreprise ou d’organisation; Modélisation d’entreprise ou d’organisation
G06F 16/901 - Indexation; Structures de données à cet effet; Structures de stockage
H04J 3/16 - Systèmes multiplex à division de temps dans lesquels le temps attribué à chacun des canaux au cours d'un cycle de transmission est variable, p.ex. pour tenir compte de la complexité variable des signaux, pour adapter le nombre de canaux transmis
G06Q 10/08 - Logistique, p.ex. entreposage, chargement ou distribution; Gestion d’inventaires ou de stocks
A wireless link monitor is configured to operate as an active client that can send and/or receive wireless traffic to and/or from wireless devices-under-test (DUTs) in the network. When the wireless link monitor operates as an active client, the DUTs can send respective wireless traffic to the wireless link monitor. This ensures that the wireless link monitor receives the wireless traffic even when the DUTs transmit their wireless signals narrowly (e.g., in adaptive beamforming technologies).
The disclosed technology teaches testing a mesh network using new service application level KPIs that extend the TWAMP measurement architecture. A control-client receives and parses a configuration file to populate memory with IP addresses, ports, and test session parameters for disclosed KPIs used to originate two-way test sessions from a first network host; with control-servers and session-reflectors. The method extends the receiving, parsing and originating to dozens to thousands of control-clients, by sending to the control-clients configuration files to originate respective test sessions with control-servers in a mesh network using respective test session parameters; and while the test is running, sending an updated configuration file to at least one control-client that introduces a new control-server or replaces a control-server; and expanding the test to include the new or replacement control-server without stopping or restarting TW test sessions with other control-servers; and monitoring the running test sessions and receiving results.
H04L 69/16 - Implémentation ou adaptation du protocole Internet [IP], du protocole de contrôle de transmission [TCP] ou du protocole datagramme utilisateur [UDP]
The disclosed technology teaches detecting abnormal behavior of a UE mobile device, including a network data analytics function component, in communication with core network components of a cellular network, subscribing to location change-related events that report a change event for a UE device connection to and/or drop or handover from a cell. Included is analyzing location change-related events to detect abnormal handover behavior when the UE device changes its selection of a base station or cell more than N times in not more than M minutes, and reporting the detected abnormal handover behavior with an identifier of the UE mobile device involved and the involved cell's ID. The technology also applies to a group of UE devices selected for analysis, by device, geography or custom-defined affinity, with selection changes among a set of base stations or neighboring cells, each selected at least twice by the UE device in M minutes.
The disclosed technology teaches ad hoc testing a connection between subscriber mobile phone and counterpart location with which the subscriber is having trouble, including positioning a test harness near the location, remote from the subscriber and from a service technician. The harness includes a controller, two mobile phones with an audio cross-over cable connection between, and control connections between controller and phones. The cable feeds output of respective speakers to respective microphones and inhibits transmission between the phones of signals for button presses. The controller receives a test start signal from the technician and establishes a test connection between technician equipment and subscriber equipment through the counterpart location, establishing a call connection between the first phone and the technician equipment; and establishing a second test call connection between the second phone and the subscriber phone, so the technician and subscriber have an audio connection over the audio cross-over cable.
The disclosed methods for reducing the port setup time for a large number of TWAMP test sessions for performance measurement testing of telecommunication transport networks include parsing a configuration file to populate an accept-port data structure with proposed receiver ports for communication from a session-sender to session-reflectors; repeatedly and in parallel, from a control client, communicating with receiving servers to set up pairwise test sessions using receiver port allocations from the accept-port data structure, and receiving and checking blocks of Accept-Session messages from the receiving server and handling either case of acceptance of the proposed receiver port or of counter proposal of an alternate-and-available port to be used for the measurement session; and allocating the alternate-and-available port and updating the accept-port data structure by storing the alternate-and-available port received in the particular Accept-Session message; and using the stored ports to initiate TWAMP messages in the pairwise test sessions.
At least three uses of the technology disclosed are immediately recognized. First, a video stream classifier can be trained that has multiple uses. Second, a trained video stream classifier can be applied to monitor a live network. It can be extended by the network provider to customer relations management or to controlling video bandwidth. Third, a trained video stream classifier can be used to infer bit rate switching of codecs used by video sources and content providers. Bit rate switching and resulting video quality scores can be used to balance network loads and to balance quality of experience for users, across video sources. Balancing based on bit rate switching and resulting video quality scores also can be used when resolving network contention.
H04N 7/173 - Systèmes à secret analogiques; Systèmes à abonnement analogiques à deux voies, p.ex. l'abonné envoyant un signal de sélection du programme
H04N 21/647 - Signalisation de contrôle entre des éléments du réseau et serveur ou clients; Procédés réseau pour la distribution vidéo entre serveur et clients, p.ex. contrôle de la qualité du flux vidéo en éliminant des paquets, protection du contenu contre une modification non autorisée dans le réseau ou surveillance de la charge du résea
H04N 21/234 - Traitement de flux vidéo élémentaires, p.ex. raccordement de flux vidéo ou transformation de graphes de scènes MPEG-4
41.
Enhancing transmission control protocol (TCP) performance and scalability on multicore processor architectures
The disclosed technology teaches TCP session processing architecture for conducting numerous TCP sessions during testing of a network-under-test: multiple processor cores running, allocated to TCP session handling, and program instructions configured to distribute processing of each TCP session across multiple cores with a first set of cores allocated to handle TCP control, a second set of cores allocated to handle TCP packet transmission, and a third set of cores allocated to handle TCP packet receiving. The disclosed architecture also includes a shared memory accessible to the first, second and third sets of cores, that holds PCBs for each of numerous TCP sessions during the testing with update access controlled by an atomic spinlock processor instruction that each TCP state machine running on a core must engage to secure the update access to a respective PCB, in order to proceed with state processing of its respective TCP session.
G06F 15/16 - Associations de plusieurs calculateurs numériques comportant chacun au moins une unité arithmétique, une unité programme et un registre, p.ex. pour le traitement simultané de plusieurs programmes
H04L 1/16 - Dispositions pour détecter ou empêcher les erreurs dans l'information reçue en utilisant un canal de retour dans lesquelles le canal de retour transporte des signaux de contrôle, p.ex. répétition de signaux de demande
H04L 47/193 - Commande de flux; Commande de la congestion au niveau des couches au-dessus de la couche réseau au niveau de la couche de transport, p.ex. liée à TCP
H04L 69/163 - Adaptation dans la bande de l'échange de données TCP; Procédures de commande intra-bande
42.
Secure method for managing a virtual test platform
The technology disclosed relates to implementing a virtual test platform (VTP) and running virtual test applications (VTAs) from an unsecured location. Using a phone home service, the VTP establishes a secure tunnel connection with a test controller. The VTP receives configuration information for a VTA from the test controller. If the VTA is not stored on the VTP, the VTP retrieves the VTA from a repository specified by the test controller. The configuration information from the test controller includes information needed for the VTP to set up a second secure tunnel. The VTP establishes the second secure tunnel and launches the VTA. The VTP relays information sent through the second tunnel to the VTA, and also relays messages from the VTA back to the test controller.
G06F 9/455 - Dispositions pour exécuter des programmes spécifiques Émulation; Interprétation; Simulation de logiciel, p.ex. virtualisation ou émulation des moteurs d’exécution d’applications ou de systèmes d’exploitation
The technology disclosed is a method of testing handling of secure communication sessions of clients with servers by device or system under test (DUT). The method includes (i) establishing a secure communication session between the client and the server while the client and the server transitions past a standards-required verification step or validation step without performing the required verification or validation, (ii) establishing a secure communication session between the client and the server while the client and the server reuse standards-required security mechanisms without generating or obtaining new standards-required security mechanisms, or (iii) establishing a secure communication session between the client and the server while the client and the server generate and transmit content contrary to an established standard-based procedure that poses certain requirements of the content.
The present invention relates to testing signals on a coaxial home network that carries a digital video signal. It has direct application to testing Multimedia over Coax Alliance (MoCA) standards-compliant networks and applies to similar networks such as Data Over Cable Service Interface Specification (DOCSIS), Ethernet, and Wi-Fi. An embedded expert system can guide an inexperienced operator through the process of evaluating and resolving problems with a home network with little operator input.
The disclosed technology teaches automating evaluation of QoE for data communication services in a wireless network—accessing performance indicators, mappings for the performance indicators to SKQIs in a SKQI parameters table, and mappings for SKQIs to KQIs in an SKQI-to-KQI mapping table. The disclosed method includes configuring first and second functions that, respectively, roll up performance indicators into SKQIs based on parameters stored in the SKQI parameters table to calculate SKQI scores and weights, and roll up SKQIs into KQIs and QoE based on parameters stored in SKQI-to-KQI and SKQI-to-QoE mapping tables, to calculate KQI and QoE scores. Also disclosed is generating first SQL statements that invoke the first function to calculate the SKQIs and second SQL statements that invoke the second function to calculate KQIs and QoE, storing generated first and second SQL statements in non-volatile storage and calculating KQIs and QoE using the automatically generated SQL statements.
The technology disclosed relates to a method for storing and time-correlating real-time and queryable test results of a test of a device under test (DUT). The method includes initiating the test applied to the DUT to collect real-time data from a multitude of data streams for multiple aspects of the DUT, the collected data including counters and fact-type values, the collected data having imperfectly synchronized time bases and the collected data being collected from different sources asynchronously at different times, specifying a recording time interval for recording the data collected among multiple databases, recording data according to the specified recording time interval, such that each piece of the recorded data is associated with a particular time interval, and at a conclusion of the test, correlating the recorded data with the test configuration data about a test state in the respective time intervals.
An apparatus for testing electromagnetic components includes electromagnetically-isolating external walls that define a chamber. An internal wall is attached to one or more of the electromagnetically-isolating external walls to form an internal test instrument chamber and an internal device testing chamber. An internal RF feed-through port passes through the internal wall to electrically couple a test instrument disposed in the internal test instrument chamber to a wireless device-under-test (DUT) disposed in the internal device testing chamber. One or more external RF feed-through ports can pass through one of the electromagnetically-isolating external walls to electrically couple the DUT and/or the test instrument to a second wireless device.
H01Q 3/26 - Dispositifs pour changer ou faire varier l'orientation ou la forme du diagramme de directivité des ondes rayonnées par une antenne ou un système d'antenne faisant varier la distribution de l’énergie à travers une ouverture rayonnante
48.
System and method for synchronizing protocol and RF analyzers during wireless testing
A computer-implemented method for synchronizing wireless testing devices includes (a) in a protocol analyzer located in an RF-isolated test chamber, capturing first network packets transmitted to or from a wireless device-under-test (DUT) to generate protocol test data, (b) in the protocol analyzer, determining if any of the first network packets satisfy a trigger rule, (c) in the protocol analyzer, generating a trigger output signal when the trigger rule is satisfied, (d) sending the trigger output signal from the protocol analyzer to an RF analyzer in electrical communication with the DUT, (e) capturing second network packets with the RF analyzer based on the trigger output signal to generate RF test data, the second network packets transmitted to or from the DUT, and (f) in the protocol analyzer, time-aligning the first and second network packets in the protocol test data and the RF test data, respectively.
A computer-implemented method for synchronizing wireless testing devices includes (a) in a first protocol analyzer located in a first RF-isolated test chamber, capturing first network packets transmitted to or from a wireless device-under-test (DUT) to generate first test data, (b) in a second protocol analyzer located in a second RF-isolated test chamber, capturing second network packets transmitted to or from the wireless DUT to generate second test data, (c) synchronizing internal clocks of the first and second protocol analyzers such that the first and second protocol analyzers capture the first and second network packets with respect to a synchronized internal clock time, and (d) merging the first and second test data using the synchronized internal clock time.
An SQL interceptor inserted as a proxy between a database client and the corresponding database server intercepts a constrained application-generated SQL query and composes a new data request. Parameter values in the SQL query determine whether the new data request is sent to a database server or a web service provider. A reserved table name specified in the SQL query triggers a rewrite of the data request. Parameter values in the query are used to select among a plurality of executable modules to use for rewriting the data request. Special data encoding and formats need to be used based on the source of data that will receive and respond to the rewritten data request. For example, communication between a database client and server may use a vendor-specific, non-standard binary encoding, and XML and JSON response data must be reformatted as an SQL response for processing by the database client.
The disclosed technology teaches testing a mesh network using new service application level KPIs that extend the TWAMP measurement architecture. A control-client receives and parses a configuration file to populate memory with IP addresses, ports, and test session parameters for disclosed KPIs used to originate two-way test sessions from a first network host; with control-servers and session-reflectors. The method extends the receiving, parsing and originating to dozens to thousands of control-clients, by sending to the control-clients configuration files to originate respective test sessions with control-servers in a mesh network using respective test session parameters; and while the test is running, sending an updated configuration file to at least one control-client that introduces a new control-server or replaces a control-server; and expanding the test to include the new or replacement control-server without stopping or restarting TW test sessions with other control-servers; and monitoring the running test sessions and receiving results.
The disclosed methods and systems of using TWAMP measurement architecture for testing a large network include a control-client running on a first network host initializing memory for test session parameters used to originate a test, parsing a configuration file to populate the memory with IP addresses, ports and QoS parameters for control-servers and session-reflectors; and originating test sessions using the test session parameters. The method includes extending to thousands of control-clients, each originating respective test sessions with control-servers in a mesh network using respective test session parameters; and while the test is running, optionally sending an updated configuration file to at least one control-client that introduces a new control-server or replaces a control-server; and the control-client parsing the updated configuration file and updating memory to include the new control-server IP address, port numbers and QoS parameters; and expanding the test and monitoring the running test sessions for results.
The disclosed technology teaches training a NR VMOS score generator by generating synthetically impaired images from FR video using filters tuned to generate impaired versions and applying a FR VMOS generator to pairs of unimpaired FR images from the FR video and the impaired versions of the FR images to create ground truth scores for the impaired versions. The disclosed method also includes training by machine learning model an image evaluation classifier using the ground truth scores and the impaired versions to generate NR VMOS scores, and storing coefficients of the image evaluation classifier for use as the NR VMOS score generator. Also disclosed is generating a NR VMOS score by invoking the trained NR VMOS score generator, with stored coefficients generated by feeding the trained NR VMOS score generator with images captured from scenes in a video to be scored, and evaluating the images to generate NR VMOS scores.
G06K 9/62 - Méthodes ou dispositions pour la reconnaissance utilisant des moyens électroniques
G06K 9/00 - Méthodes ou dispositions pour la lecture ou la reconnaissance de caractères imprimés ou écrits ou pour la reconnaissance de formes, p.ex. d'empreintes digitales
Systems, methods, and devices for creating a test performance monitoring and reporting system that is adaptive for use with different types of mobile devices are disclosed. The test performance monitoring and reporting system adapts itself to be interoperable with different models of mobile device by combining sequences of deterministic logic blocks with device-specific asset libraries. Logic blocks can be added to or removed from the sequence. Logic blocks implement different operations of mobile devices, including using assets, launching applications, and replaying sequences of command interface interactions recorded from test users. The asset library contains assets corresponding to mobile device elements that can be manipulated by users. These assets are device-specific, and a test script can be adapted to fit a particular mobile device model by replacing the existing assets in the script with assets from the asset library of the particular mobile device.
The technology disclosed provides a method of testing handling of HTTPS sessions of a plurality of clients with a plurality of servers by a switching, bridging or routing device (i.e., a DUT), where the testing is conducted by a test system coupled to ports on the DUT. The method includes using client state machines running on at least four processor cores, communicating through the DUT with server state machines running on at least four additional processor cores. The method also includes, for each connection between a client represented by a client state machine and a server represented by a server state machine, setting up an HTTPS session by negotiating an encryption protocol and completing an HTTPS handshake. Further, the method includes following the setup of between 100,000 HTTPS sessions and 10,000,000 HTTPS sessions, conducting a stress test including combining payload data and header information without using the negotiated encryption.
The technology disclosed enables the automatic definition of monitoring alerts for a web page across a plurality of variables such as server response time, server CPU load, network bandwidth utilization, response time from a measured client, network latency, server memory utilization, and the number of simultaneous sessions, amongst others. This is accomplished through the combination of load or resource loading and performance snapshots, where performance correlations allow for the alignment of operating variables. Performance data such as response time for the objects retrieved, number of hits per second, number of timeouts per sec, and errors per second can be recorded and reported. This allows for the automated ranking of tens of thousands of web pages, with an analysis of the web page assets that affect performance, and the automatic alignment of performance alerts by resource participation.
The disclosed systems and methods for conducted massive MIMO array testing uses an efficient method of utilizing hardware resources for emulating signals from a massive MIMO base station transceiver to a MIMO mobile unit as dictated by a channel model; and also for emulating signals from a MIMO mobile unit to a massive MIMO BS transceiver, as dictated by a channel model. The system uses a phase matrix combiner to emulate the angular behavior of the propagation using virtual probes, combined with a radio channel emulator to create the temporal, multipath, and correlation behavior of the propagation. Using a phase matrix function increases the number of antenna elements that can be utilized in a massive MIMO array emulation while keeping the required number of fading channels within the radio channel emulator at a reduced number, thus forming a cost effective, yet realistic test system for massive MIMO testing.
Some tests can be implemented as services. A network provider can deploy (“push”) a test to a container resident on one or more devices of the network, either at installation, periodically, or when a problem is reported. When a customer reports an issue, services running on one or more devices of the customer's installation can cause the containerized tests to be run. For example, the central office of the network provider can initiate a request to run the test through the internet (or other connection) by the container. In some implementations, there is an overlap of the service based test set with traditional technician initiated test sets forming a hybrid testing architecture.
A tester system described herein enables a user (e.g., a field technician) to efficiently and conveniently upgrade, evaluate and troubleshoot customer premises networks and equipment. The tester system includes a dedicated tester device that is wirelessly coupled to a handheld device. In response to user input, the handheld device remotely controls the dedicated tester device to execute a testing routine to evaluate one or more customer premises wired and/or wireless networks.
H04L 12/28 - Réseaux de données à commutation caractérisés par la configuration des liaisons, p.ex. réseaux locaux [LAN Local Area Networks] ou réseaux étendus [WAN Wide Area Networks]
H04L 12/24 - Dispositions pour la maintenance ou la gestion
H04L 12/26 - Dispositions de surveillance; Dispositions de test
H04M 3/22 - Dispositions de supervision, de contrôle ou de test
60.
Reducing cache memory requirements for recording statistics from testing with a multiplicity of flows
A disclosed method processes a data feed including multiple streams. The method includes processing n frames of the multiple streams in parallel through n processing pipelines, n being an integer greater than or equal to 2. The n frames include a first frame belonging to a first stream and a second frame belonging to a second stream. The first stream is different than the second stream. The n processing pipelines are coupled to n-by-n value buffers per stream per recorded value for the stream, and at least one status buffer per stream. The n processing pipelines are each assigned a distinct row of read-authorized port access to the n-by-n value buffers and a distinct column of write-authorized port access to the n-by-n value buffers.
G06F 3/06 - Entrée numérique à partir de, ou sortie numérique vers des supports d'enregistrement
G06F 12/0802 - Adressage d’un niveau de mémoire dans lequel l’accès aux données ou aux blocs de données désirés nécessite des moyens d’adressage associatif, p.ex. mémoires cache
The disclosed system for testing a massive MIMO beamforming antenna array of arbitrary size includes an anechoic chamber, and a mount for a MIMO array antenna positioned in the chamber, wherein the array has at least 8×4 antenna elements that are individually activated to steer transmissions from the array. The system includes dual element antenna probes positionable in the anechoic chamber, with feeds coupling one or more UE sources to the antenna probes; and the UE sources generate RF in OTA communication with the array, emulating multiple UE devices. Additionally the system includes base station electronics coupled to the array, and a test controller coupled to the base station electronics. The test controller signals the UE sources OTA via the array to invoke a connection to the UE sources and measure OTA channel performance between the array and the multiple UE devices emulated, the performance including at least throughput.
Some tests can be implemented as services. A network provider can deploy (“push”) a test to a container resident on one or more devices of the network, either at installation, periodically, or when a problem is reported. When a customer reports an issue, services running on one or more devices of the customer's installation can cause the containerized tests to be run. For example, the central office of the network provider can initiate a request to run the test through the internet (or other connection) by the container. In some implementations, there is an overlap of the service based test set with traditional technician initiated test sets forming a hybrid testing architecture.
H04L 12/28 - Réseaux de données à commutation caractérisés par la configuration des liaisons, p.ex. réseaux locaux [LAN Local Area Networks] ou réseaux étendus [WAN Wide Area Networks]
H04L 12/24 - Dispositions pour la maintenance ou la gestion
H04H 20/12 - Dispositions de contrôle, de test ou de dépannage
H04L 12/26 - Dispositions de surveillance; Dispositions de test
H04W 84/12 - Réseaux locaux sans fil [WLAN Wireless Local Area Network]
Systems and methods for design and testing of RF components are described. One or more RF isolation chambers are used to house MU-MIMO capable devices under test, including wireless access points and client devices. Spatial and angular positioning of the antennas within a chamber and controlled power of the signals into each antenna via RF combiners and RF attenuators to achieve a controllable apparent/virtual angular spread among the respective client device signals is described.
A unique method/device for isolating the over-the-air segment within a mobile communications network is provided. A coordinated set of tests is run to isolate problems in an end-to-end network including over-the-air segment, wired, and core network segments. Test results are compared to identify which segment or components within a segment is failing. The testing device executes the same test in two differentiated modes. In one mode, the device acts as a mobile client device identified by subscriber identification data that communicates with the network base station over-the-air using the standard control and data protocols of the mobile network. In another mode, the testing device, identified by the same subscriber identification data, acts like the combination of the same Mobile Client Device(s) and a Network Base Station using a wired interface that is equivalent to the wired interface that connects the network base station to the rest of the wired network.
Systems, methods, and devices for creating test and testing a plurality of touchscreen devices are described. The methods comprise creating a test script by recording the touch events performed on a touchscreen device by a technician. The method of recording touch events for later use as a test script is faster and requires less programming knowledge, compared to manually writing a test script. This is beneficial if a new test script is needed quickly because a technician can perform a desired touch sequence on a device recording the sequence and then distribute the recorded sequence to be played on a plurality of devices to be tested. The recorded sequence may include a plurality of sequential touch events. Additionally, the recorded sequence may include conditional statements used to determining the timing of simulating one of the touch events in the sequence.
A utilization test generates the multiple dimensions of resource load on the first computer, the multiple dimensions including at least two of: a processor utilization dimension, a main memory utilization dimension, a mass storage utilization dimension, and a network utilization dimension. The utilization test performs iterations of attempts to generate said each dimension of the resource load on the first computer, in an amount equal to a changeable target utilization of said each dimension of the resource load on the first computer. The utilization test adjusts the adjusted utilization to attempt to correct for inequality between (i) the actual utilization of a particular one of the multiple dimensions of the resource load on the first computer, and (ii) the changeable target utilization of the particular one of the multiple dimensions of the resource load on the first computer.
A utilization test generates the multiple dimensions of resource load on the first computer, the multiple dimensions including at least two of: a processor utilization dimension, a main memory utilization dimension, a mass storage utilization dimension, and a network utilization dimension. The utilization test performs iterations of attempts to generate said each dimension of the resource load on the first computer, in an amount equal to a changeable target utilization of said each dimension of the resource load on the first computer. The utilization test adjusts the adjusted utilization to attempt to correct for inequality between (i) the actual utilization of a particular one of the multiple dimensions of the resource load on the first computer, and (ii) the changeable target utilization of the particular one of the multiple dimensions of the resource load on the first computer.
H04L 29/08 - Procédure de commande de la transmission, p.ex. procédure de commande du niveau de la liaison
G06F 11/34 - Enregistrement ou évaluation statistique de l'activité du calculateur, p.ex. des interruptions ou des opérations d'entrée–sortie
G06F 9/50 - Allocation de ressources, p.ex. de l'unité centrale de traitement [UCT]
H04L 12/24 - Dispositions pour la maintenance ou la gestion
H04L 12/911 - Contrôle d’admission au réseau et allocation de ressources, p.ex. allocation de bande passante ou renégociation en cours de communication
The disclosed technology relates to systems and methods for emulating a massive MIMO beamforming antenna array of arbitrary size—a channel model between a transmitter and a receiver, with one or more signal paths having respective amplitudes, angles of arrival, angle spreads, and delays. The disclosed technology includes defining a complete channel model H, calculating the correlation matrix for the channel, grouping the base antenna elements of the antenna array by combinations of signal and polarization, and calculating observed beamforming power of each group of the base elements, by applying a cross-correlation matrix to determine observed power signals and delay of each signal at each remote antenna element of the user equipment. Emulation includes supplying cross-correlated signals to remote antenna elements of user equipment during a RF test of the user equipment. Disclosed technology includes a channel emulator that generates output streams for testing user equipment for multiple users.
The technology disclosed relates to systems and methods for testing adaptive antennas via a multi-probe anechoic chamber, which includes the emulation of real world conditions of a radio frequency (RF) signal reaching a device-under-test (DUT). The technology disclosed can be applied to test and evaluate a range of changed conditions. In one case, beamforming scenarios use separate spatial desired and interference signals, and the results can be compared to uniform interference. Based on performance for a segment of a test profile, the segment can be modified or expanded: shortened, repeated, or repeated with a modification—to fully evaluate the aspect being tested. Also, a dynamic profile that is utilized to evaluate a first device can be saved and repeated as a fixed profile for further testing of a first or second device.
The technology disclosed enables understanding the user experience of accessing a web page under high loads. A testing system generates a simulated load by retrieving and loading a single web object. A performance snapshot is taken of accessing an entire web page from the server under load. The performance snapshot may be performed by emulating a browser accessing a web page's URL, the web page comprising multiple objects that are independently retrieved and loaded. The simulated load is configured with a number of users per region of the world where the user load will originate, and a single object from the web page to retrieve. Performance data such as response time for the single object retrieved, number of hits per second, number of timeouts per sec, and errors per second may be recorded and reported. An optimal number of users may be determined to achieve a target user experience goal.
The technology disclosed relates to scoring user experience of video frames displayed on a mobile or other video display device. In particular, it relates to capture alignment and test stimulus isolation techniques that compensate for artifacts in the capture mechanism. The technology disclosed includes methods and systems for analyzing both downlink and uplink quality for mobile or other video display device cameras capturing and transmitting video frames including teleconference video display. Particular aspects of the technology disclosed are described in the claims, specification and drawings.
H04N 21/442 - Surveillance de procédés ou de ressources, p.ex. détection de la défaillance d'un dispositif d'enregistrement, surveillance de la bande passante sur la voie descendante, du nombre de visualisations d'un film, de l'espace de stockage disponible dans l
72.
Systems and methods of building sequenceable test methodologies
Networks and applications can have many different profiles. Template configurations can consist of a wide variety of technologies such as IPv4, DHCP, and BGP. A list of application profiles would include web services, VoIP, Email, and Point-to-point. Network and application profiles can be combined into topology templates. Test methodologies can include complex sets of instructions that allow for testing any number of topology templates in a number of ways. The technology disclosed allows for the assembly, edit, and execution of those profiles and methodologies by someone who does not possess detailed domain knowledge.
A new test control structure improves on constructing complex test sequences in a scripting language. The new test control structure iterates over two or more arbitrary values of a test attribute, such as a networking protocol parameter applied at OSI layers 2-7.
A method is provided for calibrating a test platform to establish a phase relationship between copies of a signal at a measurement location within the test platform. Phase relationships of the copies of the signal traversing signal paths and ending at the measurement location are manipulated. Vector signal addition from the copies of the signal is analyzed as the phase relationships are manipulated to find a phase offset adjustment that establishes a particular phase relationship between the signal paths.
H04B 3/462 - Tests de temps de propagation de groupe ou de déphasage, p.ex. instabilité de temporisation
H04B 17/21 - Surveillance; Tests de récepteurs pour la correction des mesures
H04B 7/04 - Systèmes de diversité; Systèmes à plusieurs antennes, c. à d. émission ou réception utilisant plusieurs antennes utilisant plusieurs antennes indépendantes espacées
A channel emulator generates radio channel conditions of live cellular base station signals in a simulation of a radio environment of a fielded cellular network, based on a record of captured radio signal data of a plurality of cellular base stations in the fielded cellular network. A generates a simulation of a fielded cellular network. In one aspect, the radio channel conditions in the simulation of the radio environment are synchronized with events in the simulation of the fielded cellular network. In another aspect, an event handling state machine directs configurable events in the simulation of the fielded cellular network in response to radio channel conditions in the simulation of the radio environment.
G06F 9/455 - Dispositions pour exécuter des programmes spécifiques Émulation; Interprétation; Simulation de logiciel, p.ex. virtualisation ou émulation des moteurs d’exécution d’applications ou de systèmes d’exploitation
The present invention relates to simulation on a lab workbench of conditions that would be encountered by a mobile device during a so-called drive test, which involves transporting the mobile device along a course so that it encounters fading and changing wireless access points used normally to connect the mobile device to a wireless network but in this case used to locate the device. The instrument and method also support parametric testing of transceivers used for WiFi positioning and, optionally, GNSS positioning by the same mobile device used for WiFi positioning.
H04W 24/06 - Réalisation de tests en trafic simulé
G01S 5/02 - Localisation par coordination de plusieurs déterminations de direction ou de ligne de position; Localisation par coordination de plusieurs déterminations de distance utilisant les ondes radioélectriques
G01S 19/23 - Test, contrôle, correction ou étalonnage d'un élément récepteur
H04L 12/26 - Dispositions de surveillance; Dispositions de test
H04L 12/24 - Dispositions pour la maintenance ou la gestion
A system method and device for evaluating the Quality of Service (QoS) performance of mobile telephone devices in the concurrent performance of different services through a mobile telephone network is provided. In one embodiment, the method comprises establishing a first logical communication channel via the mobile telephone network, communicating first information over the first logical communication channel, establishing a second logical communication channel over a communication network, concurrently with said communicating first information, communicating second information over the second logical communication channel, and determining a plurality of service quality metrics for the first and second information communicated over the first and second logical communication channel.
A method is described that includes securing authorization for a control module to conduct a test using a plurality of test modules running on a plurality of virtual machines. The method further includes registering the plurality of test modules with the control module to conduct the test. Authorization of the control module is extended to the test modules by securely communicating authorization and instructions to a first set of the registered test modules to send test stimulus to a device under test. Similarly, the authorization is extended to the test modules by securely communicating authorization to and receiving test result data from a second set of the registered test modules, wherein the test result data is responsive to the test stimulus sent to the device under test. The first and second sets of registered test modules can overlap or be the same test modules.
H04L 29/00 - Dispositions, appareils, circuits ou systèmes non couverts par un seul des groupes
H04L 29/06 - Commande de la communication; Traitement de la communication caractérisés par un protocole
H04L 12/26 - Dispositions de surveillance; Dispositions de test
G06F 21/44 - Authentification de programme ou de dispositif
G06F 9/455 - Dispositions pour exécuter des programmes spécifiques Émulation; Interprétation; Simulation de logiciel, p.ex. virtualisation ou émulation des moteurs d’exécution d’applications ou de systèmes d’exploitation
A method is provided for generating and transmitting a test signal for an over-the-air test of a device-under-test that is in simulated motion. The method includes dithering Doppler shifts of a carrier frequency of the test signal on sub-path components of the test signal to produce slightly different frequencies per sub-path component, wherein the sub-path components are at a first and second polarization orientations. Dithering Doppler shifts can include dithering a first sub-path component at the first polarization orientation while keeping this sub-path component at the second polarization orientation at the original Doppler shift of the carrier frequency of the test signal, or keeping a first sub-path component at the first polarization orientation at the carrier frequency of the test signal while dithering this sub-path component at the second polarization orientation. Dithering Doppler shifts can include dithering sub-path components at the first and the second polarization orientation.
The invention relates to a method for automatically configuring a mobile device such as a mobile phone with service parameters provided by a network operator. In order to receive the service parameters the mobile phone needs to connect with the network operator associated with the SIM card which the mobile device has been configured with. However, it may be difficult to make this connection since the SIM card does not uniquely define the network operator. According to an embodiment of the invention the network operator is identified or suggested based on databases containing information of names or alternative names of network operators and probabilities indicating a likeliness that a network operator may be the operator associated with the SIM card.
H04W 8/18 - Traitement de données utilisateur ou abonné, p.ex. services faisant l'objet d'un abonnement, préférences utilisateur ou profils utilisateur; Transfert de données utilisateur ou abonné
H04W 48/18 - Sélection d'un réseau ou d'un service de télécommunications
An electronic device holder includes a base with at least three adjustable-position retaining posts extending upwardly from the base to permit an electronic device to be secured at a position above the base by the retaining posts. A test lead restraint assembly may be used to capture and thereby stabilize a test lead extending from the electronic device during testing of the electronic device.
09 - Appareils et instruments scientifiques et électriques
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Computer software for systems verification testing; computer software for testing and analyzing the performance and integrity of devices and product features in the field of product and/or systems design, the field of product quality assurance, and the field of product and/or systems testing; computer software for product, device, and/or system design modeling and testing; computer software for use in device, product and/or system test planning, test case design, test execution, test automation, defect analysis and documentation, and test result tracking and reporting; computer software for system orchestration of processes, people and products Providing temporary use of on-line non-downloadable software for systems verification testing; Providing temporary use of on-line non-downloadable software for testing and analyzing the performance and integrity of devices and product features in the field of product and/or systems design, the field of product quality assurance, and the field of product and/or systems testing; Providing temporary use of on-line non-downloadable software for product, device, and/or system design modeling and testing; Providing temporary use of on-line non-downloadable software for use in device, product and/or system test planning, test case design, test execution, test automation, defect analysis and documentation, and test result tracking and reporting; Consulting services for others in the fields of design, planning, and implementation project management of computer software testing, product and/or systems design, product quality assurance, and product and/or systems testing
The present invention relates to testing a mobile device in a lab by providing test signals to the mobile device via a cabled connection which bypasses the actual physical antennas in the mobile device. The test signals emulate a wireless channel and incorporate representative and/or actual measured characteristics of the performance of the antennas in the mobile device. As such, the performance mobile device can be accurately measured without requiring placement in an anechoic chamber, which enables efficient testing over a large set of configurations and underlying conditions.
The technology disclosed relates to implementing a novel-testing framework that combines playback of captured GNSS signals with real-time emulation of assisted global navigation satellite system telemetry (abbreviated A-GNSS) in a test session with a mobile device. In particular, it can be used for testing A-GNSS performance of communication devices, navigation systems, telematics and tracking applications.
A multipath channel emulation system and method are disclosed. In some aspects, the system and method allow for analog emulation of a multipath MIMO wireless channel. Such multipath channel emulation system is used for testing the ability of wireless communication devices to operate in an airlink channel characterized by multipath. In a particular aspect, an impedance mismatch or discontinuity is provided in an open-ended coaxial cable so as to cause multiple back and forth reflections between an impedance discontinuity and an open coaxial cable stub and, optionally, including a delay element to emulate a multi-cluster multipath environment. A plurality of such stub subsystems may be combined as sub-paths in a multipath channel emulator.
The problem of simulating movement of multiple GNSS or regional navigational satellite system satellites across the sky within a test environment is solved by the technology disclosed using a test chamber with a plurality of zones bounded by azimuth and elevation limits, positioning at least one directional antenna in each zone, driving each antenna individually with a GNSS simulator capable of producing multiple positioning signals for a plurality of satellite sources in a single zone, and coordinating among GNSS simulators a simulated orbital movement of the satellite sources from one zone to an adjoining zone to produce changing angles of arrival for the positioning signals during a test. Both methods and systems implement this technology.
Various example embodiments are directed to computer-implemented systems and methods for generating tests. A computer system may execute an application host and a browser. Messages originating from the application host and messages directed to the application host may be routed through the browser. The browser may be programmed to capture a plurality of application-level messages, which may comprise a plurality of requests originating from an application host and a plurality of responses directed to the application host. The computer system may generate a test scenario based on the plurality of application-level messages.
A channel emulator reads a record of captured radio signal data of a group of cellular base stations in a fielded cellular network from a memory. Based on the record of the captured radio signal data, the channel emulator generates a simulation of a radio environment of the fielded cellular network. In one aspect, the simulation generates a number of live cellular base station signals fewer than the group of cellular base stations in the fielded cellular network. In another aspect, a terrain environment model is applied based on the captured radio signal data.
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Online, cloud-based computer software services featuring software for load and performance testing of websites, web applications, mobile applications, and application program interfaces (APIs).
90.
Finite state machine method for test case generation and execution of communication protocols
The technology disclosed relates to implementing a novel architecture of a finite state machine (abbreviated FSM) that can be used for testing. In particular, it can be used for testing communications devices and communication protocol behaviors.
The present disclosure is directed to systems and methods for operating, designing, testing and verifying the performance of wireless communication devices. Specifically, the present systems and methods can passively attenuate unwanted electromagnetic interference (EMI) without degrading signal quality of predetermined frequency using a novel versatile module including a RF absorbing material in a composite medium surrounding the conducting signal lines. Utilizing varying permeability media, the present invention offer a robust platform to eliminate unwanted noise while maintaining a desirable control and power interfaces used for testing of wireless communication systems.
A system and method for providing assisted manual testing of computer related devices. Test commands are routed from a user system through a proxy module to a device under test. The responses of the device are routed through the proxy module to a user system. A user interface is run on the user system that allows the user to view the responses of the device in a log with the issued test commands. The user interface includes annotation dialog boxes and fields, highlighting elements and flagging elements through which a user can annotate and create notes for the test log as the test is being run on the device. Through the proxy module, a third party can act as a user and view the test log and user created annotations and notes as the test is being run on the device. The test log, annotation and notes can also be stored by the proxy module so that a third party can view them at a later time. The third party can act as a user in issuing commands through the proxy module to be run on the device, thereby assisting in the testing. Additionally, the third party can provide additional notes and annotation to the test log.
G06F 11/00 - Détection d'erreurs; Correction d'erreurs; Contrôle de fonctionnement
G06F 11/263 - Génération de signaux d'entrée de test, p.ex. vecteurs, formes ou séquences de test
G06F 11/22 - Détection ou localisation du matériel d'ordinateur défectueux en effectuant des tests pendant les opérations d'attente ou pendant les temps morts, p.ex. essais de mise en route
93.
Connected vehicle application testing in the laboratory
The technology disclosed relates to testing of connected vehicle systems. The connections involved are sometimes referred to as Car-2-Car (C2C), Vehicle-to-Vehicle (V2V), Car-2-Infrastructure (C2I), or Vehicle-to-Infrastructure (V2I). More generically, the connections are referred to as C2X and V2X. The technology disclosed provides an over the wire simulation of signals that a system will receive in operation, which allows testing of algorithms, breadboards, prototypes and complete systems. The system simulates the position of multiple on board units as the move with the vehicles that carry them. It attenuates signals between the OBUs and can attenuate signals among the OBUs and other test components, including roadside units and synthetic OBUs. The simulation is can be practiced as a method, a device, or computer readable medium that causes a device to practice the method or that, when combined with appropriate hardware, produces the device.
G06F 19/00 - Équipement ou méthodes de traitement de données ou de calcul numérique, spécialement adaptés à des applications spécifiques (spécialement adaptés à des fonctions spécifiques G06F 17/00;systèmes ou méthodes de traitement de données spécialement adaptés à des fins administratives, commerciales, financières, de gestion, de surveillance ou de prévision G06Q;informatique médicale G16H)
A system method and device for evaluating the Quality of Service (QoS) performance of mobile telephone devices in the concurrent performance of different services through a mobile telephone network is provided. In one embodiment, the method comprises establishing a first logical communication channel via the mobile telephone network, communicating first information over the first logical communication channel, establishing a second logical communication channel over a communication network, concurrently with said communicating first information, communicating second information over the second logical communication channel, and determining a plurality of service quality metrics for the first and second information communicated over the first and second logical communication channel.
A method of emulating real world conditions of a radio frequency (RF) signal reaching a device-under-test (DUT) includes exposing the DUT to a cone of RF signal angles of arrival transmitting coordinated RF signals from an antenna array. The antenna array has at least one antenna located at a center of the antenna array and at least three antennas located at substantially equal distance from the center and from each other. Such configuration of the antennas in the antenna array defines a base of the cone to have a range of angles of 20° to 70°. The cone of RF signal angles of arrival and the DUT may be enclosed in a chamber such as an anechoic chamber. The method sets an azimuth angle and/or an elevation angle of the DUT with respect to the transmitted RF signals.
Various embodiments relate to an apparatus that converts between CFP signals and electrical CXP signals. Circuitry compensates for attenuation of a CXP interconnect connected to a CXP transceiver port, and converts between (i) electrical CXP signals of the CXP transceiver port (the electrical CXP signals compliant with the CXP specification), and (ii) CFP signals of the CFP transceiver port (the CFP signals compliant with the CFP specification).
Various example embodiments are directed to systems and methods for managing a plurality of distributed test engines to test at least one device under analysis (DUA). A controller and a control database may be used to manage the plurality of test engines. The control database may have stored thereon a plurality of configuration documents, a plurality of instruction documents, and at least one statistics document. Each configuration document may be associated with at least one of the plurality of test engines and may indicate an execution group of the associated at least one test engine. Each instruction document may be associated with an execution group and may comprise an indication of a testing task to be performed by the execution group associated with the instruction document. The controller may be configured to write to the plurality of configuration documents to assign each of the plurality of test engines to an execution group; write to the plurality of instruction documents to provide, for each execution group, a testing task to be performed by test engines of the execution group on the at least one DUA. The control database may configured to receive from at least a portion of a plurality of test engines an update to the at least one statistics document.
Various example embodiments are directed to scale testing based on scenarios. A computer system may receive a scenario, which may comprise a plurality of scenario objects including, a first host, a second host, a plurality of transports, a plurality of variables and a plurality of steps. The computer system may also receive a pattern. The scenario may be processed to generate a processed scenario. The computer system may execute a first track including executing a plurality of concurrencies of the processed scenario according to the pattern.
A system and method for determining the quality of service in wireless data network by a plurality of mobile devices is provided. In one embodiment, the method includes presenting to a user a plurality of reference content items, for each content item, receiving a reference content item rating indicative of a quality rating provided by the user, wirelessly transmitting a test content item to the mobile device, presenting the transmitted test content item to the user; receiving a test content item rating provided by the user, wherein at least some of the plurality of reference content items comprise content items of known and differing quality, normalizing the test content item rating based on the reference content rating received to provide a normalized test content item rating; and outputting a quality of service performance metric based on the normalized test content item rating.
Various aspects of the disclosed technology relate to the generation for test purposes of test traffic, in a manner compliant with advanced flow control.
G01R 31/00 - Dispositions pour tester les propriétés électriques; Dispositions pour la localisation des pannes électriques; Dispositions pour tests électriques caractérisées par ce qui est testé, non prévues ailleurs
