Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OTG: Move ConfigureATE before ConfigureDUT #2012

Open
wants to merge 51 commits into
base: main
Choose a base branch
from

Conversation

ANISH-GOTTAPU
Copy link
Contributor

@ANISH-GOTTAPU ANISH-GOTTAPU commented Aug 14, 2023

A vendor has indicated that when we execute TE 3.5 and then TE 6.2 one after the other, a problem arises where the test fails to resolve the ARP. The underlying reason for this issue is that the OTG system retains configurations from TE 3.5, causing the DUT to attempt a GARP for an IP that was recently configured on the interface.

This was jointly discussed with the vendor where this failure was seen, Configuring the ATE before the DUT resolves the issue.
The same is applicable for most of the tests, we are doing the same for multiple tests in this PR

resolves #743
resolves #574
resolves #733
resolves #577
resolves #573
resolves #596
resolves #572
resolves #560
resolves #563
resolves #564
resolves #1452
resolves #570
resolves #571
Resolves #796
Resolves #1077
Resolves #1102
Resolves #1149
Resolves #982
Resolves #1209
Resolves #1328
Resolves #1150
Resolves #589
Resolves #620
Resolves #725
Resolves #633
Resolves #895
Resolves #881
Resolves #1004
Resolves #893
Resolves #909
Resolves #814
Resolves #1445
Resolves #1700
Resolves #894
Resolves #588
Resolves #1329
Resolves #1193

@OpenConfigBot
Copy link

OpenConfigBot commented Aug 14, 2023

Pull Request Functional Test Report for #2012 / 5457d4f

Virtual Devices

Device Test Test Documentation Job Raw Log
Arista cEOS status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Cisco 8000E status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Cisco XRd status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Juniper ncPTX status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Nokia SR Linux status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Openconfig Lemming status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection

Hardware Devices

Device Test Test Documentation Raw Log
Arista 7808 status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Cisco 8808 status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Juniper PTX10008 status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection
Nokia 7250 IXR-10e status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
status
TE-14.1: gRIBI Scaling
DP-1.7: One strict priority queue traffic test
P4RT-7.2: LLDP: PacketOut
P4RT-5.1: Traceroute: PacketIn
TE-4.1: Base Leader Election
TE-5.1: gRIBI Get RPC
DP-1.4: QoS Interface Output Queue Counters
P4RT-7.1: LLDP: PacketIn
RT-3.1: Policy based VRF selection
TE-3.1: Base Hierarchical Route Installation
TE-15.1: gRIBI Compliance
P4RT-1.2: P4RT Daemon Failure
DP-1.8: Two strict priority queue traffic test
RT-1.2: BGP Policy & Route Installation
TE-11.1: Backup NHG: Single NH
P4RT-5.2: Traceroute Packetout
TE-8.2: Supervisor Failure
RT-1.5: BGP Prefix Limit
P4RT-1.1: Base P4RT Functionality
P4RT-3.1: Google Discovery Protocol: PacketIn
DP-1.9: WRR traffic test
TE-8.1: DUT Daemon Failure
TE-3.6: ACK in the Presence of Other Routes
DP-1.14: QoS basic test
TE-4.2: Persistence Mode
TE-6.2: Route Removal In Non Default VRF
TE-6.1: Route Removal via Flush
DP-1.11: Bursty traffic test
RT-1.10: BGP Keepalive and HoldTimer Configuration Test
TE-13.1: gRIBI route ADD during Failover
P4RT-6.1: Required Packet I/O rate: Performance
gNMI-1.10: Telemetry: Basic Check
DP-1.10: Mixed strict priority and WRR traffic test
RT-1.3: BGP Route Propagation
TE-13.2: gRIBI route DELETE during Failover
TE-1.2: My Station MAC
RT-3.2: Multiple <Protocol, DSCP> Rules for VRF Selection

Help

@ANISH-GOTTAPU ANISH-GOTTAPU marked this pull request as draft August 22, 2023 15:55
@coveralls
Copy link

coveralls commented Aug 23, 2023

Pull Request Test Coverage Report for Build 9321626806

Details

  • 0 of 0 changed or added relevant lines in 0 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage remained the same at 55.5%

Totals Coverage Status
Change from base Build 9313491262: 0.0%
Covered Lines: 1983
Relevant Lines: 3573

💛 - Coveralls

@ANISH-GOTTAPU ANISH-GOTTAPU marked this pull request as ready for review September 11, 2023 13:22
octpetre and others added 29 commits November 8, 2023 16:20
- removed unused params
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
4 participants