Network Working Group S. Dasgupta
Request for Comments: 5468 J. de Oliveira
Category: Informational Drexel University
JP. Vasseur
Cisco Systems
April 2009
Performance Analysis of Inter-Domain Path Computation Methodologies
Status of This Memo
This memo provides information for the Internet community. It does
not specify an Internet standard of any kind. Distribution of this
memo is unlimited.
Copyright Notice
Copyright (c) 2009 IETF Trust and the persons identified as the
document authors. All rights reserved.
This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents in effect on the date of
publication of this document (http://trustee.ietf.org/license-info).
Please review these documents carefully, as they describe your rights
and restrictions with respect to this document.
Abstract
This document presents a performance comparison between the per-
domain path computation method and the Path Computation Element (PCE)
Architecture-based Backward Recursive Path Computation (BRPC)
procedure. Metrics to capture the significant performance aspects
are identified, and detailed simulations are carried out on realistic
scenarios. A performance analysis for each of the path computation
methods is then undertaken.
Dasgupta, et al. Informational [Page 1]
RFC 5468 Analysis of Inter-Domain Path Computation April 2009
Table of Contents
1. Introduction ....................................................2
2. Terminology .....................................................3
3. Evaluation Metrics ..............................................4
4. Simulation Setup ................................................5
5. Results and Analysis ............................................6
5.1. Path Cost ..................................................7
5.2. Crankback/Setup Delay ......................................7
5.3. Signaling Failures .........................................8
5.4. Failed TE-LSPs/Bandwidth on Link Failures ..................8
5.5. TE LSP/Bandwidth Setup Capacity ............................8
6. Security Considerations .........................................9
7. Acknowledgment ..................................................9
8. Informative References ..........................................9
1. Introduction
The IETF has specified two approaches for the computation of inter-
domain (Generalized) Multi-Protocol Label Switching ((G)MPLS) Traffic
Engineering (TE) Label Switched Paths (LSP): the per-domain path
computation approach defined in [RFC5152] and the PCE-based approach
specified in [RFC4655]. More specifically, we study the PCE-based
path computation model that makes use of the BRPC method outlined in
[RFC5441]. In the rest of this document, we will call PD and PCE the
per-domain path computation approach and the PCE path computation
approach, respectively.
In the per-domain path computation approach, each path segment within
a domain is computed during the signaling process by each entry node
of the domain up to the next-hop exit node of that same domain.
In contrast, the PCE-based approach and, in particular, the BRPC
method defined in [RFC5441] rely on the collaboration between a set
of PCEs to find to shortest inter-domain path after the computation
of which the corresponding TE LSP is signaled: path computation is
undertaken using multiple PCEs in a backward recursive fashion from
the destination domain to the source domain. The notion of a Virtual
Shortest Path Tree (VSPT) is introduced. Each link of a VSPT
represents the shortest path satisfying the set of required
constraints between the border nodes of a domain and the destination
LSR. The VSPT of each domain is returned by the corresponding PCE to
create a new VSPT by PCEs present in other domains. [RFC5441]
discusses the BRPC procedure in complete detail.
Dasgupta, et al. Informational [Page 2]
RFC 5468 Analysis of Inter-Domain Path Computation April 2009
This document presents some simulation results and analysis to
compare the performance of the above two inter-domain path
computation approaches. Two realistic topologies with accompanying
traffic matrices are used to undertake the simulations.
Note that although the simulation results discussed in this document
have used inter-area networks, they also apply to Inter-AS cases.
Disclaimer: although simulations have been made on different and
realistic topologies showing consistent results, the metrics shown
below may vary with the network topology.
Note that this document refers to multiple figures that are only
available in the PDF version.
2. Terminology
Terminology used in this document:
TE LSP: Traffic Engineered Label Switched Path.
CSPF: Constrained Shortest Path First.
PCE: Path Computation Element.
BRPC: Backward Recursive PCE-based Computation.
AS: Autonomous System.
ABR: Routers used to connect two IGP areas (areas in OSPF or levels
in IS-IS).
ASBR: Routers used to connect together ASes of a different or the
same Service Provider via one or more Inter-AS links.
Border LSR: A border LSR is either an ABR in the context of inter-
area TE or an ASBR in the context of Inter-AS TE.
VSPT: Virtual Shortest Path Tree.
LSA: Link State Advertisement.
LSR: Label Switching Router.
IGP: Interior Gateway Protocol.
TED: Traffic Engineering Database.
Dasgupta, et al. Informational [Page 3]
RFC 5468 Analysis of Inter-Domain Path Computation April 2009
PD: Per-Domain
3. Evaluation Metrics
This section discusses the metrics that are used to quantify and
compare the performance of the two approaches.
o Path Cost. The maximum and average path costs are observed for
each TE LSP. The distributions for the maximum and average path
costs are then compared for the two path computation approaches.
o Signaling Failures. Signaling failures may occur in various
circumstances. With PD, the head-end LSR chooses the downstream
border router (ABR, ASBR) according to some selection criteria
(IGP shortest path, ....) based on the information in its TED.
This ABR then selects the next ABR using its TED, continuing the
process till the destination is reached. At each step, the TED
information could be out of date, potentially resulting in a
signaling failure during setup. In the BRPC procedure, the PCEs
are the ABRs that cooperate to form the VSPT based on the
information in their respective TEDs. As in the case of the PD
approach, information in the TED could be out of date, potentially
resulting in signaling failures during setup. Also, only with the
PD approach, another situation that leads to a signaling failure
is when the selected exit ABR does not have any path obeying the
set of constraints toward a downstream exit node or the TE LSP
destination. This situation does not occur with the BRPC. The
signaling failure metric captures the total number of signaling
failures that occur during initial setup and re-route (on link
failure) of a TE LSP. The distribution of the number of signaling
failures encountered for all TE LSPs is then compared for the PD
and BRPC methods.
o Crankback Signaling. In this document, we made the assumption
that in the case of PD, when an entry border node fails to find a
route in the corresponding domain, boundary re-routing crankback
[RFC4920] signaling was used. A crankback signaling message
propagates to the entry border node of the domain and a new exit
border node is chosen. After this, path computation takes place
to find a path segment to a new entry border node of the next
domain. This causes an additional delay in setup time. This
metric captures the distribution of the number of crankback
signals and the corresponding delay in setup time for a TE LSP
when using PD. The total delay arising from the crankback
signaling is proportional to the costs of the links over which the
signal travels, i.e., the path that is setup from the entry border
node of a domain to its exit border node (the assumption was made
Dasgupta, et al. Informational [Page 4]
RFC 5468 Analysis of Inter-Domain Path Computation April 2009
that link metrics reflect propagation delays). Similar to the
above metrics, the distribution of total crankback signaling and
corresponding proportional delay across all TE LSPs is compared.
o TE LSPs/Bandwidth Setup Capacity. Due to the different path
computation techniques, there is a significant difference in the
amount of TE LSPs/bandwidth that can be set up. This metric
captures the difference in the number of TE LSPs and corresponding
bandwidth that can be set up using the two path computation
techniques. The traffic matrix is continuously scaled and stopped
when the first TE LSP cannot be set up for both the methods. The
difference in the scaling factor gives the extra bandwidth that
can be set up using the corresponding path computation technique.
o Failed TE LSPs/Bandwidth on Link Failure. Link failures are
induced in the network during the course of the simulations
conducted. This metric captures the number of TE LSPs and the
corresponding bandwidth that failed to find a route when one or
more links lying on its path failed.
4. Simulation Setup
A very detailed simulator has been developed to replicate a real-life
network scenario accurately. Following is the set of entities used
in the simulation with a brief description of their behavior.
+------------+-------+-------+--------+--------+---------+----------+
| Domain | # of | # of | OC48 | OC192 | [0,20) | [20,100] |
| Name | nodes | links | links | links | Mbps | Mbps |
+------------+-------+-------+--------+--------+---------+----------+
| D1 | 17 | 24 | 18 | 6 | 125 | 368 |
| D2 | 14 | 17 | 12 | 5 | 76 | 186 |
| D3 | 19 | 26 | 20 | 6 | 14 | 20 |
| D4 | 9 | 12 | 9 | 3 | 7 | 18 |
| MESH-CORE | 83 | 167 | 132 | 35 | 0 | 0 |
| (backbone) | | | | | | |
| SYM-CORE | 29 | 377 | 26 | 11 | 0 | 0 |
| (backbone) | | | | | | |
+------------+-------+-------+--------+--------+---------+----------+
Table 1. Domain Details and TE LSP Size Distribution
o Topology Description. To obtain meaningful results applicable to
present-day Service Provider topologies, simulations have been run
on two representative topologies. They consists of a large
backbone area to which four smaller areas are connected. For the
first topology named MESH-CORE, a densely connected backbone was
obtained from RocketFuel [ROCKETFUEL]. The second topology has a
Dasgupta, et al. Informational [Page 5]
RFC 5468 Analysis of Inter-Domain Path Computation April 2009
symmetrical backbone and is called SYM-CORE. The four connected
smaller areas are obtained from [DEF-DES]. Details of the
topologies are shown in Table 1 along with their layout in Figure
1. All TE LSPs set up on this network have their source and
destinations in different areas and all of them need to traverse
the backbone network. Table 1 also shows the number of TE LSPs
that have their sources in the corresponding areas along with
their size distribution.
o Node Behavior. Every node in the topology represents a router
that maintains states for all the TE LSPs passing through it.
Each node in a domain is a source for TE LSPs to all the other
nodes in the other domains. As in a real-life scenario, where
routers boot up at random points in time, the nodes in the
topologies also start sending traffic on the TE LSPs originating
from them at a random start time (to take into account the
different boot-up times). All nodes are up within an hour of the
start of simulation. All nodes maintain a TED that is updated
using LSA updates as outlined in [RFC3630]. The flooding scope of
the Traffic Engineering IGP updates are restricted only to the
domain in which they originate in compliance with [RFC3630] and
[RFC5305].
o TE LSP Setup. When a node boots up, it sets up all TE LSPs that
originate from it in descending order of size. The network is
dimensioned such that all TE LSPs can find a path. Once set up,
all TE LSPs stay in the network for the complete duration of the
simulation unless they fail due to a link failure. Even though
the TE LSPs are set up in descending order of size from a head-end
router, from the network perspective, TE LSPs are set up in random
fashion as the routers boot up at random times.
o Inducing Failures. For thorough performance analysis and
comparison, link failures are induced in all the areas. Each link
in a domain can fail independently with a mean failure time of 24
hours and be restored with a mean restore time of 15 minutes.
Both inter-failure and inter-restore times are uniformly
distributed. No attempt to re-optimize the path of a TE LSP is
made when a link is restored. The links that join two domains
never fail. This step has been taken to concentrate only on how
link failures within domains affect the performance.
5. Results and Analysis
Simulations were carried out on the two topologies previously
described. The results are presented and discussed in this section.
All figures are from the PDF version of this document. In the
figures, "PD-Setup" and "PCE-Setup" represent results corresponding
Dasgupta, et al. Informational [Page 6]
RFC 5468 Analysis of Inter-Domain Path Computation April 2009
to the initial setting up of TE LSPs on an empty network using the
per-domain and the PCE approach, respectively. Similarly, "PD-
Failure" and "PCE-Failure" denote the results under the link failure
scenario. A period of one week was simulated and results were
collected after the transient period. Figure 2 and Figure 3
illustrate the behavior of the metrics for topologies MESH-CORE and
SYM-CORE, respectively.
5.1. Path Cost
Figures 2a and 3a show the distribution of the average path cost of
the TE LSPs for MESH-CORE and SYM-CORE, respectively. During the
initial setup, roughly 40% of TE LSPs for MESH-CORE and 70% of TE
LSPs for SYM-CORE have path costs greater with PD (PD-Setup) than
with the PCE approach (PCE-Setup). This is due to the ability of the
BRPC procedure to select the inter-domain shortest constrained paths
that satisfy the constraints. Since the per-domain approach to path
computation is undertaken in stages where every entry border router
to a domain computes the path in the corresponding domain, the most
optimal (shortest constrained inter-domain) route is not always
found. When failures start to take place in the network, TE LSPs are
re-routed over different paths resulting in path costs that are
different from the initial costs. PD-Failure and PCE-Failure in
Figures 2a and 3a show the distribution of the average path costs
that the TE LSPs have over the duration of the simulation with link
failures occurring. Similarly, the average path costs with the PD
approach are much higher than the PCE approach when link failures
occur. Figures 2b and 3b show similar trends and present the maximum
path costs for a TE LSP for the two topologies, respectively. It can
be seen that with per-domain path computation, the maximum path costs
are larger for 30% and 100% of the TE LSPs for MESH-CORE and SYM-
CORE, respectively.
5.2. Crankback/Setup Delay
Due to crankbacks that take place in the per-domain approach of path
computation, TE LSP setup time is significantly increased. This
could lead to Quality-of-Service (QoS) requirements not being met,
especially during failures when re-routing needs to be quick in order
to keep traffic disruption to a minimum (for example in the absence
of local repair mechanisms such as defined in [RFC4090]). Since
crankbacks do not take place during path computation with a PCE,
setup delays are significantly reduced. Figures 2c and 3c show the
distributions of the number of crankbacks that took place during the
setup of the corresponding TE LSPs for MESH-CORE and SYM-CORE,
respectively. It can be seen that all crankbacks occurred when
failures were taking place in the networks. Figures 2d and 3d
illustrate the "proportional" setup delays experienced by the TE LSPs
Dasgupta, et al. Informational [Page 7]
RFC 5468 Analysis of Inter-Domain Path Computation April 2009
due to crankbacks for the two topologies. It can be observed that
for a large proportion of the TE LSPs, the setup delays arising out
of crankbacks are very large, possibly proving to be very detrimental
to QoS requirements. The large delays arise out of the crankback
signaling that needs to propagate back and forth from the exit border
router of a domain to its entry border router. More crankbacks occur
for SYM-CORE as compared to MESH-CORE as it is a very "restricted"
and "constrained" network in terms of connectivity. This causes a
lack of routes and often several cycles of crankback signaling are
required to find a constrained path.
5.3. Signaling Failures
As discussed in the previous sections, signaling failures occur
either due to an outdated TED or when a path cannot be found from the
selected entry border router. Figures 2e and 3e show the
distribution of the total number of signaling failures experienced by
the TE LSPs during setup. About 38% and 55% of TE LSPs for MESH-CORE
and SYM-CORE, respectively, experience a signaling failures with per-
domain path computation when link failures take place in the network.
In contrast, only about 3% of the TE LSPs experience signaling
failures with the PCE method. It should be noted that the signaling
failures experienced with the PCE correspond only to the TEDs being
out of date.
5.4. Failed TE-LSPs/Bandwidth on Link Failures
Figures 2f and 3f show the number of TE LSPs and the associated
required bandwidth that fail to find a route when link failures are
taking place in the topologies. For MESH-CORE, with the per-domain
approach, 395 TE LSPs failed to find a path corresponding to 1612
Mbps of bandwidth. For PCE, this number is lesser at 374
corresponding to 1546 Mbps of bandwidth. For SYM-CORE, with the per-
domain approach, 434 TE LSPs fail to find a route corresponding to
1893 Mbps of bandwidth. With the PCE approach, only 192 TE LSPs fail
to find a route, corresponding to 895 Mbps of bandwidth. It is
clearly visible that the PCE allows more TE LSPs to find a route thus
leading to better performance during link failures.
5.5. TE LSP/Bandwidth Setup Capacity
Since PCE and the per-domain path computation approach differ in how
path computation takes place, more bandwidth can be set up with PCE.
This is primarily due to the way in which BRPC functions. To observe
the extra bandwidth that can fit into the network, the traffic matrix
was scaled. Scaling was stopped when the first TE LSP failed to set
up with PCE. This metric, like all the others discussed above, is
topology dependent (therefore, the choice of two topologies for this
Dasgupta, et al. Informational [Page 8]
RFC 5468 Analysis of Inter-Domain Path Computation April 2009
study). This metric highlights the ability of PCE to fit more
bandwidth in the network. For MESH-CORE, on scaling, 1556 Mbps more
could be set up with PCE. In comparison, for SYM-CORE, this value is
986 Mbps. The amount of extra bandwidth that can be set up on SYM-
CORE is lesser due to its restricted nature and limited capacity.
6. Security Considerations
This document does not raise any security issues.
7. Acknowledgment
The authors would like to acknowledge Dimitri Papadimitriou for his
helpful comments to clarify the text.
8. Informative References
[DEF-DES] J. Guichard, F. Le Faucheur, and J.-P. Vasseur,
"Definitive MPLS Network Designs", Cisco Press, 2005.
[RFC5152] Vasseur, JP., Ed., Ayyangar, A., Ed., and R. Zhang, "A
Per-Domain Path Computation Method for Establishing
Inter-Domain Traffic Engineering (TE) Label Switched
Paths (LSPs)", RFC 5152, February 2008.
[RFC5441] Vasseur, JP., Zhang, R., Bitar, N., and JL. Le Roux, "A
Backward Recursive PCE-Based Computation (BRPC)
Procedure to Compute Shortest Constrained Inter-Domain
Traffic Engineering Label Switched Paths", RFC 5441,
April 2009.
[RFC3630] Katz, D., Kompella, K., and D. Yeung, "Traffic
Engineering (TE) Extensions to OSPF Version 2", RFC
3630, September 2003.
[RFC5305] Li, T. and H. Smit, "IS-IS Extensions for Traffic
Engineering", RFC 5305, October 2008.
[RFC4090] Pan, P., Ed., Swallow, G., Ed., and A. Atlas, Ed., "Fast
Reroute Extensions to RSVP-TE for LSP Tunnels", RFC
4090, May 2005.
[RFC4655] Farrel, A., Vasseur, J.-P., and J. Ash, "A Path
Computation Element (PCE)-Based Architecture", RFC 4655,
August 2006.
Dasgupta, et al. Informational [Page 9]
RFC 5468 Analysis of Inter-Domain Path Computation April 2009
[RFC4920] Farrel, A., Ed., Satyanarayana, A., Iwata, A., Fujita,
N., and G. Ash, "Crankback Signaling Extensions for MPLS
and GMPLS RSVP-TE", RFC 4920, July 2007.
[ROCKETFUEL] N. Spring, R. Mahajan, and D. Wehterall, "Measuring ISP
Topologies with Rocketfuel", Proceedings of ACM SIGCOMM,
2002.
Authors' Addresses
Sukrit Dasgupta
Drexel University
Dept of ECE, 3141 Chestnut Street
Philadelphia, PA 19104
USA
Phone: 215-895-1862
EMail: sukrit@ece.drexel.edu
URI: www.pages.drexel.edu/~sd88
Jaudelice C. de Oliveira
Drexel University
Dept. of ECE, 3141 Chestnut Street
Philadelphia, PA 19104
USA
Phone: 215-895-2248
EMail: jau@ece.drexel.edu
URI: www.ece.drexel.edu/faculty/deoliveira
JP Vasseur
Cisco Systems
1414 Massachussetts Avenue
Boxborough, MA 01719
USA
EMail: jpv@cisco.com
Dasgupta, et al. Informational [Page 10]