Está en la página 1de 36

KPI LIBRARY

KPIBASEDACCEPTANCE

Introduction
The most important part of any acceptance (giving thumbs up or down from the customer) is the level of the required thresholds, can they be reached and how much effort is needed to reach them. Each of these tricky thresholds (KPI) can increase financial risk significantly. Thats why we have to approach the KPI issue with extreme caution and always bear in mind potential financial implications. If the number of KPIs, or the scope of measurement (method, area, success criteria) is large, the collection and post processing of data, can be time and resource consuming. On the other hand, KPI targets are sometimes so high that they are almost impossible to achieve. Furthermore, if the acceptance and exclusion criteria are not well defined, a lot of effort will need to be put into the tuning and optimization activities in order to bring the network to an acceptable condition. This document lists the set of KPIs that should be measured, the way that they should be measured and the commercial impact of this. If the customer is asking for an alternative KPI, the arguments against the alternative and potential risk analysis will also be found in this document. Special attention has been paid to the calculation of the number of samples needed to reach certain KPI levels. The number of samples directly affects the measurement time and the number of resources involved, hence it also affects the cost of the acceptance procedure. These variables will dictate the types of services that are necessary to perform, and the amount of time and effort needed to collect the data necessary to achieve the targets.

How to use the KPI Library


The document can be used during the entire sales process. Before the actual contract negotiation, the document is valuable for understanding the Ericsson KPI and acceptance approach. During this phase, it is possible to influence the customer to adopt the Ericsson way of thinking. When the customers acceptance proposal is on the table, the document can be used as a cook-book in order to assess the differences between the methodologies and to assess the risks. If the risks are too big to accept, the document offers argumentation why another set of KPIs, or measurement areas, or exclusion criteria should be used.

It is of utmost importance to understand that KPI values (targets) and questions like can we achieve 99% should not be considered as simple yes or no type of technical question. Pure values (targets) are just one of the variables in Ericssons strategy and approach in how to handle KPIs in a structured way. The KPI Library contains very sensitive internal information and none of its contents should be open to customers.

KPI Library Content


KPIs in the library are divided according to the Ericsson KPI handling strategy mapped on ITU-T and ETSI specifications:
Quality of Service (QoS)

Service Accessibilty

Service Retainability

Service Integrity

QoS Network Performance

Features & Functionalities

Design& Resources Dimensioning & Facilities

Reliability Performance Performance Monitoring (Nodes, System)

O&M Maintainabilty (Node, system Performance Availability)

Maintenance Support SLAs Performance

Interfaces, Transmission Transmission Performance and Transport

Availablity Performance

Contractual KPIs are classified into: Recommended (QoS most used services) Optional (QoS - most used services) Not Recommended (Network Performance PIs, other QoS services)

In this document main focus will be detailed description of Recommended and Optional KPIs.

Fields Description
Field Name Description KPI Range/Value a: Recommendation b: User Impact c: Area 1) Completion 2)Accessibility 3)Retainability 4)Integrity 5)Mobility 6)Others

Number

Structured No of KPI (a.b.c)

Area

The main six areas for performance monitoring

Name SW Release Recommendation

KPI Name Applicable SW release Contractual classification of the KPI according to the Ericsson KPI strategy and ITU-T / ETSI specification. GENERAL Description of the meaning of the KPI and how the formula is built; Description of all the counters included in the formula and their triggering conditions; Eventual comments or notes about KPI inconsistency or statistical limit. Some tips about aggregation method. Drive Test (general) formula High level formula used for statistics (Counter based) CONTRACTUAL INFORMATION Defines relevance of the KPI to the end user experience (i.e. Drop call high) Important contractual implications linked to the specific KPI, like what network elements are impacting the KPIs or if KPI can replace other KPI(s). MEASUREMENT Description on how to perform the measurement Defines applicable Acceptance measurement area for the KPI Defines KPI Domains as per KPI strategy and ITU-T and ETSI specifications Details on measurement execution (call sequences, start stop triggers..) for Drive tests and Statistics. Pre requisites to start the measurement like Known limitations and data exclusion (number of samples, confidence intervals..) TARGETS AND IMPLICATIONS Verbal argumentation to support Sales in the commercial phase handling risk. Required design and performance improvement services needed for specific KPI contractual commitment. Design; Initial Tuning; Optimization.. Drive Test; Counters Golden Cluster; All Cluster; QoS; Network Performance/(sub levels) i.e. WCDMA RAN P6 Recommended; Optional; Not Recommended

Definition

Formula Alternative Formula

User Impact Contractual Information

High; Medium; Low

Method Measurement Area

KPI Domain

Measurement Execution

Entry and Exit Criteria

Conditions/Commercial Implication Required Services/Prerequisites

4.1

Recommended KPIs
No 1 2 3 4 5 6 Recommended KPI Call Completion Success Rate Speech (CCSR Speech) Call Completion Success Rate CS64 (CCSR Video) Call Completion Success Rate PS (CCSR PS) PS Interactive R99 User Throughput (User Throughput R99) PS Interactive HSDPA User Throughput (User Throughput HSDPA) PS Interactive EUL User Throughput (User Throughput EUL) User Impact High High High High High High

KPI
No Area Name SW Rel Recommendation

1.1.1.
Definition

Completion

Call Completion Success Rate Speech (CCSR Speech) GENERAL

P6

Recommended

The Call Completion Success Rate Speech (CCSR Speech) is defined as the ratio of successful normal call disconnections, divided by the total number of call setup attempts for speech calls. It is the probability of successfully initiating, holding and then terminating a speech call from an end user perspective. CCSR Speech measured by Drive tests, presents proportion of speech calls which are successfully setup, held and released by the initiating party. Calculated with Counter Statistics, CCSR Speech is a product of Accessibility [Call Setup Success Rate (CSSR) Speech] and Retainability [1 - Drop Call Rate (DCR) Speech] within a cell or RNC.
Formula

Alternative Formula

CONTRACTUAL INFORMATION
User Impact Contractual Information

KPI REDUCTION: Can replace Accessibility (CSSR Speech) and Retainability (1-DCR Speech) KPIs. High KPI Impacted by Radio Env. RAN nodes, CS Core nodes and interfaces MEASUREMENT
Method Measurement Area KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test with call sequences (120s or 180s) set up from idle mode. The terminating party shall be fixed test line. Start Trigger: Call Attempt or first RRC Connection Request Stop Trigger: Disconnect UL (normal call clearing) STATISTICS: Counters for Speech Accessibility and Speech Retainability agregated on Cell or RNC level.
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 2% - 200 samples needed - 7 h (120s call) or 10h (180s call) of DT measurements with a target of 98% To reach Confidence Interval +/- 1% - 700 samples needed - 25 h (120s call) or 35h (180s call) of DT measurements with a target of 98% STATISTICS: With low sample size it is possible to have CCSR > 100% (terminations greater than new calls) To reach Confidence Interval +/- 2% - 200 samples needed with target 98% TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: MTM calls to be avoided - to exclude faults and radio environment impact from the terminating party STATISTICS : High value warning: To reach CCSR of 99% CSSR should be 99.5% and DCR 0.5% Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned (no data) KPI
No Area Name

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting 4) Optimization (Statistics)

SW Rel

Recommendation

1.1.1.
Definition

Completion

Call Completion Success Rate CS64 (CCSR Video) GENERAL

P6

Recommended

The Call Completion Success Rate CS64 (CCSR Video) is defined as the ratio of successful normal call disconnections, divided by the total number of call setup attempts for video calls. It is the probability of successfully initiating, holding and then terminating a video call from an end user perspective. CCSR Video measured by Drive tests, presents proportion of speech calls which are successfully setup, held and released by the initiating party. Calculated with Counter Statistics, CCSR Video is a product of Accessibility [Call Setup Success Rate (CSSR) Video] and Retainability [1 - Drop Call Rate (DCR) Video] within a cell or RNC.
Formula

CCSR(Video) =

Alternative Formula

# Normal _ Video _ Call _ Disconnections #Video _ Call _ Attempts


# RRC _ Success # RAB _ Success # RAB _ Normal _ Re lease # RRC _ Attempt # RAB _ Attempt # RAB _ Normal _ Re lease+ # RAB _ Abnormal _ Re lease
CONTRACTUAL INFORMATION
Contractual Information

CCSR (Video) =
User Impact

KPI REDUCTION: Can replace Accessibility (CSSR Video) and Retainability (1-DCR Video) KPIs. High KPI Impacted by Radio Env RAN nodes, CS Core nodes, MEASUREMENT
Method Measurement Area KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test with call sequences (120s or 180s) set up from idle mode. Terminating party is static 3G phone in good radio Env. Start Trigger: Call Attempt or first RRC Connection Request Stop Trigger: Disconnect UL (normal call clearing) STATISTICS: Counters for Speech Accessibility and Speech Retainability aggregated on Cell or RNC level.
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 2% - 200 samples needed - 7 h (120s call) or 10h (180s call) of DT measurements with a target of 98% To reach Confidence Interval +/- 1% - 700 samples needed - 25 h (120s call) or 35h (180s call) of DT measurements with a target of 98% STATISTICS: With low sample size it is possible to have CCSR > 100% (terminations greater than new calls) To reach Confidence Interval +/- 2% - 200 samples needed with target 98% TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Impacts on the drive test route as Video Calls are unable to perform a IRAT handover to a GSM network and abnormal releases may occur on the cluster edges COUNTER STATISTICS : High value warning: To reach CCSR of 98% CSSR should be 99% and DCR 1%. Network traffic is traditionally low for this KPI and statistical performance fluctuates. Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned (no data) KPI
No Area Name

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting 4) Optimization (Statistics)

SW Rel

Recommendation

1.1.1.
Definition

Completion

Call Completion Success Rate PS (CCSR PS) GENERAL

P6

Recommended

The Call Completion Success Rate PS (CCSR PS) is defined as the ratio of successful normal call disconnections, divided by the total number of call setup attempts for packet calls. It is the probability of successfully initiating, holding and then terminating a packet connection from an end user perspective. CCSR PS is independent of the throughput of any download, either HTTP or FTP or UDP. The KPI is the ability of the network to setup and maintain a packet radio access bearer independent of the user session on the bearer. Session errors (caused by FTP problems, user aborted, etc) should not be counted unless the radio access bearer is also abnormally released or there is an abnormal transition to idle. CCSR PS measured by Drive tests, presents proportion of sessions which are successfully setup, held and released by the initiating party. Calculated with Counter Statistics, CCSR PS is a product of Accessibility [Call Setup Success Rate (CSSR) PS] and Retainability [1 - Drop Call Rate (DCR) PS] within a cell or RNC.
Formula

CCSR ( PS ) =

Alternative Formula

# Normal _ PS _ Call _ Disconnections # PS _ Call _ Attempts


# RRC _ Success # RAB _ Success # RAB _ Normal _ Re lease # RRC _ Attempt # RAB _ Attempt # RAB _ Normal _ Re lease+ # RAB _ Abnormal _ Re lease
CONTRACTUAL INFORMATION
Contractual Information

CCSR ( PS ) =
User Impact

High

KPI REDUCTION: Can replace Accessibility (CSSR PS) and Retainability (1-DCR PS) KPIs. Merges all PS Services for Call Completion together, including CCSR PS (R99), CCSR PS (HSDPA) and CCSR PS (EUL) KPI Impacted by Radio, M-PBN and PS nodes; many factors outside E/// control MEASUREMENT

Method

Measurement Area

KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test downloading a 5MB file (FTP). The terminating party is a FTP server attached to the GGSN Start Trigger: Call Attempt or first RRC Connection Request Stop Trigger: Deactivate PDP Context UL (normal packet clearing) COUNTER STATISTICS: Counters for Packet Accessibility and Packet Retainability aggregated on Cell or RNC level
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 1.8% - 180 samples needed - 11 h of DT measurements (R99; avg throughput 200kbps) with a target of 98% To reach Confidence Interval +/- 1.8% - 180 samples needed - 2 h of DT measurements (HS; throughput 1.5Mbps) with a target of 98% STATISTICS: With low sample size it is possible to have CCSR > 100% (terminations greater than new calls) TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Calls to internet servers be avoided many components can be outside E/// responsibility STATISTICS : High value warning: To reach CCSR of 99% CSSR should be 99.5% and DCR 0.5% Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned (no data) KPI

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting (E2E) 4) Optimization (Statistics)

No

Area

Name

SW Rel

Recommendation

1.1.5.
Definition

Integrity

PS Interactive R99 User Throughput DL (User Throughput R99 DL) GENERAL

P6

Recommended

The Packet-Switched Interactive R99 User Throughput (User Throughput R99) is the average user throughput for PS Data in Downlink evaluation (kbps) on a R99 DCH/FACH Radio Bearer. It includes user data but excluding retransmissions, padding bits, data PDU headers and RLC control PDU's. The most accurate method to measure User Throughput R99 is by Drive tests. The download file size divided by the time to complete the download and then taken as the indicator of user throughput. For high target throughput values, static tests are preferred. Calculated with Counter Statistics, User Throughput R99 is a ratio of the sampled RLC throughput measurements (including user data but excluding retransmissions, padding bits, data PDU headers and RLC control PDU's) in kbits/s divided by the number of times data was transmitted in the cell
Formula

User _ Throughput _( R99) =


Alternative Formula

RLC _ SDU _ Data(kb) RLC _ SDU _ Duration

User _ Throughput _( R99) =


User Impact

Download _ File _ Size _ in _ kbits Session _ End _ Time(s) Session _ Start _ Time(s)

CONTRACTUAL INFORMATION

Contractual Information

KPI REDUCTION: None High KPI Impacted by Radio Env. RAN nodes, PS Core nodes; big variations between Drive test and Statistics measurement. MEASUREMENT
Measurement Area KPI Domain

Method

Drive Test/Statistics
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test with call sequences downloading a file (5MB or 10MB) set up from idle mode. The terminating party is ideally a UDP server attached to the GGSN within the operator domain. Start Trigger: Time for Session Start for the download Stop Trigger: Time for Session End for the download STATISTICS: Counters for Packet Throughput are calculated on a per RAB basis for R99 DCH PS Interactive Traffic No IP losses shall exist. Tested by conducting at least 1000 ping commands from the UE to the test server, where all shall be successful. There are no Transmission or Core limitations to maximum user throughput.
Entry and Exit Criteria

STATISTICS: Using counter statistics, the user throughput is dependant on the file sizes being downloaded by all end users in the network. Smaller file size downloads would result in lower counter statistic throughputs, and therefore network counters could reflect an inaccurate perception of the network. TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

GENERAL: Big deviations between Drive test results (mostly high speeds) and Statistics(low speeds in average)!! As many operators have HS enabled Statistics (average throughput) goes down!! DRIVE TESTS:Usually FTP big files in tuned areas (mostly on 384 RAB) achieving speeds above 250 kbps STATISTICS: Averaged, mostly HTTP where there is no need for high speeds (internet site downloaded before switching to 384) and also transitions from HS to 64. Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned (no data) KPI
No Area Name

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting 4) Optimization (Statistics)

SW Rel

Recommendation

1.1.5.
Definition

Integrity

PS Interactive HSDPA User Throughput (User Throughput HSDPA) GENERAL

P6

Recommended

The PS Interactive HSDPA User Throughput (User Throughput HSDPA) is the average user throughput for PS Data in Downlink or Uplink evaluation (kbps) on a HSDPA Radio Bearer. It includes user data but excluding retransmissions, padding bits, data PDU headers and RLC control PDU's. The most accurate method to measure User Throughput HSDPA is by Drive tests. The download file size divided by the time to complete the download and taken as the indicator of user throughput. For high target throughput values, static tests are preferred. Calculated with Counter Statistics, User Throughput HSDPA is a ratio of the sampled RLC throughput measurements (including user data but excluding retransmissions, padding bits, data PDU headers and RLC control PDU's) in kbits/s divided by the number of times data was transmitted in the cell
Formula

User _ Throughput _( HSDPA) =


Alternative Formula

RLC _ SDU _ Data(kb) RLC _ SDU _ Duration

User _ Throughput _( HSDPA) =


User Impact

Download _ File _ Size _ in _ kbits Session _ End _ Time( s) Session _ Start _ Time(s)

CONTRACTUAL INFORMATION

Contractual Information

KPI REDUCTION: None High KPI Impacted by Radio Env. RAN nodes, PS Core nodes; big variations between Drive test and Statistics measurement. Feature dependent (Dyn Code allocation). MEASUREMENT
Measurement Area KPI Domain

Method

Drive Test/Statistics
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test with call sequences downloading a file (50MB) set up from idle mode. The terminating party is ideally a UDP server attached to the GGSN within the operator domain. Start Trigger: Time for Session Start for the download Stop Trigger: Time for Session End for the download STATISTICS: Counters for Packet Throughput are calculated on a per RAB basis for HSDPA PS Interactive Traffic and agregated on Cell or RNC level.
Entry and Exit Criteria

STATISTICS: Using counter statistics, the user throughput is dependant on the file sizes being downloaded by all end users in the network. Smaller file size downloads would result in lower counter statistic throughputs, and therefore network counters could reflect an inaccurate perception of the network. No IP losses shall exist. Tested by conducting at least 1000 ping commands from the UE to the test server, where all shall be successful. There are no Transmission or Core limitations to maximum user throughput. TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

GENERAL: Big deviations between Drive test results (mostly high speeds achieved) and Statistics (low speeds in average)!! HSDPA UE Category Dependancy affects the maximum end user throughput DRIVE TESTS: Handover attempts to 2G cells are to be avoided or mitigated in the KPI Analysis as the throughput will be degraded. Ericsson Controlled Environment Best In Class (NETQB) / Optimized

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting 4) Optimization (Statistics)

Results in Ericsson Controlled Environment is for UE Category 7/8. Average (NetQB) / Tuned Pre launched / Initially Tuned (no data) KPI
No Area Name SW Rel Recommendation

1.1.5.
Definition

Integrity

PS Interactive EUL User Throughput (User Throughput EUL) GENERAL

P6

Recommended

The PS Interactive EUL User Throughput (User Throughput EUL) is the average user throughput for PS Data in Uplink evaluation (kbps) on a EUL Radio Bearer. It includes user data but excluding retransmissions, padding bits, data PDU headers and RLC control PDU's. The most accurate method to measure User Throughput EUL is by Drive tests. The upload file size divided by the time to complete the upload and taken as the indicator of user throughput. For high target throughput values, static tests are preferred. Calculated with Counter Statistics, User Throughput EUL is a ratio of the sampled RLC throughput measurements (including user data but excluding retransmissions, padding bits, data PDU headers and RLC control PDU's) in kbits/s divided by the number of times data was transmitted in the cell
Formula

User _ Throughput _( EUL) =


Alternative Formula

RLC _ SDU _ Data(kb) RLC _ SDU _ Duration

User _ Throughput _( EUL) =


User Impact

Upload _ File _ Size _ in _ kbits Session _ End _ Time( s) Session _ Start _ Time( s)

CONTRACTUAL INFORMATION

Contractual Information

KPI REDUCTION: None High Highly Feature Dependant: KPI Impacted by Radio Env. RAN nodes, PS Core nodes, Transmission Capacity, RBS Hardware; big variations between Drive test and Statistics measurement. MEASUREMENT
Measurement Area KPI Domain

Method

Drive Test/Statistics
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test with call sequences downloading a file (1MB or 5MB) set up from idle mode. The terminating party is ideally a UDP server attached to the GGSN within the operator domain. Start Trigger: Time for Session Start for the upload (or when the first acknowledgement of a user data packet is received in the UE.) Stop Trigger: Time for Session End for the upload (or when the last acknowledgement of a user data packet is received in the UE.) STATISTICS: Counters for Packet Throughput are calculated on a per RAB basis for EUL PS Interactive and aggregated on Cell or RNC level.
Entry and Exit Criteria

GENERAL: No IP losses shall exist. Tested by conducting at least 1000 ping commands from the UE to the test server, where all shall be successful. There are no Transmission or Core limitations to maximum user throughput. STATISTICS: Using counter statistics, the user throughput is dependant on the file sizes being downloaded by all end users in the network. Smaller file size downloads would result in lower counter statistic throughputs, and therefore network counters could reflect an inaccurate perception of the network. TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

GENERAL: Big deviations between Drive test results (mostly high speeds achieved) and Statistics (low speeds in average)!! DRIVE TESTS: Handover attempts to 2G cells are to be avoided or mitigated in the KPI Analysis as the throughput will be degraded. Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned (no data)

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting 4) Optimization (Statistics)

4.2

Optional KPIs
No 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 Optional KPI Call Setup Success Rate Speech (CSSR Speech) Drop Call Rate Speech (DCR Speech) Call Setup Success Rate CS64 (CSSR CS64) Drop Call Rate CS64 (DCR CS64) Call Setup Success Rate PS (CSSR PS) Drop Call Rate PS (DCR PS) Call Setup Time Speech (CST Speech) BLER Quality Speech Uplink (BLER Speech) Call Setup Time CS64 (CST CS64) BLER Quality CS64 Uplink (BLER CS64) Call Setup Success Rate PS R99 (CSSR PS R99) Call Setup Success Rate PS HSDPA (CSSR PS HSDPA) Call Setup Success Rate PS EUL (CSSR PS EUL) Drop Call Rate PS R99 (DCR PS R99) Drop Call Rate PS HSDPA (DCR PS HSDPA) Drop Call Rate PS EUL (DCR PS EUL) Minutes per Drop PS Interactive (MPD PS) IRAT Handover Success Rate Speech (IRAT Speech) IRAT Cell Change Success Rate for PS Interactive (IRATCC PS) BLER Quality PS Uplink (BLER PS) PDP Context Activation Time PS (PDP Act Time PS) PS Interactive R99 User Throughput UL (User Throughput R99 UL) User Impact High High High High High High Medium Medium Medium Medium Medium Medium Medium Medium Medium Medium Medium Medium Medium Medium Medium Medium

KPI
No Area Name SW Rel Recommendation

2.1.2.
Definition

Accessibility

Call Setup Success Rate Speech (CSSR Speech) GENERAL

P6

Optional

The Call Setup Success Rate Speech (CCSR Speech) is defined as the ratio of successful call setups, divided by the total number of call setup attempts for speech calls. It is the probability of successfully initiating a speech call from an end user perspective. CSSR Speech measured by Drive tests, presents the proportion of speech calls which are successfully setup by the initiating party. Calculated with Counter Statistics, CCSR Speech is a product of the RRC Setup Success Rate and the RAB Setup Success Rate for Speech within a cell or RNC.
Formula

CSSR( Speech) =

Alternative Formula

# Successful _ Speech _ Call _ Setups # Speech _ Call _ Attempts


# RRC _ Success # RAB _ Success # RRC _ Attempt # RAB _ Attempt
CONTRACTUAL INFORMATION
Contractual Information

CSSR( Speech) =
User Impact

KPI REDUCTION: Can replace RRC Accessibility CS and RAB Accessibility Speech KPIs. High KPI Impacted by Radio Env. RAN nodes, CS Core nodes, Transmission Capacity; and interfaces MEASUREMENT
Method Measurement Area KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test with call sequences (20s) set up from idle mode. The terminating party shall be fixed test line. Start Trigger: Call Attempt or first RRC Connection Request UL Stop Trigger: Alerting DL STATISTICS: Counters for RRC Accessibility CS and RAB Accessibility Speech on Cell or RNC level.
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 1% - 400 samples needed - 4.4 h (20s call) of DT measurements with a target of 99% To reach Confidence Interval +/- 0.5% - 1500 samples needed - 16.7 h (20s call) or DT measurements with a target of 99% STATISTICS: To reach Confidence Interval +/- 0.5% - 1500 samples needed with target 99% TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: MTM calls to be avoided - to exclude faults and radio environment impact from the terminating party STATISTICS : High value warning: To reach CSSR of 99%, RRC Setup Success should be 99.5% and RAB Setup Success should be 99.5% Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting 4) Optimization (Statistics)

KPI
No Area Name SW Rel Recommendation

2.1.3.
Definition

Retainability

Drop Call Rate Speech (DCR Speech) GENERAL

P6

Optional

The Drop Call Rate Speech (DCR Speech) is defined as the ratio of abnormal call disconnections, divided by the total number of successful call setups for speech calls. It is the probability of successfully holding and terminating a call once it has been successfully initiated. DCR Speech measured by Drive tests, presents the proportion of speech calls which are successfully released after a specified holding time from when the call was successfully setup. Calculated with Counter Statistics, DCR Speech is the ratio of abnormally released calls divided by the sum of the abnormally and normal released Speech RABs within a cell or RNC.
Formula

DCR(Speech) =

Alternative Formula

# Abnormal _ Speech _ Call _ Disconnections # Successful _ Speech _ Call _ Setups


# Abnormal _ RAB _ Re lease _ Speech # Abnormal _ RAB _ Re lease _ Speech+ # Normal _ RAB _ Re lease _ Speech
CONTRACTUAL INFORMATION
Contractual Information

DCR( Speech) =
User Impact

KPI REDUCTION: Partly incorporates Soft/Softer Handover Success Rate High KPI Impacted by Radio Env. RAN nodes, CS Core nodes and interfaces MEASUREMENT
Method Measurement Area KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test with call sequences (120s or 180s) set up from idle mode. The terminating party shall be fixed test line. Start Trigger: Alerting DL Stop Trigger: Disconnect UL (normal call clearing) STATISTICS: Counters for RAB Retainability Speech on Cell or RNC level.
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 1% - 400 samples needed - 13.3 h (120s call) or 20h (180s call) of DT measurements with a target of 1% To reach Confidence Interval +/- 0.5% - 1500 samples needed - 50 h (120s call) or 75h (180s call) of DT measurements with a target of 1% STATISTICS: To reach Confidence Interval +/- 0.5% - 1500 samples needed with target 1% TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: MTM calls to be avoided - to exclude faults and radio environment impact from the terminating party STATISTICS : High value warning: Difficult to achieve a high value without extensive optimization and sufficient traffic levels Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting 4) Optimization (Statistics)

KPI
No Area Name SW Rel Recommendation

2.1.2.
Definition

Accessibility

Call Setup Success Rate CS64 (CSSR CS64) GENERAL

P6

Optional

The Call Setup Success Rate CS64 (CCSR CS64) is defined as the ratio of successful call setups, divided by the total number of call setup attempts for video calls. It is the probability of successfully initiating a video call from an end user perspective. CSSR CS64 measured by Drive tests, presents the proportion of video calls which are successfully setup by the initiating party. Calculated with Counter Statistics, CSSR CS64 is a product of the RRC Setup Success Rate and the RAB Setup Success Rate for Video within a cell or RNC.
Formula

CSSR (CS 64) =

# Successful _ CS 64 _ Call _ Setups # CS 64 _ Call _ Attempts

Alternative Formula

CSSR(CS 64) =
User Impact

# RRC _ Success # RAB _ Success _ CS 64 # RRC _ Attempt # RAB _ Attempt _ CS 64


CONTRACTUAL INFORMATION
Contractual Information

KPI REDUCTION: Can replace RRC Accessibility CS and RAB Accessibility Video KPIs. High KPI Impacted by Radio Env. RAN nodes, CS Core nodes, Transmission Capacity; and interfaces MEASUREMENT
Method Measurement Area KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test with call sequences (40s) set up from idle mode. Terminating party is static 3G phone in good radio Env. Start Trigger: Call Attempt or first RRC Connection Request UL Stop Trigger: Alerting DL STATISTICS: Counters for RRC Accessibility and RAB Accessibility Video on Cell or RNC level.
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 1% - 700 samples needed - 10 h (40s call) of DT measurements with a target of 98.2% To reach Confidence Interval +/- 0.5% - 2500 samples needed - 35 h (40s call) or DT measurements with a target of 98.2% STATISTICS: To reach Confidence Interval +/- 0.5% - 2500 samples needed with target 98.2% TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Impacts on the drive test route as Video Calls are unable to perform a IRAT handover to a GSM network and call setup problems may occur on the cluster edges STATISTICS : High value warning: To reach CSSR of 98%, RRC Setup Success should be 99 % and RAB Setup Success should be 99%. Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned (no data)

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting 4) Optimization (Statistics)

KPI
No Area Name SW Rel Recommendation

2.1.3.
Definition

Retainability

Drop Call Rate CS64 (DCR CS64) GENERAL

P6

Optional

The Drop Call Rate CS64 (DCR CS64) is defined as the ratio of abnormal call disconnections, divided by the total number of successful call setups for CS64 (video) calls. It is the probability of successfully holding and terminating a video call once it has been successfully initiated. DCR CS64 measured by Drive tests, presents the proportion of video calls which are successfully released after a specified holding time from when the call was successfully setup. Calculated with Counter Statistics, DCR CS64 is the ratio of abnormally released calls divided by the sum of the abnormally and normal released calls for Video RABs within a cell or RNC.
Formula

DCR(CS 64) =

# Abnormal _ CS 64 _ Call _ Disconnections # Successful _ CS 64 _ Call _ Setups


# Abnormal _ RAB _ Re lease _ CS 64 # Abnormal _ RAB _ Re lease _ CS 64+ # Normal _ RAB _ Re lease _ CS 64
CONTRACTUAL INFORMATION
Contractual Information

Alternative Formula

DCR (CS 64) =


User Impact

KPI REDUCTION: Partly incorporates Soft/Softer Handover Success Rate High KPI Impacted by Radio Env. RAN nodes, CS Core nodes and interfaces MEASUREMENT
Method Measurement Area KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test with call sequences (120s or 180s) set up from idle mode. Terminating party is static 3G phone in good radio Env. Start Trigger: Alerting DL Stop Trigger: Disconnect UL (normal call clearing) STATISTICS: Counters for RAB Retainability CS64 (Video) on Cell or RNC level.
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 1.5% - 250 samples needed - 8.5 h (120s call) or 13h (180s call) of DT measurements with a target of 1.5% To reach Confidence Interval +/- 1% - 600 samples needed - 20 h (120s call) or 30h (180s call) of DT measurements with a target of 1.5% STATISTICS: To reach Confidence Interval +/- 1% - 600 samples needed with target 1.5% TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Impacts on the drive test route as Video Calls are unable to perform a IRAT handover to a GSM network and abnormal releases may occur on the cluster edges STATISTICS : High value warning: Video Calls are unable to perform a IRAT handover and together with worldwide low traffic volumes, makes a high value KPI difficult to achieve Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned (no data) KPI

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting 4) Optimization (Statistics)

No

Area

Name

SW Rel

Recommendation

2.1.2.
Definition

Accessibility

Call Setup Success Rate PS (CSSR PS) GENERAL

P6

Optional

The Call Setup Success Rate PS (CSSR PS) is defined as the ratio of successful call setups, divided by the total number of call setup attempts for packet calls. It is the probability of successfully initiating a packet connection from an end user perspective and includes the PDP context activation and bearer setup for the R99 service. CSSR PS measured by Drive tests, presents the proportion of packet interactive calls which are successfully setup by the initiating party. Calculated with Counter Statistics, CCSR PS is a product of RRC Accessibility PS and RAB Accessibility PS within a cell or RNC.
Formula

CSSR( PS ) =

Alternative Formula

# Successful _ PS _ Call _ Setups # PS _ Call _ Attempts


# RRC _ Success # RAB _ Success # RRC _ Attempt # RAB _ Attempt
CONTRACTUAL INFORMATION
Contractual Information

CSSR( PS ) =
User Impact

High

KPI REDUCTION: Can replace RRC Accessibility PS and RAB Accessibility PS KPIs. Merges all PS Services for Call Setup Success Rate together, including CSSR PS (R99), CSSR PS (HSDPA) and CSSR PS (EUL) KPI Impacted by Radio, M-PBN and PS nodes; Transmission Capacity; many factors outside E/// control MEASUREMENT

Method

Measurement Area

KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test downloading a 1MB file (FTP). If a single drive test is used to measure a Throughput KPI and CSSR PS, DCR PS then a larger file should be downloaded, e.g. 5MB or 10MB. The terminating party is a FTP server attached to the GGSN Start Trigger: Call Attempt or first RRC Connection Request Stop Trigger: Activate PDP Accept DL STATISTICS: Counters for RRC Accessibility PS and RAB Accessibility PS are aggregated on Cell or RNC level
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 1% - 400 samples needed - 5.6 h of DT measurements (R99; avg throughput 200kbps downloading a 1MB file) with a target of 99% To reach Confidence Interval +/- 1% - 400 samples needed - 2.2 h of DT measurements (HS; throughput 1.5Mbps downloading a 1MB file) with a target of 99% STATISTICS: To reach Confidence Interval +/- 1% - 400 samples needed with a target of 99% TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Calls to internet servers be avoided many components can be outside E/// responsibility STATISTICS : High value warning: To reach CSSR of 99%, RRC Accessibility PS should be 99.5% and RAB Accessibility PS should be 99.5% Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned (no data)

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting (E2E) 4) Optimization (Statistics)

KPI
No Area Name SW Rel Recommendation

2.1.3.
Definition

Retainability

Drop Call Rate PS (DCR PS) GENERAL

P6

Optional

The Drop Call Rate PS (DCR PS) is defined as the ratio of abnormal call disconnections, divided by the total number of successful call setups for packet connections. It is the probability of successfully holding and then terminating a packet connection from an end user perspective. DCR PS R99 is independent of the throughput of any download or upload, either HTTP or FTP or UDP. The KPI is the ability of the network to maintain a packet radio access bearer independent of the user session on the bearer. Session errors (caused by FTP problems, user aborted, etc) should not be counted unless the radio access bearer is also abnormally released or there is an abnormal transition to idle. DCR PS measured by Drive tests, presents the proportion of PS radio bearers which are held and normally released by the initiating party. Calculated with Counter Statistics, DCR PS is the ratio of abnormally released calls divided by the sum of the abnormally released and normal released for Packet RABs within a cell or RNC.
Formula

DCR( PS ) =

Alternative Formula

# Abnormal _ PS _ Call _ Disconnections # Successful _ PS _ Call _ Setups


# RAB _ Abnormal _ Re lease # RAB _ Normal _ Re lease+ # RAB _ Abnormal _ Re lease
Contractual Information

DCR( PS ) =
User Impact

CONTRACTUAL INFORMATION

High

KPI REDUCTION: Merges all PS Services for Drop Rate together, including DCR PS (R99), DCR PS (HSDPA) and DCR PS (EUL) KPI Impacted by Radio, M-PBN and PS nodes; many factors outside E/// control MEASUREMENT

Method

Measurement Area

KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test downloading a 5MB or 10MB file (FTP). The terminating party is a FTP server attached to the GGSN Start Trigger: Activate PDP Accept DL Stop Trigger: Deactivate PDP Context UL (normal packet clearing) STATISTICS: Counters for Packet Retainability aggregated on Cell or RNC level
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 1% - 400 samples needed - 23 h of DT measurements (R99; avg throughput 200kbps) for a 5MB file and a target of 1% To reach Confidence Interval +/- 1% - 400 samples needed - 4 h of DT measurements (HS; throughput 1.5Mbps) for a 5MB file and a target of 1% STATISTICS: To reach Confidence Interval +/- 1% - 400 samples needed with a target of 99% TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Calls to internet servers be avoided many components can be outside E/// responsibility STATISTICS : Transitions between channel states make a high target difficult to obtain. Different UEs and behaviour impact heavily on the network counters and perceived performance Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting (E2E) 4) Optimization (Statistics)

Results from NetqB are not shown as a different statistical formula is used

KPI
No Area Name SW Rel Recommendation

2.2.2.
Definition

Accessibility

Call Setup Time Speech (CST Speech) GENERAL

P6

Optional

The Call Setup Time Speech (CST Speech) is defined as the duration of time taken to access the Speech service successfully, meaning that speech connection is established. The setup time is a taken as a Mobile Originating Connection (MOC) for Speech from a UE to a PSTN terminating connection. CST Speech measured by Drive tests, presents the average call setup time of speech calls which are successfully setup by the initiating party. CST Speech is unable to be collected and calculated with network counter statistics.
Formula

CST (Speech) =

Speech _ Call _ Setup _ Time _(Time @ Start _ Trigger Time @ Stop _ Trigger)
# Successful _ Speech _ Call _ Setups
CONTRACTUAL INFORMATION

Alternative Formula

User Impact

Contractual Information

KPI REDUCTION: Can replace RRC Setup Time and RAB Setup Time Speech KPIs. Medium KPI Impacted by Radio Env. RAN nodes, CS Core nodes and interfaces. Radio Optimization and Tuning has a limited influence on the KPI target. MEASUREMENT
Measurement Area KPI Domain

Method

Drive Test
Measurement Execution

Golden Cluster

QoS

DRIVE TESTS: Drive test with call sequences (20s) set up from idle mode. The terminating party shall be fixed test line. Start Trigger: Time of Call Attempt or first RRC Connection Request UL Stop Trigger: Time of Alerting DL STATISTICS: None available for this KPI
Entry and Exit Criteria

DRIVE TESTS: Recommended to sample 300 calls for the measurement criteria but can also be collected from the samples for CCSR Speech or CSSR Speech. STATISTICS: None available for this KPI TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: MTM calls to be avoided even in a stationary condition, the call setup time would be affected by the radio environment in the terminating party. Calls longer than 30s setup (before the Alerting message should be classified as a failed call setup and excluded. STATISTICS : None available for this KPI Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned

1) Initial Tuning 2) Troubleshooting (CS E2E)

KPI
No Area Name SW Rel Recommendation

2.2.4.
Definition

Integrity

BLER Quality Speech Uplink (BLER Speech Uplink) GENERAL

P6

Optional

The BLER Quality Speech Uplink (BLER Speech) is defined as the ratio of faulty transport blocks to transmitted transport blocks for a speech connection. BLER is an indication of speech quality since a block error means that the entire speech frame is erased and needs to be replaced, therefore affecting the perceived quality of the connection. Impacting BLER and Speech Quality are the interference, noise limitations, mobile speed (fading frequency) and time dispersion. BLER Speech Uplink defined in this KPI is an uplink measurement only and can be calculated with network counter statistics or network recordings.

Formula

BLER _UL _(Speech) =

# Number _ of _ Faulty _ Transport _ Blocks _ Speech Alternative Formula # Number _ of _ Transport _ Blocks _ Speech
CONTRACTUAL INFORMATION
User Impact Contractual Information

KPI REDUCTION: Partly is related to Speech Quality (MOS-PESQ) Medium KPI Impacted by Radio Env. RAN nodes and parameter settings. Ericsson should control the parameters for setting BLER targets for each service. MEASUREMENT
Measurement Area KPI Domain

Method

Drive Test/Counters
Measurement Execution

Golden Cluster

QoS

DRIVE TESTS: Calls should be set up in a similar manner to CCSR Speech and DCR Speech. Results can be collected via the UETR recording function INTERNAL_ MEAS_ TRANSPORT_ CHANNEL_BLER after setup for the UE IMSI. STATISTICS: Statistics can be obtained using the performance CTR measurement INTERNAL_ MEAS_ TRANSPORT_ CHANNEL_BLER after setup for the Cluster Cell Set. Network RNC level counters collect statistics on the the number of Transport Blocks and number of Faulty Transport Blocks for an RNC-wide perspective.
Entry and Exit Criteria

DRIVE TESTS: Recommended to have at least 600 normally terminated Speech Calls collected during a drive for CCSR Speech or DCR Speech. STATISTICS: Recommended to have at least 600 normally terminated Speech Calls during a 5 hour collection period. TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

Downlink BLER is not uniformly reported by different UEs. UETR / CTR Downlink BLER are reported as % and therefore can be inaccurate when aggredated together. This KPI therefore only measures the Uplink BLER. STATISTICS: When calculating Uplink BLER using CTR measurements, up to 16 simultaneous UEs can be recorded in the selected Cluster (Not all calls are represented). RNC level statistics cannot be broken into Clusters. Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned (no data)

1) RND or RND Review (Dimensioning) 2) Troubleshooting (CS)

Results in this Bar Graph for Uplink BLER using RNC level counters.

KPI
No Area Name SW Rel Recommendation

2.2.2.
Definition

Accessibility

Call Setup Time CS64 (CST CS64) GENERAL

P6

Optional

The Call Setup Time CS64 (CST CS64) is defined as the duration of time taken to access the CS64 (video) service successfully, meaning that video connection is established. The setup time is a taken as a Mobile Originating Connection (MOC) for video to another UE terminating connection (UE to UE). CST CS64 measured by Drive tests, presents the average call setup time of video calls which are successfully setup by the initiating party. CST CS64 is unable to be collected and calculated with network counter statistics.
Formula

CST (CS 64) =

CS 64 _ Call _ Setup _ Time _(Time @ Start _ Trigger Time @ Stop _ Trigger)


# Successful _ CS 64 _ Call _ Setups
CONTRACTUAL INFORMATION

Alternative Formula

User Impact

Contractual Information

KPI REDUCTION: Can replace RRC Setup Time and RAB Setup Time Video KPIs. Medium KPI Impacted by Radio Env. RAN nodes, CS Core nodes and interfaces. Radio Optimization and Tuning has a limited influence on the KPI target. MEASUREMENT
Measurement Area KPI Domain

Method

Drive Test
Measurement Execution

Golden Cluster

QoS

DRIVE TESTS: Drive test with call sequences (40s) set up from idle mode. Terminating party is static 3G phone in good radio Env. Start Trigger: Time of Call Attempt or first RRC Connection Request UL Stop Trigger: Time of Alerting DL STATISTICS: None available for this KPI
Entry and Exit Criteria

DRIVE TESTS: Recommended to sample 300 calls for the measurement criteria but can also be collected from the samples for CCSR CS64 or CSSR CS64. STATISTICS: None available for this KPI TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Time needed for terminating UE for automatic answer should be deducted from the calculations or included in the KPI. This is roughly 2s. Calls longer than 30s setup (before the Alerting message should be classified as a failed call setup and excluded. STATISTICS : None available for this KPI Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned

1) Initial Tuning 2) Troubleshooting (CS E2E)

KPI
No Area Name SW Rel Recommendation

2.2.4.
Definition

Integrity

BLER Quality CS64 Uplink (BLER CS64 Uplink) GENERAL

P6

Optional

The BLER Quality CS64 Uplink (BLER CS64 Uplink) is defined as the ratio of faulty transport blocks to transmitted transport blocks for a CS64 (video) connection. BLER is an indication of quality since a block error means that the frame is erased or needs to be replaced, therefore affecting the perceived quality of the connection. Impacting BLER and Quality is the interference, noise limitations, mobile speed (fading frequency) and time dispersion. BLER CS64 Uplink defined in this KPI is an uplink measurement only and can be calculated with network counter statistics or network recordings.

Formula

BLER _ UL(CS 64) =

# Number _ of _ Faulty _ Transport _ Blocks _ CS 64 Alternative Formula # Number _ of _ Transport _ Blocks _ CS 64


CONTRACTUAL INFORMATION
User Impact Contractual Information

KPI REDUCTION: None Medium KPI Impacted by Radio Env. RAN nodes and parameter settings. Ericsson should control the parameters for setting BLER targets for each service. MEASUREMENT
Measurement Area KPI Domain

Method

Drive Test/Counters
Measurement Execution

Golden Cluster

QoS

DRIVE TESTS: Calls should be set up in a similar manner to CCSR CS64 and DCR CS64. Results can be collected via the UETR recording function INTERNAL_ MEAS_ TRANSPORT_ CHANNEL_BLER after setup for the UE IMSI. STATISTICS: Statistics can be obtained using the performance CTR measurement INTERNAL_ MEAS_ TRANSPORT_ CHANNEL_BLER after setup for the Cluster Cell Set. Network RNC level counters collect statistics on the the number of Transport Blocks and number of Faulty Transport Blocks for an RNC-wide perspective.
Entry and Exit Criteria

DRIVE TESTS: Recommended to have at least 600 normally terminated Video Calls collected during a drive for CCSR CS64 or DCR CS64. STATISTICS: Recommended to have at least 600 normally terminated Video Calls during a 5 hour collection period. TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

Downlink BLER is not uniformly reported by different UEs. UETR / CTR Downlink BLER are reported as % and therefore can be inaccurate when aggredated together. This KPI therefore only measures the Uplink BLER. STATISTICS: When calculating Uplink BLER using CTR measurements, up to 16 simultaneous UEs can be recorded in the selected Cluster (Not all calls are represented). RNC level statistics cannot be broken into Clusters. Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned (no data)

1) RND or RND Review (Dimensioning) 2) Troubleshooting (CS)

KPI
No Area Name SW Rel Recommendation

2.1.2.
Definition

Accessibility

Call Setup Success Rate PS R99 (CSSR PS R99) GENERAL

P6

Optional

The Call Setup Success Rate PS R99 (CSSR PS R99) is defined as the ratio of successful call setups, divided by the total number of call setup attempts for packet calls using a R99 radio bearer. It is the probability of successfully initiating a R99 packet connection from an end user perspective resulting in a R99 connection of up to 384kbps and includes the PDP context activation and bearer setup for the R99 service. CSSR PS R99 measured by Drive tests, presents the proportion of R99 radio bearers which are successfully setup by the initiating party. Calculated with Counter Statistics, CCSR PS R99 is a product of RRC Accessibility (PS) and RAB Accessibility R99 (PS) within a cell or RNC.
Formula

CSSR( PS _ R99) =
Alternative Formula

# Successful _ PS _ R99 _ Call _ Setups # PS _ R99 _ Call _ Attempts


# RRC _ Success # RAB _ R99 _ Success # RRC _ Attempt # RAB _ R99 _ Attempt
CONTRACTUAL INFORMATION
Contractual Information

CSSR( PS _ R99) =
User Impact

KPI REDUCTION: Can replace RRC Accessibility PS and RAB Accessibility R99 PS KPIs. Medium KPI Impacted by Radio, M-PBN and PS nodes; many factors outside E/// control MEASUREMENT
Method Measurement Area KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test downloading a 500KB file (FTP). If a single drive test is used to measure a Throughput KPI and CCSR PS R99 then a larger file should be downloaded, e.g. 5MB or 10MB. The terminating party is a FTP server attached to the GGSN Start Trigger: Call Attempt or first RRC Connection Request Stop Trigger: Activate PDP Accept DL COUNTER STATISTICS: Counters for Packet Accessibility are aggregated on Cell or RNC level
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 1% - 400 samples needed - 2.5 h of DT measurements (R99; avg throughput 200kbps downloading a 500KB file) with a target of 99% STATISTICS: With low sample size it is possible to have CSSR > 100%. With a confidence of +/- 1% - 400 samples needed for a target of 99% TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Calls to internet servers be avoided many components can be outside E/// responsibility STATISTICS : To reach CSSR of 99%, RRC Accessibility should be 99.5% and RAB R99 Accessibility should be 99.5% Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting (E2E) 4) Optimization (Statistics)

KPI
No Area Name SW Rel Recommendation

2.1.2.
Definition

Accessibility

Call Setup Success Rate PS HSDPA (CSSR PS HSDPA) GENERAL

P6

Optional

The Call Setup Success Rate PS HSDPA (CSSR PS HSDPA) is defined as the ratio of successful call setups, divided by the total number of call setup attempts for packet calls using a HSDPA radio bearer. It is the probability of successfully initiating a HSDPA packet connection from an end user perspective resulting in a HSDPA connection and includes the PDP context activation and bearer setup for the HSDPA service. CSSR PS HSDPA measured by Drive tests, presents the proportion of sessions which are successfully setup by the initiating party. Calculated with Counter Statistics, CCSR PS HSDPA is a product of RRC Accessibility (PS) and RAB HSDPA Accessibility (PS) within a cell or RNC.
Formula

CSSR( PS _ HSDPA) =
Alternative Formula

# Successful _ HSDPA _ R99 _ Call _ Setups # PS _ HSDPA _ Call _ Attempts


# RRC _ Success # RAB _ HSDPA _ Success # RRC _ Attempt # RAB _ HSDPA _ Attempt
Contractual Information

CSSR( PS _ HSDPA) =
User Impact

CONTRACTUAL INFORMATION

KPI REDUCTION: Can replace RRC Accessibility PS and RAB HSDPA Accessibility PS KPIs. Medium KPI Impacted by Radio, M-PBN and PS nodes; many factors outside E/// control MEASUREMENT
Method Measurement Area KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test downloading a 1MB file (FTP). If a single drive test is used to measure a Throughput KPI and CCSR PS then a larger file should be downloaded, e.g. 5MB or 10MB. The terminating party is a FTP server attached to the GGSN Start Trigger: Call Attempt or first RRC Connection Request Stop Trigger: Activate PDP Accept DL COUNTER STATISTICS: Counters for Packet Accessibility are aggregated on Cell or RNC level
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 1% - 400 samples needed - 1.7 h of DT measurements (HS; throughput 1.5Mbps downloading a 1MB file) with a target of 99% STATISTICS: With low sample size it is possible to have CSSR > 100%. With a confidence of +/- 1% - 400 samples needed for a target of 99% TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Calls to internet servers be avoided many components can be outside E/// responsibility STATISTICS : High value warning: To reach CSSR of 99%, RRC Accessibility should be 99.5% and RAB HSDPA Accessibility should be 99.5% Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting (E2E) 4) Optimization (Statistics)

KPI
No Area Name SW Rel Recommendation

2.1.2.
Definition

Accessibility

Call Setup Success Rate PS EUL (CSSR PS EUL) GENERAL

P6

Optional

The Call Setup Success Rate PS EUL (CSSR PS EUL) is defined as the ratio of successful call setups, divided by the total number of call setup attempts for packet calls using a EUL radio bearer. It is the probability of successfully initiating an EUL packet connection from an end user perspective resulting in a EUL connection and includes the PDP context activation and bearer setup for the EUL service. CSSR PS EUL measured by Drive tests, presents the proportion of sessions which are successfully setup by the initiating party. Calculated with Counter Statistics, CCSR PS EUL is a product of RRC Accessibility (PS) and RAB Accessibility EUL (PS) within a cell or RNC.
Formula

CSSR( PS _ EUL) =
Alternative Formula

# Successful _ EUL _ R99 _ Call _ Setups # PS _ EUL _ Call _ Attempts


# RRC _ Success # RAB _ EUL _ Success # RRC _ Attempt # RAB _ EUL _ Attempt
Contractual Information

CSSR( PS _ EUL) =
User Impact

CONTRACTUAL INFORMATION

KPI REDUCTION: Can replace RRC Accessibility PS and RAB Accessibility EUL PS KPIs. Medium KPI Impacted by Radio, M-PBN and PS nodes; many factors outside E/// control MEASUREMENT
Method Measurement Area KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test uploading a 500KB file (FTP). The terminating party is a FTP server attached to the GGSN Start Trigger: Call Attempt or first RRC Connection Request Stop Trigger: Activate PDP Accept DL COUNTER STATISTICS: Counters for Packet Accessibility are aggregated on Cell or RNC level
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 1% - 400 samples needed - 1.5 h of DT measurements (EUL; avg throughput 400kbps uploading a 500KB file) with a target of 99% STATISTICS: With low sample size it is possible to have CSSR > 100%. With a confidence of +/- 1% - 400 samples needed for a target of 99% TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Calls to internet servers be avoided many components can be outside E/// responsibility STATISTICS : High value warning: To reach CSSR of 99%, RRC Accessibility should be 99.5% and RAB EUL Accessibility should be 99.5% Ericsson Controlled Environment Best In Class (NETQB) / Optimized

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting (E2E) 4) Optimization (Statistics)

NetqB data is currently unavailabe for EUL Statistics Average (NetQB) / Tuned Pre launched / Initially Tuned

KPI
No Area Name SW Rel Recommendation

2.1.3.
Definition

Retainability

Drop Call Rate PS R99 (DCR PS R99) GENERAL

P6

Optional

The Drop Call Rate PS R99 (DCR PS R99) is defined as the ratio of abnormal call disconnections, divided by the total number of successful call setups for packet connections using a R99 radio bearer. It is the probability of successfully holding and then terminating a R99 packet connection from an end user perspective. DCR PS R99 is independent of the throughput of any download, either HTTP or FTP or UDP. The KPI is the ability of the network to maintain a packet radio access bearer independent of the user session on the bearer. Session errors (caused by FTP problems, user aborted, etc) should not be counted unless the radio access bearer is also abnormally released or there is an abnormal transition to idle. DCR PS R99 measured by Drive tests, presents the proportion of R99 radio bearers which are held and normally released by the initiating party. Calculated with Counter Statistics, DCR PS R99 is the ratio of abnormally released calls divided by the sum of the abnormally released and normal released within a cell or RNC while on a R99 radio bearer.
Formula

DCR( PS _ R99) =

# Abnormal _ PS _ R99 _ Call _ Disconnections # Successful _ PS _ R99 _ Call _ Setups


# RAB _ Abnormal _ Re lease _ R99 # RAB _ Normal _ Re lease _ R99+ # RAB _ Abnormal _ Re lease _ R99
CONTRACTUAL INFORMATION
Contractual Information

Alternative Formula

DCR( PS _ R99) =
User Impact

KPI REDUCTION: Partly incorporates Soft/Softer Handover Success Rate Medium KPI Impacted by Radio, M-PBN and PS nodes; many factors outside E/// control. Warning: Statistics for DCR may not reflect end user experience due to missing idle to active transitions which can result in a poor achieved value for the KPI. Ericsson therefore recommends the KPI Minutes per Drop PS Interactive (MPD PS) MEASUREMENT
Measurement Area KPI Domain

Method

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test downloading a 5MB file (FTP). The terminating party is a FTP server attached to the GGSN Start Trigger: Activate PDP Accept DL Stop Trigger: Deactivate PDP Context UL (normal packet clearing) COUNTER STATISTICS: Counters for Packet R99 Retainability aggregated on Cell or RNC level
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 1% - 400 samples needed - 23 h of DT measurements (R99; avg throughput 200kbps) for a 5MB file and a target of 1% STATISTICS: To reach Confidence Interval +/- 1% - 400 samples needed with a target of 1% TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Calls to internet servers be avoided many components can be outside E/// responsibility STATISTICS : Drop rate is heavily impacted by channel state transitions including URA / FACH / DCH / HSDPA and by different UEs. Ericsson Controlled Environment Best In Class (NETQB) / Optimized

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting (E2E) 4) Optimization (Statistics)

Results from NetqB are not shown as a different statistical formula is used Average (NetQB) / Tuned Pre launched / Initially Tuned (no data)

KPI
No Area Name SW Rel Recommendation

2.1.3.
Definition

Retainability

Drop Call Rate PS HSDPA (DCR PS HSDPA) GENERAL

P6

Optional

The Drop Call Rate PS HSDPA (DCR PS HSDPA) is defined as the ratio of abnormal call disconnections, divided by the total number of successful call setups for packet connections using a HSDPA radio bearer. It is the probability of successfully holding and then terminating a R99 packet connection from an end user perspective. DCR PS HSDPA is independent of the throughput of any download, either HTTP or FTP or UDP. The KPI is the ability of the network to maintain a packet radio access bearer independent of the user session on the bearer. Session errors (caused by FTP problems, user aborted, etc) should not be counted unless the radio access bearer is also abnormally released or there is an abnormal transition to idle. DCR PS HSDPA measured by Drive tests, presents the proportion of HSDPA radio bearers which are held and normally released by the initiating party. Calculated with Counter Statistics, DCR PS HSDPA is the ratio of abnormally released calls divided by the sum of the abnormally released and normal released within a cell or RNC while on a HSDPA radio bearer.
Formula

DCR(PS _ HSDPA) =

# Abnormal _ PS _ HSDPA _ Call _ Disconnections # Successful _ PS _ HSDPA _ Call _ Setups Alternative Formula
# RAB _ Abnormal _ Re lease _ HSDPA # RAB _ Normal _ Re lease _ HSDPA+ # RAB _ Abnormal _ Re lease _ HSDPA
CONTRACTUAL INFORMATION
User Impact Contractual Information

DCR( PS _ HSDPA) =

KPI REDUCTION: Partly incorporates Soft/Softer Handover Success Rate Medium KPI Impacted by Radio, M-PBN and PS nodes; many factors outside E/// control Warning: Statistics for DCR may not reflect end user experience due to missing idle to active transitions which can result in a poor achieved value for the KPI. Ericsson therefore recommends the KPI Minutes per Drop PS Interactive (MPD PS) MEASUREMENT
Measurement Area KPI Domain

Method

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test downloading a 5MB file (FTP). The terminating party is a FTP server attached to the GGSN Start Trigger: Activate PDP Accept DL Stop Trigger: Deactivate PDP Context UL (normal packet clearing) COUNTER STATISTICS: Counters for Packet HSDPA Retainability aggregated on Cell or RNC level
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 1% - 400 samples needed - 4 h of DT measurements (HS; throughput 1.5Mbps) for a 5MB file and a target of 1% STATISTICS: To reach Confidence Interval +/- 1% - 400 samples needed with a target of 1% TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Calls to internet servers be avoided many components can be outside E/// responsibility STATISTICS : Drop rate is heavily impacted by channel state transitions including URA / FACH / DCH / HSDPA and by different UEs. Ericsson Controlled Environment Best In Class (NETQB) / Optimized

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting (E2E) 4) Optimization (Statistics)

Results from NetqB are not shown as a different statistical formula is used Average (NetQB) / Tuned Pre launched / Initially Tuned

KPI
No Area Name SW Rel Recommendation

2.1.3.
Definition

Retainability

Drop Call Rate PS EUL (DCR PS EUL) GENERAL

P6

Optional

The Drop Call Rate PS EUL (DCR PS EUL) is defined as the ratio of abnormal call disconnections, divided by the total number of successful call setups for packet connections using a EUL radio bearer. It is the probability of successfully holding and then terminating a EUL packet connection from an end user perspective. DCR PS EUL is independent of the throughput of any upload, either HTTP or FTP or UDP. The KPI is the ability of the network to maintain a packet radio access bearer independent of the user session on the bearer. Session errors (caused by FTP problems, user aborted, etc) should not be counted unless the radio access bearer is also abnormally released or there is an abnormal transition to idle. DCR PS EUL measured by Drive tests, presents the proportion of EUL radio bearers which are held and normally released by the initiating party. Calculated with Counter Statistics, DCR PS EUL is the ratio of abnormally released calls divided by the sum of the abnormally released and normal released within a cell or RNC while on a EUL radio bearer.
Formula

DCR(PS _ EUL) =

# Abnormal _ PS _ EUL _ Call _ Disconnections # Successful _ PS _ EUL _ Call _ Setups Alternative Formula
# RAB _ Abnormal _ Re lease _ EUL # RAB _ Normal _ Re lease _ EUL+ # RAB _ Abnormal _ Re lease _ EUL
CONTRACTUAL INFORMATION
User Impact Contractual Information

DCR( PS _ EUL) =

KPI REDUCTION: Partly incorporates Soft/Softer Handover Success Rate Medium KPI Impacted by Radio, M-PBN and PS nodes; many factors outside E/// control Warning: Statistics for DCR may not reflect end user experience due to missing idle to active transitions which can result in a poor achieved value for the KPI. Ericsson therefore recommends the KPI Minutes per Drop PS Interactive (MPD PS) MEASUREMENT
Measurement Area KPI Domain

Method

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test downloading a 5MB file (FTP). The terminating party is a FTP server attached to the GGSN Start Trigger: Activate PDP Accept DL Stop Trigger: Deactivate PDP Context UL (normal packet clearing) COUNTER STATISTICS: Counters for Packet EUL Retainability aggregated on Cell or RNC level
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 1% - 400 samples needed - 12 h of DT measurements (EUL; throughput 400kbps) for a 5MB file and a target of 1% STATISTICS: To reach Confidence Interval +/- 1% - 400 samples needed with a target of 1% TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Calls to internet servers be avoided many components can be outside E/// responsibility STATISTICS : Drop rate is heavily impacted by channel state transitions including URA / FACH / DCH / EUL and by different UEs. Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting (E2E) 4) Optimization (Statistics)

Results from NetqB are not shown as a different statistical formula is used

KPI
No Area Name SW Rel Recommendation

2.1.3.
Definition

Retainability

Minutes per Drop PS Interactive (MPD PS) GENERAL

P6

Optional

The Minutes per Drop PS Interactive (MPD PS) is defined as the ratio of the total end user time where a packet connection is maintained after being successfully set up divided by the abnormal call disconnections. It is the probable length of time a PS interactive call can be held by the end user before the packet connection is abnormally terminated. MPD PS is independent of the throughput of any download, either HTTP or FTP or UDP. The KPI is the ability of the network to maintain a packet radio access bearer for a certain time period independent of the user session on the bearer. Session errors (caused by FTP problems, user aborted, etc) should not be counted unless the radio access bearer is also abnormally released or there is an abnormal transition to idle. MPD PS measured by Drive tests, presents the proportion of time PS radio bearers are held by the number of abnormally released packet connections. Calculated with Counter Statistics, MPD PS is the ratio of the average users using the PS radio bearer during the measurement period divided by the number of abnormally released calls within a cell or RNC.
Formula

MPD( PS ) =

Time _ Holding _ PS _ Connections(min)


# RAB _ Abnormal _ Re lease _ PS

Alternative Formula

MPD( PS ) =
User Impact

Measurement _ Period Average _ No _ PS _ Users # RAB _ Abnormal _ Re lease _ PS


CONTRACTUAL INFORMATION
Contractual Information

KPI REDUCTION: Can replace DCR PS (which includes R99, HSDPA and EUL DCR) Medium KPI Impacted by Radio, M-PBN and PS nodes; many factors outside E/// control MEASUREMENT
Method Measurement Area KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test downloading a 5MB file (FTP). The terminating party is a FTP server attached to the GGSN Start Trigger: Activate PDP Accept DL Stop Trigger: Deactivate PDP Context UL (normal packet clearing) COUNTER STATISTICS: Counters for Packet Retainability and Utilization aggregated on Cell or RNC level
Entry and Exit Criteria

DRIVE TESTS: To reach Confidence Interval +/- 1.8% - 180 samples needed - 11 h of DT measurements (R99; avg throughput 200kbps) To reach Confidence Interval +/- 1.8% - 180 samples needed - 2 h of DT measurements (HS; throughput 1.5Mbps) STATISTICS: With low sample size it is possible to have DCR > 100% (terminations greater than new calls) TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Calls to internet servers be avoided many components can be outside E/// responsibility STATISTICS : Drop rate is heavily impacted by channel state transitions including URA / FACH / DCH / HSDPA and by different UEs. Ericsson Controlled Environment Best In Class (NETQB) / Optimized Still to be updated. Average (NetQB) / Tuned Pre launched / Initially Tuned (no data)

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting (E2E) 4) Optimization (Statistics)

KPI
No Area Name SW Rel Recommendation

2.2.5.
Definition

Mobility

IRAT Handover Success Rate Speech (IRAT Speech) GENERAL

P6

Optional

The Inter Radio Access Technology Handover Success Rate for Speech (IRAT Speech) is defined as the ratio of successful handovers to GSM over the number of attempted handovers to GSM. It is the probability of successfully performing a handover from WCDMA to GSM and continuing the call without end user interruption. IRAT Speech Handovers can be measured either by Drive tests or Statistics data although due to difficulties in drive test collection, Statistics is recommended. In the case of a drive test, a normal drive within the coverage area may not have sufficient number of samples where IRAT handover is performed and it is recommended that a separate drive route along the borders of the coverage be covered. Calculated with Statistics, IRAT Speech is a ratio of the number of successful Handovers over the number of attempted handovers. The counters are only incremented if a GSM relation exists between the Target and the Source Cell where the Source cell is the Best Cell in the Active Set. This can be aggregated to Cell and RNC level
Formula

IRAT _ Success( Speech) =


Alternative Formula

# Successful _ IRAT _ Handovers # Attempted _ IRAT _ Handovers

# " Handover _ from _ UTRAN _ Failure" IRAT _ Success( Speech) = 1 CONTRACTUAL INFORMATION # " Handover _ from _ UTRAN _ Command " User Impact Contractual Information
KPI REDUCTION: None Medium KPI Impacted by GSM Network performance and interfaces between GSM and UMTS (neighbouring definitions on GSM and UMTS side) MEASUREMENT
Method Measurement Area KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters specialized drive route

QoS

DRIVE TESTS: Drive test with call sequences (360s) set up from idle mode. The terminating party shall be fixed test line. Start Trigger: Handover from UTRAN Command Stop Trigger: Handover from UTRAN Failure STATISTICS: Counters for IRAT Handover Attempts and Success, collected at GSM Relation level and aggregated to Cell and RNC level
Entry and Exit Criteria

DRIVE TESTS: Neighbour relations must be defined and updated frequently (during rollout). Special drive route needed (cluster edges) To reach Confidence Interval +/- 2% 190 samples needed - 18 h of DT measurements with a target of 98% STATISTICS: The counters are only incremented if a GSM relation exists between the Target and the Source Cell TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Highly dependent on the 3G/2G neighbour relations (during network rollout) STATISTICS : Counter KPI heavily impacted by repeated failures between a 3G source cell to a 2G target cell in the case of a stationary end user, adding risk to a high value KPI target Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned (no data)

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting (E2E and GSM) 4) Optimization (Statistics)

KPI
No Area Name SW Rel Recommendation

2.2.5.
Definition

Mobility

IRAT Cell Change Success Rate for PS Interactive (IRATCC PS) GENERAL

P6

Optional

The Inter Radio Access Technology Cell Change Success Rate for PS Interactive (IRAT CC PS ) is defined as the ratio of successful cell changes to GSM over the number of attempted cell changes to GSM. It is the probability of successfully performing a cell change from WCDMA to GSM and continuing the packet connection without the packet call terminating. IRAT Cell Change PS Handovers can be measured either by Drive tests or Statistics data although due to difficulties in drive test collection, Statistics are recommended. In the case of a drive test, a normal drive within the coverage area may not have sufficient number of samples where IRAT cell change is performed and it is recommended that a separate drive route along the borders of the coverage be covered. Calculated with Statistics, IRAT Cell Change PS is a ratio of the number of successful cell change over the number of attempted cell changes. The counters are only incremented if a GSM relation exists between the Target and the Source Cell where the Source cell is the Best Cell in the Active Set. This can be aggregated to Cell and RNC level
Formula

IRATCC _ Success( PS ) = 1
Alternative Formula

IRATCC _ Success( PS ) = 1
User Impact

# " Cell _ Change _ Order _ from _ UTRAN _ Failure" # "Cell _ Change _ Order _ from _ UTRAN _ Command " # Cell _ Change _ Order _ Success
CONTRACTUAL INFORMATION

# Cell _ Change _ Order _ Attempt


Contractual Information

KPI REDUCTION: None Medium KPI Impacted by GSM Network performance and interfaces between GSM and UMTS (neighbouring definitions on GSM and UMTS side) MEASUREMENT
Method Measurement Area KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster/All Clusters specialized drive route

QoS

DRIVE TESTS: Drive test with call sequences (360s) set up from idle mode. The terminating party is a FTP server attached to the GGSN Start Trigger: Cell Change Order from UTRAN Command Stop Trigger: Cell Change Order from UTRAN Failure STATISTICS: Counters for IRAT Cell Change Attempts and Success, collected at GSM Relation level and aggregated to Cell and RNC level
Entry and Exit Criteria

DRIVE TESTS: Neighbour relations must be defined and updated frequently (during rollout). Special drive route needed (cluster edges) To reach Confidence Interval +/- 2% (target 98%) 190 samples needed - 18 h of DT measurements STATISTICS: The counters are only incremented if a GSM relation exists between the Target and the Source Cell TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Highly dependent on the 3G/2G neighbour relations (during network rollout) STATISTICS : Counter KPI heavily impacted by repeated failures between a 3G source cell to a 2G target cell in the case of a stationary end user, adding risk to a high value KPI target Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned (no data)

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting (E2E and GSM) 4) Optimization (Statistics)

KPI
No Area Name SW Rel Recommendation

2.2.4.
Definition

Integrity

BLER Quality PS Uplink (BLER PS Uplink) GENERAL

P6

Optional

The BLER Quality PS Uplink (BLER PS Uplink) is defined as the ratio of faulty transport blocks to transmitted transport blocks for a packet (PS) connection. BLER is an indication of quality since a block error means that the entire frame is erased or retransmitted, therefore affecting the perceived quality of the connection and limiting the throughput. Impacting BLER and Quality is the interference, noise limitations, mobile speed (fading frequency) and time dispersion. BLER PS Uplink defined in this KPI is an uplink measurement only and can be calculated with network counter statistics or network recordings.

Formula

BLER _ UL( PS ) =

# Number _ of _ Faulty _ Transport _ Blocks _ PS Alternative Formula # Number _ of _ Transport _ Blocks _ PS


CONTRACTUAL INFORMATION
User Impact Contractual Information

KPI REDUCTION: None Medium KPI Impacted by Radio Env. RAN nodes MEASUREMENT
Method Measurement Area KPI Domain

Drive Test/Counters
Measurement Execution

Golden Cluster

QoS

DRIVE TESTS: Calls should be set up in a similar manner to CCSR PS and DCR PS. Results can be collected via the UETR recording function INTERNAL_ MEAS_ TRANSPORT_ CHANNEL_BLER after setup for the UE IMSI. STATISTICS: Statistics can be obtained using the performance CTR measurement INTERNAL_ MEAS_ TRANSPORT_ CHANNEL_BLER after setup for the Cluster Cell Set. Network RNC level counters collect statistics on the the number of Transport Blocks and number of Faulty Transport Blocks for an RNC-wide perspective.
Entry and Exit Criteria

DRIVE TESTS: Recommended to have at least 600 normally terminated Speech Calls collected during a drive for CCSR PS or DCR PS. STATISTICS: Recommended to have at least 600 normally terminated Speech Calls during a 5 hour collection period. TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

Downlink BLER is not uniformly reported by different UEs. UETR / CTR Downlink BLER are reported as % and therefore can be inaccurate when aggredated together. This KPI therefore only measures the Uplink BLER. STATISTICS: When calculating Uplink BLER using CTR measurements, up to 16 simultaneous UEs can be recorded in the selected Cluster (Not all calls are represented). RNC level statistics cannot be broken into Clusters. Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned (no data)

1) RND or RND Review (Dimensioning) 2) Troubleshooting

KPI
No Area Name SW Rel Recommendation

2.2.2.
Definition

Accessibility

PDP Context Activation Time PS (PDP Act Time PS) GENERAL

P6

Optional

The PDP Context Activation Time PS (PDP Act Time PS) is defined as the length of the time it takes to activate a PDP context. From an end user perspective, it is the time taken from idle mode to the network providing the end user with an assigned IP address and negotiated QoS parameters. PDP Act Time PS measured by Drive tests, presents the average PDP context activation time when setting up a packet connection. PDP Act Time PS is unable to be collected or measured with network counter statistics.
Formula

PDP _ Act _ Time(PS ) =


Alternative Formula

PDP _ Context _ Activation _ Time _(Time @ Start _ Trigger Time @ Stop _ Trigger)
# Successful _ PDP _ Context _ Activation _ Accept
CONTRACTUAL INFORMATION
Contractual Information

User Impact

KPI REDUCTION: None Medium KPI Impacted by Radio Env. RAN nodes, CS Core nodes and interfaces. Radio Optimization and Tuning has a limited influence on the KPI target. MEASUREMENT
Measurement Area KPI Domain

Method

Drive Test
Measurement Execution

Golden Cluster

QoS

DRIVE TESTS: Drive test downloading a 1MB file (FTP). If a single drive test is used to measure a Throughput KPI and CCSR PS then a larger file should be downloaded, e.g. 5MB or 10MB. The terminating party is a FTP server attached to the GGSN Start Trigger: Time of Call Attempt or first RRC Connection Request UL Stop Trigger: Time of Activate PDP Context Accept DL STATISTICS: None available for this KPI
Entry and Exit Criteria

DRIVE TESTS: Recommended to sample 300 calls for the measurement criteria. STATISTICS: None available for this KPI TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

DRIVE TESTS: Congestion or delay in the Core Network nodes have an impact on this KPI. Results larger than 20s should be discarded as a failed attempt. STATISTICS : None available for this KPI Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned (no data) KPI

1) Initial Tuning 2) Troubleshooting (E2E)

No

Area

Name

SW Rel

Recommendation

2.2.4.
Definition

Integrity

PS Interactive R99 User Throughput UL (User Throughput R99 UL) GENERAL

P6

Optional

The Packet-Switched Interactive R99 User Throughput UL (User Throughput R99 UL) is the average user throughput for PS Data in Uplink evaluation (kbps) on a R99 Radio Bearer. It includes user data but excluding retransmissions, padding bits, data PDU headers and RLC control PDU's. The most accurate method to measure User Throughput R99 UL is by Drive tests. The upload file size divided by the time to complete the upload and then taken as the indicator of user throughput. For high target throughput values, static tests are preferred. Calculated with Counter Statistics, User Throughput R99 UL is a ratio of the sampled RLC throughput measurements (including user data but excluding retransmissions, padding bits, data PDU headers and RLC control PDU's) in kbits/s divided by the number of times data was transmitted in the cell
Formula

User _ Throughput _( R99) =


Alternative Formula

RLC _ SDU _ Data(kb) RLC _ SDU _ Duration

User _ Throughput _( R99) =


User Impact

Upload _ File _ Size _ in _ kbits Session _ End _ TimeCONTRACTUAL (s) Session _ StartINFORMATION _ Time(s)

Contractual Information

KPI REDUCTION: None Medium Highly Feature Dependant: Impacted by Radio Env. RAN nodes, PS Core nodes; RBS Hardware; large variations between Drive test and Statistics measurement. MEASUREMENT
Measurement Area KPI Domain

Method

Drive Test/Statistics
Measurement Execution

Golden Cluster/All Clusters

QoS

DRIVE TESTS: Drive test with call sequences downloading a file (1MB or 5MB) set up from idle mode. The terminating party is ideally a UDP server attached to the GGSN within the operator domain. Start Trigger: Time for Session Start for upload (or when the first acknowledgement of a user data packet is received in UE.) Stop Trigger: Time for Session End for upload (or when the last acknowledgement of a user data packet is received in UE.) STATISTICS: Counters for Packet Throughput are calculated on a per RAB basis for R99 DCH UL PS Interactive.
Entry and Exit Criteria

GENERAL: No IP losses shall exist. Tested by conducting at least 1000 ping commands from the UE to the test server, where all shall be successful. There are no Transmission or Core limitations to maximum user throughput. STATISTICS: Using counter statistics, the user throughput is dependant on the file sizes being downloaded by all end users in the network. Smaller file size downloads would result in lower counter statistic throughputs, and therefore network counters could reflect an inaccurate perception of the network. TARGETS AND IMPLICATIONS
Conditions/Commercial Implication Required Services / Prerequisites

GENERAL: Big deviations between Drive test results (mostly high speeds) and Statistics(low speeds in average)!! High R99 throughput would depend on the optional RAB combinations availabe in the network for R99 UL DRIVE TESTS:Usually large FTP large files in tuned areas (mostly on 384 RAB) achieve speeds above 250 kbps STATISTICS: Averaged, mostly HTTP where there is no need for high speeds (internet site downloaded before switching to 384) and also transitions from 64/128/384 to EUL. Ericsson Controlled Environment Best In Class (NETQB) / Optimized Average (NetQB) / Tuned Pre launched / Initially Tuned (no data)

1) RND or RND Review 2) Initial Tuning 3) Troubleshooting 4) Optimization (Statistics)