TD-LTE Air Performance

(KPI Test)
& Optimization

Contents
- LTE Overview
- KPI for LTE
- Optimization
2

LTE Overview

LTE System Architecture Evolution

LTE Channel Bandwidth

Frequency
Range
Channel
Bandwidth,
1Resource
Block (RB) =
180KHz
Modulation
scheme
Multiple
Access

MIMO

UMTS FDD bands and UMTS TDD bands

1.4MHz

3MHz

5MHz

10MHz

15MHz

20MHz

6 RBs

15RBs

25RBs

50RBs

75RBs

100RBs

Downlink: QPSK, 16QAM, 64QAM

Uplink: QPSK, 16QAM, 64QAM (optional for handset)
Downlink: OFDMA
Uplink: SC-FDMA
- Transmit diversity, Cyclic delay diversity (Max. 4
antenna at Base station and handset)
- Spatial multiplexing, Multiuser MIMO

LTE Resource Grid

LTE Frame Structure

FDD-LTE frame structure (type1)

1 radio frame (Tf = 307200Ts = 10 ms)

1 slot (Tslot = 15360Ts = 0.5 ms)

#0

#1

#2

1subframe
(1 ms)
TDD-LTE
frame

#3

#18

#19

structure (type2)

1 radio frame ( Tf = 307200Ts = 10 ms)

1 half-frame ( 153600Ts = 5 ms)

1 subframe ( 30720Ts = 1 ms)

#0

#2

DwPTS UpPTS
Guard period

#3

1 slot ( Tslot = 15360Ts = 0.5 ms)

#4

#5

#7

#8

#9

Transmission in LTE

TDD-LTE

Special subframe : provide guard time for DL-to-UL switchin

g
Single carrier frequency
FDD-LTE

Two carrier frequencies for UL transmission and DL transmis

sion
UL and DL transmission can occur simultaneously

LTE Physical Signals

Physical

Signals

Reference signal
(RS)
Synchronization signal
(SS)

Downlink
Cell-specific RS
UE-specific RS
MBSFN RS
Primary SS
Secondary SS

Synchronization signal (SS)

Acquire frequency and symbol synchronization to a cell
Reference signal (RS)
Provide for channel estimation between UE and eNB
Performs as pilot signal for coherent detection

Uplink
Demodulation RS
Sounding RS

LTE Synchronization signals

Synchronization signals : PSS, SSS

The detection of these two signals
Enables time and frequency synchronization
Provides the UE with the physical layer identity of the cell
Provides the cyclic prefix length
Informs the UE whether the cell uses FDD or TDD
Transmitted periodically, twice per 10ms radio frame
the PSS and SSS are transmitted in the central six RBs
PCID (0 ~ 503) = 3 *SSS + PSS
PSS : 0, 1, 2
SSS : 0, 1, 2, , 167
Synchronization signals In TDD cell
The PSS is located in the third symbol of the 3rd and 13th slots
The SSS is located three symbols earlier
The precise position of the SSS changes depending on the length of the CP which is chosen
for the cell

LTE Reference signal

Mapping of DL Reference Signals

Transmitted in every DL subframe
Used for channel estimation for coherent demodulation of any dowinlink trans
mission
Cell-specific reference signals in case of multi-antenna transmission
Cell-specific RSs are staggered with Six possible frequency shift

<PSS

<PSS

<PSS

LTE Measurement Items

RSRP [dBm] : Reference Signal Received Power

Absolute value, not related to Payload

RSSI [dBm] : Received Signal Strength Indicator

Directly proportional to Payload

RSRQ [dB] : RSRP/RSSI ratio

Inversely proportional to Payload
Using for handover of cell loading

LTE Call Setup Procedure

LTE Power Control

DL Tx Power
eNB Tx Attenuation
Power Option (PA, PB)

UL Tx Power
Open Loop Power Control

Compensate Pass Loss

Closed Loop Power Control

Compensate Fading

Outer Loop Power Control

Compensate BLER (ACK/NACK_Count comparing with Threshold)

Power Head-Room
Compensate UE_Tx_Power_limit

KPI for LTE

15

Exam
p le
of A
ctua
Rep
l
ort

KPI Overview
KPI Test Method and Condition Overview

The test achieved on Samsung LTE system service area.

Basically, KPI test and test method on cluster follow the document
LTE_WiMAX SOW _Final.
Test terminal for drive test is a USB dongle type terminal for mobility.
Stationary test items are measured 1 time on each cluster.
Used mobile terminal side DM software is Optis by Innowireless co.

UE Information
Type

Model

USB Dongle

1K3

SW Ver.

Chipset

Chipset FW Ver.

1.0.03.010 Qualcomm20120329_1K3QCI_4036_M0.02

System Information
System

Frequency

TDD Configuration

MIMO Mode

TD-LTE

2592MHz

Configuration #1
Special Subframe #7

TM3(SM)

KPI Test Items

Stationary Test

Cell Edge Coverage Probability

Wireless link Burst Error Rate
Sector Burst Error Rate
Successful Setup rate/Accessibility
Session establishment delay
Session Recovery success rate
Maximum Round Trip Latency
Maximum Jitter
Average downstream throughput Terminal level
Average upstream throughput Terminal level
Average downstream throughput Sector level
Average upstream throughput Sector level
Handof

Mobility Test

Global Coverage Probability

Dropped session rate / Retainability
Minimum Data Rate Guarantees - Downstream
Minimum Data Rate Guarantees Upstream
Handof

Cell Edge Coverage Probability

To verify Cell Edge coverage probability
Measurement Method : using ftp client CMD window
result
Test method
Located UE at Edge area
(RSRP < -100 dBm , SINR < 5dB)
Capture a CMD window text result
Calculate Minimum Download and Upload rate
Pass Criteria
Acceptable Range : More than 80 % (1Mbps,
256kbps)
Target Range
: More than 85 % (1Mbps,
Test 256kbps)
area

Test Result
Point

Cluster #5
RSRP

SNR

DL

UL

-108.6

2.4

10.5 Mbps

0.99 Mbps

-111.9

3.9

5.6 Mbps

0.52 Mbps

-110.5

2.6

5.8 Mbps

0.38 Mbps

-117.5

2.7

6.2 Mbps

0.42 Mbps

-102.0

2.6

12.4 Mbps

0.33 Mbps

-101.3

3.2

11.0 Mbps

0.47Mbps

-101.5

2.1

8.5 Mbps

0.68 Mbps

-108.6

3.3

9.5 Mbps

1.3 Mbps

-108.8

2.4

8.8 Mbps

0.51Mbps

10

-106.1

3.7

11.1 Mbps

0.33 Mbps

11

-112.5

2.4

8.7 Mbps

0.74 Mbps

12

-115.4

3.1

10.6 Mbps

0.31Mbps

13

-108.9

2.5

11.6 Mbps

0.32 Mbps

14

-106.3

4.7

11.5 Mbps

0.95 Mbps

15

-113.7

2.3

5.8 Mbps

0.33 Mbps

16

-104.2

2.2

7.2 Mbps

0.83 Mbps

17

-101.2

3.8

11.6 Mbps

1.0 Mbps

18

-109.4

3.6

11.0Mbps

0.37 Mbps

19

-120.6

2.1

6.7 Mbps

1.6 Mbps

20

-109.4

4.9

11.4 Mbps

1.1 Mbps

Successful Setup Rate

To verify that wireless session are successful in service.
Measurement tool : DM tool
Measurement = (#. of Total call Attach try - # of Call Fault) / (#. of Total call
Attach try)
Test method
Located UE at Edge area (RSRP -95dBm ~ -105dBm)
Try Attach 100 times.
Logging RRC message at the eNB and calculate attach success rate
Pass Criteria
Acceptable Range : More than 96 %
Target Range
: More than 98 %
Log file Analysis:

Result = (1800-0) / (1800)

Result
Total Setup Try Count

1800

Setup Fail Count

Successful Setup Rate

100 %

Session Establishment Delay

Def.) Time delay from message RRCconnectionRequest to
RRCconnectionReconfigurationcomplete
Measurement tool: DM tool
Measurement = Total Attach Delay
Test method
Located UE at Edge area (RSRP -95dBm ~ -105dBm)
Try Attach 100 times.
Calculate attach delay at DM tool
Pass Criteria
Acceptable Range : Less than 2.5 sec
Target Range
: Less than 2.5 sec
Log file Analysis:

Result
Total Setup Try Count

1800

Session Establishment Delay

392.2 ms

Session Establishment Delay

Dropped Session Rate

To verify dropped session rate
Measurement tool: PSS DM
Measurement = ((# of Drop)+(# of Timeout)) / (# of Total)

# of traffic fail is excepted to # of Total Try, when UE state is abnormal

state
after Call drop
Test method

Drive route test on Cluster area

Short call test
FTP download / upload

Pass Criteria
Acceptable Range : Less than 4 %
Target Range
: Less than 4 %
Log file Analysis
( Filtering RSRP > -113dBm & SINR > -3dB)

Result = (23+15) /
(1651)

Total Call

1668

Traffic fall

End by user

Attempt Call

1651

Success

1613

Drop

23

Timeout

15

Drop Rate

2.30%

Session Recovery Success

Rate
Def.) To verify that the network allows user to enter the active state with a high
success rate
Measurement tool: System Log (eccb Block)
Test method
Located UE at Edge area (RSRP -95dBm ~ -105dBm)
Try Idle to active state 50 times.
Logging RRC message at eccb block and calculate attach success rate
Pass Criteria
Acceptable Range : More than 96 %
Target Range
: More than 98 %
Log file Analysis:

Result = (900) / (900)

Result
Total Setup Try Count

900

Setup Fail Count

Successful Setup Rate

100 %

LTE Handover Classification

Intra-RAT Handover

Intra-eNB Handover

Inter-eNB Handover over X2

Inter-eNB Handover over S1 (Intra-MME)

Inter-eNB Handover over S1 (Inter-MME)

Inter-RAT Handover

CDMA2000, GERAN, UTRA, etc.

LTE Handover Procedure [signaling]

LTE Tool example

LTE Handover Procedure [signaling]

LTE Tool example

Check NBR List at
rrcconnectionreconfiguration msg.

Handover from PCI 107 to PCI 258

Handoff Successful Rate

Measurement tool: PSS DM, O&M
Test method
Drive between BSs and measure HSR.
Pass Criteria
Acceptable Range : More than 96 %
Target Range
: More than 96 %
Log file Analysis:

Result
HO attempt

108

HO success

106

HO fail

HO success rate

98.13%

Handoff Stationary
Def.) Any given fixed terminal shall not perform more than 6 handofs in any 60
sec interval
Measurement tool: PSS DM
Test method
20% of sectors per Cluster
overlapping area is selected to test / Must wait for 60 seconds stationary
Log file Analysis:

Site

Resul
t

Site
To
Site

2189A 2189B 2189G 2190A 2190B 2190G 2218A 2218B 2218G 2348A

2218G 2857B 2813B 2813G 2813G 2332B 5754G 3906B 2189A 2826G

Time

1min 1min 1min 1min 1min 1min 1min 1min 1min 1min 1min 1min 1min 1min 1min 1min 1min 1min

H/O
count

2348B
2348G 5736A 5736B 5736G 5737A 5802B 5737G

5736B 5804B 5737A 2336B 2348B 2809G 2813A

2329G

1Min
OK

Minimum Data Rate Guarantees Down

To verify that all PSS configured with minimum rate service flows always
respect their minimum rate guarantees
Global Coverage probability, Cell Edge Coverage probability item is replaced
testfail
item
with
# ofthis
traffic
is excluded for calculation, when UE state is abnormal state
after Call drop
Test method
Drive route test on Coverage area.
Short call test
FTP Download
Pass Criteria
Acceptable Range : More than 90 % (1Mbps)
Target Range
: More than 95 % (1Mbps)
Log file Analysis
Total
832
( Filtering RSRP > -113dBm & SINR > -3dB)

Result = (814) / (823)

Traffic fail
End by user
DL (FTP Download)
Attempt
Success (more than
1Mbps)
Drop
Failure
Timeout
Minimum Data Success
Rate

Exception

4
5

823
814
3
5
98.91%

Minimum Data Rate

Guarantees
Up
To verify that all PSS configured with minimum rate service flows always
respect their minimum rate guarantees
Global Coverage probability, Cell Edge Coverage probability item is replaced
testfail
item
with
# ofthis
traffic
is excluded for calculation, when UE state is abnormal state
after Call drop
Test method
Drive route test on Coverage area.
Short call test
FTP Upload
Pass Criteria
Acceptable Range : More than 90 % (256kbps)
Target Range
: More than 95 % (256kbps)
Log file Analysis
Total
834
( Filtering RSRP > -113dBm & SINR > -3dB)
Exception

Result = (811) / (826)

Traffic fail

End by user

UL (FTP Upload) Attempt

Success (more than
256kbps)
Drop
Failure
Timeout
Minimum Data Success
Rate

826
811
7
8
98.18%

LTE Frame Structure_TDD

LTE TD-LTE Throughput

TD LTE
Maximum
Throughput
Ideal
Field

1 UE Max. (Category 3)

1 Sector Max.

DL-UL
Configuration

Special
subframe
Configuration

DL (Mbps)

UL (Mbps)

DL (Mbps)

UL (Mbps)

Config#1

config. #7

61.2

17.5

80.6

18.6

Config#2

config. #7

81.6

8.1

110.6

8.2

Config#1

config. #7

55.3

16.3

70.8

17.2

Config#2

config. #7

74.6

7.8

98.2

7.9

Theoretical Peak T-put vs. Field Practical peak T-put

msg. overhead (Overhead 10%)

Air Error (Target BLER 10%)

FTP Test (UDP * 0.90% ~ 0.95%)

1 UE peak vs. 1 Sector peak T-put

Capacity of UE-Category 3 (3GPP 36.306)

- Maximum TBS(Transmission Block Size): 75376 bits
- Maximum total data rate: 102048 bits
- Maximum num of layers: 2 (2x2 MIMO)

1UE Theoretical Peak value

- limited by the Maximum data rate: min(75376 x 2, 102048) = 102048
- Theoretical Peak value with TDD configuration 1-7 can be calculated as below: (102048 x 6) * 100 61Mbps
* where 6 is the number of DL sub-frames included 2 special sub-frames,
100 is the number of frame within 1 sec.

UL resource allocation (2n*3n*5n)

- 1 Sector of eNB can allocate UL resource to 1 UE Max. RB 81 (43816 bits)
- 1 Sector of eNB can allocate UL resource to 2 UEs Max. RB 88 (46480 bits)
* 12 RBs are using for PUCCH

LTE UE Category
LTE UE category data rates (per TTI)
Category

DL

10

50

100

150

300

UL

25

50

50

75

LTE UE category modulation formats supported

Category

DL

QPSK, 16QAM, 64QAM

UL

QPSK, 16QAM

QPSK, 16QAM, 64QAM

LTE UE category modulation formats supported

Category
2Rx diversity
2x2 MIMO
4x4 MIMO

Assumed in performance requirements across all LTE UE categories

Not
supported

Mandatory
Not supported

Mandatory

Average down throughput terminal

Measurement tool : Using ftp client program and screen capture.
Test method
Stationary point test on 3 diferent environment area.
Single UE for test.
Measured for 1 minutes on each position
Record the each throughput at 3 points
Pass Criteria
Acceptable Range : More than 4 Mbps
Target Range
: More than 4 Mbps
Log file Analysis:

Strong RF point

RSRP SINR

Average

DL

-67

29

Middle RF point

Weak RF point

Total (Mbps)

DL

RSRP

SINR

DL

RSRP

SINR

DL

Average

53.1

-89

20

35.3

-104

17.0

35.14

Point

RSRP

SINR

Good

-67 dBm

Mid
Weak

Site
2348_A

2348_B

5736_A

5736_B

5736_G

2189_A

2189_B

2189_G

2190_A

29 dB

56.7

56.3

55.6

54.9

53.6

49.8

56.0

49.0

47.7

-89 dBm

20 dB

35.9

39.8

35.9

35.5

33.9

30.9

31.6

30.1

32.9

-104 dBm

9 dB

21.4

12.9

12.7

18.4

14.8

15.0

12.6

10.9

15.0

Average

38.00

36.33

34.73

36.27

34.10

31.90

33.40

30.00

31.87

Result

OK

OK

OK

OK

OK

OK

OK

OK

OK

Average up throughput terminal

Measurement tool : Using ftp client program and screen capture.
Test method
Stationary point test on 3 diferent environment area.
Single UE for test.
Measured for 1 minutes on each position
Record the each throughput at 3 points.
Pass Criteria
Acceptable Range : More than 1 Mbps
Target Range
: More than 1 Mbps
Log file Analysis:

Strong RF point

RSRP SINR

Averag
e

DL

-67

30

Middle RF point

Weak RF point

Total (Mbps)

UL

RSRP

SINR

UL

RSRP

SINR

UL

Average

16.2

-80

20

9.9

-104

2.2

9.43

Point

RSRP

SINR

Good

-67 dBm

Mid
Weak

Site
2348_A

2348_B

5736_A

5736_B

5736_G

2189_A

2189_B

2189_G

2190_A

30 dB

16.4

16.0

17.3

17.1

16.5

15.4

17.1

14.6

15.7

-80 dBm

20 dB

7.5

9.0

10.6

8.9

8.1

7.1

2.3

9.9

13.0

-104 dBm

9 dB

3.9

2.4

2.2

1.2

1.0

0.7

1.0

0.4

3.6

Average

9.27

9.13

10.03

9.07

8.53

7.73

6.79

8.30

10.77

Result

OK

OK

OK

OK

OK

OK

OK

OK

OK

Average down throughput sector

Measurement tool : Using ftp client program and screen capture.
Test method
Stationary point test on 3 diferent environment area.
Single UE for test.
Measured for 1 minutes on each position
Record the each throughput at 3 points
Pass Criteria
Acceptable Range : More than 15 Mbps (80%)
Target Range
: More than 18 Mbps (90%)
Log file Analysis:
Strong RF point

RSRP SINR

Average

DL

-67

28

DL
23.2

Point

RSRP

SINR

Good

-67 dBm

Mid
Weak

Middle RF point
RSRP SINR
-90

20

Weak RF point

DL

RSRP SINR

11.9

-103

Total (Mbps)

DL

Average

6.6

41.67

Site
2348_A

2348_B

5736_A

5736_B

5736_G

2189_A

2189_B

2189_G

2190_A

28 dB

25.1

25.0

25.10

25.4

25.3

22.4

22.30

19.0

19.4

-90 dbm

20 dB

14.7

14.3

11.6

13.9

11.9

9.8

12.4

11.2

10.2

-103 dBm

9 dB

8.5

4.9

7.2

6.0

5.8

6.1

5.0

4.0

5.2

Average

48.30

44.20

43.90

45.30

43.00

38.30

39.70

34.20

34.80

Result

OK

OK

OK

OK

OK

OK

OK

OK

OK

Average up throughput - sector

Measurement tool : Using ftp client program and screen capture.
Test method
Stationary point test on 3 diferent environment area.
3 UEs uploading simultaneously for test.
Measured for 1 minutes on each position
Pass Criteria
Acceptable Range : More than 5.5 Mbps (80%)
Target Range
: More than 6.5 Mbps (90%)
Log file Analysis:

Strong RF point

RSRP SINR
Average

DL

-66

30

UL

Middle RF point
RSRP SINR

6.8

Point

RSRP

SINR

Good

-66 dBm

Mid
Weak

-91

Weak RF point

UL

22

RSRP SINR

5.3

-106

11

Total (Mbps)

UL

Average

1.2

13.31

Site
5783_A

5783_G

5716_G

2204_A

2204_B

2204_G

5714_A

5714_B

5714_G

30 dB

8.0

7.0

6.4

10.3

7.5

7.2

5.7

6.0

7.4

-91 dBm

22 dB

7.5

5.1

4.8

6.3

5.7

7.3

5.1

4.6

6.3

-106 dBm

11 dB

1.1

0.6

0.9

0.6

0.7

0.7

0.7

0.7

3.4

Average

16.60

12.70

12.14

17.25

13.90

15.24

11.55

11.26

17.10

Result

OK

OK

OK

OK

OK

OK

OK

OK

OK

Wireless Block Error Rate

Measurement tool: PSS DM
Measurement = (count count of above 1%) / count
* count of above 1% = count of BLER all data except 0
Test method
Drive route test on Cluster area.
Short call test
Pass Criteria
Acceptable Range : 95% (Less than 1%)
Target Range
: 99% (Less than 1%)
Log file Analysis:

% of less than 1% BLER =(21168-390) / 21168

Result
Count

21168

Count of above 1%

390

Less than 1% BLER

98.16%

Sector Block Error Rate

Measurement tool: WSM
Measurement = Block Error Rate during FTP
Test method
Stationary point test on Cluster area.
BLER is measured on WSM side with BLER statistics.
Pass Criteria
Acceptable Range : 95% (Less than 1%)
Target Range
: 99% (Less than 1%)
Log file Analysis:

Result
Total Test Sector

18

Ave. Sector Block Error Rate

0.14%

Count of Sector (Above BLER

1%)

Rate of sector (Less than 1%

BLER)

100%

Maximum Round Trip Latency

Def.) Latency for ping size of 32byte (95% percentile)
Measurement tool: : using ftp client CMD window result
Test method
Stationary point test on Cluster area.
20% of sectors per Cluster / Each Sector has test 100 times.
Pass Criteria
Acceptable Range : Less than 60 ms (95%)
Target Range
: Less than 50 ms (95%)
Log file Analysis:

Result
Test Site

2189

2190
Gamm
Alpha
a

2218
Gamm
Alpha
a

2348
Gamm
Alpha
a

5736
Gamm
Alpha
a

5737
Gamm
Alpha
a

Beta

Gamm
a

100

100

100

24

24

23

19

146

57

150

107

Sector

Alpha

Beta

Count

100

100

100

100

100

100

100

100

100

100

100

100

100

100

100

Minimum

28

28

27

25

29

29

29

23

22

19

22

30

28

23

Maximum

57

49

48

49

55

212

49

47

112

49

53

68

50

50

Beta

Beta

Beta

Beta

Average

33.57 34.35 33.61 33.83 38.92 36.34 35.87 35.50 36.30 33.87 33.88 35.58 35.33 33.95 35.40 35.52 35.66 33.52

Median of
95%

35ms 35ms 35ms 34ms 38ms 38ms 37ms 35ms 36ms 34ms 34ms 36ms 35ms 34ms 36ms 35ms 35ms 33ms

Maximum Round Trip Time

Maximum Jitter
Def.) Jitter for Round Trip Delay of ping size of 32byte (95% percentile)
Measurement tool: : using ftp client CMD window result
Test method
Stationary point test on Cluster area.
20% of sectors per Cluster / Each Sector has test 100 times.
Pass Criteria
Acceptable Range : Less than 10 ms (median of 95% tile)
Target Range
: Less than 10 ms (median of 95% tile)
Log file Analysis:

Result
Test Site

2189

2190
Gamm
Alpha
a

2218
Gamm
Alpha
a

2348
Gamm
Alpha
a

5736
Gamm
Alpha
a

5737
Gamm
Alpha
a

Beta

Gamm
a

100

100

100

13

15

15

19

23

3.73

4.09

4.05

4.53

5.73

Sector

Alpha

Beta

Count

100

100

100

100

100

100

100

100

100

100

100

100

100

100

100

Minimum

Maximum

12

15

13

12

20

12

15

16

19

23

36

12

13

Average

5.12

4.85

4.64

3.30

4.20

4.96

4.77

4.20

5.39

5.11

4.12

3.84

3.22

Median of
95%

5ms 5ms 4ms 2ms 2ms 6ms 6ms 2ms 3ms 4ms 2ms 2ms 2ms 2ms 2ms 2ms

Beta

Beta

Beta

Beta

2.5m
4ms
s

Diagnostic Monitoring Tool

Diagnostic Monitoring Tool

DM(Diagnostic Monitoring) Tool : Collecting RF data and RRC Log messages from
the UE. It is consist of S/W which is installed at the laptop PC and USB dongle. It
will be used for the optimization and trouble shooting purpose

Diagnostic Monitoring Tool

Information taken by Optis

RF environment, Resource assignment, Signaling message, etc.

Diagnostic Monitoring Tool

Information taken by Optis

Real time mapping of the information (ex RSRP, CINR)

Diagnostic Monitoring Tool

DM Port Setup

DM Port setting

Interface setting

Diagnostic Monitoring Tool

Autocall Setup (Attach Success rate)

check this
check box

Diagnostic Monitoring Tool

Autocall Setup (Minimum data Rate Guarantees, Drop rate)

Thank You

51