Table of Contents

�1���� Scope����������
�2���� References
�3���� Abbreviations and acronyms�������������
�4���� Layered model of performance for IP service�������������
�5���� Generic IP service performance model���������
������� 5.1���� Network components
������� 5.2���� Exchange links and network sections�
������� 5.3���� Measurement points and measurable sections�������������
������� 5.4���� IP packet transfer reference events (IPREs)�����
������� 5.5���� IP packet transfer outcomes��
�6���� IP packet transfer performance parameters
�� �����6.1���� Packet qualifications�
������� 6.2���� IP packet transfer delay�����������
������� 6.3���� IP packet error ratio (IPER)�����
������� 6.4���� IP packet loss ratio (IPLR)��������
������� 6.5���� Spurious IP packet rate������������
������� 6.6���� IP packet reordered ratio (IPRR)�����������
������� 6.7���� IP packet severe loss block ratio (IPSLBR)���������
������� 6.8���� IP packet duplicate ratio (IPDR)������������
������� 6.9���� Replicated IP packet ratio (RIPR)����������
������ 6.10���� Stream repair parameters�����
������ 6.11���� Capacity parameters
������ 6.12���� Flow-related parameters�������
�7���� IP service availability�������������
������� 7.1���� IP service availability function
������� 7.2���� IP service availability parameters��������
Annex A � IP-based capacity and flow-related parameters and methods of measurement����
������� A.1���� Background��
������� A.2���� IP-layer access capacity parameters and methods of measurement (consumer Internet access)����
������� A.3���� Flow-related throughput parameters and methods of measurement (reliable delivery transport)����
������� A.4���� Plan to qualify and compare access measurement methods����
Annex B � Additional search algorithm for IP-based capacity parameters� and methods of measurement����
������� B.1���� Search algorithm��������
Appendix I � IP packet routing considerations����
Appendix II � Secondary terminology for IP packet delay variation����
������ II.1���� Introduction��
������ II.2���� Definition of inter-packet delay variation����������
������ II.3���� Definition of 1-point packet delay variation������
��� ���II.4���� Guidance on applying the different parameters�������������
Appendix III � Rate and throughput capacity related parameters����
Appendix IV � Tests of IP service availability state and sampling estimation of IP service availability parameters����
������ IV.1���� Minimal test of IP service availability state (for test methodologies and test sets)����������
������ IV.2���� Test of IP service availability state (using sequential probability ratio test)��������
������ IV.3���� Alternate test of statistical significance to determine IP service availability��������
������ IV.4���� Sampling estimation of IP service availability��
Appendix V � Material relevant to IP performance measurement methods����
Appendix VI � Background on IP service availability����
������ VI.1���� Introduction�
������ VI.2���� Background��
������ VI.3���� Definitions of the regions in Figure VI.1������������
������ VI.4���� Summary�������
Appendix VII � Packet performance parameters for estimation� and optimization of stream repair techniques����
����� VII.1���� Introduction
����� VII.2���� Short description of application-layer stream repair techniques������������
����� VII.3���� Simple model of application-layer stream repair techniques���
����� VII.4���� Example of performance parameters to characterize stream repair variables���
����� VII.5���� Discussion of parameter measurement and usage�������
����� VII.6���� Additional considerations�������
Appendix VIII � IP-layer capacity framework����
���� VIII.1���� Introduction
���� VIII.2���� Terminology and relation to IETF RFC 5136������
���� VIII.3���� Items for further study������������
Appendix IX � Explanation of TCP-based measurement inadequacy to meet normative requirements����
������ IX.1���� Introduction�
������ IX.2���� Comparison with normative requirements������
Appendix X � Summary of Laboratory (Phase 1) and Field (Phase 2) results:� Annex A evaluation plan����
������� X.1���� Introduction�
����� Page
������� X.2
���� Phase 1 laboratory test set-up��������������
������� X.3���� Detailed test set-up��
������� X.4���� Test tools�������
������� X.5���� Calibration of reported results with iPerf 2������
������� X.6���� Summary of test approach and results��������������
������� X.7���� Summary of tests comparing measured capacity vs calibrated PHY rates������������
������� X.8���� Summary of tests comparing measured capacity vs round-trip delay����
������� X.9���� Summary of tests with competing traffic����������
������ X.10���� Tests with early implementation of a new UDP testing tool�����
������ X.11���� Tests of the effects of low-level packet loss���
������ X.12���� Examination of the maximum transmission limitations of the test tools and platform��
������ X.13���� Examination of tests with early impairments on UDP streams
������ X.14���� Examination of TBF shaper parameters used in tests and comparison with policer filter����
������ X.15���� Summary of Phase 1 laboratory testing�����������
������ X.16���� Platform specifications�����������
������ X.17���� Summary of Phase 2 field test results
Appendix XI � A brief survey on Internet access related QoS and QoE research����
������ XI.1���� Introduction�
������ XI.2���� Key findings��
������ XI.3���� Analysis of research publications related to QoS and QoE measurements���������
������ XI.4���� General tendencies related to Internet access performance����
Appendix XII � Accurate bit rate measurements����
����� XII.1���� Introduction�
����� XII.2���� Key findings��
����� XII.3���� Header size inflicted bandwidth measurement error estimation������������
����� XII.4���� Example overhead calculation for a wireline IEEE 802.3 Ethernet interface�������
����� XII.5���� Description of token bucket filter functionality��������������
Appendix XIII � IP-based flow-related parameters and methods of measurement����
���� XIII.1���� Background��
���� XIII.2���� Why MBM meets the requirements of this Recommendation
���� XIII.3���� Role and status of the MBM method of measurement
���� XIII.4���� Test stream selection
���� XIII.5���� Measurement points
���� XIII.6���� Target model parameter specification���������������
���� XIII.7���� Setting acceptance criteria and interpreting the results�������������
���� XIII.8���� Test methods��������������
���� XIII.9���� Example(s)���
Bibliography����