C&I Deliverables (Pillar 1&2)

• SG11 confirmed the creation of the ITU Testing Laboratory Recognition procedure. Based on the request of SG11, TSB launched ITU Testing Laboratory Recognition datatabse. The relevant request needs to be submitted through the online form which is available on ITU C&I Portal (1f8a81b9b0707b63-19211.webchannel-proxy.scarabresearch.com/go/citest).
• Any TL including non-ITU members, which expresses its interest to be accredited against ITU-T Recommendations to be further recognized by ITU, needs to approach Accreditation Body (AB) that is a signatory to the ILAC MRA. The list of ABs is available at: https://ilac.org/signatory-search/​. Afterwards, once the accreditation is given to the TL and relevant application form submitted to ITU by TL, the TL can be recognized by ITU accordingly.
• All ICT products tested against ITU-T Recommendation by TLs recognized by ITU may be registered in the ITU Product Conformity Database, based on the request. The relevant requests need to be submitted via online form​ accordingly.
  
• SG11 approved number of standards which contains test specififications for tactile internet testing and VNF testing (ITU-T Q.4065, Q.4067) (2021, SG11-R42​)
  
• CASC decided that ITU may recognize TLs that have been accredited by ILAC MRA signatories AB which have ITU Recommendations in its scope of accreditation (2021, SG11-R42, Annex 6).
  
• SG11 approved number of standards which contains test specififications for IoT, AR applications, virtual Broadband Gateways, etc. (ITU-T Q.4066, Q.4062, Q.4063, Q.3915, Q.4064) (2020, SG11 report​).
• CASC continues colloboration with ILAC on recognition of Testing Laboratories which perform tests against ITU Recommendations (2020, CASC Report)​.
  
• CASC decided that the standalone ITU/IECE​E TL recognition procedure, which comes with extra costs for TLs, is not needed, as there is no financial benefit in return for TLs who might wish to populate the ITU Product Conformity Database only (2020, CASC Report). 
• CASC decided to put the joint ITU/IEC certification scheme on hold in order to give ITU-T SGs a possibility to consider all provided financial details and provide CASC feedback whether such joint certification scheme is of interest of their members, taking into consideration financial implications (2020, CASC Report).
  
• SG11 approved ITU-T Q.3963 on compatibility testing of SDN-based equipment and started develoment of several new test specifications including interoperability testing requirements of blockchain as a service​ (2020)
  
• CASC started collaboration with ITU-T SG16 on Self-declaration Conformity and Interoperability testing for  the video surveillance and certification procedure against ITU-T standards to be used for “safe listening” (CASC report​) 
  
• CASC considered the outcomes of the Questionnaire on evaluation of market needs for joint ITU/IEC TL recognition procedure and certification schemes on ITU-T Recommendations (SG11-TD1142/GEN)
  
• SG11/CASC revised a guideline on ITU-T C​ASC procedure to appoint ITU-T technical experts​​ (2019)
  
• CASC appointed 11 technical experts proposed by ITU-T SG2, SG5 and SG16 and several individuals (2019, CASC report​)
  
• SG11 decided to disseminate a questionnaire on evaluation of market needs for joint ITU/IEC TL recognition procedure and certification schemes on ITU-T Recommendations (2019, TSB Circular 208​)
  
• ​​​​​IECEE TF finalized the Operational Document (OD) “ICT Laboratory Recognition Service on ITU-T Recomme​ndations" and presented it at the ITU-T CASC meeting. The service is based on IECEE peer assessment processes by using ITU-T Recommendations. This service would be organized and arranged from IECEE side based on IECEE peer assessment program, which would use and facilitate ITU-T technical experts nominated by ITU-T CASC (CASC Report, 2019)
• ​SG11 aproved three new test specifications (2019):
  
• ​ITU-T Q.4061 “Framework of SDN controller testing"
  
• ITU-T Q.4014.1 "PSTN/ISDN terminal equipment using IP Multimedia core network subsystem; Conformance testing; Part 1: PICS"
• ITU-T Q.4014.2 "PSTN/ISDN terminal equipment using IP Multimedia core network subsystem; Conformance testing; Part 2: TSS&TP"
• ​​SG11 approved Supplement 71 to ITU-T Q-series of Recommendations “Testing methodologies of Internet related performance measurements including e2e bit rate within the fixed and mobile operator’s networks” (2019)
• SG20 approved set of new Recommendations dealing with IoT testing (2018):
  
• ​Q.3954: oneM2M – Interoperability testing
• Q.3955: oneM2M – Testing framework
• ITU-T SG11 approved a new Recommendation ITU-T Q.4060: The structure of the testing of heterogeneous Internet of Things gateways in a laboratory environment (2018)
• SG11 decided to start a new subcategory Q.4060-Q.4099: Testing specifications for IMT-2020 and IoT (2018).​
• SG11/CASC approved ​a guideline on ITU-T C​ASC procedure to appoint ITU-T technical experts (2017)
• ​CASC started close collaboration with IECEE. CASC representatives were included into IECEE TF "ITU Requirements" (2017, CASC report​)
  
• SG11 approved new Recommendation ITU-T Q.3952 “The architecture and facilities of Model network for IoT ​testing” (2017)​
  
• SG11 approved two new Recommendations on VoLTE interconnection (2017):
• ​ITU-T Q.3640: Framework of interconnection of VoLTE/ViLTE-based networks
• ITU-T Q.3953: VoLTE/ViLTE interconnection testing for interworking and roaming scenarios
• SG11 approved the revised Terms of Reference (ToR) of CASC​, which were aligned with WTSA-16 Resolution 2 and Resolution 76 referring to joint ITU/IEC certification scheme (2017)​​​
  

• ​​ITU-T SG11 Action plan for ITU C&I Programme implementation (25 February - 1 March 2013)
  
• Agreed the status report and Action plan (Council-13)
  
• Term of Reference of the Correspondence Group on collaboration between ITU-T and Testing Laboratories for ITU C&I Programme (WP4/11 meeting, 14-20 November 2013)
• Started the conformance testing pilot project on “network management interface related Recommendations (ITU-T M.3170 series)” is established in collaboration with SG2 (WP4/11 meeting, 14-20 November 2013)
• Report of the Correspondence Group meeting “Collaboration between ITU-T and testing laboratories for ITU C&I programme” (20 February 2014)
• ITU-T conducted the Test event "Performance assessment of vehicle-mounted mobile phones in conjunction with Hands-free Terminals according to Recommendations ITU-T P.1100 and ITU-T P.1110" (12-16 May 2014)
• SG11 approved Guideline "Testing laboratory recognition procedure" and established ITU-T Conformity Assessment Steering Committee (ITU-T CASC) (Geneva, SG11 meeting, 22-29 April 2015)
• SG11 approved 9 new ITU-T Recommendations on C&I which specify testing requirements and test specifications (Geneva, SG11 meeting, 22-29 April 2015)
• ITU conducted a Workshop on "Voice and Video Services Interoperability Over Fixed-Mobile Hybrid Environments, Including IMT-Advanced (LTE)" on 1 December 2015 (Geneva, 1 December 2015, see report)
• SG11 started a new work item Q.30xx_VoLTE_Interconnection "Framework of interconnection of VoLTE/ViLTE-based networks" (Geneva, SG11 meeting, 2-11 December 2015)
• SG11 approved collaboration agreement with ETSI TC INT to facilitate the development of standards on some technical areas which are points of interest for ETSI and ITU-T (e.g. SIP-IMS conformity testing, Internet speed measurement, interconnection among VoLTE/ViLTE-based networks) (Geneva, SG11 meeting, 2-11 December 2015) 
• The first meeting of ITU-T CASC took place during SG11 meeting. As one of the key results, ITU-T CASC agreed to develop the guidelines which will specify procedures of the appointment of ITU-T experts, a collaboration with the existing accreditation bodies (such as IEC and ILAC) and a recognition of Testing Laboratories (TL). See the report. (Geneva, ITU-T CASC meeting, 3 December 2015)
• SG11 aproved 30 new ITU-T Recommendations on C&I which specify testing requirements and test specifications (e.g. SIP-IMS conformity testing, Internet speed measurements etc.), Among others, there is a new Recommendation ITU-T Q.3905 “Conformance test plan for Number Portability requirements defined by ITU-T Q.Suppl.4” (Geneva, SG11 meeting, 2-11 December 2015)
  
• The second meeting of the ITU-T CASC took place during ITU-T SG11 meeting. CASC agreed a list of ITU-T Recommendations which may become subject of joint certification schemes (Geneva, 28 June 2016, see report)
• SG11 approved ITU-T Q.3960 "Framework for Internet related performance measurements" (Geneva, July 2016)
• SG11 approved ITU-T Q.3920 "Terms and definitions to be used in conformance and interoperability issues" (Geneva, July 2016)
• SG11 advanced Draft ITU-T Q.30xx_VoLTE_Interconnection "Framework of interconnection of VoLTE/ViLTE-based networks" (Geneva, July 2016)
• SG11 consented 20 new ITU-T Recommendations which specify testing requirements and test specifications for SIP-IMS conformity testing (Geneva, July 2016)
• ITU conducted a Workshop on "Combating Counterfeit Using Conformance and Interoperability Solutions"(Geneva, 28 June 2016, see summary)
• SG11 updated the list of pilot projects, living list of key technologies and reference table of ITU-T Recommendations which are suitable for C&I testing (Geneva, July 2016)
• JCA-CIT success​fully concluded in July 2016 because it accomplished its objectives. The coordination on the implementation of C&I Programme will be led by ITU-T SG11 (see progress report)​
  

​​