Table of Contents

Cover

Title Page

Preface

Acknowledgments

About the Authors

Abbreviations

Chapter 1: Introduction

1.1 Types of Networks
1.2 Standard Organizations
1.3 Market

Chapter 2: Requirements

2.1 Telephony
2.2 Streaming
2.3 IPTV
2.4 High-End Videoconferences
2.5 Webcast
2.6 Requirement Summary

Chapter 3: Audio, Image, Video Coding, and Transmission

3.1 Audio
3.2 Basics of Video Coding
3.3 JPEG
3.4 MPEG/H.26x Video Compression
3.5 Other Video Compression Standards
3.6 Three-Dimensional Video
3.7 Error Resilience
3.8 Transcoder

Chapter 4: Underlying Network Functions

4.1 Real-Time Protocol (RTP)
4.2 Session Description Protocol (SDP)
4.3 Streaming
4.4 Multicast
4.5 Quality of Service
4.6 NTP
4.7 Caching

Chapter 5: Synchronization and Adaptation

5.1 End-to-End Model
5.2 Jitter
5.3 Packet Loss
5.4 Play-Out Time
5.5 Congestion Control
5.6 Delay
5.7 Queuing
5.8 Media Player
5.9 Storage and Retrieval
5.10 Integration Scripting Languages
5.11 Optimization

Chapter 6: Session Initiation Protocol

6.1 SIP Basics
6.2 PSTN Interconnection
6.3 Conferencing
6.4 Presence
6.5 Network Address Translation
6.6 APIs and Scripting
6.7 Security and Safety
6.8 Planning a VoIP Company Telephony System

Chapter 7: Other Standard VoIP Protocols

7.1 H.323 VoIP Family
7.2 T.120 Data Applications
7.3 Gateway Control
7.4 Mobile VoIP
7.5 Skype

Chapter 8: WebRTC

8.1 WebRTC Transport
8.2 RTP/SDP Adaptations
8.3 Interworking

Chapter 9: Streaming and Over-the-Top TV

9.1 HTTP Live Streaming – Apple
9.2 Smooth Streaming – Microsoft
9.3 HTTP Dynamic Streaming – Adobe
9.4 Dynamic Adaptive Streaming over HTTP – DASH
9.5 DASH and Network Interaction
9.6 Content Delivery Networks
9.7 Providers

Chapter 10: Home Networks

10.1 IETF Home Standards
10.2 UPnP
10.3 DLNA
10.4 Residential Gateway

Chapter 11: High-End IPTV

11.1 Overview of DVB IPTV
11.2 Live Media Broadcast
11.3 Datacast Protocols
11.4 Management Functions
11.5 Content Download Service
11.6 Deployments
11.7 Companion Screen Application
11.8 Set-Top-Box Functions
11.9 Integration into Other Systems

Chapter 12: Solutions and Summary

12.1 Global Webcast
12.2 Digital Signage Broadcasting
12.3 Call Center
12.4 Videoconference and TelePresence
12.5 Summary of Requirements versus Solutions

References

Index

End User License Agreement

List of Illustrations

Chapter 2: Requirements

Figure 2.1 Rotary dial telephone
Figure 2.2 Presence example on a smartphone
Figure 2.3 Arcon historic set-top box STB1 – first VoD system (Source: Reproduced by permission of Centre for Computing History, Cambridge, UK)
Figure 2.4 Telefunken TV set from 1936 (Source: Licensed under CC BY 2.0 via Wikimedia Commons – https://commons.wikimedia.org/wiki/File:Telefunken_1936.jpg#mediaviewer/File:Telefunken_1936.jpg. Courtesy: Erik Newth)
Figure 2.5 HbbTV: linking between TV and Internet information content
Figure 2.6 AT&T picturephone – by Courtesy: LabguysWorld.com (Source: Licensed under CC BY 3.0 via Wikimedia Commons –https://commons.wikimedia.org/wiki/File:AT%26T_Picturephone_-_upper_RH_oblique_view.jpg#mediaviewer/File:AT%26T_Picturephone_-_upper_RH_oblique_view.jpg. Courtesy: LabguysWorld.com)
Figure 2.7 Telepresence system IX5000 (Source: Courtesy of Cisco Systems, Inc.)
Figure 2.8 Typical browser setup for a Webcast

Chapter 3: Audio, Image, Video Coding, and Transmission

Figure 3.1 Scope
Figure 3.2 Example for sampling and quantization
Figure 3.3 Human hearing range for pure tones
Figure 3.4 Companding function in telephony
Figure 3.5 Schema ADPCM Encoder
Figure 3.6 Overview of MPEG audio compression
Figure 3.7 Basic MPEG audio coding
Figure 3.8 Frequency masking
Figure 3.9 Overview of video sampling
Figure 3.10 $c03-math-0113$ value range for $c03-math-0114$
Figure 3.11 Subsampling schemas
Figure 3.12 Display size and resolution
Figure 3.13 Eight bit CLUT
Figure 3.14 Displaced blocks for treatment by motion compensation
Figure 3.15 Searching the motion vector MV
Figure 3.16 Example of Huffman coding
Figure 3.17 Example to arithmetic coding
Figure 3.18 One-dimensional DCT base functions
Figure 3.19 Two-dimensional $c03-math-0263$ DCT base functions
Figure 3.20 Lea transformed by $c03-math-0265$ DCT coefficients
Figure 3.21 JPEG encoder overview
Figure 3.22 MPEG packetized elementary stream (PES)
Figure 3.23 MPEG transport stream
Figure 3.24 H.261 schema
Figure 3.25 Possible frames
Figure 3.26 Two video objects in three VOPs
Figure 3.27 Predicting and interlacing
Figure 3.28 Block boundaries treated by deblocking filter
Figure 3.29 H.264 profiles: main, extended, and baseline
Figure 3.30 Overview of layering NAL
Figure 3.31 NAL header
Figure 3.32 Video coding layer NAL Access Unit
Figure 3.33 Temporal scalability
Figure 3.34 Spatial scalability
Figure 3.35 Partitioning of the $c03-math-0311$ macroblock by the Coding Tree Block (CTB)
Figure 3.36 Parallel operation on CTUs of a slice
Figure 3.37 Comparison of H.265–H.261 compression efficiency since 1990
Figure 3.38 SbS and TaB
Figure 3.39 Probability depending on bits passing through decoder until error is detected
Figure 3.40 Open-loop (a) and CPDT (b) for quality adaptation

Chapter 4: Underlying Network Functions

Figure 4.1 The multimedia network stack
Figure 4.2 RTP packet
Figure 4.3 Mapping video streams to RTP using NALUs
Figure 4.5 Multilayer synchronization with SVC
Figure 4.4 Sample RTP packet with MTAP16
Figure 4.6 Packet format for RTCP sender report
Figure 4.7 Calculation of RTT using RTCP reports
Figure 4.8 Packet format for RTCP Source Description (SDES) packet
Figure 4.9 Packet format for RTCP goodbye packet (BYE)
Figure 4.10 Example of CRTP header compression
Figure 4.11 CRTP packet
Figure 4.12 SDP sample message
Figure 4.13 Sample RTSP session
Figure 4.14 Mapping Ethernet and IPv4 multicast addresses
Figure 4.15 IGMP membership query packet
Figure 4.16 IGMP Membership Report packet (Note: IGMPv1: 0x12, IGMPv2: 0x16)
Figure 4.17 IGMP group record
Figure 4.18 IGMP state diagram
Figure 4.19 Multicast routing protocols
Figure 4.20 PIM-SM sequence
Figure 4.21 PIM-SM join/prune message
Figure 4.22 Acceptable voice delay (Source: Courtesy of ITU. © ITU)
Figure 4.23 RSVP PATH messages
Figure 4.24 RSVP RESV messages
Figure 4.25 TOS marking
Figure 4.26 Ethernet frames with 802.1Q header
Figure 4.27 NTP packet format
Figure 4.28 NTP offset calculation
Figure 4.29

Chapter 5: Synchronization and Adaptation

Figure 5.1 End-to-End (EtE) timing model
Figure 5.2 Transmission between sender and receiver using RTP for voice
Figure 5.3 Transmission between sender and receiver using HTTP for video
Figure 5.4 Consecutive Error Probability
Figure 5.5 Minimum Rendering Buffer Size $c05-math-0072$
Figure 5.6 Submarine Cable Map. (Source: TeleGeography, www.submarinecablemap.com)
Figure 5.7 Steady-state TCP flows
Figure 5.8 Typical lumpy traffic
Figure 5.9 Schema of a media player
Figure 5.10 Object structure of ISO BMFF
Figure 5.11 BMFF example for storage of RTP packets together with MPEG-TS

Chapter 6: Session Initiation Protocol

Figure 6.1 A simple SIP call
Figure 6.2 Registration in SIP
Figure 6.3 A more typical SIP call
Figure 6.4 Client- and server-transaction interworking
Figure 6.5 State diagram SIP client transaction
Figure 6.6 Typical SIP call with name resolutions
Figure 6.7 SIP-PSTN gateway with ENUM
Figure 6.8 The SPEERMINT architecture
Figure 6.9 XCON conferencing framework
Figure 6.10 A SIP conference call flow example
Figure 6.11 Binary flow control protocol functionality
Figure 6.12 BFCP packet
Figure 6.13 Centralized conference objects (XCON) lifecycle
Figure 6.14 Presence: possible structure and example
Figure 6.15 Discovery of NAT mapping based on Ref. [360]
Figure 6.16 Example for a VoIP security zone in companies
Figure 6.17 Possible data flows for a VoIP system in a company
Figure 6.18 LLPD packet
Figure 6.19 Example network map

Chapter 7: Other Standard VoIP Protocols

Figure 7.1 H.323 overview
Figure 7.2 ASN.1 example
Figure 7.3 Registering with gatekeeper and call setup
Figure 7.4 Registering with two gatekeepers, call setup and release
Figure 7.5 Details of the H.245 establishment and release illustrated in Figure 7.4
Figure 7.6 T.120 family of standards
Figure 7.7 Multipoint communication services
Figure 7.8 Media gateway with controller
Figure 7.9 Simple H.264 commands
Figure 7.10 More complicated H.264 commands
Figure 7.11 Simplified SS7/DSS signaling protocol stack
Figure 7.12 Central Q.931 call agent for remote signaling gateway
Figure 7.13 Protocol stacks for PSTN switch, signaling gateway, and call agent
Figure 7.14 SCTP packet
Figure 7.15 Example of IUA communication to application server processes
Figure 7.16 Overview of IMS and its connections
Figure 7.17 Example of IMS registration
Figure 7.18 Example of IMS invite with two roaming UEs
Figure 7.19 3GPP enhanced core and radio access network – very simplified
Figure 7.20 IMS and VoLTE INVITE

Chapter 8: WebRTC

Figure 8.1 Overview WebRTC
Figure 8.2 Overview WebRTC protocols
Figure 8.3 DCEP: data channel open message
Figure 8.4 Example of an SDP description for ICE
Figure 8.5 JSEP state diagram for the SDP answer/offering
Figure 8.6 The often shown WebRTC trapezoid
Figure 8.7 A typical gateway between WebRTC and IMS

Chapter 9: Streaming and Over-the-Top TV

Figure 9.1 HLS structure
Figure 9.2 Simple sample of HLS index file
Figure 9.3 Smooth streaming structure
Figure 9.4 HDS structure
Figure 9.5 SVC layers
Figure 9.6 Dynamically SVC adapting streams
Figure 9.7 MPEG-DASH format and message exchange
Figure 9.8 MPD sample
Figure 9.9 Adaptive player framework
Figure 9.10 SABR bandwidth control technique
Figure 9.11 Comparison of direct versus CDN delivery of content to client
Figure 9.12 Distribution of content: direct versus peer-to-peer
Figure 9.13 Content delivery networks versus content centric networks

Chapter 10: Home Networks

Figure 10.1 mDNS query and reply
Figure 10.2 Claiming a hostname with mDNS
Figure 10.3 Example of DNS-SD TXT resource record
Figure 10.4 Example of DNS-SD query
Figure 10.5 UPnP device architecture
Figure 10.6 Example of SSDP NOTIFY message
Figure 10.7 UPnP AV architecture
Figure 10.8 Media Renderer and Server functional diagrams
Figure 10.9 Rendering control service mixing three virtual streams
Figure 10.10 Status diagram for AV transport service
Figure 10.11 Combining the different services to an overall example
Figure 10.12 Simplified schema of the IMS home network integration
Figure 10.13 HGI network termination recommendation

Chapter 11: High-End IPTV

Figure 11.1 Overview of DVB IPTV functional architecture – adapted from Ref. [581]
Figure 11.2 Protocol stack DVB IPTV
Figure 11.3 RET server in action
Figure 11.4 RTCP feedback message
Figure 11.5 Error before RET server
Figure 11.6 Summary of the communication with the RET server
Figure 11.7 Structure of the RAMS request packet
Figure 11.8 One channel switch with RAMS
Figure 11.9 Structure of the FLUTE/ALC packet
Figure 11.10 FLUTE receiver logic
Figure 11.11 Data structure maintained by DVBSTP
Figure 11.12 Structure of the DVBSTP packet
Figure 11.13 DSM-CC object carousel layers
Figure 11.14 Architecture DVB for remote management and firmware update
Figure 11.15 CWMP transaction session example for configuring an HNED
Figure 11.16 Content download – functional architecture
Figure 11.17 Schema of an IPTV headend setup
Figure 11.18 Companion screen – functional architecture
Figure 11.19 UPnP discovery and association between CSA and HNED
Figure 11.20 Schema of IPTV and IMS integration
Figure 11.21 Schema of IPTV and UPnP integration

Chapter 12: Solutions and Summary

Figure 12.1 Webcast browser
Figure 12.2 Webcast streaming
Figure 12.3 Unicast splitters
Figure 12.4 Webcast content management
Figure 12.5 Global signage system: screen at each local affiliate
Figure 12.6 Example of a protocol between signage manager and signage player
Figure 12.7 Example of a display scheduling within a signage manager
Figure 12.8 Setup of a call center
Figure 12.9 Example of a call-center wallboard
Figure 12.10 W3C speech interface framework
Figure 12.11 Voice XML interpretation environment
Figure 12.12 Example VoiceXML – boxes and numbers only for referencing
Figure 12.13 Technical architecture for a call center
Figure 12.14 Characteristics for a videoconference and perceived value
Figure 12.15 Cisco TelePresence System. Courtesy of Cisco Systems, Inc.
Figure 12.16 Telepresence RTP connections
Figure 12.17 Redundant campus network also supporting Telepresence

List of Tables

Chapter 1: Introduction

Table 1.1 Characteristics of Network Types

Chapter 2: Requirements

Table 2.1 Requirements of typical multimedia applications – network view

Chapter 3: Audio, Image, Video Coding, and Transmission

Table 3.1 Characteristics of sampling and data rate for audio
Table 3.2 Vowel formants in English
Table 3.3 Typical voice compression standards
Table 3.4 Characteristics of display types
Table 3.5 (a) Luminance $c03-math-0273$ and (b) Chroma $c03-math-0274$
Table 3.6 Comparison of other standards in relation to H.264
Table 3.7 Comparison of RVLC to Huffman coding (English alphabet)

Chapter 4: Underlying Network Functions

Table 4.1 Common payload type (PT) values
Table 4.2 H.264 profile modes
Table 4.3 Description of SDP fields
Table 4.4 Sample RTSP session
Table 4.5 AF behavior group
Table 4.6 Class selector values
Table 4.7 QoS baseline recommendations

Chapter 5: Synchronization and Adaptation

Table 5.1 Typical delay
Table 5.2 Minimum line transmission delay
Table 5.3 Typical Internet transmission delay in January 2015

Chapter 6: Session Initiation Protocol

Table 6.1 Standardized extension to presence information
Table 6.2 Major SIP security and safety threats

Chapter 7: Other Standard VoIP Protocols

Table 7.1 Summarized comparison of H.323 and SIP
Table 7.2 Comparison MGCP and H.248
Table 7.3 3GPP enhanced core and radio access network – abbreviations

Chapter 9: Streaming and Over-the-Top TV

Table 9.1 Proprietary streaming protocols
Table 9.2 Effect of distance on throughput and download times

Chapter 10: Home Networks

Table 10.1 UPnP media related service areas and functionality

Chapter 12: Solutions and Summary

Table 12.1 Repeated requirements of typical multimedia applications – network view
Table 12.2 Characteristics of typical multimedia applications – network view
Table 12.3 Required measures taken for multimedia applications (network view) plus usability per network type

John Wiley & Sons Ltd, The Atrium, Southern Gate, Chichester, West Sussex, PO19 8SQ, United Kingdom

For details of our global editorial offices, for customer services and for information about how to apply for permission to reuse the copyright material in this book please see our website at www.wiley.com.

The right of the author to be identified as the author of this work has been asserted in accordance with the Copyright, Designs and Patents Act 1988.

All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic, mechanical, photocopying, recording or otherwise, except as permitted by the UK Copyright, Designs and Patents Act 1988, without the prior permission of the publisher.

Wiley also publishes its books in a variety of electronic formats. Some content that appears in print may not be available in electronic books.

Designations used by companies to distinguish their products are often claimed as trademarks. All brand names and product names used in this book are trade names, service marks, trademarks or registered trademarks of their respective owners. The publisher is not associated with any product or vendor mentioned in this book.

Limit of Liability/Disclaimer of Warranty: While the publisher and author have used their best efforts in preparing this book, they make no representations or warranties with respect to the accuracy or completeness of the contents of this book and specifically disclaim any implied warranties of merchantability or fitness for a particular purpose. It is sold on the understanding that the publisher is not engaged in rendering professional services and neither the publisher nor the author shall be liable for damages arising herefrom. If professional advice or other expert assistance is required, the services of a competent professional should be sought

Preface

It is obvious to almost any consumer with a PC, Smartphone, radio, TV, or even a “normal” telephone that the methods of communicating, listening to, or viewing content have changed radically over the past years. Napster, iPhone, Skype, Netflix, Android, Internet Radio, YouTube, VoIP, streaming programs from TV networks (the list is almost endless) have all profoundly changed the way we talk, listen, and watch.

What sets multimedia delivery somewhat apart from other technology topics is its unusually high level of complexity. Different user platforms, different network media, different types of content, and of course, many different vendors and standards all make this topic a challenging one.

The motivation for this book is based on the many new multimedia technologies that have appeared or changed in the past 15 years, the immense number of new standards, and the lack of overarching books on the subject. At the time of writing, there is no book available that covers the range of topics you find here, which are needed to cope with multimedia usage from a network point of view. It goes without saying that there are many excellent books on the individual subjects covered in this book. In fact, we cite many of them as references. While they cover specific topics in detail, this book provides the “big picture” and ties together the various principles for the entire multimedia space.

Another driver for this book is the authors' involvement in deploying multimedia applications and networks in large multinational companies. These deployments and operational involvement provided insight into what is important and what can safely be ignored. Many new multimedia technologies went live during our working time in networks, and the reader will profit from the combined practical experience and technological background of the authors.

This book focuses primarily on principles but sometimes dives into the details to show how the principles really work in practical situations. As a prerequisite for reading the book, you need basic knowledge of networks, but no additional literature is required. Since this book is aimed to give an overview in a rather active field, we provide the reader with extensive references – over 600 recent literature links – to dive deeper. In addition, the detailed index and the abbreviation list will help you easily find the treatment of a specific subject.

Acknowledgments

First and foremost, we must thank our spouses and families. The writing of a reference book is a long and difficult task. Without their patience and support over many months, including during holidays, we could not have completed this book.

We also thank Professor Bernhard Plattner from ETH Zürich (Switzerland) for his support of a lecture by Hans Barz from 2010 to 2014 on this subject at the ETH.

Finally, and equally important, we thank our former colleagues from the networking group at Hoffmann-La Roche in Basel, Switzerland (PGIN), for working together with us to create and implement many of the multimedia solutions described here in the book. Our special thanks to Andre Rudin for his expert review of our material, Andy Fringeli for world-class operational insight, and Brian O'Connor for all things related to voice. There are other members of the PGIN team too numerous to mention, but they know who they are.

About the Authors

Hans W. Barz

Hans Barz received a Master's Degree in Economical Engineering from the Technical University in Karlsruhe, Germany (Prof. H. Maurer) and a PhD in Computer Science from University Bonn, Germany (Prof. H. Zima) with a theme on the power of synchronization mechanisms. He worked for over 25 years with the IT staff at the headquarters of Ciba-Geigy, Novartis, Syngenta, and Hoffmann-La Roche in Basel. For many years, he held the position of Global Head of Architecture. At that time, he was responsible for major rollouts of new technologies (TCP/IP, X.400/X.500 backbone, E-Business-Infrastructure), technology trials (DECnet Phase V, OSI, PKI), and infrastructure consolidations in mergers and split-offs. In Hoffmann-La Roche, he was, for many years, Global Head of Network Services with engineering and operation responsibility for networks, telephony, and multimedia services in more than 80 countries.

He has lectured on telecommunication subjects at the University Freiburg (Germany), University Basel (Switzerland), and ETH Zürich (Switzerland). He did publish a number of articles on parallel processing and a book on telecommunication in 1994 (Hanser Verlag, in German).

Gregory A. Bassett

Greg Bassett received a Bachelor's Degree in Computer Engineering from Syracuse University, in Syracuse, NY, USA. The first 20 years of his career was spent working for Digital Equipment Corporation is a wide variety of roles including instructor (including teaching the first DECnet course offered), software engineer, technical leader for networking and personal computers, and program management.

For the next 18 years, he worked for the pharmaceutical companies of Syntex in Palo Alto, CA, USA, and Hoffmann-La Roche in Basel, Switzerland. He spent 8 years as a network engineer. For the remaining 10 years, he was an Enterprise Architect responsible for networking including data, fixed and mobile voice, video, and call center. He earned the Cisco Certified Internetworking Engineer (CCIE) in Routing and Switching certification in 2002.

During his years as an Enterprise Architect for Roche, he worked closely with Hans Barz to develop networking strategies and implementation plans.

Multimedia Networks

Protocols, Design, and Applications

Preface

Acknowledgments

About the Authors