jfmcarreira/doc_phd_thesis
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Review all chapters and start conclusions

Browse Source
This commit is contained in:
jfmcarreira
2018-09-12 02:44:20 +01:00
parent 461b560b17
commit 8d3a4c72ff
20 changed files with 304 additions and 427 deletions
Download Patch File Download Diff File Expand all files Collapse all files
010_Introduction/Introduction.tex
+3 -7
View File
@@ -10,7 +10,7 @@
Over the recent years new advances in video compression and networking technologies have enabled the development of many multimedia applications over the internet, such as video conferencing, video streaming, video publishing, among others.
The increasing diversity of services, the demands for high quality multimedia and the growing popularity of \ac{uhd} formats (\emph{e.g.}, $4k$ or $8k$ resolution and beyond) are pushing technologies forward and opening new research directions.
Moreover, the emerging new video formats with increased resolutions have created stronger needs for higher coding efficiency, beyond the previous standards, i.e., the MPEG-4/\ac{h264}~\cite{H264AVCStandard2003,H264OverviewJul2003}.
Moreover, the emerging new video formats with increased resolutions, such as, 360-degree video, have created stronger needs for higher coding efficiency, beyond the previous standards, i.e., the MPEG-4/\ac{h264}~\cite{H264AVCStandard2003,H264OverviewJul2003}.
Such need has been driven not only by higher resolutions but also by stereoscopic and multi-view video formats, which increase the number of viewpoints that need to be encoded and delivered simultaneously.
Moreover, the ever increasing traffic generated by mobile multimedia applications \cite{CiscoMobile1621_Feb2017} and different video services with ever increasing popularity, e.g., Netflix, impose new challenges to the existing networks.
To cope with such demanding requirements a new coding standard was developed by the ITU-T \ac{vceg} and the \ac{iso}/\ac{iec} \ac{mpeg} standardisation organisations, referred to as H.265 - \ac{hevc}~\cite{H265StandardFeb2018,HEVCOverviewDez2012}.
@@ -67,19 +67,15 @@ Although different \ac{ec} methods have been developed during the past years for
\section{Main objectives and contributions}
The research objectives of this thesis are focused in robust error resilience for efficient error concealment in highly efficiency video decoders.
Thus, this work investigates novel techniques to increase the video quality of \ac{hevc} bitstreams delivered through error-prone networks.
The following objectives were pursued in this work:
\begin{enumerate}
\item
\textbf{evaluation and study of the error robustness:} The first objective of this research work is to evaluate the robustness against transmission errors of highly efficiently coded video. The study conclusions aimed at finding relevant research directions to increase the error robust of coded streams. The results and conclusions of this study were published in conference paper (\ref{Conf:ErrorResilience}) and in journal paper (\ref{Journal:TwoStage}) (see Appendix \ref{Appen:Papers}).
\textbf{evaluation and study of the error robustness:} The first objective of this research work is to evaluate the robustness against transmission errors of highly efficiently coded video. The study conclusions aimed at finding relevant research directions to increase the error robust of coded streams. The results and conclusions of this study were published in conference paper (\ref{Conf:ErrorResilience}) and in journal paper (\ref{Journal:TwoStage}) (see Appendix~\ref{Appen:Papers}).
\item
\textbf{robust video coding:} At the encoder-side, novel techniques to extend the existing error robustness of highly predictive video coding techniques are investigated in order to increase the received video quality over error-prone networks. This research topic resulted in a new method to reduce the error propagation in motion vector coding algorithms, which was published in conference paper (\ref{Conf:DynamicTMVP}). Moreover, a novel two-stage approach was devised to improve the error robustness of highly efficiently coded video at the encoder and streaming levels, resulting in two conference publications (\ref{Conf:MotionVectorRedundancies} and \ref{Conf:Chkb}) and a journal publication (\ref{Journal:TwoStage}).
\textbf{robust video coding:} At the encoder-side, novel techniques to extend the existing error robustness of highly predictive video coding techniques are investigated in order to increase the received video quality over error-prone networks. This research topic resulted in a new method to reduce the error propagation in motion vector coding algorithms, which was published in conference paper (\ref{Conf:DynamicTMVP}). Moreover, a novel two-stage approach was devised to improve the error robustness of highly efficiently coded video at the encoder and streaming levels, resulting in two conference publications (\ref{Conf:MotionVectorRedundancies} and~\ref{Conf:Chkb}) and a journal publication (\ref{Journal:TwoStage}).
\item \textbf{robust video decoding:} error concealment techniques are used to increase the error robustness of video decoder and improve the perceived video quality.
The paradigm of error concealment is evaluated at the encoder-side, as part of the encoding process, in order to optimise the reconstruction process at the decoder-side. This research resulted in a novel error concealment-aware technique to optimise the error concealment process at the encoder-side, which was proposed for intra-frame only in a conference paper (\ref{Conf:ConcAware}) and for a generic robust video transmission in the journal (\ref{Journal:ConcAware}).
010_Introduction/RobustVideoSystem.tikz
+12 -13
View File
@@ -53,36 +53,35 @@
row sep=-\pgflinewidth,
column sep=-\pgflinewidth,
nodes={rectangle,text width=1.5cm,align=center},
text depth=1.25ex,
text height=.7ex,
text depth=1ex,
minimum height=2mm,
nodes in empty cells
}
}
\matrix (arrow) [arrowMatrix] {
|[fill=TikZColorFillProp]| & |[fill=TikZColorFillProp]| & |[fill=TikZColorFillProp]| & |[fill=TikZColorFillProp] (last1)| \\
|[fill=TikZColorFill]| & |[fill=TikZColorFill]| & |[fill=TikZColorFill]| & |[fill=TikZColorFill] (last2)| \\
|[fill=TikZColorFill]| & |[fill=TikZColorFill]| & |[fill=TikZColorFill]| & |[fill=TikZColorFill] (last3)| \\
|[fill=TikZColorFillProp] | & |[fill=TikZColorFillProp]| & |[fill=TikZColorFillProp]| & |[fill=TikZColorFillProp] (last1)| \\
|[fill=TikZColorFill] | & |[fill=TikZColorFill]| & |[fill=TikZColorFill]| & |[fill=TikZColorFill] (last2)| \\
|[fill=TikZColorFill] | & |[fill=TikZColorFill]| & |[fill=TikZColorFill]| & |[fill=TikZColorFill] (last3)| \\
};
% The labels
\node[text centered, xshift=.7cm] at (arrow-1-1) {\footnotesize SEI};
\node[text centered, xshift=.7cm, text width=2.2cm] at (arrow-2-1.south) {\footnotesize VCL};
\node[text centered, xshift=1cm] at (arrow-1-1) {\footnotesize SEI};
\node[text centered, xshift=1cm, text width=2.2cm] at (arrow-2-1.south) {\footnotesize VCL};
\fill[white] (last1.north) -- (last2.east) -- (last1.north east) -- cycle;
\fill[white] (last3.south) -- (last3.south east) -- (last2.east) -- cycle;
\fill[white] (arrow-1-1.north west) -- ($(arrow-2-1.center)+(-.4,0)$) -- (arrow-3-1.south west) -- cycle;
\coordinate (div0) at (-.8,-1.3);
\coordinate (div1) at ($(div0)+(-20:.2cm)+(-20:.2cm)+(60:3.1cm)$);
\coordinate (div0) at (-.8,-1.1);
\coordinate (div1) at ($(div0)+(-20:.2cm)+(-20:.2cm)+(60:2.5cm)$);
\fill[fill=white] ($(div0)+(-20:-.2cm)$) -- ++(60:1.8cm) -- ++(-30:.4cm) -- ($(div1)+(-20:-.2cm)$) -- ++(-30:.4cm) -- ++(60:-1.85cm) -- ++(-30:-.4cm) -- ($(div0)+(-20:.2cm)$);
%\draw ( $(div0)$ ) -- ( $(div0)+(60:1.7cm)$ );
\path[decoration={markings, mark=at position .5 with \node[transform shape] {\scriptsize Error-prone};}, postaction={decorate}]
( $(div0)$ ) -- ( $(div0)+(60:1.7cm)$ );
%\draw ($(div1)+(60:-1.8cm)$) -- ($(div1)$);
\path[decoration={markings, mark=at position .5 with \node[transform shape] {\scriptsize Transmission};}, postaction={decorate}]
($(div1)+(60:-1.8cm)$) -- ($(div1)$);
@@ -100,7 +99,7 @@
%% Encoding
\node[fill=TikZColorFillProp, coders, minimum height=3.1cm, text width=2.6cm, left=-.5 of arrow] (SideInformation) {};
\node[fill=TikZColorFillProp, coders, minimum height=3.1cm, text width=2.6cm, left=0 of arrow] (SideInformation) {};
\node[fill=TikZColorFillProp, coders, minimum height=2.1cm, text width=2.2cm, yshift=-7] (RobustEncoding) at (SideInformation) {};
\node[fill=TikZColorFill, coders, minimum height=1.1cm, text width=1.5cm, yshift=-13] (Encoding) at (SideInformation) {Encoding};
@@ -111,7 +110,7 @@
($(SideInformation.west)+(.3,.3)$) to [bend left=50] ($(SideInformation.east)+(-.3,.3)$);
%% Decoding
\node[fill=TikZColorFillProp, coders, minimum height=2.1cm, text width=2.2cm, right=-.2 of arrow] (RobustDecoding) {};
\node[fill=TikZColorFillProp, coders, minimum height=2.1cm, text width=2.2cm, right=.1 of arrow] (RobustDecoding) {};
\node[fill=TikZColorFill, coders, minimum height=1.1cm, text width=1.5cm, yshift=-7] (Decoding) at (RobustDecoding) {Decoding};
\path[postaction={decorate,decoration={text along path,text align=center,text={|\small|Robust Decoding}}}]