From 745963cbd412cd59ff81d8524659ae8172a70aca Mon Sep 17 00:00:00 2001 From: Joao Carreira Date: Thu, 19 Jul 2018 17:57:55 +0100 Subject: [PATCH] Fix labels in 042_ConcealmentAwareEncoding --- 042_ConcealmentAwareEncoding/ConcealmentAwareEncoding.tex | 6 +++--- .../Results/IntraEC_QualityVsFrameLowDelay.tex | 2 +- .../Results/IntraEC_QualityVsFrameRandomAccess.tex | 2 +- .../Results/TableOveralPerformance.tex | 4 ++-- .../Results/TableSignallingPerformance.tex | 4 ++-- 5 files changed, 9 insertions(+), 9 deletions(-) diff --git a/042_ConcealmentAwareEncoding/ConcealmentAwareEncoding.tex b/042_ConcealmentAwareEncoding/ConcealmentAwareEncoding.tex index 09466c7..edeb6fd 100644 --- a/042_ConcealmentAwareEncoding/ConcealmentAwareEncoding.tex +++ b/042_ConcealmentAwareEncoding/ConcealmentAwareEncoding.tex @@ -38,7 +38,7 @@ Finally, Section~\ref{Section5:Summary} concludes this chapter. \glsreset{mve} -In Chapter~\ref{Chapter:ErrorResilienceReview} described different \ac{ec} algorithms that can effectively reconstruct lost data, leading to lower error propagation. However, as mentioned before different algorithms might not present the same accuracy for every lost frame or slice. Moreover, selection at the \ac{mb}/\ac{pu} level is not straightforward. Approaches in the past proposed the combination of spatial and temporal \ac{ec} strategies to improve the reconstruction quality~\cite{HybridConcTB2008}. Regarding temporal \ac{ec}, there are hybrid algorithms to optimise the \ac{mve} at the pixel and block levels \cite{HybridConcealmentTB2008,2DConcHybridMotion2010}. Regarding the \ac{hevc}, existing algorithms also aim to improve the reconstruction accuracy of the motion-based recovery by using the information of correctly received neighbours, e.g., block partitions~\cite{HEVCMCBlockAug2013} and prediction residue~\cite{HEVCMCResidueDec2013}. Although such methods are able to improve the reconstruction quality and reduce the artefacts, decoder-based decisions are still not fully accurate, as they do not have enough reference information to ease the decision process. Therefore, higher performance can be achieved by performing encoding-side estimations and decisions based on the error-free information. This approach not only improves quality but also reduces the complexity of the video decoders. +Chapter~\ref{Chapter:ErrorResilienceReview} described different \ac{ec} algorithms that can effectively reconstruct lost data, leading to lower error propagation. However, as mentioned before different algorithms might not present the same accuracy for every lost frame or slice. Moreover, selection at the \ac{mb}/\ac{pu} level is not straightforward. Approaches in the past proposed the combination of spatial and temporal \ac{ec} strategies to improve the reconstruction quality~\cite{HybridConcTB2008}. Regarding temporal \ac{ec}, there are hybrid algorithms to optimise the \ac{mve} at the pixel and block levels \cite{HybridConcealmentTB2008,2DConcHybridMotion2010}. Regarding the \ac{hevc}, existing algorithms also aim to improve the reconstruction accuracy of the motion-based recovery by using the information of correctly received neighbours, e.g., block partitions~\cite{HEVCMCBlockAug2013} and prediction residue~\cite{HEVCMCResidueDec2013}. Although such methods are able to improve the reconstruction quality and reduce the artefacts, decoder-based decisions are still not fully accurate, as they do not have enough reference information to ease the decision process. Therefore, higher performance can be achieved by performing encoding-side estimations and decisions based on the error-free information. This approach not only improves quality but also reduces the complexity of the video decoders. In this chapter a robust coding driven by \ac{ec} methods with the objective of enhancing the quality of reconstructed video at decoders receiving erroneous streams from the transmission network. The proposed approach combines error resilience tools at the encoder-side with \ac{ec} at the decoder-side. Different approaches were proposed in the past to that address the problem of \ac{ec} at the encoder-side \cite{ConcealmentDrivenSliceOrdering2008,ConcealmentAwareME2006,ErrorResilienceModeHEVC2016}. Moreover, extra information was used to aid the \ac{ec} operation at the decoder-side, either by sending redundant data \cite{ResilienceRECAP_ICASSP2009,SaliencyErrorConcealment_TM2013} or by embedding data into the bitstream \cite{ConcealmentIntraDataHidng2009}. Although the above methods facilitate the EC performance either through slice reordering or based on \acs{mv}, they always rely on the assumption that a fixed \ac{ec} method is used at the decoder. The work presented in \cite{ConcealmentSignalling2008,SignallingRobustScalable2015} proposes testing several methods with transmission of extra symbols to indicate the best method to be applied by the decoder. Although such approaches achieves reasonably good performance, it relies on the spatial neighbouring information or multi-layer video, which may not be available in all cases. @@ -217,7 +217,7 @@ In this process, each \ac{ctu} is partitioned to form a quadtree structure of \a Then, the best trade-off between \ac{ecu} partition and signalling is found through \ac{rd} optimisation. In order to achieve an efficient use of the signalling overhead a saliency-weighted procedure is embedded in the \ac{rd} optimisation based on a spatio-temporal saliency, where more signalling bits are allocated to regions with higher saliency values. Finally, the signalling information is transmitted to the decoder by using the \ac{sei} \ac{nal} unit type~\cite{HEVCHighLevelReferenceDez2012}. -Since in general, the optimal \ac{ec} mode is still not be able to correctly reconstruct all the missing regions, extra residual information is multiplexed in the stream as a scalable enhancement layer. +Since in general, the optimal \ac{ec} mode is still not be able to correctly reconstruct all the missing regions, extra residual information is multiplexed in the stream as a scalable \ac{el}. This residual information contains the difference between the compressed ($\hat f_t$) and the \ac{ec} frames ($\tilde f$). The transmitted information is used to assist the \ac{ec} operation at the decoder to recover erroneous frames with high accuracy, by using the best \ac{ec} mode and also residual information to reduce error propagation. @@ -718,7 +718,7 @@ The proposed method uses \ac{ec} techniques with different levels of computati \begin{table}[t] \newcommand{\somespaces}{} \centering -\caption{Comparison against existing methods.}\label{tab:overall_gain_ratio} +\caption{Comparison against existing methods. \HIGHLIGHT{Sort methods}}\label{tab:overall_gain_ratio} \footnotesize % \resizebox{\columnwidth}{!}{ \begin{tabular}{p{2.4cm}x{2.4cm}x{2.4cm}x{2cm}} diff --git a/042_ConcealmentAwareEncoding/Results/IntraEC_QualityVsFrameLowDelay.tex b/042_ConcealmentAwareEncoding/Results/IntraEC_QualityVsFrameLowDelay.tex index 2d67ed8..e72c73d 100644 --- a/042_ConcealmentAwareEncoding/Results/IntraEC_QualityVsFrameLowDelay.tex +++ b/042_ConcealmentAwareEncoding/Results/IntraEC_QualityVsFrameLowDelay.tex @@ -5,7 +5,7 @@ load 'carreira_phd_thesis_gnuplot_template.cfg' set xlabel '\TitleFont Frame Number' set xrange[6:6+27] set xtics 6,2,6+27 -set key bottom left width 1 +set key bottom left width 0 #set title '\TitleFont Basketball Drill' plot '-' using 1:2 title '\KeyFont \MC' w lp ls 1, '-' using 1:2 title '\KeyFont \emph{16x16}' w lp ls 2, '-' using 1:2 title '\KeyFont \PROP' w lp ls 3 2 40.24 43.19 44.01 diff --git a/042_ConcealmentAwareEncoding/Results/IntraEC_QualityVsFrameRandomAccess.tex b/042_ConcealmentAwareEncoding/Results/IntraEC_QualityVsFrameRandomAccess.tex index 72cebc9..7a26a23 100644 --- a/042_ConcealmentAwareEncoding/Results/IntraEC_QualityVsFrameRandomAccess.tex +++ b/042_ConcealmentAwareEncoding/Results/IntraEC_QualityVsFrameRandomAccess.tex @@ -5,7 +5,7 @@ load 'carreira_phd_thesis_gnuplot_template.cfg' set xlabel '\TitleFont Frame Number' set xrange[6:6+27] set xtics 6,2,6+27 -set key bottom left width 1 +set key bottom left width 0 #set title '\TitleFont Park Scene' plot '-' using 1:2 title '\KeyFont \MC' w lp ls 1, '-' using 1:2 title '\KeyFont \emph{16x16}' w lp ls 2, '-' using 1:2 title '\KeyFont \PROP' w lp ls 3 2 39.63 41.81 43.47 diff --git a/042_ConcealmentAwareEncoding/Results/TableOveralPerformance.tex b/042_ConcealmentAwareEncoding/Results/TableOveralPerformance.tex index b4fbf06..5a1bdb7 100644 --- a/042_ConcealmentAwareEncoding/Results/TableOveralPerformance.tex +++ b/042_ConcealmentAwareEncoding/Results/TableOveralPerformance.tex @@ -65,7 +65,7 @@ \begin{tabular}{p{3cm}|x{\colwidth}|x{\colwidth}|x{\colwidth}|x{\colwidth}|x{\colwidth}} \toprule \multirow{3}{*}{\vbox{\centering \textbf{Sequence}}} -& \multirow{2}{*}{\vbox{\centering \REF}} & \multirow{2}{*}{\vbox{\centering \MC}} & \multirow{2}{*}{\vbox{\centering \AVG}} & \multicolumn{2}{c}{\PROP} \\ +& \multirow{2}{*}{\vbox{\centering \REF}} & \multirow{2}{*}{\vbox{\centering \MC}} & \multirow{2}{*}{\vbox{\centering \AVG}} & \multicolumn{2}{c}{\textit{Proposed}} \\ & & & & $10\%$ & $20\%$ \\ \midrule & \multicolumn{5}{c}{Low-delay configuration} \\ [2pt] @@ -108,7 +108,7 @@ Tennis & 33.86 & +0.16 & +0.18 & +0.98 & +1.48 \\ \hline \begin{tabular}{p{3cm}|x{\colwidth}|x{\colwidth}|x{\colwidth}|x{\colwidth}|x{\colwidth}} \toprule \multirow{3}{*}{\vbox{\centering \textbf{Sequence}}} -& \multirow{2}{*}{\vbox{\centering \REF}} & \multirow{2}{*}{\vbox{\centering \MC}} & \multirow{2}{*}{\vbox{\centering \AVG}} & \multicolumn{2}{c}{\PROP} \\ +& \multirow{2}{*}{\vbox{\centering \REF}} & \multirow{2}{*}{\vbox{\centering \MC}} & \multirow{2}{*}{\vbox{\centering \AVG}} & \multicolumn{2}{c}{\textit{Proposed}} \\ & & & & $10\%$ & $20\%$\\ \midrule & \multicolumn{5}{c}{Low-delay configuration} \\ [2pt] diff --git a/042_ConcealmentAwareEncoding/Results/TableSignallingPerformance.tex b/042_ConcealmentAwareEncoding/Results/TableSignallingPerformance.tex index 345e959..73d2e6b 100644 --- a/042_ConcealmentAwareEncoding/Results/TableSignallingPerformance.tex +++ b/042_ConcealmentAwareEncoding/Results/TableSignallingPerformance.tex @@ -153,10 +153,10 @@ Tennis & 96.64 & +0.98 & +0.98 & +1 \caption{Error concealment signalling overhead.}\label{tab:redundancy_signalling} \TABLESVSPACE \footnotesize -\begin{tabular}{p{3.6cm}|x{3.8cm}|x{3.8cm}} +\begin{tabular}{p{3.6cm}|x{3.3cm}|x{3.3cm}} \toprule \multirow{3}{*}{\vbox{\centering \textbf{Sequence}}} & \multicolumn{2}{c}{\textbf{Bits used for signalling (\%)}} \\ -& \FIXEDLAMBDALONG & \DYNLAMBDALONG \\ +& \FIXEDLAMBDALONG & \DYNLAMBDALONG\\ \hline Basketball Drill & 2.88 & 2.55 \\ \hline Book Arrival & 4.03 & 3.35 \\ \hline