Finish thesis review
This commit is contained in:
1 parent
1c50b4c036
commit
59d007205a
17 files changed
+131
-117
No files matched your search
@@ -25,7 +25,7 @@ This chapter is organized as follows. Section~\ref{Section4:Problem} presents th
|
||||
\label{Section4:Problem}
|
||||
|
||||
As previously mentioned, when \ac{hevc} bitstreams are subject to transmission losses, the decoded video signal incurs in significant degradation of both objective and subjective quality.
|
||||
This is mostly due to the strong decoding dependencies imposed by the highly complex prediction modes, which are selected according to \ac{rd} optimisation criteria, which always assume error-free transmission~\cite{ROPE2007}.
|
||||
This is mostly due to the strong decoding dependencies imposed by the highly complex prediction modes, which are selected according to \ac{rd} optimisation criteria, which always assume transmission without errors~\cite{ROPE2007}.
|
||||
Therefore, high compression efficiency is achieved, but resilience to errors and data loss is penalised.
|
||||
|
||||
\begin{figure}[tb]
|
||||
@@ -143,7 +143,7 @@ Note that an exponential cost increase is used in (\ref{eq:Lagrangian}) in order
|
||||
\begin{figure}[t]
|
||||
\centering
|
||||
\includegraphics[width=0.8\columnwidth]{./041_ImprovedErrorResilience/Figures/ExponentialWeight}
|
||||
\caption{Exponential weight as a function of the global and local deviations}
|
||||
\caption{Exponential weight as a function of the global and local deviations.}
|
||||
\label{fig:weightfct}
|
||||
\end{figure}
|
||||
|
||||
@@ -251,7 +251,7 @@ In this section the performance of the proposed two-stage architecture is evalua
|
||||
As references for comparison, three other methods are used: (i) a fixed checkerboard approach (\CHKB), (ii) the reference picture generation method based on leaky predictions proposed in \cite{ROPERefGenJan2010}, identified as ``\AVG'', and (iii) long-term reference frames (\LONG). The \LONG method only uses the key frames as reference, i.e., in the \ac{ra} configuration only one out of eight frames is used as reference for prediction, allowing a more robust transmission, as the reference frames are less likely to be hit by errors.
|
||||
|
||||
The experimental setup used in this section is the same as the one previously described in Section~\ref{Section3:ErrorResilienceEvaluation}.
|
||||
Two test cases were considered for simulation: (i) in \emph{\LOSTALL} all frames may be equally affected by packet loss, including \ac{idr} frames; (ii) in \emph{\KEEPINTRA} \ac{idr} frames are assumed to be prioritised in the network and delivered error-free, or using some combined approach as recently proposed in \cite{ErrorResilienceHeterogenousNetworks2016}.
|
||||
Two test cases were considered for simulation: (i) in \emph{\LOSTALL} all frames may be equally affected by packet loss, including \ac{idr} frames; (ii) in \emph{\KEEPINTRA} \ac{idr} frames are assumed to be prioritised in the network and delivered without errors packet loss, or using some combined approach as recently proposed in \cite{ErrorResilienceHeterogenousNetworks2016}.
|
||||
At the decoder-side, \ac{ec} is based on motion compensation from previously decoded frames. The motion field of a missing frame is obtained by applying \ac{mv} extrapolation from the two closest neighbours. Afterwards, the final \acs{mv} are selected based on the residual energy of their original prediction~\cite{HEVCMCResidueDec2013}.
|
||||
The evaluation of the encoding-stage is carried out separately from the streaming-stage.
|
||||
|
||||
@@ -329,7 +329,7 @@ The proposed method is also able to outperform the \ac{hevc} reference software
|
||||
In comparison to the reference \ac{hevc}, quality improvements up to $1.42$~dB at PLR=$10\%$ are obtained for Kendo sequence.%, while the average gain across all test sequences is 1~dB.
|
||||
|
||||
When comparing the results for both test cases, it is noticeable that the proposed method is able to outperform the reference methods for both cases, regardless whether \ac{idr} frame loss is allowed or not (\LOSTALL and \KEEPINTRA, respectively).
|
||||
As the \ac{plr} increases, the gains of the proposed method decrease in comparison with the case where the \ac{idr} frames are delivered error-free (i.e., case \KEEPINTRA), due to the higher error propagation of the missing \ac{idr} frame. Moreover, the quality gains are lower in the \LOSTALL case when comparing with \KEEPINTRA for the same \ac{plr}, for both the \ac{ld} and \ac{ra}.
|
||||
As the \ac{plr} increases, the gains of the proposed method decrease in comparison with the case where the \ac{idr} frames are delivered without errors (i.e., case \KEEPINTRA), due to the higher error propagation of the missing \ac{idr} frame. Moreover, the quality gains are lower in the \LOSTALL case when comparing with \KEEPINTRA for the same \ac{plr}, for both the \ac{ld} and \ac{ra}.
|
||||
Taking into account the above results and the spatio-temporal information shown in Table~\ref{TableTestSequences}, one can observe that the performance of the proposed method is lower for sequences with high spatial details and low temporal activity (e.g., BQSquare and Park Scene), which indicates higher effectiveness for video content with higher motion activity, as can be seen by the results of Race Horses and Tennis sequences.
|
||||
|
||||
|
||||
@@ -348,25 +348,25 @@ Taking into account the above results and the spatio-temporal information shown
|
||||
|
||||
The influence of $\gamma$ parameter used in (\ref{eq:KFactor}) on the video quality was also evaluated, in order to check how the cost constrains affect the performance of the proposed method.
|
||||
Figure~\ref{fig:QualityVsGamma} shows the average quality gains of the proposed method in comparison to the reference \ac{hevc} (\REF) across all test sequences, for different values of $\gamma$.
|
||||
For the error-free case (PLR=0\%), the results in this figure show that increasing $\gamma$ leads to a decrease in the coding efficiency, especially in the \ac{ld} configuration.
|
||||
For the \ac{plf} case, the results in this figure show that increasing $\gamma$ leads to a decrease in the coding efficiency, especially in the \ac{ld} configuration.
|
||||
The reason is that higher values of $\gamma$ lead to higher values of $W(r_{\phi})$, therefore the reference picture selection cost is severely constrained by the exponential weights.
|
||||
Since $T_{ID}$ is constant for all frames in the \ac{ld}, higher weights are used for all frames ($T_{ID}$ is used to reduce the weights in case of hierarchical coding) and the encoder is not able to select the best reference frame in the \ac{rd} sense.
|
||||
In the case where packet loss occurs, higher values of $\gamma$ lead to improved error resilience.
|
||||
Since higher weights are used in the \ac{rd} cost, the encoder is constrained to distribute the use of the reference frames of different \acs{pu}, reducing the error propagation.
|
||||
For very high values (e.g., $\gamma=1000$) the encoder is forced to uniformly select the reference frames, resulting in a fixed checkerboard pattern.
|
||||
\HIGHLIGHT{Overall, the $\gamma$ parameter is able to control the reference frame selection constrains,
|
||||
thus achieving better trade-off between improved error resilience and loss of coding efficiency. The value of this parameter should be selected accordingly with the conditions regarding particular applications, e.g., loss ratios or network bandwidth.}
|
||||
thus achieving better trade-off between improved error resilience and loss of coding efficiency. The value of this parameter should be selected accordingly with the requirements and condition of the streaming application, e.g., network bandwidth or packet loss ratio.}
|
||||
|
||||
|
||||
\subsubsection{BD-PSNR under error-free conditions}
|
||||
\subsubsection{BD-PSNR under packet loss free conditions}
|
||||
|
||||
This sub-section evaluates the \ac{rd} penalty incurred by the proposed method in comparison with \CHKB, as well as the other reference methods.
|
||||
Table~\ref{tab:bd_error_free} shows the Bjontegaard's Delta PSNR (BD-PSNR) values compared to the reference \ac{hevc} encoder for different coding configurations in error-free decoding. Four \acs{qp} were used from the common test conditions: 22, 27, 32, 37.
|
||||
Table~\ref{tab:bd_error_free} shows the Bjontegaard's Delta PSNR (BD-PSNR) values compared to the reference \ac{hevc} encoder for different coding configurations in error-free video decoding. Four \acs{qp} were used from the common test conditions: 22, 27, 32, 37.
|
||||
|
||||
\begin{table}[tb]
|
||||
\centering
|
||||
\newcommand{\resultswidth}{1.5cm}
|
||||
\caption{BD-PSNR (dB) in error-free conditions of the proposed reference frame selection algorithm (\PROP) in comparison with existing methods.}
|
||||
\caption{BD-PSNR (dB) in comparison with the reference HEVC for the proposed reference frame selection algorithm (\PROP) in comparison with existing methods, for the case without errors.}
|
||||
\TABLESVSPACE
|
||||
\footnotesize
|
||||
\label{tab:bd_error_free}
|
||||
@@ -388,7 +388,7 @@ The results in Table~\ref{tab:bd_error_free} indicate a small loss of coding ef
|
||||
The fixed checkerboard approach leads to an average quality reduction of $1.22$~dB for the \ac{ld} ($0.32$~dB for \ac{ra}), while the proposed method only loses $0.82$~dB and $0.24$~dB in the \ac{ld} and \ac{ra} configurations, respectively.
|
||||
These results clearly show that dynamically selecting the reference frames is more efficient than using a fixed pattern, confirming the previous results for error-prone conditions.
|
||||
Moreover, in comparison to \LONG and the method in~\cite{ROPERefGenJan2010}, the proposed method is still more efficient, because it consistently achieves better results.
|
||||
Comparing, the results for both error-free and error-prone conditions, one may conclude that the proposed method not only achieves higher quality gains, but also reduces the impact on coding efficiency.
|
||||
Comparing, the results for both packet loss free and error-prone conditions, one may conclude that the proposed method not only achieves higher quality gains, but also reduces the impact on coding efficiency.
|
||||
Overall, the loss in the quality compared to the reference \ac{hevc} is considered acceptable, given the increase in robustness obtained in lossy transmission.
|
||||
|
||||
%As expected, this is due to the sub-optimal \ac{rd} optimisation of the proposed method, because the cost function also includes the cost associated to the choice of the reference frame, in addition to the rate and distortion.
|
||||
|
||||
Reference in new issue
Block a user