From 1c50b4c0361eff87a32c51a51bb4e893d6b1e4bc Mon Sep 17 00:00:00 2001 From: Joao Carreira Date: Mon, 17 Dec 2018 11:48:35 +0000 Subject: [PATCH] Minor changes --- .../ErrorResilienceEvaluation.tex | 13 ++++++------- .../DynamicErrorRobustness.tex | 1 - 060_Appendix/Papers.tex | 12 ++++++------ 3 files changed, 12 insertions(+), 14 deletions(-) diff --git a/031_ErrorResilienceEvaluation/ErrorResilienceEvaluation.tex b/031_ErrorResilienceEvaluation/ErrorResilienceEvaluation.tex index d4c7c4c..c6ac75e 100644 --- a/031_ErrorResilienceEvaluation/ErrorResilienceEvaluation.tex +++ b/031_ErrorResilienceEvaluation/ErrorResilienceEvaluation.tex @@ -167,16 +167,16 @@ This allows the decoder to recover from frame/slice loss and continue error-free \begin{figure}[!t] \centering \input{./031_ErrorResilienceEvaluation/QualityEvaluation/PSNRvsIntra.tex} - \caption{Decoded video quality for different intra periods.} + \caption{Decoded video quality with a 95\% confidence interval for different intra periods.} % \caption{Decoded video quality for different intra periods, i.e., distance between intra-frames (Complementary results in Figure~\ref{Appendix:Figure3:QualityvsIntra}).} \label{Figure3:QualityvsIntra} \end{figure} -Figure~\ref{Figure3:QualityvsIntra} shows the average decoded video quality (\ac{psnr}) for different distances of intra frames, covering \acs{plr} between 3\% and 5\%. +Figure~\ref{Figure3:QualityvsIntra} shows the average decoded video quality (\ac{psnr}) obtained with different error patterns with a 95\% confidence interval for different distances of intra frames, covering \acs{plr} between 3\% and 5\%. Results in the figure indicate that as the distance between intra frames increases, the decoded video quality significantly decreases. The quality decreasing is especially noticeable for intra periods higher than 32 frames, indicating that temporal distances greater than approximately one second are not suitable for video streaming under error-prone conditions. When a high temporal distance between intra frames is used, the quality decreasing is more noticeable in the People On Street and BQSquare sequences, which have higher spatial complexity (see values for \ac{si}), leading to a reduction of 13 dB and 14 dB, respectively. -As spatial complexity increases, the prediction residue energy also increases, which leads to more erroneous information in case of data loss, reducing the video quality under errors. +As spatial complexity increases, the prediction residue energy also increases, which leads to more erroneous information in case of data loss, reducing the video quality under errors. \HIGHLIGHT{Finally, based on the result of the confidence interval one may conclude that for different error patterns the average \ac{psnr} of all frames does not significantly changes (maximum interval of 1 dB approximately).} One should also note from the results of Figure~\ref{Figure3:QualityvsIntra} that, using a small distance between intra frames is not always more efficient. Since intra frames require higher amount of bits, the overall coding efficiency is reduced, resulting in lower overall quality in case of data loss, when comparing with other cases. @@ -200,7 +200,7 @@ A comparison of the quality obtained for different partition modes is also carri \label{Figure3:SlicePartitioning} \end{figure} -Figure~\ref{Figure3:SlicePartitioning} shows the average \ac{psnr} for four different slice partitioning modes and different \acs{plr}. +Figure~\ref{Figure3:SlicePartitioning} shows the average \ac{psnr} with a 95\% confidence interval for four different slice partitioning modes and different \acs{plr}. The first three modes are characterised by a different amount of bytes per slice (B/S), namely 1200, 2400 and 4800 bytes. In these cases each frame has a variable number of slices. The last mode uses a single slice per frame (referred to as \textit{SS}), corresponding to the case where slice partitioning is disabled. The results shown in Figure~\ref{Figure3:SlicePartitioning} reveal a clear impact of the slice partitioning mode on the error robustness of \ac{hevc}, as the quality degradation for increasing \ac{plr} changes significantly for each mode. @@ -209,7 +209,8 @@ This is true for the results of most test sequences shown in Figure~\ref{Figure3 Although the use of smaller slices increases the overhead required for slice headers, the superior error robustness achieved with 1200 B/S is able to overcome the inherent degradation on coding efficiency. This is due to the lack of refresh points within a frame, resulting in errors that affect larger regions of the frame, which are propagated to the subsequent inter predicted frames. -The results for of \textit{SS} (slice partitioning disabled) reveals that this approach also leads to lower error robustness when comparing with those cases where the frames are divided into multiple slices. +The results for of \textit{SS} (slice partitioning disabled) reveals that this approach also leads to lower error robustness when comparing with those cases where the frames are divided into multiple slices. +\HIGHLIGHT{Moreover, in this case the 95\% confidence interval increases, due to the fact that each packet corresponds to whole frames, which vary in size. Therefore, depending on the affected frame, the amount of lost data will vary leading to a different impact of the recovered quality.} Although higher coding efficiency is achieved in this mode, the lower error robustness leads to an overall poor performance under frame or slice loss conditions. It is worthwhile to notice that the results for Kendo sequence do not follow the main trend. This can be explained by the low bitrate required to compress the video signal, which is the lowest when compared with the other test sequences (see Table~\ref{TableTestSequences}). @@ -399,8 +400,6 @@ However, reducing the temporal dependencies of the \acs{mv} using the proposed m The proposed method is able to reduce the quality variations up to 0.94 dB for Kendo sequence (3$\%$ of packet loss) compared to the~\TIDR~method. Therefore, since the proposed method achieves the lowest \ac{psnr} standard deviation, one may conclude that it is able to reduce the video quality variations leading to a better visual quality. -%\HIGHLIGHT{vantagem do std} - \begin{table}[tbp] \centering \caption{BD-PSNR (dB) differences for the proposed method and \TIDR at different frame loss conditions.} \label{Table3:AverageResultsProposed} diff --git a/043_DynamicErrorRobustness/DynamicErrorRobustness.tex b/043_DynamicErrorRobustness/DynamicErrorRobustness.tex index a269227..a32d5d0 100644 --- a/043_DynamicErrorRobustness/DynamicErrorRobustness.tex +++ b/043_DynamicErrorRobustness/DynamicErrorRobustness.tex @@ -98,7 +98,6 @@ Secondly, comparing the results across different video content, i.e., different For instance, in the results of Figure~\ref{Figure6:AverageQualityMain}, for Tennis sequence the method \MEXPELTWEN clearly outperforms the remaining ones. However for the BQSquare sequence, higher performance is achieved by using less bitrate (i.e., 10\%) allocated for the \ac{el} (\MEXPELTEN). This is a consequence of the higher quality degradation due to higher motion in Tennis sequence (see results for TI and \ac{mv} size in Table~\ref{Table6:TestMaterialCharacteristics}) which requires higher redundant information to increase the overall quality. -%\HIGHLIGHT{Mention SI!!} Finally, by comparing the results for all test sequences and both bitrates it can be clearly noticed that the \ac{plr} has a significant impact on the performance of the error robustness techniques. In case of the proposed reference frame selection method (\EXP), quality gains in comparison with the \REF case are achieved for lower loss ratio, i.e., \acs{plr} as low as 2\% for all test conditions. For method \MEXPELTWEN, higher \acs{plr} are required to be able to outperform both the reference \ac{hevc} and the \ac{mve} method. diff --git a/060_Appendix/Papers.tex b/060_Appendix/Papers.tex index 54c898f..7eb0658 100644 --- a/060_Appendix/Papers.tex +++ b/060_Appendix/Papers.tex @@ -8,21 +8,21 @@ This appendix presents a list of the published papers that resulted from the res \begin{description} \item[\namedlabel{Journal:TwoStage}{J1}] -J.~Carreira, P.~Assuncao, S.~Faria, E.~Ekmekcioglu, and A.~Kondoz, ``A two-stage approach for robust HEVC coding and streaming,'' \emph{IEEE Transactions on Circuits and Systems for Video Technology}, vol. 28, no. 8, pp. 1960-1973, Aug. 2018. DOI:10.1109/TCSVT.2017.2691471 +J.~Carreira, P.~Assuncao, S.~Faria, E.~Ekmekcioglu, and A.~Kondoz, ``A two-stage approach for robust HEVC coding and streaming,'' \emph{IEEE Transactions on Circuits and Systems for Video Technology}, vol. 28, no. 8, pp. 1960-1973, Aug. 2018. \newline DOI:10.1109/TCSVT.2017.2691471 \item[\namedlabel{Journal:ConcAware}{J2}] -J.~Carreira, P.~Assuncao, S.~Faria, E.~Ekmekcioglu, and A.~Kondoz, ``Error \linebreak concealment-aware encoding for robust video transmission,'' \emph{IEEE Transactions on Broadcasting} (available in IEEEXplore since Aug. 2018). DOI:10.1109/TBC.2018.2865644 +J.~Carreira, P.~Assuncao, S.~Faria, E.~Ekmekcioglu, and A.~Kondoz, ``Error \linebreak concealment-aware encoding for robust video transmission,'' \emph{IEEE Transactions on Broadcasting} (available in IEEEXplore since Aug. 2018). \newline DOI:10.1109/TBC.2018.2865644 \end{description} \section{Conference publications} \begin{description} \item[\namedlabel{Conf:DynamicTMVP}{C1}] -J.~Carreira, V.~D. Silva, E.~Ekmekcioglu, A.~Kondoz, P.~Assuncao, and S.~Faria, ``Dynamic motion vector refreshing for enhanced error resilience in HEVC,'' in \emph{22nd European Signal Processing Conference (EUSIPCO)}, Sep. 2014, pp. 281--285. ISBN:978-0-9928-6261-9 +J.~Carreira, V.~D. Silva, E.~Ekmekcioglu, A.~Kondoz, P.~Assuncao, and S.~Faria, ``Dynamic motion vector refreshing for enhanced error resilience in HEVC,'' in \emph{22nd European Signal Processing Conference (EUSIPCO)}, Sep. 2014, pp. 281--285. \newline ISBN:978-0-9928-6261-9 \item[\namedlabel{Conf:MotionVectorRedundancies}{C2}] -J.~Carreira, E.~Ekmekcioglu, A.~Kondoz, P.~Assuncao, S.~Faria, and V.~D. Silva, ``Selective motion vector redundancies for improved error resilience in HEVC,'' in \emph{IEEE International Conference on Image Processing (ICIP)}, Oct. 2014, pp. 2457--2461. DOI:10.1109/ICIP.2014.7025497 +J.~Carreira, E.~Ekmekcioglu, A.~Kondoz, P.~Assuncao, S.~Faria, and V.~D. Silva, ``Selective motion vector redundancies for improved error resilience in HEVC,'' in \emph{IEEE International Conference on Image Processing (ICIP)}, Oct. 2014, pp. 2457--2461. \newline DOI:10.1109/ICIP.2014.7025497 \item[\namedlabel{Conf:ErrorResilience}{C3}] J.~Carreira, S.~Faria, P.~Assuncao, E.~Ekmekcioglu, and A.~Kondoz, ``Error resilience analysis of motion vector prediction in HEVC,'' in \emph{Conference on Telecommunications (Conftele)}, Oct. 2015, pp. 1--4. \item[\namedlabel{Conf:Chkb}{C4}] -J.~Carreira, P.~Assuncao, S.~Faria, E.~Ekmekcioglu, A.~Kondoz, and H.Lim, ``Reference picture selection using checkerboard pattern for resilient video coding,'' in \emph{IEEE International Conference on Visual Communications and Image Processing (VCIP)}, Dec. 2015, pp. 1--5. DOI:10.1109/VCIP.2015.7457852 +J.~Carreira, P.~Assuncao, S.~Faria, E.~Ekmekcioglu, A.~Kondoz, and H.Lim, ``Reference picture selection using checkerboard pattern for resilient video coding,'' in \emph{IEEE International Conference on Visual Communications and Image Processing (VCIP)}, Dec. 2015, pp. 1--5. \newline DOI:10.1109/VCIP.2015.7457852 \item[\namedlabel{Conf:ConcAware}{C5}] - J.~Carreira, P.~Assuncao, S.~Faria, E.~Ekmekcioglu, and A.~Kondoz, ``A robust video encoding scheme to enhance error concealment of intra frames,'' in \emph{IEEE International Conference on Circuits and Systems (ISCAS)}, May 2017, pp. 1--5. DOI:10.1109/ISCAS.2017.8050576 + J.~Carreira, P.~Assuncao, S.~Faria, E.~Ekmekcioglu, and A.~Kondoz, ``A robust video encoding scheme to enhance error concealment of intra frames,'' in \emph{IEEE International Conference on Circuits and Systems (ISCAS)}, May 2017, pp. 1--5. \newline DOI:10.1109/ISCAS.2017.8050576 \end{description}