Review chapter 8
This commit is contained in:
1 parent
15f95a314b
commit
77cfe2f79d
1 file changed
+9
-9
@@ -15,7 +15,7 @@ Then, the main coding tools of the state-of-the-art \ac{hevc} were described.
|
|||||||
This description covered the high-level features, such as the new picture types and the slice partitioning schemes, the new block partitioning scheme, which allow multi-level hierarchical structures with size-independent representation, the main predictions techniques, including the newly introduced advanced motion vector prediction technique.
|
This description covered the high-level features, such as the new picture types and the slice partitioning schemes, the new block partitioning scheme, which allow multi-level hierarchical structures with size-independent representation, the main predictions techniques, including the newly introduced advanced motion vector prediction technique.
|
||||||
This provided the necessary knowledge about the novel techniques in \ac{hevc}, which may have a relevant impact on the error robustness of the coded streams.
|
This provided the necessary knowledge about the novel techniques in \ac{hevc}, which may have a relevant impact on the error robustness of the coded streams.
|
||||||
The main algorithms proposed in the past to increase the error robustness of video streams were also presented, describing techniques based on error resilience \ac{rd} optimisation, redundant based approaches and \ac{ec}-based methods.
|
The main algorithms proposed in the past to increase the error robustness of video streams were also presented, describing techniques based on error resilience \ac{rd} optimisation, redundant based approaches and \ac{ec}-based methods.
|
||||||
After a simulation study it was concluded that, although the previous works provide efficient techniques to reduce the bitstream dependencies and ease the error recovery, vulnerabilities of the \ac{hevc} standard could not be fully addressed with existing techniques.
|
After a simulation study it was concluded that, although previous works provide efficient techniques to reduce the bitstream dependencies and ease the error recovery, vulnerabilities of the \ac{hevc} standard could not be fully addressed with existing techniques.
|
||||||
The main problems range from new \ac{mv} coding techniques to the lack of robust coding mechanisms, such as \ac{fmo} or data partitioning.
|
The main problems range from new \ac{mv} coding techniques to the lack of robust coding mechanisms, such as \ac{fmo} or data partitioning.
|
||||||
Moreover, there were also open issues regarding robust \ac{ec}-based encoding, as existing methods do not fully exploit the use of different techniques with different levels of complexity, especially the use of advanced \ac{ec}-based approaches.
|
Moreover, there were also open issues regarding robust \ac{ec}-based encoding, as existing methods do not fully exploit the use of different techniques with different levels of complexity, especially the use of advanced \ac{ec}-based approaches.
|
||||||
|
|
||||||
@@ -23,11 +23,11 @@ To investigate new techniques for robust video coding an evaluation study was fi
|
|||||||
Existing studies were limited to generic comparisons between \ac{hevc} and previous standards (e.g., \ac{h264}).
|
Existing studies were limited to generic comparisons between \ac{hevc} and previous standards (e.g., \ac{h264}).
|
||||||
This study extended existing ones by considering different coding configurations, which allowed to evaluate the impact of new coding tools.
|
This study extended existing ones by considering different coding configurations, which allowed to evaluate the impact of new coding tools.
|
||||||
The study revealed that some features, such as increased block size, do not have significant impact on the error robustness performance.
|
The study revealed that some features, such as increased block size, do not have significant impact on the error robustness performance.
|
||||||
However, slice partitioning and intra-refreshing have a noticeable impact on both, coding efficiency and error robustness.
|
However, slice partitioning and intra-refreshing have a noticeable impact on both coding efficiency and error robustness.
|
||||||
This led to the insight that a small compromise in coding efficiency should be reasoned, in order to achieve an acceptable quality in case of errors.
|
This led to the insight that a small compromise in coding efficiency should be accepted, in order to achieve an higher quality in case of errors.
|
||||||
Finally, one could also conclude that the use of temporal predictions in \ac{mv} coding significantly increases temporal dependencies, leading to higher quality degradation and compromising the performance of \ac{hevc}-based video transmission systems.
|
Finally, one could also conclude that the use of temporal predictions in \ac{mv} coding significantly increases temporal dependencies, leading to higher quality degradation and compromising the performance of \ac{hevc}-based video transmission systems.
|
||||||
|
|
||||||
Based on the above evidences, a new \ac{mv} coding scheme was devised, aiming at reducing the temporal dependencies.
|
Based on the above findings, a new \ac{mv} coding scheme was devised, aiming at reducing the temporal dependencies.
|
||||||
In this scheme the use of the temporal \ac{mv} candidate is selectively used in some \acs{pu}, preventing temporal dependencies across several frames.
|
In this scheme the use of the temporal \ac{mv} candidate is selectively used in some \acs{pu}, preventing temporal dependencies across several frames.
|
||||||
As this method significantly reduces the temporal dependencies, the number of mismatched \acs{mv} is decreases.
|
As this method significantly reduces the temporal dependencies, the number of mismatched \acs{mv} is decreases.
|
||||||
Moreover, as the temporal candidate is not fully disabled the impact on coding efficiency was shown to be low.
|
Moreover, as the temporal candidate is not fully disabled the impact on coding efficiency was shown to be low.
|
||||||
@@ -36,7 +36,7 @@ Experimental results demonstrated that a clear improvement on decoded video qual
|
|||||||
Another investigation carried out in this thesis was focused on the reference frame distribution in highly efficient video coders.
|
Another investigation carried out in this thesis was focused on the reference frame distribution in highly efficient video coders.
|
||||||
Since in general, the reference frame usage is unbalanced, a new method based on constrained \ac{rd} optimisation was proposed to equally distribute the use of multiple reference frames across neighbouring \acs{pu}.
|
Since in general, the reference frame usage is unbalanced, a new method based on constrained \ac{rd} optimisation was proposed to equally distribute the use of multiple reference frames across neighbouring \acs{pu}.
|
||||||
Moreover, the use of selective \ac{mv} redundancies was also investigated, in order to recover from erroneous motion predictions.
|
Moreover, the use of selective \ac{mv} redundancies was also investigated, in order to recover from erroneous motion predictions.
|
||||||
This resulted in a two-fold approach to reduce error propagation.
|
This resulted in a two-fold approach to reducing error propagation.
|
||||||
As part of the proposed method can be applied at the streaming-stage, using a low complexity parser, it can be used to adapt pre-encoded streams to error-prone transmission channels.
|
As part of the proposed method can be applied at the streaming-stage, using a low complexity parser, it can be used to adapt pre-encoded streams to error-prone transmission channels.
|
||||||
The proposed method was compared against existing techniques, and the simulation results revealed a consistently superior performance of using the two-fold approach for different packet loss ratios.
|
The proposed method was compared against existing techniques, and the simulation results revealed a consistently superior performance of using the two-fold approach for different packet loss ratios.
|
||||||
|
|
||||||
@@ -49,11 +49,11 @@ Experimental results revealed that using different \ac{ec} algorithms contribute
|
|||||||
|
|
||||||
Finally, the problem of adaptive robust coding was investigated, in order to achieve superior quality when different error robustness techniques are available and dynamic conditions are taken into account.
|
Finally, the problem of adaptive robust coding was investigated, in order to achieve superior quality when different error robustness techniques are available and dynamic conditions are taken into account.
|
||||||
Simulation results showed that the robust coding technique which obtains the higher quality depends on different factors, such as video content, bitrate and network conditions.
|
Simulation results showed that the robust coding technique which obtains the higher quality depends on different factors, such as video content, bitrate and network conditions.
|
||||||
Therefore, an adaptive scheme based on six input parameters and a pre-trained \ac{nn} was proposed, to predicts the video stream that is able to achieve the highest decoded quality, under transmission errors.
|
Therefore, an adaptive scheme based on six input parameters and a pre-trained \ac{nn} was proposed, to predicts the video stream that is able to achieve the highest decoded quality, under packet loss environments.
|
||||||
Results revealed that using the proposed adaptive scheme, an efficient trade-off between coding efficiency and error resilience is achieved for the majority of test conditions.
|
Results revealed that using the proposed adaptive scheme, an efficient trade-off between coding efficiency and error resilience is achieved for the majority of test conditions.
|
||||||
Using this architecture, the problem of robust video coding and decoding was addressed using a combination of different methods, which leads to a superior performance in comparison with individual techniques.
|
Using this architecture, the problem of robust video coding and decoding was addressed using a combination of different methods, which leads to a superior performance in comparison with individual techniques.
|
||||||
|
|
||||||
As a final remark, one may conclude that the use of the novel methods proposed in this thesis consistently contribute to increase the robustness of video communications using state of the art high efficiency video encoding tools are error prone networks.
|
As a final remark, one may conclude that the use of the novel methods proposed in this thesis consistently contributes to increase the robustness of video communications using state of the art high efficiency video encoding tools in error prone networks.
|
||||||
The best performance is achieved by combining robust video coding techniques with efficient error concealment algorithms optimised at the encoder, using an optimised dynamic approach.
|
The best performance is achieved by combining robust video coding techniques with efficient error concealment algorithms optimised at the encoder, using an optimised dynamic approach.
|
||||||
|
|
||||||
|
|
||||||
@@ -66,14 +66,14 @@ This would possibly allow stronger limitation of error propagation by introducin
|
|||||||
Moreover, one can also use more advanced constrains, such as, end-to-end based optimisations, to devise more efficient methods for distribution of the use of reference frames.
|
Moreover, one can also use more advanced constrains, such as, end-to-end based optimisations, to devise more efficient methods for distribution of the use of reference frames.
|
||||||
|
|
||||||
Regarding the \ac{ec}-aware method proposed in Chapter~\ref{Chapter:ConcealmentAwareTechniques} there are also some possible improvements to be addressed in future research.
|
Regarding the \ac{ec}-aware method proposed in Chapter~\ref{Chapter:ConcealmentAwareTechniques} there are also some possible improvements to be addressed in future research.
|
||||||
Firstly, more advanced algorithms ca be developed on a \ac{ctu} basis, in order to improve the reconstruction accuracy.
|
Firstly, more advanced algorithms can be developed on a \ac{ctu} basis, in order to improve the reconstruction accuracy.
|
||||||
This can be implemented either by replacing the existing methods, or by extending beyond the four candidates that were used in this work.
|
This can be implemented either by replacing the existing methods, or by extending beyond the four candidates that were used in this work.
|
||||||
Alternatively, to reduce the computational complexity overhead at the encoder, instead of measuring the \ac{rd} cost for each method, pre-trained classification algorithms can be investigated to predict the optimal \ac{ec} mode for each block.
|
Alternatively, to reduce the computational complexity overhead at the encoder, instead of measuring the \ac{rd} cost for each method, pre-trained classification algorithms can be investigated to predict the optimal \ac{ec} mode for each block.
|
||||||
As the complexity of the decoder is also a relevant issue, due to the increasing of mobile and battery-based devices, the optimal \ac{ec} selection should also take into account the end devices, thus penalising high complexity algorithms (e.g., algorithms requiring an estimated motion field) in case of constrained devices.
|
As the complexity of the decoder is also a relevant issue, due to the increasing of mobile and battery-based devices, the optimal \ac{ec} selection should also take into account the end devices, thus penalising high complexity algorithms (e.g., algorithms requiring an estimated motion field) in case of constrained devices.
|
||||||
The performance of the adaptive selection of the robust coding technique can also be improved by combining different classification algorithms, based on more complex neural network architectures.
|
The performance of the adaptive selection of the robust coding technique can also be improved by combining different classification algorithms, based on more complex neural network architectures.
|
||||||
|
|
||||||
Furthermore, the error robustness schemes proposed in this research work can be extended to cope with robust transmission of multi-view video, where errors propagate in the temporal and inter-layer domains.
|
Furthermore, the error robustness schemes proposed in this research work can be extended to cope with robust transmission of multi-view video, where errors propagate in the temporal and inter-layer domains.
|
||||||
Finally, as a new coding standard is currently being developed, targeting the deployment of higher-quality video services and emerging applications such as 360-degree multimedia and high-dynamic-range video, it is also an open direction for research the study of the impact of errors in such video applications and the development of novel efficient techniques to guarantee high quality visual experiences, to users of such emerging video formats.
|
Finally, as a new coding standard, entitled Versatile Video Coding, is currently being developed, targeting the deployment of higher-quality video services and emerging applications such as \HIGHLIGHT{360-degree multimedia, where the relative importance of different view points could be used to restrict the application of the proposed techniques} or high-dynamic-range video. This opens new research directions to the study the impact of errors in such video applications and the development of novel efficient techniques to guarantee high quality visual experiences, to users of such emerging video formats.
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
|||||||
Reference in new issue
Block a user