Page 1 of 9
Journal for Studies in Management and Planning
Available at
http://edupediapublications.org/journals/index.php/JSMaP/
e-ISSN: 2395-0463
Volume 02 Issue 12
December 2016
Available online: http://edupediapublications.org/journals/index.php/JSMaP/ P a g e | 14
Deep Blind Evaluation of the Quality of the Use of
Graphic Form Analysis
1mutakana Viswanatha Reddy,2Mrs.G.Satya Prabha
1PG Scholar, Department of ECE, SLC's Institute of Engineering and Technology, Piglipur Village, Hayathnagar
Mandal, Near Ramoji Film City, Ranga Reddy District, Hyderabad, Telangana
2Assistant Professor, Department of ECE, SLC's Institute of Engineering and Technology, Piglipur Village, Hayathnagar Mandal,
Near Ramoji Film City, Ranga Reddy District, Hyderabad, Telangana
Abstract Multiview videos plus depth
(MVD) is a popular 3D video representation
where pixel depth information is exploited to
generate additional views to provide 3D
experience. Quality assessment of MVD data
is of paramount importance since the latest
research results show that existing 2D
quality metrics are not suitable for MVD.
This paper focuses on depth quality
assessment and presents a novel algorithm
to estimate the distortion in depth videos
induced by compression. The proposed
algorithm is noreference and does not
require any prior training or modeling. The
proposed method is based solely on the
statistical analysis of the compression
sensitive pixels of depth images. The
experimental results worked out on a
standard MVD dataset show that the
proposed algorithm exhibits a very high
correlation with conventional full-reference
metrics.
1. INTRODUCTION
Multiview-video-plus-depth format for 3D
content representation has been adopted for
current and future 3D television
technologies e.g. free-viewpoint television
(FTV) and Super Multiview (SMV)
displays. The gray scale depth image
represents the per pixel depth value of the
corresponding texture image which is
exploited to generate novel views through
depth image based rendering (DIBR) .In
MVD format only few views with their
associated depth maps are coded and
transmitted. The compression of MVD data
is indeed an important activity in 3D
television framework and much attention
has been devoted to this research area. To
efficiently compress MVD data various
coding formats have been proposed and new
tools have been developed, e.g., [4–7].
Advanced Video Coding (H.264/AVC) has
been used in past to encode the texture
videos and depth videos independently, also
Page 2 of 9
Available online: http://edupediapublications.org/journals/index.php/JSMaP/ P a g e | 15
known as simulcast coding. The novel High
Efficiency Video Coding (HEVC) [9] is the
current state of the art video coding tool.
The Joint Collaborative Team on 3D Video
Coding Extension Development (JCT-3V)
has recently developed extensions of HEVC
to efficiently encode multiview videos and
MVDdata. Multiview-HEVC (MV-HEVC)
[10] extends the HEVC syntax to encode
MVD without additional coding tools
whereas 3D-HEVC [11] is expressively
dedicated to the design of novel coding
techniques for MVD. 3D-HEVC encodes the
base view with its depth map using
unmodified HEVC whereas the dependent
views and their depth maps are encoded by
exploiting additional coding tools. 3D- HEVC achieves the best compression This
work was partially supported by Universit ́a
degli Studi di Torino and Compagnia di San
Paolo under project ratio for MVD data. To
achieve autostereoscopy additional
intermediate viewpoints can be generated
with DIBR on the receiver side. Given a
DIBR algorithm, the perceptual quality of
the rendered images depends on both texture
and depth image quality. Quality of the
depth map is particularly important as the
compression artifacts in depth maps can
cause structural and textural distortions in
the synthesized resulting in poor 3D
experience. 3D image and video quality
assessment is a more difficult and complex
problem compared to its 2D counterpart.
Earlier, 2D image quality metrics have been
used to quantify the quality of 3D images
(video plus depth) and stereoscopic images.
In this context, the 2D metrics have been
used in two ways: some metrics estimate the
quality by assessing each texture image
separately and aggregating the values
without considering the depth images.
Others exploit the depth maps in addition to
texture image quality
to predict the overall quality. However, due
to different nature of acquisition,
representation, transmission and rendering,
3D images are affected by different types of
quality Recent studies tested various
existing 2D image quality metrics to assess
the quality of stereoscopic and 3D images
and concluded that none of the existing 2D
quality metrics is suitable in this context.
Ekmekcioglu et.al proposed a 3D quality
assessment algorithm based on weighted
PSNR and SSIM . They propose to weight
each pixel quality value (PSNR or SSIM)
with the corresponding
depth value to increase the contribution of
pixels closer to the camera; indeed,
according to their study the closer the pixel,
the larger the impact on visual perception.
Page 3 of 9
Available online: http://edupediapublications.org/journals/index.php/JSMaP/ P a g e | 16
The 3D QA proposed in combines SSIM
and C4with disparity estimation to compute
a single quality metric. The two measures
are then integrated (globally or locally) to
obtain the final quality value. Boev et. al.
[23] proposed a full-reference multi-scale
stereo video QA algorithm that computes the
monoscopic artifacts from the texture
images and stereoscopic artifacts from the
disparity images. Cyclopean images are
constructed from the reference and the test
stereopairs with block based matching;
SSIM is used to quantify the monoscopic
artifacts (2D artifacts like blur, noise, etc).
The perceptual disparity maps computed for
test and reference stereopairs are compared
to estimate the binocular distortions (e.g.
keystone, color distortion). Most existing 3D
quality metrics are full reference and few
consider depth maps in the evaluation. As
already described, quality of depth images is
very important due to their role in
intermediate view generation. Moreover, no- reference 3D quality evaluation is of
fundamental importance since the
corresponding original views may not be
available; indeed, cost, hardware and
bandwidth constraints usually impose to
capture a limited set of views and the quality
of the synthesized view must be estimated in
absence of the corresponding reference.
Furthermore, as the depth images are gray
scale textureless images usually consisting
of large homogeneous or linearly changing
regions with sharp edges representing
objects’ boundaries, the conventional 2D
visual quality metrics such as SSIM [20] are
not effective to assess the quality of depth
images. As an answer to the mentioned
issues, this paper proposes ‘Blind depth
quality metric’ (BDQM), a no-reference
algorithm to assess the quality of
compressed depth images. The major
contributions of the paper are:
• the proposal of a novel no-reference depth
quality metric BDQM for blind evaluation
of depth compression artifact;
• the shape of the histogram of compression
sensitive depth pixels is exploited to
estimate the depth quality; in particular, we
show that as the compression ratio is
increased the histogram around depth
transitions flattens because of smoothing;
• BDQM is used to predict the quality of
depth images undergoing HEVC
compression at various bitrates.
2. PROPOSED DEPTH IMAGE
QUALITY METRIC
The proposed quality metric works in two
steps; first, the compression sensitivity map
(CSM) of the depth image is computed to
