Log In Sign Up

On basis images for the digital image representation

by   V. N. Gorbachev, et al.

Digital array orthogonal transformations that can be presented as a decomposition over basis items or basis images are considered. The orthogonal transform provides digital data scattering, a process of pixel energy redistributing, that is illustrated with the help of basis images. Data scattering plays important role for applications as image coding and watermarking. We established a simple quantum analogues of basis images. They are representations of quantum operators that describe transition of single particle between its states. Considering basis images as items of a matrix, we introduced a block matrix that is suitable for orthogonal transforms of multi-dimensional arrays such as block vector, components of which are matrices. We present an orthogonal transform that produces correlation between arrays. Due to correlation new feature of data scattering was found. A presented detection algorithm is an example of how it can be used in frequency domain watermarking.


page 1

page 2

page 3

page 4


Quantum Energy Regression using Scattering Transforms

We present a novel approach to the regression of quantum mechanical ener...

Families of Multidimensional Arrays with Good Autocorrelation and Asymptotically Optimal Cross-correlation

We introduce a construction for families of 2n-dimensional arrays with a...

On the orthogonal arrays of parameters OA(1536,13,2,7) and related

With a computer-aided approach based on the connection with equitable pa...

A Multigraph Approach for Performing the Quantum Schur Transform

We take inspiration from the Okounkov-Vershik approach to the representa...

Measuring Atmospheric Scattering from Digital Images of Urban Scenery using Temporal Polarization-Based Vision

Particulate Matter (PM) is a form of air pollution that visually degrade...

Properties of the Discrete Pulse Transform for Multi-Dimensional Arrays

This report presents properties of the Discrete Pulse Transform on multi...

eGHWT: The extended Generalized Haar-Walsh Transform

Extending computational harmonic analysis tools from the classical setti...

0.1 Introduction

A digital image has various representations and some of them are required by applications. Many useful representations are produced by orthogonal transforms that are powerful tools of image processing. Well known examples are JPEG and JPEG2000 lossy compression formats based on DCT (Discrete Cosine Transform) and DWT (Discrete Wavelet Transform). For the image compression problem block based DCT and DWT techniques are developed [1] and generalized to non-separable transforms [2].
Orthogonal transform produces scattering of digital data, a process that redistributes pixel energy of transformed image. It is useful for protection the hiding data in steganography, when a message is embedded into image. The hidden data is scattered among all digital cover image and becomes more robust to lossy data compression and some statistical attacks [3].

The orthogonal transform of images may be considered as a decomposition over matrices known as basis matrices [4]. Being some kind of grayscale images, the basis matrices look attractive and they are often reproduced by textbooks [5]. We will also call these matrices basis images.

In this paper we study basis images. We focus on the following questions: color and wavelet basis images, orthogonal transform by matrix of basis images and their quantum analogues. For color images the solution is directly achieved by considering three-dimensional orthogonal transform but for wavelets the solution is not so simple. The reason is that in practice, DWT is calculated by algorithms using signal processing techniques instead of orthogonal transforms. Nevertheless these algorithms can be used to calculate wavelet basis images. So it was found for various wavelets that the basis has a block structure similar to DWT coefficients [6].

Basis images may be considered as items of a matrix. We introduced such a matrix, it is orthogonal and suitable for transforms of multi-dimensional arrays such as a block vectors consisting of matrices. In this case there is a large number of degrees of freedom that may be correlated by the transformation. The correlation results in new features of the orthogonal transform for data scattering.

Indeed, in the standard image transform a given image pixel maps into all pixels of the transformed image. To retrieve it back all the transformed image pixels are required rather than one of them. A new feature is that retrieval can be made from a single pixel only due to correlation between arrays. A detection algorithm illustrates how this feature may be used for the frequency domain watermarking.

The paper is organized as follows. First, the orthogonal transform and the data scattering and basis images are considered. Then a matrix consisting of basis images and the orthogonal transform of multi-dimensional arrays are introduced. Next, an example of the scheme for frequency domain watermarking is presented.

0.2 The orthogonal transform

The orthogonal transform can scatter digital data.

The orthogonal matrix

A square matrix of real items is orthogonal if [7]


Columns of this matrix and rows

are orthonormal vectors


where denotes scalar product of two vectors.

Scattering. We will study data scattering that can be illustrated by orthogonal transform of vectors.
Let us assume that , is a vector and is an orthogonal matrix. Taking into account that , we find orthogonal transform of vector


where vector , is often called a representation of . In matrix form these equations look as follows


As a result two points concerning data scattering can be made.

  1. Every item of transforms into all items of with the weight , where

  2. To get , we need to know all items of .

Let us assume that the data are hidden in , for example, by steganography and is distributed among all the digital space of by an orthogonal transform. The data can be extracted, we need all space of in spite of every point the data have. Formally the problem is to find for given and the orthogonal transform.
Here and later we will consider data scattering as mapping


It is clear that due to symmetry, the vector may be replaced with . The considered features are true for the orthogonal transforms of matrices and other multi-dimensional arrays.

Data scattering can be directly demonstrated by the orthogonal transform of a set of basic vectors. Let us consider a set of vectors and each of them has a nonzero component , . The vectors are known to be unit vectors and form a standard basis [7]

An orthogonal matrix transforms the standard basis into another basis consisting of the columns of


This equation shows that a single nonzero item of distributes among a column

Since the column has at least two non zero items this transformation can be considered as scattering.

Scattering may results in energy concentration, a process that is important for applications. The array energy, defined as the sum of all components squared, is preserved under orthogonal transforms. Due to scattering, the energy can be distributed into a small amount of components, that is a base of coding in the image compression field. It depends on the orthogonal matrix, regardless of whether the energy would be concentrated or not. It is known that DCT, WHT (Walsh Hadamard Transform) and KLT (Karhunen Loeve Transform) can concentrate the image energy, if image is not random, but DST (Discrete Sine Transform) can’t do it [5].

0.3 Basis images

The orthogonal transform of a matrix and three-dimensional array provides decomposition over the grayscale and color basis images.

Representation of matrix. Let be a real rectangular matrix, that corresponds to a grayscale image. We introduce two orthogonal matrices and of and . Then taking into account, that , we find


where is a matrix.
Let us assume that is an image in a spatial domain (that is the image as we see it). Matrix is usually called a frequency representation of or an image in frequency domain. The frequency domain image may look senseless, however the orthogonal transform is reversible and the original image can always be retrieved.

Using the matrix form of (0.3), for example,

we get a decomposition over tensor products of rows and columns of the matrices

and . Here and later we assume and that is a more interesting case. Then the decomposition produced by the orthogonal transformation takes the form


We introduce the matrices


that we call basis images. There are basis images of size , every image pixel is a product of two items of the orthogonal matrix

Color basis images. A color RGB image is a three-dimensional array and similar to matrices it provides a decomposition over basis images.
Let be a three-dimensional array of . The orthogonal transform of can be achieved by three orthogonal matrices , and . The matrices have size , and respectively. Similarly to (0.3) the array can be presented as follows


where , is a column of the matrix . Tensor products

produce a basis, the basis items are


In general a three-dimensional array can not be a color image. The color RGB image is described by three matrices , and of equal dimensions, say . Matrices are concatenated in a array

where is concatenation. Here we use notation of MATLAB, it means that , and .

Let us assume that in (10) is a matrix of size and introduce color basis images

Using (11) we find the color channels , and . Full basis has color items. As a result we get the decomposition of RGB images over basis color images

0.4 Properties of basis images

Being tensor products of orthogonal matrix columns and rows the basis images have properties that follow from orthogonality, and they have a simple analogue came from quantum mechanics.

Properties. Now let us consider the basis images , if , properties of are the same.

  1. The matrix product of two basis images is another basis image

  2. The scalar product


    where the scalar product of matrices is .

  3. The sum of diagonal elements, trace


    It follows that .

Analysing these properties we came to the conclusion that basis images are orthonormal. This observation allows us to consider the orthogonal transform (0.3) as a standard decomposition over the orthonormal basis. Is is obvious that the first equation takes the form



Generation of basis images. There are at least two ways to get basis images. The first is to use its definitions. In this case the orthogonal matrix has to be given. The second way follows from orthogonal transform of the basis images.
Let us focus on the second approach. Let be in equation (14). Then we find the basis image representation of the form . It means that the matrix has one nonzero pixel, it is equal to 1 and its position is . So, the orthogonal transform of a basis image is a binary matrix of unit brightness. We denote such unit matrix as


where . Then the next relations are true


These equations are two-dimensional analogue of (6) and they have a simple meaning. So together with the unit vectors the unit matrices form a standard basis and the orthogonal transform of the basis is a set of basis images .
Indeed, with the help of the standard basis any matrix can be presented in the following form

Then we get the decomposition given by (14), using the orthogonal transform and taking into account (16).

Example. WHT basis images. The orthogonal WHT matrix known also as Hadamard matrix consists of plus 1 and minus 1


In optics this matrix describes so called beam splitter, a linear optical element often used in experiments to split the beam into two parts. Four basis images , denoted as tensor product of columns, have the following form

The determinant of every matrix equals to 0 and the matrices are non invertable. The matrices can be generated from a unit matrix by WHT:


This equation illustrates relations between the basis images and the standard two-dimensional basis. But what is more interesting, the equation demonstrates scattering of digital data (5). So, a nonzero pixel of the unit matrix transforms into a basis images of a matrix with only nonzero pixels.

As a result, basis images can be produced by transformation of unit matrices.

The quantum analogue. The presented features allow us to consider basis images as a representation of quantum operators. These operators describe transitions of a physical system between its states or levels.

Let us assume that and are two basis of a single particle Hilbert space

where , . Let the overlapping integrals be real


Then we find a real matrix that is orthogonal because and are complete basis.
The following operator


where , describes transition from the state or level into level . If , this operator is known as projection operator.
Using , the introduced operator (20) can be presents as a real matrix

where . It is not difficult to understand, that these matrices are basis images, considered above.
Using we can present any single particle operator as follows

Operator can be written as a matrix using and (19), then the right part of this equation takes the form (14). As result we find that some of representations of single particle operators can be considered as basis grayscale images.

0.5 Basis wavelet images

Basis images can be generated by DWT. In calculation the DWT techniques do not use matrix methods and the basis wavelet images can be achieved by transform of standard basis.

Wavelet coefficients. The DWT coefficients have a block structure due to orthogonal matrix . In case of single level transform this matrix consists of two parts and known as low and high frequency blocks. Let be a frequency representation of a grayscale image . Applying the MATLAB notation, we write DWT as follows


Here the introduced blocks , , and — are approximation coefficients, horizontal, vertical and diagonal details or , , and frequency bands.
The DWT coefficient matrix can be considered as a three-dimensional array of size . Index labels the , , and blocks, for example, .

Block structure of basis and basis images. To calculate basis images we use equation (16)

According to (21) indexes belong to one of the blocks , , or . Let , so there is a set of basis items


where — is a matrix of zeros. Here the upper indexes are in brackets to label number of the matrices instead of indicating the pixel position. In other words, we perform an orthogonal transformation of the unit block matrix

The total number of basis images of is , every image is a matrix.
It is important to note that the equation (16) gives solution by Matlab functions dwt and idwt. The reason is that in practice the DWT calculations are often based on the filter function techniques [9]. These techniques were developed for signal processing without referring to the orthogonal matrix . Usually wavelets are introduced numerically or by recurrent equations so the calculation of is a problem (except, for example, the Haar wavelet).
Using the block coefficients and we can achieve an approximation of original image

This image has diagonal details only.
The wavelet coefficient structure results in basis of four blocks. The blocks refer to , , and similarly to (22)

Every block has basis images. As a result the representation over the wavelet basis images looks as follows

Indeed, the considered above function dwt can produce another basis. For this case in accordance with (21) every basis images has a block structure

0.6 A block matrix

Basis images may be items of a matrix that can be orthogonal.

A matrix of basis images. Consider a square matrix, which elements are basis images


Elements of do not commute. The introduced matrix is a four-dimensional array, consisting of elements

The matrix has the following important feature:


So considering the matrix elements we find

Indeed, matrix , which elements are basis images, , doesn’t have the property given by (24). In this case .

The biorthogonal decomposition. The equation (24) tells that the matrix has rows orthogonal to columns


However, the rows are not orthogonal vectors themselves and similarly to columns. An orthonormal basis is obtained from rows and columns. The basis is known to be biorthogonal or biorthonormal [8] and it can be used to represent digital arrays.
Let us consider a vector , . Using (24), we find


where the introduced vector , is a representation of . To focus on the particular feature of transform (0.6), we introduce decomposition of vectors and over columns of matrix

In contrast to orthogonal transform, the coefficients are denoted by rows but not by columns

That is a biorthogonal decomposition.
The biorthogonal decompositions are applied in the wavelet field. So, to perform dwt (21) and inverse transform idwt, we need two different wavelets. An example is the Cohen-Daubechies-Feauveau wavelet or biorthogonal 9/7 wavelet that is used in JPEG 2000.

Orthogonality. Is the matrix orthogonal? The answer is not clear because is a four-dimensional array. However, we can refer to the array primitives and consider rows and columns consisting of the rows and columns of the basis images. Let be a block row. It has items of basis images . Selecting a row of every basis image, we get a row . This may be done for a column as well. Introduced rows and columns will be orthonormal vectors. This is a reason to consider the block matrix as an orthogonal matrix.
Indeed, this result follows from the definition of the transposing operation. In case of block matrix it can be presented as follows

0.7 The block based representation

The orthogonal matrix of basis images provides a block based representation of multi-dimensional arrays.

Representation. The block based representation follows from the equations (0.6), if they are written in the matrix form


Here and are two block vectors

items of which may be chosen as vectors, matrices etc.
Let us assume that and are matrices. Restrictions on will be established later. For this case the equations (0.7) take the following form


It is important to notice that index plays minor role in these equations and from the formal point of view it is unnecessary. It means that and have to be not less than one-dimensional arrays. Then for considered matrices we find the following condition .
The unnecessary index indicates that there is more space to which matrices do not belong. From the physical point of view we have two systems, for example, atoms and light. Both systems are described by its observations that can be represented by matrices that, however, affect its Hilbert spaces. To describe elements of different spaces, e.g. two matrices and a tensor product is introduced .

0.8 Non separability and scattering

The block based representation leads to new features of data scattering and has a quantum analogue.

Correlation. Formally, the block based representation (0.7) looks as one-dimensional transform (0.2) and we find properties given by (0.3) for data scattering. However, due to large number of degrees of freedom, scattering obtains new features.

Let us assume that both arrays and are block matrices consisting of other matrices. They are four-dimensional arrays that we specify by four indexes . Let, in contrast to , the array be dependant on the last pair of indexes only

Under these conditions the equations (0.7) take the following form


where .
An important fact follows that the array is non-separable. We will use the term separable as divisibility, when the variables are factorized. For example, the function is separable over and and the function is not. In our case we focus on two pairs of variables, a pair , that describe basis images , and pair . From this point of view, the array is separable in contrast to , that is a non-separable array, because it is a sum of products


Non separability is a kind of correlation. Now this is a correlation between the matrices from different spaces, the basis images and the matrices .

Scattering. Due to the property of the scalar product of basis matrices (12), we find that



For data scattering this result tells us the following. The component scatters into every with its weight and it may be established from every item

This is a new property and it is usually impossible. The property arises from non separability produced by orthogonal transform of the block matrix . The transform results in correlation between the set of basis images and the input matrices.

A quantum analogue. The block-based representation can be introduced for a three particle quantum system.
Let us consider a three particle operator given by

where and is a single particle basis. The operator is Hermitian and unitary

Let us note that two particle operator

is a quantum analogue of the matrix , given by (0.6).
Let us introduce three particle operators and that are equal up to orthogonal transform given by

These equations can be written in a block form. Introducing the matrix elements over particle 1 for operators and way we get two operators of particle 2 and 3, which we denote as

where . Then we have the block representation

Let be the operator of particle 3 only, , then we find being a two particle non-separable operator

This equation is a quantum analogue of (31) found for digital data scattering. It is obvious, that

where the average refers to particle 2.

0.9 A steganographic scheme

The block-based representation may be useful for frequency domain steganographic technique.

Scheme. Let the digital data be images in a spatial domain and be its representation in a frequency domain. Any standard frequency embedding scheme has the following steps.

  • Transform data into the frequency domain and embed a message using an algorithm , where is a set of parameters with a possible secrete key.

  • Transform data into the spatial domain and send it to a receiver via the communication channel.

  • Extract the embedded message using detection algorithm .

The scheme includes transformations

Indeed, the transform can scatter the embedded data among the spatial domain. Scattering may result in more robust of hidden data to degradation due to various transformations. An example is a JPEG lossy compression, that stores image in a graphical format. By decreasing the image redundancy, the lossy compression introduces changes into embedded data that exploits the redundancy. So, there is a trade between the compression and the quality of the extracted information. The higher the compression level is, the worse the quality is.

Data scattering in the spatial domain. Let us consider data scattering in the block based representation (0.7), assuming . Let a message be embedded into . Then two spatial items will be changed


To extract the message, we need or two items and

The equation is a basis for the detection algorithm

Data scattering means that all spatial items were changed after embedding and all items are required for detection. Any frequency domain watermarking technique has these properties regardless of whether it use the block based representation or not. However, the representation leads to new features appearance.

Embedding. Let us assume that both vectors and have two components. Also , where is an image in the spatial domain, . In accordance to (0.8), the frequency representation consists of pair of four-dimensional arrays

Let the embedding algorithm replace with messages


where four matrices are introduced messages. The main feature of this algorithm is store the ability to the structure of the array that holds a set of tensor products including basis images. In the spatial domain we have

This allows us to exploit the equation (31) for detection. Then the embedded messages can be extracted, if the component or the component is given

For this case the detection algorithm works as follows

Let us note that it differs from the standard algorithm (0.9) that needs two spatial items instead of one.
Moreover there is a difference between this and the spatial domain embedding. We assume that message is embedded into spatial components , . It is clear that two messages can be embedded only. In the frequency domain there are four messages that may be embedded. But what is more important, these four messages can be distinguished. This fact plays a key role in detection and arises from coupling the messages and basis images to be orthogonal and hence to be well distinguished.

Taking into account the considered quantum analogues, we admit that the presented scheme can be extended to quantum mechanic fields.

0.10 Conclusions

  1. Orthogonal transform provides decomposition over basis items or basis images that have a simple quantum analogue. So, they are a representation of single particle operators that describe transitions of a particle between its states.

  2. Grayscale, color and wavelet basis images can be introduced for decomposition of two- and three-dimensional arrays.

  3. Basis images can be achieved by orthogonal transform of a standard basis that is a set of unit vectors, unit matrices and etc. This fact illustrates digital data scattering, a process of redistributing pixel energy.

  4. Due to scattering, energy can be concentrated in small amount of items or, in contrast, be spread. Both cases are interesting for applications. For example, in lossy compression scattering allows to extract the image redundancy, in watermarking it can increase the robustness of a watermark.

  5. A block matrix of basis images may be orthogonal and suitable for transformation of multi-dimensional arrays. Different degrees of freedom can be correlated by this transform and non separable arrays can be produced. As a result, in this way, new features of scattering appears. These features may be used whole executing detection algorithms in frequency domain watermarking.