1 Introduction
Rapid development in imaging technologies has made medical imaging one of the most important techniques in providing essential evidence for clinical diagnosis and medical intervention. We can now collect unprecedented amounts of image data in both spatial and temporal dimensions per patient, from one or more modalities. The challenges in extracting valuable information from these images motivate modern updates and developments in image processing and analysis methods and tools. For example, three recent imaging books by Russ and Neal[1], Birkfellner[2], and Burger and Burge[3] show the fundamentals of image processing methods developed in the last score. Industries have also invested in developing image processing tools to accommodate many different modalities with types of images ranging from document imaging [4] and multimedia imaging [5] to medical imaging [6]. The National Institute of Health (NIH)’s Center for Information Technology is leading the Medical Image Processing, Analysis, and Visualization (MIPAV) project for quantitative analysis of medical images [7]. Most of the functionalities in MIPAV are for image (pre)processing of PET, MRI, CT, microscopy, 3D images and other widelyused images in medicine. One of the most widely used image analysis that MIPIV provides, uses summary statistics of the volume of interest (VOI) within a single image to generate contour VOI plots for all of the images to be analyzed.
Comparing images or assessing their similarities is one of the most important objectives in image analysis. The methods for such comparisons include the methods for pixel by pixel comparison and those based on a specific image measure [8]. The measurebased methods include Least Square Image Matching (LSM) [9], Hausdorff distance [10] and components of a matrix decomposition [11]
. Among these measures, LSM has been used extensively because of its simplicity, but it may suffer from inaccurate initial input value and outliers
[9]. To obtain comprehensive details of the differences over entire imaging region, a statistical pixel by pixel comparison is needed.Denote an image sequence as spatial and temporal data , where is the intensity value at the pixel or spatial location and time for the subject . Here , , are the sizes of sets , , and respectively. Then, the number of measurements per subject, or the data dimension is . This can be huge, leading to a largep data problem. If is much smaller than , we have a largepsmalln problem. Largep data challenges statistical multiple comparisons, no matter the number of subjects is large or small. How to obtain an objective threshold for multiple comparisons of large, noisy and potentially heterogeneous images has challenged statisticians, especially for analyzing overflowing simultaneous images. Statistical parametric mapping (SPM) [12]
is an effective and widelyused pixel by pixel image comparison approach. The motivation for developing
Longitudinal Image Sequence Analysis (LISA) MATLAB package comes from generalizing and making a onestop ensemble of image processing and analysis tool for complex, longitudinal images, by transforming the components of the Longitudinal Analysis and SelfRegistration (LASR) procedure [13]. The LASR was developed to overcome the heterogeneity, and the largepsmalln issue in assessing the effect of Neuromuscular Electrical Stimulation (NMES) experiments [14] in reducing the risk of developing pressure ulcers. The data for LASR were movies composed from sequences of seated pressure mat images obtained under a static and a dynamic stimulation, respectively, in each session from each visit by a patient, for eight patients observed up to 5 years. There were artifacts, heterogeneity, noises, and substantial spatial and temporal alignment issues from different sessions even on the same patient. The data was massive with a huge and a small of 8. These data required extensive imaging preprocessing and general statistical analysis method, Statistical Nonparametric Mapping (SNM) that is more general than the SPM, for each set of comparisons. Various code for the components of LASR was developed individually and specifically to the pressure data formate. It would have been easier if the LISA, a general purpose MATLAB package was available then. With increasing amounts of imaging data from different modalities in nowadays, it becomes imperative to implement and generalize the LASR method into a standalone MATLAB package for general application of images in standard image formate. Making LISA available to public as a onestop MATLAB package sets a basis for future development for even large data and more generalized case. See the discussion in Section 6.Figure 1 above shows the schematic structure of LISA tool, where the ‘image processing’ is called ‘image preprocessing,’ and ‘statistical analysis’ is called ‘image postprocessing.’ The top part of Figure 1 presents the overall flow of LISA. A complete process of LISA goes through 2 steps: “I. Image Preprocessing” step as introduced in the left bottom flowchart of Figure 1 and “II. Image Postprocessing (Statistical Analysis)” step as introduced in right bottom flowchart of Figure 1. However, if image preprocessing is unnecessary or a user chooses to use other MATLAB builtin tools to denoise, segment or register their two sequences of images, LISA has the option to skip the image preprocessing step to go directly to image postprocessing (statistical analysis). Image preprocessing is done by 1) selecting a region of interest (ROI), 2) denoising the images by automatic or manual image segmentation, and 3) aligning the images by also automatic or manual image registration. Image postprocessing is done automatically by 1) calculating curated differences, 2) denoising the differences obtained from Step 1 by a nonparametric smoothing, 3) deriving varianceadjusted, smoothed values to get Ttype statistics, and 4) providing final significances of the differences based on the multiplicity adjusted pvalues. These four postprocessing steps provide Statistical Nonparametric Mapping (SNM) with minimal assumptions on the images. Here we use the False Discovery Rate (FDR) to adjust the multiplicity.
The development of MATLAB package LISA
(Longitudinal Image Sequence Analysis) has implemented and expanded the functionality of LASR to general cases for any images that can be aligned using a reference line (estimable from the image data directly) or general image processing tools in Matlab. A graphical user interface in
LISA provides convenience for a user to quickly remove noise and artifacts, decide on the region of interests and choose a quick reference line if feasible. In addition, LISA provides a parallel computing option for a large sequence or highresolution images.In the remaining paper, we provide the LISA installation guide (§2), options for preprocessing (§3) and postprocessing (statistical analysis) with a brief introduction of methodologies (§4), demonstrate the software LISA via an application (§5), and then conclude the article with a discussion, including limitations and further extensions (§6). For the details and interpretations of of the D, S, T and P maps, see Section 4. With features introduced in LISA, we improve the accuracy of statistical comparison for both static and dynamic sequences of images. LISA can tackle two sequences of timeseries images in general, including seated pressure mat images used in the NMES study, timeseries satellite image[15], and timeseries chemical imaging data [16].
2 Installation
A stepbystep installation guide is provided in this section.
1. Download LISA App
LISA program “LISA.zip” can be downloaded from the following two locations.

MathWorks File Exchange website : http://www.mathworks.com/matlabcentral/fileexchange/?term=type%3AApp

Center for Statistical Research, Computing, and Collaboration(SR2c) website : http://sr2c.case.edu/software.html
The archive “LISA.zip” contains three files : LISAxxx.mlappinstall, LISAxxx.prj, and ReadMe where xxx is the package version number. “LISAxxx.mlappinstall” file is the installation file, “LISAxxx.prj"’ is a project file containing package information and “ReadMe” file is a quick starting guide.
2. Install and load LISA App
With a newer version of MATLAB (version 8 or above), one can install and load LISA by simply running the LISAxxx.mlappinstall file [17] and follow the three steps below. However, with an older version of MATLAB (version 7 or below) one can manually install LISA using the instructions provided in the following MathWorks website https://www.mathworks.com/help/matlab/matlab_env/manageyouraddons.html.

Run LISAxxx.mlappinstall file. Then MATLAB will be launched and a “Install” window will popup as shown in Figure 2 (a)

Continue by clicking the “Install” button. MATLAB will automatically install the package and will notify the installer from the “APP” tab when the installation is complete, as shown in Figure 2 (b)

Load LISA by clicking on the LISA App icon under “APPS  MY APPS” as shown in Figure 3
When LISA is loaded, a user can start using the program right away by running the lisa function. Typing “helpLISA” into MATLAB command window will provide a vignette including the syntax and examples of the lisa function.
3 Data and Image Processing
LISA is bulit to compare two sequences of images by contrasting each sequence with representing images taken in one session. The first stable image of each sequence is treated as its reference image, which will be used throughout the image processing. Data and image processing consists of the following 5 steps.

[nolistsep]

Data Scan : Scan image frames from “csv" files

Region of Interest(ROI) Selection : Crop images to the region of interest

Image Segmentation : Detect noise

Image Registration : Calibrate Images

Finer ROI Selection(optional)
3.1 Data Scanning
The current version of LISA accepts “csv" files as inputs. A user can convert various image formats to a “csv” format in MATLAB by reading images using imread and saving the image to a “csv” file using csvwrite. In general, the output of an imaging tool in a “csv” file includes information on the date, time, frame numbers, intensity values of the images and metadata such as equipment model, user information etc. Therefore, it is very important to distinguish the image intensity matrix in a numerical form to conduct statistical comparison. LISA is able to extract image intensity matrices from the raw data files that are in the following three formats as shown in figures 4(a), 4(b), and 4(c).
The data structure in Figure 4(a) requires a user to extract the data matrix using a row identifier. A user needs to set the parameter ‘scantype’ to ‘row’ and a row identifier character string needs to be passed over to the parameter ‘rowid’. LISA skips the header rows until it encounters the first identifier. It then scans next ‘nrow’ number of rows to extract as a numeric matrix and define it as the first image frame. LISA continues the same steps until it reaches the last identifier. Here is an example of the syntax for scanning the data using the row identifier having all other arguments with their default values.
lisa(‘file1.csv’,‘file2.csv’,‘row’,#frame,#row,#col,‘rowidentifier’,
‘’,‘’,‘’,‘’,‘’,‘’,‘’,‘’ )
The data structure in Figure 4(b) requires a user to extract the data matrix using a column identifier. A user needs to specify the column that contains information on the frame numbers by setting the parameter ‘scantype’ to ‘col’ and a column number needs to be passed over to the parameter ‘colid’. LISA reads the number in that column to extract numeric matrix and save each matrix to its corresponding frames. Here is an example of the syntax for scanning the data using the column identifier having all other arguments with their default values.
lisa(‘file1.csv’,‘file2.csv’,‘col’,#frame,#row,#col,‘ ’,# of column
identifier,‘’,‘’,‘’,‘’,‘’,‘’,‘’,‘’ )
The data structure in Figure 4(c) requires a user to extract the data matrix using a blank row right before the numeric intensity matrix. A user needs to set the parameter ‘scantype’ to ‘blank’ and LISA skips the header rows until it encounters the first blank row. It then scans next ‘nrow’ number of rows to extract as a numeric matrix and define it as the first image frame. LISA continues the same steps until it reaches the last blank row. Here is an example of the syntax for scanning the data using a blank row having all other arguments with their default values.
lisa(‘file1.csv’,‘file2.csv’,‘blank’,#frame,#row,#col,‘’,‘’,‘’,‘’,
‘’,‘’,‘’,‘’,‘’ )
3.2 Select Region of Interest
This is the first interactive step for a user. A user is given the opportunity to select a rectangular region of interest from the first images of each sequence. Cropping images to a specific area of interest enhances the result of data segmentation and data registration because this naturally eliminates some part of the noise. LISA uses the “imcrop" function within the MATLAB Image Processing Toolbox to select the region of interest.
3.3 Image Segmentation
It is critical to reduce noises and outliers by segmenting an image, which sets the noisy intensity values to zero before performing an image registration. LISA provides datadriven automatic and manual segmentation. A pixel is identified as noise if its intensity value is less than a threshold . Let denote the pixel intensity value at the th row and th column of a representative image. Then the intensity values in the segmented image are below:
(1) 
The threshold value is derived differently for automatic segmentation and manual segmentation, as shown below.
3.3.1 Automatic Segmentation
Automatic segmentation finds an optimal that separates data into two groups with the maximum separation, based on an estimated mixture of Gaussian distributions of the pixel intensity values, as introduced in [13]. The mixture density has the following form:
(2) 
where is the standard normal density, is the number of mixtures, and are mixing parameters satisfying . The firstcomponent density represents the background distribution, while the secondcomponent density represents the distribution of pixel intensity inside the region of interest, also as a mixture of Gaussian distributions. The value automatically computed by LISA separates and at the valley bottom between the two densities  see the black vertical line in Figure 5.
Figure 5 is an example of the histogram and density plot for the pixel intensity values in a seated pressure map. The distribution of the intensity values is modeled by a mixture of 3component Gaussian distributions. The threshold
is determined by the vertical line that separates the first and second components in the fitted parametric Gaussian mixture model.
3.3.2 Manual Segmentation
Manual segmentation allows a user to choose visually based on a histogram of pixel intensity values. Figure 6 is a histogram of intensity values. It is natural to select the threshold at the gap where the target cross is located because at that threshold value the intensity values are distinctively divided into two groups. Once the threshold is selected, intensity values below will be replaced with zero, defined as the background noise.
3.4 Image Registration
There are two steps in image registration: temporal registration and spatial registration. Temporal registration excludes unstable images from each sequence and identifies the most similar subset of images to compare between the two sequences. Spatial image registration is done using a geometric transformation of the images.
3.4.1 Temporal Registration
The correlation coefficient of the intensities between two images is a reasonable measure of similarity between the two images. LISA temporally aligns two image sequences (of same speed) by shifting one sequence forward frames to match temporally the conditions of another sequence, using an Intensitybased Correlation Registration (ICR) below.

Exclude or the first 5 of images from each sequence, whichever the number is larger. This step removes noise images at the start of recording. Let and be the emaining sequential images in two image sequences and .

Compute the shift correlation coefficient of two sequences by averaging correlation coefficients of the data from the respective th and th frames of two sequences over , for each to obtain:
Then find that maximizes the correlations coefficients over . In other words .

Align and for frames .
3.4.2 Spatial Registration
LISA provides automatic registration and manual registration for the sequences after a temporal registration,
Automatic Registration
The following midline registration algorithm from Algorithm 3.1 in Wang et al.(2006)[13] is applicable to registering images that can be aligned by a rigid transformation using a midline (and a point) as a natural landmark.
Automatic Registration Algorithm:

Determine, column by column, the midpoints() by counting nonzero values in each column of an image using = , where are the number of rows, number of nonzero intensity values from the upper half and lower half of the column respectively for .

Fit a regression line through the midpoints and call this line the midline.

Conduct a rigid transformation by aligning each midline with a horizontal line as shown in Figure 7 using a rotation and location shift.
In other words, we define the transformation matrix R using the slope and intercept estimates of the midline from step 2 as
where is the slope of the midline and and are the shifting parameters. Using we change to where contains the information of the coordinate of the pixel defined as .
Figure 8 shows an example of automatic registration. The image is translated to be aligned with the horizontal center line. The midline registration algorithm given above is fast to implement automatically when comparing sequences of many images. For images that require a rescaling or other types of registration, we suggest a user to use other MATLAB builtin image processing tools or manual registration in the next section.
Manual Registration
Manual registration aligns the images using a line defined by two userselected points. Users select two points on the first images from each sequence which makes four point selections in total. The first points selected for each sequence are used as a reference point which is aligned at (5,# of rows/2) to shift the image to the same starting point. The second points selected is used to form a line which is used to rotate the image to the horizontal middle line of the image. An illustration of the point selection is provided in Figure 9.
Then LISA will perform a rigid transformation based on a shift and rotation matrix of R defined by the dotted blue line and 1^{st} points from Figure 9, where R = . The mathematics behind the transformation using the matrix R us identical to step 3 in the automatic registration.
3.5 Optional ROI selection
LISA provides an optional region of interest selection after the image registration as shown in Figure 10. This step is done by connecting a polygon around the ROI to distinguish ROI from the background by setting intensity values outside of the ROI to zero. Figure 10 shows an example of optional ROI selection after registration. Comparing figure 10(a) and figure 10(b), regions at y = 7 to 15 at x = 30 of the image in figure 10(b) is trimmed off after the selection.
This step is optional to be used only when it is necessary because a user needs to be cautious when selecting the ROI at this step. If the ROI is accurately selected, it will improve the accuracy of our statistical analysis. However, if the ROI selection includes artifacts or strong noises by accident, it will corrupt the image and possibly lead to misleading significance regions.
4 Statistical Analysis
Our primary objective for LISA is to identify the areas where there have been significant changes. The statistical methods to achieve this goal are given in the following four steps, by revising the Algorithm 4.1 in our early work [13].

[nolistsep]

Curated difference

Nonparametric smoothing map

Generalized TMap

FDRcontrolled PMap
4.1 Curated Difference
The initial step is to calculate curated difference of intensity values between the pairs of images in the two sequences being compared. For an image with a resolution of by , the image contains number of pixels where = . Let and be the pixel intensity values at coordinate of the corresponding images at time in sequence 1 and sequence 2 respectively. Then the curated difference is a pixel by pixel subtraction defined as for , and are calculated for every pair of image comparison from the two image sequences and are used to generate the time series Dmaps.
4.2 Nonparametric smoothing map
Our nonparametric smoothing map first pads the border of curated difference and then smooth the curated difference,
, in the region of interest. Padding the edge will prevent outstanding falsepositive differences due to image alignment and noise. Our nonparametric smoothing method uses a local polynomial regression. The method is reproduced from 4.1.Ttype Statistics [13] as follows.For a single set of curated difference image data , consider the model
where is an unknown smooth function and is an error term representing the random errors of the curated differences derived from the image observations. Then the smooth function at can be approximated by the value of a fitted local polynomial function using the intensity values in the neighborhood of . Specifically, for any of interest, the least squares problem seeks such that
and then defines the estimate of the regression surface as [18, 19]. The smooth weight function peaks at and the smoothness of is controlled by the bandwidth
. A normal density function with mean 0 and standard deviation
is a typical choice. In our procedure, the bandwidths and are selected based on the approach of 10 fold cross validation with 20 iterations [20].4.3 Generalized TMap
The method used for generalized TMap is reproduced from 4.1.Ttype Statistics [13] as follows.
The hypothesis we are testing is vs. at . Where can be written as a linear combination of the actual curated differences of pixel values,
where are the rows of the hat matrix specified by the local quadratic approximation. The estimated standard deviation of the local estimate is . From these estimates, a Ttype statistics is derived as,
follows tdistribution and the null hypothesis is rejected at
when under a significance level ofwith the degrees of freedom
, and andobtained by twomoment chisquare approximations
[18, 21, 22]. Ttype statistics is different from the conventional Tstatistics because it uses the weighted average of the values near whereas conventional Tstatistics uses simple average. Therefore, andcan be correlated for our Ttype statistics whereas the test statistics are independent to each other in the conventional Ttests.
4.4 FDRcontrolled PMap
The PMap is generated from multiple comparison controlled pvalues derived from the distribution of the Ttype statistics. The most important problem in generating PMap is overcoming the multiplicity problem for simultaneous comparisons. Familywise error rate (FWER) such as Bonferroni correction and false discovery rate(FDR) are the most common methods used to control for multiple comparisons. Section 4.2 of Zhang(2005)[23] discussed the relationship between FWER and FDR and we decided to use FDR for LISA. Specifically, we used the Benjamini and Hochberg’s FDRcontrolled method [24]. The details of the method are introduced in section 4.2 Multiple testing problem of Wang et al.(2006)[13]. LISA provides ‘2D’ and ‘3D’ options in displaying the Pmap.
5 Application
In this section, an application of LISA on Neuromuscular Electrical Stimulation(NMES) experiment [14] is introduced. NMES is a treatment proposed to improve pressure distribution at the seating or lying support area for patients with mobile difficulties. Patients are at a risk of developing pressure ulcers when seated or lying down for a long time due to the blocking of the blood flow. NMES is intended to improve the blood flow for healthier regional tissue. In this application, the effect of NMES is evaluated by comparing the sequences of the pressure mat images before and after the treatment. A step by step process of using LISA will be introduced to conduct the comparison.
Generic LISA function :
filename1  Name of the csv file that contains the first sequence of images 
filename2  Name of the csv file that contains the second sequence of images 
scantype  Data scanning method. Possible options include 
‘row’ : using a row identifier (required arguments : nrow, rowid)  
‘col’ : using a column identifier (required arguments : colid)  
‘no’ : using a blank row  
nframe  Number of frames in each sequence 
nrow  Number of rows in one frame or the height of the image 
ncol  Number of columns in one frame or the width of the image 
rowid  A characters string that identifies the start of a frame 
colid  An integer number that identifies the column where the frame numbers are stored 
preprocess  Logical value to inform if the images have been preprocessed. Possible options include 
‘T’ : True  
‘F’ : False (default)  
segtype  Type of image segmentation. Possible options include 
‘auto’ : Denoises the image by choosing a cutoff value to divide noise to the region of interest by using a mixture of normal distributions of the intensity values (default) 

‘manual’ : Denoises the image through userchosen cutoffs for the intensity values to divide noise to the region of interest  
registtype  Type of image registration. Possible options include 
‘auto’ : Rotates and/or shifts images based on a midline found by a linear regression (no user interface is required) (default) 

‘manual’ : Rotates and/or shifts images based on a line specified by two points selected manually by a user (the first click sets a reference point and the second click draws the reference line)  
roi  Select region of interest after image registration. Possible options include 
‘T’ : True  
‘F’ : False (default)  
display  Output option. Possible options include 
‘basic’ : Only displays the PMovie (movie of multiple comparison adjusted pvalues) (default)  
‘all’ : Displays OMovies (movies of the original two sequences of images), RMovies (movies of the registered sequence of images), DMovie (movie of the curated difference), SMovie (movie of the nonparametrically smoothed differences), TMovie (movie of varianceadjusted smoothed differences), and PMovie  
dimenpmap  Select the dimension of PMovie. Possible options include 
2 : Two dimensions (default)  
3 : Three dimensions  
parcomp  Parallel computing. Possible options include 
‘T’ : True  
‘F’ : False (default) 
5.1 Read in Data
The argument ‘scantype’ takes one of the three possible values. When scantype = ‘row’, LISA finds the first row that matches ‘rowid’, then ‘nrow’ rows after the ‘rowid’ are stored as a frame. The search continues until the frame after the last ‘rowid’ is read in. When scantype = ‘col’, LISA scans the csv file, and read in frames using the frame numbers found under the ‘colid’ column. When scantype = ‘no’, LISA uses blank rows as row ids, and read in ‘nrow’ rows after each blank row as individual frames. After all data are read in, LISA will have two arrays with nframe number of cells having ‘nrow’ by ‘ncol’ matrix of the intensity values in each cell.
5.2 Image Processing
A user can skip the image processing step if it’s unnecessary by setting ‘preprocess’ to ‘T’. Otherwise, a user can set ‘preprocess’ to ‘F’ to process the images as follows.
5.3 Select Region of Interest
LISA shows the first images of each sequence to select ROI as the first step of image processing. An example is displayed in Figure 11 and specific instructions on how to choose ROI are provided on the screen. A user needs to drag a square to roughly select the ROI. It is advised to choose a region large enough to enclose all ROI. Between the two regions selected from each sequence, the size of the larger region will be used to crop the images.
5.4 Image Segmentation
In the image segmentation step, noises to ROI are identified using the pixel intensity values. Automatic and manual image segmentation options are available in LISA as described in section 3.3. The following is an example.
(Automatic segmentation)

Select ROI : A user can use a multipoint polygon to select detailed ROI as shown in Figure 12.
Figure 12: Example of ROI selection for automatic image segmentation 
Select groups for mixture of Gaussian distribution : A user can change the number of bins and define visually distinct groups from the distribution of intensity as shown in Figure 13.
Figure 13: Example of groups selection for automatic image segmentation
(Manual segmentation)

Pick cutoff value : A user should select one cutoff value from the histogram of the intensity values to distinguish the noise and ROI as shown in Figure 14.
Figure 14: Example of selecting cutoff value for manual image segmentation
5.5 Image Registration
Image registration can be done automatically or manually as described in section 3.4. Automatic registration does not require any additional input from a user. Manual registration requires a user to select two points : a reference point and a second point to form a reference line using the first image of each sequence as shown in Figure 15.
5.6 Image Alignment Check
Before conducting statistical comparison, LISA overlaps the first images of the two sequences which have been processed to confirm whether the image segmentation and image registration is satisfied by a user. If a user is satisfied and selects ‘Yes’, then LISA continues to statistical analysis but if a user selects ‘No’ LISA provides suggestions to the user on image processing in a popup window and terminates the process. An example of the overlapped image is shown in Figure 16.
5.7 Output Movies
Depending on the option a user selects, LISA can provide 8 different movies :

Omovie 1 (Figure 17a) : Movie of the actual images from the first sequence

Omovie 2 (Figure 17b) : Movie of the actual images from the second sequence

Rmovie 1 (Figure 17c) : Movie of the registered images from the first sequence

Rmovie 2 (Figure 17d) : Movie of the registered images from the second sequence

Dmovie (Figure 17e) : Movie of the curated difference

Smovie (Figure 17f) : Movie of the nonparametrically smoothed difference

Tmovie (Figure 17g) : Movie of the Ttype statistics

Pmovie (Figure 17h) : Movie of FDRcontrolled pvalues
When ‘basic’ is selected only Pmap will be generated but when ‘all’ is selected, all 8 movies will be generated for display. In Dmovie, Smovie and Tmovie, a blue peak signifies positive differences which indicate higher pressure in the first sequence compared to the second sequence, whereas, a red peak signifies the opposite. In Pmovie, red areas are statistically significantly activated/different areas. The snapshots of the movies resulting from our data application using the seated pressure mats are introduced in Figure 17.
6 Discussion
LISA is an image analysis package that processes and analyzes two sequences of images to find significant activation regions between them. In LISA, the essential components of image processing functionality include ROI selection, image segmentation and image registration and that of statistical analysis functionality include nonparametric mapping, smoothing and multiple comparison adjusted testing.
The current version of LISA was developed for and focused on sequence of images from seated pressure mats but the package can be extended to analyze other types of time series images such as satellite images, hyperspectral chemical images, longitudinal magnetic resonance images. The interactive function during the image processing step makes it easier for users to use the package and provides users with visual evidence to derive more accurate image alignment and statistical comparison results. Statistical analysis is designed to reduce possible errors resulting from edge effects and to account for multiple comparisons using false discovery rate which makes the final result conservative and accurate. LISA also has a parallel computing function to help with computing issues for big data. Highresolution or long image sequences can be analyzed with the parallel computing function in a multicore processing environment.
Depending on a user’s needs and preference, other image processing tools can enhance the overall analysis experience, such as the Image Processing Toolbox(IPT) within MATLAB. Among the many options in IPT, a function such as multipoint registration could help users to derive more accurate image alignments depending on the characteristics of the image. The underlying method is identical to manual registration in LISA, but users can select multireference points for image translation. For details, please refer to the MathWorks website [25]. Any other tools can be used for image processing as long as the images are well aligned and the results are saved in ‘csv’ format to be consumed by LISA.
Development of a standalone MATLAB package LISA as an ensemble of elements from the LASR algorithm [13] with additional features for image processing and graphical user interface is the start of our project in building an image comparison analysis package for large dynamic sequence of highresolution images. The current version can handle relatively simple and static sequence of images. However, we aim to develop a next generation of LISA to be able to handle more complex and dynamic images, such as the entire body of a human and comparing images at many different time points. If we take a pressure map of a entire body of a human as an example, our future work will focus on segmented image processing and relevant statistical comparisons. This will allow us to compare and find significant activation regions independently separating by upper body, lower body, arms, legs and for any specific areas.
Another area of our future development includes reducing the computing time. Even with the parallel computing option, the computing time for LISA can be relatively long depending on the size of the image and sequence and the number of cores in the computer because the image comparison is done pixelbypixel. Pixelbypixel comparison is the most comprehensive and exhaustive way to compare images but can also provide most accurate results relative to using measures. Therefore, we will be aiming to develop methods such as to distribute the statistical calculation to reduce the computing time working under the essential framework of pixelbypixel comparison.
References
 [1] J. Russ and B. Neal. The Image Processing Hadbook Seventh Edition. CRC Press Taylor and Francis Group, 6000 Broken Sound Parkway NW, Suite 300 Boca Raton, Fl 334872742, 2016.
 [2] W. Birkfellner. Applied Medical Image Processing Second Edition. CRC Press Taylor and Francis Group, 6000 Broken Sound Parkway NW, Suite 300 Boca Raton, Fl 334872742, 2014.
 [3] W. Burger and M. Burge. Digital Image Processing Second Edition. Springer, Noblis, Inc. Washington, DC, 2016.
 [4] Inc. CVISION Technologies. Document image processing : Smarter document capture, 19982017.
 [5] ARMLtd. Multimedia processing from arm, 19952017.
 [6] Inc. LEAD Technologies. Leadtools, 19902017.
 [7] NIHCIT. Medical image processing, analysis, and visualization(mipav), 2016.
 [8] R. Katukam and P. Sindhoora. Image comparison methods and tools : A review. 1st National Conference on Emerging Trends in Information Technology, pages 35–42, 2015.
 [9] W. Förstner. On the geometric precision of digital correlation. International Archives of Photogrammetry and Remote Sensing, 24(3):176–189, 1982.
 [10] D.P. Huttenlochter, G.A. Klanderman, and W.J. Rucklidge. Comparing images using the hausdorff distance. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15:850–863, 1993.
 [11] Z. Hocenski and A. Baumgartner. Image comparison method for visual quality control based on matrix decomposition. Proceedings of the 2000 IEEE International on Industrial Electornics, 2000.
 [12] K.J. Worsley, C. Liao, Aston J., V. Petre, G.H. Duncan, F. Morales, and A.C. Evans. A general statistical analysis for fmri data. NeuroImage, 15:1–15, 2002.

[13]
X. Wang, J. Sun, and K. Bogie.
Spatialtemporal data mining procedure : Lasr.
IMS LNMS Series, "Recent Developments in Nonparametric Inference and Probability"
, 50:213–231, 2006.  [14] N. Bergstrom, M. Bennet, and C.E. Carlson. Treatment of pressure ulcers: Clinical practice guideline. No. 950852 1994. AHCPR Publication, US Department of Health and Human Services. Rockville, MD. Public Health Service, Agency for Health Care Policy and Research., 2004.
 [15] J. Verbesselt, R.J. Hyndman, G. Newnham, and Culvenor D. Detecting trend and seasonal changes in satellite image time series. Remote Sensing of Environment, 114:106–115, 2010.
 [16] A.A. Gowen, F. Marini, C. O’Donnell, C. Downew, and J. Burger. Time series hyperspectral chemical imaging data: challenges, solutions and applications. Analyitica Chimica Acta, 705:272–282, 2011.
 [17] MathWorks. Packaging and installing matlab apps, 2013.

[18]
W. Cleveland and S. Delvin.
Locally weighted regresion : An approach to regression analysis by local fitting.
Journal of the American Statistical Association, 83:596–610, 1988.  [19] X. F. Wang and D. Ye. On nonparametric comparison of images and regression surfaces. Journal of statistical planning and inference, 140:2875–2884, 2010.
 [20] T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning. Springer, New York, 2001.
 [21] J. Sun and C. Loader. Simultaneous confidence bands for linear regression and smoothing. The Annals of Statistics, 22:627–643, 1994.
 [22] X. Wang. New procedures for data mining and measurement error models with medical imaging applications. Ph.d. disseratation., Case Western Reserve University, Cleveland OH, 2005.
 [23] Z. Zhang. Multiple hypothesis testing for finite and infinite number of hypothesis. Ph.d. disseratation., Case Western Reserve University, Cleveland OH, 2005.
 [24] Y. Benjamini and Y. Hochberg. Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, 57:289–300, 1995.
 [25] MathWorks. Register an aerial photograph to a digital orthophoto, 2016.
Comments
There are no comments yet.