I Introduction
Patient similarity learning has been identified as one of the key techniques for healthcare transformation. During the past decade, Electronic Health events (EHR), including diagnosis codes, lab results, prescription data, are becoming readily available for a huge amount of patients. This makes EHR a valuable resource for evaluating the clinical similarities between pairwise patients. Patient similarity, which measures how similar a pair of patients are according to their historical information under a specific clinical context, will be the enabling technique for making various healthcare applications possible, such as cohort analysis, case based reasoning, treatment comparison, disease subtyping, and personalized medicine. In addition, learning patient similarity is a fundamental problem in evidence based medicine, which has been identified as one of the major thrust areas for transforming healthcare and improving the quality of delivery of care.
Motivation. One of the key challenges to derive patient similarity measure is how to represent the medical events of patients effectively without loss of information. Since a great deal of healthcare analytics applications critically rely upon patient similarity, the similarity measures need to be both clinically effective and accurate. Though important, there are only a handful studies on patient similarity learning [1][2]. Existing methods have successfully derived the similarity measure from EHR data through mapping the medical events into vector spaces, however, their applicability is limited due to the lack of convincing explanations for patient representations in medical domain. There has been some existing work on applying patient similarity to various applications in medical literatures. However, there are still significant challenges on learning effective patient similarities, which, to our knowledge, have not been systematically addressed. (i) TemporalSensitivity: Temporal information is important to medical events, and is crucial to understand the dynamics of medical expressions. (ii) High Dimensionality and Sparsity: EHR includes a wide range of data (such as diagnosis, medication, lab test) and a large number of possible medical events (over ten thousands of diseases and medications), so that EHR data is usually represented in a high dimensional space. Besides, EHR data is also very sparse, since a record exists if and only if the patient pays a visit to a specific clinical institute, for a particular condition. (iii) Limited interpretability: Due to the complexity of medical data, existing patient representation models are often weak at the perspective of clinical interpretations, which if addressed would significantly widen their applicability.
Proposal. Taking into account all challenges mentioned above, inspired by the idea of words embedding [3], we propose a method to represent patients and derive a similarity measure based on it. Unlike previous methods that model each medical event as a binary event vector over time (one if the medical event happened and zero otherwise), we derive a fixedlength vector representation from EHRs by medical concept embedding. In text mining, a particular word can be predicted based on the context around it [4][3]. Similarly, events happened before and after a specific medical event can be viewed as its medical context, which may be used to make event predictions in medical domain. Based on the medical context, each event is compressed into a given length vector with medical concept embedding. Similar to the word embedding [3], the event embedding presented in our model hold its natural medical concept. Furthermore, we adjust the range of context, with respect to the specific conditions of a medical event, to achieve an event embedding with temporal information. By stacking all event embedding vectors together, each patient is then represented as an embedding matrix. Note that, compared to describing patients using binary event vectors, the embedding extracts clinical features of a patient from EHRs and represent them in a reasonable dimension, resulting a natural dense embedding matrix for every patient.
Based on the embedding matrix representation of patients, we propose two methods, supervised and unsupervised, to derive the similarity measures. Note that the number of medical events varies from patients to patients, and both the supervised and unsupervised approaches are required to measure the similarity between matrices with different dimensions. As for the unsupervised method, we adopt the coefficient [5] and coefficient [6], respectively, to measure linear and nonlinear relations between pairwise patients based on the embedding matrix. In the supervised model, we measure the patients similarity using the Convolutional Neural Network (CNN), where the deep medical embedding is obtained from the intermediate convolutional feature maps. With the given number of convolutional filters, an event embedding matrix is mapped to a fixedlength feature vector. The deep medical concept embedding contributes to improved patients similarity measures. We shall later in the paper make a comparison amongst different types of patient representations, including the binary event matrix representation.
Empirical Study. Patient cohort study is the most effective way to analyze the causes, treatments, and outcomes of diseases. To evaluate the representations we proposed, we conduct a cohort analysis based on the obtained measures of patient similarity. Our model is tested on a realworld EHR dataset containing a wide range of medical events over a long time period. The experimental results demonstrate the effectiveness of our model in measuring patient similarity.
Contributions. Our work makes the following distinctive technical contributions:

We adopt a stateoftheart distributional representation model to project medical events to fixedlength vectors, which are then used to measure patient similarity.

We effectively extract the lowdimensional and dense representation for patients from EHR data, with the temporal information preserved.

We propose two solutions for patient similarity Learning, unsupervised and supervised. This makes our framework applicable to most similarityrelated applications in healthcare analytics.
Ii Related Work
In this section, we first review some related work on evaluating the clinical patient similarities, and then review some relevant problems associated with deep learning.
Iia Patient Similarity
In healthcare informatics domain, there are a lot of works focusing on patient similarity. For example, [7]
proposed a patient similarity algorithm named SimSvm that uses Support Vector Machine(SVM) to weight the similarity measures.
[8] proposed a patient similarity based disease prognosis strategy named SimProX. This model uses a Local Spline Regression (LSR) based method to embed these patient events into an intrinsic space, then measure the patient similarity by the Euclidean distance in the embedded space. These methods do not take the temporal information into consideration when evaluating patient similarities. Wang [9] presented an OneSided Convolutional Matrix Factorization for detection of temporal patterns. Cheng [1, 10] proposed an adjustable temporal fusion scheme using CNNextracted features. Based on patients similarity, plenty of applications are enabled. In [11], Ng provided personalized predictive healthcare model by matching clinical similar patients with a locally supervised metric learning measure. [12] proposed Integrated Method for Personalised Modelling (IMPM) to provide personalised treatment and personalised drug design.There are many research have been conducted on clustering patients based on machine learning. In order to rate patients health perceptions, Sewitch
[13]make cluster analysis using kmeans to identify the patients groups based on the discovering the multivariate pattern. To capture underlying structure in the history of present illness section from patients EHR, Henao
[14] proposed a statistical model that groups patients based on text data in the initial history of present illness (HPI) and final diagnosis (DX) of a patient’s EHR. For human disease gene expression, Huang [15]presented a new recursive Kmeans spectral clustering method (ReKS) to efficient cluster human diseases. Most of these research have demonstrate effectiveness of their model with realworld experiments, that convinces us of the applicability of clustering patients on cohorts discovering.
IiB Embedding Learning and Semantic Matching
One of the most important components in our patients similarity measure is deep distributional medical concept embedding. Distributional representations has gone through the long evolution, and shows stateoftheart results in many fields recently. [4, 3] proposed continuous BagofWords model and Skipgram model to represent words in vector space. The word representations using neural networks provide stateoftheart performance on measuring syntactic and semantic word similarities. Many works as well as ours are inspired by the words embedding with neural networks. [16] learned image embedding by concatenating skipgram linguistic representation vectors with visual concept representation vectors. [17] encoded a querydocument pairs into discriminate feature vectors using distributional sentence model. Similar embedding also has been used in other applications [18, 19]. Our model achieves the goal of embedding patients clinical features in the dense matrices with modest dimensionality. This
With medical concept embedding, we look forward to calculating the similarity amongst patients according to their EHRs. Considering the representations of patient medical events do not have a common time dimension, we cannot compare the patient event matrix directly. [20] provided a relevant similarity measures between temporal series of brain functional images belonging to different subjects. Similar to [20]
, we adopt the RV coefficient to measure patient similarities. Note, however, that this coefficient only considers linear relationships between two data sets. To do more systematic research on measuring similarity of patient, our model also measures nonlinear correlation between two patients using dCov coefficient. Apart from those unsupervised approach, we adopt the supervised learning method. We modify the Convolutional Neural Network(CNN) to derive the similarity scores for pairs of patients. The Convolutional networks models which are originally invented for image processing have wide applications in other domains.
[17, 21] and [22] respectively obtains the continuous representations of the sentences or short texts by a convolutional deep network, then the similarity can be effectively established.Iii The Proposed Method
Accessing patients similarities in EHR data is a very challengeable task. In this section, we will fist propose to learn the ontextual embedding of each medical concept. Then we provide an unsupervised method to estimate the similarity score, which takes the learned medical concept as the input. After that we exploit an architexture building with convolutional neural network to measure the similarity of pair patient records with some supervision encoded.
Iiia Contextual Embedding of Medical Concepts
Our goal in this step is to get the contextual embedding of each medical concept from patient EHR, which provide a better representation for medical concepts than general onehot encoding representation. By “context” around a medical concept A we really mean the medical events happening before and after A within the patient EHR corpus. For each patient, by concatenating all medical events in his/her EHR according to their happening timestamps (for events with the same timestamp we do not care about the order), we obtained a “paragraph” describing the historical condition of him/her. So the context around a specific medical event is similar to the context around a word in a paragraph. How to derive effective word representations by incorporating contextual information is a fundamental problem in Natural Language Processing (NLP) and has been extensively studied. One recent advance is the “Word2Vec” technique
[4] that trains a twolayer neural network from a text corpus to map each word into a vector space encoding the word contextual correlations. The similarities (usually cosine distance) evaluated in such embedded vector space reflect the contextual associations (e.g., words A and B with high similarity suggests they tend to appear in the same context).In NLP, the context around each word is usually identified as the adjacent words before and after it. In Word2Vec such context is defined by a sliding window around each word and the length of the window reflects the scope of the context. In EHR, as there is a timestamp associated with each medical concept, we do not just want to consider the relative positions when defining the context, but consider the actual timestamps. For example, we may want to treat event B happened one year after A differently comparing to event B happened one week after A. Another factor we need to consider is the context scope around each event, i.e., the length of the sliding windows. In Word2Vec models for NLP every word is assigned with the same window length. In contrast, for EHR, we may want medical concepts related to chronic conditions to have larger scopes while acute condition concepts to have smaller scopes. Moreover, because of the variabilities among individual patients, the scope for the same event could be different for different patients. Therefore we propose an adaptive way to determine the window length for an event in the EHR of a specific patient. Our heuristic is that chronic conditions are more likely to appear repeatedly in a patient’s EHR and thus have higher frequency, and acute conditions will be less frequent. Then for medical event
and patient ,(1) 
where is the frequency of event in the EHR of patient . and are constants.
IiiB Temporal Patient Representation
After the medical concepts embedding step, We expect that the medical concept representations learned by Skipgram will show similar properties so that the concept vectors will support clinically meaningful vector additions. A straitfoward representation of a patient will be as simple as converting all medical concepts in his medical history to medical concept vectors, then summing all those vectors to obtain a single representation vector. However, this representation will loss the temporal information. Instead, we utilize a temporal representation: the records of each patient is represented as a matrix with dimension , where is the fix embedding dimension and is the total number of visit patient has. A single representation vector of one visit is obtained by umming all the medical vectors in that visit. Usually, varies from patient to patient. Given two patients and , calculating the similarity between the record and is not that intuitive. We propose the method in the following sections.
IiiC Unsupervised Patient Similarity
In order to calculate the similarity score based on the patient temporal representation, we provide two alternatives. The first one is to utilize RV coefficient and dCov efficient to estimate the similarity over the pair of temporal patient representation. In particularly, given two matrix representations and , the RV coefficient is defined as:
(2) 
For the dCov efficient, let’s first define the empirical distance covariance:
(3) 
where is the Euclidean distance between sample and of random vector , , , . The empirical distance correlation (dCov efficient) is defined:
(4) 
IiiD Measure Similarities with Supervision
In order to add some supervision to this procedure, we proposed a deep learning model. The idea is derived from semantic matching problem in NLP, which aims to determine a matching score for two given texts. Deep learning approach has been applied to this area and most of the models conducts the matching through creating a hierarchical matching structure built on convoluational neural nets (ConvNets). The architecture of our model for measure patient pairs is presented in Figure 1. The models based on ConvNets learn to map input patient representation to vectors, which can then be used to compute their similarity. These are then used to compute a patient similarity score, which together with the representation vectors are joined in a single representation.
In the following we describe how the intermediate representations produced by the ConvNets model can be used to compute patient similarity scores and give a brief explanation of the remaining layers, e.g. hidden and softmax, used in our network.
Single Convolution feature maps: The aim of the convolutional layer is to extract effective patterns, i.e., discriminative medical concept sequences found within the input record that are common throughout the training instances. In general, let be the dimensional event vector corresponding to the th time items. A oneside convolution operation involves a filter , which is applied to a window of event features to produce a new feature. For example, a feature is generated from a window of events is defined by:
(5) 
where is a bias term and
is a nonlinear function (we use rectification (ReLU)).
Pooling
: The output from the convolutional layer (passed through the activation function) are then passed to the pooling layer, whose goal is to aggregate the information and reduce the representation. This filter is applied to each possible window of features in the event matrix
to produce a feature map , where. We then apply a max pooling over the feature map and take the average value
. The idea is to capture the most important feature one with the highest value for each feature map.Matching Matrix: Given the output of our basic for processing patient records, their resulting vector representations and , can be used to compute a recordrecord similarity score. We follow the approach of [23] that defines the similarity between and vectors as follows:
(6) 
where is a similarity matrix. The similarity matrix is a symmetrical parameter of the network and is optimized during the training.
Softmax: The output of the penultimate convolutional and pooling layers is flattened to a dense vector
, which is passed to a fully connected softmax layer. It computes the probability distribution over the labels.
IiiE Optimization
For different tasks, we need to utilize different loss functions to train our model. Taking regression as an example, we can use square loss for optimization:
(7) 
where is the realvalued groundtruth label to indicate the matching degree between and .
All parameters of the model, including the parameters of word embedding, neural tensor network, spatial RNN are jointly trained by backpropagation and Stochastic Gradient Descent. Specifically, we use AdaGrad
[24] on all parameters in the training process.Regularization For regularization we employ dropout on the penultimate layer. Dropout prevents coadaptation of hidden units by randomly dropping out—i.e., setting to zero—a proportion of the hidden units during fowardbackpropagation.
Iv Experiments and evaluation
In this section, we evaluate our framework on a real clinical EHR dataset. We carry out the cohort studies by selecting several chronic diseases associated with a range of comorbidities. There are some reasons for our cohort selection. First, they are frequently occurred diseases being extensively analyzed in healthcare applications. Second, these diseases are highly associated with each other, and their combination presents many diagnostic challenges. More importantly, due to the long period progression path of those disease, there are a great deal of temporal information embedded in the medical events. Many of medical research based on machine learning ignored the temporality while our model effectively extract those features and enrich the patients representations. Based on patients clinical similarities derived from these representations, we group patients into clusters by some classical clustering algorithms. As we focus on matching similar patients, the clustering evaluations verify the effectiveness of our model.
As testing our model on the real world EHRs, we demonstrate that our method can effectively represent patients without sacrificing temporal information. With the distributional continuous representations, we apply deep neural networks to derive measure of similarities amongst patients in the datasets. We then make use of the similarity matrix to group patients. For the evaluations shown in the results, we are convinced that the deep medical event embedding achieves a significant improvement in patients representations.
Further more, we demonstrate the robustness of our model in the cohort studies. As mentioned in [25], the primary disadvantage of medical cohort study is the limited control the investigator has over data collection. The existing data may be incomplete, inaccurate, or inconsistently measured between subjects [26]. As a result, we process patients EHR for constructing two kinds of data sets. One covers the whole complete patient events for global features analyzing. On another data set, we remove particular events labeled as cohort identifers from patients EHR to provide more natural setting in clinical cases. We systematically analyze the performance of our model in the above two settings, and draw some conclusions through our result discussions.
Iva Datasets
Our model is trained on a real world longitudinal EHR database of 218,680 patients for the course of over four years. According to the reasons presented at the beginning of this section, we select four patient cohorts from the EHR data, namely, Chronic Obstructive Pulmonary Disease (COPD), Diabetes, Heart Failure, and Obesity.
Table I provides a summary of the patient cohorts used in our experiment. Each cohort consists of a set of case patients who are confirmed with one of the four diseases according to their medical diagnosis, and each patient comes with a set of medical events including diagnosis and medications. In each patient encounter, we use the International Classification of DiseaseVersion 9 (ICD9) codes to denote the diagnosis of diseases that a patient suffers from. All the clinical events about medications are preprocessed to normalize the descriptions based on brand names and clinical dosages.
Cohorts  # Patients  # Events 

COPD  2,000  247,043 
Diabetes  2,000  259,074 
Obesity  2,000  211,496 
Heart Failure  1,135  165,254 
Total  7,135  882,867 
We construct datasets with medical events collected from patients who were confirmed of having the disease by medical experts. We develop the criteria that any patients presented in the datasets has at least forty events. The requirement is set to ensure that each test case has minimum events of clinical history that could be used in reasonable analytics tasks in healthcare. Also, to enable distinctly cluster without overlapping among cohorts, we remove patients who suffers from more than one disease in the cohort list. Finally, there are 8,000 remaining patients and 6,064 distinct clinical events. Medical event appearing in more than 90% of patients or present in fewer than five patients are removed from the datasets to avoid biases and noise in the learning process.
In the following experiments, we create two datasets: DATASETI uses the complete patients events while DATASETII reserves historical events except those labeled as cohort identifiers. On DATASETI, we split the dataset into training and test sets with same number of patients, and other patients left for validation. As for DATASETII, we construct the data sets in accordance with DATASETI. A few of patients are filtered out because of the limited number of their medical events. Table II summaries the two datasets.
Data  # Patients  # Events 

DATASETI  
TRAIN  3,211  396,072 
TEST  3,210  399,804 
DEV  714  86,991 
DATASETII  
TRAIN  3,083  373,145 
TEST  3,080  377,287 
DEV  685  81,392 
IvB Medical concept embeddings
We use word embeddings to represent each medical event as a vector. We run word2vec on the datasets containing 218,680 patients with around 16.9 million medical event records. To learn the embeddings, we choose the Bag of Words model with window size setting to 20 and events filtering with frequency less than 5. The dimensionality of our embedding vectors is set to 20, 30, 50, 200, 500, respectively, for the comparison purpose, and after a serial practices we select 50 as medical event dimension according to the best performance. Finally, the resulting event matrix covers around 8,000 events which are presented using 50dimensional vectors, and the event matrix contains all of medical features of patient. Next, we shall discuss how to use them for representing individuals and measuring their distances.
IvC Experimental Settings
The parameters of our deep learning were as follow: the width of the convolution filters is set to 5, 10, 15, 20, 25, and the number of convolutional feature maps takes on 50, 100, 150, 200. We use stochastic gradient descent to optimize the model’s parameters. We train the model with 50 examples of shuffled minibatches. We adopt nonlinear rectification (ReLU) activation function and a simple maxpooling to achieve the intermediate representations. With regards to overfitting issue we add dropout regularization with dropout rate setting to 0.5.
To optimize our deep features embedding, we conduct experiments using several different parameters sets
, which vary in size of word2vec embedding dimension, convolution filters width, and the number of convolutional feature maps. In oder to find optimal set of parameters, we compare the performance of clustering with only one variable of ,, varies.We implement the clustering base on following representations: (1) Onehot representation. Patient is represented as an event matrix. The matrices are composed of medical event columns, the dimension of which is set to 8,000, or the number of distinct medical events. The event matrix is naturally sparse, but it simplifies patients descriptions. (2) “Shallow” embeddings. As described in section IVB, we make progress in patients representations with medical event embedding by word2vec. Similar to Onehot representation, we represent patients as matrices, but denser and lower dimensional. The dimension of matrix columns has been reduced, with setting from 50 to 800. (3) Deep embeddings. To achieve a deep representation, we combine CNN with distributional medical events embeddings from word2vec. Based on above event matrix representations, patients features are filtered through the convolutional layer of neural network. Feature maps that represent patients clinical characteristics are then used to measure patients distances.
With generated representations of each patient, we firstly calculate the similarity amongst all the test patients. Then, we group patients cohorts by matching pairs of patients according to their similarity. and [27] are adopted for grouping patients based on the first two representations. Also, we compare our model with another metric learning algorithm that have shown stateoftheart results in clustering. Besides deep neural networks we have applied to learn patients features, we present other two unsupervised methods for calculating patients distances as complementary. Specifically, we use and coefficient to calculate correlations of patient feature matrices what derived form word2vec embedding.
We verify the cohort discover studies by evaluating the clustering using three popular criteria: , and .
is frequently used in data clustering, it is computed as following in [28]:
where counts the number of right decision we have made on grouping pairs of patients who are in the same cohort into one cluster, is the number of pairs of patients who came from different cohorts are grouped into dissimilar categories. In general, bad clustering have values close to 0, a perfect clustering has a of 1.
is one of very primary validation measure to evaluate the cluster quality. We compute as defined in [29]:
where is the set of clusters, is the group of classes, or cohorts in our case. The cohort is identified by the categories of dominant patients in cluster. Similar to , the has upper bound of 1 corresponding to the perfect match between the partitions and lower bound of 0 that indicates the opposite.
measures the information shared by the two clusters,thus can be adopted as a clustering similarity measure. We follow the form defined in [30] to calculate value.
where,
is the mutual information between the random variables
and ,is the information entropy of a discrete random variable
. are the probabilities of a object being in cluster and in the the intersection of and . The has a fixed lower bound of 0 and upper bound of 1. In our case, takes its maximum value of 1 when grouping clusters are identical to the real cohorts, if the partition found is totally independent of the real cohorts, then .There are other popular measures for cluster evaluation, such as [31],
, and their harmonic mean,
[32]. We also present our results by these evaluation.IvD Results and discussion
DATASETI  DATASETII  
Method  
0.5919  0.3538  0.0481  0.5834  0.3367  0.0351  
0.6506  0.4801  0.0976  0.6451  0.4410  0.0682  
0.6627  0.4192  0.1336  0.6547  0.4129  0.1106  
0.6796  0.5610  0.1682  0.6794  0.5487  0.1622  
0.6732  0.5103  0.1049  0.6475  0.4013  0.1055  
Our model()  0.6679  0.4457  0.2301  0.6285  0.3858  0.1037 
Our model()  0.6708  0.4475  0.2361  0.6268  0.3858  0.1048 
Our model(CNN)  0.9887  0.9882  0.9516  0.7491  0.6894  0.4624 
IvD1 Performance Comparison
Table III summaries the results of clustering. As we can see, the deep model with feature embedding is clearly superior to others. On DATASETI, the deep embedding model achieves an average of , comparing with the second best one with . Measured by and , it can achieve the performances of and , separately, which also outperforms others with a margin. The superiority of the model is illustrated in DATASETII as well, which is a more difficult task. Measured by and , and achieve 0.3367, 0.0351 and 0.4410, 0.0682 separately. and can only improve 11% and 25% on respectively. On the other hand, our CNN model achieves about more than 50% improvement over them.
As a reasonal explanation, we view that the deep features learning can be viewed as a twostage model. During the first stage, the clinical features of each patients are summarized in the shallow word2vec embedding, making progress with nearly improvement. Next, global features are learned base on local context features came from word2vec. The deep learning representation makes continuous improvement, which leads to a ultimate expression of patients. Figure 2 shows how expressive representations of patients contribute to match patients cohorts. With a significant improvement produced in our experiments, we demonstrate the effectiveness of our deep embedding model in expressively representing patients.
IvD2 Parameters Optimization
Figure 3 illustrates the optimizations of hyperparameters in our model. The line charts in one row assess what effects the variation has on grouping patients. As results summarized in Figure (a)a, Figure (b)b, Figure (c)c, the dimension of medical event embedding have little effect on DATASETI. That because our deep learning model have successfully obtained the primary features in the patients representations, achieving nearly perfect 1 of , , and . We make determinations based on DATASETII. According to the performance lines shown in the figures, three clustering evaluations we choose—, and achieves the best performance at the same time, with 50 dimensionality embedding, 100 feature maps, and 5 convolution filter width. The consistent performances of different measures assessed in our experiments convince us that the optimizations of parameters are correct and free of bias.
IvD3 Discussions
Table III provides the comparisons of clustering results on DATASETI and DATASETII. The results of deep embedding on DATASETII exhibit a steady outperformance over other methods. On DATASETII, the deep embedding model is trained with fewer medical events than DATASETI. As expected, the evaluations of identifying patient cohorts is slight affected by the data we deal with. Compared to the sterling performances on DATASETI, the resulted in DATASETII drops to with loss of . One simple but reasonable explanation is that the events removing from dataset cause a loss of many a medical features. Even though, our deep model extract remain features effectively offering promising performance. To sum up, we verify that our deep learning method works effectively in representing patients and learning specific features that are not present or missing.
Table III also reports the comparisons on effectiveness of our supervised and unsupervised measurement of patient similarity. On average, the unsupervise measurements— and , respectively gets of and of , which are 31% and 72% lower than the deep learning model(). Although, it’s worthwhile to mention that our unsupervise models achieve at least 12% improvement over the baseline. Comparing to the semisupervise method proposed in [27], our model achieves the same performance but do not need training examples. These comparisons suggest that our models consistently and significantly surpass other patient representations.
IvD4 Visual Analysis
As we have achieved a definitely accurate measure of patient similarity, we make a study on medical events sequence mining for representation. In order to discovery the medical pattern hidden behind the EHR about COPD, we select top100 similar patients from the COPD cohort , whom are grouped into true cluster by our method. We extract the common events occurred in the EMR of many patients.The SanKey diagram presents the progression path of the medical events collected from patients EHR. As shown in the Figure, the green,purple and red bar are related closely, which respectively represent Chronic Airways Obstruction, Essential Hypertension, Other Disorder of Bone and Cartilage. The interactions of those diseases presented in the diagram has been validated by lots of medical research in the real world, that convinces us of the applicability of our model.
In summary, the results of experiments clearly demonstrate the effectiveness of the deep model with medical feature embedding on real EHR data. Theoretically, our model benefits from the large number of convolutional filters and lower event embedding dimensionality. It is notable that our model has several important hyperparameters like word2vec window size, dimensionality of clinical event vector, the number of convolutional filters. Selecting a set of optimal parameters settings can also bring the benefit of the performance. To be more realistic, we narrow down the scopes of variations and select the best performance values.
V Conclusions
Patient similarity assessment is the enabling technique for various healthcare applications, such as disease subtyping and evidence based medicine. However, due to the complexity of medical data, extracting effective patient representations confronts distinct challenges. Though useful, most existing models proposed to discover hidden patterns in EHRs overlook the temporal information of medical events. In this paper, we propose a deep learning framework to learn patient representations for similarity measuring, in which the temporal properties of EHRs are preserved. The experimental results show that our model achieves significantly better representations over the baselines, which enables more accurate patient cohort discovery. Our next plans include solving the data irregularity issue by adding the time interval information and applying this techniques in other domain, such as health visualization. Besides, it can be observed in the experiments that our unsupervised scheme also succeeded in matching similar patients.
Vi Acknowledgement
This work is sponsored by “The Fundamental Theory and Applications of Big Data with Knowledge Engineering” under the National Key Research and Development Program of China with grant number 2016YFB1000903; National Science Foundati on of China under Grant Nos. 61428206; Ministry of Education Innovation Research Team No. IRT13035.
References
 [1] Y. Cheng, F. Wang, P. Zhang, and J. Hu, “Risk prediction with electronic health records: A deep learning approach,” 2016.
 [2] J. Sun, F. Wang, J. Hu, and S. Edabollahi, “Supervised patient similarity measure of heterogeneous patient records,” ACM SIGKDD Explorations Newsletter, vol. 14, no. 1, pp. 16–24, 2012.
 [3] T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean, “Distributed representations of words and phrases and their compositionality,” in Advances in neural information processing systems, 2013, pp. 3111–3119.
 [4] T. Mikolov, K. Chen, G. Corrado, and J. Dean, “Efficient estimation of word representations in vector space,” arXiv preprint arXiv:1301.3781, 2013.
 [5] J. Josse and S. Holmes, “Measures of dependence between random vectors and tests of independence. literature review,” arXiv preprint arXiv:1307.7383, 2013.
 [6] G. J. Székely, M. L. Rizzo, N. K. Bakirov et al., “Measuring and testing dependence by correlation of distances,” The Annals of Statistics, vol. 35, no. 6, pp. 2769–2794, 2007.
 [7] L. Chan, T. Chan, L. Cheng, and W. Mak, “Machine learning of patient similarity: A case study on predicting survival in cancer patient after locoregional chemotherapy,” in Bioinformatics and Biomedicine Workshops (BIBMW), 2010 IEEE International Conference on. IEEE, 2010, pp. 467–470.
 [8] F. Wang, J. Hu, and J. Sun, “Medical prognosis based on patient similarity and expert feedback,” in Pattern Recognition (ICPR), 2012 21st International Conference on. IEEE, 2012, pp. 1799–1802.
 [9] F. Wang, N. Lee, J. Hu, J. Sun, and S. Ebadollahi, “Towards heterogeneous temporal clinical event pattern discovery: a convolutional approach,” in Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 2012, pp. 453–461.
 [10] Z. Che, Y. Cheng, Z. Sun, and Y. Liu, “Exploiting convolutional neural network for risk prediction with medical feature embedding,” CoRR, vol. abs/1701.07474, 2017.
 [11] K. Ng, J. Sun, J. Hu, and F. Wang, “Personalized predictive modeling and risk factor identification using patient similarity,” AMIA Summits on Translational Science Proceedings, vol. 2015, p. 132, 2015.
 [12] N. Kasabov and Y. Hu, “Integrated optimisation method for personalised modelling and case studies for medical decision support,” International Journal of Functional Informatics and Personalised Medicine, vol. 3, no. 3, pp. 236–256, 2010.
 [13] M. J. Sewitch, K. Leffondré, and P. L. Dobkin, “Clustering patients according to health perceptions: relationships to psychosocial characteristics and medication nonadherence,” Journal of psychosomatic research, vol. 56, no. 3, pp. 323–332, 2004.
 [14] R. Henao, J. Murray, G. Ginsburg, L. Carin, and J. E. Lucas, “Patient clustering with uncoded text in electronic medical records,” in AMIA Annual Symposium Proceedings, vol. 2013. American Medical Informatics Association, 2013, p. 592.
 [15] G. T. Huang, K. I. Cunningham, P. V. Benos, and C. S. CHENNUBHOTLA, “Spectral clustering strategies for heterogeneous disease expression data,” in Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing. NIH Public Access, 2013, p. 212.
 [16] D. Kiela and L. Bottou, “Learning image embeddings using convolutional neural networks for improved multimodal semantics.” in EMNLP. Citeseer, 2014, pp. 36–45.
 [17] A. Severyn and A. Moschitti, “Learning to rank short text pairs with convolutional deep neural networks,” in Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 2015, pp. 373–382.

[18]
Y. Luo, Y. Cheng, z. Uzuner, P. Szolovits, and J. Starren, “Segment convolutional neural networks (SegCNNs) for classifying relations in clinical notes,”
Journal of the American Medical Informatics Association, vol. 25, no. 1, pp. 93–98, 2017.  [19] Z. Che, Y. Cheng, S. Zhai, Z. Sun, and Y. Liu, “Boosting deep learning risk prediction with generative adversarial networks for electronic health records,” in 2017 IEEE International Conference on Data Mining, ICDM 2017, New Orleans, LA, USA, November 1821, 2017, 2017, pp. 787–792.
 [20] F. Kherif, J.B. Poline, S. Mériaux, H. Benali, G. Flandin, and M. Brett, “Group analysis in functional neuroimaging: selecting subjects using similarity measures,” NeuroImage, vol. 20, no. 4, pp. 2197–2208, 2003.
 [21] B. Hu, Z. Lu, H. Li, and Q. Chen, “Convolutional neural network architectures for matching natural language sentences,” in Advances in Neural Information Processing Systems, 2014, pp. 2042–2050.
 [22] Z. Lu and H. Li, “A deep architecture for matching short texts,” in Advances in Neural Information Processing Systems, 2013, pp. 1367–1375.
 [23] A. Bordes, J. Weston, and N. Usunier, “Open question answering with weakly supervised embedding models,” in Machine Learning and Knowledge Discovery in Databases. Springer, 2014, pp. 165–180.

[24]
J. Duchi, E. Hazan, and Y. Singer, “Adaptive subgradient methods for online learning and stochastic optimization,”
The Journal of Machine Learning Research, vol. 12, pp. 2121–2159, 2011.  [25] J. W. Song and K. C. Chung, “Observational studies: cohort and casecontrol studies,” Plastic and reconstructive surgery, vol. 126, no. 6, p. 2234, 2010.
 [26] W. S. Browner, S. B. Hulley, and S. R. Cummings, Designing clinical research: an epidemiologic approach. Lippincott Williams & Wilkins, 1988.
 [27] S. Basu, A. Banerjee, and R. J. Mooney, “Active semisupervision for pairwise constrained clustering.” in SDM, vol. 4. SIAM, 2004, pp. 333–344.
 [28] W. M. Rand, “Objective criteria for the evaluation of clustering methods,” Journal of the American Statistical association, vol. 66, no. 336, pp. 846–850, 1971.
 [29] C. D. Manning, P. Raghavan, H. Schütze et al., Introduction to information retrieval. Cambridge university press Cambridge, 2008, vol. 1, no. 1.

[30]
M. Meilă, “Comparing clusterings—an information based distance,”
Journal of multivariate analysis
, vol. 98, no. 5, pp. 873–895, 2007.  [31] Y. Zhao and G. Karypis, “Criterion functions for document clustering: Experiments and analysis,” Citeseer, Tech. Rep., 2001.
 [32] C. J. Van Rijsbergen, “Foundation of evaluation,” Journal of Documentation, vol. 30, no. 4, pp. 365–373, 1974.
Comments
There are no comments yet.