I Introduction
In recent years, we can see the realtime information updating systems in many places because of the everincreasing demand of controlling timecritical information throughout network systems. The typical examples are monitoring systems of weather reports, vehicular status update systems that assist selfdriving of cars, remote controlling of construction machinery, etc. In such systems, various kinds of status are displayed on equipped monitors (e.g., temperature, humidity, and air pressure in weather reports; position, velocity, and acceleration in vehicular status). When updated status of one kind is captured by a sensor, a packet is generated by the associated source of an updated information. Thereafter, it is processed by one of servers, and then displayed on the corresponding monitor. In addition, while all the servers are busy with processing, a newly arriving packet is backlogged and becomes outdated. Note that these situations occur in practice if the arrival frequency of packets is beyond the processing power of servers. Owing to the above properties of the systems, the information displayed on the monitor is not always uptodate. Therefore, the freshness of the displayed information should be quantified and managed for those information updating systems.
From such backgrounds, a performance metric called the age of information (AoI) was proposed [1]. To define the AoI, let denote the timestamp of the generation time of the information displayed on the monitor at time . Then, the AoI at time is defined by
The AoI defined by can indicate the freshness, because the above expression means the elapsed time from the generation of the information displayed on the monitor. We note that, in a system with multiple sources, the AoI is defined for each source.
The AoI in queueing systems have been studied in recent years. We here focus on previous studies which investigated the AoIs in queueing systems with multiple information sources. Yates and Kaul provided the pioneering study in [2]. They considered singleserver queueing systems where two sources share one server to process updated information, and derived the userful expression of the average AoI of each information source. They also studied the firstcomefirstserved (FCFS) M/M/1 system as a special case, and derived the closedform expression of the average AoI of each source. Kaul and Yates [3] showed that twosource M/M/1/1 systems with preemption outperform twosource FCFS M/M/1 systems in terms of the average AoI, which triggered further studies for such withoutqueue systems. Najm and Telatar [4] derived the average AoI and the peak AoI of each source in twosource M/G/1 systems with preemption. The systems with general multiple information sources were investigated by Yates and Kaul [5]. They considered the average AoI on M/M/1/1 and M/M/1/2 systems, in both of which multiple sources share one server. In case of M/M/1/2, they utilized stochastic hybrid systems to discard waiting packets, and then they successfully reduced complexity of their analysis.
As described above, most of the works handling multiple information sources have been devoted to analyzing the average AoI of each source. To the best of our knowledge, no previous works try analytical studies about the correlation of the AoIs from different information sources. In order to grasp structures of the information updating systems with the multiple sources, it is crucially important to study a metric indicating a correlation of different sources in addition to the AoIs of the individual sources. Considering the correlation leads to a better management of an information updating system with multiple sources.
In this paper, we study the correlation of AoIs of a status updating system with multiple sources, which is modeled by an M/M/1/1 queueing system with preemption. Our model is assumed to consist of multiple information sources and the corresponding monitors and to share one server. Our model described above is defined in detail in Section II.
The contribution of this paper is as follows. We first derive the LaplaceStieltjes transform
(LST) of the stationary distribution of each AoI in our model. The LST enables to obtain the mean and the variance of the AoI. Next, assuming that the number of sources is two, we provide the closedform expression of the
correlation coefficient of the AoIs, which is the main contribution of this paper. Furthermore, using this result, we reveal some nontrivial properties on our model.The rest of this paper is organized as follows. In Section II, we describe the model of our investigating information updating systems. Sections III and IV present analysis results. In Section III, we derive the LST for each AoI. In Section IV, assuming that the number of sources is two, we obtain the correlation coefficient of the AoIs. Numerical experiments are conducted in Section V. Finally, this paper is concluded in Section VI.
Ii System Model
We consider an information updating system such that multiple sources generate information packets of updated status. Generated packets are immediately transmitted to an M/M/1/1 queueing system, which is illustrated in Fig. 1. Note that an M/M/1/1 queueing system has only one server and no buffer space. After being processed in the server, the packets are directly sent to monitors, and then the monitors display the updated information. Each source has the corresponding monitor, and updated information of a source is displayed on its corresponding monitor. The number of sources is denoted as , and denotes the set of type indexes of sources.
Packets are generated from source () according to the timehomogeneous Poisson process with rate
. Service times of packets are assumed to be independent and identically distributed (i.i.d.) with the exponential distribution having mean
; that is, packets from all sources have the same service time distribution. Besides, preemption is assumed in our system; that is, the packet which currently occupies the server will be pushed out if a new packet arrives before its service completion. We refer to a packet which completes its service without being pushed out as the valid packet. Henceforth, we refer to generation times of packets as arrival times. In addition, we define as the total arrival rate of the sources.Iii AoI for each source
In this section, we derive the LST of stationary AoI of each source. For and , let denote the th arrival time of the packet of source , and denote the service time of the packet of source which arrives at . We define as the AoI of source at time . Using these notations, we have the following expression, for and .
where . Samples paths of are illustrated in Figs. 2 and 3. is the stationary and ergodic marked point process. Thus, we define ,
, as the random variable following the stationary distribution of
.In addition, we define some notations related to valid packets. For and , we define and as the arrival time and service time of the th valid packet of source , respectively. We also define as the th departure times of the valid packet; that is, . Without loss of generality, we assume that
The service time distribution of valid packets is obtained as follows
Lemma 1
The service time of a valid packet of source follows the exponential distribution having mean .
Proof.
Let denote a random variable following the exponential distribution with mean for . Note that packets arrive according to the Poisson process with rate if we ignore types of sources. In addition, a packet is valid if no other packets arrive until its service is completed. Thus, it follows that, for and ,
∎∎
Using this lemma, we obtain the LST of each source.
Theorem 1
The LaplaceStieltjes transform of the stationary AoI of source , denoted by , is given by
Proof.
We define (resp. ) as the AoI of the immediately after (resp. before) the th update of source . Let (resp. ) denote the LSTs of the stationary distributions of (resp. ). It follows from [7] that, for and ,
(1) 
where denotes the arrival rate of valid packets of source .
Note here that is equivalent to the service time of the valid packet arriving at . Thus, from Lemma 1, we obtain
(2) 
We define as the interval time of th and st updates of source ; that is, . The following relation holds for and .
(3) 
We also have
(4) 
which is shown in Appendix A. Applying (2) and (4) to (3) yields
(5) 
Furthermore, a packet of source
is valid with probability
, independently other packets. We then have(6) 
Consequently, applying (2), (5), and (6) to (1), we obtain Theorem 1.∎∎
Furthermore, using Theorem 1, we can easily obtain the expectation and variance of each AoI.
Corollary 1
For , we have
Iv Correlation Coefficient
In this section, assuming that , we derive the correlation coefficient of stationary AoIs. For , let denote the th arrival time of packets of either sources 1 or 2, and let denote the service time of the packet arriving at .
In addition we define some notations related to valid packets. We define and as the arrival time and service time of the th valid packet of either sources 1 or 2, respectively. We also define as the th departure times of the valid packet of either sources 1 or 2; that is, . Without loss of generality, we assume that
We define as the interval time of th and st updates; that is, . We obtain the following lemma.
Lemma 2
follows the convolution of two independent random variables following exponential distributions having mean and .
We first consider the AoI of source immediately after source 1 or 2 is updated. We define for and . We obtain the following lemma.
Lemma 3
, , and are stationary and ergodic. In addition, we have, for ,
Proof.
For , let denote the type of the valid packet arriving at . For and , we define
which means that the th valid packet is the last packet which arrives from source before the th update. Note that if the valid packet arriving at is generated by source . Using this notation, we have
(7) 
which implies that , and are stationary and ergodicity.
Using Lemma 3, we obtain the main theorem of this paper.
Theorem 2
The correlation coefficient of AoIs in 2source M/M/1/1 pushout queue, denoted by , is given by
(11) 
Proof.
Using the pointwise ergodic theorem (see, e.g., [6, Theorem 1.6.4]) yields
(12) 
Dividing the integral in (12) by update times , we have
(13) 
where denotes the total number of updates in and
(14) 
Note that, for ,
(15) 
We estimate the righthand side of (
13). From (15), we haveIt follows from Lemmas 2 and 3 that and are finite w.p.1. Thus, it follows from (IV) that
(17) 
Furthermore, is the i.i.d. random variables, because the system becomes empty at time , . Thus, it follows from the elementary renewal theorem and Lemma 2 that
(18) 
Furthermore, using the pointwise ergodic theorem, we have
(19) 
where the first equation holds because it follows from (18) that . Substituting (17)–(19) into (13) yields
(20) 
From Theorem 2, we can see some nontrivial properties on the systems as follows. The proof of Corollary 2 is omitted due to the page restriction.
Corollary 2
The following statements holds.

AoIs of sources 1 and 2 have a negative correlation; that is, .

When any of , , or approaches infinity, the correlation coefficient converges to zero.

The minimum value of the correlation coefficient is , which is achieved when .
V Numerical Results
In this section, we provide numerical results of the correlation coefficient presented in Theorem 2, and confirm the statements presented in Corollary 2 through the numerical results. Fig. 4 shows the correlation coefficients which is numerically computed with several cases using Theorem 2, where the axis represents the value of , the arrival rate of source 1. Note that the parameter is fixed for each curve in Fig. 4, and is fixed as .
From Fig. 4, we observe that is always negative, that is, the two AoIs in our model always have a negative correlation, which implies (i) in Corollary 2. We also find that the curves in the figures are all convergent to zero, so that (ii) in Corollary 2 is likely to hold with respect to . Moreover, we see that the correlation coefficient has a minimum value with respect to . This means that a certain arrival rate of packets from one source gives the strongest negative correlation with the other source. Furthermore, we see from the figure that the smallest minimum value of is seen when . Actually, the smallest value in the figure is , and is achieved when , which corresponds to (iii) in Corollary 2.
Vi Conclusion
In this paper, we considered a correlation of the AoIs of two sources sharing one server to process information, and derived the closed form expression of the correlation coefficient, on the model of M/M/1/1 queueing systems. In addition, we also derived the expression of the LST of the stationary distribution of each AoI on the assumption that multiple sources share the one server. From our analysis, we found that the correlation coefficient is always negative, and that the correlation coefficient has a certain minimum value. This indicates that there is always a negative correlation between the two AoIs, and the strongest negative correlation is achieved by adjusting the parameters introduced in our model.
For further study, it would be expected that the correlation coefficient is investigated with more generalized assumptions for modeling the systems because our model adopts an elemental M/M/1/1 queueing systems with the common service rate for all the sources. To consider the correlation among several sources is also an interesting research point.
Appendix A
This appendix is devoted to the proof of (4). For and , let denote the number of arriving packets of source in . We define as the number of arriving packets of source in ; that is, . In addition, we define .
Let also denote the length from the time that the th valid packet departs to the time that a new packet arrives from source ; that is . We have the following relation (see Fig. 2).
which leads to
(21)  
For , the th arrival packet is not valid. We then have, for ,
(22)  
where denotes a random variable following the exponential distribution with mean for . Furthermore, it follows from the memoryless property that
(23) 
Note that is the service time of a valid packet. Thus, it follows from Lemma 1 that
(24) 
Applying (22)–(24) to (21), we obtain
(25)  
Finally, we show the distribution function of . A packet is valid if no packets (of all sources) arrive before its service completion. It then follows from the independence of and that a packet is valid with probability , independently other packets. Therefore, for any and ,
follows the geometric distribution on
with parameter . Thus, from (25), we obtain(26) 
Appendix B
This appendix is devoted to the proof of Lemma 2
. We derive the moment generation function of
. Let denote the total number of packets arriving from either source 1 and 2 in . In addition, we define .We define and . As similar way to (21), we have
(27)  
References
 [1] S. Kaul, R. Yates, and M. Gruteser, Realtime status: How often should one update?. in Proc. IEEE INFOCOM, p. 2731–2735, 2012.
 [2] R. Yates and S. Kaul, Realtime status updating: Multiple sources. in Proc. IEEE Int. Symp. on Inf. Theory, p. 2666–2670, 2012.
 [3] S. Kaul, R. Yates, and M. Gruteser, Status updates through queues. in Proc. IEEE CISS, p. 1–6, 2012.
 [4] E. Najm and E. Telatar, Status updates in a multistream M/G/1/1 preemptive queue. in Proc. IEEE INFOCOM Workshops, p. 124–129, 2018.
 [5] R. Yates and S. Kaul, The age of information: Realtime status updating by multiple sources. IEEE Trans. on Inf. Theory, vol. 65, no. 3, p. 1807–1827, 2019.
 [6] F. Baccelli and P. Brémaud, Elements of queueing theory: Palm Martingale calculus and stochastic recurrences. Springer Science & Business Media, 2013.
 [7] Y. Inoue, and H. Masuyama, T. Takine and T. Tanaka, A general formula for the stationary distribution of the age of information and its application to singleserver queues. IEEE Trans. on Inf. Theory, vol. 65, no. 12, p. 8305–8324, 2019.