DeepAI
Log In Sign Up

Dealing with missing data under stratified sampling designs where strata are study domains

A quick count seeks to estimate the voting trends of an election and communicate them to the population on the evening of the same day of the election. In quick counts, the sampling is based on a stratified design of polling stations. Voting information is gathered gradually, often with no guarantee of obtaining the complete sample or even information in all the strata. However, accurate interval estimates with partial information must be obtained. Furthermore, this becomes more challenging if the strata are additionally study domains. To produce partial estimates, two strategies are proposed: 1) A Bayesian model using a dynamic post-stratification strategy and a single imputation process defined after a thorough analysis of historic voting information. Additionally, a credibility level correction is included to solve the underestimation of the variance; 2) a frequentist alternative that combines standard multiple imputation ideas with classic sampling techniques to obtain estimates under a missing information framework. Both solutions are illustrated and compared using information from the 2021 quick count. The aim was to estimate the composition of the Chamber of Deputies in Mexico.

READ FULL TEXT VIEW PDF

page 1

page 2

page 3

page 4

07/29/2020

Regression-based imputation of explanatory discrete missing data

Imputation of missing values is a strategy for handling non-responses in...
10/10/2019

A stacked approach for chained equations multiple imputation incorporating the substantive model

Multiple imputation by chained equations (MICE) has emerged as a popular...
11/11/2020

Multiple Imputation for Nonignorable Item Nonresponse in Complex Surveys Using Auxiliary Margin

We outline a framework for multiple imputation of nonignorable item nonr...
03/30/2022

A comparison of strategies for selecting auxiliary variables for multiple imputation

Multiple imputation (MI) is a popular method for handling missing data. ...
04/28/2021

Reference based multiple imputation – what is the right variance and how to estimate it

Reference based multiple imputation methods have become popular for hand...
04/17/2018

Hierarchical correlation reconstruction with missing data

Machine learning often needs to estimate density from a multidimensional...
10/25/2022

Joint Point and Variance Estimation under a Hierarchical Bayesian model for Survey Count Data

We propose a novel Bayesian framework for the joint modeling of survey p...

1 Introduction

1.1 Motivation

The 2021 Mexican quick count aimed to estimate the final composition of the Chamber of Deputies (COD) in the federal election. 500 deputies integrate the COD in Mexico: 300 are elected by simple majority in each of the 300 federal districts, and 200 are assigned by a proportional representation rule. Therefore, inference is required at a district level, as well as a population level. The natural sample design is a stratified random sampling by federal districts, with the particular aspect that strata are also study domains. Ultimately, the quick count produces interval estimates of the number of deputies (seats) obtained by each political force. This task is non-trivial because several rules have to be followed to transform votes into seats, these are described in [3] and [8].

The primary challenge to overcome is the production of estimates under a missing information scenario, because of the gradual arrival of the sample of polling stations. On the election day, polling places close approximately at 18 hours. Hence, information from the sample of polling stations starts arriving gradually around 19 hours as it becomes available. These incomplete samples are updated every 5 minutes with new polling stations. The aim of the quick count is to produce partial estimates until the final estimation is obtained around 22 hours (or as soon as possible). Thus, it is impossible to wait until the full sample arrives because that might never happen. In addition, at the time of the final estimation,there could be strata with no information.

Missing data is a ubiquitous problem that complicates the statistical analysis of data collected in almost every discipline. When the information collected from a study is incomplete, there are important implications for their analysis. It should be clear that when a portion of the data is missing, there is an inevitably loss of information which implies a reduction in the parameters’ estimation precision. In certain circumstances, missing data can introduce bias and thereby lead to misleading inferences about the parameters of interest. The validity of any method of analysis will thus require certain assumptions, often referred as the missing data mechanism. For an introduction on missing data ideas and implications see [9] and [12].

In general, there are three missing data scenarios [9]: Missing completely at random (if the events that lead to data being missing are independent both of observable variables and unobservable parameters of interest, and they occur solely at random), missing at random (when the missing values are not random, but these can be completely accounted for by variables where there is complete information), and missing not at random (there is a relationship between the propensity of a value to be missing and its values). It is well known, by all the members of the quick count committee, that there is bias in the arrival of the information. This is due to factors like the size of the nominal list111The nominal list is the register of citizens entitled to vote. or the location (rural-urban) of the polling stations. These scenarios fall under a missing at random mechanism. However, some additional causes induce bias and enter under a missing not at random setting. For example, disagreements concerning voting results between voters and/or between voting officials and representatives of the political parties, etc.

1.2 Objectives

The main objective of this work is to propose two strategies to produce partial estimates, under missing data, in stratified random sampling where strata are also study domains.

The first strategy is based on a frequentist estimation procedure and relies on multiple imputation ideas to deal with the missing information problem. See [14] for the original idea of multiple imputations and [13] for a review. First, complete stratified samples are obtained, second sampling techniques are used to produce variance and point estimates for these stratified samples. Finally, these estimates are pooled into a single interval estimate. A Bootstrap alternative [5]

, along with a correction to obtain unbiased estimates under stratified random sampling is used. See

[15] and [16] for the solution used in our implementation and [19] for a recent discussion on the use of Bootstrap ideas under complex survey sampling. The second strategy is based on a Bayesian estimation procedure and uses a dynamic post-stratification to impute the sufficient statistics of the Bayesian model. The post-stratification is defined by a thorough analysis of historic information. A further credibility level correction is suggested, to solve the underestimation of the variance when a single imputation is used. Post-stratification is a technique for adjusting a non-representative sample after the sample has been selected so it tackles, among many issues, missing information [6]. See also [1] for a recent application of post-stratification using multilevel regression in the context of the quick counts for Mexican governorship elections.

A minor objective is to show how to determine the sample size and estimation errors in the stratified sampling design for the 2021 Mexican quick count.

2 The Chamber of Deputies

The COD in Mexico is conformed by 500 deputies, 300 of them by the principle of simple (or relative) majority in each of the 300 federal districts222Geographically Mexico is divided into 300 federal districts. These districts are delimited to distribute the population of the country in a balanced manner so that each elected deputation represents a similar number of inhabitants. and 200 by proportional representation.

For the principle of simple majority, it is important to consider the coalitions between different political forces. If there is a coalition in a particular district, the sum of the votes obtained by all valid ways of voting for the coalition will be used in favor of the coalition candidate. In case the coalition wins, the parties agree for which one the seat in the COD will be assigned. To determine the weight of each party at the national level it is important to distribute the coalition votes among the parties that made up the coalition. In this case, the votes for valid combinations that include two or more parties are equally divided among each party in the combination. However, individual votes for each party are not shared.

In the case of proportional representation, two issues are important to mention. The first is that only political parties that accumulate more than 3% of the votes at a national level can enter the distribution of deputies by this principle333Independent candidates, null plus unregistered votes and abstentions are not considered for proportional representation.. Second, there are two upper bounds for the total number of deputies obtained by each party: 1) no political party can have more than 300 deputies, and 2) no political party can have a proportion of deputies that exceeds 8% of its proportion of votes at a national level. These two bounds imply an iterative process to assign the deputies by proportional representation, and this is outlined below.

Let denote the votes in favour of the political force in stratum and polling station . Then, the maximum number of deputies for the political force is given by , where and with the total votes for party at a national level, and is the total number of votes for all political forces that have more than 3% of the votes at a national level.

In the first distribution by proportional representation, 200 deputies are distributed considering . Let us assume that after receiving the deputies by proportional representation, the total number of deputies obtained by, say , considering both principles, exceeds . Then, an adjustment is made to the number of deputies by proportional representation such that the total number of deputies is exactly and force is removed from the distribution. If the number of deputies by proportional representation is given by , in the next step of the iteration deputies are distributed considering among the remaining political parties. Hence, this process is repeated until all the political forces meet both bounds. A final concern is the rounding problem in integers quantities, e.g. , and this is solved by the largest residual method.

This is a very particular algorithm and is carefully described in [3] and [8]. However, the inputs that it requires are the total number of votes for the political force in all the federal districts . With these totals at the federal district level, it is trivial to obtain and as described in the paragraph above. Hence, the attention is focused on the estimation of these totals and the use of the algorithm to transform votes into seats granted for the COD.

3 Estimation methods under complete samples

This section describes the strategies to estimate the conformation of the COD. We work under a stratified sample setting assuming the complete sample on each stratum is available, and the strata are study domains. First, the notation for the usual stratified sampling is introduced and then the frequentists and Bayesian estimating approaches are outlined.

3.1 Notation

The sample design is based on a stratified random sampling of polling stations by federal district with 300 strata, where strata are also study domains. It is important to stress that when a polling station is selected for the quick count, the votes for all political forces including political parties, independent candidates plus null, unregistered votes and abstentions are collected. So, in principle, complete results on each polling station in the sample are available to make inference.

Before proceeding we introduce the basic concepts, as well as the notation used by the two estimation strategies. In stratified random sampling the finite population, consisting of units is partitioned into non-overlapping strata of units, for ; clearly . To estimate the composition of the COD, is the total number of polling stations installed at a national level, are the polling stations installed in the federal district , with federal districts. A simple random sample without replacement (SRSWOR) of polling stations is taken independently from each stratum. The sample sizes within each stratum are denoted by , for ; thus the total sample size is . Finally, denotes the votes in favour of the political force in the stratum and polling station , where and is the total number of political forces (which includes political parties and independent candidates) plus two extra categories: null plus unregistered votes and abstentions. The population parameter of interest , where , is usually estimated by , where .

3.2 Frequentist method

The stratified sampling design is defined via classic sampling techniques (non-parametric), and thus to obtain estimates of the total votes for each political force is trivial, e.g. [7]. However, we need to follow classic re-sampling techniques (e.g. [4]) to obtain interval estimates for the conformation of the COD. It is well known that when the usual Bootstrap is used to estimate totals under a stratified sampling approach the variance estimators are biased, e.g. [16]. Thus, the ideas of [15] were used to obtain unbiased estimates for the total number of votes. For completion, an outline of this strategy is provided.

Let

be the probability of selecting a polling station at a stratum

, then define and , for and assume and for all are integers. The following steps are iterated times:

  1. Set .

  2. Select a SRSWOR of polling stations from the selected in district to get for and .

  3. Repeat the last step times and thus obtaining a sample of polling stations.

  4. The Bootstrap estimate for the total votes in stratum for the political force is thus given by

  5. If there are coalitions, thus considering the coalition agreements;

    1. Estimate the political force that wins the seat in the Chamber.

    2. Votes for valid combinations of political parties in the coalition, that include two or more parties, are divided between each party in the combination. The remainder of the division is assigned to the political party with the most votes.

  6. Set and return to Step 2 while .

  7. Estimate the total votes in favor of each political force at a national level.

  8. Apply the algorithm to obtain the conformation of the COD. This algorithm further requires estimates of

    • The total number of votes obtained by each political force at a national level, i.e

    • The proportion of valid votes in favor of each political force at a national level, and these are obtained via where null and unregistered votes are ignored.

    • The proportion of valid votes for each political party after excluding parties that do not reach in valid voting (independent candidates are ignored), this is given by

    where denotes the indicator function of set .

The algorithm produces

conformations of the COD. Confidence intervals for the number of seats for each political force are obtained via the percentile method, see e.g.

[20].

If for some strata and are not integers there is a randomization process to round these to an integer and the algorithm is applied exactly as above. This randomization process ensures the estimates are unbiased, see [15]. Steps 1 to 4 are described in [16] (2.2. The Mirror-Match Method).

3.3 Bayesian method

Although the rules to obtain the conformation of the COD are based on the total votes per party, it is possible to represent the criteria in terms of the proportions of votes, that we introduce with the following notation. Let be the size of the nominal list, that is, the size of the list of all citizens who have the right to vote, in polling station of stratum . Let be the proportion of votes, relative to the size nominal list , in favour of the political force in the stratum , with and . Let the size of the nominal list of voters in district , for , and the size of the national nominal list. Then is the proportion of votes, relative to the size nominal list, in favour of political force at national level.

For the estimation of , we use a slight modification of the model proposed by [10]. This model assumes the votes in favour of the political force in the stratum in the polling station follows the distribution

for , where is the precision assumed constant within the stratum and independent of . Even more, is assumed independent of , for all .

The original prior distribution for the unknown model parameters , considered in [10], assumes independence and is of the form and . However, this prior only produces a proper posterior if sample size , wasting valuable information when we only have a single polling station. To overcome this problem we now propose to use a proper but vague prior of the form , which has a large variance of 200.

Thus, using Bayes’ Theorem, the posterior distribution turns out to be proportional to the product of a truncated normal for

conditional on

and a gamma distribution for

. Specifically we have

(1)

To determine the winning deputies by simple majority we define

an indicator that tells us whether or not political force won in district .

To determine the winning deputies by proportional representation, we first define , the proportion of valid votes (nulls plus no registered and abstentions are excluded), and , as the proportion after excluding parties that do not reach in valid voting, independents, null and unregistered.

Posterior point and interval estimates for are approximated via simulations from the posterior distribution. This is required due to the truncation. For details see [10]

. For each posterior draw, a conformation of the COD is obtained. Highest posterior density intervals for the number of seats for each political force are finally obtained using the 2.5% and 97.5% quantiles.

4 Incomplete Sample Strategies

This part describes the strategies to obtain estimates under an incomplete sample setting. Both proposals use imputation strategies to estimate employing the methods for complete samples. As a motivation, the complete sample sizes and the sample sizes received in several quick counts are presented first.

4.1 Motivation: previous quick counts

There has not been any quick count that has received the complete sample at the appropriate time. In Table 1, the total sample size and the sample size used to calculate the last estimation for six quick counts are displayed, three for the COD, and three presidential. Note that values for the 2021 election are also included, the total sample size was polling stations. In the next section results from a simulation study are shown to justify this sample size. Table 1 indicates the worse scenario was in 2018 (COD election) where only 67.5% of the sample was used to produce final estimates, and the best was in 2006 (presidential election) where 95.1% of the sample was used to produce estimates.

Election COD Presidential
Year 2003 2015 2021 2006 2012 2018
Total polling stations () 121,284 149,726 163,666 130,788 143,437 156,840
Total sample size () 7,236 9,450 6,345 7,636 7,597 7,787
Received sample size 6,743 7,016 5,040 7,263 6,260 5,254
% of SS received 93.1 74.2 79.4 95.1 82.4 67.5
Time of final estimate 22:00 22:15 22:35 22:15 22:30 22:30
Table 1: Total polling stations, quick count sample sizes (total, received and percentage) and time of final estimate.

We are clearly facing a missing data problem. One simple solution could be to define a larger sample size (sample augmentation), however there are two important factors to consider: The pressure the quick count exerts on the field people must be minimized, and also the bias in the arrival of the information due to factors of the polling stations, such as the size of the nominal list, the location in a rural or urban area, causes under a missing not at random setting. Therefore, larger sample sizes would increase bias and would not solve the missing data problem.

The total number of polling stations is growing year after year as it depends on the population size. However, the sample size must be kept small enough. For the quick count to be useful, final estimates have to be produced around the 22 hours (or earlier if possible) on the election day. Then, it is essential to produce estimates with incomplete samples. Here two solutions are proposed.

4.2 Frequentist alternative using multiple imputation

One direct way to deal with the missing data problem is via multiple imputation (MI), which is a three-stage approach. First, missing values are imputed times using a statistical model based on the available data. Thus, effectively generating complete datasets. Second, inference is performed on each of the complete data sets. On this step the Bootstrap algorithm described in Section 3.2 is used on each of the complete data sets. Third, the estimates are consolidated/pooled to obtain a single estimate.

It is easy to understand how several multiple univariate imputation strategies work by considering these as something similar to making predictions under a regression context. A set of predictor variables

are needed to describe a dependent variable , and the aim is to predict the values of the dependent variable that are missing. Observations with full information are used to fit the model, and predictions for the missing observations are the imputed values. However, since different predictions/imputations for the same missing observation are required, a randomization process is included. In our case the predictive mean matching (pmm) algorithm [9]

was used. For completion, an outline of the procedure is provided. First, fit a linear regression model via Bayesian ideas. Second, draw randomly from the posterior predictive distribution of

and produce a new set of regression coefficients . Third, calculate predicted values for observed and missing , and for each case where is missing, find the closest predicted values among cases where is observed. The pmm algorithm selects the closest observed values (typically with 3, 5 or 10 members) to the missing value . Fourth, draw randomly one of these close cases and impute the missing value with the observed value of this close case. Finally, under an MI setting these steps are repeated times.

To deal with the multivariate case, the MI strategy can be extended as follows. First, to start the algorithm the mean of the non-missing observations per variable is imputed on each missing value. Second, mean imputations for the first variable are put back as missing and the univariate imputation strategy is used to impute all the missing values of this variable. The remaining variables are used as predictor variables. Third, mean imputations for the second variable are put back as missing and the univariate imputation strategy is used to impute this variable. This process continues until all the missing values for all the variables have been imputed. This is one iteration of the imputation process. We can define the number of iterations to perform, the variables to use as predictors, and even the order in which each variable is used. This algorithm has been implemented in R via the mice library [18]. In our case, only the major political parties MORENA, PAN, PRI, and PRD, along with the nominal list were used as predictor variables. The variables were imputed from left to right, this means older political parties were imputed first. Finally, the number of iterations was set to 5.

MI can be used in cases where the data are missing completely at random, missing at random, and even when the data are missing not at random, see e.g. [17]. Thus, this appears as a reliable solution for the problem at hand. The frequentist strategy is as follows:

  1. Via MI generate complete data sets of polling stations. To perform MI we use the mice library of R see [17] and [18]. As mentioned before the pmm algorithm was employed to generate the imputed datasets, where only the major political parties and the nominal list were used as predictor variables. These predictor variables were used to impute all the variables with missing values.

  2. Run the Bootstrap strategy described in Section 3.2 setting to obtain estimates for the COD with each complete dataset. Here parallel processing was used to reduce the computational time, see the libraries foreach and doParallel of R, see [11] and [2].

  3. Consolidate these estimates for the conformation of the COD. This was done following the pooling formulas 3.1.2 to 3.2.10 in [14].

4.3 Bayesian strategy via dynamic post-stratification

When estimating totals or simple percentages at the population level under a stratified sampling design with no information available in all the strata, it is customary to follow a post-stratification approach and obtain estimates via this alternative. However, if the original strata are also study domains we still have to make inference for them. To solve this problem, an imputation step based on a dynamic post-stratification is used for the missing strata, and inference is made using the complete sample Bayesian method described in Section 3.3. Because with incomplete samples coverage of interval estimates is a lot lower than the nominal credible level set, a further adjustment is made to the credible level according to the percentage of the sample received. The proposal relies on imputing the sufficient statistics, which according to the posterior distribution (1) for , are and . Additionally, define . The proposal is outlined as follows:

  1. Define a sequence of clusterings, starting with the trivial clustering , which contains all the strata in a single group, up to the sample design stratification

    where each stratum belongs to a different group. These clusterings are predefined using historic data. In particular, voting results of the 2018 federal election were used to characterize each stratum and define the post-stratifications: a hierarchical clustering technique with complete linkage along with the standardized Euclidean distance was used. To be used in the 2021 quick count, seven post-stratifications where pre-defined:

    for .

  2. For strata with complete or partial information, inference is made using the available data. For strata with no information, say , let the specific group of clustering that contains stratum . Determine , the largest such that has sample information available. Considering the poststratification group , averages of the sufficient statistics over the strata with information are obtained, and impute these on stratum with further assuming that the statistic is the result of observing a single polling station with maximum nominal list of 750 voters. In notation, the imputed statistics for stratum are

    where is the number of strata with sample information in , and set and for inference purposes.

  3. Run the algorithm outlined in Section 3.3.

  4. To match the empirical coverage with the desired credible level, in the presence of incomplete samples, interval estimates are obtained by adjusting the credible level as described in Table 2. These corrections were based on fitting an accelerated failure time model to the arrival time of data from the 2018 federal election and using the features and votes in the polling stations as explanatory variables. Later, a simulation study was implemented by creating incomplete samples according to the predicted arrival time and computing the coverage for different credible nominal levels. Therefore, as suggested by Table 2, if the percentage of the sample received is less than , estimates at a credible level are produced. The credible level reduces gradually until more than of the sample is reached. Thus producing estimates at a credible level, which is the target level set for the 2021 quick count.

Percentage
Credibility
Table 2: Credibility level adjustment according to percentage of sample received.

5 Sampling design for the 2021 quick count

Here the considerations taken to determine the total sample size, , used to estimate the COD for the 2021 quick count are described. A stratified sample by federal district represents a reasonable choice and the federal districts are also study domains.

5.1 Estimation errors

The stratified sampling design by federal district requires to determine a winner in each of the strata, therefore each stratum is equally important. Thus it was decided to set , for . In this case, only the overall sample size needs to be defined. This also helps to deal with the non-response, avoiding federal districts with very small sample sizes.

The inference problem in the quick count is to obtain an estimator of the true number of deputies , for each party . Then, the estimation error for each party is simply . To summarize the margin of error of our sample design we use two measures: the average and the maximum estimation errors of all parties. For each of them, we want to determine upper bounds and such that

Simulation techniques based on repeated sampling and using the classic and Bayesian estimation methods described above were used to approximate and for different sample sizes.

Table 3 displays estimates of and for various sample sizes. These were calculated using the voting results for the COD elections of 2012, 2015, and 2018. It is important to note that in each election there were different numbers of installed polling stations and also different numbers of political parties. In there were seven political parties, ten in , and nine in . Table 3 also shows that the average estimation errors change drastically from 2015 to 2018. Instead, the maximum is more stable across the different elections. Thus, considering the maximum it is clear that there is no big improvement in precision between setting or . However, it was essential to obtain estimates around the 22 hours of the 6 of June, 2021. Hence, with these considerations, it was decided to select a sample size of polling stations per stratum. This implies an overall sample size of polling stations.

() 2012 2015 2018
1,500 (5) 2.9 9 2.8 10 0.7 9
3,000 (10) 2.3 7 2.4 9 0.5 7
4,500 (15) 2.0 6 2.3 9 0.4 6
6,000 (20) 2.0 6 2.2 9 0.4 6
7,500 (25) 1.7 5 2.0 8 0.3 5
9,000 (30) 1.7 5 2.0 8 0.3 5
Table 3: Upper bounds for average and maximum estimation errors at 95% confidence level for different samples sizes. Reported numbers correspond to the COD elections of 2012, 2015 and 2018.

5.2 Sample augmentation

The quick count needs to produce interval estimates around the 22 hours of the election day. However, in Mexico there are six states with different time zones: Baja California (8 districts) and Sonora (7 districts) are two hours behind the center time; Chihuahua (9 districts), Baja California Sur (2 districts), Nayarit (3 districts) and Sinaloa (7 districts) are one hour behind. Thus, the sample size in the strata of the states two hour behind was increased in 10 polling stations, and in the strata of the states with one hour behind additional 5 polling stations were added. Also, historically the response in Guerrero (9 districts) has been very low, thus an additional 10 polling stations were added to each of its strata. With these considerations, the total sample size to estimate the conformation of the COD in the 2021 election was polling stations.

6 Election Day

This section describes the arrival of information and estimates for the 2021 quick count. The total sample size was of polling stations. However, the sample is gathered gradually. Thus, our proposals to estimate the conformation of the COD under incomplete samples were used several times during the evening and night of the 6 of June 2021. These estimates are used to build a time series, allowing us to assess the performance of each proposal.

6.1 Information arrival

On the 6 of June 2021, voting information of the first polling stations from the sample for the quick count was received at 18:30 hours: 3 polling stations of 3 different stratum. From then, every data update contained an average of 100 new polling stations more than the previous update. The peak of information arrival was attained between 19:30 and 20:30 hours. Approximately, 175 new polling stations were received on every update within this time interval. At this point, around 3,000 polling stations had been received overall, and observed that 250 stratum had at least one polling station. Then, the rhythm of information arrival decreased and the main concern was to receive data in each of the 300 strata, with at least two polling stations in each. Figure 1 shows summaries of the number of polling stations received on each update.

Figure 1: Arrival of information summaries (time series): number of new polling stations received on each update (left), cumulative number of polling stations (center) and number of strata with sample data received.

6.2 Estimations

Estimates of the conformation of the COD were obtained considering every 5 minutes update of information using both methods presented in Section 4. These are shown in Figure 2. Official final results have also been included as a solid thick line. Thus, it is straightforward to assess the performance of each strategy under an incomplete sample setting.

Figure 2: Bayesian (dashed lines) and frequentist (dashed-dotted lines) estimations for the conformation of the COD for each political force in the 2021 quick count. Official final results are shown as solid horizontal lines.

At 18:30 hours the first estimation was obtained using only three polling stations. It is important to mention that the frequentist method based on MI did not impute values for all the valid voting combinations of the coalitions nor the independent candidates. This is easy to understand because there was no information available to predict values for these situations. Thus, in these cases, zeros were assigned. Therefore the first estimation was completely non-informative. This is reflected in the narrow confidence intervals reported. The same pattern continues until 18:45 hours, were 37 polling stations were received and confidence intervals started to behave as expected, i.e. reflecting the uncertainty due to the missing information in wide intervals.

On the other hand, the Bayesian method reflected the uncertainty of the lack of information in wide intervals for the first data received, and gradually reduced the uncertainty by producing narrower intervals for the last updates of information.

In any case, both methods started to agree around 20:30 hours with complete agreement at 22:35 hours, when the final estimates were produced. Available data at this final time had 5,040 polling stations, 79.4% of the complete sample of a total of 6,340 polling stations, and with information in all the design strata. The average number of polling stations available per stratum was 17, while the minimum and maximum were 3 and 28 respectively.

7 Discussion

We have proposed Bayesian and frequentist strategies to produce interval estimates, under stratified sampling designs, when there is no guarantee of obtaining the complete sample or even information in all the strata. Under a complete data scenario, both inference approaches produce very similar interval estimates. The differences we appreciate in Figure 2 are due to the imputation criteria under a missing data scenario. The strategy used together with the frequentist approach imputes the votes at a polling station level, although the strategy proposed together with the bayesian approach imputes the sufficient statistic at a stratum level. As more data is available, both approaches coincide, therefore indicating we have solved the problem in a reasonably straightforward manner. Although, the search for better and more useful strategies is needed.

Considering the Mexican Electoral National Institute has adopted the quick count as a permanent tool for every federal and local electoral process, it is important to review some of the challenges that the quick count of future electoral processes will have to face.

The first challenge concerns the bias in the arrival of the information and the fact that partial and final estimations are always computed under an incomplete sample setting. Since the quick count handles an extremely narrow margin of error, even with a minor relative bias, the estimated intervals could fail to contain the exact value. Naturally, it is recognized that with a 95% confidence/credible interval, 5% of the possible samples will lead to intervals that do not contain the true value. However, in the presence of relative bias, the true coverage could be considerably lower than 95%.

The second challenge is to define a sample design that reduces the polling stations that every field people has to collect without sacrificing precision in the estimation. In practice, each field person has 4 polling stations assigned in average, regardless of whether the station is in the sample or not. So, a same person could have to report data from more than one polling station. There have been some ideas for a two-stage sampling design. The obstacle over here is the estimation of the variance. This is because the frequentist formula for this sampling design requires at least two polling stations for every person selected.

Other problems that have been discussed are: To perform a verification/validation of the quality of the information at arrival; how to address situations when the estimated intervals of two or more political forces overlap with each other; or which is the most efficient strategy to consolidate two or more interval estimates for the same party, the union presumably is not the best alternative, etcetera.

Acknowledgements

The authors are grateful to the Electoral Federal Registry of the Electoral National Institute for the ongoing support in organizing the quick count. In particular to Arturo González Morales, former director of Statistics.

References

  • [1] M. Anzarut, L. F. González, and M. T. Ortiz (2019) A heavy-tailed multilevel mixture model for the quick count in the mexican elections of 2018. In

    Selected Contributions on Statistics and Data Science in Latin America

    , I. Antoniano-Villalobos, R. H. Mena, M. Mendoza, L. Naranjo, and L. E. Nieto-Barajas (Eds.),
    pp. 1–13. Cited by: §1.2.
  • [2] M. Corporation and S. Weston (2020) DoParallel: foreach parallel adaptor for the ’parallel’ package. Note: R package version 1.0.16 External Links: Link Cited by: item 2.
  • [3] CPEUM (2021) Constitución políca de los estados unidos mexicanos. Cámara de Diputados. Cited by: §1.1, §2.
  • [4] B. Efron and R.J. Tibshirani (1993) An introduction to the bootstrap. Chapman & Hall/CRC Monographs on Statistics & Applied Probability, Taylor & Francis. Cited by: §3.2.
  • [5] B. Efron (1979) Bootstrap Methods: Another Look at the Jackknife. The Annals of Statistics 7 (1), pp. 1 – 26. Cited by: §1.2.
  • [6] G. Glasgow (2005) Stratified sampling types. In Encyclopedia of Social Measurement, K. Kempf-Leonard (Ed.), pp. 683–688. Cited by: §1.2.
  • [7] G. Kalton (2020) An introduction to survey sampling. , Sage Publications. Cited by: §3.2.
  • [8] LEGIPE (2017) Ley general de instituciones y procedimientos electorales. Instituto Nacional Electoral. Cited by: §1.1, §2.
  • [9] R.J.A. Little and D.B. Rubin (2019) Statistical analysis with missing data. Wiley Series in Probability and Statistics, Wiley. Cited by: §1.1, §1.1, §4.2.
  • [10] M. Mendoza and L. E. Nieto-Barajas (2016) Quick counts in the mexican presidential elections: a bayesian approach. Electoral Studies 43, pp. 124–132. Cited by: §3.3, §3.3, §3.3.
  • [11] Microsoft and S. Weston (2020) Foreach: provides foreach looping construct. Note: R package version 1.5.1 External Links: Link Cited by: item 2.
  • [12] G. Molenberghs, G. Fitzmaurice, M.G. Kenward, A. Tsiatis, and G. Verbeke (2014) Introduction and preliminaries. In Handbook of Missing Data Methodology, G. Molenberghs, G. Fitzmaurice, M.G. Kenward, A. Tsiatis, and G. Verbeke (Eds.), Chapman & Hall/CRC Handbooks of Modern Statistical Methods, pp. 3–22. Cited by: §1.1.
  • [13] J. S. Murray (2018) Multiple imputation: a review of practical and theoretical findings. Statistical Science 33 (2), pp. 142–159. Cited by: §1.2.
  • [14] D. B. Rubin (1987) Multiple Imputation for Nonresponse in Surveys. Wiley Series in Probability and Statistics, John Wiley & Sons, Inc.. Cited by: §1.2, item 3.
  • [15] R. R. Sitter (1992) A resampling procedure for complex survey data. Journal of the American Statistical Association 87 (419), pp. 755–765. Cited by: §1.2, §3.2, §3.2.
  • [16] R. R. Sitter (1992) Comparing three bootstrap methods for survey data. Canadian Journal of Statistics 20 (2), pp. 135–154. Cited by: §1.2, §3.2, §3.2.
  • [17] K. van Buuren (2011) MICE: Multivariate Imputation by Chained Equations. R Journal of Statistical Software 3 (45), pp. 1–6. Cited by: item 1, §4.2.
  • [18] S. van Buuren (2018) Flexible Imputation of Missing Data. 2nd edition, Chapman & Hall/CRC. Cited by: item 1, §4.2.
  • [19] Z. Wang, L. Peng, and J. K. Kim (2022) Bootstrap inference for the finite population mean under complex sampling designs. Journal of the Royal Statistical Society: Series B (Statistical Methodology) n/a (n/a), pp. . External Links: Document Cited by: §1.2.
  • [20] L. Wasserman (2013) All of statistics: a concise course in statistical inference. Springer Texts in Statistics, Springer New York. Cited by: §3.2.