Preference Reasoning in Matching Procedures: Application to the Admission Post-Baccalaureat Platform

07/23/2017 ∙ by Youssef Hamadi, et al. ∙ 0

Because preferences naturally arise and play an important role in many real-life decisions, they are at the backbone of various fields. In particular preferences are increasingly used in almost all matching procedures-based applications. In this work we highlight the benefit of using AI insights on preferences in a large scale application, namely the French Admission Post-Baccalaureat Platform (APB). Each year APB allocates hundreds of thousands first year applicants to universities. This is done automatically by matching applicants preferences to university seats. In practice, APB can be unable to distinguish between applicants which leads to the introduction of random selection. This has created frustration in the French public since randomness, even used as a last mean does not fare well with the republican egalitarian principle. In this work, we provide a solution to this problem. We take advantage of recent AI Preferences Theory results to show how to enhance APB in order to improve expressiveness of applicants preferences and reduce their exposure to random decisions.

READ FULL TEXT VIEW PDF
POST COMMENT

Comments

There are no comments yet.

Authors

page 8

This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

1 Introduction

Preferences are everywhere in our daily lives. They occur as soon as we are faced with a choice problem, e.g., “which ice cream flavor would you prefer?”, “which investment funds would you choose?”, etc. Among multiple choices, it is often necessary to identify one or more choices that are more appealing than others. Preference is inherently a multidisciplinary topic which brings together artificial intelligence researchers, philosophers, psychologists, economists, operations researchers, etc. In particular, preferences are becoming of greater interest in many areas in artificial intelligence, such as non-monotonic reasoning, multi-agent systems, constraint satisfaction, decision making, social choice theory and decision-theoretic planning.

The last two decades have seen a widespread number of efforts dedicated to the problems of preferences in artificial intelligence ranging from their elicitation and representation to reasoning with/about preferences [1, 2, 3, 4, 5]. More recently, we have witnessed an increasing interest in exploiting AI advances on preferences in other disciplines e.g. databases [6, 7, 8]

and game theory

[9]. There are still many domains where preferences techniques are integrated in a very primitive and naive way. This is the case in the French Admission Post-Baccalauréat Platform (APB)111https://www.admission-postbac.fr/. And in this work, our goal is to highlight the benefits of using AI insights in that large scale application.

The Baccalauréat is an academic qualification which French students take at the end of high school. It was introduced by Napoleon Bonaparte in 1808. It is the main diploma required to pursue university studies. Since its inception, the number of laureates has dramatically increased, from 31 bacheliers in 1809 to 632,700 in 2016, which have to choose between more than 12,000 university studies [10, 11]. These numbers, combined to the limited capacity of most universities make assignment procedures challenging. To make things worst, the vast majority of French universities have to respect a non-selection principle which forbids the filtering of applicants based on their previous high school results, Baccalauréat options or motivation letters.

The adopted strategy exploits applicants expressed preferences to create institutions preferences. The idea is for an institution to prefer applicants who highly ranked it in their preferences list. This mechanism, along the collection of applicants preferences, and the execution of matching algorithms is implemented by the Admission Post-Baccalauréat Platform. In practice, APB can be unable to distinguish between applicants. This is the case when they rank-order a study at the same level. APB’s solution is to randomly order equivalent applicants in its preferences lists. Randomness, even used as a last mean does not fare well with the republican egalitarian principle, especially when it affects an institution like the bac. Once officially acknowledged by the education minister, it has created frustration for the students and their parents, and as a consequence the education ministry has fixed an objective of reducing the use of randomness in APB [12].

In this work, our aim is to tackle this problem and to provide concrete solutions to restrict the use of randomness in APB. We thoroughly analyse the APB platform and provide concrete improvements inspired by recent AI Preference Theory results. We show how and where APB can be fixed to implement our solutions and improve the performances of its allocation procedures. In particular, our work offers three benefits:

  1. allow more flexibility for applicants to express their preferences (aiming for a better embedding of preferences),

  2. allow applicants to delay their definite preferences,

  3. reduce exposure to random decisions in matching algorithms.

The presentation is organized as follows. In Section 2, we give necessary background. Section 3 fully describes the APB algorithms and processes along general information on its practical use and perception. In Section 4, we show how to extend APB to improve preferences expressiveness, allow applicants to delay their definite preferences and reduce exposure to random decision making. Before giving a general conclusion in Section 6, Section 5 presents the related work.

2 Preliminaries

2.1 Preferences Modeling

Preferences modeling is based on a finite set of objects, denoted by , to be compared or evaluated [13]. The basic ingredient in this framework is a binary relation, denoted by , over . The notation stands for “ is at least as preferred as ”. Thus is referred to as preference relation.

Given a preference relation and two objects , we distinguish between three relations over and :

  • is strictly preferred to , denoted by , when holds but does not. is called a strict preference relation.

  • is indifferent to , denoted by , when both and hold. is called an indifference relation.

  • is incomparable to , denoted by , when neither nor holds. is called an incomparability relation.

Let us now recall some basic properties concerning binary relations.

  • is reflexive if and only if , .

  • is irreflexive if and only if , does not hold.

  • is complete if and only if , we have or .

  • is transitive if and only if , if and then .

  • is symmetric if and only if , if then .

  • is antisymmetric if and only if , , we have .

  • is asymmetric if and only if , we have .

Given the properties of a preference relation , we distinguish between different types of preference structures. For the work presented here, we need to recall two structures:

  • A total preorder: this corresponds to a reflexive, complete and transitive preference relation . The associated incomparability relation is empty.
    When is antisymmetric, is the set of pairs and the preference structure is called a total order. Lastly, when is asymmetric, is empty and the preference structure is called a strict total order.

  • A partial preorder: this corresponds to a reflexive and transitive preference relation . The associated incomparability relation is not empty.
    When is antisymmetric, is composed of pairs only and the preference structure is called a partial order. Lastly, when is asymmetric, is empty and the preference structure is called a strict partial order.

A preference relation is cyclic if and only if its induced strict preference relation is cyclic, i.e., there exists a chain of objects such that . Otherwise is acyclic.

From now on, we suppose that is transitive. By abuse of language we sometimes say that is a total or partial (pre)order or (strict) total or partial (pre)order. When no confusion is possible, an order is equivalently denoted by or .

When the preference relation is a total preorder, the indifference relation induced by is an equivalence relation (reflexive, symmetric and transitive). The set of equivalence classes of given is totally ordered w.r.t. . Let be the set of equivalence classes induced by . Then,

(i) , ,

(ii) ,

(iii) , for ,

(iv) , .

is an ordered partition of given iff (, , with if and only if ).

Example 1

Let be a set of objects. Let be a total preorder over defined by , and . Then, the ordered partition of is with , and .

A total order can also be written as an ordered partition of where each equivalence class is composed of a single object.

Note that an ordered partition of associated with is acyclic. For example, the preference relation , , and cannot be written in terms of an ordered partition.

Let and be two preference relations. We say that extends if and only if , if then .

Example 2

(Example 1 continued)
Let , . Then , , extends .

2.2 Matching Algorithms

The Stable Marriage Problem (SMP) aims at finding a matching between women and men, using preferences lists (strict total orders) in which each person has expressed her preference over the members of the opposite gender. The matching must be stable which means that there is no married pair that would be individually better off than they are with the element to which they are currently matched.

This problem was first described by D. Gale and L. Shapley as a special case of the more general College Admission problem [14]. In this seminal work, it is shown that it is always possible to solve the SMP and make all marriages stable using an procedure presented in Algorithm 1.

Data: M list of men, W list of women
Result: set of engagements
begin
       Initialize all and to free
       Initialize to
       while  a free man who still has a woman to propose to do
             if  is free then
                  // and become engaged
                   add to
            else
                  // some pair already exists
                   if  prefers to  then
                         // and become engaged
                         remove from
                         becomes free
                         add to
                  else
                        // and remain engaged
                   end if
                  
             end if
            
       end while
      return
end
Algorithm 1 Gale and Shapley Stable Marriage

The algorithm runs a sequence of proposals, and at each point in the process, each person is either engaged or free. Assuming proposals from men to woman, each man may alternate between being engaged and being free. If a man is engaged more than one time, his successive partners are less and less desirable. Once a woman is engaged, she will never be free again. She remains engaged, possibly with different partners.

In each sequence, a free man can propose the woman at the top of his preference list. If is free, she becomes engaged. If her current partner is such that in her preference list, she remains engaged with him. Otherwise, she engages with , and is freed. The process stops when all men are engaged and returns a list of engagements. The solution is stable otherwise there are a non paired man and woman who prefer each other over their partners. If this was the case, would have proposed before his current partner, which gives a chance to to have engaged before rejecting him, and therefore there is a man that she prefers to him.

Remark that the algorithm is optimal for those who propose but not necessarily for those who choose, i.e., Algorithm 1 respects men preferences best.

Example 3 (Borrowed from [14])

Let , and be three men, and , and be three women. Table 1 gives men and women preferences.

(1,3) (2,2) (3,1)
(3,1) (1,3) (2,2)
(2,2) (3,1) (1,3)
Table 1: Example of Stable Marriage

For each pair in the table refers to the ranking of the woman by the man and given the ranking of the man by the women. For example prefers first, second and third, while prefers first, second and third.
Three stable marriages are possible: , and . In both men and women have their second choice. In men have their first choice while in women have their first choice. Algorithm 1 returns as it gives priority to men.

3 The Admission Post-Baccalauréat Platform

3.1 An Interactive Process

The post-Baccalauréat platform manages the interaction between applicants and institutions. It allows the collect of their preferences, and executes different allocation algorithms in an interactive multi stages process which run between January and July each year. The algorithms consider three classes of studies: selective, non selective with limited capacity, and unlimited capacity. The APB process is described in Figure 1. It follows three main steps:

Figure 1: The Admission Post-Baccalauréat Platform (APB). (source: Ministry of National Education, France)

Step 1: [Applicants’ preferences] Applicants express their preferences by means of a ranked list (strict total order) of wishes of studies, called preferences lists. Then the APB platform sends applicants academic records to selective studies (if any) for which they would have applied.

Step 2: [Institutions’ preferences] Three classes of studies are considered:

  • Selective studies: An institution with a selective study establishes a rank-ordered list (strict total order) of applicants according to its own criteria and based on applicants academic records.

  • Studies with limited capacity: These institutions create their preferences by using applicants preferences. They give priority to applicants preferring them first. This is the only legal way to distinguish between applicants in order to respect limited capacity constraints. The top-k applicants are accepted until capacity is reached. The algorithm used to create institutions’ preferences is described in Section 3.2.

  • Studies with unlimited capacity: All applications are accepted.

For each wish expressed in an applicant’s preferences list given in Step 1, we have four possible answers: (1) Accepted wish, (2) Application not yet accepted, (3) Wish not proposed because of a better ranked proposed wish, and (4) Rejected applicant.

Step 3: [Allocation proposals] Students are asked to accept (or not) proposed assignments (called proposals). APB makes proposals to applicants in three rounds. Only one proposal is offered to applicants in each round. APB takes into account:

  • Applicants preferences lists.

  • Preferences lists established by institutions with selective studies or studies with limited capacity.

  • and, from round 2, positions released by other applicants in previous rounds.

Four possible answers are offered to applicants:

  • Definitely Yes: The applicant definitely accepts the proposal. Therefore,

    • no other proposal will be made for the applicant in subsequent rounds,

    • if the applicant gives up this accepted proposal later in the process then she has to resign.

  • Yes but:

    The applicant accepts for the moment the proposal with the hope of getting a better proposal in subsequent rounds (i.e. she will be possibly offered a better ranked wish in subsequent rounds). Therefore, if in a subsequent round the applicant is offered a better ranked wish then the previous proposal is definitely deleted.

  • No but: The applicant refuses the proposal but maintains her applications for better ranked wishes. Therefore, the refused proposal is definitely deleted.

  • Resign: The applicant gives up (renounces) all her applications.

3.2 Use of Matching Algorithms in the APB platform

The Stable Marriage procedure presented in Section 2 is used to match applicants to institutions for both Selective and Non Selective Limited Capacity Studies. The APB’s implementation of this procedure is institution-proposing, i.e., it respects institutions preferences best222Julien Grenet, personal communication..

Selective Studies can enforce their own criterion to rank-order applicants. The SM procedure is then fed with the preferences of the institutions and preferences of the applicants.

On the other hand, institutions running Non Selective Limited Capacity Studies are not legally allowed to filter applicants based on their previous high school results, Baccalauréat options or motivation letters. Still, their limited capacity requires some selection process. This is done by using applicants preferences to create the preferences lists of institutions. More concretely, it starts by first giving priority to applicants of the study academy. These are applicants who take their Baccalauréat in the academy and/or live in the academy. These applicants are then rank-ordered according to their preferences expressed in Step 1. The higher ranked a study in an applicant’s preferences list, the better the applicant rank is for this particular study. Then applicants outside of the academy are considered. Before we formally describe the APB algorithm, we present two notions used in the algorithm namely absolute rank wish and relative rank wish. An absolute wish refers to the rank of the study in the applicant preferences list. As studies are grouped into families, a relative wish corresponds to the rank of a given study w.r.t. studies pertaining to the same family. An example is given below.

Example 4

Suppose we have the following preferences list of a given applicant:

Wish 1: Ecole Prépa Lycée 1 (CPGE)

Wish 2: Licence Physique (LMD)

Wish 3: Ecole Prépa Lycée 2 (CPGE)

Wish 4: Licence Maths (LMD)

Licence Maths is fourth in absolute ranking and second in relative (LMD) ranking.

We can remark that the distinction between absolute and relative ranking is a naive way to approximate incomparability between groups of objects. See Section 2.

Data: Institutions, list of institutions
Result: For each study belonging to some institution , s.Selected preferences list of applicants
begin
       for i Institutions do
             for s i.Studies do
                   for r 1 .. 24 do // relative ordering
                         for a 1 .. 24 do // absolute ordering
                               locals = s.t.
                               and
                               and
                               = randomSort(locals)
                              
                         end for
                        
                   end for
                  for r 1 .. 24 do // relative ordering
                         for a 1 .. 24 do // absolute ordering
                               nonLocals = s.t.
                               and
                               and
                               = randomSort(nonLocals)
                              
                         end for
                        
                   end for
                  
             end for
            
       end for
      
end
Algorithm 2 Create Institutions Preferences

Algorithm 2 presents this processing. It is based on the description given by the French ministry of education [15]. It exploits absolute and relative ranks to separate applicants and create for each study a totally ordered preferences list.

The method iterates over institutions and their studies, successively considering local and non local applicants. It creates sets locals (resp. nonLocals) of equivalents applicants, i.e., members of a set have ranked the considered study at the same relative and absolute ranks. Each set is transposed into a randList list data structure which randomly orders applicants. This local list is then appended to the study’s Selected list. This structure gives for each study a totally ordered list of selected applicants.

3.3 Practical Usage and Perception

In 2015, 788,000 applicants used the APB platform333A 5% increase against the previous year. to select among more than 12,000 studies. Among them, 38% put a non selective limited capacity study as their first wish. Overall, in the first admission stage, 60% obtained their first wish, 14% their second, and 8% their third. On average, applicants put 6.6 wishes in their preferences list. That year, random choices were used to meet capacity constraints on the first wish for 190 studies [12].

While the selection principle used in selective institutions is commonly agreed on (it is based on applicants high school results), studies with limited capacity have engendered doubts, incomprehension and even polemics. This is because on the one hand such studies can not legally select applicants on the basis of their results or motivation letters but on the other hand, due to the limited capacity constraint, they need to rank-order applicants in order to fulfil this constraint [16]. The ministry has responded to specify that priority is given to applicants of the academy and to ensure that applicants preferences are then used in order to have a first ranking. As described in Section 3.2, when this is not enough to meet the capacity constraint, the algorithm uses random choices between equivalent candidates.

Reacting to the pressure of parents, student associations and their lawyers, the ministry has recently released the portion of the source code concerning studies with limited capacity [17, 18]. In the light of this code it appears that all is not described in the algorithm given above and officially specified in [15]. For example applicants who passed their Baccalauréat abroad are processed first, which gives them absolute priority over all other applicants. This fact was never documented or presented by the ministry before.

As we have previously stressed, rank-ordering applicants in studies with limited capacity is troubling for applicants. In the light of comments posted on the net, the use of randomness and the fact that such studies consider applicants preferences to provide their rank-ordering generate frustration and incomprehension:

  • “If I am told that my future is based on chance, I would be surprised.”

  • “Should I first put the study that I really like, or the one where I have better chance of entering?”

  • “Do I have a chance of getting a place in a selective study, or in this study with limited capacity located in another academy than that where I pass my bac?”

  • “What is the weight of my wish number 1 if it concerns studies with limited capacity?”

  • “I do not understand why only the best wishes are offered to the candidates. Why is it not possible to be offered all top-k (e.g. top-3) wishes?”

4 Preference Reasoning in Matching Procedures: Application to the Admission Post-Baccalauréat Platform

In APB applicants must provide a rank-order (preferences list) over (maximally) 24 studies. This rank-order is a strict total order. This has the unfortunate consequence to force applicants distinguish between all rank-ordered studies which might not be faithful to real applicants’ preferences.

In the following we show how a forced linearizing of preferences and random decisions can lead to sub optimal allocation of applicants to institutions. At contrary, we show how the introduction of partial preorders:

  1. gives applicants more expressiveness in their wishes,

  2. allow applicants to delay their definite preferences, and

  3. reduce exposure to random decisions in matching algorithms.

4.1 The Benefits of Partial Ordering

From the analysis of the APB source code for non selective limited capacity studies, it appears that the algorithm is successively executed for each study to produce a ranked list of candidates. Those ranked lists are then used to define institutions/studies’ preferences in the Gale and Shapley algorithm.

Example 5

Suppose we have two studies, and with limited capacity equal to 1, and a third study with unlimited capacity. All these studies are located in the same academy . Suppose we have two candidates and in the academy A having the following true preferences lists:

  • ,

APB forces the use of strict total orders, and let us assume that as a consequence, decides for . From now on, the two candidates become indistinguishable for the algorithms. They have the same preferences and live in the same academy. We show below how this leads to sub optimal decisions.

Limited capacity studies and have and as candidates. They apply the algorithm given in Section 3.2, and randomly order candidates. Let us assume that preferences list is , and that ’s list is .

The Stable Marriage algorithm (see Algorithm 1) will propose its first choice to each institution, resulting in selecting and selecting . This means that has her second wish and her first one.

Now let us assume that partial orders are introduced in APB. This allows to use her true preferences, , .

  1. While creating the preferences list for , we can now distinguish between and , indeed, the second candidate has two top-level wishes while the first candidate has only one. In this case it is reasonable for to give priority to .

  2. While creating preferences for , is preferred to .

With these new preferences lists, the Stable Marriage procedure can now allocate applicants to institutions: to , and to . This time the solution gives her first wish to each applicant, and randomness does not impact the selection process.

We can now introduce a third candidate from the same academy A. We have:

  • ,

This time the rational is for to give priority to , and as a consequence, allocate to . Again, this is done without using randomness.

In this example, we have seen that partial orders allowed to more finely distinguish between applicants, and as a consequence, saved the process from random decisions. Partial preorders allow to have ties in applicants preferences which offers more flexibility and allows a better assignment of applicants.

However, we have also seen that by using a tie in her preferences, is paying the price of being considered after applicants able to express more specific choices. This priority is coherent with AI principles in preferences handling which give priority to more specific preferences [19, 20, 21]. Moreover this priority is intuitively meaningful. In fact indifference/incomparability reflects weak preference. Therefore the less an applicant expresses indifference/incomparability, the more specific her preferences are; thus she deserves to get precedence over less specific applicants.

Now since the relaxed preferences expressed by an applicant helped the system to minimize the impact of random decisions, we need to give the latter a concrete personal benefit. We propose, when possible, to provide those applicants with the multiple allocation choices in their relaxed constraints. Going back to the previous example, and this time assuming institutions with capacity set to 2. , would be proposed to choose between a seat in or in . This introduces the possibility of a delayed-choice in the APB process. As presented before, initial preferences are expressed in January, and allocations proposed in June-July (see Section 3.1). One can assume that those months could authorize the applicant to refine her thinking and hopefully be able to finally decide between several allocations.

4.2 Dealing with Partially Ordered Students’ Preferences

We have stressed in the previous section the advantage of offering more flexibility for applicants in expressing their preferences. In particular we do aim at allowing applicants to express their preferences in the form of partial preorders, namely applicants are allowed to express that some studies are equally desired. The example provided in the previous sub-Section suggests that when a study is considering applicants, knowing that some of these applicants have other equally preferred studies allows to more finely distinguish applicants, and as a consequence minimize the impact of randomness.

More generally, at each step of the algorithm we rank-order the list of applicants who rank-ordered the study at hand , where and respectively stand for ‘relative rank ” and “absolute rank ”, according to the number of studies that they have rank-ordered . The smaller is the number, the better rank-ordered the applicant is. Lastly, randomness is used as an extreme mean to break ties on applicants having the same number of -rank-ordered studies. Returning to Example 5, precedence is given to over because the former has only one wish, namely which is rank-ordered while the latter has two studies, namely and that are rank-ordered .

Technically speaking, given applicant’s preferences in the form of a partial preorder we need to know the rank of each study w.r.t. that partial preorder. In Example 5, and needed to know which studies are rank-ordered first by and . These studies are and respectively.

The idea behind this reasoning is to linearize the partial preorder in order to rank-order equivalence classes. Consider again Example 5 and applicant . We have that and are rank-ordered first (meant to have an equal preference for ) and second. This rank-order is a total preorder, , which extends the initial partial order provided by .

4.2.1 Optimistic vs Pessimistic Reasoning

We may have multiple total preorders extending a partial preorder. The better is to deal with only one such a total preorder in order to guarantee a robust treatment of applicants’ preferences [20]. For this purpose we will use insights from non-monotonic reasoning [22] which are referred to as optimistic reasoning and pessimistic reasoning [4]. More precisely we distinguish between the following two ways of constructing a total preorder which extends a partial preorder. Let the total preorder extending a partial preorder over a set of objects .

  1. Optimistic reasoning:
    Put in objects in which are not strictly less preferred to any other object in w.r.t. . Remove elements of from . Repeat this process until is empty. Then, .

  2. Pessimistic reasoning:
    Put in objects in which are not strictly preferred to any other object in w.r.t. . Remove elements of from . Repeat this process until is empty. Then, .

Example 6

Let be a set of objects. Let , .
Following optimistic reasoning we have .
Following pessimistic reasoning we have .

It has been shown that the total preorder is unique following both reasoning lines [19, 20, 21].

Optimistic reasoning is gravitation toward the best, namely each object in is put in the highest possible rank in . On the other hand, pessimistic reasoning is gravitation toward the worst, namely each object is put in the lowest possible rank in . Roughly, objects are rank-ordered following optimistic reasoning w.r.t. the number of objects to which they are less preferred. In our example and are each less preferred to none object, and are each less preferred to one object while is less preferred to 2 objects. Following pessimistic reasoning objects are rank-ordered w.r.t. the number of objects which they are preferred to. In our example is preferred to 2 objects, and are each preferred to one object, and and are each preferred to none object.

In AI preference reasoning optimistic reasoning is applied to negative preferences (called also rejections or constraints) [23]. The principle underlying such preferences is “what is not excluded is desired”. Pessimistic reasoning is applied to positive preferences which obey the principle “desired only what is explicitly desired” [24, 23].

4.2.2 Indifference vs Incomparability

Now that we have stated the benefit of allowing flexible expressions of preferences in terms of partial preorders. It seems important to stress the distinction between indifference and incomparability. In fact the distinction between the two notions is not always understood. It is worth noticing that indifference is an “information” that expresses equal preference between objects. On the other hand, incomparability is “lack of information”. Therefore expressing indifference is more constraining than expressing incomparability. The two notions generally induce different results.

Example 7

(Example 6 continued)
In the previous example and were incomparable. Suppose now that they are equally preferred w.r.t. . Therefore we have , . Following optimistic reasoning we have . Following pessimistic reasoning we have .

4.2.3 Optimistic or Pessimistic Reasoning for APB?

In an allocation system we aim at satisfying applicants’ preferences as best as possible. Therefore we first try to allocate an applicant to her top preferred studies w.r.t. her preferences list. If this is not possible then we look at immediately less preferred studies, and so on. In Example 6 if , , , and were studies then the allocation system should first try to allocate or to the applicant. If none is possible then and should be considered. This reasoning line is nothing but optimistic reasoning. Therefore in the rest of this presentation we consider optimistic reasoning to deal with partially ordered applicants’ preferences. Algorithm 3 provides a formal computation of sketched in item 1 above (sub-Section 4.2.1).

Data: A set of objects , a partial preorder over .
Result: A total preorder over .
begin
      
      
      
       while  do
            
             for each  do
                   if  and  then remove from ;
                  
             end for
            if  then Stop (inconsistent preference statements);
             from remove if
             from remove if
             from remove elements of
       end while
      return
end
Algorithm 3 Computing a total preorder extending a partial preorder following optimistic reasoning

One may wonder whether expressing a partial preorder would not give advantage to applicants. For example let us just suppose that an applicant rank-orders all studies first, assuming that she will have a better chance to get her preferred study. This will possibly be the case if the applicant has revealed her true preferences by equally rank-ordering these studies. If this is not the case then she may be allocated to a study that she does not really prefer. This is because, at a given stage, priority will be given to applicants who have less choices, i.e. applicants who expressed more specific preferences (i.e. expressed less equally preferred studies). Back to Example 5 has precedence over because she has only one preferred study, namely , while has two preferred studies, namely and . An optimal allocation system would allocate to and to . Therefore both and get their preferred choice. Now if has not expressed her true preferences and, in reality, prefers , she will be disadvantaged by expressing more equally preferred studies than necessary.

4.3 Revised APB Algorithms

We have seen that allowing preorders in applicants preferences helps to distinguish between them. For non selective limited capacity institutions this is crucial since APB relies on random decisions to separate equivalent applicants (see sub-Section 3.2). Selective institutions are not impacted by random decisions. Nevertheless they would definitely benefit from the flexibility offered by partial preorders to express their preferences.

A total order is required by APB’s stable marriage procedure444Remark that in many practical applications, a person may not wish (or be able) to choose between alternatives. As a consequence, the Stable Marriage procedure presented in Section 1 has been extended to deal with these cases [25]. which must be able to gradually exploit preferences lists to converge to a stable solution. Since in general, applicants or institutions can produce disconnected partial orders as their preferences lists, we have presented a general method to compute a total preorder from partial preorders. Considering the intent of preferences expression in APB, we came to the conclusion that optimistic reasoning should be preferred to pessimistic reasoning while computing total preorders.

In the following we show how the use of total preorders as preferences lists impacts the APB algorithm used to automatically create institutions/studies preferences.

Data: Institutions, list of institutions
Result: For each study belonging to some institution , s.Selected preferences list of applicants
begin
       for i Institutions do
             for s i.Studies do
                   for r 1 .. 24 do // relative ordering
                         for a 1 .. 24 do // absolute ordering
                               for d 1 .. maxDisj do // disjunction size
                                     locals = s.t.
                                     and
                                     and and // s referenced in disjunction of size d
                                     = randomSort(locals)
                                    
                               end for
                              
                         end for
                        
                   end for
                  for r 1 .. 24 do // relative ordering
                         for a 1 .. 24 do // absolute ordering
                               for d 1 .. maxDisj do // disjunction size
                                     nonLocals = s.t.
                                     and
                                     and and // s referenced in disjunction of size d
                                     = randomSort(nonLocals)
                                    
                               end for
                              
                         end for
                        
                   end for
                  
             end for
            
       end for
      
end
Algorithm 4 Create Institutions Preferences Using Indifference

We need to generalize to total preorders the APB method which creates institutions/studies preferences list according to applicants preferences. We want to exploit the knowledge that at a given rank, if applicants and prefer a study but has also indicated, at the same level, indifference with a study , will give priority to .

Algorithm 4 generalizes the previous idea to increasing degrees of indifference. It outputs for each study a total order on applicants. The constant maxDisj reflects some limit on the size of a disjunction. Applicants are considered starting with the ones who gave more specific preferences (no or small disjunction) first.

We focused in the previous sections on partial preorders which are the most general form of preferences. Whatever students preferences list being partial or total preorders, when considering these preferences to construct institutions/studies preferences list over students the problem turns out to linearize students preferences lists in the case they are in the form of partial preorders.

5 Related Work

The Stable Marriage problem is based on a very general notion of stability which corresponds to allocations where no individuals can discern any gain from further trade. It became central in cooperative game theory and found applications in a variety of important real-life scenarios [26, 27]. As a recognition of this large impact, the 2012 Nobel Prize in Economics was awarded to Lloyd S. Shapley and Alvin E. Roth for the theory of stable allocations and the practice of market design [28].

In the domain of education, a large number of U.S. metropolitan areas use some variant of the Gale-Shapley algorithm for high school admission. It all started in 2004, when the New York department of education introduced an applicant-proposing version of the Gale and Shapley algorithm for high school admission. In these systems, total orders are used to express preferences [29]. Remark that they do not use randomness since institutions are legally entailed to perform selection.

In Artificial Intelligence, several researchers considered the stable marriage problem. In [30], the authors introduce a local search approach which exploits properties of the problems to reduce the size of a state neighborhood. In [31], male optimality and uniqueness of stable marriages for partially ordered preferences are studied.

In the domain of Constraint Programming, [32] explores stability in different problems variations including cases where men/women can rank members of their own genders, etc. A constraint encoding of the SM problem with ties and incomplete lists is presented and empirically evaluated in [33].

In the related field of Satisfiability, parallel solvers can solve, at scale, formulae encoding these NP-complete problems, [34], [35], [36].

6 Summary and Conclusion

The Admission Post-Baccalauréat Platform (APB) is used every year to allocate hundreds of thousands first year students to more than twelve thousands university degrees. This is done automatically by matching applicants preferences to university seats. In practice, APB can be unable to distinguish between applicants through their expressed preferences, and as a consequence it can introduce randomness in the matching process. This has created frustration and incomprehension in the public since randomness, even applied as a last mean, is hard to accept in a system used to decide about someone’s career. In this work, we have provided a first solution to this problem. We have shown how partial preorders can be introduced to improve applicants expressiveness and consequently reduce exposure to random ordering. Moreover allowing partial preorders permit applicants to postpone their definite preferences. In fact it may be the case that an applicant hesitates between two or more studies in January – when asked to express her preferences – but that her preferences become more precise in June-July – when she has to state her final choice.

Since in general, applicants or institutions can produce disconnected partial preorders as their preference lists, we have presented a general method to compute a total preorder from partial preorders. Considering the intent of preferences expression in APB, we came to the conclusion that optimistic preferences reasoning should be favored to pessimistic reasoning while computing total preorders.

Our solution has been thoroughly described using examples, theoretical analysis, and new preferences processing algorithms. This was done to allow a quick reuse in some future version of the APB platform. Remarkably, our work solves both minister and applicants concerns. The former has officially acknowledged as an objective the reduction of random choices [12], and the latter have often raised their voices in public forums to criticize APB’s restricted expressiveness and systematic use of randomness.

Although we focused on the APB application our proposal to use partial preorders instead of total orders may be of interest in any preferences-based matching procedures.

The initial ingredient in the APB platform is applicants’ preferences which are total orders over (maximally) 24 studies. In this paper we extended applicants’ preferences to deal with partial preorders thus permitting more flexibility. Nevertheless it is well established that humans are generally cognitively unable to provide such (pre)orders because of the cognitive effort required [37]. Moreover humans generally do not have prior preferences but construct them on the fly [37]. AI researchers have addressed this problem. In particular instead of asking humans to provide an explicit (pre)order over a set of objects, they consider partial and compact humans preferences. Completion principles are then used to compute the associated pre(order) [38, 39, 40, 4]. In a future work we intend to extend the APB platform with elicitation of applicants compact preferences as initial input.

In our societies, more and more decisions are going to be based on the output of automated decision processes. APB is a striking example of these systems whose lack of transparency has been heavily criticized. This has been exacerbated since it touches one of the last symbol of the French republican egalitarian principle: the universal access to university for bacheliers. As a consequence, the pressure put by parents, students, associations and their lawyers has forced the minister to gradually open the black-box and give information on the underlying APB algorithms. As AI researchers, we felt obliged to consider this problem and to provide new algorithms which would improve the APB platform. We hope that more AI researchers will consider the analysis of similar systems whose decisions have direct societal impact.

References