Difference between revisions of "FunctorApplicativeMonad Proposal"
Uchchwhash (talk  contribs) m (adding The Other Prelude reference) 
(→Futureproofing current code) 

(29 intermediate revisions by 9 users not shown)  
Line 1:  Line 1:  
−  The standard class hierarchy is a consequence of Haskell's historical development, rather than logic. The <hask>Functor</hask>, <hask>Applicative</hask>, and <hask>Monad</hask> type classes could be defined as: 

+  Haskell calls a couple of historical accidents its own. While some of them, such as the "number classes" hierarchy, can be justified by pragmatism or lack of a strictly better suggestion, there is one thing that stood out as, well, not that: Applicative not being a superclass of Monad. 

−  <haskell> 

+  The topic has been discussed multiple times in the past (cf. link section at the very end). '''This article describes the Haskell 2014 Applicative => Monad proposal (AMP)''', which was then implemented in GHC 7.10. 

−  class Functor f where 

−  map :: (a > b) > f a > f b 

−  class Functor f => Applicative f where 

+  Some relevant links: 

−  return :: a > f a 

+  * [https://github.com/quchen/articles/blob/master/applicative_monad.md Initial text of the Haskell 2014 AMP] 

−  (<*>) :: f (a > b) > f a > f b 

+  * [http://thread.gmane.org/gmane.comp.lang.haskell.libraries/19482 AMP mailing list discussion] 

−  (*>) :: f a > f b > f b 

+  * Phase one: ticket [http://hackage.haskell.org/trac/ghc/ticket/8004 #8004] 

−  (<*) :: f a > f b > f a 

−  class Applicative m => Monad m where 

−  (>>=) :: m a > (a > m b) > m b 

−  f >>= x = join $ map f x 

−  join :: m (m a) > m a 

−  join x = x >>= id 

−  class Monad m => MonadFail m where 

+  == Proposal contents == 

−  fail :: String > m a 

−  </haskell> 

−  This would eliminate the necessity of declaring a Monad instance for every Applicative, and eliminate the need for sets of duplicate functions such as [<hask>fmap</hask>, <hask>liftM</hask>, <hask>map</hask>, <hask>liftA</hask>], [<hask>(<*>)</hask>, <hask>ap</hask>], and [<hask>concat</hask>, <hask>join</hask>]. 

+  The list of changes is as follows: 

−  A monad which requires custom handling for pattern match failures can implement <hask>MonadFail</hask>; otherwise, a failed pattern match will error in the same way as is does for pure code. 

+  # Applicative becomes a superclass of Monad, and is added to the Prelude. 

+  # Alternative becomes a superclass of MonadPlus (in addition to Monad, of course). 

+  # <s><hask>join</hask> is promoted into the Monad typeclass.</s>  Left out due to [https://ghc.haskell.org/trac/ghc/wiki/Roles2#join nontrivial breaking interaction] with [[Roles]]. Will "probably be fixed in the future", but for now it's off the table. 

−  <hask>Pointed</hask> has not been included due to controversy as to whether it should be a subclass of Functor, a superclass of Functor, independent of Functor, or perhaps it is not sufficiently useful to include at all. 

+  The general rationale behind these changes: 

−  Backward compatibility could be eased with a legacy module, such as: 

+  # ''Break as little code as possible.'' For example, do not move <hask>return</hask> to Applicative and remove <hask>pure</hask>. Instead, leave <hask>return</hask> in Monad, and give it <hask>pure</hask> as default implementation. 

+  # ''Change only things that are closely related to the proposal.'' For example, using <hask>join</hask> in a monad definition requires it to be a functor, so it goes hand in hand with the AMP. On the other hand, removing <hask>fail</hask> has nothing to do with what we're trying to accomplish. 

−  <haskell> 

+  == Futureproofing current code == 

−  module Legacy where 

−  fmap :: Functor f => (a > b) > f a > f b 

+  GHC 7.8 will issue two types of warnings in order to encourage widescale code fixing. The following describes how to get rid of them, and as a result ensures your code builds both now and after the AMP is finished. For a more extensive and uptodate guide, see also the [https://ghc.haskell.org/trac/ghc/wiki/Migration/7.10#base4.8.0.0 GHC 7.10 migration guide]. 

−  fmap = map 

−  liftA :: Applicative f => (a > b) > f a > f b 

+  === Missing superclasses === 

−  liftA = map 

−  liftM :: Monad m => (a > b) > m a > m b 

+  (Warnings of the type "Warning: X is an instance of C, but not D") 

−  liftM = map 

−  ap :: Monad m => m (a > b) > m a > m b 

+  * Add Applicative/Functor instances for all your Monads. You can simply derive these instances from the Monad by adding the following code: 

−  ap = (<*>) 

+  <haskell> 

+  import Control.Applicative (Applicative(..)) 

+  import Control.Monad (liftM, ap) 

−  (>>) :: Monad m => m a > m b > m b 

+   Monad m 

−  (>>) = (*>) 

−  concat :: [[a]] > [a] 

+  instance Functor m where 

−  concat = join 

+  fmap = liftM 

−  etc. 

+  instance Applicative m where 

+  pure = { move the definition of `return` from the `Monad` instance here } 

+  (<*>) = ap 

+  
+  instance Monad m where 

+  return = pure  redundant since GHC 7.10 due to default impl 

</haskell> 
</haskell> 

−  And for those who really want a list map, 

+  Moreover, there are some subtle issues regarding the <code>(>>)</code> operator, see [https://ghc.haskell.org/trac/ghc/wiki/Migration/7.10#base4.8.0.0] for more details. 

+  * Add an Alternative instance for all instances of MonadPlus. This can again be done easily using 

<haskell> 
<haskell> 

−  listMap :: (a > b) > [a] > [b] 

+  import Control.Applicative (Alternative(..)) 

−  listMap = map 

+  import Control.Monad (mzero, mplus) 

+  
+   MonadPlus m 

+  
+  instance Alternative m where 

+  (<>) = mplus 

+  empty = mzero 

</haskell> 
</haskell> 

−  [[Context alias]] would also be a great help with backwards compatibility. 

+  === Future Prelude names === 

−  Another variant might be to split a <hask>Pointed</hask> class from the <hask>Applicative</hask> class. 

+  "The name X clashes with a future Prelude name"  Prelude will export functions called <hask><*></hask>, <hask>join</hask> and <hask>pure</hask>, so if a module defines its own versions of them, there will be name clashes. There are multiple ways of getting rid of this type of warning (in a futureproof way). 

+  # Change your code to not define functions named <hask><*></hask>, <hask>join</hask> or <hask>pure</hask>. 

+  # Import Prelude definitions you need explicitly. For example, <hask>import Prelude (map, (+))</hask> would not import <hask>join</hask>, so no warning is issued as the module is compatible with the Prelude exporting <hask>join</hask>. <hask>hiding</hask>. 

+  # Due to GHC internals, you cannot use <hask>hiding (join, (<*>), pure)</hask> to silence the warnings, although this method would be futureproof. If you want to use <hask>hiding</hask>, you will have to silence the warnings using a sledgehammer <code>fnowarnamp</code> compiler flag. (If you do so make sure you know what you're doing, otherwise your module ''will'' break in 7.10.) To make 7.10 not complain about the then unrecognized flag, it's best to specify it in a CPP block, 

<haskell> 
<haskell> 

−  class Pointed f where 

+  {# LANGUAGE CPP #} 

−  return :: a > f a 

+  #if __GLASGOW_HASKELL__ >= 707 && __GLASGOW_HASKELL__ < 710 

−  
+  {# OPTIONS_GHC fnowarnamp #} 

−  class (Functor f, Pointed f) => Applicative f where 

+  #endif 

−  (<*>) :: f (a > b) > f a > f b 

−  (*>) :: f a > f b > f b 

−  (<*) :: f a > f b > f a 

</haskell> 
</haskell> 

−  Such <hask>Pointed</hask> functionality by itself could be useful, for example, in a DSL in which it is only possible to embed values and not to lift functions to functions over those embedded values. 

+  == Discussion and consequences == 

+  
+  
+  === It's the right thing to do™ === 

+  
+  Math. You've all heard this one, it's good and compelling so I don't need to spell it out. 

+  
+  
+  === Redundant functions === 

+  
+  * <hask>pure</hask> and <hask>return</hask> do the same thing. 

+  * <hask>>></hask> and <hask>*></hask> are identical. 

+  * <hask>liftM</hask> and <hask>liftA</hask> are <hask>fmap</hask>. The <hask>liftM*</hask> are <hask>liftA*</hask>, <hask><*></hask> is <hask>ap</hask>. 

+  * Prelude's <hask>sequence</hask> requires <hask>Monad</hask> right now, while <hask>Applicative</hask> is sufficient to implement it. The more general version of this issue is captured by <hask>Data.Traversable</hask>, whose main typeclass implements the *same* functionality twice, namely <hask>traverse</hask> and <hask>mapM</hask>, and <hask>sequenceA</hask> and <hask>sequence</hask>. 

+  * The <hask>WrappedMonad</hask> type from <hask>Control.Applicative</hask> provides a semiautomatic way to using Functor/Applicative/Alternative functions for Monad/MonadPlus instances as a makeshift patch. 

+  
+  That very much violates the "don't repeat yourself" principle, and even more so it ''forces'' the programmer to repeat himself to achieve maximal generality. It may be too late to take all redundancies out, but at least we can prevent new ones from being created. 

+  
+  (Note that it is not proposed to remove any functions for compatibility reasons. Maybe some of them can be phased out in the long run, but that's beyond scope here.) 

+  
+  
+  === Using Functor/Applicative functions in monadic code === 

+  
+  Whenever there's Monad code, you can use Functor/Applicative functions, without introducing an additional constraint. Keep in mind that "Functor/Applicative functions" does not only include what their typeclasses define but many more, for example <hask>void</hask>, <hask>(<$>)</hask>, <hask>(<**>)</hask>. 

+  
+  Even if you think you have monadic code, strictly using the least restrictive functions may result in something that requires only Applicative. This is similar to writing a function that needs <hask>Int</hask>, but it turns out any <hask>Integral</hask> will do  more polymorphism for free. 

+  
+  
+  === Compatibility issues === 

+  
+  These are the kinds of issues to be expected: 

+  
+  # Monads lacking Functor or Applicative instances. This is easily fixable by either setting <hask>fmap = liftM</hask>, <hask>pure = return</hask> and <hask>(<*>) = ap</hask>, although more efficient implementations may exist, or by moving an already existing definition from <hask>Control.Applicative</hask> to the appropriate module. 

+  # This one is specific to building GHC: importing <hask>Control.Monad/Applicative</hask> introduces a circular module dependency. In this case, one can rely on handwritten implementations of the desired function, e.g. <hask>ap f x = f >>= ...</hask>. 

+  # Libraries using their own <hask>(<*>)</hask>. This one is potentially the most laborious consequence. For building GHC though, this only concerns Hoopl, and a handful of renames. 

+  
+  
+  
+  === Beginner friendliness === 

+  
+  How often did you say ... 

+  
+  * "A Monad is always an Applicative but due to historical reasons it's not but you can easily verify it by setting <hask>pure = return</hask> and <hask>(<*>) = ap</hask>" 

+  * "<hask>liftM</hask> is <hask>fmap</hask> but not really."  "So when should I use <hask>fmap</hask> and when <hask>liftM</hask>?"  ''sigh'' 

+  
+  With the new hierarchy, the answer would ''always'' be "use the least restrictive one". 

+  
+  == Applying the AMP to GHC and then Haskell in practice == 

+  
+  Proposed is a gradual introduction of the AMP in three phases: 

+  
+  
+  === Prepare GHC === 

+  
+  Using a GHC fork with the full patch applied, find and fix all compilation errors introduced by the change by adding Functor/Applicative instances for all Monads. 

+  
+  According to SPJ, adding an adhoc warning of sorts "Monad without Applicative detected" is not a problem, which will be crucial for the next phase. More specifically, issue a warning if: 

+  
+  * Monad without Applicative 

+  * MonadPlus without Alternative 

+  * One of <hask><*></hask>, <hask>pure</hask>, <hask>join</hask> is defined in a different context to avoid naming conflicts, as these functions will go into the Prelude 

+  
+  === Prepare Hackage === 

+  
+  The warning just mentioned will hint to all authors that they should fix (or help others fix) the noncomplying packages. This will ideally lead to libraries eventually adding Applicative instances, and changing their APIs if they redefine operators like <hask><*></hask>. 

+  
+  After enough time has passed by so libraries adapted to the circumstances, move on to the next phase. 

+  
+  
+  === Apply the proposal === 

+  
+  Once Hackage is prepared, applying the changes to the Base package is painless. However, this is not primarily a GHC, but a Haskell change. The previous steps were basically preparing the landscape, and when we've (hopefully) found out that it is a good idea to go through with it, it can be proposed to go into the Report. If we make it this far, the AMP should pass quite easily. 

+  
+  
+  == Previous proposals == 

−  == See also == 

+  * Early 2011: [http://hackage.haskell.org/trac/ghc/ticket/4834 GHC ticket] – changes similar to this proposal, but closed as "not GHC, but Haskell". See [http://thread.gmane.org/gmane.comp.lang.haskell.libraries/14883/focus=14905 here] for the associated discussion. 

−  * 
+  * [[The Other Prelude]] 
Latest revision as of 11:46, 24 October 2015
Haskell calls a couple of historical accidents its own. While some of them, such as the "number classes" hierarchy, can be justified by pragmatism or lack of a strictly better suggestion, there is one thing that stood out as, well, not that: Applicative not being a superclass of Monad.
The topic has been discussed multiple times in the past (cf. link section at the very end). This article describes the Haskell 2014 Applicative => Monad proposal (AMP), which was then implemented in GHC 7.10.
Some relevant links:
 Initial text of the Haskell 2014 AMP
 AMP mailing list discussion
 Phase one: ticket #8004
Contents
Proposal contents
The list of changes is as follows:
 Applicative becomes a superclass of Monad, and is added to the Prelude.
 Alternative becomes a superclass of MonadPlus (in addition to Monad, of course).

 Left out due to nontrivial breaking interaction with Roles. Will "probably be fixed in the future", but for now it's off the table.join
is promoted into the Monad typeclass.
The general rationale behind these changes:
 Break as little code as possible. For example, do not move
return
to Applicative and removepure
. Instead, leavereturn
in Monad, and give itpure
as default implementation.  Change only things that are closely related to the proposal. For example, using
join
in a monad definition requires it to be a functor, so it goes hand in hand with the AMP. On the other hand, removingfail
has nothing to do with what we're trying to accomplish.
Futureproofing current code
GHC 7.8 will issue two types of warnings in order to encourage widescale code fixing. The following describes how to get rid of them, and as a result ensures your code builds both now and after the AMP is finished. For a more extensive and uptodate guide, see also the GHC 7.10 migration guide.
Missing superclasses
(Warnings of the type "Warning: X is an instance of C, but not D")
 Add Applicative/Functor instances for all your Monads. You can simply derive these instances from the Monad by adding the following code:
import Control.Applicative (Applicative(..))
import Control.Monad (liftM, ap)
 Monad m
instance Functor m where
fmap = liftM
instance Applicative m where
pure = { move the definition of `return` from the `Monad` instance here }
(<*>) = ap
instance Monad m where
return = pure  redundant since GHC 7.10 due to default impl
Moreover, there are some subtle issues regarding the (>>)
operator, see [1] for more details.
 Add an Alternative instance for all instances of MonadPlus. This can again be done easily using
import Control.Applicative (Alternative(..))
import Control.Monad (mzero, mplus)
 MonadPlus m
instance Alternative m where
(<>) = mplus
empty = mzero
Future Prelude names
"The name X clashes with a future Prelude name"  Prelude will export functions called <*>
, join
and pure
, so if a module defines its own versions of them, there will be name clashes. There are multiple ways of getting rid of this type of warning (in a futureproof way).
 Change your code to not define functions named
<*>
,join
orpure
.  Import Prelude definitions you need explicitly. For example,
import Prelude (map, (+))
would not importjoin
, so no warning is issued as the module is compatible with the Prelude exportingjoin
.hiding
.  Due to GHC internals, you cannot use
hiding (join, (<*>), pure)
to silence the warnings, although this method would be futureproof. If you want to usehiding
, you will have to silence the warnings using a sledgehammerfnowarnamp
compiler flag. (If you do so make sure you know what you're doing, otherwise your module will break in 7.10.) To make 7.10 not complain about the then unrecognized flag, it's best to specify it in a CPP block,
{# LANGUAGE CPP #}
#if __GLASGOW_HASKELL__ >= 707 && __GLASGOW_HASKELL__ < 710
{# OPTIONS_GHC fnowarnamp #}
#endif
Discussion and consequences
It's the right thing to do™
Math. You've all heard this one, it's good and compelling so I don't need to spell it out.
Redundant functions

pure
andreturn
do the same thing. 
>>
and*>
are identical. 
liftM
andliftA
arefmap
. TheliftM*
areliftA*
,<*>
isap
.  Prelude's
sequence
requiresMonad
right now, whileApplicative
is sufficient to implement it. The more general version of this issue is captured byData.Traversable
, whose main typeclass implements the *same* functionality twice, namelytraverse
andmapM
, andsequenceA
andsequence
.  The
WrappedMonad
type fromControl.Applicative
provides a semiautomatic way to using Functor/Applicative/Alternative functions for Monad/MonadPlus instances as a makeshift patch.
That very much violates the "don't repeat yourself" principle, and even more so it forces the programmer to repeat himself to achieve maximal generality. It may be too late to take all redundancies out, but at least we can prevent new ones from being created.
(Note that it is not proposed to remove any functions for compatibility reasons. Maybe some of them can be phased out in the long run, but that's beyond scope here.)
Using Functor/Applicative functions in monadic code
Whenever there's Monad code, you can use Functor/Applicative functions, without introducing an additional constraint. Keep in mind that "Functor/Applicative functions" does not only include what their typeclasses define but many more, for example void
, (<$>)
, (<**>)
.
Even if you think you have monadic code, strictly using the least restrictive functions may result in something that requires only Applicative. This is similar to writing a function that needs Int
, but it turns out any Integral
will do  more polymorphism for free.
Compatibility issues
These are the kinds of issues to be expected:
 Monads lacking Functor or Applicative instances. This is easily fixable by either setting
fmap = liftM
,pure = return
and(<*>) = ap
, although more efficient implementations may exist, or by moving an already existing definition fromControl.Applicative
to the appropriate module.  This one is specific to building GHC: importing
Control.Monad/Applicative
introduces a circular module dependency. In this case, one can rely on handwritten implementations of the desired function, e.g.ap f x = f >>= ...
.  Libraries using their own
(<*>)
. This one is potentially the most laborious consequence. For building GHC though, this only concerns Hoopl, and a handful of renames.
Beginner friendliness
How often did you say ...
 "A Monad is always an Applicative but due to historical reasons it's not but you can easily verify it by setting
pure = return
and(<*>) = ap
"  "
liftM
isfmap
but not really."  "So when should I usefmap
and whenliftM
?"  sigh
With the new hierarchy, the answer would always be "use the least restrictive one".
Applying the AMP to GHC and then Haskell in practice
Proposed is a gradual introduction of the AMP in three phases:
Prepare GHC
Using a GHC fork with the full patch applied, find and fix all compilation errors introduced by the change by adding Functor/Applicative instances for all Monads.
According to SPJ, adding an adhoc warning of sorts "Monad without Applicative detected" is not a problem, which will be crucial for the next phase. More specifically, issue a warning if:
 Monad without Applicative
 MonadPlus without Alternative
 One of
<*>
,pure
,join
is defined in a different context to avoid naming conflicts, as these functions will go into the Prelude
Prepare Hackage
The warning just mentioned will hint to all authors that they should fix (or help others fix) the noncomplying packages. This will ideally lead to libraries eventually adding Applicative instances, and changing their APIs if they redefine operators like <*>
.
After enough time has passed by so libraries adapted to the circumstances, move on to the next phase.
Apply the proposal
Once Hackage is prepared, applying the changes to the Base package is painless. However, this is not primarily a GHC, but a Haskell change. The previous steps were basically preparing the landscape, and when we've (hopefully) found out that it is a good idea to go through with it, it can be proposed to go into the Report. If we make it this far, the AMP should pass quite easily.
Previous proposals
 Early 2011: GHC ticket – changes similar to this proposal, but closed as "not GHC, but Haskell". See here for the associated discussion.
 The Other Prelude