Difference between revisions of "HaBench"

From HaskellWiki
Jump to navigation Jump to search
(added "microbenchmarks" idea)
(added suggestions by JohnMeacam)
Line 10: Line 10:
   
 
* '''Andy Georges''' - ''Itkovian on #haskell@FreeNode'' (measurements/analysis/advice)
 
* '''Andy Georges''' - ''Itkovian on #haskell@FreeNode'' (measurements/analysis/advice)
  +
  +
* '''John Meacam''' - ''JohnMeacam on #haskell@FreeNode'' (advice/JHC support)
   
 
* <add '''your name''' here if you want to contribute!>
 
* <add '''your name''' here if you want to contribute!>
Line 15: Line 17:
 
== Ideas ==
 
== Ideas ==
   
* start from the (out-of-date?) nofib benchmark suite ([http://www.dcs.gla.ac.uk/fp/software/ghc/nofib.html website])
+
* start from the (out-of-date?) nofib benchmark suite (GHC-only, includes ghcisms) ([http://www.dcs.gla.ac.uk/fp/software/ghc/nofib.html website])
 
* include Computer Language Shootout submissions ([http://shootout.alioth.debian.org/gp4/benchmark.php?test=all&lang=ghc&lang2=ghc website])
 
* include Computer Language Shootout submissions ([http://shootout.alioth.debian.org/gp4/benchmark.php?test=all&lang=ghc&lang2=ghc website])
* microbenchmarks for comparison with C (for example bytecopying)
+
* microbenchmarks for comparison with C (for example bytecopying) (dons)
  +
* both a Haskell98 and Haskell'-only (sub)suite (JohnMeacam)
  +
* multiple Haskell compilers (GHC, JHC, ...)
 
* maintain benchmark according to Hackage ([http://hackage.haskell.org/packages/archive/pkg-list.html Hackage list])
 
* maintain benchmark according to Hackage ([http://hackage.haskell.org/packages/archive/pkg-list.html Hackage list])
 
 
  +
== Notes ==
  +
  +
Random notes are below.
  +
  +
* (''JohnMeacham'') <nowiki>Insert non-formatted text here pretty much every compiler has a mode similar to 'ghc --make',
  +
so just let the user specify an arbitrary command line for the compiler to use,
  +
like 'jhc -v -flint $< -o $@' or 'ghc --make $< -o $@'</nowiki>
   
 
== More info? ==
 
== More info? ==

Revision as of 10:26, 26 January 2007

HaBench: The Haskell Benchmark Suite

Recent discussions have illustrated the need for an up-to-date Haskell benchmark suite. The goal would be to package a number of representative benchmarks, written in Haskell, which users can run on their machine. Gathering (and publishing) performance numbers for these benchmarks on a number of different machines will hopefully help in guiding future development of both Haskell compilers and programs.

Contributors

* Kenneth Hoste - boegel on #haskell@FreeNode (ideas/advice/Wiki page maintainer)
* Donald Bruce Stewart - dons on #haskell@FreeNode (darcs repo maintainer (probably))
* Andy Georges - Itkovian on #haskell@FreeNode (measurements/analysis/advice)
* John Meacam - JohnMeacam on #haskell@FreeNode (advice/JHC support)
* <add your name here if you want to contribute!>

Ideas

* start from the (out-of-date?) nofib benchmark suite (GHC-only, includes ghcisms) (website)
* include Computer Language Shootout submissions (website)
* microbenchmarks for comparison with C (for example bytecopying) (dons)
* both a Haskell98 and Haskell'-only (sub)suite (JohnMeacam)
* multiple Haskell compilers (GHC, JHC, ...)
* maintain benchmark according to Hackage (Hackage list)

Notes

Random notes are below.

* (JohnMeacham) Insert non-formatted text here pretty much every compiler has a mode similar to 'ghc --make', 
 so just let the user specify an arbitrary command line for the compiler to use,
 like 'jhc -v -flint $< -o $@'  or 'ghc --make $< -o $@'

More info?

* #haskell IRC channel at Freenode
* initial thread @ Haskell mailing list
* follow-up thread @ Haskell-Cafe mailing list

Comments

Comments? Feel free to add them!