Difference between revisions of "HaBench"
Jump to navigation
Jump to search
NeilMitchell (talk | contribs) (→Ideas) |
(added suggestions by JohhMeacam and ndm) |
||
Line 1: | Line 1: | ||
− | = |
+ | = Haskell Benchmark Suite = |
Recent discussions have illustrated the need for an up-to-date Haskell benchmark suite. The goal would be to package a number of representative benchmarks, written in Haskell, which users can run on their machine. Gathering (and publishing) performance numbers for these benchmarks on a number of different machines will hopefully help in guiding future development of both Haskell compilers and programs. |
Recent discussions have illustrated the need for an up-to-date Haskell benchmark suite. The goal would be to package a number of representative benchmarks, written in Haskell, which users can run on their machine. Gathering (and publishing) performance numbers for these benchmarks on a number of different machines will hopefully help in guiding future development of both Haskell compilers and programs. |
||
Line 12: | Line 12: | ||
* '''Neil Mitchell''' - ''ndm on #haskell@FreeNode'' (suggestions/Yhc support/user) |
* '''Neil Mitchell''' - ''ndm on #haskell@FreeNode'' (suggestions/Yhc support/user) |
||
* <add '''your name''' here if you want to contribute!> |
* <add '''your name''' here if you want to contribute!> |
||
+ | |||
+ | == Naming == |
||
+ | |||
+ | * HaBench (intented to be '''the''' Haskell Benchmark Suite) |
||
+ | * nofib/nofib 2.0 (follow-up of well-known nofib) |
||
== Ideas == |
== Ideas == |
||
− | * start from the (out-of-date?) nofib benchmark suite (GHC-only, includes ghcisms) ([http://www.dcs.gla.ac.uk/fp/software/ghc/nofib.html website]) |
+ | * start from the (out-of-date?) nofib benchmark suite (GHC-only, includes ghcisms, but very usefull programs (gzip in pure Haskell, a whole strictness analysis pass of a compiler, quantum mechanics simulator and other _real_ stuff (JohnMeacam)) ([http://www.dcs.gla.ac.uk/fp/software/ghc/nofib.html website]) |
* include Computer Language Shootout submissions ([http://shootout.alioth.debian.org/gp4/benchmark.php?test=all&lang=ghc&lang2=ghc website]) |
* include Computer Language Shootout submissions ([http://shootout.alioth.debian.org/gp4/benchmark.php?test=all&lang=ghc&lang2=ghc website]) |
||
* microbenchmarks for comparison with C (for example bytecopying) (dons) |
* microbenchmarks for comparison with C (for example bytecopying) (dons) |
||
Line 21: | Line 26: | ||
* multiple Haskell compilers (GHC, JHC, ...) |
* multiple Haskell compilers (GHC, JHC, ...) |
||
* maintain benchmark according to Hackage ([http://hackage.haskell.org/packages/archive/pkg-list.html Hackage list]) |
* maintain benchmark according to Hackage ([http://hackage.haskell.org/packages/archive/pkg-list.html Hackage list]) |
||
− | * Rename this project as nofib, otherwise it is like that people will have to run both this ''and'' nofib, because people will ask for the nofib results as well |
+ | * Rename this project as nofib, otherwise it is like that people will have to run both this ''and'' nofib, because people will ask for the nofib results as well (ndm) |
* [http://haskell.org/haskellwiki/Libraries_and_tools Libraries and tools in Haskell] |
* [http://haskell.org/haskellwiki/Libraries_and_tools Libraries and tools in Haskell] |
||
Revision as of 12:30, 26 January 2007
Haskell Benchmark Suite
Recent discussions have illustrated the need for an up-to-date Haskell benchmark suite. The goal would be to package a number of representative benchmarks, written in Haskell, which users can run on their machine. Gathering (and publishing) performance numbers for these benchmarks on a number of different machines will hopefully help in guiding future development of both Haskell compilers and programs.
Contributors
- Kenneth Hoste - boegel on #haskell@FreeNode (ideas/advice/Wiki page maintainer)
- Donald Bruce Stewart - dons on #haskell@FreeNode (darcs repo maintainer (probably))
- Andy Georges - Itkovian on #haskell@FreeNode (measurements/analysis/advice)
- John Meacam - JohnMeacam on #haskell@FreeNode (advice/JHC support)
- Arthur van Leeuwen - earthy on #haskell@FreeNode (Computer Language Shootout man-on-the-insde)
- Neil Mitchell - ndm on #haskell@FreeNode (suggestions/Yhc support/user)
- <add your name here if you want to contribute!>
Naming
* HaBench (intented to be the Haskell Benchmark Suite) * nofib/nofib 2.0 (follow-up of well-known nofib)
Ideas
- start from the (out-of-date?) nofib benchmark suite (GHC-only, includes ghcisms, but very usefull programs (gzip in pure Haskell, a whole strictness analysis pass of a compiler, quantum mechanics simulator and other _real_ stuff (JohnMeacam)) (website)
- include Computer Language Shootout submissions (website)
- microbenchmarks for comparison with C (for example bytecopying) (dons)
- both a Haskell98 and Haskell'-only (sub)suite (JohnMeacam)
- multiple Haskell compilers (GHC, JHC, ...)
- maintain benchmark according to Hackage (Hackage list)
- Rename this project as nofib, otherwise it is like that people will have to run both this and nofib, because people will ask for the nofib results as well (ndm)
- Libraries and tools in Haskell
Notes
Random notes are below.
- (JohnMeacham) Insert non-formatted text here pretty much every compiler has a mode similar to 'ghc --make', so just let the user specify an arbitrary command line for the compiler to use, like 'jhc -v -flint $< -o $@' or 'ghc --make $< -o $@'
More info?
- #haskell IRC channel at Freenode
- initial thread @ Haskell mailing list
- follow-up thread @ Haskell-Cafe mailing list
Comments
Comments? Feel free to add them! Suggestions? Mail Kenneth at kenneth [dot] hoste [at] elis [dot] ugent [dot] be .