MapReduce with CloudHaskell

From HaskellWiki
Jump to navigation Jump to search


Introduction

This is documentation of my work on developing a proof-of-concept demonstrator for MapReduce using CloudHaskell to provide a framewok for distributed applications, and the monadic approach to MapReduce described here.

Status

Storage

I have developed a very simple distributed storage service that provides what is needed to ship data to each processing node at the start of each round of processing, and then to assemble their outputs ready to form the input for the next round.

Code to be placed on Hackage when more robust.

Distributed job scheduler

Not yet started.

julianporter 18:20, 31 October 2011 (UTC)