DUP: A Distributed Stream Processing Language

Submitted by Christian Grothoff on Sun, 05/16/2010 - 00:33

Title	DUP: A Distributed Stream Processing Language
Publication Type	Conference Paper
Year of Publication	2010
Authors	Grothoff, C, Grothoff K, Rutherford MJ, Bader K C, Meier H, Ritzdorf C, Eissler T, Evans N, GauthierDickey C
Conference Name	IFIP International Conference on Network and Parallel Computing
Publisher	Springer Verlag
Conference Location	Zhengzhou, China
Keywords	dup, primer, search, ARB, bioinformatics, DUP assembly, DUP runtime
Abstract	This paper introduces the DUP System, a simple framework for parallel stream processing. The DUP System enables developers to compose applications from stages written in almost any programming language and to run distributed streaming applications across all POSIX-compatible platforms. Parallel applications written with the DUP System do not suffer from many of the problems that exist in traditional parallel languages. The DUP System includes a range of simple stages that serve as general-purpose building blocks for larger applications. This work describes the DUP assembly language, the DUP architecture and some of the stages included in the DUP run-time library. We then present our experiences with parallelizing and distributing the ARB Project, a package of tools for RNA/DNA sequence database handling and analysis.
Export	Tagged XML BibTex

Attachment	Size
draft.pdf	286.25 KB

The DUP System