The ETLMR MapReduce-Based ETL Framework

Xiufeng Liu; Christian Thomsen; Torben  Bach Pedersen

The ETLMR MapReduce-Based ETL Framework

Xiufeng Liu
, Christian Thomsen
, Torben Bach Pedersen

Aalborg University

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Abstract

This paper presents ETLMR, a parallel Extract–Transform– Load (ETL) programming framework based on MapReduce. It has builtin support for high-level ETL-specific constructs including star schemas, snowflake schemas, and slowly changing dimensions (SCDs). ETLMR gives both high programming productivity and high ETL scalability.

Original language	English
Title of host publication	Scientific and Statistical Database Management. Proceedings
Editors	Judith Bayard Cushing, James French, Shawn Bowers
Publisher	Springer
Publication date	2011
Pages	586–588
ISBN (Print)	978-3-642-22350-1
ISBN (Electronic)	978-3-642-22351-8
Publication status	Published - 2011
Externally published	Yes
Event	23rd International Conference on Scientific and Statistical Database Management - Portland, United States Duration: 20 Jul 2011 → 22 Jul 2011 Conference number: 23

Conference

Conference	23rd International Conference on Scientific and Statistical Database Management
Number	23
Country/Territory	United States
City	Portland
Period	20/07/2011 → 22/07/2011

Series	Lecture Notes in Computer Science
Volume	6809
ISSN	0302-9743

OpenUrl availability

Full text

Cite this

@inproceedings{d22b2530c1cb46afabb9fdd0eef96ac2,

title = "The ETLMR MapReduce-Based ETL Framework",

abstract = "This paper presents ETLMR, a parallel Extract–Transform– Load (ETL) programming framework based on MapReduce. It has builtin support for high-level ETL-specific constructs including star schemas, snowflake schemas, and slowly changing dimensions (SCDs). ETLMR gives both high programming productivity and high ETL scalability.",

author = "Xiufeng Liu and Christian Thomsen and \{Bach Pedersen\}, Torben",

year = "2011",

language = "English",

isbn = "978-3-642-22350-1",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "586–588",

editor = "\{Bayard Cushing\}, \{Judith \} and French, \{James \} and Bowers, \{Shawn \}",

booktitle = "Scientific and Statistical Database Management. Proceedings",

note = "23rd International Conference on Scientific and Statistical Database Management, SSDBM 2011 ; Conference date: 20-07-2011 Through 22-07-2011",

}

Liu, X, Thomsen, C & Bach Pedersen, T 2011, The ETLMR MapReduce-Based ETL Framework. in J Bayard Cushing, J French & S Bowers (eds), Scientific and Statistical Database Management. Proceedings. Springer, Lecture Notes in Computer Science, vol. 6809, pp. 586–588, 23rd International Conference on Scientific and Statistical Database Management, Portland, Oregon, United States, 20/07/2011.

The ETLMR MapReduce-Based ETL Framework. / Liu, Xiufeng; Thomsen, Christian; Bach Pedersen, Torben .
Scientific and Statistical Database Management. Proceedings. ed. / Judith Bayard Cushing; James French; Shawn Bowers. Springer, 2011. p. 586–588 (Lecture Notes in Computer Science, Vol. 6809).

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

TY - GEN

T1 - The ETLMR MapReduce-Based ETL Framework

AU - Liu, Xiufeng

AU - Thomsen, Christian

AU - Bach Pedersen, Torben

N1 - Conference code: 23

PY - 2011

Y1 - 2011

N2 - This paper presents ETLMR, a parallel Extract–Transform– Load (ETL) programming framework based on MapReduce. It has builtin support for high-level ETL-specific constructs including star schemas, snowflake schemas, and slowly changing dimensions (SCDs). ETLMR gives both high programming productivity and high ETL scalability.

AB - This paper presents ETLMR, a parallel Extract–Transform– Load (ETL) programming framework based on MapReduce. It has builtin support for high-level ETL-specific constructs including star schemas, snowflake schemas, and slowly changing dimensions (SCDs). ETLMR gives both high programming productivity and high ETL scalability.

M3 - Article in proceedings

SN - 978-3-642-22350-1

T3 - Lecture Notes in Computer Science

SP - 586

EP - 588

BT - Scientific and Statistical Database Management. Proceedings

A2 - Bayard Cushing, Judith

A2 - French, James

A2 - Bowers, Shawn

PB - Springer

T2 - 23rd International Conference on Scientific and Statistical Database Management

Y2 - 20 July 2011 through 22 July 2011

ER -

The ETLMR MapReduce-Based ETL Framework

Abstract

Conference

OpenUrl availability

Fingerprint

Cite this