SCHEDULE: NOV 16-21, 2014

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

Leveraging Naturally Distributed Data Redundancy to Optimize Collective Replication

SESSION: Poster Reception

EVENT TYPE: Posters

TIME: 5:15PM - 7:00PM

AUTHOR(S):Bogdan Nicolae, Massimiliano Meneghin, Pierre Lemarinier

ROOM:New Orleans Theater Lobby

ABSTRACT:

Techniques such as replication are often used to enable
resilience and high availability. However, replication introduces
overhead both in terms of network traffic necessary to distribute
replicas, as well as extra storage space requirements. To this end,
redundancy elimination techniques such as compression or deduplication
are often used to reduce the overhead of communication and storage.
This paper aims to explore how these two phases can be optimized by
combining them into a single phase. Our key idea relies on the
observation that since data is related, there is a probability that
distributed redundancy is already naturally present, thus it may pay
off to try to identify this natural redundancy in order to avoid
reducing redundancy unnecessarily in the first phase only to add it
back later in the second phase. We present how this idea can be
leveraged in practice and demonstrate its viability for two real-life
HPC applications.

Chair/Author Details:

Bogdan Nicolae - IBM Corporation

Massimiliano Meneghin - IBM Corporation

Pierre Lemarinier - IBM Corporation

  Click here to download .ics calendar file

  Click here to download .vcs calendar file

  Click here to add event to your Google Calendar