Distributed formal concept analysis algorithms based on an iterative mapreduce framework

de Fréin, Ruairí and Xu, Biao and Robson, Eric and O'Foghlú, Mícheál (2012) Distributed formal concept analysis algorithms based on an iterative mapreduce framework. In: 10th International Conference on Formal Concept Analysis. Lecture Notes in Computer Science, 10 (10). Springer Verlag, Leuven , Belgium, pp. 292-308.

[img]
Preview
PDF
1210.2401v1.pdf

Download (285kB) | Preview
Official URL: http://link.springer.com/chapter/10.1007%2F978-3-6...

Abstract

While many existing formal concept analysis algorithms are efficient, they are typically unsuitable for distributed implementation. Taking the MapReduce (MR) framework as our inspiration we introduce a distributed approach for performing formal concept mining. Our method has its novelty in that we use a light-weight MapReduce runtime called Twister which is better suited to iterative algorithms than recent distributed approaches. First, we describe the theoretical foundations underpinning our distributed formal concept analysis approach. Second, we provide a representative exemplar of how a classic centralized algorithm can be implemented in a distributed fashion using our methodology: we modify Ganter’s classic algorithm by introducing a family of MR⋆ algorithms, namely MRGanter and MRGanter+ where the prefix denotes the algorithm’s lineage. To evaluate the factors that impact distributed algorithm performance, we compare our MR� algorithms with the state-of-the-art. Experiments conducted on real datasets demonstrate that MRGanter+ is efficient, scalable and an appealing algorithm for distributed problems.

Item Type: Book Section
Departments or Groups: Telecommunications Software and Systems Group
Divisions: School of Science > Department of Computing, Maths and Physics
Depositing User: Ruairi De Frein
Date Deposited: 02 Dec 2013 11:45
Last Modified: 22 Aug 2016 10:27
URI: http://repository.wit.ie/id/eprint/2744

Actions (login required)

View Item View Item