Benchmarks — Detailed Results

In one of the above sections we have summarised the AR indices based on the datasets from the Benchmark Suite for Clustering Algorithms – Version 1 [G+20]. In this section we present more detailed results for some other partition similarity measures implemented in the genieclust package — Fowlkes–Mallows [FM83], adjusted Rand [HA85], adjusted and normalised mutual information [VEB10], normalised accuracy (purity) and pair sets index [RF16], see the API documentation of genieclust.compare_partitions for more details. In each case, score of 1.0 denotes perfect agreement between the clustering results and the reference partitions.

At the preprocessing stage, features with variance of 0 were removed. Every dataset has been centred at 0 and scaled so that is has total variance of 1. Then, a tiny bit of Gaussian noise has been added to each item. Clustering is performed with respect to the Euclidean distance (wherever applicable).

All raw results can be found here.

Small Datasets

ar

Summary statistics for ar (best=1.0):

count

mean

std

min

25%

50%

75%

max

Average linkage

73

0.5

0.38

0

0.11

0.5

0.92

1

Birch_0.01

73

0.54

0.35

0

0.19

0.54

0.9

1

Centroid linkage

73

0.48

0.38

0

0.08

0.46

0.92

1

Complete linkage

73

0.47

0.34

0

0.21

0.4

0.78

1

Gaussian mixtures

73

0.65

0.37

0

0.4

0.82

0.98

1

Genie_0.1

73

0.73

0.31

0

0.53

0.88

1

1

Genie_0.3

73

0.77

0.28

0

0.59

0.92

1

1

Genie_0.5

73

0.76

0.31

0

0.56

0.88

1

1

ITM

73

0.68

0.27

0

0.53

0.69

0.99

1

K-means

73

0.54

0.35

0

0.2

0.51

0.89

1

Single linkage

73

0.44

0.45

0

0

0.32

1

1

Spectral_RBF_5

72

0.63

0.37

0

0.33

0.73

0.99

1

Ward linkage

73

0.53

0.34

0

0.19

0.54

0.91

1

Ranks for ar (best=1):

count

mean

std

min

25%

50%

75%

max

Average linkage

73

6.9

3.6

1

5

7

10

13

Birch_0.01

73

6.1

3.1

1

4

6

8

13

Centroid linkage

73

7.1

3.7

1

5

8

10

13

Complete linkage

73

8.3

3.4

1

6

9

11

13

Gaussian mixtures

73

4.3

3.8

1

1

2

6

13

Genie_0.1

73

3.8

3.6

1

1

3

5

13

Genie_0.3

73

3.5

3.3

1

1

2

5

12

Genie_0.5

73

4.4

4.1

1

1

2

8

12

ITM

73

5.5

4.3

1

1

5

9

13

K-means

73

6

4

1

1

6

9

13

Single linkage

73

7.9

5.5

1

1

11

13

13

Spectral_RBF_5

73

5.4

3.7

1

1

6

8

13

Ward linkage

73

6.4

3.2

1

4

7

8

13

Raw results for ar (best=1.0):

Average linkage

Birch_0.01

Centroid linkage

Complete linkage

Gaussian mixtures

Genie_0.1

Genie_0.3

Genie_0.5

ITM

K-means

Single linkage

Spectral_RBF_5

Ward linkage

fcps/atom

0.1

0.1

0

0.08

0.03

1

1

1

1

0.18

1

1

0.1

fcps/chainlink

0.27

0.28

0.4

0.31

0.91

1

1

1

1

0.09

1

1

0.28

fcps/engytime

0.05

0.78

0.03

0.04

0.98

0.84

0.84

0.84

0.83

0.85

0

0.92

0.75

fcps/hepta

1

1

1

1

1

1

1

1

0.9

1

1

1

1

fcps/lsun

0.36

0.4

0.36

0.4

1

1

1

1

1

0.44

1

0.8

0.37

fcps/target

0.15

0.64

0.09

0.21

0.65

1

1

1

1

0.63

1

1

0.64

fcps/tetra

0.99

0.97

1

0.99

1

1

1

1

1

1

0

1

0.97

fcps/twodiamonds

0.99

0.99

0.99

0.99

1

0.98

0.98

0.98

0.99

1

0

1

1

fcps/wingnut

1

1

1

1

0.86

1

1

1

1

0.86

1

0.78

0.6

graves/dense

0.92

0.92

0.92

0.26

1

0.96

0.96

0.96

1

0.81

0

0.92

0.92

graves/fuzzyx

0.74

0.78

0.68

0.77

0.89

0.64

0.35

0.39

0.89

0.93

0

0.44

0.64

graves/line

0

0

0

0

1

0.02

1

1

0.12

0

1

1

0

graves/parabolic

0.6

0.57

0.66

0.59

0.54

0.81

0.81

0.81

0.64

0.59

0

0.66

0.62

graves/ring

0.11

0.12

0.05

0.21

0.03

1

1

1

1

0

1

1

0.12

graves/ring_noisy

0

0.11

0

0.27

0.02

1

1

1

1

0.16

0

1

0.15

graves/ring_outliers

0.63

0.63

0.35

0.34

0.62

1

1

1

1

0.62

1

1

0.63

graves/zigzag

0.53

0.62

0.46

0.36

0.96

1

1

1

0.78

0.53

1

0.68

0.54

graves/zigzag_noisy

0.52

0.64

0.54

0.52

0.9

0.77

1

1

0.54

0.51

0.47

0.63

0.66

graves/zigzag_outliers

0.31

0.51

0.3

0.33

0.98

1

1

1

0.83

0.44

0.48

0.34

0.39

other/chameleon_t4_8k

0.64

0.62

0.72

0.55

0.56

0.83

1

0.93

0.84

0.6

0

0.63

0.61

other/chameleon_t5_8k

1

1

1

0.73

1

1

1

0.83

0.59

1

0

1

1

other/chameleon_t7_10k

0.45

0.44

0.47

0.37

0.4

0.53

0.7

1

0.53

0.42

0

0.38

0.43

other/chameleon_t8_8k

0.37

0.39

0.37

0.33

0.44

0.61

0.64

0.71

0.57

0.37

0

0.36

0.37

other/hdbscan

0.43

0.63

0.41

0.46

0.82

0.97

0.71

0.71

0.75

0.64

0

0.33

0.84

other/iris

0.76

0.73

0.76

0.64

0.9

0.89

0.89

0.56

0.89

0.73

0.56

0.75

0.73

other/iris5

0.56

0.51

0.56

0.34

0.82

0.59

0.59

0.79

0.52

0.51

0.15

0.53

0.51

other/square

0.15

0

0.25

0.17

0.04

1

1

1

1

0.03

1

0.17

0.25

sipu/a1

0.93

0.93

0.94

0.92

0.96

0.94

0.9

0.83

0.77

0.97

0.44

0.94

0.91

sipu/a2

0.93

0.94

0.94

0.91

0.96

0.95

0.92

0.83

0.77

0.97

0.35

0.91

0.92

sipu/a3

0.94

0.94

0.93

0.92

0.95

0.96

0.94

0.82

0.77

0.95

0.32

0.93

0.94

sipu/aggregation

1

0.82

0.99

0.78

1

0.48

0.57

0.88

0.61

0.76

0.8

0.99

0.81

sipu/compound

0.91

0.88

0.9

0.91

0.91

0.78

0.78

0.88

0.62

0.76

0.93

0.87

0.88

sipu/d31

0.91

0.93

0.91

0.92

0.95

0.94

0.9

0.71

0.8

0.95

0.17

0.94

0.92

sipu/flame

0.44

0.22

0.01

0

0.34

1

1

1

0.35

0.48

0.01

0.83

0.22

sipu/jain

0.78

0.51

0.51

0.78

0

0.04

1

1

0.32

0.32

0.26

0.51

0.51

sipu/pathbased

0.59

0.54

0.6

0.41

0.6

0.97

0.97

0.7

0.54

0.5

0

0.6

0.54

sipu/r15

1

1

1

1

1

0.99

0.99

1

0.99

1

1

1

1

sipu/s1

0.98

0.99

0.98

0.97

0.99

0.99

0.99

0.99

0.76

0.99

0.46

0.99

0.98

sipu/s2

0.91

0.9

0.87

0.79

0.94

0.92

0.92

0.78

0.77

0.94

0

0.94

0.91

sipu/s3

0.6

0.68

0.57

0.51

0.73

0.69

0.67

0.56

0.61

0.72

0

0.71

0.68

sipu/s4

0.49

0.56

0.47

0.44

0.64

0.62

0.59

0.47

0.55

0.63

0

0.57

0.55

sipu/spiral

0

0

0

0

0

1

1

1

0.73

0

1

0

0

sipu/unbalance

1

1

1

0.61

1

0.57

0.62

0.78

0.53

1

1

1

1

uci/ecoli

0.74

0.49

0.46

0.62

0.61

0.36

0.46

0.66

0.33

0.46

0.04

0.35

0.49

uci/glass

0.02

0.25

0.01

0.23

0.24

0.12

0.25

0.22

0.23

0.27

0.01

0.22

0.26

uci/ionosphere

0

0.19

0

0.01

0.4

0.21

0.21

0

0.09

0.18

0

0

0.19

uci/sonar

0.01

0

0

0

0

0

0

0.01

0

0.01

0

0

0

uci/statlog

0

0.33

0

0.1

0.47

0.62

0.52

0.47

0.53

0.36

0

nan

0.31

uci/wdbc

0.05

0.29

0.05

0.05

0.71

0.09

0.28

0.28

0.63

0.49

0

0

0.29

uci/wine

0.29

0.37

0.29

0.37

0.82

0.36

0.36

0.25

0.39

0.37

0.01

0.32

0.37

uci/yeast

0.01

0.12

0.01

0.09

0.05

0.11

0.18

0.08

0.08

0.14

0.01

0.01

0.13

wut/circles

1

1

1

1

1

1

1

1

1

1

1

1

1

wut/cross

0

0.02

0

0.36

0.47

0.76

0.46

0.1

0.53

0.11

0

0

0.07

wut/graph

0.41

0.44

0.41

0.4

0.86

0.48

0.49

0.39

0.52

0.44

0.03

0.41

0.46

wut/isolation

0

0

0

0

0

1

1

1

1

0

1

0

0

wut/labirynth

0.36

0.49

0.3

0.3

0.62

0.5

0.59

0.72

0.72

0.29

0.76

0.39

0.34

wut/mk1

0.99

0.99

0.99

0.97

0.99

0.99

0.99

0.99

0.53

0.99

0.56

0.99

0.99

wut/mk2

0

0.01

0

0.01

0.01

1

1

1

1

0.01

1

0

0

wut/mk3

0.56

0.85

0.56

0.84

0.88

0.8

0.8

0.56

0.54

0.89

0

0.88

0.86

wut/mk4

0.04

0.14

0.08

0.28

0.5

1

1

1

0.59

0.2

1

0.2

0.19

wut/olympic

0.14

0.15

0.15

0.12

0.14

0.17

0.15

0.09

0.21

0.11

0

0.13

0.13

wut/smile

0.99

0.61

0.99

0.77

0.61

0.64

1

1

0.62

0.61

1

1

0.65

wut/stripes

0

0

0.03

0.01

0.01

1

1

1

1

0.01

1

0.01

0.01

wut/trajectories

1

1

1

0.71

1

1

1

1

1

1

1

1

1

wut/trapped_lovers

0.13

0.14

0.14

0.25

0.14

0.39

1

1

0.39

0.15

1

0.75

0.16

wut/twosplashes

0

0.28

0

0.22

0.67

0.5

0.5

0.5

0.73

0.28

0

0.28

0.19

wut/windows

0.1

0.1

0.08

0.09

0.14

0.14

0.2

1

0.35

0.09

1

0.15

0.1

wut/x1

1

1

1

1

1

1

1

1

1

1

1

1

1

wut/x2

0.25

0.19

0.25

0.21

0.69

0.69

0.69

0.21

0.69

0.21

0

0.27

0.19

wut/x3

0.5

0.87

0.5

0.47

0.9

0.88

0.5

0.5

0.65

0.86

0.01

0.51

0.92

wut/z1

0.21

0.1

0.14

0.19

0.01

0.39

0.39

0.14

0.39

0.2

0

0.15

0.1

wut/z2

0.51

0.5

0.51

0.44

1

0.5

0.63

0.82

0.49

0.47

0.73

0.99

0.43

wut/z3

1

1

1

0.93

1

0.63

0.66

0.92

0.65

1

0.74

0.98

1

fm

Summary statistics for fm (best=1.0):

count

mean

std

min

25%

50%

75%

max

Average linkage

73

0.72

0.2

0.34

0.55

0.71

0.94

1

Birch_0.01

73

0.72

0.21

0.28

0.54

0.7

0.92

1

Centroid linkage

73

0.72

0.2

0.34

0.56

0.69

0.94

1

Complete linkage

73

0.69

0.19

0.3

0.55

0.65

0.86

1

Gaussian mixtures

73

0.79

0.22

0.26

0.66

0.87

0.98

1

Genie_0.1

73

0.82

0.2

0.25

0.66

0.92

1

1

Genie_0.3

73

0.85

0.18

0.37

0.7

0.92

1

1

Genie_0.5

73

0.85

0.18

0.36

0.75

0.92

1

1

ITM

73

0.78

0.18

0.23

0.65

0.78

0.99

1

K-means

73

0.71

0.21

0.29

0.51

0.67

0.93

1

Single linkage

73

0.72

0.24

0.26

0.51

0.71

1

1

Spectral_RBF_5

72

0.78

0.21

0.33

0.61

0.83

0.99

1

Ward linkage

73

0.71

0.21

0.29

0.55

0.68

0.92

1

Ranks for fm (best=1):

count

mean

std

min

25%

50%

75%

max

Average linkage

73

6.2

3.4

1

4

6

9

12

Birch_0.01

73

6.5

3.2

1

5

7

9

13

Centroid linkage

73

6.2

3.5

1

3

6

9

13

Complete linkage

73

8.5

3.6

1

7

9

12

13

Gaussian mixtures

73

4.7

4

1

1

3

9

13

Genie_0.1

73

4.2

4

1

1

3

7

13

Genie_0.3

73

3.8

3.5

1

1

2

6

12

Genie_0.5

73

4.2

3.9

1

1

2

8

13

ITM

73

6.1

4.7

1

1

5

11

13

K-means

73

6.9

4.3

1

2

9

10

13

Single linkage

73

6.5

5.3

1

1

6

13

13

Spectral_RBF_5

73

5.2

3.7

1

1

5

8

13

Ward linkage

73

6.9

3.4

1

5

7

9

13

Raw results for fm (best=1.0):

Average linkage

Birch_0.01

Centroid linkage

Complete linkage

Gaussian mixtures

Genie_0.1

Genie_0.3

Genie_0.5

ITM

K-means

Single linkage

Spectral_RBF_5

Ward linkage

fcps/atom

0.65

0.65

0.69

0.65

0.66

1

1

1

1

0.65

1

1

0.65

fcps/chainlink

0.68

0.68

0.72

0.69

0.95

1

1

1

1

0.55

1

1

0.68

fcps/engytime

0.65

0.89

0.66

0.65

0.99

0.92

0.92

0.92

0.92

0.92

0.71

0.96

0.87

fcps/hepta

1

1

1

1

1

1

1

1

0.91

1

1

1

1

fcps/lsun

0.6

0.63

0.6

0.63

1

1

1

1

1

0.65

1

0.88

0.61

fcps/target

0.71

0.8

0.71

0.71

0.8

1

1

1

1

0.79

1

1

0.79

fcps/tetra

0.99

0.98

1

0.99

1

1

1

1

1

1

0.49

1

0.98

fcps/twodiamonds

1

1

1

0.99

1

0.99

0.99

0.99

0.99

1

0.71

1

1

fcps/wingnut

1

1

1

1

0.93

1

1

1

1

0.93

1

0.89

0.8

graves/dense

0.96

0.96

0.96

0.67

1

0.98

0.98

0.98

1

0.9

0.69

0.96

0.96

graves/fuzzyx

0.8

0.84

0.75

0.87

0.91

0.72

0.7

0.7

0.94

0.96

0.72

0.69

0.8

graves/line

0.6

0.6

0.6

0.61

1

0.6

1

1

0.63

0.6

1

1

0.64

graves/parabolic

0.8

0.79

0.83

0.8

0.77

0.91

0.91

0.91

0.82

0.79

0.71

0.83

0.81

graves/ring

0.65

0.65

0.65

0.66

0.66

1

1

1

1

0.5

1

1

0.65

graves/ring_noisy

0.71

0.65

0.71

0.68

0.66

1

1

1

1

0.65

0.71

1

0.65

graves/ring_outliers

0.78

0.78

0.65

0.65

0.78

1

1

1

1

0.78

1

1

0.78

graves/zigzag

0.63

0.7

0.59

0.53

0.97

1

1

1

0.82

0.64

1

0.75

0.64

graves/zigzag_noisy

0.62

0.71

0.64

0.63

0.92

0.82

1

1

0.63

0.62

0.67

0.72

0.73

graves/zigzag_outliers

0.55

0.61

0.55

0.52

0.98

1

1

1

0.86

0.59

0.67

0.66

0.58

other/chameleon_t4_8k

0.72

0.69

0.78

0.63

0.64

0.86

1

0.94

0.87

0.67

0.44

0.69

0.68

other/chameleon_t5_8k

1

1

1

0.78

1

1

1

0.87

0.67

1

0.41

1

1

other/chameleon_t7_10k

0.54

0.54

0.56

0.47

0.5

0.61

0.76

1

0.62

0.51

0.43

0.48

0.52

other/chameleon_t8_8k

0.47

0.49

0.47

0.43

0.53

0.68

0.7

0.77

0.64

0.46

0.41

0.46

0.47

other/hdbscan

0.6

0.7

0.58

0.58

0.85

0.97

0.79

0.79

0.8

0.7

0.42

0.53

0.87

other/iris

0.84

0.82

0.84

0.77

0.94

0.92

0.92

0.75

0.92

0.82

0.76

0.83

0.82

other/iris5

0.77

0.74

0.77

0.67

0.9

0.76

0.76

0.89

0.72

0.73

0.69

0.75

0.74

other/square

0.65

0.5

0.67

0.65

0.52

1

1

1

1

0.52

1

0.65

0.67

sipu/a1

0.93

0.94

0.94

0.92

0.96

0.94

0.9

0.85

0.78

0.97

0.56

0.94

0.92

sipu/a2

0.94

0.94

0.94

0.91

0.96

0.95

0.92

0.84

0.78

0.97

0.48

0.91

0.92

sipu/a3

0.94

0.94

0.94

0.92

0.95

0.96

0.94

0.84

0.77

0.95

0.45

0.93

0.94

sipu/aggregation

1

0.86

0.99

0.83

1

0.58

0.66

0.91

0.69

0.82

0.86

0.99

0.86

sipu/compound

0.94

0.92

0.93

0.94

0.94

0.85

0.85

0.92

0.74

0.83

0.95

0.91

0.92

sipu/d31

0.91

0.93

0.91

0.93

0.95

0.94

0.9

0.74

0.81

0.96

0.35

0.94

0.92

sipu/flame

0.73

0.63

0.73

0.62

0.68

1

1

1

0.69

0.75

0.73

0.92

0.63

sipu/jain

0.92

0.79

0.79

0.92

0.59

0.59

1

1

0.7

0.7

0.8

0.79

0.79

sipu/pathbased

0.73

0.67

0.73

0.6

0.74

0.98

0.98

0.8

0.69

0.66

0.57

0.74

0.67

sipu/r15

1

1

1

1

1

0.99

0.99

1

0.99

1

1

1

1

sipu/s1

0.98

0.99

0.98

0.97

0.99

0.99

0.99

0.99

0.77

0.99

0.59

0.99

0.98

sipu/s2

0.92

0.91

0.88

0.81

0.95

0.92

0.92

0.8

0.78

0.94

0.26

0.94

0.91

sipu/s3

0.64

0.7

0.62

0.55

0.75

0.71

0.69

0.61

0.64

0.74

0.26

0.73

0.7

sipu/s4

0.55

0.59

0.53

0.49

0.67

0.64

0.62

0.53

0.58

0.66

0.26

0.61

0.58

sipu/spiral

0.36

0.34

0.36

0.34

0.33

1

1

1

0.82

0.33

1

0.33

0.34

sipu/unbalance

1

1

1

0.77

1

0.69

0.73

0.84

0.66

1

1

1

1

uci/ecoli

0.82

0.61

0.68

0.72

0.71

0.51

0.59

0.75

0.48

0.59

0.53

0.62

0.61

uci/glass

0.49

0.5

0.49

0.55

0.47

0.33

0.48

0.48

0.41

0.51

0.51

0.47

0.51

uci/ionosphere

0.73

0.61

0.73

0.73

0.71

0.64

0.64

0.64

0.56

0.61

0.73

0.73

0.61

uci/sonar

0.65

0.53

0.69

0.53

0.51

0.52

0.52

0.64

0.51

0.5

0.7

0.7

0.53

uci/statlog

0.37

0.47

0.38

0.43

0.57

0.68

0.6

0.58

0.6

0.48

0.38

nan

0.45

uci/wdbc

0.72

0.74

0.72

0.72

0.87

0.6

0.74

0.74

0.82

0.79

0.73

0.73

0.74

uci/wine

0.62

0.58

0.62

0.59

0.88

0.58

0.58

0.59

0.6

0.58

0.56

0.63

0.58

uci/yeast

0.46

0.28

0.47

0.42

0.26

0.25

0.39

0.39

0.23

0.3

0.47

0.47

0.29

wut/circles

1

1

1

1

1

1

1

1

1

1

1

1

1

wut/cross

0.49

0.45

0.49

0.6

0.64

0.82

0.62

0.44

0.67

0.44

0.5

0.5

0.44

wut/graph

0.49

0.51

0.49

0.48

0.88

0.54

0.55

0.49

0.57

0.51

0.31

0.49

0.53

wut/isolation

0.34

0.35

0.35

0.34

0.33

1

1

1

1

0.33

1

0.33

0.34

wut/labirynth

0.51

0.61

0.47

0.46

0.72

0.62

0.69

0.79

0.79

0.45

0.85

0.53

0.49

wut/mk1

0.99

0.99

0.99

0.98

0.99

0.99

0.99

0.99

0.7

0.99

0.77

0.99

0.99

wut/mk2

0.5

0.51

0.51

0.5

0.5

1

1

1

1

0.5

1

0.5

0.51

wut/mk3

0.77

0.9

0.77

0.9

0.92

0.86

0.86

0.75

0.7

0.93

0.57

0.92

0.91

wut/mk4

0.49

0.49

0.48

0.55

0.67

1

1

1

0.73

0.5

1

0.51

0.5

wut/olympic

0.35

0.33

0.34

0.3

0.32

0.37

0.37

0.36

0.38

0.29

0.45

0.33

0.31

wut/smile

0.99

0.73

0.99

0.86

0.73

0.75

1

1

0.72

0.73

1

1

0.76

wut/stripes

0.51

0.54

0.51

0.53

0.51

1

1

1

1

0.51

1

0.51

0.55

wut/trajectories

1

1

1

0.8

1

1

1

1

1

1

1

1

1

wut/trapped_lovers

0.5

0.5

0.52

0.54

0.5

0.64

1

1

0.64

0.5

1

0.86

0.5

wut/twosplashes

0.69

0.64

0.69

0.61

0.84

0.75

0.75

0.75

0.87

0.64

0.7

0.64

0.6

wut/windows

0.39

0.39

0.38

0.39

0.41

0.43

0.5

1

0.58

0.37

1

0.43

0.4

wut/x1

1

1

1

1

1

1

1

1

1

1

1

1

1

wut/x2

0.59

0.54

0.59

0.55

0.8

0.8

0.8

0.55

0.79

0.55

0.57

0.6

0.54

wut/x3

0.68

0.9

0.68

0.62

0.93

0.91

0.67

0.67

0.76

0.89

0.51

0.69

0.94

wut/z1

0.51

0.42

0.48

0.46

0.36

0.6

0.6

0.5

0.6

0.47

0.55

0.43

0.42

wut/z2

0.68

0.66

0.67

0.62

1

0.66

0.76

0.89

0.65

0.64

0.86

0.99

0.61

wut/z3

1

1

1

0.95

1

0.74

0.77

0.94

0.74

1

0.84

0.99

1

ami

Summary statistics for ami (best=1.0):

count

mean

std

min

25%

50%

75%

max

Average linkage

73

0.57

0.36

0

0.27

0.64

0.95

1

Birch_0.01

73

0.6

0.33

0

0.34

0.65

0.92

1

Centroid linkage

73

0.55

0.36

0

0.18

0.6

0.95

1

Complete linkage

73

0.55

0.31

0

0.35

0.55

0.83

1

Gaussian mixtures

73

0.68

0.34

0

0.43

0.8

0.97

1

Genie_0.1

73

0.79

0.26

0

0.71

0.87

1

1

Genie_0.3

73

0.82

0.24

0

0.74

0.95

1

1

Genie_0.5

73

0.81

0.26

0.06

0.7

0.94

1

1

ITM

73

0.75

0.24

0

0.63

0.76

0.97

1

K-means

73

0.59

0.33

0

0.36

0.64

0.88

1

Single linkage

73

0.49

0.46

0

0

0.71

1

1

Spectral_RBF_5

72

0.67

0.34

0

0.47

0.76

0.99

1

Ward linkage

73

0.6

0.32

0

0.35

0.63

0.91

1

Ranks for ami (best=1):

count

mean

std

min

25%

50%

75%

max

Average linkage

73

6.8

3.7

1

4

7

10

13

Birch_0.01

73

6

3.2

1

4

6

8

13

Centroid linkage

73

7

3.8

1

5

7

11

13

Complete linkage

73

8.3

3.4

1

6

9

11

13

Gaussian mixtures

73

4.4

3.9

1

1

3

7

13

Genie_0.1

73

3.7

3.5

1

1

2

5

13

Genie_0.3

73

3.2

3.2

1

1

1

4

12

Genie_0.5

73

4.1

3.9

1

1

1

8

13

ITM

73

5.9

4.2

1

2

5

10

13

K-means

73

6.1

4.1

1

1

6

10

13

Single linkage

73

8.1

5.4

1

1

11

13

13

Spectral_RBF_5

73

5.2

3.7

1

1

5

9

13

Ward linkage

73

6.3

3.3

1

4

7

9

13

Raw results for ami (best=1.0):

Average linkage

Birch_0.01

Centroid linkage

Complete linkage

Gaussian mixtures

Genie_0.1

Genie_0.3

Genie_0.5

ITM

K-means

Single linkage

Spectral_RBF_5

Ward linkage

fcps/atom

0.22

0.22

0.04

0.2

0.13

1

1

1

1

0.29

1

1

0.22

fcps/chainlink

0.36

0.37

0.45

0.39

0.84

1

1

1

1

0.07

1

1

0.37

fcps/engytime

0.16

0.68

0.12

0.15

0.96

0.79

0.79

0.79

0.74

0.77

0

0.87

0.68

fcps/hepta

1

1

1

1

1

1

1

1

0.94

1

1

1

1

fcps/lsun

0.5

0.53

0.5

0.53

1

1

1

1

1

0.54

1

0.82

0.51

fcps/target

0.33

0.64

0.28

0.38

0.65

1

1

1

1

0.63

1

1

0.63

fcps/tetra

0.99

0.96

1

0.98

1

1

1

1

1

1

0

1

0.96

fcps/twodiamonds

0.99

0.99

0.99

0.97

1

0.95

0.95

0.95

0.97

1

0

1

1

fcps/wingnut

1

1

1

1

0.78

1

1

1

1

0.77

1

0.68

0.49

graves/dense

0.88

0.88

0.88

0.35

1

0.93

0.93

0.93

1

0.76

0.02

0.88

0.88

graves/fuzzyx

0.8

0.83

0.77

0.79

0.89

0.74

0.59

0.58

0.84

0.88

0

0.64

0.74

graves/line

0.14

0.14

0.18

0.14

1

0.2

1

1

0.25

0.18

1

1

0.1

graves/parabolic

0.49

0.57

0.55

0.51

0.43

0.74

0.74

0.74

0.54

0.48

0

0.55

0.52

graves/ring

0.23

0.24

0.16

0.31

0.13

1

1

1

1

0

1

1

0.24

graves/ring_noisy

0

0.23

0

0.36

0.12

1

1

1

1

0.28

0

1

0.26

graves/ring_outliers

0.65

0.65

0.41

0.41

0.65

1

1

1

1

0.65

1

1

0.65

graves/zigzag

0.67

0.76

0.63

0.56

0.96

1

1

1

0.85

0.71

1

0.8

0.71

graves/zigzag_noisy

0.66

0.75

0.71

0.67

0.89

0.85

1

1

0.68

0.66

0.74

0.78

0.76

graves/zigzag_outliers

0.49

0.65

0.49

0.53

0.97

1

1

1

0.9

0.61

0.74

0.53

0.57

other/chameleon_t4_8k

0.76

0.73

0.81

0.62

0.69

0.91

1

0.95

0.87

0.7

0

0.72

0.73

other/chameleon_t5_8k

1

1

1

0.83

1

1

1

0.93

0.75

1

0

1

1

other/chameleon_t7_10k

0.69

0.71

0.71

0.6

0.68

0.78

0.87

1

0.76

0.66

0

0.64

0.69

other/chameleon_t8_8k

0.59

0.58

0.6

0.55

0.64

0.79

0.79

0.86

0.76

0.59

0

0.58

0.59

other/hdbscan

0.62

0.75

0.6

0.61

0.82

0.97

0.87

0.87

0.85

0.73

0

0.55

0.86

other/iris

0.8

0.77

0.8

0.72

0.9

0.87

0.87

0.7

0.87

0.76

0.71

0.8

0.77

other/iris5

0.63

0.56

0.63

0.46

0.81

0.58

0.58

0.76

0.54

0.54

0.34

0.61

0.56

other/square

0.27

0

0.34

0.28

0.03

1

1

1

1

0.02

1

0.28

0.35

sipu/a1

0.95

0.96

0.96

0.95

0.97

0.96

0.95

0.94

0.89

0.97

0.78

0.96

0.95

sipu/a2

0.96

0.96

0.96

0.95

0.98

0.97

0.96

0.94

0.9

0.98

0.76

0.96

0.96

sipu/a3

0.97

0.97

0.97

0.96

0.97

0.97

0.97

0.95

0.91

0.97

0.76

0.96

0.97

sipu/aggregation

1

0.92

0.99

0.9

1

0.7

0.76

0.92

0.78

0.88

0.88

0.99

0.92

sipu/compound

0.93

0.88

0.91

0.93

0.93

0.85

0.85

0.88

0.74

0.83

0.93

0.86

0.88

sipu/d31

0.95

0.95

0.95

0.95

0.96

0.96

0.95

0.9

0.91

0.97

0.63

0.96

0.95

sipu/flame

0.48

0.35

0.02

0.12

0.42

1

1

1

0.43

0.43

0.02

0.73

0.35

sipu/jain

0.7

0.5

0.5

0.7

0.2

0.23

1

1

0.39

0.37

0.24

0.5

0.5

sipu/pathbased

0.64

0.59

0.65

0.5

0.66

0.95

0.95

0.81

0.61

0.58

0

0.67

0.59

sipu/r15

1

1

1

1

1

0.99

0.99

1

0.99

1

1

1

1

sipu/s1

0.98

0.99

0.98

0.98

0.99

0.99

0.99

0.99

0.88

0.99

0.79

0.99

0.98

sipu/s2

0.93

0.92

0.93

0.88

0.95

0.93

0.93

0.91

0.86

0.95

0

0.94

0.93

sipu/s3

0.75

0.77

0.74

0.7

0.8

0.78

0.77

0.75

0.74

0.79

0

0.79

0.77

sipu/s4

0.66

0.69

0.65

0.63

0.73

0.71

0.7

0.66

0.68

0.72

0

0.71

0.69

sipu/spiral

0

0

0

0

0

1

1

1

0.78

0

1

0

0

sipu/unbalance

1

1

1

0.82

1

0.75

0.77

0.82

0.75

1

0.99

1

1

uci/ecoli

0.71

0.62

0.54

0.64

0.57

0.49

0.54

0.57

0.49

0.58

0.11

0.48

0.62

uci/glass

0.07

0.34

0.05

0.35

0.33

0.25

0.38

0.34

0.33

0.4

0.03

0.31

0.37

uci/ionosphere

0

0.14

0

0.01

0.32

0.13

0.13

0.06

0.09

0.13

0

0

0.14

uci/sonar

0

0

0.04

0

0

0

0

0.07

0

0.01

0

0

0

uci/statlog

0.01

0.53

0

0.35

0.61

0.68

0.68

0.7

0.63

0.52

0

nan

0.49

uci/wdbc

0.09

0.32

0.09

0.09

0.61

0.24

0.31

0.31

0.51

0.46

0

0

0.32

uci/wine

0.4

0.41

0.4

0.44

0.82

0.41

0.41

0.38

0.37

0.42

0.04

0.42

0.41

uci/yeast

0.05

0.22

0.05

0.18

0.14

0.22

0.25

0.19

0.19

0.26

0.05

0.06

0.23

wut/circles

1

1

1

1

1

1

1

1

1

1

1

1

1

wut/cross

0.04

0.18

0.04

0.48

0.61

0.81

0.62

0.36

0.7

0.36

0

0.01

0.31

wut/graph

0.62

0.63

0.63

0.6

0.89

0.68

0.69

0.62

0.69

0.64

0.23

0.62

0.65

wut/isolation

0

0

0

0

0

1

1

1

1

0

1

0

0

wut/labirynth

0.59

0.71

0.53

0.54

0.76

0.71

0.78

0.88

0.87

0.5

0.85

0.6

0.58

wut/mk1

0.98

0.98

0.98

0.95

0.98

0.98

0.98

0.98

0.61

0.98

0.72

0.98

0.98

wut/mk2

0

0.01

0

0.01

0

1

1

1

1

0.01

1

0

0

wut/mk3

0.71

0.83

0.71

0.83

0.85

0.8

0.8

0.69

0.61

0.86

0

0.85

0.84

wut/mk4

0.11

0.2

0.15

0.3

0.58

1

1

1

0.65

0.25

1

0.25

0.24

wut/olympic

0.31

0.27

0.29

0.21

0.25

0.33

0.33

0.31

0.31

0.2

0

0.31

0.23

wut/smile

0.98

0.79

0.98

0.83

0.79

0.8

1

1

0.85

0.79

1

1

0.8

wut/stripes

0

0

0.02

0.01

0.01

1

1

1

1

0.01

1

0.01

0.01

wut/trajectories

1

1

1

0.83

1

1

1

1

1

1

1

1

1

wut/trapped_lovers

0.35

0.36

0.35

0.45

0.36

0.62

1

1

0.62

0.38

1

0.74

0.39

wut/twosplashes

0.04

0.21

0.04

0.17

0.56

0.4

0.4

0.4

0.69

0.21

0.01

0.21

0.15

wut/windows

0.4

0.4

0.38

0.4

0.43

0.48

0.56

1

0.65

0.35

1

0.43

0.4

wut/x1

1

1

1

1

1

1

1

1

1

1

1

1

1

wut/x2

0.4

0.38

0.4

0.39

0.75

0.75

0.75

0.39

0.71

0.39

0

0.41

0.38

wut/x3

0.66

0.87

0.66

0.63

0.89

0.87

0.66

0.66

0.69

0.87

0.01

0.68

0.91

wut/z1

0.32

0.13

0.28

0.26

0.03

0.47

0.47

0.24

0.46

0.27

0.05

0.19

0.13

wut/z2

0.72

0.72

0.72

0.64

1

0.72

0.74

0.86

0.71

0.68

0.81

0.98

0.69

wut/z3

0.99

0.99

0.99

0.93

0.99

0.74

0.74

0.91

0.75

1

0.84

0.97

1

nmi

Summary statistics for nmi (best=1.0):

count

mean

std

min

25%

50%

75%

max

Average linkage

73

0.57

0.35

0

0.27

0.64

0.95

1

Birch_0.01

73

0.6

0.33

0

0.35

0.66

0.92

1

Centroid linkage

73

0.55

0.36

0

0.18

0.61

0.95

1

Complete linkage

73

0.56

0.31

0

0.35

0.55

0.83

1

Gaussian mixtures

73

0.68

0.34

0

0.43

0.8

0.98

1

Genie_0.1

73

0.79

0.26

0

0.71

0.87

1

1

Genie_0.3

73

0.82

0.24

0

0.74

0.95

1

1

Genie_0.5

73

0.82

0.26

0.07

0.71

0.94

1

1

ITM

73

0.75

0.24

0.01

0.63

0.76

0.97

1

K-means

73

0.59

0.32

0

0.37

0.64

0.88

1

Single linkage

73

0.5

0.45

0

0.01

0.72

1

1

Spectral_RBF_5

72

0.67

0.34

0

0.49

0.76

0.99

1

Ward linkage

73

0.6

0.32

0

0.35

0.64

0.91

1

Ranks for nmi (best=1):

count

mean

std

min

25%

50%

75%

max

Average linkage

73

6.9

3.7

1

4

7

10

13

Birch_0.01

73

6.2

3.2

1

4

6

8

13

Centroid linkage

73

7

3.8

1

5

6

11

13

Complete linkage

73

8.4

3.4

1

6

9

11

13

Gaussian mixtures

73

4.5

4

1

1

3

7

13

Genie_0.1

73

3.8

3.6

1

1

2

5

13

Genie_0.3

73

3.3

3.2

1

1

1

4

12

Genie_0.5

73

4.1

3.9

1

1

1

8

13

ITM

73

5.8

4.2

1

1

5

10

13

K-means

73

6.2

4.2

1

1

6

10

13

Single linkage

73

8.1

5.4

1

1

11

13

13

Spectral_RBF_5

73

5.2

3.7

1

1

5

8

13

Ward linkage

73

6.5

3.3

1

4

7

9

13

Raw results for nmi (best=1.0):

Average linkage

Birch_0.01

Centroid linkage

Complete linkage

Gaussian mixtures

Genie_0.1

Genie_0.3

Genie_0.5

ITM

K-means

Single linkage

Spectral_RBF_5

Ward linkage

fcps/atom

0.22

0.22

0.04

0.2

0.13

1

1

1

1

0.29

1

1

0.22

fcps/chainlink

0.36

0.37

0.45

0.39

0.84

1

1

1

1

0.07

1

1

0.37

fcps/engytime

0.16

0.68

0.12

0.15

0.96

0.79

0.79

0.79

0.74

0.77

0

0.87

0.68

fcps/hepta

1

1

1

1

1

1

1

1

0.95

1

1

1

1

fcps/lsun

0.5

0.53

0.5

0.53

1

1

1

1

1

0.54

1

0.82

0.51

fcps/target

0.34

0.64

0.28

0.38

0.65

1

1

1

1

0.64

1

1

0.64

fcps/tetra

0.99

0.96

1

0.98

1

1

1

1

1

1

0.01

1

0.96

fcps/twodiamonds

0.99

0.99

0.99

0.97

1

0.95

0.95

0.95

0.97

1

0

1

1

fcps/wingnut

1

1

1

1

0.78

1

1

1

1

0.77

1

0.68

0.49

graves/dense

0.88

0.88

0.88

0.35

1

0.93

0.93

0.93

1

0.76

0.03

0.88

0.88

graves/fuzzyx

0.8

0.83

0.77

0.79

0.89

0.75

0.6

0.58

0.84

0.88

0.01

0.64

0.74

graves/line

0.14

0.14

0.18

0.14

1

0.2

1

1

0.25

0.18

1

1

0.1

graves/parabolic

0.49

0.57

0.55

0.51

0.43

0.74

0.74

0.74

0.54

0.48

0.01

0.55

0.52

graves/ring

0.23

0.24

0.16

0.31

0.13

1

1

1

1

0

1

1

0.24

graves/ring_noisy

0

0.24

0

0.36

0.12

1

1

1

1

0.28

0

1

0.27

graves/ring_outliers

0.66

0.66

0.41

0.41

0.65

1

1

1

1

0.65

1

1

0.66

graves/zigzag

0.67

0.76

0.64

0.57

0.96

1

1

1

0.85

0.71

1

0.81

0.71

graves/zigzag_noisy

0.67

0.76

0.71

0.68

0.89

0.85

1

1

0.68

0.67

0.74

0.79

0.77

graves/zigzag_outliers

0.5

0.66

0.5

0.54

0.98

1

1

1

0.9

0.62

0.74

0.53

0.57

other/chameleon_t4_8k

0.76

0.73

0.81

0.62

0.69

0.91

1

0.95

0.87

0.7

0

0.72

0.73

other/chameleon_t5_8k

1

1

1

0.83

1

1

1

0.93

0.75

1

0

1

1

other/chameleon_t7_10k

0.69

0.71

0.71

0.6

0.68

0.78

0.87

1

0.76

0.66

0

0.64

0.69

other/chameleon_t8_8k

0.59

0.58

0.6

0.55

0.64

0.79

0.79

0.86

0.76

0.59

0

0.58

0.59

other/hdbscan

0.62

0.75

0.61

0.61

0.82

0.97

0.87

0.88

0.85

0.73

0

0.55

0.86

other/iris

0.81

0.77

0.81

0.72

0.9

0.87

0.87

0.71

0.87

0.76

0.72

0.8

0.77

other/iris5

0.64

0.57

0.64

0.47

0.81

0.59

0.59

0.76

0.55

0.55

0.36

0.62

0.57

other/square

0.27

0

0.34

0.28

0.03

1

1

1

1

0.02

1

0.28

0.35

sipu/a1

0.95

0.96

0.96

0.95

0.97

0.96

0.95

0.94

0.89

0.97

0.79

0.96

0.95

sipu/a2

0.96

0.96

0.96

0.95

0.98

0.97

0.96

0.95

0.91

0.98

0.77

0.96

0.96

sipu/a3

0.97

0.97

0.97

0.96

0.98

0.98

0.97

0.95

0.91

0.98

0.76

0.97

0.97

sipu/aggregation

1

0.92

0.99

0.9

1

0.71

0.76

0.92

0.78

0.88

0.88

0.99

0.92

sipu/compound

0.93

0.88

0.92

0.93

0.93

0.85

0.85

0.89

0.75

0.83

0.93

0.86

0.88

sipu/d31

0.95

0.96

0.95

0.95

0.96

0.96

0.95

0.91

0.91

0.97

0.64

0.96

0.95

sipu/flame

0.48

0.35

0.02

0.13

0.42

1

1

1

0.43

0.43

0.02

0.73

0.35

sipu/jain

0.7

0.51

0.51

0.7

0.2

0.23

1

1

0.39

0.37

0.25

0.51

0.51

sipu/pathbased

0.64

0.6

0.66

0.51

0.66

0.95

0.95

0.81

0.61

0.59

0.02

0.67

0.6

sipu/r15

1

1

1

1

1

0.99

0.99

1

0.99

1

1

1

1

sipu/s1

0.98

0.99

0.98

0.98

0.99

0.99

0.99

0.99

0.88

0.99

0.79

0.99

0.98

sipu/s2

0.93

0.92

0.93

0.88

0.95

0.93

0.93

0.91

0.86

0.95

0.01

0.94

0.93

sipu/s3

0.75

0.77

0.74

0.71

0.8

0.78

0.78

0.75

0.75

0.79

0.01

0.79

0.77

sipu/s4

0.67

0.69

0.66

0.63

0.73

0.72

0.71

0.67

0.68

0.72

0.01

0.71

0.69

sipu/spiral

0

0.01

0.01

0.01

0

1

1

1

0.79

0

1

0

0.01

sipu/unbalance

1

1

1

0.82

1

0.75

0.77

0.82

0.75

1

0.99

1

1

uci/ecoli

0.72

0.63

0.56

0.65

0.59

0.51

0.56

0.59

0.51

0.6

0.15

0.51

0.63

uci/glass

0.11

0.37

0.09

0.38

0.36

0.28

0.41

0.37

0.35

0.43

0.07

0.34

0.39

uci/ionosphere

0.01

0.14

0.01

0.02

0.32

0.13

0.13

0.07

0.09

0.13

0.01

0.01

0.14

uci/sonar

0.01

0

0.05

0

0.01

0

0

0.08

0.01

0.01

0.01

0.01

0

uci/statlog

0.02

0.53

0.01

0.35

0.62

0.68

0.68

0.7

0.63

0.52

0.01

nan

0.49

uci/wdbc

0.09

0.32

0.09

0.09

0.61

0.24

0.32

0.32

0.51

0.46

0.01

0.01

0.32

uci/wine

0.4

0.42

0.4

0.44

0.82

0.42

0.42

0.39

0.38

0.43

0.06

0.43

0.42

uci/yeast

0.07

0.23

0.07

0.19

0.15

0.23

0.27

0.2

0.2

0.27

0.07

0.07

0.24

wut/circles

1

1

1

1

1

1

1

1

1

1

1

1

1

wut/cross

0.04

0.19

0.04

0.48

0.61

0.81

0.62

0.36

0.7

0.37

0

0.01

0.31

wut/graph

0.62

0.63

0.64

0.61

0.89

0.68

0.69

0.62

0.7

0.64

0.24

0.63

0.66

wut/isolation

0

0

0

0

0

1

1

1

1

0

1

0

0

wut/labirynth

0.59

0.71

0.54

0.54

0.76

0.71

0.78

0.88

0.87

0.5

0.85

0.6

0.58

wut/mk1

0.98

0.98

0.98

0.95

0.98

0.98

0.98

0.98

0.62

0.98

0.73

0.98

0.98

wut/mk2

0

0.01

0

0.01

0.01

1

1

1

1

0.01

1

0

0

wut/mk3

0.71

0.83

0.71

0.83

0.85

0.8

0.8

0.69

0.61

0.86

0.01

0.85

0.84

wut/mk4

0.12

0.2

0.15

0.3

0.58

1

1

1

0.65

0.25

1

0.25

0.24

wut/olympic

0.31

0.27

0.29

0.21

0.25

0.33

0.34

0.31

0.31

0.2

0

0.31

0.23

wut/smile

0.98

0.79

0.98

0.83

0.79

0.8

1

1

0.85

0.79

1

1

0.81

wut/stripes

0

0

0.02

0.01

0.01

1

1

1

1

0.01

1

0.01

0.01

wut/trajectories

1

1

1

0.83

1

1

1

1

1

1

1

1

1

wut/trapped_lovers

0.35

0.36

0.35

0.45

0.36

0.63

1

1

0.62

0.38

1

0.74

0.39

wut/twosplashes

0.04

0.21

0.04

0.17

0.56

0.4

0.4

0.4

0.69

0.21

0.01

0.21

0.15

wut/windows

0.41

0.41

0.38

0.4

0.43

0.48

0.56

1

0.65

0.35

1

0.43

0.4

wut/x1

1

1

1

1

1

1

1

1

1

1

1

1

1

wut/x2

0.41

0.39

0.41

0.4

0.75

0.75

0.75

0.4

0.71

0.4

0.03

0.43

0.39

wut/x3

0.67

0.87

0.67

0.64

0.89

0.87

0.67

0.67

0.7

0.87

0.04

0.69

0.91

wut/z1

0.33

0.14

0.29

0.27

0.04

0.47

0.47

0.24

0.47

0.27

0.07

0.19

0.14

wut/z2

0.72

0.72

0.72

0.64

1

0.72

0.74

0.86

0.72

0.68

0.81

0.98

0.69

wut/z3

0.99

0.99

0.99

0.93

0.99

0.74

0.75

0.91

0.75

1

0.84

0.97

1

nacc

Summary statistics for nacc (best=1.0):

count

mean

std

min

25%

50%

75%

max

Average linkage

73

0.59

0.34

0

0.32

0.59

0.96

1

Birch_0.01

73

0.63

0.31

0.01

0.38

0.64

0.95

1

Centroid linkage

73

0.57

0.34

0

0.29

0.58

0.96

1

Complete linkage

73

0.58

0.3

0.02

0.38

0.56

0.84

1

Gaussian mixtures

73

0.71

0.33

0.01

0.51

0.86

0.99

1

Genie_0.1

73

0.79

0.26

0.02

0.63

0.94

1

1

Genie_0.3

73

0.82

0.23

0.02

0.66

0.95

1

1

Genie_0.5

73

0.8

0.26

0.08

0.65

0.91

1

1

ITM

73

0.75

0.23

0.08

0.6

0.8

0.99

1

K-means

73

0.63

0.3

0.01

0.4

0.64

0.94

1

Single linkage

73

0.49

0.42

0

0.09

0.37

1

1

Spectral_RBF_5

72

0.7

0.32

0.01

0.42

0.83

1

1

Ward linkage

73

0.63

0.29

0.02

0.4

0.62

0.95

1

Ranks for nacc (best=1):

count

mean

std

min

25%

50%

75%

max

Average linkage

73

6.6

3.9

1

3

8

10

13

Birch_0.01

73

6.2

3.3

1

5

6

8

13

Centroid linkage

73

7.1

4

1

4

8

11

13

Complete linkage

73

8.2

3.2

1

7

9

11

13

Gaussian mixtures

73

4.5

4.2

1

1

2

8

13

Genie_0.1

73

4

3.9

1

1

2

7

13

Genie_0.3

73

3.8

3.6

1

1

2

6

12

Genie_0.5

73

4.4

4.2

1

1

2

8

13

ITM

73

5.6

4.3

1

1

5

10

13

K-means

73

6.1

4

1

1

7

9

13

Single linkage

73

8.1

5.5

1

1

11

13

13

Spectral_RBF_5

73

5.4

3.8

1

1

5

8

13

Ward linkage

73

6.5

3.4

1

4

7

9

13

Raw results for nacc (best=1.0):

Average linkage

Birch_0.01

Centroid linkage

Complete linkage

Gaussian mixtures

Genie_0.1

Genie_0.3

Genie_0.5

ITM

K-means

Single linkage

Spectral_RBF_5

Ward linkage

fcps/atom

0.31

0.31

0.05

0.29

0.17

1

1

1

1

0.43

1

1

0.31

fcps/chainlink

0.52

0.53

0.64

0.56

0.95

1

1

1

1

0.31

1

1

0.53

fcps/engytime

0.23

0.88

0.17

0.2

0.99

0.92

0.92

0.92

0.91

0.92

0

0.96

0.86

fcps/hepta

1

1

1

1

1

1

1

1

0.94

1

1

1

1

fcps/lsun

0.58

0.62

0.58

0.62

1

1

1

1

1

0.65

1

0.89

0.58

fcps/target

0.6

0.6

0.53

0.66

0.58

1

1

1

1

0.55

1

1

0.59

fcps/tetra

1

0.98

1

0.99

1

1

1

1

1

1

0.01

1

0.98

fcps/twodiamonds

1

1

1

0.99

1

0.99

0.99

0.99

0.99

1

0

1

1

fcps/wingnut

1

1

1

1

0.93

1

1

1

1

0.93

1

0.88

0.78

graves/dense

0.96

0.96

0.96

0.51

1

0.98

0.98

0.98

1

0.9

0.03

0.96

0.96

graves/fuzzyx

0.86

0.87

0.82

0.88

0.94

0.78

0.59

0.64

0.94

0.96

0.17

0.69

0.79

graves/line

0.01

0.01

0.13

0.02

1

0.19

1

1

0.35

0.14

1

1

0.19

graves/parabolic

0.77

0.76

0.81

0.77

0.73

0.9

0.9

0.9

0.8

0.77

0.1

0.81

0.79

graves/ring

0.34

0.34

0.22

0.46

0.17

1

1

1

1

0.01

1

1

0.34

graves/ring_noisy

0

0.34

0

0.52

0.16

1

1

1

1

0.4

0

1

0.38

graves/ring_outliers

0.58

0.57

0.51

0.53

0.55

1

1

1

1

0.55

1

1

0.58

graves/zigzag

0.69

0.73

0.62

0.55

0.98

1

1

1

0.86

0.7

1

0.81

0.63

graves/zigzag_noisy

0.65

0.77

0.65

0.58

0.95

0.88

1

1

0.67

0.64

0.5

0.78

0.79

graves/zigzag_outliers

0.34

0.53

0.34

0.46

0.99

1

1

1

0.89

0.51

0.53

0.4

0.42

other/chameleon_t4_8k

0.72

0.63

0.75

0.6

0.63

0.77

1

0.89

0.83

0.63

0.09

0.64

0.62

other/chameleon_t5_8k

1

1

1

0.79

1

1

1

0.82

0.69

1

0.01

1

1

other/chameleon_t7_10k

0.49

0.45

0.44

0.43

0.4

0.55

0.77

1

0.61

0.44

0.21

0.41

0.51

other/chameleon_t8_8k

0.41

0.46

0.43

0.39

0.51

0.6

0.6

0.79

0.58

0.4

0.09

0.4

0.4

other/hdbscan

0.4

0.72

0.44

0.54

0.86

0.98

0.74

0.74

0.86

0.77

0.07

0.47

0.91

other/iris

0.86

0.84

0.86

0.76

0.95

0.94

0.94

0.55

0.94

0.84

0.52

0.85

0.84

other/iris5

0.8

0.77

0.8

0.66

0.93

0.66

0.66

0.91

0.54

0.77

0.31

0.79

0.77

other/square

0.39

0.01

0.5

0.41

0.19

1

1

1

1

0.17

1

0.41

0.5

sipu/a1

0.96

0.96

0.97

0.96

0.98

0.97

0.91

0.84

0.82

0.98

0.37

0.97

0.95

sipu/a2

0.97

0.97

0.97

0.95

0.98

0.97

0.94

0.83

0.83

0.98

0.3

0.93

0.96

sipu/a3

0.97

0.97

0.96

0.96

0.96

0.98

0.95

0.84

0.83

0.96

0.25

0.95

0.97

sipu/aggregation

1

0.82

1

0.75

1

0.55

0.63

0.86

0.63

0.75

0.79

1

0.81

sipu/compound

0.94

0.81

0.93

0.94

0.94

0.75

0.76

0.89

0.66

0.73

0.94

0.82

0.81

sipu/d31

0.94

0.96

0.94

0.96

0.97

0.97

0.93

0.76

0.85

0.98

0.24

0.97

0.96

sipu/flame

0.67

0.47

0.29

0.03

0.59

1

1

1

0.6

0.69

0.29

0.91

0.47

sipu/jain

0.89

0.72

0.72

0.89

0.16

0.25

1

1

0.57

0.57

0.62

0.72

0.72

sipu/pathbased

0.66

0.64

0.67

0.52

0.66

0.98

0.98

0.74

0.68

0.61

0.09

0.68

0.64

sipu/r15

1

1

1

1

1

0.99

0.99

1

0.99

1

1

1

1

sipu/s1

0.99

0.99

0.99

0.98

0.99

0.99

0.99

0.99

0.8

0.99

0.44

0.99

0.99

sipu/s2

0.95

0.95

0.9

0.84

0.97

0.96

0.96

0.84

0.86

0.97

0.01

0.97

0.95

sipu/s3

0.67

0.8

0.63

0.57

0.85

0.82

0.77

0.63

0.75

0.84

0.01

0.84

0.81

sipu/s4

0.59

0.68

0.54

0.53

0.79

0.77

0.73

0.54

0.66

0.78

0.01

0.7

0.68

sipu/spiral

0.04

0.07

0.08

0.06

0.03

1

1

1

0.83

0.01

1

0.02

0.07

sipu/unbalance

1

1

1

0.64

1

0.47

0.59

0.75

0.41

1

0.98

1

1

uci/ecoli

0.73

0.59

0.59

0.68

0.66

0.46

0.51

0.65

0.46

0.57

0.37

0.58

0.59

uci/glass

0.25

0.38

0.24

0.38

0.41

0.27

0.38

0.38

0.39

0.45

0.24

0.39

0.4

uci/ionosphere

0.29

0.44

0.29

0.29

0.64

0.46

0.46

0.08

0.3

0.42

0.29

0.29

0.44

uci/sonar

0.11

0.02

0.01

0.02

0.08

0.02

0.02

0.11

0.08

0.11

0.08

0.08

0.02

uci/statlog

0

0.45

0

0.17

0.53

0.74

0.59

0.51

0.6

0.43

0

nan

0.41

uci/wdbc

0.33

0.56

0.33

0.33

0.84

0.31

0.55

0.55

0.79

0.71

0.26

0.26

0.56

uci/wine

0.42

0.54

0.42

0.51

0.91

0.57

0.57

0.3

0.58

0.55

0.14

0.44

0.54

uci/yeast

0.25

0.32

0.25

0.28

0.29

0.24

0.36

0.3

0.21

0.32

0.24

0.25

0.29

wut/circles

1

1

1

1

1

1

1

1

1

1

1

1

1

wut/cross

0.03

0.17

0.03

0.32

0.48

0.87

0.68

0.38

0.44

0.39

0

0.01

0.31

wut/graph

0.56

0.58

0.58

0.56

0.93

0.63

0.59

0.45

0.63

0.59

0.07

0.58

0.62

wut/isolation

0.03

0.04

0.03

0.02

0.01

1

1

1

1

0.01

1

0.01

0.05

wut/labirynth

0.5

0.59

0.43

0.46

0.65

0.55

0.61

0.72

0.72

0.44

0.72

0.51

0.46

wut/mk1

1

1

1

0.98

1

1

1

1

0.68

1

0.5

1

1

wut/mk2

0.07

0.11

0.07

0.09

0.09

1

1

1

1

0.09

1

0.08

0.07

wut/mk3

0.5

0.92

0.5

0.92

0.94

0.88

0.88

0.58

0.68

0.94

0

0.93

0.93

wut/mk4

0.18

0.31

0.21

0.42

0.55

1

1

1

0.74

0.37

1

0.39

0.36

wut/olympic

0.27

0.26

0.31

0.21

0.2

0.32

0.29

0.25

0.36

0.22

0

0.26

0.21

wut/smile

0.99

0.71

0.99

0.83

0.54

0.63

1

1

0.58

0.72

1

1

0.77

wut/stripes

0.05

0.04

0.16

0.11

0.11

1

1

1

1

0.11

1

0.11

0.12

wut/trajectories

1

1

1

0.74

1

1

1

1

1

1

1

1

1

wut/trapped_lovers

0.25

0.29

0.26

0.5

0.3

0.57

1

1

0.56

0.36

1

0.88

0.37

wut/twosplashes

0.05

0.53

0.05

0.47

0.82

0.71

0.71

0.71

0.86

0.53

0.01

0.53

0.44

wut/windows

0.35

0.34

0.28

0.19

0.42

0.31

0.35

1

0.33

0.3

1

0.18

0.31

wut/x1

1

1

1

1

1

1

1

1

1

1

1

1

1

wut/x2

0.41

0.31

0.41

0.32

0.84

0.84

0.84

0.32

0.84

0.32

0.1

0.42

0.31

wut/x3

0.55

0.94

0.55

0.7

0.95

0.94

0.5

0.5

0.69

0.93

0.15

0.58

0.96

wut/z1

0.32

0.27

0.37

0.36

0.11

0.5

0.5

0.3

0.5

0.31

0.06

0.33

0.27

wut/z2

0.59

0.67

0.59

0.59

1

0.66

0.7

0.81

0.65

0.64

0.86

0.99

0.57

wut/z3

1

1

1

0.96

1

0.67

0.68

0.95

0.74

1

0.73

0.99

1

psi

Summary statistics for psi (best=1.0):

count

mean

std

min

25%

50%

75%

max

Average linkage

73

0.5

0.37

0

0.18

0.42

0.94

1

Birch_0.01

73

0.54

0.34

0

0.23

0.53

0.92

1

Centroid linkage

73

0.48

0.37

0

0.12

0.41

0.92

1

Complete linkage

73

0.48

0.32

0

0.21

0.39

0.74

1

Gaussian mixtures

73

0.64

0.36

0

0.3

0.82

0.98

1

Genie_0.1

73

0.73

0.32

0

0.47

0.89

1

1

Genie_0.3

73

0.76

0.29

0

0.47

0.94

1

1

Genie_0.5

73

0.73

0.32

0

0.49

0.85

1

1

ITM

73

0.67

0.28

0.01

0.49

0.72

0.99

1

K-means

73

0.56

0.33

0

0.28

0.52

0.93

1

Single linkage

73

0.41

0.44

0

0

0.2

1

1

Spectral_RBF_5

72

0.64

0.36

0

0.3

0.76

0.99

1

Ward linkage

73

0.55

0.33

0

0.24

0.49

0.92

1

Ranks for psi (best=1):

count

mean

std

min

25%

50%

75%

max

Average linkage

73

7

3.7

1

4

8

10

13

Birch_0.01

73

5.9

3.4

1

4

6

9

13

Centroid linkage

73

7.3

4

1

4

8

11

13

Complete linkage

73

8.4

3.1

1

7

9

11

13

Gaussian mixtures

73

4.7

4.3

1

1

3

9

13

Genie_0.1

73

4

3.8

1

1

3

6

13

Genie_0.3

73

3.7

3.7

1

1

2

5

13

Genie_0.5

73

4.6

4.4

1

1

1

10

13

ITM

73

5.4

4.2

1

1

4

9

13

K-means

73

5.4

3.7

1

1

6

8

13

Single linkage

73

8.3

5.4

1

1

11

13

13

Spectral_RBF_5

73

5.6

3.8

1

1

6

8

13

Ward linkage

73

6.3

3.5

1

4

7

9

13

Raw results for psi (best=1.0):

Average linkage

Birch_0.01

Centroid linkage

Complete linkage

Gaussian mixtures

Genie_0.1

Genie_0.3

Genie_0.5

ITM

K-means

Single linkage

Spectral_RBF_5

Ward linkage

fcps/atom

0.19

0.19

0.03

0.17

0.09

1

1

1

1

0.27

1

1

0.19

fcps/chainlink

0.35

0.36

0.47

0.39

0.95

1

1

1

1

0.31

1

1

0.36

fcps/engytime

0.13

0.88

0.09

0.11

0.98

0.85

0.85

0.85

0.91

0.88

0

0.92

0.77

fcps/hepta

1

1

1

1

1

1

1

1

0.9

1

1

1

1

fcps/lsun

0.45

0.51

0.45

0.51

1

1

1

1

1

0.54

1

0.81

0.46

fcps/target

0.79

0.25

0.77

0.82

0.17

1

1

1

1

0.28

1

1

0.33

fcps/tetra

0.99

0.97

1

0.99

1

1

1

1

1

1

0.01

1

0.97

fcps/twodiamonds

1

1

1

0.99

1

0.98

0.98

0.98

0.99

1

0

1

1

fcps/wingnut

1

1

1

1

0.93

1

1

1

1

0.93

1

0.88

0.78

graves/dense

0.92

0.92

0.92

0.34

1

0.96

0.96

0.96

1

0.82

0.02

0.92

0.92

graves/fuzzyx

0.76

0.79

0.71

0.81

0.89

0.67

0.47

0.49

0.89

0.93

0

0.58

0.68

graves/line

0

0

0

0

1

0.02

1

1

0.2

0

1

1

0

graves/parabolic

0.75

0.6

0.79

0.67

0.7

0.84

0.84

0.84

0.78

0.76

0

0.79

0.72

graves/ring

0.2

0.21

0.12

0.3

0.09

1

1

1

1

0.01

1

1

0.21

graves/ring_noisy

0

0.2

0

0.35

0.08

1

1

1

1

0.25

0

1

0.24

graves/ring_outliers

0.19

0.17

0.21

0.15

0.14

1

1

1

1

0.24

1

1

0.17

graves/zigzag

0.54

0.64

0.47

0.38

0.96

1

1

1

0.79

0.6

1

0.71

0.53

graves/zigzag_noisy

0.51

0.68

0.55

0.42

0.93

0.8

1

1

0.62

0.52

0.4

0.68

0.71

graves/zigzag_outliers

0.17

0.4

0.17

0.29

0.98

1

1

1

0.83

0.33

0.4

0.22

0.25

other/chameleon_t4_8k

0.54

0.51

0.55

0.48

0.47

0.64

1

0.72

0.69

0.52

0

0.52

0.48

other/chameleon_t5_8k

1

1

1

0.73

1

1

1

0.71

0.57

1

0

1

1

other/chameleon_t7_10k

0.33

0.28

0.25

0.28

0.27

0.42

0.71

1

0.46

0.31

0

0.31

0.37

other/chameleon_t8_8k

0.28

0.34

0.31

0.26

0.34

0.41

0.34

0.68

0.4

0.28

0

0.27

0.28

other/hdbscan

0.19

0.56

0.24

0.39

0.74

0.97

0.69

0.69

0.78

0.72

0

0.34

0.86

other/iris

0.76

0.74

0.76

0.64

0.91

0.9

0.9

0.4

0.9

0.76

0.38

0.75

0.74

other/iris5

0.77

0.75

0.77

0.65

0.91

0.34

0.34

0.91

0.28

0.76

0.41

0.75

0.75

other/square

0.24

0.01

0.33

0.26

0.17

1

1

1

1

0.15

1

0.26

0.34

sipu/a1

0.94

0.94

0.94

0.93

0.97

0.95

0.88

0.76

0.74

0.98

0.2

0.95

0.93

sipu/a2

0.95

0.95

0.95

0.92

0.97

0.96

0.92

0.75

0.77

0.98

0.14

0.9

0.93

sipu/a3

0.95

0.95

0.93

0.93

0.94

0.97

0.94

0.77

0.76

0.94

0.1

0.92

0.95

sipu/aggregation

1

0.7

0.99

0.67

1

0.31

0.45

0.8

0.47

0.65

0.58

0.99

0.7

sipu/compound

0.64

0.67

0.7

0.64

0.67

0.59

0.67

0.7

0.54

0.68

0.64

0.65

0.67

sipu/d31

0.91

0.95

0.91

0.95

0.96

0.95

0.9

0.69

0.81

0.97

0.15

0.95

0.94

sipu/flame

0.48

0.17

0.01

0

0.36

1

1

1

0.37

0.56

0.01

0.91

0.17

sipu/jain

0.74

0.53

0.53

0.74

0

0.01

1

1

0.39

0.39

0.21

0.53

0.53

sipu/pathbased

0.4

0.49

0.41

0.35

0.4

0.97

0.97

0.6

0.57

0.42

0

0.43

0.49

sipu/r15

1

1

1

1

1

0.99

0.99

1

0.99

1

1

1

1

sipu/s1

0.99

0.99

0.99

0.97

0.99

0.99

0.99

0.99

0.73

0.99

0.28

0.99

0.99

sipu/s2

0.94

0.92

0.85

0.75

0.96

0.94

0.94

0.78

0.8

0.96

0

0.96

0.93

sipu/s3

0.55

0.77

0.49

0.46

0.82

0.76

0.7

0.51

0.69

0.82

0

0.8

0.76

sipu/s4

0.44

0.62

0.39

0.4

0.75

0.72

0.67

0.41

0.59

0.75

0

0.59

0.63

sipu/spiral

0.03

0.06

0.05

0.05

0.03

1

1

1

0.72

0.01

1

0.02

0.06

sipu/unbalance

1

1

1

0.74

1

0.17

0.21

0.26

0.15

1

0.78

1

1

uci/ecoli

0.39

0.41

0.27

0.34

0.39

0.29

0.3

0.27

0.33

0.4

0.18

0.34

0.41

uci/glass

0.06

0.21

0.05

0.21

0.22

0.19

0.27

0.21

0.22

0.27

0.05

0.16

0.22

uci/ionosphere

0.01

0.35

0.01

0.01

0.53

0.4

0.4

0

0.17

0.34

0.01

0.01

0.35

uci/sonar

0.03

0

0

0

0.01

0

0

0.04

0.01

0.05

0.01

0.01

0

uci/statlog

0

0.35

0

0.13

0.42

0.71

0.52

0.42

0.52

0.32

0

nan

0.32

uci/wdbc

0.06

0.3

0.06

0.06

0.73

0.06

0.3

0.3

0.73

0.5

0

0

0.3

uci/wine

0.23

0.48

0.23

0.42

0.83

0.46

0.46

0.13

0.46

0.48

0.03

0.25

0.48

uci/yeast

0.17

0.23

0.1

0.17

0.18

0.16

0.17

0.13

0.13

0.24

0.13

0.14

0.21

wut/circles

1

1

1

1

1

1

1

1

1

1

1

1

1

wut/cross

0.02

0.11

0.02

0.17

0.3

0.78

0.55

0.27

0.33

0.28

0

0.01

0.22

wut/graph

0.38

0.42

0.4

0.38

0.88

0.53

0.46

0.26

0.55

0.43

0.05

0.4

0.46

wut/isolation

0.03

0.03

0.02

0.02

0.01

1

1

1

1

0.01

1

0.01

0.04

wut/labirynth

0.31

0.42

0.24

0.31

0.57

0.35

0.46

0.69

0.69

0.31

0.52

0.34

0.29

wut/mk1

0.99

0.99

0.99

0.97

0.99

0.99

0.99

0.99

0.55

0.99

0.35

0.99

0.99

wut/mk2

0.07

0.09

0.06

0.09

0.08

1

1

1

1

0.09

1

0.07

0.06

wut/mk3

0.35

0.89

0.35

0.87

0.92

0.82

0.82

0.43

0.56

0.93

0

0.92

0.91

wut/mk4

0.1

0.2

0.11

0.3

0.55

1

1

1

0.63

0.25

1

0.27

0.24

wut/olympic

0.22

0.24

0.25

0.2

0.18

0.25

0.26

0.21

0.31

0.21

0

0.24

0.19

wut/smile

0.98

0.65

0.98

0.58

0.43

0.47

1

1

0.62

0.66

1

1

0.69

wut/stripes

0.04

0.03

0.15

0.09

0.11

1

1

1

1

0.1

1

0.11

0.08

wut/trajectories

1

1

1

0.62

1

1

1

1

1

1

1

1

1

wut/trapped_lovers

0.13

0.15

0.1

0.34

0.17

0.5

1

1

0.49

0.21

1

0.77

0.21

wut/twosplashes

0.03

0.53

0.03

0.44

0.82

0.71

0.71

0.71

0.75

0.53

0.01

0.53

0.37

wut/windows

0.28

0.28

0.23

0.06

0.34

0.29

0.39

1

0.2

0.24

1

0.08

0.26

wut/x1

1

1

1

1

1

1

1

1

1

1

1

1

1

wut/x2

0.18

0.11

0.18

0.12

0.74

0.74

0.74

0.12

0.75

0.12

0

0.19

0.11

wut/x3

0.42

0.9

0.42

0.59

0.93

0.89

0.37

0.37

0.49

0.88

0.01

0.45

0.92

wut/z1

0.25

0.2

0.29

0.33

0.09

0.38

0.38

0.19

0.38

0.31

0.04

0.31

0.2

wut/z2

0.45

0.56

0.45

0.39

1

0.56

0.47

0.63

0.56

0.51

0.47

0.99

0.51

wut/z3

1

0.99

1

0.92

0.99

0.49

0.44

0.9

0.6

1

0.55

0.97

1

Summary

Medians and means of the partition similarity scores (read row-wise, in groups of 2 columns):

../_images/benchmarks_details_indices_small_1.png

Heat map of median and mean similarity scores

Large Datasets

ar

Summary statistics for ar (best=1.0):

count

mean

std

min

25%

50%

75%

max

Centroid linkage

6

0.35

0.46

0

0

0.12

0.7

1

Genie_0.1

6

0.66

0.26

0.31

0.48

0.65

0.85

1

Genie_0.3

6

0.52

0.37

0.07

0.25

0.46

0.81

1

Genie_0.5

6

0.35

0.43

0

0.02

0.17

0.63

1

ITM

6

0.6

0.18

0.37

0.46

0.65

0.71

0.8

K-means

6

0.61

0.31

0.32

0.35

0.52

0.88

0.99

Single linkage

6

0.07

0.18

0

0

0

0

0.44

Ward linkage

6

0.58

0.27

0.33

0.38

0.47

0.75

1

Ranks for ar (best=1):

count

mean

std

min

25%

50%

75%

max

Centroid linkage

6

5.3

2.4

1

4.5

6.5

7

7

Genie_0.1

6

1.8

1.2

1

1

1.5

2

4

Genie_0.3

6

3.2

1.7

1

2

3

4.8

5

Genie_0.5

6

5

2

1

5.2

6

6

6

ITM

6

3.7

2.7

1

1.5

3

6

7

K-means

6

3.5

1.9

1

2.2

3.5

4.8

6

Single linkage

6

7.3

0.8

6

7

7.5

8

8

Ward linkage

6

3.3

1.6

1

2.2

3.5

4.8

5

Raw results for ar (best=1.0):

Centroid linkage

Genie_0.1

Genie_0.3

Genie_0.5

ITM

K-means

Single linkage

Ward linkage

mnist/digits

0

0.6

0.21

0.02

0.8

0.37

0

0.53

mnist/fashion

0

0.31

0.07

0.02

0.41

0.35

0

0.37

sipu/birch1

0.85

0.89

0.89

0.73

0.72

0.94

0

0.83

sipu/birch2

1

1

1

1

0.71

0.99

0.44

1

sipu/worms_2

0.23

0.45

0.38

0.32

0.37

0.32

0

0.33

sipu/worms_64

0

0.7

0.54

0

0.59

0.67

0

0.42

fm

Summary statistics for fm (best=1.0):

count

mean

std

min

25%

50%

75%

max

Centroid linkage

6

0.5

0.33

0.2

0.32

0.33

0.72

1

Genie_0.1

6

0.69

0.23

0.42

0.51

0.68

0.85

1

Genie_0.3

6

0.6

0.29

0.31

0.4

0.49

0.82

1

Genie_0.5

6

0.49

0.31

0.2

0.31

0.34

0.65

1

ITM

6

0.62

0.16

0.39

0.51

0.66

0.72

0.82

K-means

6

0.64

0.28

0.35

0.42

0.56

0.88

0.99

Single linkage

6

0.28

0.15

0.1

0.19

0.26

0.32

0.53

Ward linkage

6

0.61

0.25

0.36

0.45

0.52

0.77

1

Ranks for fm (best=1):

count

mean

std

min

25%

50%

75%

max

Centroid linkage

6

4.8

2.1

1

4.2

5.5

6

7

Genie_0.1

6

1.7

0.8

1

1

1.5

2

3

Genie_0.3

6

3.5

2.3

1

2

3

4.8

7

Genie_0.5

6

5.3

2.5

1

4.5

6

6.8

8

ITM

6

3.7

2.7

1

1.5

3

6

7

K-means

6

3.7

2.1

1

2.2

3.5

5.5

6

Single linkage

6

6.8

1.3

5

6

7

8

8

Ward linkage

6

3.3

1.6

1

2.2

3.5

4.8

5

Raw results for fm (best=1.0):

Centroid linkage

Genie_0.1

Genie_0.3

Genie_0.5

ITM

K-means

Single linkage

Ward linkage

mnist/digits

0.32

0.65

0.41

0.31

0.82

0.43

0.32

0.58

mnist/fashion

0.32

0.42

0.31

0.31

0.47

0.42

0.32

0.44

sipu/birch1

0.85

0.89

0.89

0.75

0.72

0.94

0.1

0.83

sipu/birch2

1

1

1

1

0.72

0.99

0.53

1

sipu/worms_2

0.34

0.47

0.4

0.36

0.39

0.35

0.19

0.36

sipu/worms_64

0.2

0.72

0.58

0.2

0.61

0.69

0.2

0.47

ami

Summary statistics for ami (best=1.0):

count

mean

std

min

25%

50%

75%

max

Centroid linkage

6

0.41

0.48

0

0

0.27

0.83

1

Genie_0.1

6

0.77

0.17

0.57

0.67

0.74

0.9

1

Genie_0.3

6

0.7

0.24

0.37

0.59

0.66

0.88

1

Genie_0.5

6

0.49

0.42

0

0.19

0.41

0.84

1

ITM

6

0.75

0.15

0.56

0.63

0.74

0.87

0.91

K-means

6

0.72

0.22

0.5

0.53

0.66

0.91

1

Single linkage

6

0.15

0.36

0

0

0

0

0.89

Ward linkage

6

0.75

0.17

0.56

0.62

0.7

0.87

1

Ranks for ami (best=1):

count

mean

std

min

25%

50%

75%

max

Centroid linkage

6

5.3

2.4

1

4.5

6.5

7

7

Genie_0.1

6

1.3

0.5

1

1

1

1.8

2

Genie_0.3

6

3

1.5

1

2

3

4

5

Genie_0.5

6

4.7

2

1

4.2

5.5

6

6

ITM

6

4.2

2.6

1

2.2

4

6.5

7

K-means

6

2.8

2

1

1

2.5

4.8

5

Single linkage

6

7.3

0.8

6

7

7.5

8

8

Ward linkage

6

2.8

1.8

1

1.2

2.5

4.5

5

Raw results for ami (best=1.0):

Centroid linkage

Genie_0.1

Genie_0.3

Genie_0.5

ITM

K-means

Single linkage

Ward linkage

mnist/digits

0

0.75

0.57

0.18

0.83

0.5

0

0.68

mnist/fashion

0

0.57

0.37

0.21

0.56

0.51

0

0.56

sipu/birch1

0.93

0.94

0.94

0.92

0.89

0.98

0

0.92

sipu/birch2

1

1

1

1

0.91

1

0.89

1

sipu/worms_2

0.53

0.65

0.63

0.61

0.62

0.6

0

0.6

sipu/worms_64

0

0.72

0.68

0

0.66

0.72

0

0.72

nmi

Summary statistics for nmi (best=1.0):

count

mean

std

min

25%

50%

75%

max

Centroid linkage

6

0.41

0.48

0

0

0.27

0.83

1

Genie_0.1

6

0.77

0.17

0.57

0.67

0.74

0.9

1

Genie_0.3

6

0.7

0.24

0.37

0.59

0.66

0.88

1

Genie_0.5

6

0.49

0.42

0

0.19

0.41

0.84

1

ITM

6

0.75

0.15

0.56

0.63

0.75

0.87

0.91

K-means

6

0.72

0.22

0.5

0.53

0.66

0.91

1

Single linkage

6

0.15

0.36

0

0

0

0

0.89

Ward linkage

6

0.75

0.17

0.56

0.62

0.7

0.87

1

Ranks for nmi (best=1):

count

mean

std

min

25%

50%

75%

max

Centroid linkage

6

5.3

2.4

1

4.5

6.5

7

7

Genie_0.1

6

1.5

0.5

1

1

1.5

2

2

Genie_0.3

6

3

1.5

1

2

3

4

5

Genie_0.5

6

4.7

2

1

4.2

5.5

6

6

ITM

6

4.2

2.6

1

2.2

4

6.5

7

K-means

6

3

1.9

1

1.2

3

4.8

5

Single linkage

6

7.3

0.8

6

7

7.5

8

8

Ward linkage

6

2.8

1.8

1

1.2

2.5

4.5

5

Raw results for nmi (best=1.0):

Centroid linkage

Genie_0.1

Genie_0.3

Genie_0.5

ITM

K-means

Single linkage

Ward linkage

mnist/digits

0

0.75

0.57

0.18

0.83

0.5

0

0.68

mnist/fashion

0

0.57

0.37

0.21

0.56

0.51

0

0.56

sipu/birch1

0.93

0.94

0.94

0.92

0.89

0.98

0

0.92

sipu/birch2

1

1

1

1

0.91

1

0.89

1

sipu/worms_2

0.53

0.65

0.63

0.61

0.62

0.6

0

0.6

sipu/worms_64

0

0.72

0.68

0

0.66

0.72

0

0.73

nacc

Summary statistics for nacc (best=1.0):

count

mean

std

min

25%

50%

75%

max

Centroid linkage

6

0.37

0.47

0

0

0.14

0.75

1

Genie_0.1

6

0.75

0.22

0.43

0.61

0.77

0.92

1

Genie_0.3

6

0.61

0.33

0.16

0.39

0.61

0.88

1

Genie_0.5

6

0.4

0.43

0

0.06

0.26

0.71

1

ITM

6

0.71

0.15

0.49

0.6

0.75

0.79

0.89

K-means

6

0.67

0.26

0.42

0.44

0.62

0.91

0.99

Single linkage

6

0.1

0.24

0

0

0.01

0.02

0.59

Ward linkage

6

0.68

0.23

0.44

0.48

0.65

0.86

1

Ranks for nacc (best=1):

count

mean

std

min

25%

50%

75%

max

Centroid linkage

6

5.3

2.4

1

4.5

6.5

7

7

Genie_0.1

6

1.7

0.8

1

1

1.5

2

3

Genie_0.3

6

3.3

1.9

1

2

3.5

5

5

Genie_0.5

6

5

2

1

5.2

6

6

6

ITM

6

3.5

2.5

1

1.5

3

5.2

7

K-means

6

3.8

2

1

2.5

4

5.5

6

Single linkage

6

7.3

0.8

6

7

7.5

8

8

Ward linkage

6

3.2

1.5

1

2.2

3.5

4

5

Raw results for nacc (best=1.0):

Centroid linkage

Genie_0.1

Genie_0.3

Genie_0.5

ITM

K-means

Single linkage

Ward linkage

mnist/digits

0.01

0.7

0.35

0.07

0.89

0.48

0.01

0.58

mnist/fashion

0

0.43

0.16

0.06

0.56

0.42

0

0.44

sipu/birch1

0.92

0.94

0.94

0.8

0.8

0.96

0

0.91

sipu/birch2

1

1

1

1

0.77

0.99

0.59

1

sipu/worms_2

0.27

0.58

0.51

0.44

0.49

0.43

0.03

0.45

sipu/worms_64

0

0.84

0.7

0

0.74

0.75

0

0.73

psi

Summary statistics for psi (best=1.0):

count

mean

std

min

25%

50%

75%

max

Centroid linkage

6

0.33

0.48

0

0

0.03

0.68

1

Genie_0.1

6

0.7

0.25

0.37

0.51

0.72

0.9

1

Genie_0.3

6

0.57

0.35

0.13

0.31

0.53

0.86

1

Genie_0.5

6

0.36

0.42

0

0.04

0.18

0.63

1

ITM

6

0.65

0.16

0.39

0.57

0.69

0.73

0.85

K-means

6

0.62

0.3

0.31

0.36

0.57

0.88

0.98

Single linkage

6

0.09

0.21

0

0

0

0

0.52

Ward linkage

6

0.62

0.28

0.31

0.39

0.6

0.83

1

Ranks for psi (best=1):

count

mean

std

min

25%

50%

75%

max

Centroid linkage

6

5.3

2.4

1

4.5

6.5

7

7

Genie_0.1

6

1.5

0.5

1

1

1.5

2

2

Genie_0.3

6

3.3

1.9

1

2

3.5

5

5

Genie_0.5

6

5

2.2

1

4.5

6

6

7

ITM

6

3.5

2.5

1

1.5

3

5.2

7

K-means

6

3.8

1.7

1

3.2

4

4.8

6

Single linkage

6

7.3

0.8

6

7

7.5

8

8

Ward linkage

6

3.2

1.6

1

2.2

3

4.5

5

Raw results for psi (best=1.0):

Centroid linkage

Genie_0.1

Genie_0.3

Genie_0.5

ITM

K-means

Single linkage

Ward linkage

mnist/digits

0

0.6

0.28

0.05

0.85

0.43

0

0.5

mnist/fashion

0

0.37

0.13

0.04

0.53

0.33

0

0.35

sipu/birch1

0.89

0.92

0.92

0.73

0.75

0.94

0

0.87

sipu/birch2

1

1

1

1

0.69

0.98

0.52

1

sipu/worms_2

0.07

0.48

0.4

0.32

0.39

0.31

0

0.31

sipu/worms_64

0

0.84

0.66

0

0.7

0.7

0

0.71

Summary

Medians and means of the partition similarity scores:

../_images/benchmarks_details_indices_large_1.png

Heat map of median and mean similarity scores