# Learning New Dimensions of Human Visual Similarity using Synthetic Data

## Supplementary Material

### Submission Number: 3743

- Dataset Examples (Section 3 & Figure 1)
- Nearest Neighbor Visualizations (Section 6 & Figure 8)
- Inversion Visualizations (Section 6 & Figure 9)
- Supplementary Material PDF

## Dataset Examples

Examples of triplets from our dataset.

- DreamSim-All Metrics Disagreement
- DreamSim-LPIPS Disagreement
- DreamSim-DINO Disagreement
- DreamSim-CLIP Disagreement
- Random

57415

Humans

DreamSim

CLIP

DINO

LPIPS

16297

Humans

DreamSim

CLIP

DINO

LPIPS

71617

Humans

DreamSim

CLIP

DINO

LPIPS

36138

Humans

DreamSim

CLIP

DINO

LPIPS

95017

Humans

DreamSim

CLIP

DINO

LPIPS

10128

Humans

DreamSim

CLIP

DINO

LPIPS

19336

Humans

DreamSim

CLIP

DINO

LPIPS

61196

Humans

DreamSim

CLIP

DINO

LPIPS

91828

Humans

DreamSim

CLIP

DINO

LPIPS

85015

Humans

DreamSim

CLIP

DINO

LPIPS

32162

Humans

DreamSim

CLIP

DINO

LPIPS

89576

Humans

DreamSim

CLIP

DINO

LPIPS

81818

Humans

DreamSim

CLIP

DINO

LPIPS

34778

Humans

DreamSim

CLIP

DINO

LPIPS

29755

Humans

DreamSim

CLIP

DINO

LPIPS

51773

Humans

DreamSim

CLIP

DINO

LPIPS

56046

Humans

DreamSim

CLIP

DINO

LPIPS

19391

Humans

DreamSim

CLIP

DINO

LPIPS

55550

Humans

DreamSim

CLIP

DINO

LPIPS

98247

Humans

DreamSim

CLIP

DINO

LPIPS

24264

Humans

DreamSim

CLIP

DINO

LPIPS

55111

Humans

DreamSim

CLIP

DINO

LPIPS

61480

Humans

DreamSim

CLIP

DINO

LPIPS

35841

Humans

DreamSim

CLIP

DINO

LPIPS

32353

Humans

DreamSim

CLIP

DINO

LPIPS

53466

Humans

DreamSim

CLIP

DINO

LPIPS

70597

Humans

DreamSim

CLIP

DINO

LPIPS

71888

Humans

DreamSim

CLIP

DINO

LPIPS

39582

Humans

DreamSim

CLIP

DINO

LPIPS

38432

Humans

DreamSim

CLIP

DINO

LPIPS

50521

Humans

DreamSim

CLIP

DINO

LPIPS

29155

Humans

DreamSim

CLIP

DINO

LPIPS

84581

Humans

DreamSim

CLIP

DINO

LPIPS

50397

Humans

DreamSim

CLIP

DINO

LPIPS

98303

Humans

DreamSim

CLIP

DINO

LPIPS

43140

Humans

DreamSim

CLIP

DINO

LPIPS

85518

Humans

DreamSim

CLIP

DINO

LPIPS

62805

Humans

DreamSim

CLIP

DINO

LPIPS

47342

Humans

DreamSim

CLIP

DINO

LPIPS

51561

Humans

DreamSim

CLIP

DINO

LPIPS

32036

Humans

DreamSim

CLIP

DINO

LPIPS

24296

Humans

DreamSim

CLIP

DINO

LPIPS

24809

Humans

DreamSim

CLIP

DINO

LPIPS

45886

Humans

DreamSim

CLIP

DINO

LPIPS

90714

Humans

DreamSim

CLIP

DINO

LPIPS

82900

Humans

DreamSim

CLIP

DINO

LPIPS

23953

Humans

DreamSim

CLIP

DINO

LPIPS

86726

Humans

DreamSim

CLIP

DINO

LPIPS

51600

Humans

DreamSim

CLIP

DINO

LPIPS

80741

Humans

DreamSim

CLIP

DINO

LPIPS

30043

Humans

DreamSim

CLIP

DINO

LPIPS

91003

Humans

DreamSim

CLIP

DINO

LPIPS

93666

Humans

DreamSim

CLIP

DINO

LPIPS

64048

Humans

DreamSim

CLIP

DINO

LPIPS

76027

Humans

DreamSim

CLIP

DINO

LPIPS

8296

Humans

DreamSim

CLIP

DINO

LPIPS

78077

Humans

DreamSim

CLIP

DINO

LPIPS

83115

Humans

DreamSim

CLIP

DINO

LPIPS

33432

Humans

DreamSim

CLIP

DINO

LPIPS

66518

Humans

DreamSim

CLIP

DINO

LPIPS

12612

Humans

DreamSim

CLIP

DINO

LPIPS

39604

Humans

DreamSim

CLIP

DINO

LPIPS

57415

Humans

DreamSim

CLIP

DINO

LPIPS

54122

Humans

DreamSim

CLIP

DINO

LPIPS

6614

Humans

DreamSim

CLIP

DINO

LPIPS

16297

Humans

DreamSim

CLIP

DINO

LPIPS

71617

Humans

DreamSim

CLIP

DINO

LPIPS

51432

Humans

DreamSim

CLIP

DINO

LPIPS

12617

Humans

DreamSim

CLIP

DINO

LPIPS

36138

Humans

DreamSim

CLIP

DINO

LPIPS

57928

Humans

DreamSim

CLIP

DINO

LPIPS

40841

Humans

DreamSim

CLIP

DINO

LPIPS

87844

Humans

DreamSim

CLIP

DINO

LPIPS

98061

Humans

DreamSim

CLIP

DINO

LPIPS

75595

Humans

DreamSim

CLIP

DINO

LPIPS

96437

Humans

DreamSim

CLIP

DINO

LPIPS

87721

Humans

DreamSim

CLIP

DINO

LPIPS

53488

Humans

DreamSim

CLIP

DINO

LPIPS

51104

Humans

DreamSim

CLIP

DINO

LPIPS

38111

Humans

DreamSim

CLIP

DINO

LPIPS

40634

Humans

DreamSim

CLIP

DINO

LPIPS

36050

Humans

DreamSim

CLIP

DINO

LPIPS

63298

Humans

DreamSim

CLIP

DINO

LPIPS

69321

Humans

DreamSim

CLIP

DINO

LPIPS

96170

Humans

DreamSim

CLIP

DINO

LPIPS

17672

Humans

DreamSim

CLIP

DINO

LPIPS

97397

Humans

DreamSim

CLIP

DINO

LPIPS

80943

Humans

DreamSim

CLIP

DINO

LPIPS

11471

Humans

DreamSim

CLIP

DINO

LPIPS

59835

Humans

DreamSim

CLIP

DINO

LPIPS

84512

Humans

DreamSim

CLIP

DINO

LPIPS

6719

Humans

DreamSim

CLIP

DINO

LPIPS

18930

Humans

DreamSim

CLIP

DINO

LPIPS

8344

Humans

DreamSim

CLIP

DINO

LPIPS

27659

Humans

DreamSim

CLIP

DINO

LPIPS

52485

Humans

DreamSim

CLIP

DINO

LPIPS

90022

Humans

DreamSim

CLIP

DINO

LPIPS

95633

Humans

DreamSim

CLIP

DINO

LPIPS

48289

Humans

DreamSim

CLIP

DINO

LPIPS

30525

Humans

DreamSim

CLIP

DINO

LPIPS

36533

Humans

DreamSim

CLIP

DINO

LPIPS

34014

Humans

DreamSim

CLIP

DINO

LPIPS

36497

Humans

DreamSim

CLIP

DINO

LPIPS

18963

Humans

DreamSim

CLIP

DINO

LPIPS

16125

Humans

DreamSim

CLIP

DINO

LPIPS

32769

Humans

DreamSim

CLIP

DINO

LPIPS

24297

Humans

DreamSim

CLIP

DINO

LPIPS

15025

Humans

DreamSim

CLIP

DINO

LPIPS

31500

Humans

DreamSim

CLIP

DINO

LPIPS

6588

Humans

DreamSim

CLIP

DINO

LPIPS

16482

Humans

DreamSim

CLIP

DINO

LPIPS

36107

Humans

DreamSim

CLIP

DINO

LPIPS

4504

Humans

DreamSim

CLIP

DINO

LPIPS

34674

Humans

DreamSim

CLIP

DINO

LPIPS

13728

Humans

DreamSim

CLIP

DINO

LPIPS

33998

Humans

DreamSim

CLIP

DINO

LPIPS

4312

Humans

DreamSim

CLIP

DINO

LPIPS

15494

Humans

DreamSim

CLIP

DINO

LPIPS

9450

Humans

DreamSim

CLIP

DINO

LPIPS

5818

Humans

DreamSim

CLIP

DINO

LPIPS

- DreamSim-All Metrics Disagreement
- DreamSim-LPIPS Disagreement
- DreamSim-DINO Disagreement
- DreamSim-CLIP Disagreement
- Random

## Nearest Neighbor Visualizations

Nearest neighbor searches in ImageNet-R and COCO

Ours = DreamSim.

| LPIPS | DISTS | OpenCLIP | DINO | Ours
--- | --- | --- | --- | --- | ---
Input |  |  |  |  |
Nearest Neighbors |  |  |  |  |

| LPIPS | DISTS | OpenCLIP | DINO | Ours
--- | --- | --- | --- | --- | ---
Input |  |  |  |  |
Nearest Neighbors |  |  |  |  |

| LPIPS | DISTS | OpenCLIP | DINO | Ours
--- | --- | --- | --- | --- | ---
Input |  |  |  |  |
Nearest Neighbors |  |  |  |  |

| LPIPS | DISTS | OpenCLIP | DINO | Ours
--- | --- | --- | --- | --- | ---
Input |  |  |  |  |
Nearest Neighbors |  |  |  |  |

| LPIPS | DISTS | OpenCLIP | DINO | Ours
--- | --- | --- | --- | --- | ---
Input |  |  |  |  |
Nearest Neighbors |  |  |  |  |

| LPIPS | DISTS | OpenCLIP | DINO | Ours
--- | --- | --- | --- | --- | ---
Input |  |  |  |  |
Nearest Neighbors |  |  |  |  |

- Pizza Example
- Lighthouse Example
- Iguana Example
- Toucan Example

- Elephant Example
- Skier Example

## Inversion Visualizations

Inversion visualization using optimization, deep image prior, and guided diffusion.

Ours = DreamSim.

| Target | DINO | OpenCLIP | Ensemble | Ours
--- | --- | --- | --- | --- | ---
Run 1 |  |  |  |  |
Run 2 |  |  |  |  |
Run 3 |  |  |  |  |
Run 4 |  |  |  |  |
Run 5 |  |  |  |  |

| Target | DINO | OpenCLIP | Ensemble | Ours
--- | --- | --- | --- | --- | ---
Run 1 |  |  |  |  |
Run 2 |  |  |  |  |
Run 3 |  |  |  |  |
Run 4 |  |  |  |  |
Run 5 |  |  |  |  |

| Target | DINO | OpenCLIP | Ensemble | Ours
--- | --- | --- | --- | --- | ---
Run 1 |  |  |  |  |
Run 2 |  |  |  |  |
Run 3 |  |  |  |  |
Run 4 |  |  |  |  |
Run 5 |  |  |  |  |

| Target | DINO | OpenCLIP | Ensemble | Ours
--- | --- | --- | --- | --- | ---
Run 1 |  |  |  |  |
Run 2 |  |  |  |  |
Run 3 |  |  |  |  |
Run 4 |  |  |  |  |
Run 5 |  |  |  |  |

| Target | DINO | OpenCLIP | Ensemble | Ours
--- | --- | --- | --- | --- | ---
Run 1 |  |  |  |  |
Run 2 |  |  |  |  |
Run 3 |  |  |  |  |
Run 4 |  |  |  |  |
Run 5 |  |  |  |  |

| Target | DINO | OpenCLIP | Ensemble | Ours
--- | --- | --- | --- | --- | ---
Run 1 |  |  |  |  |
Run 2 |  |  |  |  |
Run 3 |  |  |  |  |
Run 4 |  |  |  |  |
Run 5 |  |  |  |  |

| Target | DINO | OpenCLIP | Ensemble | Ours
--- | --- | --- | --- | --- | ---
Run 1 |  |  |  |  |
Run 2 |  |  |  |  |
Run 3 |  |  |  |  |
Run 4 |  |  |  |  |
Run 5 |  |  |  |  |

| Target | DINO | OpenCLIP | Ensemble | Ours
--- | --- | --- | --- | --- | ---
Run 1 |  |  |  |  |
Run 2 |  |  |  |  |
Run 3 |  |  |  |  |
Run 4 |  |  |  |  |
Run 5 |  |  |  |  |

| Target | DINO | OpenCLIP | Ensemble | Ours
--- | --- | --- | --- | --- | ---
Run 1 |  |  |  |  |
Run 2 |  |  |  |  |
Run 3 |  |  |  |  |
Run 4 |  |  |  |  |
Run 5 |  |  |  |  |

- Optimization
- DIP Inversion
- Guided Diffusion

- Bunny Example
- Pizza Example
- Pyramid Example