Vivien Chappelier
commited on
Commit
·
07b7207
1
Parent(s):
eb16299
detection + robustness info
Browse files
README.md
CHANGED
|
@@ -24,4 +24,66 @@ vae = AutoencoderKL.from_pretrained("imatag/stable-signature-bzh-sdxl-vae-medium
|
|
| 24 |
pipe = StableDiffusionXLPipeline.from_pretrained(model, vae=vae)
|
| 25 |
```
|
| 26 |
|
| 27 |
-
For more information, please have a look at [the official demo](https://huggingface.co/spaces/imatag/stable-signature-bzh)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 24 |
pipe = StableDiffusionXLPipeline.from_pretrained(model, vae=vae)
|
| 25 |
```
|
| 26 |
|
| 27 |
+
For more information, please have a look at [the official demo](https://huggingface.co/spaces/imatag/stable-signature-bzh)
|
| 28 |
+
|
| 29 |
+
## Decoder Finetuning
|
| 30 |
+
|
| 31 |
+
This model was finetuned from the original StableDiffusion-XL autoencoder with the additional objective of including a medium invisible watermark, following the procedure of [StableSignature](https://ai.meta.com/blog/stable-signature-watermarking-generative-ai/). This watermark is detectable by [IMATAG](https://www.imatag.com/)'s demo BZH decoder, available via API.
|
| 32 |
+
|
| 33 |
+
## Detecting the watermark
|
| 34 |
+
|
| 35 |
+
For security reasons we cannot release the weights of the detector. Instead, you may check for the presence of a watermark with the [detect_api.py](https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/detect_api.py) script like this:
|
| 36 |
+
```shell
|
| 37 |
+
python detect_api.py test.png
|
| 38 |
+
```
|
| 39 |
+
|
| 40 |
+
### Visual
|
| 41 |
+
_Visualization of watermark impact on 512x512 images from the COCO2017 validation dataset prompts with SDXL-turbo._
|
| 42 |
+
|
| 43 |
+
<p align="center">
|
| 44 |
+
<br>
|
| 45 |
+
<b>
|
| 46 |
+
512x512: original (left), watermarked (middle), difference (right)</b>
|
| 47 |
+
</p>
|
| 48 |
+
|
| 49 |
+
<p align="center">
|
| 50 |
+
<img src=https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/eval/medium/0001.png />
|
| 51 |
+
</p>
|
| 52 |
+
|
| 53 |
+
<p align="center">
|
| 54 |
+
<img src=https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/eval/medium/0003.png />
|
| 55 |
+
</p>
|
| 56 |
+
|
| 57 |
+
<p align="center">
|
| 58 |
+
<img src=https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/eval/medium/0004.png />
|
| 59 |
+
</p>
|
| 60 |
+
|
| 61 |
+
<p align="center">
|
| 62 |
+
<img src=https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/eval/medium/0005.png />
|
| 63 |
+
</p>
|
| 64 |
+
|
| 65 |
+
<p align="center">
|
| 66 |
+
<img src=https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/eval/medium/0006.png />
|
| 67 |
+
</p>
|
| 68 |
+
|
| 69 |
+
### Robustness
|
| 70 |
+
|
| 71 |
+
The watermark is robust to most editorial changes to an image, such as cropping, changing brightness or contrast, resizing or JPEG compression:
|
| 72 |
+
|
| 73 |
+
<p align="center">
|
| 74 |
+
<br>
|
| 75 |
+
<b>
|
| 76 |
+
from left to right: original, watermarked, difference, 'crop 50% + brigthen 50% + jpeg 80%' attack, 'downscale 2x + crop 50% + brigthen 50% + jpeg 50%' attack</b>
|
| 77 |
+
</p>
|
| 78 |
+
|
| 79 |
+
<p align="center">
|
| 80 |
+
<img src=https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/eval/medium/0000.png />
|
| 81 |
+
</p>
|
| 82 |
+
|
| 83 |
+
The Receiver Operating Characteristic curve shows its performance under no modification and when modified by the two scenarios illustrated above:
|
| 84 |
+
<p align="center">
|
| 85 |
+
<img src=https://huggingface.co/spaces/imatag/stable-signature-bzh/resolve/main/eval/medium/roc.png />
|
| 86 |
+
</p>
|
| 87 |
+
|
| 88 |
+
More details available in our [announcement](https://www.imatag.com/blog/unlocking-the-future-of-content-authentication-imatags-breakthrough-in-ai-generated-image-watermarking) and our lab's [blog post](https://imatag-lab.medium.com/stable-signature-meets-bzh-53ad0ba13691).
|
| 89 |
+
For watermarked models with a different key, support for payload, other perceptual compromises, robustness to other attacks, or faster detection, please [contact IMATAG](https://pages.imatag.com/contact-us-imatag).
|