Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,62 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: mit
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
pipeline_tag: image-segmentation
|
| 4 |
+
library_name: pytorch
|
| 5 |
+
tags:
|
| 6 |
+
- point-cloud
|
| 7 |
+
- point-cloud-backbone
|
| 8 |
+
- graph-learning
|
| 9 |
+
- pytorch
|
| 10 |
+
authors:
|
| 11 |
+
- Yuanwen Yue
|
| 12 |
+
- Damien Robert
|
| 13 |
+
- Jianyuan Wang
|
| 14 |
+
- Sunghwan Hong
|
| 15 |
+
- Jan Dirk Wegner
|
| 16 |
+
- Christian Rupprecht
|
| 17 |
+
- Konrad Schindler
|
| 18 |
+
---
|
| 19 |
+
|
| 20 |
+
This repository contains model weights for **LitePT: Lighter Yet Stronger Point Transformer**, a lightweight, high-performance 3D point cloud architecture.
|
| 21 |
+
|
| 22 |
+
LitePT embodies the simple principle "convolutions for low-level geometry, attention for high-level relations" and strategically places only the required operations at each hierarchy level. LitePT is equipped with a novel, parameter-free 3D positional encoding, PointROPE. The resulting model achieves state-of-the-art performance while being significantly more efficient.
|
| 23 |
+
|
| 24 |
+
## Paper & Resources
|
| 25 |
+
- **Paper:** [LitePT: Lighter Yet Stronger Point Transformer](https://huggingface.co/papers/2512.13689)
|
| 26 |
+
- **Arxiv:** [https://arxiv.org/abs/2512.13689](https://arxiv.org/abs/2512.13689)
|
| 27 |
+
- **Project Page:** [https://litept.github.io/](https://litept.github.io/)
|
| 28 |
+
- **Codebase:** [https://github.com/prs-eth/LitePT](https://github.com/prs-eth/LitePT)
|
| 29 |
+
|
| 30 |
+
## Models
|
| 31 |
+
We release the pretrained model weights for the benchmarks we reported in our paper.
|
| 32 |
+
|
| 33 |
+
### Semantic segmentation
|
| 34 |
+
| Model | Params | Benchmark | val mIoU | Config | Checkpoint |
|
| 35 |
+
|:-|-:|:-:|:-:|:-:|:-:|
|
| 36 |
+
| LitePT-S | 12.7M | NuScenes | 82.2 | [link](https://github.com/prs-eth/LitePT/blob/main/configs/nuscenes/semseg-litept-small-v1m1.py) | [Download](https://huggingface.co/yuanwenyue/LitePT/blob/main/nuscenes-semseg-litept-small-v1m1/model/model_best.pth) |
|
| 37 |
+
| LitePT-S | 12.7M | Waymo | 73.1 |[link](https://github.com/prs-eth/LitePT/blob/main/configs/waymo/semseg-litept-small-v1m1.py) | [Download](https://huggingface.co/yuanwenyue/LitePT/blob/main/waymo-semseg-litept-small-v1m1/model/model_best.pth) |
|
| 38 |
+
| LitePT-S | 12.7M | ScanNet | 76.5 |[link](https://github.com/prs-eth/LitePT/blob/main/configs/scannet/semseg-litept-small-v1m1.py) | [Download](https://huggingface.co/yuanwenyue/LitePT/blob/main/scannet-semseg-litept-small-v1m1/model/model_best.pth) |
|
| 39 |
+
| LitePT-S | 12.7M | Structured3D | 83.6 | [link](https://github.com/prs-eth/LitePT/blob/main/configs/structured3d/semseg-litept-small-v1m1.py) | [Download](https://huggingface.co/yuanwenyue/LitePT/blob/main/structured3d-semseg-litept-small-v1m1/model/model_best.pth) |
|
| 40 |
+
| LitePT-B | 45.1M | Structured3D | 85.1 | [link](https://github.com/prs-eth/LitePT/blob/main/configs/structured3d/semseg-litept-base-v1m1.py) | [Download](https://huggingface.co/yuanwenyue/LitePT/blob/main/structured3d-semseg-litept-base-v1m1/model/model_best.pth) |
|
| 41 |
+
| LitePT-L | 85.9M | Structured3D | 85.4 | [link](https://github.com/prs-eth/LitePT/blob/main/configs/structured3d/semseg-litept-large-v1m1.py) | [Download](https://huggingface.co/yuanwenyue/LitePT/blob/main/structured3d-semseg-litept-large-v1m1/model/model_best.pth) |
|
| 42 |
+
|
| 43 |
+
### Instance segmentation
|
| 44 |
+
| Model | Params | Benchmark | mAP<sub>25</sub> | mAP<sub>50</sub> | mAP | Config | Checkpoint |
|
| 45 |
+
|:-|-:|:-:|:-:|:-:|:-:|:-:|:-:|
|
| 46 |
+
| LitePT-S* | 16.0M | ScanNet | 78.5 | 64.9 | 41.7 | [link](https://github.com/prs-eth/LitePT/blob/main/configs/scannet/insseg-litept-small-v1m2.py) | [Download](https://huggingface.co/yuanwenyue/LitePT/blob/main/scannet-insseg-litept-small-v1m2/model/model_best.pth) |
|
| 47 |
+
| LitePT-S* | 16.0M | ScanNet200 | 40.3 | 33.1 | 22.2 | [link](https://github.com/prs-eth/LitePT/blob/main/configs/scannet200/insseg-litept-small-v1m2.py) | [Download](https://huggingface.co/yuanwenyue/LitePT/blob/main/scannet200-insseg-litept-small-v1m2/model/model_best.pth) |
|
| 48 |
+
### Object detection
|
| 49 |
+
| Model | Params | Benchmark | mAPH | Config | Checkpoint |
|
| 50 |
+
|:-|-:|:-:|:-:|:-:|:-:|
|
| 51 |
+
| LitePT | 9.0M | Waymo | 70.7 | link | [Download](https://huggingface.co/yuanwenyue/LitePT/blob/main/waymo-objdet-litept-small-v1m3/model/model_best.pth) |
|
| 52 |
+
|
| 53 |
+
## Citation
|
| 54 |
+
|
| 55 |
+
```
|
| 56 |
+
@article{yuelitept2025,
|
| 57 |
+
title={{LitePT: Lighter Yet Stronger Point Transformer}},
|
| 58 |
+
author={Yue, Yuanwen and Robert, Damien and Wang, Jianyuan and Hong, Sunghwan and Wegner, Jan Dirk and Rupprecht, Christian and Schindler, Konrad},
|
| 59 |
+
journal={arXiv preprint arXiv:2512.13689},
|
| 60 |
+
year={2025}
|
| 61 |
+
}
|
| 62 |
+
```
|