frkhan/llm-web-scrapper at 57996a3f25cca47c1598539dba7c75c136b16f14

llm-web-scrapper

34.5 kB

2 contributors

History: 18 commits

frkhan

- Updated the system prompt to ask user to use different scraper if scraping has issue.

57996a3 about 2 months ago

.github
Update sync-to-hf.yml about 2 months ago
.dockerignore

25 Bytes

- Implemented scraping using Crawl4Ai. about 2 months ago
.env.example

254 Bytes

-- Fixed the package versions. about 2 months ago
.gitignore

312 Bytes

Initial commit for LLM-Web-Scrapper project. about 2 months ago
Dockerfile

319 Bytes

- Added docstring for the whole project about 2 months ago
Dockerfile.dev

348 Bytes

- Implemented scraping using Crawl4Ai. about 2 months ago
LICENSE

1.06 kB

Initial commit for LLM-Web-Scrapper project. about 2 months ago
README.md

7.24 kB

-- Added Disclaimer section to inform user of this project to be responsible while scraping websites. about 2 months ago
app.py

12.7 kB

-- Added Disclaimer section to inform user of this project to be responsible while scraping websites. about 2 months ago
config.py

1.54 kB

-- Fixed the package versions. about 2 months ago
crawl4ai_client.py

1.22 kB

- Added docstring for the whole project about 2 months ago
docker-compose.dev.yml

1.03 kB

- Added docstring for the whole project about 2 months ago
docker-compose.yml

809 Bytes

- Added docstring for the whole project about 2 months ago
firecrawl_client.py

2.62 kB

- Added docstring for the whole project about 2 months ago
llm_inference_service.py

3.93 kB

- Updated the system prompt to ask user to use different scraper if scraping has issue. about 2 months ago
requirements.txt

219 Bytes

-- Fixed the package versions. about 2 months ago
spaces.yaml

157 Bytes

-- Added URL, getting API info etc in Readme.md about 2 months ago